2024-09-10T05:01:13.852 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T05:01:13.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T05:01:13.949 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898693 branch: wip-rgw-meta-handlers description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7898693' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9786 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ5NbsnnEacvrlVa6LYV3NgVuQckrqTL/Apy94WcCydkzIqQZgfsW8K8Pm2s5yVM0sg0TIshO0v6uVwd6ehR7+0= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDJBwrjo41wEcJGd+1W1PPYGqT1W/ICfaMIuiU69E3Z95/I5j5U9Y/TpEqLewClKNh2QQkRjepA8oRenQWeC7Cs= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_03:21:45 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T05:01:13.949 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-10T05:01:13.950 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-10T05:01:13.950 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T05:01:13.952 INFO:teuthology.task.internal:Checking packages... 2024-09-10T05:01:13.974 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-10T05:01:13.974 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T05:01:13.974 INFO:teuthology.packaging:ref: None 2024-09-10T05:01:13.974 INFO:teuthology.packaging:tag: None 2024-09-10T05:01:13.974 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-10T05:01:13.974 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T05:01:13.975 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-10T05:01:14.126 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762.gbad475c1 2024-09-10T05:01:14.128 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T05:01:14.137 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T05:01:14.137 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T05:01:14.152 INFO:teuthology.task.internal:Saving configuration 2024-09-10T05:01:14.165 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T05:01:14.177 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T05:01:14.198 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898693', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 04:56:16.836965', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ5NbsnnEacvrlVa6LYV3NgVuQckrqTL/Apy94WcCydkzIqQZgfsW8K8Pm2s5yVM0sg0TIshO0v6uVwd6ehR7+0='} 2024-09-10T05:01:14.217 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898693', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 04:56:16.838631', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDJBwrjo41wEcJGd+1W1PPYGqT1W/ICfaMIuiU69E3Z95/I5j5U9Y/TpEqLewClKNh2QQkRjepA8oRenQWeC7Cs='} 2024-09-10T05:01:14.217 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T05:01:14.226 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-10T05:01:14.226 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-10T05:01:14.226 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T05:01:14.285 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3d1ee1bac0>, signals=[15]) 2024-09-10T05:01:14.285 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T05:01:14.297 INFO:teuthology.task.internal:Opening connections... 2024-09-10T05:01:14.297 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-09-10T05:01:14.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:01:14.375 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2024-09-10T05:01:14.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:01:14.449 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T05:01:14.461 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-09-10T05:01:14.479 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-09-10T05:01:14.479 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-09-10T05:01:14.537 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2024-09-10T05:01:14.537 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2024-09-10T05:01:14.537 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2024-09-10T05:01:14.537 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2024-09-10T05:01:14.537 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2024-09-10T05:01:14.537 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2024-09-10T05:01:14.537 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T05:01:14.537 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2024-09-10T05:01:14.537 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2024-09-10T05:01:14.537 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T05:01:14.538 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2024-09-10T05:01:14.538 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T05:01:14.538 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T05:01:14.538 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T05:01:14.538 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-09-10T05:01:14.642 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-09-10T05:01:14.661 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-09-10T05:01:14.662 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-09-10T05:01:14.720 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-09-10T05:01:14.720 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-09-10T05:01:14.720 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-09-10T05:01:14.720 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-09-10T05:01:14.720 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-09-10T05:01:14.720 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-09-10T05:01:14.720 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T05:01:14.720 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-09-10T05:01:14.721 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-09-10T05:01:14.721 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T05:01:14.721 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-09-10T05:01:14.721 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T05:01:14.721 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T05:01:14.721 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T05:01:14.721 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-09-10T05:01:14.818 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T05:01:14.832 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T05:01:14.847 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T05:01:14.848 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-09-10T05:01:14.850 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2024-09-10T05:01:14.867 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T05:01:14.878 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T05:01:14.879 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-09-10T05:01:14.908 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2024-09-10T05:01:14.934 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T05:01:14.981 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T05:01:14.996 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T05:01:14.997 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T05:01:14.997 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T05:01:14.997 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T05:01:15.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:01:15.015 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-10T05:01:15.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:01:15.016 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-09-10T05:01:15.072 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-503.el9.x86_64 2024-09-10T05:01:15.072 INFO:teuthology.task.kernel:Running kernel on smithi139: 5.14.0-503.el9.x86_64 2024-09-10T05:01:15.072 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum install -y kernel 2024-09-10T05:01:15.073 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-503.el9.x86_64 2024-09-10T05:01:15.074 INFO:teuthology.task.kernel:Running kernel on smithi192: 5.14.0-503.el9.x86_64 2024-09-10T05:01:15.074 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum install -y kernel 2024-09-10T05:01:19.022 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.2 MB 00:02 2024-09-10T05:01:19.743 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-10T05:01:20.905 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-10T05:01:21.886 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-10T05:01:26.614 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-10T05:01:26.628 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 6.5 MB 00:00 2024-09-10T05:01:28.037 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 19 kB 00:00 2024-09-10T05:01:28.064 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-10T05:01:28.859 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-10T05:01:29.301 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-10T05:01:34.281 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-10T05:01:34.707 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T05:01:36.321 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T05:01:36.321 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T05:01:36.410 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:01:36.421 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:01:36.421 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2024-09-10T05:01:36.421 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:01:36.421 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:01:36.421 INFO:teuthology.orchestra.run.smithi192.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T05:01:36.421 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-10T05:01:36.422 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T05:01:36.422 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T05:01:36.422 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T05:01:36.422 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:01:36.422 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:01:36.422 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:01:36.422 INFO:teuthology.orchestra.run.smithi192.stdout:Install 4 Packages 2024-09-10T05:01:36.422 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:01:36.423 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 79 M 2024-09-10T05:01:36.423 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 126 M 2024-09-10T05:01:36.423 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:01:36.730 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T05:01:36.730 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T05:01:36.815 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:01:36.824 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:01:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-09-10T05:01:36.824 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:01:36.824 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:01:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T05:01:36.825 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-10T05:01:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T05:01:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T05:01:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T05:01:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:01:36.825 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:01:36.825 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:01:36.825 INFO:teuthology.orchestra.run.smithi139.stdout:Install 4 Packages 2024-09-10T05:01:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:01:36.826 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 79 M 2024-09-10T05:01:36.826 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 126 M 2024-09-10T05:01:36.826 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:01:37.697 INFO:teuthology.orchestra.run.smithi139.stdout:[MIRROR] kernel-core-5.14.0-505.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-505.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-10T05:01:37.721 INFO:teuthology.orchestra.run.smithi139.stdout:[MIRROR] kernel-modules-5.14.0-505.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-505.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-10T05:01:37.727 INFO:teuthology.orchestra.run.smithi139.stdout:[MIRROR] kernel-5.14.0-505.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-505.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-10T05:01:37.929 INFO:teuthology.orchestra.run.smithi139.stdout:[MIRROR] kernel-modules-5.14.0-505.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-505.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-10T05:01:37.934 INFO:teuthology.orchestra.run.smithi139.stdout:[MIRROR] kernel-core-5.14.0-505.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-505.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-10T05:01:37.946 INFO:teuthology.orchestra.run.smithi139.stdout:[MIRROR] kernel-5.14.0-505.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-505.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-10T05:01:38.025 INFO:teuthology.orchestra.run.smithi139.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 46 kB/s | 23 kB 00:00 2024-09-10T05:01:38.323 INFO:teuthology.orchestra.run.smithi139.stdout:[MIRROR] kernel-modules-core-5.14.0-505.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-505.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-10T05:01:38.491 INFO:teuthology.orchestra.run.smithi139.stdout:[MIRROR] kernel-modules-core-5.14.0-505.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-505.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-10T05:01:39.834 INFO:teuthology.orchestra.run.smithi139.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 16 MB/s | 29 MB 00:01 2024-09-10T05:01:40.400 INFO:teuthology.orchestra.run.smithi139.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 12 MB/s | 35 MB 00:02 2024-09-10T05:01:40.617 INFO:teuthology.orchestra.run.smithi139.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.1 MB/s | 16 MB 00:03 2024-09-10T05:01:40.620 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:01:40.621 INFO:teuthology.orchestra.run.smithi139.stdout:Total 21 MB/s | 79 MB 00:03 2024-09-10T05:01:41.298 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:01:41.399 INFO:teuthology.orchestra.run.smithi192.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 227 kB/s | 23 kB 00:00 2024-09-10T05:01:41.661 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:01:41.661 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:01:42.607 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:01:42.607 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:01:43.716 INFO:teuthology.orchestra.run.smithi192.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.5 MB/s | 16 MB 00:02 2024-09-10T05:01:45.071 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:01:45.149 INFO:teuthology.orchestra.run.smithi192.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 7.6 MB/s | 29 MB 00:03 2024-09-10T05:01:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T05:01:45.950 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T05:01:48.737 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T05:01:48.870 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T05:01:49.107 INFO:teuthology.orchestra.run.smithi192.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 4.4 MB/s | 35 MB 00:07 2024-09-10T05:01:49.107 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:01:49.108 INFO:teuthology.orchestra.run.smithi192.stdout:Total 6.2 MB/s | 79 MB 00:12 2024-09-10T05:01:49.797 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:01:50.144 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:01:50.144 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:01:51.103 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:01:51.104 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:01:53.641 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:01:53.725 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T05:01:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T05:01:54.353 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T05:01:54.434 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T05:01:57.276 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T05:01:57.413 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T05:01:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T05:02:02.218 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T05:02:02.257 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T05:02:07.123 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T05:02:36.953 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T05:02:36.993 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T05:02:37.348 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T05:02:37.348 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T05:02:37.348 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T05:02:37.348 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T05:02:38.174 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T05:02:38.174 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:02:38.174 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:02:38.174 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T05:02:38.174 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T05:02:38.174 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T05:02:38.174 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T05:02:38.174 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:02:38.174 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:02:38.533 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T05:02:38.621 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T05:02:38.622 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T05:02:38.622 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T05:02:38.622 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T05:02:38.622 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T05:02:38.622 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T05:02:38.622 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi139.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T05:02:38.622 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T05:02:38.681 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T05:02:38.681 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T05:02:38.682 DEBUG:teuthology.orchestra.run.smithi139:> sudo rpm -qi grub2-tools 2024-09-10T05:02:38.722 INFO:teuthology.orchestra.run.smithi139.stdout:Name : grub2-tools 2024-09-10T05:02:38.722 INFO:teuthology.orchestra.run.smithi139.stdout:Epoch : 1 2024-09-10T05:02:38.722 INFO:teuthology.orchestra.run.smithi139.stdout:Version : 2.06 2024-09-10T05:02:38.722 INFO:teuthology.orchestra.run.smithi139.stdout:Release : 82.el9 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: x86_64 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:Group : Unspecified 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:Size : 8274670 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:License : GPLv3+ 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:Packager : builder@centos.org 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:Vendor : CentOS 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:Summary : Support tools for GRUB. 2024-09-10T05:02:38.723 INFO:teuthology.orchestra.run.smithi139.stdout:Description : 2024-09-10T05:02:38.724 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:02:38.724 INFO:teuthology.orchestra.run.smithi139.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T05:02:38.724 INFO:teuthology.orchestra.run.smithi139.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T05:02:38.724 INFO:teuthology.orchestra.run.smithi139.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T05:02:38.724 INFO:teuthology.orchestra.run.smithi139.stdout:hardware devices. 2024-09-10T05:02:38.724 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:02:38.724 INFO:teuthology.orchestra.run.smithi139.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T05:02:38.725 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T05:02:38.725 INFO:teuthology.task.kernel:Updating grub on smithi139 to boot 5.14.0-505.el9.x86_64 2024-09-10T05:02:38.725 DEBUG:teuthology.orchestra.run.smithi139:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T05:02:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2024-09-10T05:02:40.596 INFO:teuthology.orchestra.run.smithi139.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T05:02:40.636 INFO:teuthology.orchestra.run.smithi139.stderr:done 2024-09-10T05:02:40.638 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-09-10T05:02:40.654 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.SL4KbfUhjF 2024-09-10T05:02:40.654 DEBUG:teuthology.orchestra.run.smithi139:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SL4KbfUhjF 2024-09-10T05:02:40.721 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.SL4KbfUhjF 2024-09-10T05:02:40.863 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.SL4KbfUhjF is 6KB 2024-09-10T05:02:40.883 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.SL4KbfUhjF 2024-09-10T05:02:40.898 DEBUG:teuthology.orchestra.run.smithi139:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T05:02:40.960 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T05:02:40.961 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T05:02:40.961 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T05:02:40.961 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T05:02:40.962 DEBUG:teuthology.orchestra.run.smithi139:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T05:02:41.127 DEBUG:teuthology.orchestra.run.smithi139:> sudo shutdown -r now 2024-09-10T05:02:45.416 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T05:02:45.456 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T05:02:45.773 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T05:02:45.773 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T05:02:45.773 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T05:02:45.773 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T05:02:46.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T05:02:46.651 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:02:46.651 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:02:46.651 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T05:02:46.651 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T05:02:46.651 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T05:02:46.651 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T05:02:46.651 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:02:46.651 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:02:47.011 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T05:02:47.090 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T05:02:47.090 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T05:02:47.090 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T05:02:47.090 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T05:02:47.090 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T05:02:47.090 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-10T05:02:47.090 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T05:02:47.091 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T05:02:47.147 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T05:02:47.148 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T05:02:47.148 DEBUG:teuthology.orchestra.run.smithi192:> sudo rpm -qi grub2-tools 2024-09-10T05:02:47.180 INFO:teuthology.orchestra.run.smithi192.stdout:Name : grub2-tools 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:Epoch : 1 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:Version : 2.06 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:Release : 82.el9 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: x86_64 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:Group : Unspecified 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:Size : 8274670 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:License : GPLv3+ 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T05:02:47.181 INFO:teuthology.orchestra.run.smithi192.stdout:Packager : builder@centos.org 2024-09-10T05:02:47.182 INFO:teuthology.orchestra.run.smithi192.stdout:Vendor : CentOS 2024-09-10T05:02:47.182 INFO:teuthology.orchestra.run.smithi192.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T05:02:47.182 INFO:teuthology.orchestra.run.smithi192.stdout:Summary : Support tools for GRUB. 2024-09-10T05:02:47.182 INFO:teuthology.orchestra.run.smithi192.stdout:Description : 2024-09-10T05:02:47.182 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:02:47.182 INFO:teuthology.orchestra.run.smithi192.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T05:02:47.182 INFO:teuthology.orchestra.run.smithi192.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T05:02:47.182 INFO:teuthology.orchestra.run.smithi192.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T05:02:47.182 INFO:teuthology.orchestra.run.smithi192.stdout:hardware devices. 2024-09-10T05:02:47.182 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:02:47.182 INFO:teuthology.orchestra.run.smithi192.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T05:02:47.183 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T05:02:47.183 INFO:teuthology.task.kernel:Updating grub on smithi192 to boot 5.14.0-505.el9.x86_64 2024-09-10T05:02:47.183 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T05:02:47.832 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2024-09-10T05:02:49.193 INFO:teuthology.orchestra.run.smithi192.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T05:02:49.208 INFO:teuthology.orchestra.run.smithi192.stderr:done 2024-09-10T05:02:49.211 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-09-10T05:02:49.226 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.9WgJNTYsLq 2024-09-10T05:02:49.226 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9WgJNTYsLq 2024-09-10T05:02:49.293 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.9WgJNTYsLq 2024-09-10T05:02:49.431 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.9WgJNTYsLq is 6KB 2024-09-10T05:02:49.479 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.9WgJNTYsLq 2024-09-10T05:02:49.494 DEBUG:teuthology.orchestra.run.smithi192:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T05:02:49.557 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T05:02:49.558 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T05:02:49.558 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T05:02:49.558 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T05:02:49.559 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T05:02:49.701 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2024-09-10T05:03:11.151 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T05:03:11.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-10T05:03:11.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:03:19.711 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-10T05:03:19.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-10T05:03:19.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:03:29.597 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-10T05:03:38.045 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-10T05:03:38.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-10T05:03:38.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:03:41.661 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-10T05:03:47.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-10T05:03:47.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:03:50.109 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-10T05:03:53.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-10T05:03:53.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:04:02.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-10T05:04:02.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:04:25.451 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-10T05:04:25.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-10T05:04:25.945 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-10T05:04:25.945 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-10T05:04:25.961 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-505.el9.x86_64 2024-09-10T05:04:25.962 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T05:04:25.962 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T05:04:25.962 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T05:04:26.963 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T05:04:26.964 DEBUG:teuthology.orchestra.run.smithi139:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T05:04:27.111 INFO:teuthology.orchestra.run.smithi139.stdout:ttyS1 2024-09-10T05:04:27.135 DEBUG:teuthology.parallel:result is None 2024-09-10T05:04:33.936 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-10T05:04:34.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-10T05:04:34.343 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-10T05:04:34.343 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-09-10T05:04:34.402 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-505.el9.x86_64 2024-09-10T05:04:34.403 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T05:04:34.403 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T05:04:34.403 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T05:04:35.403 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-10T05:04:35.404 DEBUG:teuthology.orchestra.run.smithi192:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T05:04:35.531 INFO:teuthology.orchestra.run.smithi192.stdout:ttyS1 2024-09-10T05:04:35.560 DEBUG:teuthology.parallel:result is None 2024-09-10T05:04:35.560 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T05:04:35.569 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T05:04:35.569 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T05:04:35.572 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T05:04:35.607 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T05:04:35.614 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T05:04:35.626 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T05:04:35.626 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T05:04:35.631 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T05:04:35.753 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T05:04:35.762 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T05:04:35.763 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T05:04:35.766 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T05:04:35.797 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T05:04:35.809 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T05:04:35.835 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T05:04:35.852 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T05:04:35.855 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T05:04:35.861 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T05:04:35.861 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T05:04:35.864 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T05:04:35.922 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T05:04:35.930 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T05:04:35.931 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T05:04:35.933 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T05:04:35.985 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T05:04:36.030 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T05:04:36.084 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T05:04:36.166 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T05:04:36.209 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:04:36.209 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T05:04:36.275 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T05:04:36.316 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T05:04:36.463 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T05:04:36.507 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T05:04:36.549 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:04:36.549 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T05:04:36.618 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-09-10T05:04:36.620 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2024-09-10T05:04:36.666 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T05:04:36.778 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T05:04:37.034 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T05:04:37.044 INFO:teuthology.task.internal:Starting timer... 2024-09-10T05:04:37.045 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T05:04:37.062 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T05:04:37.076 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2024-09-10T05:04:37.135 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2024-09-10T05:04:37.137 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2024-09-10T05:04:37.180 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2024-09-10T05:04:37.182 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T05:04:37.182 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2024-09-10T05:04:37.217 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2024-09-10T05:04:37.217 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2024-09-10T05:04:37.243 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2024-09-10T05:04:37.243 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi139.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2024-09-10T05:04:37.243 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T05:04:37.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:04:37.285 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T05:04:37.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:04:37.311 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T05:04:37.312 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2024-09-10T05:04:37.363 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2024-09-10T05:04:37.399 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T05:04:37.410 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T05:04:37.422 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T05:04:37.423 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi139.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T05:08:18.822 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi139.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2024-09-10T05:08:18.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-10T05:08:18.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:08:18.915 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-10T05:08:18.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-10T05:08:18.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-10T05:08:18.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:08:19.066 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-10T05:08:19.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-10T05:08:19.099 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T05:08:19.109 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T05:08:19.110 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T05:08:19.110 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T05:08:19.113 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T05:08:19.113 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T05:08:19.140 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T05:08:19.154 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T05:08:19.169 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T05:08:19.178 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2024-09-10T05:08:19.182 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T05:08:19.189 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2024-09-10T05:08:19.204 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T05:08:19.207 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2024-09-10T05:08:19.218 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T05:08:19.218 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2024-09-10T05:08:19.232 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T05:08:19.246 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T05:08:19.279 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-09-10T05:08:19.282 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T05:08:19.283 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-09-10T05:08:19.283 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T05:08:19.283 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T05:08:19.283 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T05:08:19.283 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T05:08:19.309 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-10T05:08:19.313 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T05:08:19.313 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-10T05:08:19.313 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T05:08:19.313 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T05:08:19.313 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T05:08:19.313 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T05:08:19.313 INFO:teuthology.run_tasks:Running task install... 2024-09-10T05:08:19.322 DEBUG:teuthology.task.install:project ceph 2024-09-10T05:08:19.322 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-10T05:08:19.323 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-10T05:08:19.323 INFO:teuthology.task.install:Using flavor: default 2024-09-10T05:08:19.328 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T05:08:19.329 INFO:teuthology.task.install:extra packages: [] 2024-09-10T05:08:19.329 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-10T05:08:19.330 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T05:08:19.331 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-10T05:08:19.332 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T05:08:19.477 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-10T05:08:19.477 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-10T05:08:19.488 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-10T05:08:19.488 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-10T05:08:19.586 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T05:08:19.587 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:08:19.587 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T05:08:19.597 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T05:08:19.597 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:08:19.597 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T05:08:19.613 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T05:08:19.613 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T05:08:19.622 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T05:08:19.622 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T05:08:19.679 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T05:08:19.689 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T05:08:19.755 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T05:08:19.765 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T05:08:19.819 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2024-09-10T05:08:19.821 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2024-09-10T05:08:19.829 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2024-09-10T05:08:19.830 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2024-09-10T05:08:20.048 INFO:teuthology.orchestra.run.smithi139.stdout:45 files removed 2024-09-10T05:08:20.062 INFO:teuthology.orchestra.run.smithi192.stdout:45 files removed 2024-09-10T05:08:20.076 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw 2024-09-10T05:08:20.089 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw 2024-09-10T05:08:20.636 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-10T05:08:20.643 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-10T05:08:20.912 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-10T05:08:20.935 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-10T05:08:21.187 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T05:08:21.202 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-10T05:08:22.927 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-10T05:08:25.146 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.2 MB 00:03 2024-09-10T05:08:26.329 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 20 MB 00:02 2024-09-10T05:08:28.200 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-10T05:08:32.129 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-10T05:08:33.673 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-10T05:08:33.779 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-10T05:08:34.734 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-10T05:08:35.432 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-10T05:08:36.461 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-10T05:08:40.198 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-10T05:08:41.933 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-10T05:08:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:08:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:08:42.616 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-10T05:08:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:08:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:08:42.616 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-10T05:08:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2024-09-10T05:08:42.616 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-10T05:08:42.616 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-10T05:08:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-10T05:08:42.616 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T05:08:42.616 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-10T05:08:42.616 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-10T05:08:42.616 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-10T05:08:42.617 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T05:08:42.617 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T05:08:42.617 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T05:08:42.617 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-10T05:08:42.617 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T05:08:42.617 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T05:08:42.617 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T05:08:42.617 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-10T05:08:42.617 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T05:08:42.617 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-10T05:08:42.617 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T05:08:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:Installing weak dependencies: 2024-09-10T05:08:42.619 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T05:08:42.619 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:08:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:08:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:08:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:Install 30 Packages 2024-09-10T05:08:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 2 Packages 2024-09-10T05:08:42.619 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:08:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 61 M 2024-09-10T05:08:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:08:43.399 INFO:teuthology.orchestra.run.smithi192.stdout:(1/32): ceph-base-19.3.0-4762.gbad475c1.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-10T05:08:43.466 INFO:teuthology.orchestra.run.smithi192.stdout:(2/32): ceph-selinux-19.3.0-4762.gbad475c1.el9. 377 kB/s | 25 kB 00:00 2024-09-10T05:08:43.557 INFO:teuthology.orchestra.run.smithi192.stdout:(3/32): libcephfs2-19.3.0-4762.gbad475c1.el9.x8 8.1 MB/s | 756 kB 00:00 2024-09-10T05:08:43.641 INFO:teuthology.orchestra.run.smithi192.stdout:(4/32): libradosstriper1-19.3.0-4762.gbad475c1. 6.0 MB/s | 508 kB 00:00 2024-09-10T05:08:43.766 INFO:teuthology.orchestra.run.smithi192.stdout:(5/32): ceph-radosgw-19.3.0-4762.gbad475c1.el9. 12 MB/s | 11 MB 00:00 2024-09-10T05:08:43.825 INFO:teuthology.orchestra.run.smithi192.stdout:(6/32): python3-ceph-argparse-19.3.0-4762.gbad4 777 kB/s | 45 kB 00:00 2024-09-10T05:08:44.075 INFO:teuthology.orchestra.run.smithi192.stdout:(7/32): ceph-common-19.3.0-4762.gbad475c1.el9.x 18 MB/s | 22 MB 00:01 2024-09-10T05:08:44.100 INFO:teuthology.orchestra.run.smithi192.stdout:(8/32): python3-ceph-common-19.3.0-4762.gbad475 520 kB/s | 143 kB 00:00 2024-09-10T05:08:44.126 INFO:teuthology.orchestra.run.smithi192.stdout:(9/32): python3-cephfs-19.3.0-4762.gbad475c1.el 3.2 MB/s | 161 kB 00:00 2024-09-10T05:08:44.160 INFO:teuthology.orchestra.run.smithi192.stdout:(10/32): python3-rados-19.3.0-4762.gbad475c1.el 5.4 MB/s | 321 kB 00:00 2024-09-10T05:08:44.235 INFO:teuthology.orchestra.run.smithi192.stdout:(11/32): librgw2-19.3.0-4762.gbad475c1.el9.x86_ 9.3 MB/s | 5.5 MB 00:00 2024-09-10T05:08:44.277 INFO:teuthology.orchestra.run.smithi192.stdout:(12/32): python3-rgw-19.3.0-4762.gbad475c1.el9. 851 kB/s | 99 kB 00:00 2024-09-10T05:08:44.302 INFO:teuthology.orchestra.run.smithi192.stdout:(13/32): python3-rbd-19.3.0-4762.gbad475c1.el9. 1.7 MB/s | 305 kB 00:00 2024-09-10T05:08:44.310 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:08:44.341 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:08:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-10T05:08:44.341 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:08:44.341 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:08:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-10T05:08:44.341 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2024-09-10T05:08:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-10T05:08:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-10T05:08:44.341 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-10T05:08:44.341 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T05:08:44.342 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T05:08:44.343 INFO:teuthology.orchestra.run.smithi139.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T05:08:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T05:08:44.344 INFO:teuthology.orchestra.run.smithi139.stdout:Installing weak dependencies: 2024-09-10T05:08:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T05:08:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:08:44.344 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:08:44.344 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:08:44.344 INFO:teuthology.orchestra.run.smithi139.stdout:Install 30 Packages 2024-09-10T05:08:44.344 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 2 Packages 2024-09-10T05:08:44.344 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:08:44.345 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 61 M 2024-09-10T05:08:44.345 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:08:44.436 INFO:teuthology.orchestra.run.smithi192.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 533 kB/s | 107 kB 00:00 2024-09-10T05:08:44.461 INFO:teuthology.orchestra.run.smithi192.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 286 kB/s | 45 kB 00:00 2024-09-10T05:08:44.495 INFO:teuthology.orchestra.run.smithi192.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 736 kB/s | 160 kB 00:00 2024-09-10T05:08:44.553 INFO:teuthology.orchestra.run.smithi192.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 727 kB/s | 42 kB 00:00 2024-09-10T05:08:44.578 INFO:teuthology.orchestra.run.smithi192.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-10T05:08:44.604 INFO:teuthology.orchestra.run.smithi192.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-10T05:08:44.654 INFO:teuthology.orchestra.run.smithi192.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-09-10T05:08:44.679 INFO:teuthology.orchestra.run.smithi192.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 357 kB/s | 36 kB 00:00 2024-09-10T05:08:44.704 INFO:teuthology.orchestra.run.smithi192.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-09-10T05:08:44.763 INFO:teuthology.orchestra.run.smithi192.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.8 MB/s | 309 kB 00:00 2024-09-10T05:08:44.789 INFO:teuthology.orchestra.run.smithi192.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-09-10T05:08:44.814 INFO:teuthology.orchestra.run.smithi192.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 970 kB/s | 49 kB 00:00 2024-09-10T05:08:44.839 INFO:teuthology.orchestra.run.smithi192.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-10T05:08:44.881 INFO:teuthology.orchestra.run.smithi192.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-10T05:08:44.914 INFO:teuthology.orchestra.run.smithi192.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-10T05:08:44.998 INFO:teuthology.orchestra.run.smithi192.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-10T05:08:45.026 INFO:teuthology.orchestra.run.smithi139.stdout:(1/32): ceph-base-19.3.0-4762.gbad475c1.el9.x86 9.7 MB/s | 5.5 MB 00:00 2024-09-10T05:08:45.090 INFO:teuthology.orchestra.run.smithi192.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-10T05:08:45.093 INFO:teuthology.orchestra.run.smithi139.stdout:(2/32): ceph-selinux-19.3.0-4762.gbad475c1.el9. 377 kB/s | 25 kB 00:00 2024-09-10T05:08:45.269 INFO:teuthology.orchestra.run.smithi139.stdout:(3/32): ceph-radosgw-19.3.0-4762.gbad475c1.el9. 13 MB/s | 11 MB 00:00 2024-09-10T05:08:45.282 INFO:teuthology.orchestra.run.smithi192.stdout:(31/32): librados2-19.3.0-4762.gbad475c1.el9.x8 9.4 MB/s | 3.5 MB 00:00 2024-09-10T05:08:45.304 INFO:teuthology.orchestra.run.smithi139.stdout:(4/32): libcephfs2-19.3.0-4762.gbad475c1.el9.x8 3.5 MB/s | 756 kB 00:00 2024-09-10T05:08:45.346 INFO:teuthology.orchestra.run.smithi139.stdout:(5/32): libradosstriper1-19.3.0-4762.gbad475c1. 6.4 MB/s | 508 kB 00:00 2024-09-10T05:08:45.357 INFO:teuthology.orchestra.run.smithi192.stdout:(32/32): librbd1-19.3.0-4762.gbad475c1.el9.x86_ 9.0 MB/s | 3.2 MB 00:00 2024-09-10T05:08:45.363 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:08:45.363 INFO:teuthology.orchestra.run.smithi192.stdout:Total 22 MB/s | 61 MB 00:02 2024-09-10T05:08:45.421 INFO:teuthology.orchestra.run.smithi139.stdout:(6/32): python3-ceph-argparse-19.3.0-4762.gbad4 602 kB/s | 45 kB 00:00 2024-09-10T05:08:45.471 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:08:45.504 INFO:teuthology.orchestra.run.smithi139.stdout:(7/32): python3-ceph-common-19.3.0-4762.gbad475 1.7 MB/s | 143 kB 00:00 2024-09-10T05:08:45.506 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:08:45.506 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:08:45.730 INFO:teuthology.orchestra.run.smithi139.stdout:(8/32): ceph-common-19.3.0-4762.gbad475c1.el9.x 17 MB/s | 22 MB 00:01 2024-09-10T05:08:45.755 INFO:teuthology.orchestra.run.smithi139.stdout:(9/32): python3-cephfs-19.3.0-4762.gbad475c1.el 645 kB/s | 161 kB 00:00 2024-09-10T05:08:45.780 INFO:teuthology.orchestra.run.smithi139.stdout:(10/32): python3-rados-19.3.0-4762.gbad475c1.el 6.3 MB/s | 321 kB 00:00 2024-09-10T05:08:45.847 INFO:teuthology.orchestra.run.smithi139.stdout:(11/32): librgw2-19.3.0-4762.gbad475c1.el9.x86_ 10 MB/s | 5.5 MB 00:00 2024-09-10T05:08:45.872 INFO:teuthology.orchestra.run.smithi139.stdout:(12/32): python3-rgw-19.3.0-4762.gbad475c1.el9. 1.1 MB/s | 99 kB 00:00 2024-09-10T05:08:45.898 INFO:teuthology.orchestra.run.smithi139.stdout:(13/32): python3-rbd-19.3.0-4762.gbad475c1.el9. 2.1 MB/s | 305 kB 00:00 2024-09-10T05:08:46.206 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:08:46.206 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:08:46.506 INFO:teuthology.orchestra.run.smithi139.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 74 kB/s | 45 kB 00:00 2024-09-10T05:08:46.532 INFO:teuthology.orchestra.run.smithi139.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 156 kB/s | 107 kB 00:00 2024-09-10T05:08:46.632 INFO:teuthology.orchestra.run.smithi139.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 211 kB/s | 160 kB 00:00 2024-09-10T05:08:47.232 INFO:teuthology.orchestra.run.smithi139.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 70 kB/s | 42 kB 00:00 2024-09-10T05:08:47.357 INFO:teuthology.orchestra.run.smithi139.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 354 kB/s | 292 kB 00:00 2024-09-10T05:08:47.382 INFO:teuthology.orchestra.run.smithi139.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 757 kB/s | 662 kB 00:00 2024-09-10T05:08:47.708 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:08:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-10T05:08:47.820 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-10T05:08:47.846 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-10T05:08:47.877 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-10T05:08:47.898 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-10T05:08:47.958 INFO:teuthology.orchestra.run.smithi139.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 60 kB/s | 36 kB 00:00 2024-09-10T05:08:47.982 INFO:teuthology.orchestra.run.smithi139.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 79 kB/s | 47 kB 00:00 2024-09-10T05:08:48.033 INFO:teuthology.orchestra.run.smithi139.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 4.1 MB/s | 309 kB 00:00 2024-09-10T05:08:48.058 INFO:teuthology.orchestra.run.smithi139.stdout:(23/32): qatlib-24.02.0-1.el9.x86_64.rpm 267 kB/s | 221 kB 00:00 2024-09-10T05:08:48.079 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-10T05:08:48.083 INFO:teuthology.orchestra.run.smithi139.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-10T05:08:48.117 INFO:teuthology.orchestra.run.smithi139.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-09-10T05:08:48.132 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-10T05:08:48.151 INFO:teuthology.orchestra.run.smithi139.stdout:(26/32): liboath-2.6.7-2.el9.x86_64.rpm 527 kB/s | 49 kB 00:00 2024-09-10T05:08:48.193 INFO:teuthology.orchestra.run.smithi139.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-10T05:08:48.226 INFO:teuthology.orchestra.run.smithi139.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 839 kB 00:00 2024-09-10T05:08:48.310 INFO:teuthology.orchestra.run.smithi139.stdout:(29/32): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-10T05:08:48.352 INFO:teuthology.orchestra.run.smithi139.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-10T05:08:48.502 INFO:teuthology.orchestra.run.smithi139.stdout:(31/32): librados2-19.3.0-4762.gbad475c1.el9.x8 13 MB/s | 3.5 MB 00:00 2024-09-10T05:08:48.517 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-10T05:08:48.572 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-10T05:08:48.585 INFO:teuthology.orchestra.run.smithi139.stdout:(32/32): librbd1-19.3.0-4762.gbad475c1.el9.x86_ 12 MB/s | 3.2 MB 00:00 2024-09-10T05:08:48.591 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:08:48.591 INFO:teuthology.orchestra.run.smithi139.stdout:Total 14 MB/s | 61 MB 00:04 2024-09-10T05:08:48.665 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-10T05:08:48.695 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:08:48.731 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:08:48.731 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:08:48.761 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 8/34 2024-09-10T05:08:48.790 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 9/34 2024-09-10T05:08:48.853 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 9/34 2024-09-10T05:08:48.891 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-10T05:08:48.927 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9. 11/34 2024-09-10T05:08:48.997 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 12/34 2024-09-10T05:08:49.026 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 13/34 2024-09-10T05:08:49.073 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 13/34 2024-09-10T05:08:49.117 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-10T05:08:49.229 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-10T05:08:49.259 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-10T05:08:49.329 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-10T05:08:49.357 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-10T05:08:49.386 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-10T05:08:49.419 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-10T05:08:49.429 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:08:49.429 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:08:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-10T05:08:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 22/34 2024-09-10T05:08:49.905 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 22/34 2024-09-10T05:08:49.936 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/34 2024-09-10T05:08:49.972 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-10T05:08:50.462 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-10T05:08:50.492 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 26/34 2024-09-10T05:08:50.547 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 26/34 2024-09-10T05:08:50.625 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 27/34 2024-09-10T05:08:50.653 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x8 28/34 2024-09-10T05:08:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:08:51.080 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-10T05:08:51.124 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-10T05:08:51.149 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-10T05:08:51.172 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-10T05:08:51.201 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-10T05:08:51.357 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-10T05:08:51.411 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-10T05:08:51.754 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-10T05:08:51.859 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-10T05:08:51.952 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-10T05:08:52.063 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 8/34 2024-09-10T05:08:52.094 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 9/34 2024-09-10T05:08:52.157 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 9/34 2024-09-10T05:08:52.204 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-10T05:08:52.255 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9. 11/34 2024-09-10T05:08:52.325 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 12/34 2024-09-10T05:08:52.354 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 13/34 2024-09-10T05:08:52.419 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 13/34 2024-09-10T05:08:52.453 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-10T05:08:52.564 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-10T05:08:52.595 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-10T05:08:52.636 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-10T05:08:52.669 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-10T05:08:52.698 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-10T05:08:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-10T05:08:52.934 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-10T05:08:52.974 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-10T05:08:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-10T05:08:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 22/34 2024-09-10T05:08:53.192 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 22/34 2024-09-10T05:08:53.223 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/34 2024-09-10T05:08:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-10T05:08:53.558 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-10T05:08:53.594 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 30/34 2024-09-10T05:08:53.677 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 30/34 2024-09-10T05:08:53.677 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T05:08:53.677 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T05:08:53.677 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:08:53.712 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-10T05:08:53.750 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-10T05:08:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 26/34 2024-09-10T05:08:53.850 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 26/34 2024-09-10T05:08:53.920 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 27/34 2024-09-10T05:08:53.948 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x8 28/34 2024-09-10T05:08:56.229 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-10T05:08:56.269 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-10T05:08:56.829 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 29/34 2024-09-10T05:08:56.864 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 30/34 2024-09-10T05:08:56.956 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 30/34 2024-09-10T05:08:56.956 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T05:08:56.957 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T05:08:56.957 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:08:56.990 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-10T05:09:03.835 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-10T05:09:03.835 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2024-09-10T05:09:03.835 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2024-09-10T05:09:03.835 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2024-09-10T05:09:03.835 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2024-09-10T05:09:03.836 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2024-09-10T05:09:03.836 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /root 2024-09-10T05:09:03.836 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2024-09-10T05:09:03.836 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:04.870 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 32/34 2024-09-10T05:09:04.896 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 32/34 2024-09-10T05:09:04.896 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:09:04.896 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T05:09:04.896 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T05:09:04.896 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T05:09:04.896 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:04.898 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-10T05:09:04.973 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-10T05:09:04.973 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-10T05:09:06.159 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-10T05:09:06.159 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 1/34 2024-09-10T05:09:06.159 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2/34 2024-09-10T05:09:06.159 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 3/34 2024-09-10T05:09:06.159 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 4/34 2024-09-10T05:09:06.159 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 5/34 2024-09-10T05:09:06.159 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 6/34 2024-09-10T05:09:06.159 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-10T05:09:06.159 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9. 8/34 2024-09-10T05:09:06.159 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x8 9/34 2024-09-10T05:09:06.159 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 10/34 2024-09-10T05:09:06.160 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 11/34 2024-09-10T05:09:06.160 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 12/34 2024-09-10T05:09:06.160 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 13/34 2024-09-10T05:09:06.160 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-10T05:09:06.160 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-10T05:09:06.160 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-10T05:09:06.160 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-10T05:09:06.160 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-10T05:09:06.160 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-10T05:09:06.160 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-10T05:09:06.160 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-10T05:09:06.160 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-10T05:09:06.161 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-10T05:09:06.161 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-10T05:09:06.161 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-10T05:09:06.161 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-10T05:09:06.161 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-10T05:09:06.161 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-10T05:09:06.161 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-10T05:09:06.161 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-10T05:09:06.161 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-10T05:09:06.161 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-10T05:09:06.161 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 33/34 2024-09-10T05:09:06.918 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-10T05:09:06.918 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2024-09-10T05:09:06.919 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2024-09-10T05:09:06.919 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2024-09-10T05:09:06.919 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2024-09-10T05:09:06.919 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2024-09-10T05:09:06.919 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /root 2024-09-10T05:09:06.919 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2024-09-10T05:09:06.919 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:07.146 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-10T05:09:07.146 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:07.146 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2024-09-10T05:09:07.146 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.146 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.146 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:09:07.146 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T05:09:07.146 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.146 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.146 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T05:09:07.147 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T05:09:07.148 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T05:09:07.149 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:07.149 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:09:07.495 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-test 2024-09-10T05:09:07.938 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 32/34 2024-09-10T05:09:07.964 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 32/34 2024-09-10T05:09:07.964 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:09:07.964 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T05:09:07.964 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T05:09:07.965 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T05:09:07.965 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:07.966 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-10T05:09:08.040 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-10T05:09:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-10T05:09:08.062 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:28 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:09:08.199 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:09:08.200 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-10T05:09:08.200 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:08.200 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:09:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-10T05:09:08.200 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-10T05:09:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-10T05:09:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T05:09:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T05:09:08.200 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:08.200 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:09:08.201 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:08.201 INFO:teuthology.orchestra.run.smithi192.stdout:Install 4 Packages 2024-09-10T05:09:08.201 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:08.201 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 46 M 2024-09-10T05:09:08.201 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 201 M 2024-09-10T05:09:08.201 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:09:08.469 INFO:teuthology.orchestra.run.smithi192.stdout:(1/4): libcephsqlite-19.3.0-4762.gbad475c1.el9. 735 kB/s | 161 kB 00:00 2024-09-10T05:09:08.502 INFO:teuthology.orchestra.run.smithi192.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-10T05:09:08.611 INFO:teuthology.orchestra.run.smithi192.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 449 kB/s | 64 kB 00:00 2024-09-10T05:09:09.235 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-10T05:09:09.235 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 1/34 2024-09-10T05:09:09.235 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2/34 2024-09-10T05:09:09.235 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 3/34 2024-09-10T05:09:09.235 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 4/34 2024-09-10T05:09:09.236 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 5/34 2024-09-10T05:09:09.236 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_6 6/34 2024-09-10T05:09:09.236 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 7/34 2024-09-10T05:09:09.236 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9. 8/34 2024-09-10T05:09:09.236 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x8 9/34 2024-09-10T05:09:09.236 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 10/34 2024-09-10T05:09:09.236 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 11/34 2024-09-10T05:09:09.237 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 12/34 2024-09-10T05:09:09.237 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 13/34 2024-09-10T05:09:09.237 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-10T05:09:09.237 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-10T05:09:09.237 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-10T05:09:09.237 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-10T05:09:09.237 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-10T05:09:09.237 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-10T05:09:09.238 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-10T05:09:09.238 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-10T05:09:09.238 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-10T05:09:09.238 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-10T05:09:09.238 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-10T05:09:09.238 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-10T05:09:09.238 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-10T05:09:09.238 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-10T05:09:09.238 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-10T05:09:09.238 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-10T05:09:09.238 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-10T05:09:09.239 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 31/34 2024-09-10T05:09:09.239 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-10T05:09:09.239 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 33/34 2024-09-10T05:09:09.686 INFO:teuthology.orchestra.run.smithi192.stdout:(4/4): ceph-test-19.3.0-4762.gbad475c1.el9.x86_ 32 MB/s | 45 MB 00:01 2024-09-10T05:09:09.688 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:09:09.688 INFO:teuthology.orchestra.run.smithi192.stdout:Total 31 MB/s | 46 MB 00:01 2024-09-10T05:09:09.716 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:09:09.736 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:09:09.736 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:09:10.087 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:09:10.087 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:09:10.180 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T05:09:10.181 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.182 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.183 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T05:09:10.183 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.183 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.183 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:10.183 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T05:09:10.183 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T05:09:10.183 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T05:09:10.183 INFO:teuthology.orchestra.run.smithi139.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T05:09:10.183 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T05:09:10.183 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:10.183 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:09:10.527 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-test 2024-09-10T05:09:10.601 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:09:10.703 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T05:09:10.751 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T05:09:10.779 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 3/4 2024-09-10T05:09:11.096 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:30 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:09:11.228 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:09:11.228 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:11.228 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-10T05:09:11.229 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:11.229 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:09:11.229 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-10T05:09:11.229 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-10T05:09:11.229 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-10T05:09:11.229 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T05:09:11.229 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T05:09:11.229 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:11.229 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:09:11.229 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:11.229 INFO:teuthology.orchestra.run.smithi139.stdout:Install 4 Packages 2024-09-10T05:09:11.229 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:11.230 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 46 M 2024-09-10T05:09:11.230 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 201 M 2024-09-10T05:09:11.230 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:09:11.837 INFO:teuthology.orchestra.run.smithi139.stdout:(1/4): libcephsqlite-19.3.0-4762.gbad475c1.el9. 761 kB/s | 161 kB 00:00 2024-09-10T05:09:13.037 INFO:teuthology.orchestra.run.smithi139.stdout:(2/4): ceph-test-19.3.0-4762.gbad475c1.el9.x86_ 32 MB/s | 45 MB 00:01 2024-09-10T05:09:14.057 INFO:teuthology.orchestra.run.smithi139.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 29 kB/s | 64 kB 00:02 2024-09-10T05:09:14.187 INFO:teuthology.orchestra.run.smithi139.stdout:(4/4): socat-1.7.4.1-6.el9.x86_64.rpm 119 kB/s | 304 kB 00:02 2024-09-10T05:09:14.189 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:09:14.189 INFO:teuthology.orchestra.run.smithi139.stdout:Total 16 MB/s | 46 MB 00:02 2024-09-10T05:09:14.217 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:09:14.237 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:09:14.237 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:09:14.591 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:09:14.591 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:09:15.102 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:09:15.110 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 3/4 2024-09-10T05:09:15.171 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T05:09:15.186 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 4/4 2024-09-10T05:09:15.210 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T05:09:15.239 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 3/4 2024-09-10T05:09:17.500 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 4/4 2024-09-10T05:09:17.501 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 1/4 2024-09-10T05:09:17.501 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2/4 2024-09-10T05:09:17.501 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T05:09:17.806 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T05:09:17.806 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:17.806 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:09:17.807 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:17.807 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:17.807 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T05:09:17.807 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T05:09:17.807 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:17.807 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:09:18.111 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph 2024-09-10T05:09:18.699 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:38 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:09:18.874 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:09:18.877 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:18.877 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-10T05:09:18.877 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:18.877 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:09:18.877 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-10T05:09:18.877 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-10T05:09:18.877 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T05:09:18.878 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T05:09:18.879 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout:Install 37 Packages 2024-09-10T05:09:18.880 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:18.881 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 31 M 2024-09-10T05:09:18.881 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 109 M 2024-09-10T05:09:18.881 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:09:19.575 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 3/4 2024-09-10T05:09:19.661 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 4/4 2024-09-10T05:09:19.695 INFO:teuthology.orchestra.run.smithi192.stdout:(1/37): ceph-19.3.0-4762.gbad475c1.el9.x86_64.r 25 kB/s | 6.6 kB 00:00 2024-09-10T05:09:20.445 INFO:teuthology.orchestra.run.smithi192.stdout:(2/37): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86_ 1.5 MB/s | 1.5 MB 00:01 2024-09-10T05:09:21.062 INFO:teuthology.orchestra.run.smithi192.stdout:(3/37): ceph-mds-19.3.0-4762.gbad475c1.el9.x86_ 1.4 MB/s | 2.4 MB 00:01 2024-09-10T05:09:21.221 INFO:teuthology.orchestra.run.smithi192.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4762.gbad4 1.8 MB/s | 291 kB 00:00 2024-09-10T05:09:21.437 INFO:teuthology.orchestra.run.smithi192.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-10T05:09:21.613 INFO:teuthology.orchestra.run.smithi192.stdout:(6/37): ceph-osd-19.3.0-4762.gbad475c1.el9.x86_ 15 MB/s | 17 MB 00:01 2024-09-10T05:09:21.680 INFO:teuthology.orchestra.run.smithi192.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 5.1 MB/s | 1.2 MB 00:00 2024-09-10T05:09:21.730 INFO:teuthology.orchestra.run.smithi192.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-10T05:09:21.747 INFO:teuthology.orchestra.run.smithi192.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 797 kB/s | 106 kB 00:00 2024-09-10T05:09:21.780 INFO:teuthology.orchestra.run.smithi192.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-10T05:09:21.832 INFO:teuthology.orchestra.run.smithi192.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-10T05:09:21.856 INFO:teuthology.orchestra.run.smithi192.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-10T05:09:21.890 INFO:teuthology.orchestra.run.smithi192.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-10T05:09:21.915 INFO:teuthology.orchestra.run.smithi192.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 592 kB/s | 35 kB 00:00 2024-09-10T05:09:21.940 INFO:teuthology.orchestra.run.smithi192.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-10T05:09:21.965 INFO:teuthology.orchestra.run.smithi192.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T05:09:21.991 INFO:teuthology.orchestra.run.smithi192.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-09-10T05:09:22.049 INFO:teuthology.orchestra.run.smithi192.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-10T05:09:22.067 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 4/4 2024-09-10T05:09:22.067 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 1/4 2024-09-10T05:09:22.067 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2/4 2024-09-10T05:09:22.068 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T05:09:22.075 INFO:teuthology.orchestra.run.smithi192.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-10T05:09:22.100 INFO:teuthology.orchestra.run.smithi192.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-10T05:09:22.142 INFO:teuthology.orchestra.run.smithi192.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-10T05:09:22.167 INFO:teuthology.orchestra.run.smithi192.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 462 kB/s | 11 kB 00:00 2024-09-10T05:09:22.192 INFO:teuthology.orchestra.run.smithi192.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 714 kB/s | 18 kB 00:00 2024-09-10T05:09:22.218 INFO:teuthology.orchestra.run.smithi192.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 925 kB/s | 23 kB 00:00 2024-09-10T05:09:22.243 INFO:teuthology.orchestra.run.smithi192.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 784 kB/s | 19 kB 00:00 2024-09-10T05:09:22.269 INFO:teuthology.orchestra.run.smithi192.stdout:(26/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.1 MB/s | 358 kB 00:00 2024-09-10T05:09:22.294 INFO:teuthology.orchestra.run.smithi192.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 393 kB/s | 20 kB 00:00 2024-09-10T05:09:22.319 INFO:teuthology.orchestra.run.smithi192.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 926 kB/s | 46 kB 00:00 2024-09-10T05:09:22.344 INFO:teuthology.orchestra.run.smithi192.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-10T05:09:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T05:09:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:22.375 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:09:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T05:09:22.375 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T05:09:22.376 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:22.376 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:09:22.378 INFO:teuthology.orchestra.run.smithi192.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 494 kB/s | 16 kB 00:00 2024-09-10T05:09:22.403 INFO:teuthology.orchestra.run.smithi192.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-10T05:09:22.429 INFO:teuthology.orchestra.run.smithi192.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-10T05:09:22.454 INFO:teuthology.orchestra.run.smithi192.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 715 kB/s | 36 kB 00:00 2024-09-10T05:09:22.487 INFO:teuthology.orchestra.run.smithi192.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 6.8 MB/s | 230 kB 00:00 2024-09-10T05:09:22.504 INFO:teuthology.orchestra.run.smithi192.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-10T05:09:22.529 INFO:teuthology.orchestra.run.smithi192.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-10T05:09:22.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph 2024-09-10T05:09:23.030 INFO:teuthology.orchestra.run.smithi192.stdout:(37/37): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 1.4 MB/s | 4.8 MB 00:03 2024-09-10T05:09:23.034 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:09:23.035 INFO:teuthology.orchestra.run.smithi192.stdout:Total 7.4 MB/s | 31 MB 00:04 2024-09-10T05:09:23.188 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:09:23.226 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:42 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:09:23.228 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:09:23.228 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:09:23.378 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:09:23.381 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:23.381 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-10T05:09:23.381 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:23.381 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:09:23.381 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-10T05:09:23.381 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-10T05:09:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-10T05:09:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-10T05:09:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-10T05:09:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-10T05:09:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-10T05:09:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T05:09:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T05:09:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T05:09:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T05:09:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T05:09:23.382 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T05:09:23.383 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T05:09:23.384 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T05:09:23.385 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:23.385 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:09:23.385 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:23.385 INFO:teuthology.orchestra.run.smithi139.stdout:Install 37 Packages 2024-09-10T05:09:23.385 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:23.386 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 31 M 2024-09-10T05:09:23.386 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 109 M 2024-09-10T05:09:23.386 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:09:23.727 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:09:23.728 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:09:24.254 INFO:teuthology.orchestra.run.smithi139.stdout:(1/37): ceph-19.3.0-4762.gbad475c1.el9.x86_64.r 50 kB/s | 6.6 kB 00:00 2024-09-10T05:09:24.462 INFO:teuthology.orchestra.run.smithi139.stdout:(2/37): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86_ 4.5 MB/s | 1.5 MB 00:00 2024-09-10T05:09:24.512 INFO:teuthology.orchestra.run.smithi139.stdout:(3/37): ceph-mds-19.3.0-4762.gbad475c1.el9.x86_ 6.1 MB/s | 2.4 MB 00:00 2024-09-10T05:09:24.579 INFO:teuthology.orchestra.run.smithi139.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4762.gbad4 4.3 MB/s | 291 kB 00:00 2024-09-10T05:09:24.771 INFO:teuthology.orchestra.run.smithi139.stdout:(5/37): ceph-mon-19.3.0-4762.gbad475c1.el9.x86_ 9.3 MB/s | 4.8 MB 00:00 2024-09-10T05:09:24.830 INFO:teuthology.orchestra.run.smithi139.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-10T05:09:24.897 INFO:teuthology.orchestra.run.smithi139.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-10T05:09:24.964 INFO:teuthology.orchestra.run.smithi139.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-09-10T05:09:25.030 INFO:teuthology.orchestra.run.smithi139.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.8 MB/s | 125 kB 00:00 2024-09-10T05:09:25.104 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:09:25.166 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-10T05:09:25.189 INFO:teuthology.orchestra.run.smithi139.stdout:(10/37): ceph-osd-19.3.0-4762.gbad475c1.el9.x86 24 MB/s | 17 MB 00:00 2024-09-10T05:09:25.201 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-10T05:09:25.214 INFO:teuthology.orchestra.run.smithi139.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.1 MB/s | 215 kB 00:00 2024-09-10T05:09:25.234 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-10T05:09:25.248 INFO:teuthology.orchestra.run.smithi139.stdout:(12/37): python3-cryptography-36.0.1-4.el9.x86_ 2.6 MB/s | 1.2 MB 00:00 2024-09-10T05:09:25.305 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-10T05:09:25.342 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-10T05:09:25.365 INFO:teuthology.orchestra.run.smithi139.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 298 kB/s | 35 kB 00:00 2024-09-10T05:09:25.375 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-10T05:09:25.415 INFO:teuthology.orchestra.run.smithi139.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 858 kB/s | 172 kB 00:00 2024-09-10T05:09:25.440 INFO:teuthology.orchestra.run.smithi139.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 752 kB/s | 188 kB 00:00 2024-09-10T05:09:25.465 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-10T05:09:25.474 INFO:teuthology.orchestra.run.smithi139.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-09-10T05:09:25.499 INFO:teuthology.orchestra.run.smithi139.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 575 kB/s | 77 kB 00:00 2024-09-10T05:09:25.524 INFO:teuthology.orchestra.run.smithi139.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 496 kB/s | 42 kB 00:00 2024-09-10T05:09:25.536 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-10T05:09:25.577 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-10T05:09:25.593 INFO:teuthology.orchestra.run.smithi139.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 187 kB/s | 22 kB 00:00 2024-09-10T05:09:25.612 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-10T05:09:25.642 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-10T05:09:25.650 INFO:teuthology.orchestra.run.smithi139.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 347 kB/s | 43 kB 00:00 2024-09-10T05:09:25.668 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-10T05:09:25.675 INFO:teuthology.orchestra.run.smithi139.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 862 kB/s | 151 kB 00:00 2024-09-10T05:09:25.701 INFO:teuthology.orchestra.run.smithi139.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 433 kB/s | 11 kB 00:00 2024-09-10T05:09:25.702 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-10T05:09:25.726 INFO:teuthology.orchestra.run.smithi139.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-10T05:09:25.742 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-10T05:09:25.751 INFO:teuthology.orchestra.run.smithi139.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 350 kB/s | 18 kB 00:00 2024-09-10T05:09:25.777 INFO:teuthology.orchestra.run.smithi139.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-10T05:09:25.777 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-10T05:09:25.802 INFO:teuthology.orchestra.run.smithi139.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-10T05:09:25.811 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-10T05:09:25.827 INFO:teuthology.orchestra.run.smithi139.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-10T05:09:25.852 INFO:teuthology.orchestra.run.smithi139.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-10T05:09:25.860 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-10T05:09:25.878 INFO:teuthology.orchestra.run.smithi139.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-10T05:09:25.891 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-10T05:09:25.894 INFO:teuthology.orchestra.run.smithi139.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-10T05:09:25.920 INFO:teuthology.orchestra.run.smithi139.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 392 kB/s | 16 kB 00:00 2024-09-10T05:09:25.945 INFO:teuthology.orchestra.run.smithi139.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-10T05:09:25.964 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-10T05:09:25.970 INFO:teuthology.orchestra.run.smithi139.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-10T05:09:25.996 INFO:teuthology.orchestra.run.smithi139.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-10T05:09:26.020 INFO:teuthology.orchestra.run.smithi139.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T05:09:26.046 INFO:teuthology.orchestra.run.smithi139.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2024-09-10T05:09:26.071 INFO:teuthology.orchestra.run.smithi139.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-10T05:09:26.075 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:09:26.075 INFO:teuthology.orchestra.run.smithi139.stdout:Total 11 MB/s | 31 MB 00:02 2024-09-10T05:09:26.139 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-10T05:09:26.218 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:09:26.219 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-10T05:09:26.258 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:09:26.258 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:09:26.272 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-10T05:09:26.311 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-10T05:09:26.369 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-10T05:09:26.424 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-10T05:09:26.613 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-10T05:09:26.658 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-10T05:09:26.733 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:09:26.734 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:09:26.735 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-10T05:09:26.831 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-10T05:09:26.873 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-10T05:09:27.000 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-10T05:09:27.161 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9. 32/37 2024-09-10T05:09:27.192 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 33/37 2024-09-10T05:09:27.218 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 33/37 2024-09-10T05:09:27.218 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:09:27.219 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T05:09:27.219 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T05:09:27.219 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T05:09:27.219 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:28.103 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:09:28.182 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-10T05:09:28.219 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-10T05:09:28.285 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-10T05:09:28.355 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-10T05:09:28.400 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-10T05:09:28.433 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-10T05:09:28.525 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-10T05:09:28.619 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-10T05:09:28.669 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-10T05:09:28.676 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 34/37 2024-09-10T05:09:28.704 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-10T05:09:28.704 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 34/37 2024-09-10T05:09:28.704 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:09:28.704 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T05:09:28.704 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T05:09:28.705 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T05:09:28.705 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:28.734 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-10T05:09:28.769 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-10T05:09:28.802 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-10T05:09:28.842 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-10T05:09:28.877 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-10T05:09:28.906 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-10T05:09:28.954 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-10T05:09:28.986 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-10T05:09:29.059 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-10T05:09:29.152 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 35/37 2024-09-10T05:09:29.176 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 35/37 2024-09-10T05:09:29.176 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:09:29.176 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T05:09:29.176 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T05:09:29.176 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T05:09:29.176 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-10T05:09:29.294 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-10T05:09:29.347 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-10T05:09:29.386 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-10T05:09:29.403 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 36/37 2024-09-10T05:09:29.426 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 36/37 2024-09-10T05:09:29.427 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:09:29.427 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T05:09:29.427 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T05:09:29.427 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T05:09:29.427 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:29.434 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-10T05:09:29.490 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-10T05:09:29.499 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 37/37 2024-09-10T05:09:29.675 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-10T05:09:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-10T05:09:29.802 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-10T05:09:29.889 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-10T05:09:29.922 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-10T05:09:30.049 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-10T05:09:30.210 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9. 32/37 2024-09-10T05:09:30.241 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 33/37 2024-09-10T05:09:30.267 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 33/37 2024-09-10T05:09:30.268 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:09:30.268 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T05:09:30.268 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T05:09:30.268 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T05:09:30.268 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:31.323 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 37/37 2024-09-10T05:09:31.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/37 2024-09-10T05:09:31.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2/37 2024-09-10T05:09:31.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 3/37 2024-09-10T05:09:31.323 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 4/37 2024-09-10T05:09:31.324 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 5/37 2024-09-10T05:09:31.324 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9. 6/37 2024-09-10T05:09:31.324 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-10T05:09:31.324 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-10T05:09:31.324 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-10T05:09:31.324 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-10T05:09:31.324 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-10T05:09:31.324 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-10T05:09:31.324 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-10T05:09:31.324 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-10T05:09:31.325 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-10T05:09:31.325 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-10T05:09:31.325 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-10T05:09:31.325 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-10T05:09:31.325 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-10T05:09:31.325 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-10T05:09:31.325 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-10T05:09:31.325 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-10T05:09:31.325 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-10T05:09:31.325 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-10T05:09:31.326 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-10T05:09:31.326 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-10T05:09:31.326 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-10T05:09:31.326 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-10T05:09:31.326 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-10T05:09:31.326 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-10T05:09:31.326 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-10T05:09:31.326 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-10T05:09:31.326 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-10T05:09:31.326 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-10T05:09:31.326 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-10T05:09:31.326 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-10T05:09:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 34/37 2024-09-10T05:09:31.770 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 34/37 2024-09-10T05:09:31.770 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:09:31.770 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T05:09:31.770 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T05:09:31.770 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T05:09:31.770 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:32.209 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 35/37 2024-09-10T05:09:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 35/37 2024-09-10T05:09:32.232 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:09:32.232 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T05:09:32.232 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T05:09:32.232 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T05:09:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:32.274 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-10T05:09:32.274 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:32.274 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:09:32.274 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:32.274 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:32.274 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:32.274 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:09:32.274 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:32.274 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T05:09:32.275 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T05:09:32.276 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T05:09:32.277 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T05:09:32.277 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T05:09:32.277 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:32.277 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:09:32.451 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 36/37 2024-09-10T05:09:32.475 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 36/37 2024-09-10T05:09:32.475 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:09:32.475 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T05:09:32.475 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T05:09:32.475 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T05:09:32.475 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:32.532 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 37/37 2024-09-10T05:09:32.655 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-base 2024-09-10T05:09:33.218 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:53 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:09:33.307 INFO:teuthology.orchestra.run.smithi192.stdout:Package ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:09:33.348 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:09:33.349 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-10T05:09:33.349 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:09:33.418 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install cephadm 2024-09-10T05:09:33.975 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:53 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:09:34.107 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:09:34.108 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:34.108 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-10T05:09:34.108 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:34.108 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:09:34.108 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-10T05:09:34.108 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:34.108 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:09:34.108 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:34.109 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-10T05:09:34.109 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:34.109 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 783 k 2024-09-10T05:09:34.109 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 789 k 2024-09-10T05:09:34.109 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:09:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 37/37 2024-09-10T05:09:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/37 2024-09-10T05:09:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2/37 2024-09-10T05:09:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 3/37 2024-09-10T05:09:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 4/37 2024-09-10T05:09:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 5/37 2024-09-10T05:09:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9. 6/37 2024-09-10T05:09:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-10T05:09:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-10T05:09:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-10T05:09:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-10T05:09:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-10T05:09:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-10T05:09:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-10T05:09:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-10T05:09:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-10T05:09:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-10T05:09:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-10T05:09:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-10T05:09:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-10T05:09:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-10T05:09:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-10T05:09:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-10T05:09:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-10T05:09:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-10T05:09:34.378 INFO:teuthology.orchestra.run.smithi192.stdout:cephadm-19.3.0-4762.gbad475c1.el9.noarch.rpm 2.8 MB/s | 783 kB 00:00 2024-09-10T05:09:34.379 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:09:34.379 INFO:teuthology.orchestra.run.smithi192.stdout:Total 2.8 MB/s | 783 kB 00:00 2024-09-10T05:09:34.379 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:09:34.384 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:09:34.385 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:09:34.391 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:09:34.391 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:09:34.465 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:09:34.874 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:09:34.974 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:09:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-10T05:09:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T05:09:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T05:09:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T05:09:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T05:09:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T05:09:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T05:09:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T05:09:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T05:09:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T05:09:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T05:09:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T05:09:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T05:09:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T05:09:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T05:09:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T05:09:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:35.306 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:09:35.349 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:09:35.579 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:09:35.579 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:35.579 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:09:35.579 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:09:35.579 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:35.579 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:09:35.638 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-base 2024-09-10T05:09:35.810 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T05:09:36.210 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:55 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:09:36.300 INFO:teuthology.orchestra.run.smithi139.stdout:Package ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:09:36.341 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:09:36.342 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-10T05:09:36.342 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:09:36.395 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:56 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:09:36.403 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install cephadm 2024-09-10T05:09:36.531 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:09:36.532 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:36.532 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2024-09-10T05:09:36.532 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:36.532 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:09:36.532 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-10T05:09:36.532 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:36.532 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:09:36.533 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:36.533 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-10T05:09:36.533 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:36.533 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 145 k 2024-09-10T05:09:36.533 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 432 k 2024-09-10T05:09:36.533 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:09:36.734 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-immutable-object-cache-19.3.0-4762.gbad475 722 kB/s | 145 kB 00:00 2024-09-10T05:09:36.735 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:09:36.735 INFO:teuthology.orchestra.run.smithi192.stdout:Total 716 kB/s | 145 kB 00:00 2024-09-10T05:09:36.735 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:09:36.743 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:09:36.743 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:09:36.800 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:09:36.800 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:09:36.949 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:09:36.966 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:55 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:09:37.035 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-10T05:09:37.061 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-10T05:09:37.061 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:09:37.061 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T05:09:37.061 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:37.098 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:09:37.099 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:37.099 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-10T05:09:37.099 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:37.099 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:09:37.099 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-10T05:09:37.100 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:37.100 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:09:37.100 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:37.100 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-10T05:09:37.100 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:37.100 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 783 k 2024-09-10T05:09:37.100 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 789 k 2024-09-10T05:09:37.100 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:09:37.374 INFO:teuthology.orchestra.run.smithi139.stdout:cephadm-19.3.0-4762.gbad475c1.el9.noarch.rpm 2.8 MB/s | 783 kB 00:00 2024-09-10T05:09:37.375 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:09:37.375 INFO:teuthology.orchestra.run.smithi139.stdout:Total 2.8 MB/s | 783 kB 00:00 2024-09-10T05:09:37.375 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:09:37.380 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:09:37.380 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:09:37.386 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:09:37.386 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:09:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:09:37.938 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-10T05:09:37.939 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:37.939 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:09:37.939 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:37.939 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:37.939 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:09:37.977 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:09:38.061 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:09:38.206 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr 2024-09-10T05:09:38.430 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:09:38.669 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:09:38.669 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:38.669 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:09:38.669 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:09:38.669 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:38.670 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:09:38.787 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:58 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:09:38.868 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T05:09:38.878 INFO:teuthology.orchestra.run.smithi192.stdout:Package ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:09:38.920 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:09:38.921 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-10T05:09:38.921 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:09:38.985 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T05:09:39.453 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:58 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:09:39.545 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:59 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:09:39.587 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:09:39.588 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:39.588 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-09-10T05:09:39.588 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:39.588 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:09:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-10T05:09:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:39.589 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:09:39.589 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:39.589 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-10T05:09:39.589 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:39.589 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 145 k 2024-09-10T05:09:39.589 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 432 k 2024-09-10T05:09:39.589 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:09:39.677 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:09:39.678 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:39.679 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-10T05:09:39.679 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:39.679 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:09:39.679 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-10T05:09:39.679 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-10T05:09:39.679 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T05:09:39.679 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-10T05:09:39.679 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-10T05:09:39.679 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T05:09:39.679 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T05:09:39.679 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T05:09:39.679 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T05:09:39.680 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T05:09:39.680 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T05:09:39.680 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T05:09:39.680 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T05:09:39.680 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:39.680 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:09:39.680 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:39.680 INFO:teuthology.orchestra.run.smithi192.stdout:Install 12 Packages 2024-09-10T05:09:39.680 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:39.681 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 19 M 2024-09-10T05:09:39.681 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 159 M 2024-09-10T05:09:39.681 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:09:39.804 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-immutable-object-cache-19.3.0-4762.gbad475 675 kB/s | 145 kB 00:00 2024-09-10T05:09:39.805 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:09:39.805 INFO:teuthology.orchestra.run.smithi139.stdout:Total 670 kB/s | 145 kB 00:00 2024-09-10T05:09:39.805 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:09:39.812 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:09:39.812 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:09:39.869 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:09:39.869 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:09:40.009 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:09:40.045 INFO:teuthology.orchestra.run.smithi192.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4762.gba 225 kB/s | 34 kB 00:00 2024-09-10T05:09:40.071 INFO:teuthology.orchestra.run.smithi192.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4762.gbad 93 kB/s | 16 kB 00:00 2024-09-10T05:09:40.072 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-10T05:09:40.096 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-10T05:09:40.096 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:09:40.096 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T05:09:40.096 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:40.279 INFO:teuthology.orchestra.run.smithi192.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.3 MB/s | 269 kB 00:00 2024-09-10T05:09:40.338 INFO:teuthology.orchestra.run.smithi192.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-09-10T05:09:40.388 INFO:teuthology.orchestra.run.smithi192.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-10T05:09:40.405 INFO:teuthology.orchestra.run.smithi192.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-10T05:09:40.497 INFO:teuthology.orchestra.run.smithi192.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 22 MB/s | 2.0 MB 00:00 2024-09-10T05:09:40.522 INFO:teuthology.orchestra.run.smithi192.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-10T05:09:40.539 INFO:teuthology.orchestra.run.smithi192.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-10T05:09:40.698 INFO:teuthology.orchestra.run.smithi192.stdout:(10/12): ceph-mgr-dashboard-19.3.0-4762.gbad475 18 MB/s | 14 MB 00:00 2024-09-10T05:09:40.731 INFO:teuthology.orchestra.run.smithi192.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.9 MB/s | 863 kB 00:00 2024-09-10T05:09:40.756 INFO:teuthology.orchestra.run.smithi192.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 869 kB/s | 188 kB 00:00 2024-09-10T05:09:40.759 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:09:40.760 INFO:teuthology.orchestra.run.smithi192.stdout:Total 18 MB/s | 19 MB 00:01 2024-09-10T05:09:40.808 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:09:40.827 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:09:40.827 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:09:41.003 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1. 1/1 2024-09-10T05:09:41.004 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:41.004 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:09:41.004 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:09:41.004 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:41.004 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:09:41.090 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:09:41.091 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:09:41.224 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr 2024-09-10T05:09:41.684 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:09:41.766 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-10T05:09:41.800 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-10T05:09:41.802 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:00 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:09:41.847 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-10T05:09:41.878 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-10T05:09:41.892 INFO:teuthology.orchestra.run.smithi139.stdout:Package ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:09:41.934 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:09:41.935 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-10T05:09:41.935 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:09:41.980 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-10T05:09:41.993 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T05:09:42.112 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-10T05:09:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-10T05:09:42.249 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-10T05:09:42.277 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-10T05:09:42.309 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9 10/12 2024-09-10T05:09:42.552 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:01 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:09:42.684 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:09:42.685 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:42.685 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T05:09:42.686 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T05:09:42.687 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T05:09:42.687 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:42.687 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:09:42.687 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:09:42.687 INFO:teuthology.orchestra.run.smithi139.stdout:Install 12 Packages 2024-09-10T05:09:42.687 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:42.687 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 19 M 2024-09-10T05:09:42.687 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 159 M 2024-09-10T05:09:42.688 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:09:42.982 INFO:teuthology.orchestra.run.smithi139.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4762.gba 240 kB/s | 34 kB 00:00 2024-09-10T05:09:43.008 INFO:teuthology.orchestra.run.smithi139.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4762.gbad 98 kB/s | 16 kB 00:00 2024-09-10T05:09:43.133 INFO:teuthology.orchestra.run.smithi139.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.1 MB/s | 269 kB 00:00 2024-09-10T05:09:43.166 INFO:teuthology.orchestra.run.smithi139.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-09-10T05:09:43.217 INFO:teuthology.orchestra.run.smithi139.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-10T05:09:43.242 INFO:teuthology.orchestra.run.smithi139.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 7.7 MB/s | 863 kB 00:00 2024-09-10T05:09:43.267 INFO:teuthology.orchestra.run.smithi139.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-09-10T05:09:43.301 INFO:teuthology.orchestra.run.smithi139.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.3 MB/s | 144 kB 00:00 2024-09-10T05:09:43.328 INFO:teuthology.orchestra.run.smithi139.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-10T05:09:43.354 INFO:teuthology.orchestra.run.smithi139.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-10T05:09:43.429 INFO:teuthology.orchestra.run.smithi139.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-09-10T05:09:43.637 INFO:teuthology.orchestra.run.smithi139.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4762.gbad475 18 MB/s | 14 MB 00:00 2024-09-10T05:09:43.641 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:09:43.641 INFO:teuthology.orchestra.run.smithi139.stdout:Total 20 MB/s | 19 MB 00:00 2024-09-10T05:09:43.689 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:09:43.707 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:09:43.708 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:09:43.979 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:09:43.980 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:09:44.571 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:09:44.646 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-10T05:09:44.681 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-10T05:09:44.728 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-10T05:09:44.767 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-10T05:09:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-10T05:09:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-10T05:09:45.078 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-10T05:09:45.138 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-10T05:09:45.166 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-10T05:09:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9 10/12 2024-09-10T05:09:45.495 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el 11/12 2024-09-10T05:09:45.556 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 12/12 2024-09-10T05:09:47.568 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 12/12 2024-09-10T05:09:47.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el 1/12 2024-09-10T05:09:47.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 2/12 2024-09-10T05:09:47.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9 3/12 2024-09-10T05:09:47.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-10T05:09:47.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-10T05:09:47.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-10T05:09:47.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-10T05:09:47.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-10T05:09:47.569 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-10T05:09:47.569 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-10T05:09:47.569 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-10T05:09:47.880 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-10T05:09:47.880 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:47.880 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:09:47.880 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T05:09:47.880 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:09:47.880 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:09:47.881 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:09:47.881 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T05:09:47.881 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T05:09:47.881 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T05:09:47.881 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T05:09:47.881 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T05:09:47.881 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T05:09:47.881 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T05:09:47.881 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T05:09:47.881 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:47.881 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:09:48.126 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T05:09:48.399 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el 11/12 2024-09-10T05:09:48.461 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 12/12 2024-09-10T05:09:48.699 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:08 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:09:48.836 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:09:48.837 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-09-10T05:09:48.837 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-10T05:09:48.837 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-09-10T05:09:48.837 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:09:48.837 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T05:09:48.838 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:48.839 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:09:48.839 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-09-10T05:09:48.839 INFO:teuthology.orchestra.run.smithi192.stdout:Install 12 Packages 2024-09-10T05:09:48.839 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:48.839 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 38 M 2024-09-10T05:09:48.839 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 212 M 2024-09-10T05:09:48.839 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:09:49.438 INFO:teuthology.orchestra.run.smithi192.stdout:(1/12): ceph-mgr-diskprediction-local-19.3.0-47 17 MB/s | 7.4 MB 00:00 2024-09-10T05:09:49.488 INFO:teuthology.orchestra.run.smithi192.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 384 kB/s | 191 kB 00:00 2024-09-10T05:09:49.530 INFO:teuthology.orchestra.run.smithi192.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-10T05:09:49.572 INFO:teuthology.orchestra.run.smithi192.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 436 kB/s | 18 kB 00:00 2024-09-10T05:09:49.622 INFO:teuthology.orchestra.run.smithi192.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-10T05:09:49.756 INFO:teuthology.orchestra.run.smithi192.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-10T05:09:49.815 INFO:teuthology.orchestra.run.smithi192.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.2 MB/s | 3.0 MB 00:00 2024-09-10T05:09:49.940 INFO:teuthology.orchestra.run.smithi192.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 5.1 MB 00:00 2024-09-10T05:09:50.015 INFO:teuthology.orchestra.run.smithi192.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 13 MB/s | 4.9 MB 00:00 2024-09-10T05:09:50.040 INFO:teuthology.orchestra.run.smithi192.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.4 MB/s | 250 kB 00:00 2024-09-10T05:09:50.066 INFO:teuthology.orchestra.run.smithi192.stdout:(11/12): python3-devel-3.9.19-8.el9.x86_64.rpm 792 kB/s | 245 kB 00:00 2024-09-10T05:09:50.325 INFO:teuthology.orchestra.run.smithi192.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 53 MB/s | 16 MB 00:00 2024-09-10T05:09:50.325 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:09:50.325 INFO:teuthology.orchestra.run.smithi192.stdout:Total 26 MB/s | 38 MB 00:01 2024-09-10T05:09:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 12/12 2024-09-10T05:09:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el 1/12 2024-09-10T05:09:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noa 2/12 2024-09-10T05:09:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9 3/12 2024-09-10T05:09:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-10T05:09:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-10T05:09:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-10T05:09:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-10T05:09:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-10T05:09:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-10T05:09:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-10T05:09:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-10T05:09:50.643 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T05:09:50.644 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T05:09:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T05:09:50.645 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:50.645 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:09:50.680 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:09:50.706 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:09:50.706 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:09:50.879 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T05:09:51.137 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:09:51.138 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:09:51.445 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:10 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:09:51.577 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:09:51.578 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-09-10T05:09:51.578 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-10T05:09:51.578 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-09-10T05:09:51.578 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:09:51.578 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-10T05:09:51.578 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-10T05:09:51.578 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T05:09:51.578 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T05:09:51.578 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T05:09:51.578 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T05:09:51.579 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T05:09:51.579 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T05:09:51.579 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T05:09:51.579 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T05:09:51.579 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T05:09:51.579 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T05:09:51.579 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T05:09:51.579 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:51.579 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:09:51.579 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-09-10T05:09:51.579 INFO:teuthology.orchestra.run.smithi139.stdout:Install 12 Packages 2024-09-10T05:09:51.579 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:09:51.580 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 38 M 2024-09-10T05:09:51.580 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 212 M 2024-09-10T05:09:51.580 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:09:51.914 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:09:51.988 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T05:09:52.031 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T05:09:52.129 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T05:09:52.142 INFO:teuthology.orchestra.run.smithi139.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 941 kB/s | 191 kB 00:00 2024-09-10T05:09:52.165 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T05:09:52.242 INFO:teuthology.orchestra.run.smithi139.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-10T05:09:52.268 INFO:teuthology.orchestra.run.smithi139.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-10T05:09:52.318 INFO:teuthology.orchestra.run.smithi139.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 365 kB/s | 18 kB 00:00 2024-09-10T05:09:52.348 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T05:09:52.381 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T05:09:52.410 INFO:teuthology.orchestra.run.smithi139.stdout:(5/12): ceph-mgr-diskprediction-local-19.3.0-47 16 MB/s | 7.4 MB 00:00 2024-09-10T05:09:52.444 INFO:teuthology.orchestra.run.smithi139.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 307 kB/s | 38 kB 00:00 2024-09-10T05:09:52.457 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T05:09:52.585 INFO:teuthology.orchestra.run.smithi139.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-10T05:09:53.106 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T05:09:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T05:09:53.494 INFO:teuthology.orchestra.run.smithi139.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.4 MB/s | 3.0 MB 00:01 2024-09-10T05:09:53.636 INFO:teuthology.orchestra.run.smithi139.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-10T05:09:54.444 INFO:teuthology.orchestra.run.smithi139.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.4 MB/s | 4.9 MB 00:02 2024-09-10T05:09:54.449 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T05:09:54.778 INFO:teuthology.orchestra.run.smithi139.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.3 MB/s | 5.1 MB 00:02 2024-09-10T05:09:55.487 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T05:09:55.522 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 12/12 2024-09-10T05:09:58.086 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 12/12 2024-09-10T05:09:58.087 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 1/12 2024-09-10T05:09:58.087 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T05:09:58.087 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T05:09:58.087 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T05:09:58.087 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T05:09:58.087 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T05:09:58.087 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T05:09:58.087 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T05:09:58.087 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T05:09:58.087 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T05:09:58.087 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T05:09:58.482 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T05:09:58.482 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:58.482 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:09:58.482 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:09:58.482 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T05:09:58.482 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T05:09:58.482 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T05:09:58.482 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T05:09:58.482 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T05:09:58.482 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T05:09:58.482 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T05:09:58.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T05:09:58.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T05:09:58.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T05:09:58.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T05:09:58.483 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:58.483 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:09:58.865 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr-rook 2024-09-10T05:09:58.869 INFO:teuthology.orchestra.run.smithi139.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.1 MB/s | 16 MB 00:05 2024-09-10T05:09:58.870 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:09:58.871 INFO:teuthology.orchestra.run.smithi139.stdout:Total 5.2 MB/s | 38 MB 00:07 2024-09-10T05:09:59.232 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:09:59.258 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:09:59.259 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:09:59.448 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:19 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:09:59.581 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:09:59.582 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:59.582 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-10T05:09:59.582 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:59.582 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:09:59.582 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-10T05:09:59.583 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-10T05:09:59.583 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T05:09:59.583 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T05:09:59.583 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T05:09:59.583 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T05:09:59.583 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T05:09:59.583 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T05:09:59.583 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T05:09:59.583 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T05:09:59.583 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T05:09:59.583 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T05:09:59.583 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T05:09:59.584 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T05:09:59.584 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:59.584 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:09:59.584 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:09:59.584 INFO:teuthology.orchestra.run.smithi192.stdout:Install 13 Packages 2024-09-10T05:09:59.584 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:09:59.585 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 2.2 M 2024-09-10T05:09:59.585 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 26 M 2024-09-10T05:09:59.585 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:09:59.690 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:09:59.691 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:09:59.938 INFO:teuthology.orchestra.run.smithi192.stdout:(1/13): ceph-mgr-rook-19.3.0-4762.gbad475c1.el9 284 kB/s | 49 kB 00:00 2024-09-10T05:10:00.288 INFO:teuthology.orchestra.run.smithi192.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 37 kB/s | 19 kB 00:00 2024-09-10T05:10:00.330 INFO:teuthology.orchestra.run.smithi192.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 45 kB/s | 26 kB 00:00 2024-09-10T05:10:00.475 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:10:00.543 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T05:10:00.592 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T05:10:00.672 INFO:teuthology.orchestra.run.smithi192.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 303 kB/s | 222 kB 00:00 2024-09-10T05:10:00.692 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T05:10:00.726 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T05:10:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T05:10:00.942 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T05:10:00.988 INFO:teuthology.orchestra.run.smithi192.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 227 kB/s | 159 kB 00:00 2024-09-10T05:10:01.022 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T05:10:01.022 INFO:teuthology.orchestra.run.smithi192.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 979 kB/s | 32 kB 00:00 2024-09-10T05:10:01.039 INFO:teuthology.orchestra.run.smithi192.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 848 kB/s | 14 kB 00:00 2024-09-10T05:10:01.064 INFO:teuthology.orchestra.run.smithi192.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.6 MB/s | 220 kB 00:00 2024-09-10T05:10:01.098 INFO:teuthology.orchestra.run.smithi192.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 363 kB/s | 279 kB 00:00 2024-09-10T05:10:01.140 INFO:teuthology.orchestra.run.smithi192.stdout:(10/13): python3-kubernetes-26.1.0-2.el9.noarch 14 MB/s | 1.0 MB 00:00 2024-09-10T05:10:01.165 INFO:teuthology.orchestra.run.smithi192.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-10T05:10:01.190 INFO:teuthology.orchestra.run.smithi192.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 641 kB/s | 59 kB 00:00 2024-09-10T05:10:01.274 INFO:teuthology.orchestra.run.smithi192.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 89 kB/s | 54 kB 00:00 2024-09-10T05:10:01.277 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:01.278 INFO:teuthology.orchestra.run.smithi192.stdout:Total 1.3 MB/s | 2.2 MB 00:01 2024-09-10T05:10:01.346 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:10:01.362 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:10:01.363 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:10:01.453 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:10:01.456 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:10:01.707 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T05:10:01.814 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T05:10:01.960 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:10:02.154 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T05:10:02.208 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T05:10:02.272 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T05:10:02.309 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T05:10:02.359 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T05:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T05:10:02.562 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T05:10:02.611 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T05:10:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T05:10:03.321 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T05:10:03.391 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T05:10:03.425 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T05:10:03.473 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T05:10:03.495 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 13/13 2024-09-10T05:10:04.107 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T05:10:04.142 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 12/12 2024-09-10T05:10:04.262 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 13/13 2024-09-10T05:10:04.262 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 1/13 2024-09-10T05:10:04.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T05:10:04.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T05:10:04.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T05:10:04.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T05:10:04.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T05:10:04.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T05:10:04.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T05:10:04.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T05:10:04.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T05:10:04.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T05:10:04.263 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T05:10:04.587 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T05:10:04.587 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:04.587 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:10:04.587 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:10:04.588 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T05:10:04.588 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T05:10:04.588 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T05:10:04.588 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T05:10:04.588 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T05:10:04.588 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T05:10:04.588 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T05:10:04.588 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T05:10:04.588 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T05:10:04.588 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T05:10:04.588 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T05:10:04.588 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T05:10:04.589 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:04.589 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:04.845 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T05:10:05.411 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:25 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:05.544 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:05.545 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:05.545 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-10T05:10:05.545 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:05.545 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:10:05.545 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-10T05:10:05.545 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-10T05:10:05.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T05:10:05.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T05:10:05.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T05:10:05.545 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T05:10:05.546 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T05:10:05.546 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:05.546 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:10:05.546 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:05.546 INFO:teuthology.orchestra.run.smithi192.stdout:Install 6 Packages 2024-09-10T05:10:05.546 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:05.546 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 7.0 M 2024-09-10T05:10:05.546 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 33 M 2024-09-10T05:10:05.546 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:10:06.259 INFO:teuthology.orchestra.run.smithi192.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-10T05:10:06.293 INFO:teuthology.orchestra.run.smithi192.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4762.gbad475c1.e 703 kB/s | 154 kB 00:00 2024-09-10T05:10:06.360 INFO:teuthology.orchestra.run.smithi192.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.4 MB/s | 548 kB 00:00 2024-09-10T05:10:06.385 INFO:teuthology.orchestra.run.smithi192.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 628 kB/s | 58 kB 00:00 2024-09-10T05:10:06.419 INFO:teuthology.orchestra.run.smithi192.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-10T05:10:06.569 INFO:teuthology.orchestra.run.smithi192.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-10T05:10:06.572 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:06.572 INFO:teuthology.orchestra.run.smithi192.stdout:Total 6.8 MB/s | 7.0 MB 00:01 2024-09-10T05:10:06.645 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:10:06.656 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:10:06.656 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:10:06.681 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 12/12 2024-09-10T05:10:06.682 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad47 1/12 2024-09-10T05:10:06.682 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T05:10:06.682 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T05:10:06.682 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T05:10:06.682 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T05:10:06.682 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T05:10:06.682 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T05:10:06.682 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T05:10:06.682 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T05:10:06.682 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T05:10:06.683 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T05:10:06.757 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:10:06.757 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:10:07.070 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:10:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T05:10:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:07.094 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:10:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:10:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T05:10:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T05:10:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T05:10:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T05:10:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T05:10:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T05:10:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T05:10:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T05:10:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T05:10:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T05:10:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T05:10:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:07.095 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:07.250 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T05:10:07.304 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T05:10:07.517 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-rook 2024-09-10T05:10:07.821 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T05:10:07.915 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T05:10:07.982 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T05:10:08.025 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 6/6 2024-09-10T05:10:08.098 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:27 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:08.232 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:08.233 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-10T05:10:08.233 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T05:10:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T05:10:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T05:10:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T05:10:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:08.235 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:10:08.235 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:08.235 INFO:teuthology.orchestra.run.smithi139.stdout:Install 13 Packages 2024-09-10T05:10:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:08.235 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 2.2 M 2024-09-10T05:10:08.236 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 26 M 2024-09-10T05:10:08.236 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:10:08.558 INFO:teuthology.orchestra.run.smithi139.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 209 kB/s | 26 kB 00:00 2024-09-10T05:10:08.583 INFO:teuthology.orchestra.run.smithi139.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 129 kB/s | 19 kB 00:00 2024-09-10T05:10:08.608 INFO:teuthology.orchestra.run.smithi139.stdout:(3/13): ceph-mgr-rook-19.3.0-4762.gbad475c1.el9 284 kB/s | 49 kB 00:00 2024-09-10T05:10:08.733 INFO:teuthology.orchestra.run.smithi139.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-10T05:10:08.759 INFO:teuthology.orchestra.run.smithi139.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 905 kB/s | 159 kB 00:00 2024-09-10T05:10:08.773 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 6/6 2024-09-10T05:10:08.773 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/6 2024-09-10T05:10:08.773 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T05:10:08.773 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T05:10:08.773 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T05:10:08.773 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T05:10:08.793 INFO:teuthology.orchestra.run.smithi139.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 911 kB/s | 54 kB 00:00 2024-09-10T05:10:08.818 INFO:teuthology.orchestra.run.smithi139.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-09-10T05:10:08.851 INFO:teuthology.orchestra.run.smithi139.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-10T05:10:08.885 INFO:teuthology.orchestra.run.smithi139.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 156 kB/s | 14 kB 00:00 2024-09-10T05:10:08.910 INFO:teuthology.orchestra.run.smithi139.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-10T05:10:08.927 INFO:teuthology.orchestra.run.smithi139.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 5.3 MB/s | 90 kB 00:00 2024-09-10T05:10:08.952 INFO:teuthology.orchestra.run.smithi139.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.7 MB/s | 220 kB 00:00 2024-09-10T05:10:08.994 INFO:teuthology.orchestra.run.smithi139.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-09-10T05:10:08.997 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:08.997 INFO:teuthology.orchestra.run.smithi139.stdout:Total 2.9 MB/s | 2.2 MB 00:00 2024-09-10T05:10:09.053 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T05:10:09.053 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:09.053 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:10:09.053 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:10:09.053 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T05:10:09.053 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T05:10:09.053 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T05:10:09.053 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T05:10:09.054 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T05:10:09.054 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:09.054 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:09.062 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:10:09.077 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:10:09.077 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:10:09.166 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:10:09.167 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:10:09.320 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-fuse 2024-09-10T05:10:09.668 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:10:09.841 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T05:10:09.880 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:29 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:09.896 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T05:10:09.951 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T05:10:09.987 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T05:10:10.012 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:10.012 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:10.013 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-10T05:10:10.013 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:10.013 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:10:10.013 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-10T05:10:10.013 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-10T05:10:10.013 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T05:10:10.013 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:10.013 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:10:10.013 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:10.013 INFO:teuthology.orchestra.run.smithi192.stdout:Install 2 Packages 2024-09-10T05:10:10.013 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:10.014 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 980 k 2024-09-10T05:10:10.014 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 2.9 M 2024-09-10T05:10:10.014 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:10:10.029 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T05:10:10.139 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T05:10:10.239 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T05:10:10.288 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T05:10:10.562 INFO:teuthology.orchestra.run.smithi192.stdout:(1/2): ceph-fuse-19.3.0-4762.gbad475c1.el9.x86_ 3.0 MB/s | 900 kB 00:00 2024-09-10T05:10:10.696 INFO:teuthology.orchestra.run.smithi192.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 188 kB/s | 80 kB 00:00 2024-09-10T05:10:10.696 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:10.697 INFO:teuthology.orchestra.run.smithi192.stdout:Total 1.4 MB/s | 980 kB 00:00 2024-09-10T05:10:10.710 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:10:10.733 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:10:10.733 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:10:10.815 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:10:10.815 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:10:10.997 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T05:10:11.005 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:10:11.044 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T05:10:11.078 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T05:10:11.126 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T05:10:11.148 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T05:10:11.156 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 13/13 2024-09-10T05:10:11.212 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2/2 2024-09-10T05:10:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 13/13 2024-09-10T05:10:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 1/13 2024-09-10T05:10:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T05:10:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T05:10:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T05:10:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T05:10:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T05:10:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T05:10:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T05:10:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T05:10:11.907 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T05:10:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T05:10:11.908 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T05:10:11.911 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2/2 2024-09-10T05:10:11.911 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/2 2024-09-10T05:10:12.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T05:10:12.185 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:12.185 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:10:12.185 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T05:10:12.185 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:12.185 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:12.242 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T05:10:12.243 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:12.243 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:10:12.243 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:10:12.243 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T05:10:12.243 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T05:10:12.243 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T05:10:12.243 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T05:10:12.243 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T05:10:12.243 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T05:10:12.243 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T05:10:12.243 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T05:10:12.244 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T05:10:12.244 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T05:10:12.244 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T05:10:12.244 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T05:10:12.244 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:12.244 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:12.434 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-volume 2024-09-10T05:10:12.492 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T05:10:13.021 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:33 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:13.056 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:32 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:13.157 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:13.157 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:13.158 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-10T05:10:13.158 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:13.158 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:10:13.158 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-10T05:10:13.158 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:13.158 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:10:13.158 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:13.158 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-10T05:10:13.158 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:13.158 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 285 k 2024-09-10T05:10:13.158 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 1.3 M 2024-09-10T05:10:13.159 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:10:13.189 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:13.190 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-10T05:10:13.190 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout:Install 6 Packages 2024-09-10T05:10:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:13.192 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 7.0 M 2024-09-10T05:10:13.192 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 33 M 2024-09-10T05:10:13.192 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:10:13.392 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-volume-19.3.0-4762.gbad475c1.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-10T05:10:13.392 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:13.392 INFO:teuthology.orchestra.run.smithi192.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-10T05:10:13.392 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:10:13.401 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:10:13.401 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:10:13.428 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:10:13.428 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:10:13.595 INFO:teuthology.orchestra.run.smithi139.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-10T05:10:13.645 INFO:teuthology.orchestra.run.smithi139.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-10T05:10:13.646 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:10:13.662 INFO:teuthology.orchestra.run.smithi139.stdout:(3/6): ceph-mgr-cephadm-19.3.0-4762.gbad475c1.e 731 kB/s | 154 kB 00:00 2024-09-10T05:10:13.687 INFO:teuthology.orchestra.run.smithi139.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.3 MB/s | 58 kB 00:00 2024-09-10T05:10:13.702 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:10:13.718 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:10:13.718 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:10:13.718 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T05:10:13.718 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:13.729 INFO:teuthology.orchestra.run.smithi139.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-10T05:10:13.804 INFO:teuthology.orchestra.run.smithi139.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-10T05:10:13.807 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:13.807 INFO:teuthology.orchestra.run.smithi139.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-10T05:10:13.877 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:10:13.887 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:10:13.888 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:10:13.988 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:10:13.988 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:10:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:10:14.501 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T05:10:14.556 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T05:10:14.749 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:10:14.749 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:14.749 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:10:14.750 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:10:14.750 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:14.750 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:15.036 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librados-devel 2024-09-10T05:10:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T05:10:15.149 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T05:10:15.218 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T05:10:15.243 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 6/6 2024-09-10T05:10:15.615 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:35 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:15.753 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:15.754 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:15.754 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2024-09-10T05:10:15.754 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:15.754 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:10:15.754 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-10T05:10:15.754 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:15.754 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:10:15.754 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:15.755 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-10T05:10:15.755 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:15.755 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 126 k 2024-09-10T05:10:15.755 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 456 k 2024-09-10T05:10:15.755 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:10:15.930 INFO:teuthology.orchestra.run.smithi192.stdout:librados-devel-19.3.0-4762.gbad475c1.el9.x86_64 725 kB/s | 126 kB 00:00 2024-09-10T05:10:15.930 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:15.931 INFO:teuthology.orchestra.run.smithi192.stdout:Total 718 kB/s | 126 kB 00:00 2024-09-10T05:10:15.931 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:10:15.936 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:10:15.936 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:10:16.000 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:10:16.000 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:10:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 6/6 2024-09-10T05:10:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 1/6 2024-09-10T05:10:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T05:10:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T05:10:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T05:10:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T05:10:16.153 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:10:16.244 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T05:10:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:16.290 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:10:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:10:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T05:10:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T05:10:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T05:10:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T05:10:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T05:10:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:16.291 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:16.531 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-fuse 2024-09-10T05:10:16.680 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:16.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:16.943 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:16.944 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:10:16.944 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:10:16.944 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:16.944 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:17.099 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:36 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:17.200 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install libcephfs2 2024-09-10T05:10:17.232 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:17.232 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:17.232 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-10T05:10:17.233 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:17.233 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:10:17.233 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-10T05:10:17.233 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-10T05:10:17.233 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T05:10:17.233 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:17.233 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:10:17.233 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:17.233 INFO:teuthology.orchestra.run.smithi139.stdout:Install 2 Packages 2024-09-10T05:10:17.233 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:17.234 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 980 k 2024-09-10T05:10:17.234 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 2.9 M 2024-09-10T05:10:17.234 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:10:17.389 INFO:teuthology.orchestra.run.smithi139.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 592 kB/s | 80 kB 00:00 2024-09-10T05:10:17.531 INFO:teuthology.orchestra.run.smithi139.stdout:(2/2): ceph-fuse-19.3.0-4762.gbad475c1.el9.x86_ 3.2 MB/s | 900 kB 00:00 2024-09-10T05:10:17.532 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:17.532 INFO:teuthology.orchestra.run.smithi139.stdout:Total 3.2 MB/s | 980 kB 00:00 2024-09-10T05:10:17.543 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:10:17.565 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:10:17.565 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:10:17.647 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:10:17.647 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:10:17.782 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:37 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:17.849 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:10:17.876 INFO:teuthology.orchestra.run.smithi192.stdout:Package libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:17.921 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:17.922 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-10T05:10:17.922 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T05:10:17.989 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install libcephfs-devel 2024-09-10T05:10:18.056 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2/2 2024-09-10T05:10:18.569 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:38 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:18.711 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:18.712 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:18.712 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2024-09-10T05:10:18.712 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:18.712 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:10:18.712 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-10T05:10:18.712 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:18.712 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:10:18.712 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:18.712 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-10T05:10:18.713 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:18.713 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 32 k 2024-09-10T05:10:18.713 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 142 k 2024-09-10T05:10:18.713 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:10:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2/2 2024-09-10T05:10:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/2 2024-09-10T05:10:18.866 INFO:teuthology.orchestra.run.smithi192.stdout:libcephfs-devel-19.3.0-4762.gbad475c1.el9.x86_6 207 kB/s | 32 kB 00:00 2024-09-10T05:10:18.867 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:18.867 INFO:teuthology.orchestra.run.smithi192.stdout:Total 204 kB/s | 32 kB 00:00 2024-09-10T05:10:18.868 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:10:18.871 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:10:18.871 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:10:18.892 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:10:18.892 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:10:18.979 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:10:19.032 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T05:10:19.032 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:19.032 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:10:19.032 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T05:10:19.032 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:19.032 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:19.090 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:19.293 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-volume 2024-09-10T05:10:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:19.708 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:19.708 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:19.708 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:10:19.708 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:10:19.708 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:19.708 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:19.874 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:38 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:19.889 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librados2 2024-09-10T05:10:20.010 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:20.010 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-10T05:10:20.011 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:20.011 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:10:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-10T05:10:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:20.011 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:10:20.011 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:20.011 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-10T05:10:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:20.011 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 285 k 2024-09-10T05:10:20.011 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 1.3 M 2024-09-10T05:10:20.011 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:10:20.213 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-volume-19.3.0-4762.gbad475c1.el9.noarch.rp 1.4 MB/s | 285 kB 00:00 2024-09-10T05:10:20.213 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:20.213 INFO:teuthology.orchestra.run.smithi139.stdout:Total 1.4 MB/s | 285 kB 00:00 2024-09-10T05:10:20.213 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:10:20.220 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:10:20.220 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:10:20.253 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:10:20.254 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:10:20.458 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:40 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:20.474 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:10:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:10:20.549 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:10:20.553 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:10:20.553 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T05:10:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:20.591 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:20.592 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-10T05:10:20.592 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:20.653 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librbd1 2024-09-10T05:10:21.222 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:41 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:21.312 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:21.354 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:21.355 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-10T05:10:21.355 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:21.423 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install python3-rados 2024-09-10T05:10:21.547 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 1/1 2024-09-10T05:10:21.547 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:21.547 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:10:21.547 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-10T05:10:21.547 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:21.547 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:21.825 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librados-devel 2024-09-10T05:10:21.989 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:41 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:22.080 INFO:teuthology.orchestra.run.smithi192.stdout:Package python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:22.123 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:22.124 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-10T05:10:22.124 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:22.188 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install python3-rgw 2024-09-10T05:10:22.410 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:41 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:22.545 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:22.546 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:22.546 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-09-10T05:10:22.546 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:22.546 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:10:22.546 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-10T05:10:22.546 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:22.546 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:10:22.546 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:22.546 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-10T05:10:22.546 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:22.546 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 126 k 2024-09-10T05:10:22.547 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 456 k 2024-09-10T05:10:22.547 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:10:22.753 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:42 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:22.756 INFO:teuthology.orchestra.run.smithi139.stdout:librados-devel-19.3.0-4762.gbad475c1.el9.x86_64 604 kB/s | 126 kB 00:00 2024-09-10T05:10:22.757 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:22.757 INFO:teuthology.orchestra.run.smithi139.stdout:Total 599 kB/s | 126 kB 00:00 2024-09-10T05:10:22.757 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:10:22.762 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:10:22.762 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:10:22.826 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:10:22.827 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:10:22.843 INFO:teuthology.orchestra.run.smithi192.stdout:Package python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:22.886 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:22.887 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-10T05:10:22.887 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:22.954 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install python3-cephfs 2024-09-10T05:10:22.978 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:10:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:23.519 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:43 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:23.520 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:23.609 INFO:teuthology.orchestra.run.smithi192.stdout:Package python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:23.652 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:23.653 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-10T05:10:23.653 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:23.718 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install python3-rbd 2024-09-10T05:10:23.772 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:23.772 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:23.772 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:10:23.772 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:10:23.772 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:23.772 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:24.025 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install libcephfs2 2024-09-10T05:10:24.280 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:44 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:24.370 INFO:teuthology.orchestra.run.smithi192.stdout:Package python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:24.414 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:24.415 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-10T05:10:24.415 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:24.476 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install rbd-fuse 2024-09-10T05:10:24.590 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:43 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:24.680 INFO:teuthology.orchestra.run.smithi139.stdout:Package libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:24.725 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:24.725 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-10T05:10:24.725 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:24.815 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install libcephfs-devel 2024-09-10T05:10:25.045 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:45 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:25.179 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:25.180 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:25.180 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2024-09-10T05:10:25.180 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:25.180 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:10:25.180 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-10T05:10:25.180 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:25.181 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:10:25.181 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:25.181 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-10T05:10:25.181 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:25.181 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 85 k 2024-09-10T05:10:25.181 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 231 k 2024-09-10T05:10:25.181 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:10:25.377 INFO:teuthology.orchestra.run.smithi192.stdout:rbd-fuse-19.3.0-4762.gbad475c1.el9.x86_64.rpm 436 kB/s | 85 kB 00:00 2024-09-10T05:10:25.377 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:25.378 INFO:teuthology.orchestra.run.smithi192.stdout:Total 432 kB/s | 85 kB 00:00 2024-09-10T05:10:25.378 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:10:25.382 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:44 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:25.385 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:10:25.385 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:10:25.448 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:10:25.449 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:10:25.516 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 32 k 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 142 k 2024-09-10T05:10:25.517 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:10:25.596 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:10:25.685 INFO:teuthology.orchestra.run.smithi139.stdout:libcephfs-devel-19.3.0-4762.gbad475c1.el9.x86_6 190 kB/s | 32 kB 00:00 2024-09-10T05:10:25.685 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:25.685 INFO:teuthology.orchestra.run.smithi139.stdout:Total 188 kB/s | 32 kB 00:00 2024-09-10T05:10:25.685 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:10:25.689 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:10:25.689 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:10:25.692 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:25.708 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:10:25.708 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:10:25.803 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:10:25.915 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:26.081 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:26.273 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:26.318 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:26.318 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:26.318 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:10:26.318 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:10:26.318 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:26.318 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:26.510 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:26.511 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:26.511 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:10:26.511 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:10:26.511 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:26.511 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:26.581 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install rbd-mirror 2024-09-10T05:10:26.666 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librados2 2024-09-10T05:10:27.160 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:47 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:27.233 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:46 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:27.296 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:27.297 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:27.297 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2024-09-10T05:10:27.297 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:27.297 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:10:27.297 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-10T05:10:27.297 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:27.297 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:10:27.297 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:27.297 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-10T05:10:27.297 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:27.298 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 3.2 M 2024-09-10T05:10:27.298 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 14 M 2024-09-10T05:10:27.298 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:10:27.323 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:27.366 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:27.367 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-10T05:10:27.367 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:27.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librbd1 2024-09-10T05:10:27.640 INFO:teuthology.orchestra.run.smithi192.stdout:rbd-mirror-19.3.0-4762.gbad475c1.el9.x86_64.rpm 9.3 MB/s | 3.2 MB 00:00 2024-09-10T05:10:27.640 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:27.640 INFO:teuthology.orchestra.run.smithi192.stdout:Total 9.2 MB/s | 3.2 MB 00:00 2024-09-10T05:10:27.641 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:10:27.650 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:10:27.650 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:10:27.731 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:10:27.731 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:10:27.988 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:46 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:28.078 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:28.121 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:28.122 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-10T05:10:28.122 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:28.164 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:10:28.185 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rados 2024-09-10T05:10:28.240 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:28.266 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:28.266 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:10:28.266 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T05:10:28.266 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T05:10:28.266 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T05:10:28.266 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:28.747 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:47 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:28.837 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:28.880 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:28.881 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-10T05:10:28.881 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:28.947 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rgw 2024-09-10T05:10:29.349 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:29.349 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:29.349 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:10:29.349 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:10:29.350 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:29.350 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:29.512 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:48 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:29.598 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install rbd-nbd 2024-09-10T05:10:29.602 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:29.645 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:29.646 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-10T05:10:29.646 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:29.704 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-cephfs 2024-09-10T05:10:30.181 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:50 ago on Tue 10 Sep 2024 05:08:40 AM UTC. 2024-09-10T05:10:30.266 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:49 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:30.315 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T05:10:30.315 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:30.315 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2024-09-10T05:10:30.316 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:30.316 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T05:10:30.316 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-10T05:10:30.316 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:30.316 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T05:10:30.316 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-10T05:10:30.316 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-10T05:10:30.316 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:30.317 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 170 k 2024-09-10T05:10:30.317 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 490 k 2024-09-10T05:10:30.317 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T05:10:30.356 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:30.399 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:30.400 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-10T05:10:30.400 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:30.463 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rbd 2024-09-10T05:10:30.543 INFO:teuthology.orchestra.run.smithi192.stdout:rbd-nbd-19.3.0-4762.gbad475c1.el9.x86_64.rpm 753 kB/s | 170 kB 00:00 2024-09-10T05:10:30.543 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:30.544 INFO:teuthology.orchestra.run.smithi192.stdout:Total 749 kB/s | 170 kB 00:00 2024-09-10T05:10:30.544 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T05:10:30.551 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T05:10:30.552 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T05:10:30.615 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T05:10:30.615 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T05:10:30.772 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T05:10:30.874 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:31.031 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:50 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:31.127 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 is already installed. 2024-09-10T05:10:31.173 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:31.174 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-09-10T05:10:31.174 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:31.241 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-fuse 2024-09-10T05:10:31.307 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:31.541 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:31.541 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:31.541 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T05:10:31.541 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:10:31.541 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:31.541 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T05:10:31.764 DEBUG:teuthology.parallel:result is None 2024-09-10T05:10:31.847 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:50 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:31.987 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:31.988 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:31.988 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-09-10T05:10:31.988 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:31.988 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:10:31.988 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-10T05:10:31.988 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:31.988 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:10:31.988 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:31.988 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-10T05:10:31.988 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:31.988 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 85 k 2024-09-10T05:10:31.988 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 231 k 2024-09-10T05:10:31.989 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:10:32.171 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-fuse-19.3.0-4762.gbad475c1.el9.x86_64.rpm 468 kB/s | 85 kB 00:00 2024-09-10T05:10:32.172 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:32.172 INFO:teuthology.orchestra.run.smithi139.stdout:Total 463 kB/s | 85 kB 00:00 2024-09-10T05:10:32.172 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:10:32.179 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:10:32.179 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:10:32.242 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:10:32.242 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:10:32.390 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:10:32.477 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:33.178 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:33.179 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:33.179 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:10:33.179 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:10:33.179 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:33.179 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:33.458 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-mirror 2024-09-10T05:10:34.031 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:53 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:34.170 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:34.171 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-09-10T05:10:34.171 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:34.171 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:10:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-10T05:10:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:34.171 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:10:34.171 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:34.171 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-10T05:10:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:34.171 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 3.2 M 2024-09-10T05:10:34.172 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 14 M 2024-09-10T05:10:34.172 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:10:34.508 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-mirror-19.3.0-4762.gbad475c1.el9.x86_64.rpm 9.4 MB/s | 3.2 MB 00:00 2024-09-10T05:10:34.508 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:34.509 INFO:teuthology.orchestra.run.smithi139.stdout:Total 9.4 MB/s | 3.2 MB 00:00 2024-09-10T05:10:34.509 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:10:34.518 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:10:34.518 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:10:34.601 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:10:34.601 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:10:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:10:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:35.135 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T05:10:35.135 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T05:10:35.135 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T05:10:35.135 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T05:10:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:36.225 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:36.225 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:36.225 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:10:36.225 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:10:36.225 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:36.225 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:36.438 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-nbd 2024-09-10T05:10:37.015 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:56 ago on Tue 10 Sep 2024 05:08:41 AM UTC. 2024-09-10T05:10:37.150 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-10T05:10:37.151 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:37.151 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-09-10T05:10:37.151 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:37.151 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-10T05:10:37.151 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-10T05:10:37.151 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:37.152 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-10T05:10:37.152 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-10T05:10:37.152 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-09-10T05:10:37.152 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:37.152 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 170 k 2024-09-10T05:10:37.152 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 490 k 2024-09-10T05:10:37.152 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-10T05:10:37.361 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-nbd-19.3.0-4762.gbad475c1.el9.x86_64.rpm 818 kB/s | 170 kB 00:00 2024-09-10T05:10:37.361 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-10T05:10:37.361 INFO:teuthology.orchestra.run.smithi139.stdout:Total 812 kB/s | 170 kB 00:00 2024-09-10T05:10:37.361 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-10T05:10:37.369 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-10T05:10:37.369 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-10T05:10:37.432 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-10T05:10:37.432 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-10T05:10:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-10T05:10:37.691 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:38.110 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:38.392 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 1/1 2024-09-10T05:10:38.392 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:38.392 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-10T05:10:38.392 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-10T05:10:38.392 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:38.393 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-10T05:10:38.597 DEBUG:teuthology.parallel:result is None 2024-09-10T05:10:38.598 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T05:10:38.735 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T05:10:38.757 INFO:teuthology.orchestra.run.smithi139.stdout:19.3.0-4762.gbad475c1.el9 2024-09-10T05:10:38.758 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-10T05:10:38.758 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-10T05:10:38.759 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-10T05:10:38.901 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T05:10:38.927 INFO:teuthology.orchestra.run.smithi192.stdout:19.3.0-4762.gbad475c1.el9 2024-09-10T05:10:38.927 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-10T05:10:38.927 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-10T05:10:38.929 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T05:10:38.929 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:10:38.929 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T05:10:38.954 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:38.955 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T05:10:38.997 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T05:10:38.998 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:10:38.998 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T05:10:39.022 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T05:10:39.086 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:39.086 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T05:10:39.114 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T05:10:39.180 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T05:10:39.181 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:10:39.181 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T05:10:39.206 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T05:10:39.270 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:39.270 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T05:10:39.297 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T05:10:39.364 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T05:10:39.364 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:10:39.364 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T05:10:39.389 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T05:10:39.454 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:39.455 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T05:10:39.481 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T05:10:39.546 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T05:10:39.630 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T05:10:39.630 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2024-09-10T05:10:39.632 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2024-09-10T05:10:39.658 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T05:10:39.658 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T05:10:39.697 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T05:10:39.724 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T05:10:39.724 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T05:10:39.762 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T05:10:39.797 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T05:10:39.797 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T05:10:39.798 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898693', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7898693', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9786, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi139.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ5NbsnnEacvrlVa6LYV3NgVuQckrqTL/Apy94WcCydkzIqQZgfsW8K8Pm2s5yVM0sg0TIshO0v6uVwd6ehR7+0=', 'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDJBwrjo41wEcJGd+1W1PPYGqT1W/ICfaMIuiU69E3Z95/I5j5U9Y/TpEqLewClKNh2QQkRjepA8oRenQWeC7Cs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_03:21:45', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T05:10:39.798 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T05:10:39.827 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T05:10:39.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T05:10:39.882 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T05:10:39.909 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:10:39.909 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T05:10:39.961 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T05:10:39.961 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-09-10T05:10:40.016 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T05:10:40.016 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:10:40.016 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T05:10:40.016 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:10:40.016 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T05:10:40.017 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-10 05:10:35.390958065 +0000 2024-09-10T05:10:40.017 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-10 05:07:58.623725065 +0000 2024-09-10T05:10:40.017 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-10 05:07:58.623725065 +0000 2024-09-10T05:10:40.017 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-10 05:07:58.623725065 +0000 2024-09-10T05:10:40.017 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T05:10:40.079 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-10T05:10:40.080 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-10T05:10:40.080 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000179745 s, 2.8 MB/s 2024-09-10T05:10:40.081 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T05:10:40.137 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-09-10T05:10:40.192 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T05:10:40.192 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:10:40.192 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-10T05:10:40.192 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:10:40.192 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T05:10:40.192 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-10 05:10:35.391958044 +0000 2024-09-10T05:10:40.192 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-10 05:07:58.952718373 +0000 2024-09-10T05:10:40.192 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-10 05:07:58.952718373 +0000 2024-09-10T05:10:40.192 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-10 05:07:58.952718373 +0000 2024-09-10T05:10:40.193 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T05:10:40.254 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-10T05:10:40.254 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-10T05:10:40.255 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000180202 s, 2.8 MB/s 2024-09-10T05:10:40.256 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T05:10:40.312 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-09-10T05:10:40.367 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T05:10:40.367 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:10:40.367 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T05:10:40.367 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:10:40.368 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T05:10:40.368 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-10 05:10:35.391958044 +0000 2024-09-10T05:10:40.368 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-10 05:07:59.282711660 +0000 2024-09-10T05:10:40.368 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-10 05:07:59.282711660 +0000 2024-09-10T05:10:40.368 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-10 05:07:59.282711660 +0000 2024-09-10T05:10:40.368 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T05:10:40.431 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-10T05:10:40.431 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-10T05:10:40.431 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000210327 s, 2.4 MB/s 2024-09-10T05:10:40.432 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T05:10:40.489 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-09-10T05:10:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T05:10:40.544 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:10:40.544 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-10T05:10:40.544 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:10:40.544 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T05:10:40.545 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-10 05:10:35.391958044 +0000 2024-09-10T05:10:40.545 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-10 05:07:59.611704967 +0000 2024-09-10T05:10:40.545 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-10 05:07:59.611704967 +0000 2024-09-10T05:10:40.545 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-10 05:07:59.611704967 +0000 2024-09-10T05:10:40.545 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T05:10:40.607 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-10T05:10:40.607 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-10T05:10:40.607 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000221764 s, 2.3 MB/s 2024-09-10T05:10:40.608 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T05:10:40.665 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-10T05:10:40.665 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:40.665 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T05:10:40.683 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T05:10:40.683 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2024-09-10T05:10:40.741 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T05:10:40.741 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:10:40.741 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T05:10:40.741 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:10:40.741 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T05:10:40.741 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-10 05:10:28.508924176 +0000 2024-09-10T05:10:40.742 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-10 05:07:58.616881748 +0000 2024-09-10T05:10:40.742 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-10 05:07:58.616881748 +0000 2024-09-10T05:10:40.742 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-10 05:07:58.616881748 +0000 2024-09-10T05:10:40.742 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T05:10:40.808 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-10T05:10:40.808 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-10T05:10:40.808 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000236965 s, 2.2 MB/s 2024-09-10T05:10:40.809 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T05:10:40.867 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2024-09-10T05:10:40.924 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T05:10:40.924 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:10:40.924 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-10T05:10:40.924 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:10:40.924 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T05:10:40.924 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-10 05:10:28.508924176 +0000 2024-09-10T05:10:40.924 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-10 05:07:58.960875471 +0000 2024-09-10T05:10:40.924 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-10 05:07:58.960875471 +0000 2024-09-10T05:10:40.924 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-10 05:07:58.960875471 +0000 2024-09-10T05:10:40.925 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T05:10:40.988 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-10T05:10:40.988 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-10T05:10:40.988 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000205116 s, 2.5 MB/s 2024-09-10T05:10:40.994 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T05:10:41.052 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2024-09-10T05:10:41.109 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T05:10:41.109 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:10:41.109 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T05:10:41.109 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:10:41.109 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T05:10:41.109 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-10 05:10:28.509924157 +0000 2024-09-10T05:10:41.109 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-10 05:07:59.284869559 +0000 2024-09-10T05:10:41.109 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-10 05:07:59.284869559 +0000 2024-09-10T05:10:41.109 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-10 05:07:59.284869559 +0000 2024-09-10T05:10:41.110 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T05:10:41.173 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-10T05:10:41.173 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-10T05:10:41.173 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000189398 s, 2.7 MB/s 2024-09-10T05:10:41.174 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T05:10:41.231 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2024-09-10T05:10:41.286 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T05:10:41.286 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:10:41.286 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T05:10:41.286 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:10:41.286 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T05:10:41.286 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-10 05:10:28.509924157 +0000 2024-09-10T05:10:41.286 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-10 05:07:59.604863720 +0000 2024-09-10T05:10:41.286 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-10 05:07:59.604863720 +0000 2024-09-10T05:10:41.286 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-10 05:07:59.604863720 +0000 2024-09-10T05:10:41.287 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T05:10:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-10T05:10:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-10T05:10:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000159927 s, 3.2 MB/s 2024-09-10T05:10:41.350 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T05:10:41.405 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T05:10:41.406 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-10T05:10:41.406 INFO:tasks.ceph:Generating config... 2024-09-10T05:10:41.407 INFO:tasks.ceph:[client] debug ms = 1 2024-09-10T05:10:41.407 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-10T05:10:41.407 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-10T05:10:41.407 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-10T05:10:41.407 INFO:tasks.ceph:[client] setuser = ceph 2024-09-10T05:10:41.407 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T05:10:41.407 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-10T05:10:41.407 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T05:10:41.407 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T05:10:41.407 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T05:10:41.408 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T05:10:41.408 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T05:10:41.408 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T05:10:41.408 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T05:10:41.408 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T05:10:41.408 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T05:10:41.408 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T05:10:41.408 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T05:10:41.408 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T05:10:41.408 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T05:10:41.408 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T05:10:41.408 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T05:10:41.408 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T05:10:41.408 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T05:10:41.408 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T05:10:41.409 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T05:10:41.409 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T05:10:41.409 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T05:10:41.457 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T05:10:41.460 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T05:10:41.504 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T05:10:41.569 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.139')] 2024-09-10T05:10:41.569 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.139'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-10T05:10:41.570 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:10:41.570 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T05:10:41.624 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.139 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:10:41.703 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:10:41.703 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:10:41.704 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:10:41.704 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: generated fsid 3465d198-8f8d-4e0c-ba83-88b13d9b49be 2024-09-10T05:10:41.704 INFO:teuthology.orchestra.run.smithi139.stdout:setting min_mon_release = quincy 2024-09-10T05:10:41.704 INFO:teuthology.orchestra.run.smithi139.stdout:epoch 0 2024-09-10T05:10:41.704 INFO:teuthology.orchestra.run.smithi139.stdout:fsid 3465d198-8f8d-4e0c-ba83-88b13d9b49be 2024-09-10T05:10:41.704 INFO:teuthology.orchestra.run.smithi139.stdout:last_changed 2024-09-10T05:10:41.703616+0000 2024-09-10T05:10:41.704 INFO:teuthology.orchestra.run.smithi139.stdout:created 2024-09-10T05:10:41.703616+0000 2024-09-10T05:10:41.704 INFO:teuthology.orchestra.run.smithi139.stdout:min_mon_release 17 (quincy) 2024-09-10T05:10:41.705 INFO:teuthology.orchestra.run.smithi139.stdout:election_strategy: 1 2024-09-10T05:10:41.705 INFO:teuthology.orchestra.run.smithi139.stdout:0: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.a 2024-09-10T05:10:41.705 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-10T05:10:41.706 DEBUG:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T05:10:41.761 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3465d198-8f8d-4e0c-ba83-88b13d9b49be... 2024-09-10T05:10:41.761 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T05:10:41.803 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T05:10:41.843 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2024-09-10T05:10:41.843 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2024-09-10T05:10:41.844 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2024-09-10T05:10:41.845 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2024-09-10T05:10:41.846 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2024-09-10T05:10:41.846 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2024-09-10T05:10:41.846 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T05:10:41.846 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T05:10:41.846 INFO:teuthology.orchestra.run.smithi139.stdout: mon_allow_pool_size_one = true 2024-09-10T05:10:41.846 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.846 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T05:10:41.846 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.846 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2024-09-10T05:10:41.846 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.846 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2024-09-10T05:10:41.847 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.847 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2024-09-10T05:10:41.847 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2024-09-10T05:10:41.847 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2024-09-10T05:10:41.847 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = 172.21.15.139 2024-09-10T05:10:41.847 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = 3465d198-8f8d-4e0c-ba83-88b13d9b49be 2024-09-10T05:10:41.847 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.847 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2024-09-10T05:10:41.847 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: osd mclock profile = high_recovery_ops 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug trim objects = true 2024-09-10T05:10:41.848 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2024-09-10T05:10:41.849 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: debug objclass = 20 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: bdev async discard = True 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: bdev enable discard = True 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore allocator = bitmap 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 1/20 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 1/20 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 4/10 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T05:10:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2024-09-10T05:10:41.851 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T05:10:41.852 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T05:10:41.853 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.853 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T05:10:41.853 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T05:10:41.853 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T05:10:41.853 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.853 INFO:teuthology.orchestra.run.smithi139.stdout: # 1m isn't quite enough 2024-09-10T05:10:41.853 INFO:teuthology.orchestra.run.smithi139.stdout: mon_down_mkfs_grace = 2m 2024-09-10T05:10:41.853 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.853 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_filestore_osds = false 2024-09-10T05:10:41.853 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:10:41.853 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2024-09-10T05:10:41.854 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2024-09-10T05:10:41.854 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2024-09-10T05:10:41.854 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2024-09-10T05:10:41.854 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T05:10:41.854 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T05:10:41.854 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-10T05:10:41.854 INFO:teuthology.orchestra.run.smithi139.stdout: rgw gc obj min wait = 15 2024-09-10T05:10:41.854 INFO:teuthology.orchestra.run.smithi139.stdout: debug rgw = 20 2024-09-10T05:10:41.854 INFO:teuthology.orchestra.run.smithi139.stdout: setgroup = ceph 2024-09-10T05:10:41.854 INFO:teuthology.orchestra.run.smithi139.stdout: setuser = ceph 2024-09-10T05:10:41.854 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2024-09-10T05:10:41.855 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2024-09-10T05:10:41.855 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2024-09-10T05:10:41.855 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T05:10:41.855 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2024-09-10T05:10:41.855 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.855 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2024-09-10T05:10:41.855 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.855 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.856 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T05:10:41.857 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = 172.21.15.139 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = 3465d198-8f8d-4e0c-ba83-88b13d9b49be 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.858 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: osd mclock profile = high_recovery_ops 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug trim objects = true 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2024-09-10T05:10:41.859 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: debug objclass = 20 2024-09-10T05:10:41.860 INFO:teuthology.orchestra.run.smithi192.stdout: bdev async discard = True 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: bdev enable discard = True 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore allocator = bitmap 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 1/20 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 1/20 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 4/10 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2024-09-10T05:10:41.861 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2024-09-10T05:10:41.862 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T05:10:41.863 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T05:10:41.864 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-10T05:10:41.865 INFO:teuthology.orchestra.run.smithi192.stdout: rgw gc obj min wait = 15 2024-09-10T05:10:41.865 INFO:teuthology.orchestra.run.smithi192.stdout: debug rgw = 20 2024-09-10T05:10:41.865 INFO:teuthology.orchestra.run.smithi192.stdout: setgroup = ceph 2024-09-10T05:10:41.865 INFO:teuthology.orchestra.run.smithi192.stdout: setuser = ceph 2024-09-10T05:10:41.865 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2024-09-10T05:10:41.866 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T05:10:41.867 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T05:10:41.960 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T05:10:41.961 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:10:41.961 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T05:10:41.976 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:10:41.976 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T05:10:42.031 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2024-09-10T05:10:42.032 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:10:42.032 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T05:10:42.032 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T05:10:42.105 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:10:42.105 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:10:42.162 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2024-09-10T05:10:42.162 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:42.162 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T05:10:42.162 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T05:10:42.197 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:42.197 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:10:42.253 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T05:10:42.253 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T05:10:42.253 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T05:10:42.373 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T05:10:42.375 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T05:10:42.375 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T05:10:42.375 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T05:10:42.415 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T05:10:42.428 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T05:10:42.428 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-10T05:10:42.428 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T05:10:42.454 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-10T05:10:42.454 INFO:tasks.ceph:role: osd.0 2024-09-10T05:10:42.454 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-10T05:10:42.454 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T05:10:42.526 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:10:42.526 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:10:42.526 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:10:42.526 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T05:10:42.526 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:10:42.526 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:10:42.526 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:10:42.527 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T05:10:42.527 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:10:42.527 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:10:43.046 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-09-10T05:10:43.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-10T05:10:43.048 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T05:10:43.181 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T05:10:43.212 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:10:43.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:43.308+0000 7f1c25210640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T05:10:43.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:43.313+0000 7f1c25210640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T05:10:43.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:43.313+0000 7f1c25210640 -1 bdev(0x564a71a75800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T05:10:43.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:43.314+0000 7f1c25210640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T05:10:46.496 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T05:10:46.527 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T05:10:46.558 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T05:10:46.558 INFO:tasks.ceph:role: osd.1 2024-09-10T05:10:46.558 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-10T05:10:46.558 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T05:10:46.634 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:10:46.634 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:10:46.634 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:10:46.634 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T05:10:46.634 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:10:46.635 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:10:46.635 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:10:46.635 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T05:10:46.635 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:10:46.635 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:10:47.138 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-10T05:10:47.141 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-10T05:10:47.141 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-10T05:10:47.279 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T05:10:47.313 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T05:10:47.380 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T05:10:47.381 INFO:tasks.ceph:role: osd.2 2024-09-10T05:10:47.381 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-10T05:10:47.381 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T05:10:47.454 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:10:47.454 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:10:47.454 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:10:47.454 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T05:10:47.454 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:10:47.454 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:10:47.454 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:10:47.454 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T05:10:47.454 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:10:47.454 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:10:47.905 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-10T05:10:47.907 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-10T05:10:47.907 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-10T05:10:47.995 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T05:10:48.024 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T05:10:48.089 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-10T05:10:48.089 INFO:tasks.ceph:role: osd.3 2024-09-10T05:10:48.089 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-10T05:10:48.090 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T05:10:48.162 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:10:48.162 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:10:48.162 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:10:48.162 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T05:10:48.162 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:10:48.162 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:10:48.162 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:10:48.163 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T05:10:48.163 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:10:48.163 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:10:48.648 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-10T05:10:48.650 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-10T05:10:48.650 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-10T05:10:48.769 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T05:10:48.801 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:10:48.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:10:48.899+0000 7f4fe0215640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T05:10:48.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:10:48.902+0000 7f4fe0215640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T05:10:48.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:10:48.903+0000 7f4fe0215640 -1 bdev(0x5574c1a8f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T05:10:48.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:10:48.903+0000 7f4fe0215640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T05:10:52.058 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T05:10:52.088 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:10:52.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:10:52.177+0000 7f892e02e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T05:10:52.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:10:52.178+0000 7f892e02e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T05:10:52.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:10:52.178+0000 7f892e02e640 -1 bdev(0x55b8d0267800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T05:10:52.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:10:52.178+0000 7f892e02e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T05:10:55.092 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T05:10:55.122 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:10:55.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:10:55.214+0000 7fcc17bc5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T05:10:55.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:10:55.214+0000 7fcc17bc5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T05:10:55.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:10:55.214+0000 7fcc17bc5640 -1 bdev(0x555fcef7b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T05:10:55.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:10:55.214+0000 7fcc17bc5640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T05:10:58.620 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T05:10:58.649 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T05:10:58.649 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:10:58.649 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T05:10:58.680 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:58.680 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T05:10:58.718 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:58.719 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T05:10:58.784 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:58.784 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T05:10:58.849 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:58.850 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T05:10:58.916 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:58.917 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T05:10:58.972 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T05:10:58.972 DEBUG:teuthology.orchestra.run.smithi139:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T05:10:59.000 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.0] 2024-09-10T05:10:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDT1N9mIbZsEhAABnCtsYbF38k98AYfsNBxxw== 2024-09-10T05:10:59.000 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.x] 2024-09-10T05:10:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDS1N9m5eE5FhAAK7d7SqXGl204wlJDRVfxCw== 2024-09-10T05:10:59.000 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.1] 2024-09-10T05:10:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDY1N9mBLuoNRAAsHYMOOtfVXbjWc3EMrDiRQ== 2024-09-10T05:10:59.000 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.2] 2024-09-10T05:10:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDc1N9mSgKkChAAnKdqHZSh1tJdBCxiQ+ruUg== 2024-09-10T05:10:59.001 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.3] 2024-09-10T05:10:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDf1N9m1ujMDBAAlng2O5mYtDoi0YvLjZYiZA== 2024-09-10T05:10:59.001 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2024-09-10T05:10:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDS1N9meqjLGBAAmGzM9XK0Lj6mLXMokGhdgw== 2024-09-10T05:10:59.002 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:10:59.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T05:10:59.154 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:10:59.205 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:10:59.256 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:10:59.307 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T05:10:59.361 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T05:10:59.361 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T05:10:59.385 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T05:10:59.482 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T05:10:59.508 DEBUG:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:10:59.563 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T05:10:59.563 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T05:10:59.563 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T05:10:59.605 INFO:tasks.ceph.mon.a:Started 2024-09-10T05:10:59.606 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T05:10:59.606 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T05:10:59.606 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T05:10:59.609 INFO:tasks.ceph.mgr.x:Started 2024-09-10T05:10:59.609 DEBUG:tasks.ceph:set 0 configs 2024-09-10T05:10:59.609 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T05:10:59.610 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T05:10:59.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.708+0000 7f0acd38a640 1 Processor -- start 2024-09-10T05:10:59.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.708+0000 7f0acd38a640 1 -- start start 2024-09-10T05:10:59.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.709+0000 7f0acd38a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0ac8072c50 0x7f0ac8134570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:10:59.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.709+0000 7f0acd38a640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac8073e70 con 0x7f0ac8072160 2024-09-10T05:10:59.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.709+0000 7f0acd38a640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f0ac8096710 con 0x7f0ac8072c50 2024-09-10T05:10:59.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.709+0000 7f0ac6ffd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f0ac8072160 0x7f0ac8072540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:43742/0 (socket says 172.21.15.139:43742) 2024-09-10T05:10:59.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.709+0000 7f0ac6ffd640 1 -- 172.21.15.139:0/472274989 learned_addr learned my addr 172.21.15.139:0/472274989 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:10:59.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.709+0000 7f0ac67fc640 1 --2- 172.21.15.139:0/472274989 >> v2:172.21.15.139:3300/0 conn(0x7f0ac8072c50 0x7f0ac8134570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:10:59.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.709+0000 7f0ac5ffb640 1 -- 172.21.15.139:0/472274989 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444531452 0 0) 0x7f0ac8073e70 con 0x7f0ac8072160 2024-09-10T05:10:59.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.709+0000 7f0ac5ffb640 1 -- 172.21.15.139:0/472274989 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ab0003520 con 0x7f0ac8072160 2024-09-10T05:10:59.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.709+0000 7f0ac67fc640 1 -- 172.21.15.139:0/472274989 >> v1:172.21.15.139:6789/0 conn(0x7f0ac8072160 legacy=0x7f0ac8072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:10:59.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.709+0000 7f0ac67fc640 1 -- 172.21.15.139:0/472274989 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac8135ac0 con 0x7f0ac8072c50 2024-09-10T05:10:59.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.710+0000 7f0ac67fc640 1 --2- 172.21.15.139:0/472274989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ac8072c50 0x7f0ac8134570 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009720 tx=0x7f0abc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09d12786dddc2af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:10:59.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.710+0000 7f0ac5ffb640 1 -- 172.21.15.139:0/472274989 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc037070 con 0x7f0ac8072c50 2024-09-10T05:10:59.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.710+0000 7f0ac5ffb640 1 -- 172.21.15.139:0/472274989 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc02ad90 con 0x7f0ac8072c50 2024-09-10T05:10:59.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.710+0000 7f0ac5ffb640 1 -- 172.21.15.139:0/472274989 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0abc032590 con 0x7f0ac8072c50 2024-09-10T05:10:59.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.710+0000 7f0acd38a640 1 -- 172.21.15.139:0/472274989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ac8072c50 msgr2=0x7f0ac8134570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:10:59.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.710+0000 7f0acd38a640 1 --2- 172.21.15.139:0/472274989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ac8072c50 0x7f0ac8134570 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009720 tx=0x7f0abc02a110 comp rx=0 tx=0).stop 2024-09-10T05:10:59.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.710+0000 7f0acd38a640 1 -- 172.21.15.139:0/472274989 shutdown_connections 2024-09-10T05:10:59.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.710+0000 7f0acd38a640 1 --2- 172.21.15.139:0/472274989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ac8072c50 0x7f0ac8134570 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:10:59.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.710+0000 7f0acd38a640 1 -- 172.21.15.139:0/472274989 >> 172.21.15.139:0/472274989 conn(0x7f0ac809cf80 msgr2=0x7f0ac809d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:10:59.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.710+0000 7f0acd38a640 1 -- 172.21.15.139:0/472274989 shutdown_connections 2024-09-10T05:10:59.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.711+0000 7f0acd38a640 1 -- 172.21.15.139:0/472274989 wait complete. 2024-09-10T05:10:59.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.711+0000 7f0acd38a640 1 Processor -- start 2024-09-10T05:10:59.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.712+0000 7f0acd38a640 1 -- start start 2024-09-10T05:10:59.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.712+0000 7f0acd38a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ac8072160 0x7f0ac8124ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:10:59.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.712+0000 7f0acd38a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8134e40 con 0x7f0ac8072160 2024-09-10T05:10:59.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.712+0000 7f0ac6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ac8072160 0x7f0ac8124ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:10:59.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.712+0000 7f0ac6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ac8072160 0x7f0ac8124ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38834/0 (socket says 172.21.15.139:38834) 2024-09-10T05:10:59.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.712+0000 7f0ac6ffd640 1 -- 172.21.15.139:0/1394847042 learned_addr learned my addr 172.21.15.139:0/1394847042 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:10:59.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.712+0000 7f0ac6ffd640 1 -- 172.21.15.139:0/1394847042 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac81279d0 con 0x7f0ac8072160 2024-09-10T05:10:59.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.712+0000 7f0ac6ffd640 1 --2- 172.21.15.139:0/1394847042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ac8072160 0x7f0ac8124ca0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800c480 tx=0x7f0ab800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:10:59.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.712+0000 7f0aaf7fe640 1 -- 172.21.15.139:0/1394847042 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ab8017070 con 0x7f0ac8072160 2024-09-10T05:10:59.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.712+0000 7f0aaf7fe640 1 -- 172.21.15.139:0/1394847042 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ab8005cd0 con 0x7f0ac8072160 2024-09-10T05:10:59.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.713+0000 7f0acd38a640 1 -- 172.21.15.139:0/1394847042 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac81272a0 con 0x7f0ac8072160 2024-09-10T05:10:59.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.713+0000 7f0aaf7fe640 1 -- 172.21.15.139:0/1394847042 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ab8007200 con 0x7f0ac8072160 2024-09-10T05:10:59.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.713+0000 7f0acd38a640 1 -- 172.21.15.139:0/1394847042 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac81251e0 con 0x7f0ac8072160 2024-09-10T05:10:59.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.713+0000 7f0aaf7fe640 1 -- 172.21.15.139:0/1394847042 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0ab801a070 con 0x7f0ac8072160 2024-09-10T05:10:59.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.713+0000 7f0aaf7fe640 1 -- 172.21.15.139:0/1394847042 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0ab8012400 con 0x7f0ac8072160 2024-09-10T05:10:59.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.713+0000 7f0acd38a640 1 -- 172.21.15.139:0/1394847042 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac8072540 con 0x7f0ac8072160 2024-09-10T05:10:59.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.715+0000 7f0aaf7fe640 1 -- 172.21.15.139:0/1394847042 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0ab801c440 con 0x7f0ac8072160 2024-09-10T05:10:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.778+0000 7f0acd38a640 1 -- 172.21.15.139:0/1394847042 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0ac81265c0 con 0x7f0ac8072160 2024-09-10T05:10:59.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.779+0000 7f0aaf7fe640 1 -- 172.21.15.139:0/1394847042 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f0ab80073a0 con 0x7f0ac8072160 2024-09-10T05:10:59.780 INFO:teuthology.orchestra.run.smithi139.stderr:adjusted tunables profile to default 2024-09-10T05:10:59.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.780+0000 7f0acd38a640 1 -- 172.21.15.139:0/1394847042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ac8072160 msgr2=0x7f0ac8124ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:10:59.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.780+0000 7f0acd38a640 1 --2- 172.21.15.139:0/1394847042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ac8072160 0x7f0ac8124ca0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800c480 tx=0x7f0ab800c940 comp rx=0 tx=0).stop 2024-09-10T05:10:59.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.780+0000 7f0acd38a640 1 -- 172.21.15.139:0/1394847042 shutdown_connections 2024-09-10T05:10:59.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.780+0000 7f0acd38a640 1 --2- 172.21.15.139:0/1394847042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ac8072160 0x7f0ac8124ca0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:10:59.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.780+0000 7f0acd38a640 1 -- 172.21.15.139:0/1394847042 >> 172.21.15.139:0/1394847042 conn(0x7f0ac809cf80 msgr2=0x7f0ac8099660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:10:59.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.780+0000 7f0acd38a640 1 -- 172.21.15.139:0/1394847042 shutdown_connections 2024-09-10T05:10:59.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:10:59.780+0000 7f0acd38a640 1 -- 172.21.15.139:0/1394847042 wait complete. 2024-09-10T05:10:59.791 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T05:10:59.791 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T05:10:59.791 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-10T05:10:59.791 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T05:10:59.816 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:59.816 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T05:10:59.841 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:59.841 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T05:10:59.906 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T05:10:59.907 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T05:10:59.972 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 66219d18-2e08-4bf8-9271-bfaf3e270982 0 2024-09-10T05:11:00.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.109+0000 7f245e191640 1 Processor -- start 2024-09-10T05:11:00.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.109+0000 7f245e191640 1 -- start start 2024-09-10T05:11:00.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.109+0000 7f245e191640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2458113700 0x7f2458113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:00.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.109+0000 7f245e191640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24581141d0 con 0x7f245810fd80 2024-09-10T05:11:00.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.109+0000 7f245e191640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f2458110920 con 0x7f2458113700 2024-09-10T05:11:00.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.110+0000 7f24577fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2458113700 0x7f2458113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:00.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.110+0000 7f24577fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2458113700 0x7f2458113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:53718/0 (socket says 172.21.15.192:53718) 2024-09-10T05:11:00.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.110+0000 7f244ffff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f245810fd80 0x7f2458110210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:42538/0 (socket says 172.21.15.192:42538) 2024-09-10T05:11:00.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.110+0000 7f24577fe640 1 -- 172.21.15.192:0/3572226596 learned_addr learned my addr 172.21.15.192:0/3572226596 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:00.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.110+0000 7f24577fe640 1 -- 172.21.15.192:0/3572226596 >> v1:172.21.15.139:6789/0 conn(0x7f245810fd80 legacy=0x7f2458110210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.110+0000 7f2456ffd640 1 -- 172.21.15.192:0/3572226596 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250084564 0 0) 0x7f24581141d0 con 0x7f245810fd80 2024-09-10T05:11:00.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.110+0000 7f24577fe640 1 -- 172.21.15.192:0/3572226596 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2458110ad0 con 0x7f2458113700 2024-09-10T05:11:00.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.111+0000 7f24577fe640 1 --2- 172.21.15.192:0/3572226596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2458113700 0x7f2458113ae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24480097f0 tx=0x7f244802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cd7fce69ceed71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:00.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.111+0000 7f2456ffd640 1 -- 172.21.15.192:0/3572226596 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2448037070 con 0x7f2458113700 2024-09-10T05:11:00.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.111+0000 7f2456ffd640 1 -- 172.21.15.192:0/3572226596 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2448032440 con 0x7f2458113700 2024-09-10T05:11:00.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.111+0000 7f2456ffd640 1 -- 172.21.15.192:0/3572226596 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f244802ae60 con 0x7f2458113700 2024-09-10T05:11:00.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.112+0000 7f245e191640 1 -- 172.21.15.192:0/3572226596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2458113700 msgr2=0x7f2458113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.112+0000 7f245e191640 1 --2- 172.21.15.192:0/3572226596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2458113700 0x7f2458113ae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24480097f0 tx=0x7f244802a1e0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.112+0000 7f245e191640 1 -- 172.21.15.192:0/3572226596 shutdown_connections 2024-09-10T05:11:00.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.112+0000 7f245e191640 1 --2- 172.21.15.192:0/3572226596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2458113700 0x7f2458113ae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.112+0000 7f245e191640 1 -- 172.21.15.192:0/3572226596 >> 172.21.15.192:0/3572226596 conn(0x7f2458070c60 msgr2=0x7f2458073080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:00.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.112+0000 7f245e191640 1 -- 172.21.15.192:0/3572226596 shutdown_connections 2024-09-10T05:11:00.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.112+0000 7f245e191640 1 -- 172.21.15.192:0/3572226596 wait complete. 2024-09-10T05:11:00.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.112+0000 7f245e191640 1 Processor -- start 2024-09-10T05:11:00.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.113+0000 7f245e191640 1 -- start start 2024-09-10T05:11:00.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.113+0000 7f245e191640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f245810fd80 0x7f24581a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:00.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.113+0000 7f245e191640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f245811ba60 con 0x7f245810fd80 2024-09-10T05:11:00.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.113+0000 7f24577fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f245810fd80 0x7f24581a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:00.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.113+0000 7f24577fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f245810fd80 0x7f24581a61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:53734/0 (socket says 172.21.15.192:53734) 2024-09-10T05:11:00.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.113+0000 7f24577fe640 1 -- 172.21.15.192:0/957288694 learned_addr learned my addr 172.21.15.192:0/957288694 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:00.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.113+0000 7f24577fe640 1 -- 172.21.15.192:0/957288694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24581a6720 con 0x7f245810fd80 2024-09-10T05:11:00.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.113+0000 7f24577fe640 1 --2- 172.21.15.192:0/957288694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f245810fd80 0x7f24581a61e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2448035040 tx=0x7f24480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:00.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.113+0000 7f2454ff9640 1 -- 172.21.15.192:0/957288694 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2448041070 con 0x7f245810fd80 2024-09-10T05:11:00.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.113+0000 7f2454ff9640 1 -- 172.21.15.192:0/957288694 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244803c7a0 con 0x7f245810fd80 2024-09-10T05:11:00.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.113+0000 7f2454ff9640 1 -- 172.21.15.192:0/957288694 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2448037040 con 0x7f245810fd80 2024-09-10T05:11:00.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.114+0000 7f245e191640 1 -- 172.21.15.192:0/957288694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24581a69b0 con 0x7f245810fd80 2024-09-10T05:11:00.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.114+0000 7f245e191640 1 -- 172.21.15.192:0/957288694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24581a6e70 con 0x7f245810fd80 2024-09-10T05:11:00.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.114+0000 7f2454ff9640 1 -- 172.21.15.192:0/957288694 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2448044070 con 0x7f245810fd80 2024-09-10T05:11:00.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.114+0000 7f2454ff9640 1 -- 172.21.15.192:0/957288694 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f244803d3f0 con 0x7f245810fd80 2024-09-10T05:11:00.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.114+0000 7f245e191640 1 -- 172.21.15.192:0/957288694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2458113b60 con 0x7f245810fd80 2024-09-10T05:11:00.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.117+0000 7f2454ff9640 1 -- 172.21.15.192:0/957288694 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2448046450 con 0x7f245810fd80 2024-09-10T05:11:00.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.187+0000 7f245e191640 1 -- 172.21.15.192:0/957288694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "66219d18-2e08-4bf8-9271-bfaf3e270982", "id": 0} v 0) -- 0x7f2458113700 con 0x7f245810fd80 2024-09-10T05:11:00.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.188+0000 7f2454ff9640 1 -- 172.21.15.192:0/957288694 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "66219d18-2e08-4bf8-9271-bfaf3e270982", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f2448046630 con 0x7f245810fd80 2024-09-10T05:11:00.189 INFO:teuthology.orchestra.run.smithi192.stdout:0 2024-09-10T05:11:00.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.189+0000 7f245e191640 1 -- 172.21.15.192:0/957288694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f245810fd80 msgr2=0x7f24581a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.189+0000 7f245e191640 1 --2- 172.21.15.192:0/957288694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f245810fd80 0x7f24581a61e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2448035040 tx=0x7f24480046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.189+0000 7f245e191640 1 -- 172.21.15.192:0/957288694 shutdown_connections 2024-09-10T05:11:00.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.189+0000 7f245e191640 1 --2- 172.21.15.192:0/957288694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f245810fd80 0x7f24581a61e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.189+0000 7f245e191640 1 -- 172.21.15.192:0/957288694 >> 172.21.15.192:0/957288694 conn(0x7f2458070c60 msgr2=0x7f2458071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:00.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.189+0000 7f245e191640 1 -- 172.21.15.192:0/957288694 shutdown_connections 2024-09-10T05:11:00.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.189+0000 7f245e191640 1 -- 172.21.15.192:0/957288694 wait complete. 2024-09-10T05:11:00.201 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new c8cf450e-b552-4e11-aa38-83613145105d 1 2024-09-10T05:11:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.299+0000 7f57d50b0640 1 Processor -- start 2024-09-10T05:11:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.299+0000 7f57d50b0640 1 -- start start 2024-09-10T05:11:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.299+0000 7f57d50b0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f57d011b900 0x7f57d011dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.299+0000 7f57d50b0640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d011e230 con 0x7f57d0113070 2024-09-10T05:11:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.299+0000 7f57d50b0640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f57d011f430 con 0x7f57d011b900 2024-09-10T05:11:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.299+0000 7f57ce59c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f57d011b900 0x7f57d011dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.299+0000 7f57ce59c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f57d011b900 0x7f57d011dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:53738/0 (socket says 172.21.15.192:53738) 2024-09-10T05:11:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.299+0000 7f57ce59c640 1 -- 172.21.15.192:0/3266836049 learned_addr learned my addr 172.21.15.192:0/3266836049 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.299+0000 7f57ced9d640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f57d0113070 0x7f57d0113450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:42548/0 (socket says 172.21.15.192:42548) 2024-09-10T05:11:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.299+0000 7f57ce59c640 1 -- 172.21.15.192:0/3266836049 >> v1:172.21.15.139:6789/0 conn(0x7f57d0113070 legacy=0x7f57d0113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.299+0000 7f57ce59c640 1 -- 172.21.15.192:0/3266836049 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d011f5e0 con 0x7f57d011b900 2024-09-10T05:11:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.299+0000 7f57cdd9b640 1 -- 172.21.15.192:0/3266836049 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3178317770 0 0) 0x7f57d011e230 con 0x7f57d0113070 2024-09-10T05:11:00.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.300+0000 7f57ce59c640 1 --2- 172.21.15.192:0/3266836049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57d011b900 0x7f57d011dcf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f57b80097f0 tx=0x7f57b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a4b3762971ec05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:00.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.300+0000 7f57cdd9b640 1 -- 172.21.15.192:0/3266836049 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b8037070 con 0x7f57d011b900 2024-09-10T05:11:00.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.300+0000 7f57cdd9b640 1 -- 172.21.15.192:0/3266836049 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b8032440 con 0x7f57d011b900 2024-09-10T05:11:00.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.300+0000 7f57cdd9b640 1 -- 172.21.15.192:0/3266836049 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b802ae60 con 0x7f57d011b900 2024-09-10T05:11:00.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.301+0000 7f57d50b0640 1 -- 172.21.15.192:0/3266836049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57d011b900 msgr2=0x7f57d011dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.301+0000 7f57d50b0640 1 --2- 172.21.15.192:0/3266836049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57d011b900 0x7f57d011dcf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f57b80097f0 tx=0x7f57b802a1e0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.301+0000 7f57d50b0640 1 -- 172.21.15.192:0/3266836049 shutdown_connections 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.301+0000 7f57d50b0640 1 --2- 172.21.15.192:0/3266836049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57d011b900 0x7f57d011dcf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.301+0000 7f57d50b0640 1 -- 172.21.15.192:0/3266836049 >> 172.21.15.192:0/3266836049 conn(0x7f57d006f330 msgr2=0x7f57d006f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.301+0000 7f57d50b0640 1 -- 172.21.15.192:0/3266836049 shutdown_connections 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.301+0000 7f57d50b0640 1 -- 172.21.15.192:0/3266836049 wait complete. 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.302+0000 7f57d50b0640 1 Processor -- start 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.302+0000 7f57d50b0640 1 -- start start 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.302+0000 7f57d50b0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57d0113070 0x7f57d01a7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.302+0000 7f57d50b0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f57d011e8e0 con 0x7f57d0113070 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.302+0000 7f57ced9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57d0113070 0x7f57d01a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.302+0000 7f57ced9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57d0113070 0x7f57d01a7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:53742/0 (socket says 172.21.15.192:53742) 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.302+0000 7f57ced9d640 1 -- 172.21.15.192:0/94008836 learned_addr learned my addr 172.21.15.192:0/94008836 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:00.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.303+0000 7f57ced9d640 1 -- 172.21.15.192:0/94008836 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d01a7bd0 con 0x7f57d0113070 2024-09-10T05:11:00.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.303+0000 7f57ced9d640 1 --2- 172.21.15.192:0/94008836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57d0113070 0x7f57d01a7600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c7c0 tx=0x7f57c800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:00.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.303+0000 7f57c77fe640 1 -- 172.21.15.192:0/94008836 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57c8018070 con 0x7f57d0113070 2024-09-10T05:11:00.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.303+0000 7f57c77fe640 1 -- 172.21.15.192:0/94008836 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c8004d70 con 0x7f57d0113070 2024-09-10T05:11:00.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.303+0000 7f57d50b0640 1 -- 172.21.15.192:0/94008836 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d01a7ec0 con 0x7f57d0113070 2024-09-10T05:11:00.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.303+0000 7f57c77fe640 1 -- 172.21.15.192:0/94008836 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57c800a710 con 0x7f57d0113070 2024-09-10T05:11:00.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.303+0000 7f57d50b0640 1 -- 172.21.15.192:0/94008836 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d01ad010 con 0x7f57d0113070 2024-09-10T05:11:00.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.303+0000 7f57c77fe640 1 -- 172.21.15.192:0/94008836 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f57c801b070 con 0x7f57d0113070 2024-09-10T05:11:00.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.303+0000 7f57c77fe640 1 -- 172.21.15.192:0/94008836 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f57c801d440 con 0x7f57d0113070 2024-09-10T05:11:00.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.304+0000 7f57d50b0640 1 -- 172.21.15.192:0/94008836 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d01a8200 con 0x7f57d0113070 2024-09-10T05:11:00.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.306+0000 7f57c77fe640 1 -- 172.21.15.192:0/94008836 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f57c8007130 con 0x7f57d0113070 2024-09-10T05:11:00.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.377+0000 7f57d50b0640 1 -- 172.21.15.192:0/94008836 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c8cf450e-b552-4e11-aa38-83613145105d", "id": 1} v 0) -- 0x7f57d011ef60 con 0x7f57d0113070 2024-09-10T05:11:00.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.378+0000 7f57c77fe640 1 -- 172.21.15.192:0/94008836 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c8cf450e-b552-4e11-aa38-83613145105d", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f57c800a8b0 con 0x7f57d0113070 2024-09-10T05:11:00.379 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-10T05:11:00.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.379+0000 7f57d50b0640 1 -- 172.21.15.192:0/94008836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57d0113070 msgr2=0x7f57d01a7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.379+0000 7f57d50b0640 1 --2- 172.21.15.192:0/94008836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57d0113070 0x7f57d01a7600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c7c0 tx=0x7f57c800cc80 comp rx=0 tx=0).stop 2024-09-10T05:11:00.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.379+0000 7f57d50b0640 1 -- 172.21.15.192:0/94008836 shutdown_connections 2024-09-10T05:11:00.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.379+0000 7f57d50b0640 1 --2- 172.21.15.192:0/94008836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57d0113070 0x7f57d01a7600 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.379+0000 7f57d50b0640 1 -- 172.21.15.192:0/94008836 >> 172.21.15.192:0/94008836 conn(0x7f57d006f330 msgr2=0x7f57d010fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:00.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.379+0000 7f57d50b0640 1 -- 172.21.15.192:0/94008836 shutdown_connections 2024-09-10T05:11:00.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.379+0000 7f57d50b0640 1 -- 172.21.15.192:0/94008836 wait complete. 2024-09-10T05:11:00.390 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 7e53ce5e-92fc-4417-b675-a20d8b740415 2 2024-09-10T05:11:00.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.485+0000 7f497edf5640 1 Processor -- start 2024-09-10T05:11:00.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.485+0000 7f497edf5640 1 -- start start 2024-09-10T05:11:00.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.485+0000 7f497edf5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4978111060 0x7f4978111440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:00.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.485+0000 7f497edf5640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4978111b30 con 0x7f49781154f0 2024-09-10T05:11:00.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.485+0000 7f497edf5640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f49781160b0 con 0x7f4978111060 2024-09-10T05:11:00.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.486+0000 7f497cb91640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4978111060 0x7f4978111440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:00.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.486+0000 7f4977fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f49781154f0 0x7f49781159a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:42554/0 (socket says 172.21.15.192:42554) 2024-09-10T05:11:00.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.486+0000 7f4977fff640 1 -- 172.21.15.192:0/3598719932 learned_addr learned my addr 172.21.15.192:0/3598719932 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:00.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.486+0000 7f497cb91640 1 -- 172.21.15.192:0/3598719932 >> v1:172.21.15.139:6789/0 conn(0x7f49781154f0 legacy=0x7f49781159a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.486+0000 7f497cb91640 1 -- 172.21.15.192:0/3598719932 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4978116260 con 0x7f4978111060 2024-09-10T05:11:00.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.486+0000 7f49777fe640 1 -- 172.21.15.192:0/3598719932 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3559613914 0 0) 0x7f4978111b30 con 0x7f49781154f0 2024-09-10T05:11:00.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.487+0000 7f497cb91640 1 --2- 172.21.15.192:0/3598719932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4978111060 0x7f4978111440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f496c009720 tx=0x7f496c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf43c2e676551b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:00.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.487+0000 7f49777fe640 1 -- 172.21.15.192:0/3598719932 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496c037070 con 0x7f4978111060 2024-09-10T05:11:00.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.487+0000 7f49777fe640 1 -- 172.21.15.192:0/3598719932 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496c02ad90 con 0x7f4978111060 2024-09-10T05:11:00.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.487+0000 7f49777fe640 1 -- 172.21.15.192:0/3598719932 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496c032590 con 0x7f4978111060 2024-09-10T05:11:00.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.487+0000 7f497edf5640 1 -- 172.21.15.192:0/3598719932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4978111060 msgr2=0x7f4978111440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.487+0000 7f497edf5640 1 --2- 172.21.15.192:0/3598719932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4978111060 0x7f4978111440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f496c009720 tx=0x7f496c02a110 comp rx=0 tx=0).stop 2024-09-10T05:11:00.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.488+0000 7f497edf5640 1 -- 172.21.15.192:0/3598719932 shutdown_connections 2024-09-10T05:11:00.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.488+0000 7f497edf5640 1 --2- 172.21.15.192:0/3598719932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4978111060 0x7f4978111440 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.488+0000 7f497edf5640 1 -- 172.21.15.192:0/3598719932 >> 172.21.15.192:0/3598719932 conn(0x7f4978071dd0 msgr2=0x7f49780741f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:00.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.488+0000 7f497edf5640 1 -- 172.21.15.192:0/3598719932 shutdown_connections 2024-09-10T05:11:00.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.488+0000 7f497edf5640 1 -- 172.21.15.192:0/3598719932 wait complete. 2024-09-10T05:11:00.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.488+0000 7f497edf5640 1 Processor -- start 2024-09-10T05:11:00.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.488+0000 7f497edf5640 1 -- start start 2024-09-10T05:11:00.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.489+0000 7f497edf5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4978111060 0x7f497806e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.489+0000 7f497edf5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f497811cbd0 con 0x7f4978111060 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.489+0000 7f497cb91640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4978111060 0x7f497806e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.489+0000 7f497cb91640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4978111060 0x7f497806e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:53750/0 (socket says 172.21.15.192:53750) 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.489+0000 7f497cb91640 1 -- 172.21.15.192:0/4291837612 learned_addr learned my addr 172.21.15.192:0/4291837612 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.489+0000 7f497cb91640 1 -- 172.21.15.192:0/4291837612 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49780703b0 con 0x7f4978111060 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.489+0000 7f497cb91640 1 --2- 172.21.15.192:0/4291837612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4978111060 0x7f497806e4b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f496c009720 tx=0x7f496c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.489+0000 7f49757fa640 1 -- 172.21.15.192:0/4291837612 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496c041070 con 0x7f4978111060 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.489+0000 7f49757fa640 1 -- 172.21.15.192:0/4291837612 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496c03c460 con 0x7f4978111060 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.489+0000 7f49757fa640 1 -- 172.21.15.192:0/4291837612 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496c037040 con 0x7f4978111060 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.489+0000 7f497edf5640 1 -- 172.21.15.192:0/4291837612 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497806ea50 con 0x7f4978111060 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.489+0000 7f497edf5640 1 -- 172.21.15.192:0/4291837612 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497806eff0 con 0x7f4978111060 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.490+0000 7f49757fa640 1 -- 172.21.15.192:0/4291837612 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f496c044070 con 0x7f4978111060 2024-09-10T05:11:00.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.490+0000 7f49757fa640 1 -- 172.21.15.192:0/4291837612 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f496c046cd0 con 0x7f4978111060 2024-09-10T05:11:00.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.490+0000 7f497edf5640 1 -- 172.21.15.192:0/4291837612 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f497806f330 con 0x7f4978111060 2024-09-10T05:11:00.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.492+0000 7f49757fa640 1 -- 172.21.15.192:0/4291837612 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f496c046450 con 0x7f4978111060 2024-09-10T05:11:00.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.563+0000 7f497edf5640 1 -- 172.21.15.192:0/4291837612 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e53ce5e-92fc-4417-b675-a20d8b740415", "id": 2} v 0) -- 0x7f49781114c0 con 0x7f4978111060 2024-09-10T05:11:00.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.564+0000 7f49757fa640 1 -- 172.21.15.192:0/4291837612 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e53ce5e-92fc-4417-b675-a20d8b740415", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f496c0468b0 con 0x7f4978111060 2024-09-10T05:11:00.565 INFO:teuthology.orchestra.run.smithi192.stdout:2 2024-09-10T05:11:00.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.565+0000 7f497edf5640 1 -- 172.21.15.192:0/4291837612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4978111060 msgr2=0x7f497806e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.565+0000 7f497edf5640 1 --2- 172.21.15.192:0/4291837612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4978111060 0x7f497806e4b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f496c009720 tx=0x7f496c0046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.565+0000 7f497edf5640 1 -- 172.21.15.192:0/4291837612 shutdown_connections 2024-09-10T05:11:00.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.565+0000 7f497edf5640 1 --2- 172.21.15.192:0/4291837612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4978111060 0x7f497806e4b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.565+0000 7f497edf5640 1 -- 172.21.15.192:0/4291837612 >> 172.21.15.192:0/4291837612 conn(0x7f4978071dd0 msgr2=0x7f4978114460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:00.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.565+0000 7f497edf5640 1 -- 172.21.15.192:0/4291837612 shutdown_connections 2024-09-10T05:11:00.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.565+0000 7f497edf5640 1 -- 172.21.15.192:0/4291837612 wait complete. 2024-09-10T05:11:00.576 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new c4099f78-d4fa-41cd-a4c4-2aa56d3d1e62 3 2024-09-10T05:11:00.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.672+0000 7fe0ab8e6640 1 Processor -- start 2024-09-10T05:11:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.672+0000 7fe0ab8e6640 1 -- start start 2024-09-10T05:11:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.672+0000 7fe0ab8e6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe0a4111060 0x7fe0a4111440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.672+0000 7fe0ab8e6640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a4111b30 con 0x7fe0a41154f0 2024-09-10T05:11:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.672+0000 7fe0ab8e6640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a41160b0 con 0x7fe0a4111060 2024-09-10T05:11:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.673+0000 7fe0a9682640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe0a4111060 0x7fe0a4111440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.673+0000 7fe0a9682640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe0a4111060 0x7fe0a4111440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:53764/0 (socket says 172.21.15.192:53764) 2024-09-10T05:11:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.673+0000 7fe0a8e81640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fe0a41154f0 0x7fe0a41159a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:42568/0 (socket says 172.21.15.192:42568) 2024-09-10T05:11:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.673+0000 7fe0a9682640 1 -- 172.21.15.192:0/1420111921 learned_addr learned my addr 172.21.15.192:0/1420111921 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:00.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.673+0000 7fe0a9682640 1 -- 172.21.15.192:0/1420111921 >> v1:172.21.15.139:6789/0 conn(0x7fe0a41154f0 legacy=0x7fe0a41159a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.673+0000 7fe0a9682640 1 -- 172.21.15.192:0/1420111921 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a4116260 con 0x7fe0a4111060 2024-09-10T05:11:00.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.674+0000 7fe0a9682640 1 --2- 172.21.15.192:0/1420111921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0a4111060 0x7fe0a4111440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe0940097f0 tx=0x7fe09402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3532f3c473b16a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:00.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.674+0000 7fe09bfff640 1 -- 172.21.15.192:0/1420111921 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe094037070 con 0x7fe0a4111060 2024-09-10T05:11:00.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.674+0000 7fe09bfff640 1 -- 172.21.15.192:0/1420111921 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe094032440 con 0x7fe0a4111060 2024-09-10T05:11:00.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.674+0000 7fe09bfff640 1 -- 172.21.15.192:0/1420111921 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe09402ae60 con 0x7fe0a4111060 2024-09-10T05:11:00.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.674+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/1420111921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0a4111060 msgr2=0x7fe0a4111440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.674+0000 7fe0ab8e6640 1 --2- 172.21.15.192:0/1420111921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0a4111060 0x7fe0a4111440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe0940097f0 tx=0x7fe09402a1e0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.675+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/1420111921 shutdown_connections 2024-09-10T05:11:00.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.675+0000 7fe0ab8e6640 1 --2- 172.21.15.192:0/1420111921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0a4111060 0x7fe0a4111440 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.675+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/1420111921 >> 172.21.15.192:0/1420111921 conn(0x7fe0a4071dd0 msgr2=0x7fe0a40741f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:00.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.675+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/1420111921 shutdown_connections 2024-09-10T05:11:00.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.675+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/1420111921 wait complete. 2024-09-10T05:11:00.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.675+0000 7fe0ab8e6640 1 Processor -- start 2024-09-10T05:11:00.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.675+0000 7fe0ab8e6640 1 -- start start 2024-09-10T05:11:00.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.675+0000 7fe0ab8e6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0a4111060 0x7fe0a41a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:00.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.675+0000 7fe0ab8e6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a411cbd0 con 0x7fe0a4111060 2024-09-10T05:11:00.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.676+0000 7fe0a9682640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0a4111060 0x7fe0a41a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:00.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.676+0000 7fe0a9682640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0a4111060 0x7fe0a41a54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:53778/0 (socket says 172.21.15.192:53778) 2024-09-10T05:11:00.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.676+0000 7fe0a9682640 1 -- 172.21.15.192:0/3956064236 learned_addr learned my addr 172.21.15.192:0/3956064236 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:00.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.676+0000 7fe0a9682640 1 -- 172.21.15.192:0/3956064236 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a41a5ac0 con 0x7fe0a4111060 2024-09-10T05:11:00.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.676+0000 7fe0a9682640 1 --2- 172.21.15.192:0/3956064236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0a4111060 0x7fe0a41a54f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe09402a220 tx=0x7fe0940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:00.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.676+0000 7fe099ffb640 1 -- 172.21.15.192:0/3956064236 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe094041070 con 0x7fe0a4111060 2024-09-10T05:11:00.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.676+0000 7fe099ffb640 1 -- 172.21.15.192:0/3956064236 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09403c7a0 con 0x7fe0a4111060 2024-09-10T05:11:00.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.676+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/3956064236 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a41a5db0 con 0x7fe0a4111060 2024-09-10T05:11:00.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.676+0000 7fe099ffb640 1 -- 172.21.15.192:0/3956064236 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe094037040 con 0x7fe0a4111060 2024-09-10T05:11:00.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.676+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/3956064236 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a41aaf80 con 0x7fe0a4111060 2024-09-10T05:11:00.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.677+0000 7fe099ffb640 1 -- 172.21.15.192:0/3956064236 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe094044070 con 0x7fe0a4111060 2024-09-10T05:11:00.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.677+0000 7fe099ffb640 1 -- 172.21.15.192:0/3956064236 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fe09403d3f0 con 0x7fe0a4111060 2024-09-10T05:11:00.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.677+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/3956064236 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a41a60f0 con 0x7fe0a4111060 2024-09-10T05:11:00.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.679+0000 7fe099ffb640 1 -- 172.21.15.192:0/3956064236 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe094046450 con 0x7fe0a4111060 2024-09-10T05:11:00.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.750+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/3956064236 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c4099f78-d4fa-41cd-a4c4-2aa56d3d1e62", "id": 3} v 0) -- 0x7fe0a41114c0 con 0x7fe0a4111060 2024-09-10T05:11:00.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.753+0000 7fe099ffb640 1 -- 172.21.15.192:0/3956064236 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4099f78-d4fa-41cd-a4c4-2aa56d3d1e62", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fe09403cac0 con 0x7fe0a4111060 2024-09-10T05:11:00.754 INFO:teuthology.orchestra.run.smithi192.stdout:3 2024-09-10T05:11:00.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.754+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/3956064236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0a4111060 msgr2=0x7fe0a41a54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.754+0000 7fe0ab8e6640 1 --2- 172.21.15.192:0/3956064236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0a4111060 0x7fe0a41a54f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe09402a220 tx=0x7fe0940046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.755+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/3956064236 shutdown_connections 2024-09-10T05:11:00.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.755+0000 7fe0ab8e6640 1 --2- 172.21.15.192:0/3956064236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0a4111060 0x7fe0a41a54f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.755+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/3956064236 >> 172.21.15.192:0/3956064236 conn(0x7fe0a4071dd0 msgr2=0x7fe0a4114560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:00.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.755+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/3956064236 shutdown_connections 2024-09-10T05:11:00.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:00.755+0000 7fe0ab8e6640 1 -- 172.21.15.192:0/3956064236 wait complete. 2024-09-10T05:11:00.766 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T05:11:00.766 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T05:11:00.768 INFO:tasks.ceph.osd.0:Started 2024-09-10T05:11:00.768 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T05:11:00.769 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T05:11:00.771 INFO:tasks.ceph.osd.1:Started 2024-09-10T05:11:00.771 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T05:11:00.771 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T05:11:00.773 INFO:tasks.ceph.osd.2:Started 2024-09-10T05:11:00.773 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T05:11:00.773 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T05:11:00.775 INFO:tasks.ceph.osd.3:Started 2024-09-10T05:11:00.775 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:11:00.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.874+0000 7f27449ec640 1 Processor -- start 2024-09-10T05:11:00.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.874+0000 7f27449ec640 1 -- start start 2024-09-10T05:11:00.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.875+0000 7f27449ec640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f274012f160 0x7f274012f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:00.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.875+0000 7f27449ec640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2740070f40 con 0x7f274012fa80 2024-09-10T05:11:00.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.875+0000 7f27449ec640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f2740070d70 con 0x7f274012f160 2024-09-10T05:11:00.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.875+0000 7f273e59c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f274012f160 0x7f274012f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:00.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.875+0000 7f273dd9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f274012fa80 0x7f274012bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:43770/0 (socket says 172.21.15.139:43770) 2024-09-10T05:11:00.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.875+0000 7f273dd9b640 1 -- 172.21.15.139:0/1513033859 learned_addr learned my addr 172.21.15.139:0/1513033859 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:00.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.875+0000 7f273e59c640 1 -- 172.21.15.139:0/1513033859 >> v1:172.21.15.139:6789/0 conn(0x7f274012fa80 legacy=0x7f274012bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.875+0000 7f273e59c640 1 -- 172.21.15.139:0/1513033859 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2740072160 con 0x7f274012f160 2024-09-10T05:11:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.876+0000 7f273e59c640 1 --2- 172.21.15.139:0/1513033859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f274012f160 0x7f274012f540 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2738009d90 tx=0x7f273802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a2139c9ae47242 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.876+0000 7f273d59a640 1 -- 172.21.15.139:0/1513033859 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2738007670 con 0x7f274012f160 2024-09-10T05:11:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.876+0000 7f273d59a640 1 -- 172.21.15.139:0/1513033859 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2738007810 con 0x7f274012f160 2024-09-10T05:11:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.876+0000 7f273d59a640 1 -- 172.21.15.139:0/1513033859 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2738007b10 con 0x7f274012f160 2024-09-10T05:11:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.876+0000 7f27449ec640 1 -- 172.21.15.139:0/1513033859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f274012f160 msgr2=0x7f274012f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.876+0000 7f27449ec640 1 --2- 172.21.15.139:0/1513033859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f274012f160 0x7f274012f540 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2738009d90 tx=0x7f273802a660 comp rx=0 tx=0).stop 2024-09-10T05:11:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.876+0000 7f27449ec640 1 -- 172.21.15.139:0/1513033859 shutdown_connections 2024-09-10T05:11:00.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.876+0000 7f27449ec640 1 --2- 172.21.15.139:0/1513033859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f274012f160 0x7f274012f540 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.876+0000 7f27449ec640 1 -- 172.21.15.139:0/1513033859 >> 172.21.15.139:0/1513033859 conn(0x7f27400a0ae0 msgr2=0x7f274006dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:00.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.877+0000 7f27449ec640 1 -- 172.21.15.139:0/1513033859 shutdown_connections 2024-09-10T05:11:00.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.877+0000 7f27449ec640 1 -- 172.21.15.139:0/1513033859 wait complete. 2024-09-10T05:11:00.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.877+0000 7f27449ec640 1 Processor -- start 2024-09-10T05:11:00.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.878+0000 7f27449ec640 1 -- start start 2024-09-10T05:11:00.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.878+0000 7f27449ec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f274012f160 0x7f274011fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:00.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.878+0000 7f27449ec640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f274012c310 con 0x7f274012f160 2024-09-10T05:11:00.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.878+0000 7f273e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f274012f160 0x7f274011fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:00.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.878+0000 7f273e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f274012f160 0x7f274011fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38852/0 (socket says 172.21.15.139:38852) 2024-09-10T05:11:00.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.878+0000 7f273e59c640 1 -- 172.21.15.139:0/1500419202 learned_addr learned my addr 172.21.15.139:0/1500419202 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:00.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.878+0000 7f273e59c640 1 -- 172.21.15.139:0/1500419202 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2740122e00 con 0x7f274012f160 2024-09-10T05:11:00.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.878+0000 7f273e59c640 1 --2- 172.21.15.139:0/1500419202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f274012f160 0x7f274011fd20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2738009d90 tx=0x7f2738004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:00.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.878+0000 7f2736ffd640 1 -- 172.21.15.139:0/1500419202 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2738040070 con 0x7f274012f160 2024-09-10T05:11:00.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.879+0000 7f2736ffd640 1 -- 172.21.15.139:0/1500419202 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2738031b10 con 0x7f274012f160 2024-09-10T05:11:00.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.879+0000 7f27449ec640 1 -- 172.21.15.139:0/1500419202 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2740123130 con 0x7f274012f160 2024-09-10T05:11:00.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.879+0000 7f2736ffd640 1 -- 172.21.15.139:0/1500419202 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2738031df0 con 0x7f274012f160 2024-09-10T05:11:00.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.879+0000 7f27449ec640 1 -- 172.21.15.139:0/1500419202 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27401227c0 con 0x7f274012f160 2024-09-10T05:11:00.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.879+0000 7f2736ffd640 1 -- 172.21.15.139:0/1500419202 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2738039040 con 0x7f274012f160 2024-09-10T05:11:00.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.879+0000 7f2736ffd640 1 -- 172.21.15.139:0/1500419202 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f273802ae00 con 0x7f274012f160 2024-09-10T05:11:00.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.879+0000 7f27449ec640 1 -- 172.21.15.139:0/1500419202 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2740073370 con 0x7f274012f160 2024-09-10T05:11:00.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.881+0000 7f2736ffd640 1 -- 172.21.15.139:0/1500419202 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2738053080 con 0x7f274012f160 2024-09-10T05:11:00.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.941+0000 7f27449ec640 1 -- 172.21.15.139:0/1500419202 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f274012c860 con 0x7f274012f160 2024-09-10T05:11:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.941+0000 7f2736ffd640 1 -- 172.21.15.139:0/1500419202 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f2740122e00 con 0x7f274012f160 2024-09-10T05:11:00.945 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:11:00.945 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":6,"fsid":"3465d198-8f8d-4e0c-ba83-88b13d9b49be","created":"2024-09-10T05:10:59.697360+0000","modified":"2024-09-10T05:11:00.751464+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T05:11:00.751464+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"66219d18-2e08-4bf8-9271-bfaf3e270982","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c8cf450e-b552-4e11-aa38-83613145105d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7e53ce5e-92fc-4417-b675-a20d8b740415","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c4099f78-d4fa-41cd-a4c4-2aa56d3d1e62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:11:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.942+0000 7f27449ec640 1 -- 172.21.15.139:0/1500419202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f274012f160 msgr2=0x7f274011fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.942+0000 7f27449ec640 1 --2- 172.21.15.139:0/1500419202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f274012f160 0x7f274011fd20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2738009d90 tx=0x7f2738004a40 comp rx=0 tx=0).stop 2024-09-10T05:11:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.942+0000 7f27449ec640 1 -- 172.21.15.139:0/1500419202 shutdown_connections 2024-09-10T05:11:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.942+0000 7f27449ec640 1 --2- 172.21.15.139:0/1500419202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f274012f160 0x7f274011fd20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.942+0000 7f27449ec640 1 -- 172.21.15.139:0/1500419202 >> 172.21.15.139:0/1500419202 conn(0x7f27400a0ae0 msgr2=0x7f2740118a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.942+0000 7f27449ec640 1 -- 172.21.15.139:0/1500419202 shutdown_connections 2024-09-10T05:11:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:00.942+0000 7f27449ec640 1 -- 172.21.15.139:0/1500419202 wait complete. 2024-09-10T05:11:00.954 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T05:11:00.955 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T05:11:01.358 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T05:11:01.452 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.450+0000 7f1975aa9640 1 Processor -- start 2024-09-10T05:11:01.452 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.450+0000 7f1975aa9640 1 -- start start 2024-09-10T05:11:01.453 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.450+0000 7f1975aa9640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1970112210 0x7f19701314b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:01.453 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.450+0000 7f1975aa9640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1970113060 con 0x7f1970111720 2024-09-10T05:11:01.453 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.450+0000 7f1975aa9640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f197010fff0 con 0x7f1970112210 2024-09-10T05:11:01.453 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.451+0000 7f196f7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1970111720 0x7f1970111b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:43782/0 (socket says 172.21.15.139:43782) 2024-09-10T05:11:01.453 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.451+0000 7f196f7fe640 1 -- 172.21.15.139:0/326598884 learned_addr learned my addr 172.21.15.139:0/326598884 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:01.453 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.451+0000 7f196effd640 1 --2- 172.21.15.139:0/326598884 >> v2:172.21.15.139:3300/0 conn(0x7f1970112210 0x7f19701314b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:01.453 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.451+0000 7f196e7fc640 1 -- 172.21.15.139:0/326598884 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291520510 0 0) 0x7f1960001110 con 0x7f1970111720 2024-09-10T05:11:01.453 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.451+0000 7f196e7fc640 1 -- 172.21.15.139:0/326598884 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1958003520 con 0x7f1970111720 2024-09-10T05:11:01.453 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.451+0000 7f196effd640 1 -- 172.21.15.139:0/326598884 >> v1:172.21.15.139:6789/0 conn(0x7f1970111720 legacy=0x7f1970111b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:01.453 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.451+0000 7f196effd640 1 -- 172.21.15.139:0/326598884 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19701132a0 con 0x7f1970112210 2024-09-10T05:11:01.456 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.452+0000 7f196effd640 1 --2- 172.21.15.139:0/326598884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1970112210 0x7f19701314b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1964009720 tx=0x7f196402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9ab736a67a78de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:01.456 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.452+0000 7f196e7fc640 1 -- 172.21.15.139:0/326598884 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1964037070 con 0x7f1970112210 2024-09-10T05:11:01.456 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.452+0000 7f196e7fc640 1 -- 172.21.15.139:0/326598884 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196402ae20 con 0x7f1970112210 2024-09-10T05:11:01.457 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.452+0000 7f196e7fc640 1 -- 172.21.15.139:0/326598884 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1964032590 con 0x7f1970112210 2024-09-10T05:11:01.457 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.452+0000 7f1975aa9640 1 -- 172.21.15.139:0/326598884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1970112210 msgr2=0x7f19701314b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:01.457 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.452+0000 7f1975aa9640 1 --2- 172.21.15.139:0/326598884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1970112210 0x7f19701314b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1964009720 tx=0x7f196402a1a0 comp rx=0 tx=0).stop 2024-09-10T05:11:01.457 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.452+0000 7f1975aa9640 1 -- 172.21.15.139:0/326598884 shutdown_connections 2024-09-10T05:11:01.457 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.452+0000 7f1975aa9640 1 --2- 172.21.15.139:0/326598884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1970112210 0x7f19701314b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:01.457 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.452+0000 7f1975aa9640 1 -- 172.21.15.139:0/326598884 >> 172.21.15.139:0/326598884 conn(0x7f197006fcf0 msgr2=0x7f19700720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:01.457 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.452+0000 7f1975aa9640 1 -- 172.21.15.139:0/326598884 shutdown_connections 2024-09-10T05:11:01.457 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.452+0000 7f1975aa9640 1 -- 172.21.15.139:0/326598884 wait complete. 2024-09-10T05:11:01.457 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.453+0000 7f1975aa9640 1 Processor -- start 2024-09-10T05:11:01.457 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.453+0000 7f1975aa9640 1 -- start start 2024-09-10T05:11:01.457 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f1975aa9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1970111720 0x7f1970119a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:01.457 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f1975aa9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1970113950 con 0x7f1970111720 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f196f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1970111720 0x7f1970119a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f196f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1970111720 0x7f1970119a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38874/0 (socket says 172.21.15.139:38874) 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f196f7fe640 1 -- 172.21.15.139:0/2091593447 learned_addr learned my addr 172.21.15.139:0/2091593447 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f196f7fe640 1 -- 172.21.15.139:0/2091593447 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197011c270 con 0x7f1970111720 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f196f7fe640 1 --2- 172.21.15.139:0/2091593447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1970111720 0x7f1970119a10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f196000c680 tx=0x7f196000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f1957fff640 1 -- 172.21.15.139:0/2091593447 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19600058b0 con 0x7f1970111720 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f1957fff640 1 -- 172.21.15.139:0/2091593447 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1960005a50 con 0x7f1970111720 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f1957fff640 1 -- 172.21.15.139:0/2091593447 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1960005db0 con 0x7f1970111720 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f1975aa9640 1 -- 172.21.15.139:0/2091593447 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197011c560 con 0x7f1970111720 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f1975aa9640 1 -- 172.21.15.139:0/2091593447 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f197011a130 con 0x7f1970111720 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.454+0000 7f1957fff640 1 -- 172.21.15.139:0/2091593447 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1960007070 con 0x7f1970111720 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.455+0000 7f1957fff640 1 -- 172.21.15.139:0/2091593447 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f196000ad30 con 0x7f1970111720 2024-09-10T05:11:01.458 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.455+0000 7f1975aa9640 1 -- 172.21.15.139:0/2091593447 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1970111b00 con 0x7f1970111720 2024-09-10T05:11:01.459 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.457+0000 7f1957fff640 1 -- 172.21.15.139:0/2091593447 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1970113060 con 0x7f1970111720 2024-09-10T05:11:01.518 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.517+0000 7f1975aa9640 1 -- 172.21.15.139:0/2091593447 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1970126670 con 0x7f1970111720 2024-09-10T05:11:01.519 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.518+0000 7f1957fff640 1 -- 172.21.15.139:0/2091593447 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f19600076a0 con 0x7f1970111720 2024-09-10T05:11:01.519 INFO:teuthology.misc.health.smithi139.stdout: 2024-09-10T05:11:01.519 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":6,"fsid":"3465d198-8f8d-4e0c-ba83-88b13d9b49be","created":"2024-09-10T05:10:59.697360+0000","modified":"2024-09-10T05:11:00.751464+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T05:11:00.751464+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"66219d18-2e08-4bf8-9271-bfaf3e270982","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c8cf450e-b552-4e11-aa38-83613145105d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7e53ce5e-92fc-4417-b675-a20d8b740415","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c4099f78-d4fa-41cd-a4c4-2aa56d3d1e62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:11:01.520 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.518+0000 7f1975aa9640 1 -- 172.21.15.139:0/2091593447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1970111720 msgr2=0x7f1970119a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:01.520 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.518+0000 7f1975aa9640 1 --2- 172.21.15.139:0/2091593447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1970111720 0x7f1970119a10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f196000c680 tx=0x7f196000cb40 comp rx=0 tx=0).stop 2024-09-10T05:11:01.520 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.518+0000 7f1975aa9640 1 -- 172.21.15.139:0/2091593447 shutdown_connections 2024-09-10T05:11:01.520 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.518+0000 7f1975aa9640 1 --2- 172.21.15.139:0/2091593447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1970111720 0x7f1970119a10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:01.520 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.518+0000 7f1975aa9640 1 -- 172.21.15.139:0/2091593447 >> 172.21.15.139:0/2091593447 conn(0x7f197006fcf0 msgr2=0x7f1970125070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:01.520 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.518+0000 7f1975aa9640 1 -- 172.21.15.139:0/2091593447 shutdown_connections 2024-09-10T05:11:01.520 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:01.518+0000 7f1975aa9640 1 -- 172.21.15.139:0/2091593447 wait complete. 2024-09-10T05:11:01.528 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-10T05:11:01.730 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-10T05:11:01.729+0000 7f9300631640 -1 Falling back to public interface 2024-09-10T05:11:02.473 INFO:tasks.ceph.osd.1.smithi192.stderr:2024-09-10T05:11:02.472+0000 7f9fbf302640 -1 Falling back to public interface 2024-09-10T05:11:02.474 INFO:tasks.ceph.osd.2.smithi192.stderr:2024-09-10T05:11:02.472+0000 7f086fa60640 -1 Falling back to public interface 2024-09-10T05:11:02.474 INFO:tasks.ceph.osd.1.smithi192.stderr:2024-09-10T05:11:02.472+0000 7f9fbe2aa640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-09-10T05:11:02.474 INFO:tasks.ceph.osd.1.smithi192.stderr:2024-09-10T05:11:02.473+0000 7f9fbe2aa640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6813/0: (98) Address already in use 2024-09-10T05:11:02.479 INFO:tasks.ceph.osd.3.smithi192.stderr:2024-09-10T05:11:02.478+0000 7f0fada12640 -1 Falling back to public interface 2024-09-10T05:11:04.879 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-09-10T05:11:04.878+0000 7f81a03c9640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-10T05:11:05.222 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-10T05:11:05.221+0000 7f9300631640 -1 osd.0 0 log_to_monitors true 2024-09-10T05:11:06.293 INFO:tasks.ceph.osd.1.smithi192.stderr:2024-09-10T05:11:06.292+0000 7f9fbf302640 -1 osd.1 0 log_to_monitors true 2024-09-10T05:11:06.335 INFO:tasks.ceph.osd.2.smithi192.stderr:2024-09-10T05:11:06.334+0000 7f086fa60640 -1 osd.2 0 log_to_monitors true 2024-09-10T05:11:06.541 INFO:tasks.ceph.osd.3.smithi192.stderr:2024-09-10T05:11:06.540+0000 7f0fada12640 -1 osd.3 0 log_to_monitors true 2024-09-10T05:11:07.694 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-10T05:11:07.693+0000 7f92fc5c0640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T05:11:07.703 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-09-10T05:11:07.702+0000 7f92f43df640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:11:07.932 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T05:11:08.020 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.019+0000 7f075c53d640 1 Processor -- start 2024-09-10T05:11:08.020 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.019+0000 7f075c53d640 1 -- start start 2024-09-10T05:11:08.021 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.020+0000 7f075c53d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f075412cfb0 0x7f075412d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:08.021 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.020+0000 7f075c53d640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0754114860 con 0x7f0754114110 2024-09-10T05:11:08.021 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.020+0000 7f075c53d640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f0754114a30 con 0x7f075412cfb0 2024-09-10T05:11:08.022 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.020+0000 7f075a2d9640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f075412cfb0 0x7f075412d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:08.022 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.020+0000 7f0759ad8640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f0754114110 0x7f075412d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:32852/0 (socket says 172.21.15.139:32852) 2024-09-10T05:11:08.022 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.020+0000 7f0759ad8640 1 -- 172.21.15.139:0/1817104345 learned_addr learned my addr 172.21.15.139:0/1817104345 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:08.022 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.020+0000 7f075a2d9640 1 -- 172.21.15.139:0/1817104345 >> v1:172.21.15.139:6789/0 conn(0x7f0754114110 legacy=0x7f075412d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:08.022 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.020+0000 7f075a2d9640 1 -- 172.21.15.139:0/1817104345 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0754133340 con 0x7f075412cfb0 2024-09-10T05:11:08.023 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.021+0000 7f075a2d9640 1 --2- 172.21.15.139:0/1817104345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075412cfb0 0x7f075412d390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0750009720 tx=0x7f075002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac9c19afc66b21f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:08.023 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.021+0000 7f07592d7640 1 -- 172.21.15.139:0/1817104345 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0750037070 con 0x7f075412cfb0 2024-09-10T05:11:08.023 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.021+0000 7f07592d7640 1 -- 172.21.15.139:0/1817104345 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f075002ad90 con 0x7f075412cfb0 2024-09-10T05:11:08.023 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.021+0000 7f07592d7640 1 -- 172.21.15.139:0/1817104345 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0750032590 con 0x7f075412cfb0 2024-09-10T05:11:08.023 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.021+0000 7f075c53d640 1 -- 172.21.15.139:0/1817104345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075412cfb0 msgr2=0x7f075412d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:08.023 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.021+0000 7f075c53d640 1 --2- 172.21.15.139:0/1817104345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075412cfb0 0x7f075412d390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0750009720 tx=0x7f075002a110 comp rx=0 tx=0).stop 2024-09-10T05:11:08.023 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.021+0000 7f075c53d640 1 -- 172.21.15.139:0/1817104345 shutdown_connections 2024-09-10T05:11:08.023 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.021+0000 7f075c53d640 1 --2- 172.21.15.139:0/1817104345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f075412cfb0 0x7f075412d390 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:08.023 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.022+0000 7f075c53d640 1 -- 172.21.15.139:0/1817104345 >> 172.21.15.139:0/1817104345 conn(0x7f075406fcf0 msgr2=0x7f07540720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:08.024 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.022+0000 7f075c53d640 1 -- 172.21.15.139:0/1817104345 shutdown_connections 2024-09-10T05:11:08.024 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.022+0000 7f075c53d640 1 -- 172.21.15.139:0/1817104345 wait complete. 2024-09-10T05:11:08.026 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.022+0000 7f075c53d640 1 Processor -- start 2024-09-10T05:11:08.026 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.022+0000 7f075c53d640 1 -- start start 2024-09-10T05:11:08.026 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.023+0000 7f075c53d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0754114110 0x7f075412fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:08.026 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.023+0000 7f075c53d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f07541326c0 con 0x7f0754114110 2024-09-10T05:11:08.026 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.023+0000 7f075a2d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0754114110 0x7f075412fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:08.026 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.023+0000 7f075a2d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0754114110 0x7f075412fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35570/0 (socket says 172.21.15.139:35570) 2024-09-10T05:11:08.026 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.023+0000 7f075a2d9640 1 -- 172.21.15.139:0/665965807 learned_addr learned my addr 172.21.15.139:0/665965807 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:08.026 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.023+0000 7f075a2d9640 1 -- 172.21.15.139:0/665965807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0754132090 con 0x7f0754114110 2024-09-10T05:11:08.026 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.023+0000 7f075a2d9640 1 --2- 172.21.15.139:0/665965807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0754114110 0x7f075412fd70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0750009840 tx=0x7f07500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:08.026 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.023+0000 7f074affd640 1 -- 172.21.15.139:0/665965807 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0750041070 con 0x7f0754114110 2024-09-10T05:11:08.026 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.023+0000 7f074affd640 1 -- 172.21.15.139:0/665965807 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f075003c460 con 0x7f0754114110 2024-09-10T05:11:08.026 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.023+0000 7f075c53d640 1 -- 172.21.15.139:0/665965807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0754131420 con 0x7f0754114110 2024-09-10T05:11:08.027 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.023+0000 7f074affd640 1 -- 172.21.15.139:0/665965807 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0750037040 con 0x7f0754114110 2024-09-10T05:11:08.027 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.023+0000 7f075c53d640 1 -- 172.21.15.139:0/665965807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0754115440 con 0x7f0754114110 2024-09-10T05:11:08.027 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.024+0000 7f074affd640 1 -- 172.21.15.139:0/665965807 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) ==== 50363+0+0 (secure 0 0 0) 0x7f0750044070 con 0x7f0754114110 2024-09-10T05:11:08.027 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.024+0000 7f075c53d640 1 -- 172.21.15.139:0/665965807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0754132c00 con 0x7f0754114110 2024-09-10T05:11:08.027 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.024+0000 7f074affd640 1 --2- 172.21.15.139:0/665965807 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f073803de00 0x7f07380402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:08.027 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.024+0000 7f074affd640 1 -- 172.21.15.139:0/665965807 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1903+0+0 (secure 0 0 0) 0x7f07500722f0 con 0x7f0754114110 2024-09-10T05:11:08.027 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.025+0000 7f0759ad8640 1 --2- 172.21.15.139:0/665965807 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f073803de00 0x7f07380402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:08.027 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.025+0000 7f0759ad8640 1 --2- 172.21.15.139:0/665965807 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f073803de00 0x7f07380402c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0744007fd0 tx=0x7f0744007aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:08.030 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.029+0000 7f074affd640 1 -- 172.21.15.139:0/665965807 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f0754132090 con 0x7f0754114110 2024-09-10T05:11:08.205 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.204+0000 7f075c53d640 1 -- 172.21.15.139:0/665965807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0754131d60 con 0x7f0754114110 2024-09-10T05:11:08.205 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.204+0000 7f074affd640 1 -- 172.21.15.139:0/665965807 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+4661 (secure 0 0 0) 0x7f075004e350 con 0x7f0754114110 2024-09-10T05:11:08.206 INFO:teuthology.misc.health.smithi139.stdout: 2024-09-10T05:11:08.206 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":9,"fsid":"3465d198-8f8d-4e0c-ba83-88b13d9b49be","created":"2024-09-10T05:10:59.697360+0000","modified":"2024-09-10T05:11:07.885992+0000","last_up_change":"2024-09-10T05:11:07.885992+0000","last_in_change":"2024-09-10T05:11:00.751464+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"66219d18-2e08-4bf8-9271-bfaf3e270982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6801","nonce":2915567440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6803","nonce":2915567440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6807","nonce":2915567440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6805","nonce":2915567440}]},"public_addr":"172.21.15.139:6801/2915567440","cluster_addr":"172.21.15.139:6803/2915567440","heartbeat_back_addr":"172.21.15.139:6807/2915567440","heartbeat_front_addr":"172.21.15.139:6805/2915567440","state":["exists","up"]},{"osd":1,"uuid":"c8cf450e-b552-4e11-aa38-83613145105d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7e53ce5e-92fc-4417-b675-a20d8b740415","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c4099f78-d4fa-41cd-a4c4-2aa56d3d1e62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:11:08.208 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.206+0000 7f075c53d640 1 -- 172.21.15.139:0/665965807 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f073803de00 msgr2=0x7f07380402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:08.208 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.206+0000 7f075c53d640 1 --2- 172.21.15.139:0/665965807 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f073803de00 0x7f07380402c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0744007fd0 tx=0x7f0744007aa0 comp rx=0 tx=0).stop 2024-09-10T05:11:08.208 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.206+0000 7f075c53d640 1 -- 172.21.15.139:0/665965807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0754114110 msgr2=0x7f075412fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:08.208 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.206+0000 7f075c53d640 1 --2- 172.21.15.139:0/665965807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0754114110 0x7f075412fd70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0750009840 tx=0x7f07500046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:08.208 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.206+0000 7f075c53d640 1 -- 172.21.15.139:0/665965807 shutdown_connections 2024-09-10T05:11:08.208 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.206+0000 7f075c53d640 1 --2- 172.21.15.139:0/665965807 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f073803de00 0x7f07380402c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:08.208 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.206+0000 7f075c53d640 1 --2- 172.21.15.139:0/665965807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0754114110 0x7f075412fd70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:08.208 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.206+0000 7f075c53d640 1 -- 172.21.15.139:0/665965807 >> 172.21.15.139:0/665965807 conn(0x7f075406fcf0 msgr2=0x7f07541283a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:08.208 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.206+0000 7f075c53d640 1 -- 172.21.15.139:0/665965807 shutdown_connections 2024-09-10T05:11:08.209 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:08.206+0000 7f075c53d640 1 -- 172.21.15.139:0/665965807 wait complete. 2024-09-10T05:11:08.217 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-09-10T05:11:09.485 INFO:tasks.ceph.osd.2.smithi192.stderr:2024-09-10T05:11:09.485+0000 7f086c203640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T05:11:09.500 INFO:tasks.ceph.osd.2.smithi192.stderr:2024-09-10T05:11:09.500+0000 7f086380e640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:11:09.571 INFO:tasks.ceph.osd.1.smithi192.stderr:2024-09-10T05:11:09.571+0000 7f9fbb291640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T05:11:09.589 INFO:tasks.ceph.osd.1.smithi192.stderr:2024-09-10T05:11:09.589+0000 7f9fb30b0640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:11:09.592 INFO:tasks.ceph.osd.3.smithi192.stderr:2024-09-10T05:11:09.591+0000 7f0fa9423640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T05:11:09.603 INFO:tasks.ceph.osd.3.smithi192.stderr:2024-09-10T05:11:09.603+0000 7f0fa1242640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:11:14.622 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T05:11:14.717 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.715+0000 7f64811aa640 1 Processor -- start 2024-09-10T05:11:14.717 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.715+0000 7f64811aa640 1 -- start start 2024-09-10T05:11:14.718 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.716+0000 7f64811aa640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f647c132500 0x7f647c1348f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:14.718 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.716+0000 7f64811aa640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647c116f10 con 0x7f647c12bdf0 2024-09-10T05:11:14.718 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.716+0000 7f64811aa640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f647c1162d0 con 0x7f647c132500 2024-09-10T05:11:14.718 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.716+0000 7f647a59c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f647c132500 0x7f647c1348f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:14.718 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.716+0000 7f647ad9d640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f647c12bdf0 0x7f647c12c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60672/0 (socket says 172.21.15.139:60672) 2024-09-10T05:11:14.718 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.716+0000 7f647ad9d640 1 -- 172.21.15.139:0/2138272007 learned_addr learned my addr 172.21.15.139:0/2138272007 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:14.718 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.716+0000 7f647a59c640 1 -- 172.21.15.139:0/2138272007 >> v1:172.21.15.139:6789/0 conn(0x7f647c12bdf0 legacy=0x7f647c12c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:14.718 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.716+0000 7f647a59c640 1 -- 172.21.15.139:0/2138272007 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c116b50 con 0x7f647c132500 2024-09-10T05:11:14.721 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.717+0000 7f647a59c640 1 --2- 172.21.15.139:0/2138272007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c132500 0x7f647c1348f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f646c009720 tx=0x7f646c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7431e9ff212ce024 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:14.721 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.717+0000 7f6479d9b640 1 -- 172.21.15.139:0/2138272007 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f646c037070 con 0x7f647c132500 2024-09-10T05:11:14.721 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.717+0000 7f6479d9b640 1 -- 172.21.15.139:0/2138272007 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f646c02ad90 con 0x7f647c132500 2024-09-10T05:11:14.721 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.717+0000 7f6479d9b640 1 -- 172.21.15.139:0/2138272007 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f646c032590 con 0x7f647c132500 2024-09-10T05:11:14.721 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.717+0000 7f64811aa640 1 -- 172.21.15.139:0/2138272007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c132500 msgr2=0x7f647c1348f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:14.721 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.717+0000 7f64811aa640 1 --2- 172.21.15.139:0/2138272007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c132500 0x7f647c1348f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f646c009720 tx=0x7f646c02a110 comp rx=0 tx=0).stop 2024-09-10T05:11:14.721 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.717+0000 7f64811aa640 1 -- 172.21.15.139:0/2138272007 shutdown_connections 2024-09-10T05:11:14.721 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.717+0000 7f64811aa640 1 --2- 172.21.15.139:0/2138272007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c132500 0x7f647c1348f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.717+0000 7f64811aa640 1 -- 172.21.15.139:0/2138272007 >> 172.21.15.139:0/2138272007 conn(0x7f647c0721c0 msgr2=0x7f647c0725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.717+0000 7f64811aa640 1 -- 172.21.15.139:0/2138272007 shutdown_connections 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.717+0000 7f64811aa640 1 -- 172.21.15.139:0/2138272007 wait complete. 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.719+0000 7f64811aa640 1 Processor -- start 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.719+0000 7f64811aa640 1 -- start start 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.719+0000 7f64811aa640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c12bdf0 0x7f647c1c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.719+0000 7f64811aa640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f647c12c8e0 con 0x7f647c12bdf0 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.719+0000 7f647ad9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c12bdf0 0x7f647c1c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.719+0000 7f647ad9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c12bdf0 0x7f647c1c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46234/0 (socket says 172.21.15.139:46234) 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.719+0000 7f647ad9d640 1 -- 172.21.15.139:0/598384950 learned_addr learned my addr 172.21.15.139:0/598384950 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.719+0000 7f647ad9d640 1 -- 172.21.15.139:0/598384950 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c12fa60 con 0x7f647c12bdf0 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.719+0000 7f647ad9d640 1 --2- 172.21.15.139:0/598384950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c12bdf0 0x7f647c1c3d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f646400c480 tx=0x7f646400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:14.722 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.720+0000 7f64737fe640 1 -- 172.21.15.139:0/598384950 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464017070 con 0x7f647c12bdf0 2024-09-10T05:11:14.723 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.720+0000 7f64737fe640 1 -- 172.21.15.139:0/598384950 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6464005c10 con 0x7f647c12bdf0 2024-09-10T05:11:14.723 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.720+0000 7f64811aa640 1 -- 172.21.15.139:0/598384950 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c118750 con 0x7f647c12bdf0 2024-09-10T05:11:14.723 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.720+0000 7f64737fe640 1 -- 172.21.15.139:0/598384950 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6464007070 con 0x7f647c12bdf0 2024-09-10T05:11:14.723 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.720+0000 7f64811aa640 1 -- 172.21.15.139:0/598384950 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c117850 con 0x7f647c12bdf0 2024-09-10T05:11:14.724 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.721+0000 7f64737fe640 1 -- 172.21.15.139:0/598384950 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) ==== 50363+0+0 (secure 0 0 0) 0x7f646401a070 con 0x7f647c12bdf0 2024-09-10T05:11:14.724 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.721+0000 7f64811aa640 1 -- 172.21.15.139:0/598384950 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c12c1d0 con 0x7f647c12bdf0 2024-09-10T05:11:14.724 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.721+0000 7f64737fe640 1 --2- 172.21.15.139:0/598384950 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f645c03de00 0x7f645c0402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:14.724 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.721+0000 7f64737fe640 1 -- 172.21.15.139:0/598384950 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3129+0+0 (secure 0 0 0) 0x7f6464051200 con 0x7f647c12bdf0 2024-09-10T05:11:14.724 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.721+0000 7f647a59c640 1 --2- 172.21.15.139:0/598384950 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f645c03de00 0x7f645c0402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:14.724 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.722+0000 7f647a59c640 1 --2- 172.21.15.139:0/598384950 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f645c03de00 0x7f645c0402c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f646c009720 tx=0x7f646c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:14.726 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.725+0000 7f64737fe640 1 -- 172.21.15.139:0/598384950 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f647c116f10 con 0x7f647c12bdf0 2024-09-10T05:11:14.901 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.900+0000 7f64811aa640 1 -- 172.21.15.139:0/598384950 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f647c050d60 con 0x7f647c12bdf0 2024-09-10T05:11:14.902 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.901+0000 7f64737fe640 1 -- 172.21.15.139:0/598384950 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8026 (secure 0 0 0) 0x7f6464019cd0 con 0x7f647c12bdf0 2024-09-10T05:11:14.902 INFO:teuthology.misc.health.smithi139.stdout: 2024-09-10T05:11:14.902 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":15,"fsid":"3465d198-8f8d-4e0c-ba83-88b13d9b49be","created":"2024-09-10T05:10:59.697360+0000","modified":"2024-09-10T05:11:14.502159+0000","last_up_change":"2024-09-10T05:11:10.486612+0000","last_in_change":"2024-09-10T05:11:00.751464+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:11:11.892255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66219d18-2e08-4bf8-9271-bfaf3e270982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6801","nonce":2915567440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6803","nonce":2915567440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6807","nonce":2915567440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6805","nonce":2915567440}]},"public_addr":"172.21.15.139:6801/2915567440","cluster_addr":"172.21.15.139:6803/2915567440","heartbeat_back_addr":"172.21.15.139:6807/2915567440","heartbeat_front_addr":"172.21.15.139:6805/2915567440","state":["exists","up"]},{"osd":1,"uuid":"c8cf450e-b552-4e11-aa38-83613145105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6803","nonce":3487349558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6805","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6807","nonce":3487349558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6815","nonce":3487349558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6811","nonce":3487349558}]},"public_addr":"172.21.15.192:6803/3487349558","cluster_addr":"172.21.15.192:6807/3487349558","heartbeat_back_addr":"172.21.15.192:6815/3487349558","heartbeat_front_addr":"172.21.15.192:6811/3487349558","state":["exists","up"]},{"osd":2,"uuid":"7e53ce5e-92fc-4417-b675-a20d8b740415","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6801","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6802","nonce":2435677948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6806","nonce":2435677948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6813","nonce":2435677948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6810","nonce":2435677948}]},"public_addr":"172.21.15.192:6802/2435677948","cluster_addr":"172.21.15.192:6806/2435677948","heartbeat_back_addr":"172.21.15.192:6813/2435677948","heartbeat_front_addr":"172.21.15.192:6810/2435677948","state":["exists","up"]},{"osd":3,"uuid":"c4099f78-d4fa-41cd-a4c4-2aa56d3d1e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6817","nonce":1620624472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6819","nonce":1620624472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6823","nonce":1620624472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6821","nonce":1620624472}]},"public_addr":"172.21.15.192:6817/1620624472","cluster_addr":"172.21.15.192:6819/1620624472","heartbeat_back_addr":"172.21.15.192:6823/1620624472","heartbeat_front_addr":"172.21.15.192:6821/1620624472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:06.174920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:07.342107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:07.381356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:07.499864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:11:14.905 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.903+0000 7f64811aa640 1 -- 172.21.15.139:0/598384950 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f645c03de00 msgr2=0x7f645c0402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:14.905 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.903+0000 7f64811aa640 1 --2- 172.21.15.139:0/598384950 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f645c03de00 0x7f645c0402c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f646c009720 tx=0x7f646c02e000 comp rx=0 tx=0).stop 2024-09-10T05:11:14.905 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.903+0000 7f64811aa640 1 -- 172.21.15.139:0/598384950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c12bdf0 msgr2=0x7f647c1c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:14.905 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.903+0000 7f64811aa640 1 --2- 172.21.15.139:0/598384950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c12bdf0 0x7f647c1c3d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f646400c480 tx=0x7f646400c940 comp rx=0 tx=0).stop 2024-09-10T05:11:14.905 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.903+0000 7f64811aa640 1 -- 172.21.15.139:0/598384950 shutdown_connections 2024-09-10T05:11:14.905 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.903+0000 7f64811aa640 1 --2- 172.21.15.139:0/598384950 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f645c03de00 0x7f645c0402c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:14.905 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.903+0000 7f64811aa640 1 --2- 172.21.15.139:0/598384950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f647c12bdf0 0x7f647c1c3d70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:14.905 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.903+0000 7f64811aa640 1 -- 172.21.15.139:0/598384950 >> 172.21.15.139:0/598384950 conn(0x7f647c0721c0 msgr2=0x7f647c10fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:14.905 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.903+0000 7f64811aa640 1 -- 172.21.15.139:0/598384950 shutdown_connections 2024-09-10T05:11:14.905 INFO:teuthology.misc.health.smithi139.stderr:2024-09-10T05:11:14.903+0000 7f64811aa640 1 -- 172.21.15.139:0/598384950 wait complete. 2024-09-10T05:11:14.914 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-10T05:11:14.914 INFO:tasks.ceph:Creating RBD pool 2024-09-10T05:11:14.914 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-10T05:11:15.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.010+0000 7fa3bbe73640 1 Processor -- start 2024-09-10T05:11:15.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.010+0000 7fa3bbe73640 1 -- start start 2024-09-10T05:11:15.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.011+0000 7fa3bbe73640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa3b412ca00 0x7fa3b41314b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:15.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.011+0000 7fa3bbe73640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b409a160 con 0x7fa3b412bf10 2024-09-10T05:11:15.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.011+0000 7fa3bbe73640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fa3b406def0 con 0x7fa3b412ca00 2024-09-10T05:11:15.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.011+0000 7fa3b940e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa3b412ca00 0x7fa3b41314b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:15.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.011+0000 7fa3b9c0f640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa3b412bf10 0x7fa3b412c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60676/0 (socket says 172.21.15.139:60676) 2024-09-10T05:11:15.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.011+0000 7fa3b9c0f640 1 -- 172.21.15.139:0/1416551165 learned_addr learned my addr 172.21.15.139:0/1416551165 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:15.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.011+0000 7fa3b940e640 1 -- 172.21.15.139:0/1416551165 >> v1:172.21.15.139:6789/0 conn(0x7fa3b412bf10 legacy=0x7fa3b412c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:15.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.011+0000 7fa3b940e640 1 -- 172.21.15.139:0/1416551165 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b4099b10 con 0x7fa3b412ca00 2024-09-10T05:11:15.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.011+0000 7fa3b8c0d640 1 -- 172.21.15.139:0/1416551165 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578149997 0 0) 0x7fa3b409a160 con 0x7fa3b412bf10 2024-09-10T05:11:15.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.012+0000 7fa3b940e640 1 --2- 172.21.15.139:0/1416551165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3b412ca00 0x7fa3b41314b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009720 tx=0x7fa3a402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8160d74df42d3527 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:15.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.012+0000 7fa3b8c0d640 1 -- 172.21.15.139:0/1416551165 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a4037070 con 0x7fa3b412ca00 2024-09-10T05:11:15.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.012+0000 7fa3b8c0d640 1 -- 172.21.15.139:0/1416551165 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a402ad90 con 0x7fa3b412ca00 2024-09-10T05:11:15.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.012+0000 7fa3b8c0d640 1 -- 172.21.15.139:0/1416551165 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a4032590 con 0x7fa3b412ca00 2024-09-10T05:11:15.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.012+0000 7fa3bbe73640 1 -- 172.21.15.139:0/1416551165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3b412ca00 msgr2=0x7fa3b41314b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:15.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.012+0000 7fa3bbe73640 1 --2- 172.21.15.139:0/1416551165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3b412ca00 0x7fa3b41314b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009720 tx=0x7fa3a402a110 comp rx=0 tx=0).stop 2024-09-10T05:11:15.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.012+0000 7fa3bbe73640 1 -- 172.21.15.139:0/1416551165 shutdown_connections 2024-09-10T05:11:15.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.012+0000 7fa3bbe73640 1 --2- 172.21.15.139:0/1416551165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3b412ca00 0x7fa3b41314b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:15.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.012+0000 7fa3bbe73640 1 -- 172.21.15.139:0/1416551165 >> 172.21.15.139:0/1416551165 conn(0x7fa3b409a930 msgr2=0x7fa3b409ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:15.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.013+0000 7fa3bbe73640 1 -- 172.21.15.139:0/1416551165 shutdown_connections 2024-09-10T05:11:15.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.013+0000 7fa3bbe73640 1 -- 172.21.15.139:0/1416551165 wait complete. 2024-09-10T05:11:15.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.013+0000 7fa3bbe73640 1 Processor -- start 2024-09-10T05:11:15.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.013+0000 7fa3bbe73640 1 -- start start 2024-09-10T05:11:15.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.014+0000 7fa3bbe73640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3b412bf10 0x7fa3b41c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:15.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.014+0000 7fa3bbe73640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b41319f0 con 0x7fa3b412bf10 2024-09-10T05:11:15.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.014+0000 7fa3b9c0f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3b412bf10 0x7fa3b41c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:15.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.014+0000 7fa3b9c0f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3b412bf10 0x7fa3b41c1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46254/0 (socket says 172.21.15.139:46254) 2024-09-10T05:11:15.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.014+0000 7fa3b9c0f640 1 -- 172.21.15.139:0/2413591518 learned_addr learned my addr 172.21.15.139:0/2413591518 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:15.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.014+0000 7fa3b9c0f640 1 -- 172.21.15.139:0/2413591518 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b4090280 con 0x7fa3b412bf10 2024-09-10T05:11:15.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.014+0000 7fa3b9c0f640 1 --2- 172.21.15.139:0/2413591518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3b412bf10 0x7fa3b41c1d20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000c3d0 tx=0x7fa3b000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:15.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.014+0000 7fa3aa7fc640 1 -- 172.21.15.139:0/2413591518 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3b00074d0 con 0x7fa3b412bf10 2024-09-10T05:11:15.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.014+0000 7fa3aa7fc640 1 -- 172.21.15.139:0/2413591518 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b00047e0 con 0x7fa3b412bf10 2024-09-10T05:11:15.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.014+0000 7fa3aa7fc640 1 -- 172.21.15.139:0/2413591518 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3b0007670 con 0x7fa3b412bf10 2024-09-10T05:11:15.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.014+0000 7fa3bbe73640 1 -- 172.21.15.139:0/2413591518 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b408f610 con 0x7fa3b412bf10 2024-09-10T05:11:15.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.014+0000 7fa3bbe73640 1 -- 172.21.15.139:0/2413591518 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b4090920 con 0x7fa3b412bf10 2024-09-10T05:11:15.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.015+0000 7fa3bbe73640 1 -- 172.21.15.139:0/2413591518 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b412c2f0 con 0x7fa3b412bf10 2024-09-10T05:11:15.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.015+0000 7fa3aa7fc640 1 -- 172.21.15.139:0/2413591518 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) ==== 50363+0+0 (secure 0 0 0) 0x7fa3b0011070 con 0x7fa3b412bf10 2024-09-10T05:11:15.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.016+0000 7fa3aa7fc640 1 --2- 172.21.15.139:0/2413591518 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa39803de30 0x7fa3980402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:15.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.016+0000 7fa3aa7fc640 1 -- 172.21.15.139:0/2413591518 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3129+0+0 (secure 0 0 0) 0x7fa3b0051b60 con 0x7fa3b412bf10 2024-09-10T05:11:15.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.016+0000 7fa3b940e640 1 --2- 172.21.15.139:0/2413591518 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa39803de30 0x7fa3980402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:15.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.017+0000 7fa3b940e640 1 --2- 172.21.15.139:0/2413591518 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa39803de30 0x7fa3980402f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4034000 tx=0x7fa3a402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:15.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.020+0000 7fa3aa7fc640 1 -- 172.21.15.139:0/2413591518 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fa3b4090920 con 0x7fa3b412bf10 2024-09-10T05:11:15.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.196+0000 7fa3bbe73640 1 -- 172.21.15.139:0/2413591518 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fa3b4068da0 con 0x7fa3b412bf10 2024-09-10T05:11:15.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.518+0000 7fa3aa7fc640 1 -- 172.21.15.139:0/2413591518 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) ==== 109+0+0 (secure 0 0 0) 0x7fa3b0012dd0 con 0x7fa3b412bf10 2024-09-10T05:11:15.519 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'rbd' created 2024-09-10T05:11:15.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.520+0000 7fa3bbe73640 1 -- 172.21.15.139:0/2413591518 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa39803de30 msgr2=0x7fa3980402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:15.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.520+0000 7fa3bbe73640 1 --2- 172.21.15.139:0/2413591518 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa39803de30 0x7fa3980402f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4034000 tx=0x7fa3a402e000 comp rx=0 tx=0).stop 2024-09-10T05:11:15.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.520+0000 7fa3bbe73640 1 -- 172.21.15.139:0/2413591518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3b412bf10 msgr2=0x7fa3b41c1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:15.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.520+0000 7fa3bbe73640 1 --2- 172.21.15.139:0/2413591518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3b412bf10 0x7fa3b41c1d20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000c3d0 tx=0x7fa3b000c890 comp rx=0 tx=0).stop 2024-09-10T05:11:15.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.520+0000 7fa3bbe73640 1 -- 172.21.15.139:0/2413591518 shutdown_connections 2024-09-10T05:11:15.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.520+0000 7fa3bbe73640 1 --2- 172.21.15.139:0/2413591518 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa39803de30 0x7fa3980402f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:15.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.520+0000 7fa3bbe73640 1 --2- 172.21.15.139:0/2413591518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3b412bf10 0x7fa3b41c1d20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:15.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.520+0000 7fa3bbe73640 1 -- 172.21.15.139:0/2413591518 >> 172.21.15.139:0/2413591518 conn(0x7fa3b409a930 msgr2=0x7fa3b406e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:15.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.520+0000 7fa3bbe73640 1 -- 172.21.15.139:0/2413591518 shutdown_connections 2024-09-10T05:11:15.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.520+0000 7fa3bbe73640 1 -- 172.21.15.139:0/2413591518 wait complete. 2024-09-10T05:11:15.533 DEBUG:teuthology.orchestra.run.smithi139:> rbd --cluster ceph pool init rbd 2024-09-10T05:11:15.589 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:15.589 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:15.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.589+0000 7facb1805f00 1 Processor -- start 2024-09-10T05:11:15.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.589+0000 7facb1805f00 1 -- start start 2024-09-10T05:11:15.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.589+0000 7facb1805f00 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55bab2c55a60 0x55bab2c55e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:15.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.589+0000 7facb1805f00 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55bab2adcf30 con 0x55bab2c56380 2024-09-10T05:11:15.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.589+0000 7facb1805f00 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55bab2b43a10 con 0x55bab2c55a60 2024-09-10T05:11:15.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.590+0000 7facb02f3640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55bab2c55a60 0x55bab2c55e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:15.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.590+0000 7facafaf2640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55bab2c56380 0x55bab2d032b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60688/0 (socket says 172.21.15.139:60688) 2024-09-10T05:11:15.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.590+0000 7facafaf2640 1 -- 172.21.15.139:0/2989019940 learned_addr learned my addr 172.21.15.139:0/2989019940 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:15.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.590+0000 7facb02f3640 1 -- 172.21.15.139:0/2989019940 >> v1:172.21.15.139:6789/0 conn(0x55bab2c56380 legacy=0x55bab2d032b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:15.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.590+0000 7facb02f3640 1 -- 172.21.15.139:0/2989019940 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab2ac20c0 con 0x55bab2c55a60 2024-09-10T05:11:15.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.592+0000 7facb02f3640 1 --2- 172.21.15.139:0/2989019940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bab2c55a60 0x55bab2c55e40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faca000a4a0 tx=0x7faca0045e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a04ebf20a7b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:15.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.592+0000 7facaf2f1640 1 -- 172.21.15.139:0/2989019940 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faca005a070 con 0x55bab2c55a60 2024-09-10T05:11:15.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.592+0000 7facaf2f1640 1 -- 172.21.15.139:0/2989019940 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca004d5f0 con 0x55bab2c55a60 2024-09-10T05:11:15.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.592+0000 7facaf2f1640 1 -- 172.21.15.139:0/2989019940 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faca004d910 con 0x55bab2c55a60 2024-09-10T05:11:15.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.592+0000 7facb1805f00 1 -- 172.21.15.139:0/2989019940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bab2c55a60 msgr2=0x55bab2c55e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:15.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.592+0000 7facb1805f00 1 --2- 172.21.15.139:0/2989019940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bab2c55a60 0x55bab2c55e40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faca000a4a0 tx=0x7faca0045e30 comp rx=0 tx=0).stop 2024-09-10T05:11:15.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.592+0000 7facb1805f00 1 -- 172.21.15.139:0/2989019940 shutdown_connections 2024-09-10T05:11:15.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.592+0000 7facb1805f00 1 --2- 172.21.15.139:0/2989019940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bab2c55a60 0x55bab2c55e40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:15.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.592+0000 7facb1805f00 1 -- 172.21.15.139:0/2989019940 >> 172.21.15.139:0/2989019940 conn(0x55bab2c72d50 msgr2=0x55bab2c6f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:15.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.592+0000 7facb1805f00 1 -- 172.21.15.139:0/2989019940 shutdown_connections 2024-09-10T05:11:15.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.592+0000 7facb1805f00 1 -- 172.21.15.139:0/2989019940 wait complete. 2024-09-10T05:11:15.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.593+0000 7facb1805f00 1 Processor -- start 2024-09-10T05:11:15.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.593+0000 7facb1805f00 1 -- start start 2024-09-10T05:11:15.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.593+0000 7facb1805f00 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bab2c55a60 0x55bab2cf3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:15.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.593+0000 7facb1805f00 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bab2b479c0 con 0x55bab2c55a60 2024-09-10T05:11:15.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.593+0000 7facb02f3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bab2c55a60 0x55bab2cf3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:15.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.594+0000 7facb02f3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bab2c55a60 0x55bab2cf3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46278/0 (socket says 172.21.15.139:46278) 2024-09-10T05:11:15.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.594+0000 7facb02f3640 1 -- 172.21.15.139:0/3317747294 learned_addr learned my addr 172.21.15.139:0/3317747294 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:15.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.594+0000 7facb02f3640 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab2cf55e0 con 0x55bab2c55a60 2024-09-10T05:11:15.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.594+0000 7facb02f3640 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bab2c55a60 0x55bab2cf3ee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faca0058040 tx=0x7faca0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:15.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.594+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faca0065020 con 0x55bab2c55a60 2024-09-10T05:11:15.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.594+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca004ec50 con 0x55bab2c55a60 2024-09-10T05:11:15.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.594+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faca005a040 con 0x55bab2c55a60 2024-09-10T05:11:15.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.594+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bab2cf61e0 con 0x55bab2c55a60 2024-09-10T05:11:15.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.594+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bab2cf4630 con 0x55bab2c55a60 2024-09-10T05:11:15.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.595+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 4) ==== 50363+0+0 (secure 0 0 0) 0x7faca0068020 con 0x55bab2c55a60 2024-09-10T05:11:15.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.595+0000 7facacaec640 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac9403c6f0 0x7fac9403ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:15.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.595+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3471+0+0 (secure 0 0 0) 0x7faca0095350 con 0x55bab2c55a60 2024-09-10T05:11:15.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.595+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55bab2d11ba0 con 0x55bab2c55a60 2024-09-10T05:11:15.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.596+0000 7facafaf2640 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac9403c6f0 0x7fac9403ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:15.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:15.596+0000 7facafaf2640 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac9403c6f0 0x7fac9403ebb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faca4004170 tx=0x7faca4001330 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:16.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.521+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v17) ==== 141+0+0 (secure 0 0 0) 0x7faca006f030 con 0x55bab2c55a60 2024-09-10T05:11:16.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.521+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faca004d5f0 con 0x55bab2c55a60 2024-09-10T05:11:16.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.524+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faca0055440 con 0x55bab2c55a60 2024-09-10T05:11:16.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.526+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 8 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7faca0006580 con 0x55bab2c55a60 2024-09-10T05:11:16.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.526+0000 7facaeaf0640 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7fac8c002ae0 con 0x55bab2c55a60 2024-09-10T05:11:16.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.526+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 9 ==== osd_map(17..17 src has 1..17) ==== 650+0+0 (secure 0 0 0) 0x7faca0093f40 con 0x55bab2c55a60 2024-09-10T05:11:16.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.526+0000 7facb1805f00 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55bab2c56380 0x55bab2d16ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:16.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.526+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x55bab2d17420 con 0x55bab2c56380 2024-09-10T05:11:16.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.527+0000 7facb1555640 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55bab2c56380 0x55bab2d16ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:16.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.527+0000 7facb1555640 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55bab2c56380 0x55bab2d16ee0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:16.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.535+0000 7facb1555640 1 -- 172.21.15.139:0/3317747294 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(1 rbd_trash [create] v17'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7faca8002040 con 0x55bab2c56380 2024-09-10T05:11:16.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.538+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x55bab2d69290 con 0x55bab2c56380 2024-09-10T05:11:16.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.538+0000 7facb1555640 1 -- 172.21.15.139:0/3317747294 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faca8002040 con 0x55bab2c56380 2024-09-10T05:11:16.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.538+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x55bab2d683a0 con 0x55bab2c56380 2024-09-10T05:11:16.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.539+0000 7facb1555640 1 -- 172.21.15.139:0/3317747294 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faca8002040 con 0x55bab2c56380 2024-09-10T05:11:16.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:16.539+0000 7facae2ef640 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fac90001f00 con 0x55bab2c55a60 2024-09-10T05:11:17.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:17.524+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v18) ==== 55+0+0 (secure 0 0 0) 0x7faca0019060 con 0x55bab2c55a60 2024-09-10T05:11:17.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:17.524+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=18}) -- 0x7fac94042430 con 0x55bab2c55a60 2024-09-10T05:11:17.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:17.524+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 11 ==== osd_map(18..18 src has 1..18) ==== 626+0+0 (secure 0 0 0) 0x7faca006ddc0 con 0x55bab2c55a60 2024-09-10T05:11:17.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:17.524+0000 7facaeaf0640 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7fac8c005780 con 0x55bab2c56380 2024-09-10T05:11:17.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:17.529+0000 7facb1555640 1 -- 172.21.15.139:0/3317747294 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v18'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7faca8002040 con 0x55bab2c56380 2024-09-10T05:11:17.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:17.530+0000 7facae2ef640 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v18) -- 0x7fac90003350 con 0x55bab2c55a60 2024-09-10T05:11:18.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.529+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v19) ==== 43+0+0 (secure 0 0 0) 0x7faca001b2e0 con 0x55bab2c55a60 2024-09-10T05:11:18.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.529+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=19}) -- 0x7fac94042600 con 0x55bab2c55a60 2024-09-10T05:11:18.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.529+0000 7facacaec640 1 -- 172.21.15.139:0/3317747294 <== mon.0 v2:172.21.15.139:3300/0 13 ==== osd_map(19..19 src has 1..19) ==== 654+0+0 (secure 0 0 0) 0x7faca0097120 con 0x55bab2c55a60 2024-09-10T05:11:18.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.529+0000 7facaeaf0640 1 -- 172.21.15.139:0/3317747294 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7fac8c005b20 con 0x55bab2c56380 2024-09-10T05:11:18.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1555640 1 -- 172.21.15.139:0/3317747294 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(7 rbd_info [write 0~19] v19'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faca8002040 con 0x55bab2c56380 2024-09-10T05:11:18.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55bab2c56380 msgr2=0x55bab2d16ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:18.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55bab2c56380 0x55bab2d16ee0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:18.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac9403c6f0 msgr2=0x7fac9403ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:18.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac9403c6f0 0x7fac9403ebb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faca4004170 tx=0x7faca4001330 comp rx=0 tx=0).stop 2024-09-10T05:11:18.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bab2c55a60 msgr2=0x55bab2cf3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:18.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bab2c55a60 0x55bab2cf3ee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faca0058040 tx=0x7faca0002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:18.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 shutdown_connections 2024-09-10T05:11:18.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac9403c6f0 0x7fac9403ebb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:18.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55bab2c56380 0x55bab2d16ee0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:18.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 --2- 172.21.15.139:0/3317747294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bab2c55a60 0x55bab2cf3ee0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:18.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 >> 172.21.15.139:0/3317747294 conn(0x55bab2c72d50 msgr2=0x55bab2d01c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:18.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 shutdown_connections 2024-09-10T05:11:18.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.533+0000 7facb1805f00 1 -- 172.21.15.139:0/3317747294 wait complete. 2024-09-10T05:11:18.539 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T05:11:18.540 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T05:11:18.540 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T05:11:18.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.645+0000 7fac608c6640 1 Processor -- start 2024-09-10T05:11:18.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.645+0000 7fac608c6640 1 -- start start 2024-09-10T05:11:18.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.646+0000 7fac608c6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fac5c09ecd0 0x7fac5c1314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:18.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.646+0000 7fac608c6640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c073050 con 0x7fac5c071d10 2024-09-10T05:11:18.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.646+0000 7fac608c6640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c073600 con 0x7fac5c09ecd0 2024-09-10T05:11:18.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.646+0000 7fac59d9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fac5c09ecd0 0x7fac5c1314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:18.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.646+0000 7fac5a59c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fac5c071d10 0x7fac5c0720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60690/0 (socket says 172.21.15.139:60690) 2024-09-10T05:11:18.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.646+0000 7fac5a59c640 1 -- 172.21.15.139:0/1046709428 learned_addr learned my addr 172.21.15.139:0/1046709428 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:18.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.646+0000 7fac59d9b640 1 -- 172.21.15.139:0/1046709428 >> v1:172.21.15.139:6789/0 conn(0x7fac5c071d10 legacy=0x7fac5c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:18.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.646+0000 7fac59d9b640 1 -- 172.21.15.139:0/1046709428 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c0732f0 con 0x7fac5c09ecd0 2024-09-10T05:11:18.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.647+0000 7fac59d9b640 1 --2- 172.21.15.139:0/1046709428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac5c09ecd0 0x7fac5c1314d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac44009720 tx=0x7fac4402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2c74f7aeb61ddc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:18.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.647+0000 7fac5959a640 1 -- 172.21.15.139:0/1046709428 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac44037070 con 0x7fac5c09ecd0 2024-09-10T05:11:18.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.647+0000 7fac5959a640 1 -- 172.21.15.139:0/1046709428 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4402ad90 con 0x7fac5c09ecd0 2024-09-10T05:11:18.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.647+0000 7fac5959a640 1 -- 172.21.15.139:0/1046709428 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac44032590 con 0x7fac5c09ecd0 2024-09-10T05:11:18.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.648+0000 7fac608c6640 1 -- 172.21.15.139:0/1046709428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac5c09ecd0 msgr2=0x7fac5c1314d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:18.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.648+0000 7fac608c6640 1 --2- 172.21.15.139:0/1046709428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac5c09ecd0 0x7fac5c1314d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac44009720 tx=0x7fac4402a110 comp rx=0 tx=0).stop 2024-09-10T05:11:18.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.648+0000 7fac608c6640 1 -- 172.21.15.139:0/1046709428 shutdown_connections 2024-09-10T05:11:18.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.648+0000 7fac608c6640 1 --2- 172.21.15.139:0/1046709428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac5c09ecd0 0x7fac5c1314d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:18.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.648+0000 7fac608c6640 1 -- 172.21.15.139:0/1046709428 >> 172.21.15.139:0/1046709428 conn(0x7fac5c09c640 msgr2=0x7fac5c06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:18.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.648+0000 7fac608c6640 1 -- 172.21.15.139:0/1046709428 shutdown_connections 2024-09-10T05:11:18.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.648+0000 7fac608c6640 1 -- 172.21.15.139:0/1046709428 wait complete. 2024-09-10T05:11:18.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.649+0000 7fac608c6640 1 Processor -- start 2024-09-10T05:11:18.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.649+0000 7fac608c6640 1 -- start start 2024-09-10T05:11:18.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.649+0000 7fac608c6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac5c071d10 0x7fac5c117560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:18.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.649+0000 7fac608c6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c072980 con 0x7fac5c071d10 2024-09-10T05:11:18.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.649+0000 7fac5a59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac5c071d10 0x7fac5c117560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:18.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.650+0000 7fac5a59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac5c071d10 0x7fac5c117560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46294/0 (socket says 172.21.15.139:46294) 2024-09-10T05:11:18.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.650+0000 7fac5a59c640 1 -- 172.21.15.139:0/69719598 learned_addr learned my addr 172.21.15.139:0/69719598 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:18.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.650+0000 7fac5a59c640 1 -- 172.21.15.139:0/69719598 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c071580 con 0x7fac5c071d10 2024-09-10T05:11:18.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.650+0000 7fac5a59c640 1 --2- 172.21.15.139:0/69719598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac5c071d10 0x7fac5c117560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00c480 tx=0x7fac4c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:18.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.650+0000 7fac52ffd640 1 -- 172.21.15.139:0/69719598 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4c017070 con 0x7fac5c071d10 2024-09-10T05:11:18.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.650+0000 7fac52ffd640 1 -- 172.21.15.139:0/69719598 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4c005c10 con 0x7fac5c071d10 2024-09-10T05:11:18.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.650+0000 7fac608c6640 1 -- 172.21.15.139:0/69719598 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c126720 con 0x7fac5c071d10 2024-09-10T05:11:18.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.650+0000 7fac52ffd640 1 -- 172.21.15.139:0/69719598 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4c007070 con 0x7fac5c071d10 2024-09-10T05:11:18.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.650+0000 7fac608c6640 1 -- 172.21.15.139:0/69719598 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c070e70 con 0x7fac5c071d10 2024-09-10T05:11:18.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.651+0000 7fac52ffd640 1 -- 172.21.15.139:0/69719598 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fac4c01a070 con 0x7fac5c071d10 2024-09-10T05:11:18.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.651+0000 7fac608c6640 1 -- 172.21.15.139:0/69719598 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c0720f0 con 0x7fac5c071d10 2024-09-10T05:11:18.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.651+0000 7fac52ffd640 1 --2- 172.21.15.139:0/69719598 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac3c03de90 0x7fac3c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:18.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.651+0000 7fac52ffd640 1 -- 172.21.15.139:0/69719598 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fac4c0514c0 con 0x7fac5c071d10 2024-09-10T05:11:18.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.652+0000 7fac59d9b640 1 --2- 172.21.15.139:0/69719598 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac3c03de90 0x7fac3c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:18.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.652+0000 7fac59d9b640 1 --2- 172.21.15.139:0/69719598 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac3c03de90 0x7fac3c040350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fac44034000 tx=0x7fac4402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:18.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.656+0000 7fac52ffd640 1 -- 172.21.15.139:0/69719598 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fac5c073050 con 0x7fac5c071d10 2024-09-10T05:11:18.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.831+0000 7fac608c6640 1 -- 172.21.15.139:0/69719598 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fac5c118e70 con 0x7fac5c071d10 2024-09-10T05:11:18.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.832+0000 7fac52ffd640 1 -- 172.21.15.139:0/69719598 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7fac4c019cd0 con 0x7fac5c071d10 2024-09-10T05:11:18.833 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:11:18.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.834+0000 7fac608c6640 1 -- 172.21.15.139:0/69719598 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac3c03de90 msgr2=0x7fac3c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:18.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.834+0000 7fac608c6640 1 --2- 172.21.15.139:0/69719598 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac3c03de90 0x7fac3c040350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fac44034000 tx=0x7fac4402e000 comp rx=0 tx=0).stop 2024-09-10T05:11:18.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.834+0000 7fac608c6640 1 -- 172.21.15.139:0/69719598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac5c071d10 msgr2=0x7fac5c117560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:18.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.834+0000 7fac608c6640 1 --2- 172.21.15.139:0/69719598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac5c071d10 0x7fac5c117560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00c480 tx=0x7fac4c00c940 comp rx=0 tx=0).stop 2024-09-10T05:11:18.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.834+0000 7fac608c6640 1 -- 172.21.15.139:0/69719598 shutdown_connections 2024-09-10T05:11:18.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.834+0000 7fac608c6640 1 --2- 172.21.15.139:0/69719598 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac3c03de90 0x7fac3c040350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:18.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.834+0000 7fac608c6640 1 --2- 172.21.15.139:0/69719598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac5c071d10 0x7fac5c117560 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:18.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.834+0000 7fac608c6640 1 -- 172.21.15.139:0/69719598 >> 172.21.15.139:0/69719598 conn(0x7fac5c09c640 msgr2=0x7fac5c128930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:18.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.834+0000 7fac608c6640 1 -- 172.21.15.139:0/69719598 shutdown_connections 2024-09-10T05:11:18.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.834+0000 7fac608c6640 1 -- 172.21.15.139:0/69719598 wait complete. 2024-09-10T05:11:18.846 INFO:teuthology.orchestra.run.smithi139.stdout:[{"version":5,"timestamp":"2024-09-10T05:11:09.592674+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"5700.362833"}]}] 2024-09-10T05:11:18.846 INFO:tasks.ceph_manager:config epoch is 5 2024-09-10T05:11:18.846 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T05:11:18.846 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T05:11:18.846 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T05:11:18.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.942+0000 7facde4ef640 1 Processor -- start 2024-09-10T05:11:18.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.942+0000 7facde4ef640 1 -- start start 2024-09-10T05:11:18.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.943+0000 7facde4ef640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7facd812f160 0x7facd812f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:18.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.943+0000 7facde4ef640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd8070f40 con 0x7facd812fa80 2024-09-10T05:11:18.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.943+0000 7facde4ef640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7facd8070d70 con 0x7facd812f160 2024-09-10T05:11:18.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.943+0000 7facd7fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7facd812f160 0x7facd812f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:18.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.943+0000 7facd77fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7facd812fa80 0x7facd812bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60704/0 (socket says 172.21.15.139:60704) 2024-09-10T05:11:18.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.943+0000 7facd77fe640 1 -- 172.21.15.139:0/906873235 learned_addr learned my addr 172.21.15.139:0/906873235 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:18.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.943+0000 7facd7fff640 1 -- 172.21.15.139:0/906873235 >> v1:172.21.15.139:6789/0 conn(0x7facd812fa80 legacy=0x7facd812bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:18.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.943+0000 7facd7fff640 1 -- 172.21.15.139:0/906873235 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd8072160 con 0x7facd812f160 2024-09-10T05:11:18.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.944+0000 7facd7fff640 1 --2- 172.21.15.139:0/906873235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facd812f160 0x7facd812f540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7facc8009720 tx=0x7facc802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6eddf213a1bc04 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:18.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.944+0000 7facd6ffd640 1 -- 172.21.15.139:0/906873235 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc8037070 con 0x7facd812f160 2024-09-10T05:11:18.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.944+0000 7facd6ffd640 1 -- 172.21.15.139:0/906873235 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc802ad90 con 0x7facd812f160 2024-09-10T05:11:18.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.944+0000 7facd6ffd640 1 -- 172.21.15.139:0/906873235 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc8032590 con 0x7facd812f160 2024-09-10T05:11:18.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.945+0000 7facde4ef640 1 -- 172.21.15.139:0/906873235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facd812f160 msgr2=0x7facd812f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:18.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.945+0000 7facde4ef640 1 --2- 172.21.15.139:0/906873235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facd812f160 0x7facd812f540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7facc8009720 tx=0x7facc802a110 comp rx=0 tx=0).stop 2024-09-10T05:11:18.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.945+0000 7facde4ef640 1 -- 172.21.15.139:0/906873235 shutdown_connections 2024-09-10T05:11:18.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.945+0000 7facde4ef640 1 --2- 172.21.15.139:0/906873235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facd812f160 0x7facd812f540 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:18.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.945+0000 7facde4ef640 1 -- 172.21.15.139:0/906873235 >> 172.21.15.139:0/906873235 conn(0x7facd80a0ae0 msgr2=0x7facd806dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:18.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.945+0000 7facde4ef640 1 -- 172.21.15.139:0/906873235 shutdown_connections 2024-09-10T05:11:18.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.945+0000 7facde4ef640 1 -- 172.21.15.139:0/906873235 wait complete. 2024-09-10T05:11:18.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.945+0000 7facde4ef640 1 Processor -- start 2024-09-10T05:11:18.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.946+0000 7facde4ef640 1 -- start start 2024-09-10T05:11:18.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.946+0000 7facde4ef640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facd812f160 0x7facd811fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:18.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.946+0000 7facde4ef640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7facd812c310 con 0x7facd812f160 2024-09-10T05:11:18.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.946+0000 7facd7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facd812f160 0x7facd811fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:18.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.946+0000 7facd7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facd812f160 0x7facd811fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46310/0 (socket says 172.21.15.139:46310) 2024-09-10T05:11:18.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.946+0000 7facd7fff640 1 -- 172.21.15.139:0/213369465 learned_addr learned my addr 172.21.15.139:0/213369465 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.946+0000 7facd7fff640 1 -- 172.21.15.139:0/213369465 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd8121520 con 0x7facd812f160 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.947+0000 7facd7fff640 1 --2- 172.21.15.139:0/213369465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facd812f160 0x7facd811fdf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7facc8009720 tx=0x7facc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.947+0000 7facd4ff9640 1 -- 172.21.15.139:0/213369465 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc8041070 con 0x7facd812f160 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.947+0000 7facd4ff9640 1 -- 172.21.15.139:0/213369465 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc803c460 con 0x7facd812f160 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.947+0000 7facde4ef640 1 -- 172.21.15.139:0/213369465 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd8122650 con 0x7facd812f160 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.947+0000 7facd4ff9640 1 -- 172.21.15.139:0/213369465 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc8037040 con 0x7facd812f160 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.947+0000 7facde4ef640 1 -- 172.21.15.139:0/213369465 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd81221d0 con 0x7facd812f160 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.947+0000 7facd4ff9640 1 -- 172.21.15.139:0/213369465 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7facc8044070 con 0x7facd812f160 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.948+0000 7facde4ef640 1 -- 172.21.15.139:0/213369465 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd81228f0 con 0x7facd812f160 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.948+0000 7facd4ff9640 1 --2- 172.21.15.139:0/213369465 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7facc403de90 0x7facc4040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.948+0000 7facd4ff9640 1 -- 172.21.15.139:0/213369465 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7facc8072ad0 con 0x7facd812f160 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.948+0000 7facd77fe640 1 --2- 172.21.15.139:0/213369465 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7facc403de90 0x7facc4040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:18.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.949+0000 7facd77fe640 1 --2- 172.21.15.139:0/213369465 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7facc403de90 0x7facc4040350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faccc007fd0 tx=0x7faccc007aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:18.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:18.952+0000 7facd4ff9640 1 -- 172.21.15.139:0/213369465 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7facc803cc60 con 0x7facd812f160 2024-09-10T05:11:19.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.170+0000 7facde4ef640 1 -- 172.21.15.139:0/213369465 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7facd812c860 con 0x7facd812f160 2024-09-10T05:11:19.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.172+0000 7facd4ff9640 1 -- 172.21.15.139:0/213369465 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97045 (secure 0 0 0) 0x7facc803c740 con 0x7facd812f160 2024-09-10T05:11:19.175 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:11:19.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.174+0000 7facde4ef640 1 -- 172.21.15.139:0/213369465 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7facc403de90 msgr2=0x7facc4040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.174+0000 7facde4ef640 1 --2- 172.21.15.139:0/213369465 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7facc403de90 0x7facc4040350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faccc007fd0 tx=0x7faccc007aa0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.174+0000 7facde4ef640 1 -- 172.21.15.139:0/213369465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facd812f160 msgr2=0x7facd811fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.174+0000 7facde4ef640 1 --2- 172.21.15.139:0/213369465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facd812f160 0x7facd811fdf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7facc8009720 tx=0x7facc80046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.174+0000 7facde4ef640 1 -- 172.21.15.139:0/213369465 shutdown_connections 2024-09-10T05:11:19.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.174+0000 7facde4ef640 1 --2- 172.21.15.139:0/213369465 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7facc403de90 0x7facc4040350 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.174+0000 7facde4ef640 1 --2- 172.21.15.139:0/213369465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7facd812f160 0x7facd811fdf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.174+0000 7facde4ef640 1 -- 172.21.15.139:0/213369465 >> 172.21.15.139:0/213369465 conn(0x7facd80a0ae0 msgr2=0x7facd8118a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.175+0000 7facde4ef640 1 -- 172.21.15.139:0/213369465 shutdown_connections 2024-09-10T05:11:19.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.175+0000 7facde4ef640 1 -- 172.21.15.139:0/213369465 wait complete. 2024-09-10T05:11:19.186 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1421803816},{"type":"v1","addr":"172.21.15.192:6825","nonce":1421803816}]},"active_addr":"172.21.15.192:6825/1421803816","active_change":"2024-09-10T05:11:03.871494+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":1100752852}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":3444789865}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":3494523705}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":909488094}]}]} 2024-09-10T05:11:19.189 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T05:11:19.189 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T05:11:19.189 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:11:19.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.286+0000 7f0643cbf640 1 Processor -- start 2024-09-10T05:11:19.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.286+0000 7f0643cbf640 1 -- start start 2024-09-10T05:11:19.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.286+0000 7f0643cbf640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f063c130270 0x7f063c132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.286+0000 7f0643cbf640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f063c06dc00 con 0x7f063c129d80 2024-09-10T05:11:19.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.286+0000 7f0643cbf640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f063c1299c0 con 0x7f063c130270 2024-09-10T05:11:19.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.286+0000 7f064125a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f063c130270 0x7f063c132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.286+0000 7f0641a5b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f063c129d80 0x7f063c12a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60714/0 (socket says 172.21.15.139:60714) 2024-09-10T05:11:19.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.286+0000 7f0641a5b640 1 -- 172.21.15.139:0/3511354375 learned_addr learned my addr 172.21.15.139:0/3511354375 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:19.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.287+0000 7f064125a640 1 -- 172.21.15.139:0/3511354375 >> v1:172.21.15.139:6789/0 conn(0x7f063c129d80 legacy=0x7f063c12a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.287+0000 7f0640a59640 1 -- 172.21.15.139:0/3511354375 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458522605 0 0) 0x7f063c06dc00 con 0x7f063c129d80 2024-09-10T05:11:19.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.287+0000 7f064125a640 1 -- 172.21.15.139:0/3511354375 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c12a870 con 0x7f063c130270 2024-09-10T05:11:19.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.287+0000 7f064125a640 1 --2- 172.21.15.139:0/3511354375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f063c130270 0x7f063c132660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f062c009720 tx=0x7f062c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103ac59ac41bc21b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.288+0000 7f0640a59640 1 -- 172.21.15.139:0/3511354375 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c037070 con 0x7f063c130270 2024-09-10T05:11:19.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.288+0000 7f0640a59640 1 -- 172.21.15.139:0/3511354375 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c02ad90 con 0x7f063c130270 2024-09-10T05:11:19.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.288+0000 7f0640a59640 1 -- 172.21.15.139:0/3511354375 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c032590 con 0x7f063c130270 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.288+0000 7f0643cbf640 1 -- 172.21.15.139:0/3511354375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f063c130270 msgr2=0x7f063c132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.288+0000 7f0643cbf640 1 --2- 172.21.15.139:0/3511354375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f063c130270 0x7f063c132660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f062c009720 tx=0x7f062c02a110 comp rx=0 tx=0).stop 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.288+0000 7f0643cbf640 1 -- 172.21.15.139:0/3511354375 shutdown_connections 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.288+0000 7f0643cbf640 1 --2- 172.21.15.139:0/3511354375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f063c130270 0x7f063c132660 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.288+0000 7f0643cbf640 1 -- 172.21.15.139:0/3511354375 >> 172.21.15.139:0/3511354375 conn(0x7f063c070850 msgr2=0x7f063c072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.288+0000 7f0643cbf640 1 -- 172.21.15.139:0/3511354375 shutdown_connections 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.288+0000 7f0643cbf640 1 -- 172.21.15.139:0/3511354375 wait complete. 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.289+0000 7f0643cbf640 1 Processor -- start 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.289+0000 7f0643cbf640 1 -- start start 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.289+0000 7f0643cbf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f063c129d80 0x7f063c115750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.289+0000 7f0643cbf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f063c073a10 con 0x7f063c129d80 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.289+0000 7f0641a5b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f063c129d80 0x7f063c115750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.289+0000 7f0641a5b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f063c129d80 0x7f063c115750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46330/0 (socket says 172.21.15.139:46330) 2024-09-10T05:11:19.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.289+0000 7f0641a5b640 1 -- 172.21.15.139:0/1756581388 learned_addr learned my addr 172.21.15.139:0/1756581388 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:19.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.290+0000 7f0641a5b640 1 -- 172.21.15.139:0/1756581388 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c117520 con 0x7f063c129d80 2024-09-10T05:11:19.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.290+0000 7f0641a5b640 1 --2- 172.21.15.139:0/1756581388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f063c129d80 0x7f063c115750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f063800c3d0 tx=0x7f063800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.290+0000 7f06327fc640 1 -- 172.21.15.139:0/1756581388 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06380074d0 con 0x7f063c129d80 2024-09-10T05:11:19.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.290+0000 7f06327fc640 1 -- 172.21.15.139:0/1756581388 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06380047e0 con 0x7f063c129d80 2024-09-10T05:11:19.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.290+0000 7f0643cbf640 1 -- 172.21.15.139:0/1756581388 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063c118520 con 0x7f063c129d80 2024-09-10T05:11:19.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.290+0000 7f06327fc640 1 -- 172.21.15.139:0/1756581388 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0638007670 con 0x7f063c129d80 2024-09-10T05:11:19.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.290+0000 7f0643cbf640 1 -- 172.21.15.139:0/1756581388 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063c118960 con 0x7f063c129d80 2024-09-10T05:11:19.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.291+0000 7f06327fc640 1 -- 172.21.15.139:0/1756581388 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0638011070 con 0x7f063c129d80 2024-09-10T05:11:19.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.291+0000 7f0643cbf640 1 -- 172.21.15.139:0/1756581388 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f063c12a160 con 0x7f063c129d80 2024-09-10T05:11:19.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.291+0000 7f06327fc640 1 --2- 172.21.15.139:0/1756581388 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f062003de90 0x7f0620040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.291+0000 7f06327fc640 1 -- 172.21.15.139:0/1756581388 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f0638051e20 con 0x7f063c129d80 2024-09-10T05:11:19.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.291+0000 7f064125a640 1 --2- 172.21.15.139:0/1756581388 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f062003de90 0x7f0620040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.292+0000 7f064125a640 1 --2- 172.21.15.139:0/1756581388 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f062003de90 0x7f0620040350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f062c034000 tx=0x7f062c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.295+0000 7f06327fc640 1 -- 172.21.15.139:0/1756581388 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f0638012dd0 con 0x7f063c129d80 2024-09-10T05:11:19.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.474+0000 7f0643cbf640 1 -- 172.21.15.139:0/1756581388 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f063c068da0 con 0x7f063c129d80 2024-09-10T05:11:19.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.475+0000 7f06327fc640 1 -- 172.21.15.139:0/1756581388 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+9926 (secure 0 0 0) 0x7f0638010d40 con 0x7f063c129d80 2024-09-10T05:11:19.476 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:11:19.476 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":19,"fsid":"3465d198-8f8d-4e0c-ba83-88b13d9b49be","created":"2024-09-10T05:10:59.697360+0000","modified":"2024-09-10T05:11:18.526115+0000","last_up_change":"2024-09-10T05:11:10.486612+0000","last_in_change":"2024-09-10T05:11:00.751464+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:11:11.892255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T05:11:15.200669+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66219d18-2e08-4bf8-9271-bfaf3e270982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6801","nonce":2915567440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6803","nonce":2915567440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6807","nonce":2915567440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6805","nonce":2915567440}]},"public_addr":"172.21.15.139:6801/2915567440","cluster_addr":"172.21.15.139:6803/2915567440","heartbeat_back_addr":"172.21.15.139:6807/2915567440","heartbeat_front_addr":"172.21.15.139:6805/2915567440","state":["exists","up"]},{"osd":1,"uuid":"c8cf450e-b552-4e11-aa38-83613145105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6803","nonce":3487349558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6805","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6807","nonce":3487349558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6815","nonce":3487349558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6811","nonce":3487349558}]},"public_addr":"172.21.15.192:6803/3487349558","cluster_addr":"172.21.15.192:6807/3487349558","heartbeat_back_addr":"172.21.15.192:6815/3487349558","heartbeat_front_addr":"172.21.15.192:6811/3487349558","state":["exists","up"]},{"osd":2,"uuid":"7e53ce5e-92fc-4417-b675-a20d8b740415","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6801","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6802","nonce":2435677948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6806","nonce":2435677948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6813","nonce":2435677948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6810","nonce":2435677948}]},"public_addr":"172.21.15.192:6802/2435677948","cluster_addr":"172.21.15.192:6806/2435677948","heartbeat_back_addr":"172.21.15.192:6813/2435677948","heartbeat_front_addr":"172.21.15.192:6810/2435677948","state":["exists","up"]},{"osd":3,"uuid":"c4099f78-d4fa-41cd-a4c4-2aa56d3d1e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6817","nonce":1620624472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6819","nonce":1620624472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6823","nonce":1620624472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6821","nonce":1620624472}]},"public_addr":"172.21.15.192:6817/1620624472","cluster_addr":"172.21.15.192:6819/1620624472","heartbeat_back_addr":"172.21.15.192:6823/1620624472","heartbeat_front_addr":"172.21.15.192:6821/1620624472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:06.174920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:07.342107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:07.381356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:07.499864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:11:19.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.477+0000 7f0643cbf640 1 -- 172.21.15.139:0/1756581388 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f062003de90 msgr2=0x7f0620040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.477+0000 7f0643cbf640 1 --2- 172.21.15.139:0/1756581388 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f062003de90 0x7f0620040350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f062c034000 tx=0x7f062c02e000 comp rx=0 tx=0).stop 2024-09-10T05:11:19.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.477+0000 7f0643cbf640 1 -- 172.21.15.139:0/1756581388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f063c129d80 msgr2=0x7f063c115750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.477+0000 7f0643cbf640 1 --2- 172.21.15.139:0/1756581388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f063c129d80 0x7f063c115750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f063800c3d0 tx=0x7f063800c890 comp rx=0 tx=0).stop 2024-09-10T05:11:19.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.477+0000 7f0643cbf640 1 -- 172.21.15.139:0/1756581388 shutdown_connections 2024-09-10T05:11:19.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.477+0000 7f0643cbf640 1 --2- 172.21.15.139:0/1756581388 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f062003de90 0x7f0620040350 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.477+0000 7f0643cbf640 1 --2- 172.21.15.139:0/1756581388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f063c129d80 0x7f063c115750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.477+0000 7f0643cbf640 1 -- 172.21.15.139:0/1756581388 >> 172.21.15.139:0/1756581388 conn(0x7f063c070850 msgr2=0x7f063c1282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.477+0000 7f0643cbf640 1 -- 172.21.15.139:0/1756581388 shutdown_connections 2024-09-10T05:11:19.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.477+0000 7f0643cbf640 1 -- 172.21.15.139:0/1756581388 wait complete. 2024-09-10T05:11:19.489 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T05:11:19.489 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:11:19.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.585+0000 7f1f3a2db640 1 Processor -- start 2024-09-10T05:11:19.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.585+0000 7f1f3a2db640 1 -- start start 2024-09-10T05:11:19.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.586+0000 7f1f3a2db640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1f3412fc50 0x7f1f341344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.586+0000 7f1f3a2db640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f34070f40 con 0x7f1f3412f160 2024-09-10T05:11:19.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.586+0000 7f1f3a2db640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f1f34070d70 con 0x7f1f3412fc50 2024-09-10T05:11:19.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.586+0000 7f1f33fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1f3412f160 0x7f1f3412f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60730/0 (socket says 172.21.15.139:60730) 2024-09-10T05:11:19.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.586+0000 7f1f33fff640 1 -- 172.21.15.139:0/53421312 learned_addr learned my addr 172.21.15.139:0/53421312 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:19.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.586+0000 7f1f337fe640 1 --2- 172.21.15.139:0/53421312 >> v2:172.21.15.139:3300/0 conn(0x7f1f3412fc50 0x7f1f341344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.586+0000 7f1f32ffd640 1 -- 172.21.15.139:0/53421312 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2111827381 0 0) 0x7f1f34070f40 con 0x7f1f3412f160 2024-09-10T05:11:19.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.586+0000 7f1f32ffd640 1 -- 172.21.15.139:0/53421312 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f20003520 con 0x7f1f3412f160 2024-09-10T05:11:19.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.586+0000 7f1f337fe640 1 -- 172.21.15.139:0/53421312 >> v1:172.21.15.139:6789/0 conn(0x7f1f3412f160 legacy=0x7f1f3412f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.586+0000 7f1f337fe640 1 -- 172.21.15.139:0/53421312 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f34072160 con 0x7f1f3412fc50 2024-09-10T05:11:19.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.587+0000 7f1f337fe640 1 --2- 172.21.15.139:0/53421312 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f3412fc50 0x7f1f341344e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009720 tx=0x7f1f1c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9222d606919992d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.587+0000 7f1f32ffd640 1 -- 172.21.15.139:0/53421312 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f1c037070 con 0x7f1f3412fc50 2024-09-10T05:11:19.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.587+0000 7f1f32ffd640 1 -- 172.21.15.139:0/53421312 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f1c02ad90 con 0x7f1f3412fc50 2024-09-10T05:11:19.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.587+0000 7f1f32ffd640 1 -- 172.21.15.139:0/53421312 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f1c032590 con 0x7f1f3412fc50 2024-09-10T05:11:19.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.588+0000 7f1f3a2db640 1 -- 172.21.15.139:0/53421312 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f3412fc50 msgr2=0x7f1f341344e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.588+0000 7f1f3a2db640 1 --2- 172.21.15.139:0/53421312 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f3412fc50 0x7f1f341344e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009720 tx=0x7f1f1c02a110 comp rx=0 tx=0).stop 2024-09-10T05:11:19.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.588+0000 7f1f3a2db640 1 -- 172.21.15.139:0/53421312 shutdown_connections 2024-09-10T05:11:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.588+0000 7f1f3a2db640 1 --2- 172.21.15.139:0/53421312 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f3412fc50 0x7f1f341344e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.588+0000 7f1f3a2db640 1 -- 172.21.15.139:0/53421312 >> 172.21.15.139:0/53421312 conn(0x7f1f340a0ae0 msgr2=0x7f1f3406dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.588+0000 7f1f3a2db640 1 -- 172.21.15.139:0/53421312 shutdown_connections 2024-09-10T05:11:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.588+0000 7f1f3a2db640 1 -- 172.21.15.139:0/53421312 wait complete. 2024-09-10T05:11:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.588+0000 7f1f3a2db640 1 Processor -- start 2024-09-10T05:11:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.589+0000 7f1f3a2db640 1 -- start start 2024-09-10T05:11:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.589+0000 7f1f3a2db640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f3412f160 0x7f1f3411bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.589+0000 7f1f3a2db640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1f34134ba0 con 0x7f1f3412f160 2024-09-10T05:11:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.589+0000 7f1f33fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f3412f160 0x7f1f3411bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.589+0000 7f1f33fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f3412f160 0x7f1f3411bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46344/0 (socket says 172.21.15.139:46344) 2024-09-10T05:11:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.589+0000 7f1f33fff640 1 -- 172.21.15.139:0/761137451 learned_addr learned my addr 172.21.15.139:0/761137451 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.589+0000 7f1f33fff640 1 -- 172.21.15.139:0/761137451 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3411e270 con 0x7f1f3412f160 2024-09-10T05:11:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.589+0000 7f1f33fff640 1 --2- 172.21.15.139:0/761137451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f3412f160 0x7f1f3411bf40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400c480 tx=0x7f1f2400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.590+0000 7f1f30ff9640 1 -- 172.21.15.139:0/761137451 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f24017070 con 0x7f1f3412f160 2024-09-10T05:11:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.590+0000 7f1f30ff9640 1 -- 172.21.15.139:0/761137451 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f24005cd0 con 0x7f1f3412f160 2024-09-10T05:11:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.590+0000 7f1f30ff9640 1 -- 172.21.15.139:0/761137451 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f24007200 con 0x7f1f3412f160 2024-09-10T05:11:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.590+0000 7f1f3a2db640 1 -- 172.21.15.139:0/761137451 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3411f350 con 0x7f1f3412f160 2024-09-10T05:11:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.590+0000 7f1f3a2db640 1 -- 172.21.15.139:0/761137451 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f3411c480 con 0x7f1f3412f160 2024-09-10T05:11:19.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.591+0000 7f1f3a2db640 1 -- 172.21.15.139:0/761137451 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f3412f540 con 0x7f1f3412f160 2024-09-10T05:11:19.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.591+0000 7f1f30ff9640 1 -- 172.21.15.139:0/761137451 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1f2401a070 con 0x7f1f3412f160 2024-09-10T05:11:19.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.591+0000 7f1f30ff9640 1 --2- 172.21.15.139:0/761137451 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1f1403de90 0x7f1f14040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.591+0000 7f1f30ff9640 1 -- 172.21.15.139:0/761137451 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f1f24051530 con 0x7f1f3412f160 2024-09-10T05:11:19.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.591+0000 7f1f337fe640 1 --2- 172.21.15.139:0/761137451 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1f1403de90 0x7f1f14040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.592+0000 7f1f337fe640 1 --2- 172.21.15.139:0/761137451 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1f1403de90 0x7f1f14040350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c034000 tx=0x7f1f1c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.596+0000 7f1f30ff9640 1 -- 172.21.15.139:0/761137451 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f1f2401bdc0 con 0x7f1f3412f160 2024-09-10T05:11:19.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.771+0000 7f1f3a2db640 1 -- 172.21.15.139:0/761137451 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f3411d670 con 0x7f1f3412f160 2024-09-10T05:11:19.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.772+0000 7f1f30ff9640 1 -- 172.21.15.139:0/761137451 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+9926 (secure 0 0 0) 0x7f1f24011360 con 0x7f1f3412f160 2024-09-10T05:11:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:11:19.773 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":19,"fsid":"3465d198-8f8d-4e0c-ba83-88b13d9b49be","created":"2024-09-10T05:10:59.697360+0000","modified":"2024-09-10T05:11:18.526115+0000","last_up_change":"2024-09-10T05:11:10.486612+0000","last_in_change":"2024-09-10T05:11:00.751464+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:11:11.892255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T05:11:15.200669+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66219d18-2e08-4bf8-9271-bfaf3e270982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6801","nonce":2915567440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6803","nonce":2915567440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6807","nonce":2915567440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6805","nonce":2915567440}]},"public_addr":"172.21.15.139:6801/2915567440","cluster_addr":"172.21.15.139:6803/2915567440","heartbeat_back_addr":"172.21.15.139:6807/2915567440","heartbeat_front_addr":"172.21.15.139:6805/2915567440","state":["exists","up"]},{"osd":1,"uuid":"c8cf450e-b552-4e11-aa38-83613145105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6803","nonce":3487349558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6805","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6807","nonce":3487349558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6815","nonce":3487349558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6811","nonce":3487349558}]},"public_addr":"172.21.15.192:6803/3487349558","cluster_addr":"172.21.15.192:6807/3487349558","heartbeat_back_addr":"172.21.15.192:6815/3487349558","heartbeat_front_addr":"172.21.15.192:6811/3487349558","state":["exists","up"]},{"osd":2,"uuid":"7e53ce5e-92fc-4417-b675-a20d8b740415","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6801","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6802","nonce":2435677948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6806","nonce":2435677948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6813","nonce":2435677948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6810","nonce":2435677948}]},"public_addr":"172.21.15.192:6802/2435677948","cluster_addr":"172.21.15.192:6806/2435677948","heartbeat_back_addr":"172.21.15.192:6813/2435677948","heartbeat_front_addr":"172.21.15.192:6810/2435677948","state":["exists","up"]},{"osd":3,"uuid":"c4099f78-d4fa-41cd-a4c4-2aa56d3d1e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6817","nonce":1620624472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6819","nonce":1620624472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6823","nonce":1620624472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6821","nonce":1620624472}]},"public_addr":"172.21.15.192:6817/1620624472","cluster_addr":"172.21.15.192:6819/1620624472","heartbeat_back_addr":"172.21.15.192:6823/1620624472","heartbeat_front_addr":"172.21.15.192:6821/1620624472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:06.174920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:07.342107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:07.381356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:07.499864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:11:19.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.774+0000 7f1f3a2db640 1 -- 172.21.15.139:0/761137451 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1f1403de90 msgr2=0x7f1f14040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.774+0000 7f1f3a2db640 1 --2- 172.21.15.139:0/761137451 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1f1403de90 0x7f1f14040350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c034000 tx=0x7f1f1c02e000 comp rx=0 tx=0).stop 2024-09-10T05:11:19.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.774+0000 7f1f3a2db640 1 -- 172.21.15.139:0/761137451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f3412f160 msgr2=0x7f1f3411bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.774+0000 7f1f3a2db640 1 --2- 172.21.15.139:0/761137451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f3412f160 0x7f1f3411bf40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400c480 tx=0x7f1f2400c940 comp rx=0 tx=0).stop 2024-09-10T05:11:19.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.774+0000 7f1f3a2db640 1 -- 172.21.15.139:0/761137451 shutdown_connections 2024-09-10T05:11:19.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.774+0000 7f1f3a2db640 1 --2- 172.21.15.139:0/761137451 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1f1403de90 0x7f1f14040350 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.774+0000 7f1f3a2db640 1 --2- 172.21.15.139:0/761137451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f3412f160 0x7f1f3411bf40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.774+0000 7f1f3a2db640 1 -- 172.21.15.139:0/761137451 >> 172.21.15.139:0/761137451 conn(0x7f1f340a0ae0 msgr2=0x7f1f34130270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.774+0000 7f1f3a2db640 1 -- 172.21.15.139:0/761137451 shutdown_connections 2024-09-10T05:11:19.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.774+0000 7f1f3a2db640 1 -- 172.21.15.139:0/761137451 wait complete. 2024-09-10T05:11:19.786 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T05:11:19.787 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T05:11:19.787 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T05:11:19.788 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T05:11:19.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.890+0000 7f11bbbe2640 1 Processor -- start 2024-09-10T05:11:19.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.890+0000 7fad4c7a4640 1 Processor -- start 2024-09-10T05:11:19.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.890+0000 7fad4c7a4640 1 -- start start 2024-09-10T05:11:19.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.890+0000 7f65b7594640 1 Processor -- start 2024-09-10T05:11:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.890+0000 7f56fe268640 1 Processor -- start 2024-09-10T05:11:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.890+0000 7f11bbbe2640 1 -- start start 2024-09-10T05:11:19.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.890+0000 7f56fe268640 1 -- start start 2024-09-10T05:11:19.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f65b7594640 1 -- start start 2024-09-10T05:11:19.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7fad4c7a4640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fad44071d10 0x7fad440720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7fad4c7a4640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad44073050 con 0x7fad4409ecd0 2024-09-10T05:11:19.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7fad4c7a4640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fad44073600 con 0x7fad44071d10 2024-09-10T05:11:19.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f11bbbe2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f11b4070c00 0x7f11b4070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f56fe268640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56f8070c00 0x7f56f8070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f65b7594640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f65b0125890 0x7f65b0125c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f56fe268640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f806de00 con 0x7f56f8071ec0 2024-09-10T05:11:19.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7fad49d3f640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fad4409ecd0 0x7fad44125760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60734/0 (socket says 172.21.15.139:60734) 2024-09-10T05:11:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f56fe268640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f56f8069380 con 0x7f56f8070c00 2024-09-10T05:11:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7fad49d3f640 1 -- 172.21.15.139:0/2205472520 learned_addr learned my addr 172.21.15.139:0/2205472520 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:19.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f65b7594640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b006fe70 con 0x7f65b006ed40 2024-09-10T05:11:19.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f65b7594640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f65b0117030 con 0x7f65b0125890 2024-09-10T05:11:19.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f11b997e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f11b4070c00 0x7f11b4070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f56f7fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56f8070c00 0x7f56f8070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f11bbbe2640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11b406de00 con 0x7f11b4071ec0 2024-09-10T05:11:19.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f11b997e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f11b4070c00 0x7f11b4070fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46366/0 (socket says 172.21.15.139:46366) 2024-09-10T05:11:19.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f11b997e640 1 -- 172.21.15.139:0/701661220 learned_addr learned my addr 172.21.15.139:0/701661220 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:19.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f11bbbe2640 1 -- 172.21.15.139:0/701661220 --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f11b4069380 con 0x7f11b4070c00 2024-09-10T05:11:19.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f56f7fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56f8070c00 0x7f56f8070fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46354/0 (socket says 172.21.15.139:46354) 2024-09-10T05:11:19.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f56f7fff640 1 -- 172.21.15.139:0/3552427974 learned_addr learned my addr 172.21.15.139:0/3552427974 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:19.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f65b4b2f640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f65b006ed40 0x7f65b006f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60738/0 (socket says 172.21.15.139:60738) 2024-09-10T05:11:19.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.891+0000 7f65b4b2f640 1 -- 172.21.15.139:0/254424406 learned_addr learned my addr 172.21.15.139:0/254424406 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:19.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.892+0000 7fad4a540640 1 --2- 172.21.15.139:0/2205472520 >> v2:172.21.15.139:3300/0 conn(0x7fad44071d10 0x7fad440720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.892+0000 7f11b997e640 1 -- 172.21.15.139:0/701661220 >> v1:172.21.15.139:6789/0 conn(0x7f11b4071ec0 legacy=0x7f11b412b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T05:11:19.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.892+0000 7f65b5330640 1 --2- 172.21.15.139:0/254424406 >> v2:172.21.15.139:3300/0 conn(0x7f65b0125890 0x7f65b0125c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.892+0000 7fad4953e640 1 -- 172.21.15.139:0/2205472520 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852061620 0 0) 0x7fad34001110 con 0x7fad4409ecd0 2024-09-10T05:11:19.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.892+0000 7f11b997e640 1 -- 172.21.15.139:0/701661220 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b409ecd0 con 0x7f11b4070c00 2024-09-10T05:11:19.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.892+0000 7f56f7fff640 1 -- 172.21.15.139:0/3552427974 >> v1:172.21.15.139:6789/0 conn(0x7f56f8071ec0 legacy=0x7f56f812b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T05:11:19.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.892+0000 7fad4953e640 1 -- 172.21.15.139:0/2205472520 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad30003520 con 0x7fad4409ecd0 2024-09-10T05:11:19.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.892+0000 7fad4a540640 1 -- 172.21.15.139:0/2205472520 >> v1:172.21.15.139:6789/0 conn(0x7fad4409ecd0 legacy=0x7fad44125760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.892+0000 7f56f7fff640 1 -- 172.21.15.139:0/3552427974 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f809ecd0 con 0x7f56f8070c00 2024-09-10T05:11:19.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.892+0000 7fad4a540640 1 -- 172.21.15.139:0/2205472520 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad440732f0 con 0x7fad44071d10 2024-09-10T05:11:19.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.892+0000 7f65b5330640 1 -- 172.21.15.139:0/254424406 >> v1:172.21.15.139:6789/0 conn(0x7f65b006ed40 legacy=0x7f65b006f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.892+0000 7f65b5330640 1 -- 172.21.15.139:0/254424406 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b0116c90 con 0x7f65b0125890 2024-09-10T05:11:19.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7f11b997e640 1 --2- 172.21.15.139:0/701661220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11b4070c00 0x7f11b4070fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097f0 tx=0x7f11b002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cda67cb3a3f92fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7f11b897c640 1 -- 172.21.15.139:0/701661220 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11b0037070 con 0x7f11b4070c00 2024-09-10T05:11:19.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7fad4a540640 1 --2- 172.21.15.139:0/2205472520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad44071d10 0x7fad440720f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad40009720 tx=0x7fad4002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577c67cf731690d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7f11b897c640 1 -- 172.21.15.139:0/701661220 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b002adc0 con 0x7f11b4070c00 2024-09-10T05:11:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7f11b897c640 1 -- 172.21.15.139:0/701661220 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11b0032590 con 0x7f11b4070c00 2024-09-10T05:11:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7fad4953e640 1 -- 172.21.15.139:0/2205472520 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad40037070 con 0x7fad44071d10 2024-09-10T05:11:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7f56f7fff640 1 --2- 172.21.15.139:0/3552427974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f8070c00 0x7f56f8070fe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56e80097f0 tx=0x7f56e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8da0a40e26671c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7fad4953e640 1 -- 172.21.15.139:0/2205472520 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4002ad90 con 0x7fad44071d10 2024-09-10T05:11:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7fad4953e640 1 -- 172.21.15.139:0/2205472520 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad40032590 con 0x7fad44071d10 2024-09-10T05:11:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7f65b5330640 1 --2- 172.21.15.139:0/254424406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65b0125890 0x7f65b0125c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009720 tx=0x7f65ac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c328e40c56876824 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7f65a7fff640 1 -- 172.21.15.139:0/254424406 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65ac037070 con 0x7f65b0125890 2024-09-10T05:11:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7f56f6ffd640 1 -- 172.21.15.139:0/3552427974 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e8037070 con 0x7f56f8070c00 2024-09-10T05:11:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7f65a7fff640 1 -- 172.21.15.139:0/254424406 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac02ae20 con 0x7f65b0125890 2024-09-10T05:11:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7f65a7fff640 1 -- 172.21.15.139:0/254424406 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65ac032590 con 0x7f65b0125890 2024-09-10T05:11:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7f56f6ffd640 1 -- 172.21.15.139:0/3552427974 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e8032440 con 0x7f56f8070c00 2024-09-10T05:11:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.893+0000 7f56f6ffd640 1 -- 172.21.15.139:0/3552427974 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e8037070 con 0x7f56f8070c00 2024-09-10T05:11:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f11bbbe2640 1 -- 172.21.15.139:0/701661220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11b4070c00 msgr2=0x7f11b4070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f11bbbe2640 1 --2- 172.21.15.139:0/701661220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11b4070c00 0x7f11b4070fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097f0 tx=0x7f11b002a140 comp rx=0 tx=0).stop 2024-09-10T05:11:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f11bbbe2640 1 -- 172.21.15.139:0/701661220 shutdown_connections 2024-09-10T05:11:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f11bbbe2640 1 --2- 172.21.15.139:0/701661220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11b4070c00 0x7f11b4070fe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f11bbbe2640 1 -- 172.21.15.139:0/701661220 >> 172.21.15.139:0/701661220 conn(0x7f11b409c640 msgr2=0x7f11b406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7fad4c7a4640 1 -- 172.21.15.139:0/2205472520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad44071d10 msgr2=0x7fad440720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7fad4c7a4640 1 --2- 172.21.15.139:0/2205472520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad44071d10 0x7fad440720f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad40009720 tx=0x7fad4002a110 comp rx=0 tx=0).stop 2024-09-10T05:11:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f11bbbe2640 1 -- 172.21.15.139:0/701661220 shutdown_connections 2024-09-10T05:11:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f11bbbe2640 1 -- 172.21.15.139:0/701661220 wait complete. 2024-09-10T05:11:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7fad4c7a4640 1 -- 172.21.15.139:0/2205472520 shutdown_connections 2024-09-10T05:11:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7fad4c7a4640 1 --2- 172.21.15.139:0/2205472520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad44071d10 0x7fad440720f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7fad4c7a4640 1 -- 172.21.15.139:0/2205472520 >> 172.21.15.139:0/2205472520 conn(0x7fad4409c640 msgr2=0x7fad4406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f65b7594640 1 -- 172.21.15.139:0/254424406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65b0125890 msgr2=0x7f65b0125c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f65b7594640 1 --2- 172.21.15.139:0/254424406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65b0125890 0x7f65b0125c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009720 tx=0x7f65ac02a1a0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f56fe268640 1 -- 172.21.15.139:0/3552427974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f8070c00 msgr2=0x7f56f8070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f56fe268640 1 --2- 172.21.15.139:0/3552427974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f8070c00 0x7f56f8070fe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56e80097f0 tx=0x7f56e802a1e0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7fad4c7a4640 1 -- 172.21.15.139:0/2205472520 shutdown_connections 2024-09-10T05:11:19.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f65b7594640 1 -- 172.21.15.139:0/254424406 shutdown_connections 2024-09-10T05:11:19.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f65b7594640 1 --2- 172.21.15.139:0/254424406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65b0125890 0x7f65b0125c70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f65b7594640 1 -- 172.21.15.139:0/254424406 >> 172.21.15.139:0/254424406 conn(0x7f65b0071580 msgr2=0x7f65b009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7fad4c7a4640 1 -- 172.21.15.139:0/2205472520 wait complete. 2024-09-10T05:11:19.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f56fe268640 1 -- 172.21.15.139:0/3552427974 shutdown_connections 2024-09-10T05:11:19.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f56fe268640 1 --2- 172.21.15.139:0/3552427974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f8070c00 0x7f56f8070fe0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f56fe268640 1 -- 172.21.15.139:0/3552427974 >> 172.21.15.139:0/3552427974 conn(0x7f56f809c640 msgr2=0x7f56f806ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.894+0000 7f56fe268640 1 -- 172.21.15.139:0/3552427974 shutdown_connections 2024-09-10T05:11:19.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7f56fe268640 1 -- 172.21.15.139:0/3552427974 wait complete. 2024-09-10T05:11:19.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7f65b7594640 1 -- 172.21.15.139:0/254424406 shutdown_connections 2024-09-10T05:11:19.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7f65b7594640 1 -- 172.21.15.139:0/254424406 wait complete. 2024-09-10T05:11:19.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7f11bbbe2640 1 Processor -- start 2024-09-10T05:11:19.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7f11bbbe2640 1 -- start start 2024-09-10T05:11:19.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7fad4c7a4640 1 Processor -- start 2024-09-10T05:11:19.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7f11bbbe2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11b4070c00 0x7f11b412b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7f56fe268640 1 Processor -- start 2024-09-10T05:11:19.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7f11bbbe2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f11b40718b0 con 0x7f11b4070c00 2024-09-10T05:11:19.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7fad4c7a4640 1 -- start start 2024-09-10T05:11:19.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7f11b997e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11b4070c00 0x7f11b412b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7f11b997e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11b4070c00 0x7f11b412b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46372/0 (socket says 172.21.15.139:46372) 2024-09-10T05:11:19.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.895+0000 7f11b997e640 1 -- 172.21.15.139:0/3647821925 learned_addr learned my addr 172.21.15.139:0/3647821925 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:19.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f56fe268640 1 -- start start 2024-09-10T05:11:19.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f65b7594640 1 Processor -- start 2024-09-10T05:11:19.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f65b7594640 1 -- start start 2024-09-10T05:11:19.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f11b997e640 1 -- 172.21.15.139:0/3647821925 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b411bb60 con 0x7f11b4070c00 2024-09-10T05:11:19.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7fad4c7a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad44071d10 0x7fad441264a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f11b997e640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11b4070c00 0x7f11b412b360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f11b0035040 tx=0x7f11b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7fad4c7a4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fad440727b0 con 0x7fad44071d10 2024-09-10T05:11:19.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f56fe268640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f8070c00 0x7f56f8123cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f56fe268640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8071730 con 0x7f56f8070c00 2024-09-10T05:11:19.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7fad4a540640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad44071d10 0x7fad441264a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f11aa7fc640 1 -- 172.21.15.139:0/3647821925 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11b0041070 con 0x7f11b4070c00 2024-09-10T05:11:19.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7fad4a540640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad44071d10 0x7fad441264a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46376/0 (socket says 172.21.15.139:46376) 2024-09-10T05:11:19.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7fad4a540640 1 -- 172.21.15.139:0/1621851213 learned_addr learned my addr 172.21.15.139:0/1621851213 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:19.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f11bbbe2640 1 -- 172.21.15.139:0/3647821925 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b411a560 con 0x7f11b4070c00 2024-09-10T05:11:19.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f11aa7fc640 1 -- 172.21.15.139:0/3647821925 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b003c590 con 0x7f11b4070c00 2024-09-10T05:11:19.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f56f7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f8070c00 0x7f56f8123cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f65b7594640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65b006ed40 0x7f65b011a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f65b7594640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f65b01261b0 con 0x7f65b006ed40 2024-09-10T05:11:19.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f11aa7fc640 1 -- 172.21.15.139:0/3647821925 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11b0037040 con 0x7f11b4070c00 2024-09-10T05:11:19.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7fad4a540640 1 -- 172.21.15.139:0/1621851213 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad441281e0 con 0x7fad44071d10 2024-09-10T05:11:19.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f11bbbe2640 1 -- 172.21.15.139:0/3647821925 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b412b8a0 con 0x7f11b4070c00 2024-09-10T05:11:19.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f56f7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f8070c00 0x7f56f8123cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46382/0 (socket says 172.21.15.139:46382) 2024-09-10T05:11:19.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.896+0000 7f56f7fff640 1 -- 172.21.15.139:0/1196707980 learned_addr learned my addr 172.21.15.139:0/1196707980 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:19.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7f56f7fff640 1 -- 172.21.15.139:0/1196707980 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f8124df0 con 0x7f56f8070c00 2024-09-10T05:11:19.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7fad4a540640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad44071d10 0x7fad441264a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fad40000c00 tx=0x7fad400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7f56f7fff640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f8070c00 0x7f56f8123cb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f56e80097f0 tx=0x7f56e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7f65b5330640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65b006ed40 0x7f65b011a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7f65b5330640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65b006ed40 0x7f65b011a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46394/0 (socket says 172.21.15.139:46394) 2024-09-10T05:11:19.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7f65b5330640 1 -- 172.21.15.139:0/2405067863 learned_addr learned my addr 172.21.15.139:0/2405067863 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:19.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7fad3affd640 1 -- 172.21.15.139:0/1621851213 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad40042020 con 0x7fad44071d10 2024-09-10T05:11:19.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7fad4c7a4640 1 -- 172.21.15.139:0/1621851213 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad441288c0 con 0x7fad44071d10 2024-09-10T05:11:19.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7f56f4ff9640 1 -- 172.21.15.139:0/1196707980 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e8042070 con 0x7f56f8070c00 2024-09-10T05:11:19.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7fad3affd640 1 -- 172.21.15.139:0/1621851213 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4003d470 con 0x7fad44071d10 2024-09-10T05:11:19.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7fad3affd640 1 -- 172.21.15.139:0/1621851213 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad40037040 con 0x7fad44071d10 2024-09-10T05:11:19.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7f56f4ff9640 1 -- 172.21.15.139:0/1196707980 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e8030920 con 0x7f56f8070c00 2024-09-10T05:11:19.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7f65b5330640 1 -- 172.21.15.139:0/2405067863 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b01299b0 con 0x7f65b006ed40 2024-09-10T05:11:19.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.897+0000 7f11bbbe2640 1 -- 172.21.15.139:0/3647821925 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f11b4073380 con 0x7f11b4070c00 2024-09-10T05:11:19.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f56fe268640 1 -- 172.21.15.139:0/1196707980 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f81260c0 con 0x7f56f8070c00 2024-09-10T05:11:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f11aa7fc640 1 -- 172.21.15.139:0/3647821925 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f11b0044070 con 0x7f11b4070c00 2024-09-10T05:11:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7fad4c7a4640 1 -- 172.21.15.139:0/1621851213 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad44124850 con 0x7fad44071d10 2024-09-10T05:11:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f56fe268640 1 -- 172.21.15.139:0/1196707980 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f8126cf0 con 0x7f56f8070c00 2024-09-10T05:11:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f65b5330640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65b006ed40 0x7f65b011a5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009720 tx=0x7f65ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f11aa7fc640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f119803de40 0x7f1198040300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f11aa7fc640 1 -- 172.21.15.139:0/3647821925 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f11b0072ad0 con 0x7f11b4070c00 2024-09-10T05:11:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f11aa7fc640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x7f11980435c0 0x7f1198045a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f11aa7fc640 1 -- 172.21.15.139:0/3647821925 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11b0041e70 con 0x7f11980435c0 2024-09-10T05:11:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f11aa7fc640 1 -- 172.21.15.139:0/3647821925 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f11b004e8a0 con 0x7f11b4070c00 2024-09-10T05:11:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f56f4ff9640 1 -- 172.21.15.139:0/1196707980 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e802ae60 con 0x7f56f8070c00 2024-09-10T05:11:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f65a5ffb640 1 -- 172.21.15.139:0/2405067863 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65ac042070 con 0x7f65b006ed40 2024-09-10T05:11:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f65a5ffb640 1 -- 172.21.15.139:0/2405067863 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac03e590 con 0x7f65b006ed40 2024-09-10T05:11:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f65b7594640 1 -- 172.21.15.139:0/2405067863 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b011bb10 con 0x7f65b006ed40 2024-09-10T05:11:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7f65a5ffb640 1 -- 172.21.15.139:0/2405067863 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65ac037040 con 0x7f65b006ed40 2024-09-10T05:11:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.898+0000 7fad3affd640 1 -- 172.21.15.139:0/1621851213 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fad40045020 con 0x7fad44071d10 2024-09-10T05:11:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.899+0000 7f11b917d640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f119803de40 0x7f1198040300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.899+0000 7fad4c7a4640 1 -- 172.21.15.139:0/1621851213 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad440720f0 con 0x7fad44071d10 2024-09-10T05:11:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.899+0000 7f65b7594640 1 -- 172.21.15.139:0/2405067863 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b011ceb0 con 0x7f65b006ed40 2024-09-10T05:11:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.899+0000 7f11b917d640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f119803de40 0x7f1198040300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f11a4003cf0 tx=0x7f11a4007a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.899+0000 7f56fe268640 1 -- 172.21.15.139:0/1196707980 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f56d8000f80 con 0x7f56f8070c00 2024-09-10T05:11:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.899+0000 7f56f4ff9640 1 -- 172.21.15.139:0/1196707980 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f56e8045070 con 0x7f56f8070c00 2024-09-10T05:11:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7fad3affd640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fad2803dee0 0x7fad280403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.899+0000 7f11ba17f640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x7f11980435c0 0x7f1198045a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.899+0000 7f56f4ff9640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f56e403df60 0x7f56e4040420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f56f4ff9640 1 -- 172.21.15.139:0/1196707980 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f56e8072680 con 0x7f56f8070c00 2024-09-10T05:11:19.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f65b7594640 1 -- 172.21.15.139:0/2405067863 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f65b011d3b0 con 0x7f65b006ed40 2024-09-10T05:11:19.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f56f4ff9640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f56e4043760 0x7f56e4045be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7fad3affd640 1 -- 172.21.15.139:0/1621851213 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fad40072ef0 con 0x7fad44071d10 2024-09-10T05:11:19.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f56f77fe640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f56e403df60 0x7f56e4040420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f56f4ff9640 1 -- 172.21.15.139:0/1196707980 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56e803ee50 con 0x7f56e4043760 2024-09-10T05:11:19.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7fad3affd640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x7fad28043660 0x7fad28045ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f56f4ff9640 1 -- 172.21.15.139:0/1196707980 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f56e8079050 con 0x7f56f8070c00 2024-09-10T05:11:19.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7fad3affd640 1 -- 172.21.15.139:0/1621851213 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad40049e50 con 0x7fad28043660 2024-09-10T05:11:19.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7fad3affd640 1 -- 172.21.15.139:0/1621851213 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fad40030db0 con 0x7fad44071d10 2024-09-10T05:11:19.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7fad49d3f640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fad2803dee0 0x7fad280403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f65a5ffb640 1 -- 172.21.15.139:0/2405067863 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f65ac045070 con 0x7f65b006ed40 2024-09-10T05:11:19.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f11ba17f640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x7f11980435c0 0x7f1198045a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f56fc805640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f56e4043760 0x7f56e4045be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7fad4ad41640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x7fad28043660 0x7fad28045ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f65a5ffb640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f659403dee0 0x7f65940403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f65a5ffb640 1 -- 172.21.15.139:0/2405067863 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f65ac072c10 con 0x7f65b006ed40 2024-09-10T05:11:19.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f65a5ffb640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x7f6594043660 0x7f6594045ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:19.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f56f77fe640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f56e403df60 0x7f56e4040420 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f56ec001600 tx=0x7f56ec0079f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f65a5ffb640 1 -- 172.21.15.139:0/2405067863 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65ac04cec0 con 0x7f6594043660 2024-09-10T05:11:19.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7f65a5ffb640 1 -- 172.21.15.139:0/2405067863 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f65ac077220 con 0x7f65b006ed40 2024-09-10T05:11:19.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7fad4ad41640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x7fad28043660 0x7fad28045ae0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.900+0000 7fad49d3f640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fad2803dee0 0x7fad280403a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fad34005880 tx=0x7fad34001270 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.901+0000 7f65b4b2f640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f659403dee0 0x7f65940403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.901+0000 7f56fc805640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f56e4043760 0x7f56e4045be0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.901+0000 7f65b5b31640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x7f6594043660 0x7f6594045ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:19.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.901+0000 7f11aa7fc640 1 -- 172.21.15.139:0/3647821925 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11b0041e70 con 0x7f11980435c0 2024-09-10T05:11:19.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.901+0000 7f65b5b31640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x7f6594043660 0x7f6594045ae0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.901+0000 7f65b4b2f640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f659403dee0 0x7f65940403a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f65a0007fd0 tx=0x7f65a0007aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:19.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.901+0000 7fad3affd640 1 -- 172.21.15.139:0/1621851213 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad40049e50 con 0x7fad28043660 2024-09-10T05:11:19.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.901+0000 7f56f4ff9640 1 -- 172.21.15.139:0/1196707980 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f56e803ee50 con 0x7f56e4043760 2024-09-10T05:11:19.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.902+0000 7f65a5ffb640 1 -- 172.21.15.139:0/2405067863 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f65ac04cec0 con 0x7f6594043660 2024-09-10T05:11:19.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.914+0000 7f11bbbe2640 1 -- 172.21.15.139:0/3647821925 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f11b4070fe0 con 0x7f11980435c0 2024-09-10T05:11:19.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.915+0000 7f56fe268640 1 -- 172.21.15.139:0/1196707980 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f56d8002c70 con 0x7f56e4043760 2024-09-10T05:11:19.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.915+0000 7f11aa7fc640 1 -- 172.21.15.139:0/3647821925 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f11b4070fe0 con 0x7f11980435c0 2024-09-10T05:11:19.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.915+0000 7f56f4ff9640 1 -- 172.21.15.139:0/1196707980 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f56d8002c70 con 0x7f56e4043760 2024-09-10T05:11:19.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.915+0000 7f11bbbe2640 1 -- 172.21.15.139:0/3647821925 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x7f11980435c0 msgr2=0x7f1198045a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.915+0000 7f11bbbe2640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x7f11980435c0 0x7f1198045a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.915+0000 7f11bbbe2640 1 -- 172.21.15.139:0/3647821925 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f119803de40 msgr2=0x7f1198040300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.915+0000 7f11bbbe2640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f119803de40 0x7f1198040300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f11a4003cf0 tx=0x7f11a4007a50 comp rx=0 tx=0).stop 2024-09-10T05:11:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.915+0000 7f11bbbe2640 1 -- 172.21.15.139:0/3647821925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11b4070c00 msgr2=0x7f11b412b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.915+0000 7f11bbbe2640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11b4070c00 0x7f11b412b360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f11b0035040 tx=0x7f11b00046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.915+0000 7f11bbbe2640 1 -- 172.21.15.139:0/3647821925 shutdown_connections 2024-09-10T05:11:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f11bbbe2640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x7f11980435c0 0x7f1198045a40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f11bbbe2640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f119803de40 0x7f1198040300 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f11bbbe2640 1 --2- 172.21.15.139:0/3647821925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11b4070c00 0x7f11b412b360 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f11bbbe2640 1 -- 172.21.15.139:0/3647821925 >> 172.21.15.139:0/3647821925 conn(0x7f11b409c640 msgr2=0x7f11b41304e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 -- 172.21.15.139:0/1196707980 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f56e4043760 msgr2=0x7f56e4045be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f56e4043760 0x7f56e4045be0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f11bbbe2640 1 -- 172.21.15.139:0/3647821925 shutdown_connections 2024-09-10T05:11:19.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f11bbbe2640 1 -- 172.21.15.139:0/3647821925 wait complete. 2024-09-10T05:11:19.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 -- 172.21.15.139:0/1196707980 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f56e403df60 msgr2=0x7f56e4040420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f56e403df60 0x7f56e4040420 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f56ec001600 tx=0x7f56ec0079f0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 -- 172.21.15.139:0/1196707980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f8070c00 msgr2=0x7f56f8123cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f8070c00 0x7f56f8123cb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f56e80097f0 tx=0x7f56e80046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 -- 172.21.15.139:0/1196707980 shutdown_connections 2024-09-10T05:11:19.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f56e4043760 0x7f56e4045be0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f56e403df60 0x7f56e4040420 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 --2- 172.21.15.139:0/1196707980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f8070c00 0x7f56f8123cb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 -- 172.21.15.139:0/1196707980 >> 172.21.15.139:0/1196707980 conn(0x7f56f809c640 msgr2=0x7f56f811cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 -- 172.21.15.139:0/1196707980 shutdown_connections 2024-09-10T05:11:19.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.916+0000 7f56fe268640 1 -- 172.21.15.139:0/1196707980 wait complete. 2024-09-10T05:11:19.943 INFO:teuthology.orchestra.run.smithi139.stdout:47244640261 2024-09-10T05:11:19.944 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T05:11:19.945 INFO:teuthology.orchestra.run.smithi139.stdout:47244640261 2024-09-10T05:11:19.945 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T05:11:19.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.932+0000 7fad4c7a4640 1 -- 172.21.15.139:0/1621851213 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad44124360 con 0x7fad28043660 2024-09-10T05:11:19.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.932+0000 7fad3affd640 1 -- 172.21.15.139:0/1621851213 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fad44124360 con 0x7fad28043660 2024-09-10T05:11:19.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7f65b7594640 1 -- 172.21.15.139:0/2405067863 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f65b0125890 con 0x7f6594043660 2024-09-10T05:11:19.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 -- 172.21.15.139:0/1621851213 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x7fad28043660 msgr2=0x7fad28045ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x7fad28043660 0x7fad28045ae0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 -- 172.21.15.139:0/1621851213 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fad2803dee0 msgr2=0x7fad280403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fad2803dee0 0x7fad280403a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fad34005880 tx=0x7fad34001270 comp rx=0 tx=0).stop 2024-09-10T05:11:19.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 -- 172.21.15.139:0/1621851213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad44071d10 msgr2=0x7fad441264a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad44071d10 0x7fad441264a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fad40000c00 tx=0x7fad400046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 -- 172.21.15.139:0/1621851213 shutdown_connections 2024-09-10T05:11:19.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x7fad28043660 0x7fad28045ae0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fad2803dee0 0x7fad280403a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 --2- 172.21.15.139:0/1621851213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad44071d10 0x7fad441264a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 -- 172.21.15.139:0/1621851213 >> 172.21.15.139:0/1621851213 conn(0x7fad4409c640 msgr2=0x7fad441b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 -- 172.21.15.139:0/1621851213 shutdown_connections 2024-09-10T05:11:19.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7fad4c7a4640 1 -- 172.21.15.139:0/1621851213 wait complete. 2024-09-10T05:11:19.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7f65a5ffb640 1 -- 172.21.15.139:0/2405067863 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f65b0125890 con 0x7f6594043660 2024-09-10T05:11:19.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7f65b7594640 1 -- 172.21.15.139:0/2405067863 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x7f6594043660 msgr2=0x7f6594045ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.933+0000 7f65b7594640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x7f6594043660 0x7f6594045ae0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.934+0000 7f65b7594640 1 -- 172.21.15.139:0/2405067863 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f659403dee0 msgr2=0x7f65940403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.934+0000 7f65b7594640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f659403dee0 0x7f65940403a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f65a0007fd0 tx=0x7f65a0007aa0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.934+0000 7f65b7594640 1 -- 172.21.15.139:0/2405067863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65b006ed40 msgr2=0x7f65b011a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:19.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.934+0000 7f65b7594640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65b006ed40 0x7f65b011a5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009720 tx=0x7f65ac0046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.934+0000 7f65b7594640 1 -- 172.21.15.139:0/2405067863 shutdown_connections 2024-09-10T05:11:19.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.934+0000 7f65b7594640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f659403dee0 0x7f65940403a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.934+0000 7f65b7594640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x7f6594043660 0x7f6594045ae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.934+0000 7f65b7594640 1 --2- 172.21.15.139:0/2405067863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65b006ed40 0x7f65b011a5a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:19.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.934+0000 7f65b7594640 1 -- 172.21.15.139:0/2405067863 >> 172.21.15.139:0/2405067863 conn(0x7f65b0071580 msgr2=0x7f65b012bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:19.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.934+0000 7f65b7594640 1 -- 172.21.15.139:0/2405067863 shutdown_connections 2024-09-10T05:11:19.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:19.934+0000 7f65b7594640 1 -- 172.21.15.139:0/2405067863 wait complete. 2024-09-10T05:11:19.951 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-09-10T05:11:19.951 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T05:11:19.952 INFO:teuthology.orchestra.run.smithi139.stdout:38654705670 2024-09-10T05:11:19.952 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T05:11:20.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.087+0000 7f859fbf5640 1 Processor -- start 2024-09-10T05:11:20.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.087+0000 7f8f93c50640 1 Processor -- start 2024-09-10T05:11:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.087+0000 7f13c5631640 1 Processor -- start 2024-09-10T05:11:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.087+0000 7f3e81f24640 1 Processor -- start 2024-09-10T05:11:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.087+0000 7f13c5631640 1 -- start start 2024-09-10T05:11:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.087+0000 7f3e81f24640 1 -- start start 2024-09-10T05:11:20.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.087+0000 7f8f93c50640 1 -- start start 2024-09-10T05:11:20.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.087+0000 7f859fbf5640 1 -- start start 2024-09-10T05:11:20.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f13c5631640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f13c012bec0 0x7f13c012c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:20.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f859fbf5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8598072f50 0x7f85981344d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:20.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f13c5631640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c0070750 con 0x7f13c012c7e0 2024-09-10T05:11:20.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f13c5631640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f13c0070c40 con 0x7f13c012bec0 2024-09-10T05:11:20.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f859fbf5640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f859806c530 con 0x7f8598072460 2024-09-10T05:11:20.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f859fbf5640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f8598071ee0 con 0x7f8598072f50 2024-09-10T05:11:20.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f859d190640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8598072f50 0x7f85981344d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:20.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f8f93c50640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8f8c09ecd0 0x7f8f8c1314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:20.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f8f93c50640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f8c073050 con 0x7f8f8c071d10 2024-09-10T05:11:20.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f8f93c50640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f8f8c073600 con 0x7f8f8c09ecd0 2024-09-10T05:11:20.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f859d190640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8598072f50 0x7f85981344d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46420/0 (socket says 172.21.15.139:46420) 2024-09-10T05:11:20.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f859d190640 1 -- 172.21.15.139:0/203457100 learned_addr learned my addr 172.21.15.139:0/203457100 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:20.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f8f919ec640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f8f8c071d10 0x7f8f8c0720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60784/0 (socket says 172.21.15.139:60784) 2024-09-10T05:11:20.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f8f919ec640 1 -- 172.21.15.139:0/3536805430 learned_addr learned my addr 172.21.15.139:0/3536805430 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:20.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f3e81f24640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3e7c071380 0x7f3e7c12bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:20.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f859d190640 1 -- 172.21.15.139:0/203457100 >> v1:172.21.15.139:6789/0 conn(0x7f8598072460 legacy=0x7f8598072840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f3e81f24640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e7c06de00 con 0x7f3e7c071ec0 2024-09-10T05:11:20.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f3e81f24640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f3e7c069380 con 0x7f3e7c071380 2024-09-10T05:11:20.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f859d190640 1 -- 172.21.15.139:0/203457100 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8598070a10 con 0x7f8598072f50 2024-09-10T05:11:20.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f13beffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f13c012bec0 0x7f13c012c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:20.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f13beffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f13c012bec0 0x7f13c012c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46410/0 (socket says 172.21.15.139:46410) 2024-09-10T05:11:20.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f8f911eb640 1 --2- 172.21.15.139:0/3536805430 >> v2:172.21.15.139:3300/0 conn(0x7f8f8c09ecd0 0x7f8f8c1314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:20.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f13beffd640 1 -- 172.21.15.139:0/2031263134 learned_addr learned my addr 172.21.15.139:0/2031263134 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:20.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f3e7affd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3e7c071380 0x7f3e7c12bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:20.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f3e7affd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3e7c071380 0x7f3e7c12bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46450/0 (socket says 172.21.15.139:46450) 2024-09-10T05:11:20.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.088+0000 7f3e7affd640 1 -- 172.21.15.139:0/3303436148 learned_addr learned my addr 172.21.15.139:0/3303436148 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:20.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f8f909ea640 1 -- 172.21.15.139:0/3536805430 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418612566 0 0) 0x7f8f88001110 con 0x7f8f8c071d10 2024-09-10T05:11:20.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f8f909ea640 1 -- 172.21.15.139:0/3536805430 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f78003520 con 0x7f8f8c071d10 2024-09-10T05:11:20.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f8f911eb640 1 -- 172.21.15.139:0/3536805430 >> v1:172.21.15.139:6789/0 conn(0x7f8f8c071d10 legacy=0x7f8f8c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f8f911eb640 1 -- 172.21.15.139:0/3536805430 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c0732f0 con 0x7f8f8c09ecd0 2024-09-10T05:11:20.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f13beffd640 1 -- 172.21.15.139:0/2031263134 >> v1:172.21.15.139:6789/0 conn(0x7f13c012c7e0 legacy=0x7f13c012f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f13beffd640 1 -- 172.21.15.139:0/2031263134 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c0070110 con 0x7f13c012bec0 2024-09-10T05:11:20.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f859d190640 1 --2- 172.21.15.139:0/203457100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8598072f50 0x7f85981344d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f85880097f0 tx=0x7f858802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17bc834053e3475 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:20.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f3e7affd640 1 -- 172.21.15.139:0/3303436148 >> v1:172.21.15.139:6789/0 conn(0x7f3e7c071ec0 legacy=0x7f3e7c12b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f3e7affd640 1 -- 172.21.15.139:0/3303436148 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c09ecd0 con 0x7f3e7c071380 2024-09-10T05:11:20.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f859c98f640 1 -- 172.21.15.139:0/203457100 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8588037070 con 0x7f8598072f50 2024-09-10T05:11:20.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f859c98f640 1 -- 172.21.15.139:0/203457100 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8588032440 con 0x7f8598072f50 2024-09-10T05:11:20.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f859c98f640 1 -- 172.21.15.139:0/203457100 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f858802ae60 con 0x7f8598072f50 2024-09-10T05:11:20.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.089+0000 7f8f911eb640 1 --2- 172.21.15.139:0/3536805430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f8c09ecd0 0x7f8f8c1314d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00b9c0 tx=0x7f8f7c02c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7df69e519c828b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:20.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f8f909ea640 1 -- 172.21.15.139:0/3536805430 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f7c031640 con 0x7f8f8c09ecd0 2024-09-10T05:11:20.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f8f909ea640 1 -- 172.21.15.139:0/3536805430 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f7c0317e0 con 0x7f8f8c09ecd0 2024-09-10T05:11:20.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f8f909ea640 1 -- 172.21.15.139:0/3536805430 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f7c031ae0 con 0x7f8f8c09ecd0 2024-09-10T05:11:20.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f13beffd640 1 --2- 172.21.15.139:0/2031263134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13c012bec0 0x7f13c012c2a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f13b00097f0 tx=0x7f13b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251718300a0e3738 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:20.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f13bdffb640 1 -- 172.21.15.139:0/2031263134 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b0037070 con 0x7f13c012bec0 2024-09-10T05:11:20.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f3e7affd640 1 --2- 172.21.15.139:0/3303436148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c071380 0x7f3e7c12bed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000bac0 tx=0x7f3e7002c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed32bc4d870c6ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:20.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f13bdffb640 1 -- 172.21.15.139:0/2031263134 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b0032440 con 0x7f13c012bec0 2024-09-10T05:11:20.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f13bdffb640 1 -- 172.21.15.139:0/2031263134 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b002ae60 con 0x7f13c012bec0 2024-09-10T05:11:20.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f859fbf5640 1 -- 172.21.15.139:0/203457100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8598072f50 msgr2=0x7f85981344d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f859fbf5640 1 --2- 172.21.15.139:0/203457100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8598072f50 0x7f85981344d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f85880097f0 tx=0x7f858802a1e0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f8f93c50640 1 -- 172.21.15.139:0/3536805430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f8c09ecd0 msgr2=0x7f8f8c1314d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f8f93c50640 1 --2- 172.21.15.139:0/3536805430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f8c09ecd0 0x7f8f8c1314d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00b9c0 tx=0x7f8f7c02c7e0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f3e7a7fc640 1 -- 172.21.15.139:0/3303436148 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e700326c0 con 0x7f3e7c071380 2024-09-10T05:11:20.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f3e7a7fc640 1 -- 172.21.15.139:0/3303436148 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e70038070 con 0x7f3e7c071380 2024-09-10T05:11:20.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.090+0000 7f3e7a7fc640 1 -- 172.21.15.139:0/3303436148 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e700329b0 con 0x7f3e7c071380 2024-09-10T05:11:20.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f8f93c50640 1 -- 172.21.15.139:0/3536805430 shutdown_connections 2024-09-10T05:11:20.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f8f93c50640 1 --2- 172.21.15.139:0/3536805430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f8c09ecd0 0x7f8f8c1314d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f859fbf5640 1 -- 172.21.15.139:0/203457100 shutdown_connections 2024-09-10T05:11:20.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f859fbf5640 1 --2- 172.21.15.139:0/203457100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8598072f50 0x7f85981344d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f859fbf5640 1 -- 172.21.15.139:0/203457100 >> 172.21.15.139:0/203457100 conn(0x7f859809b880 msgr2=0x7f859806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:20.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f8f93c50640 1 -- 172.21.15.139:0/3536805430 >> 172.21.15.139:0/3536805430 conn(0x7f8f8c09c640 msgr2=0x7f8f8c06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:20.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f8f93c50640 1 -- 172.21.15.139:0/3536805430 shutdown_connections 2024-09-10T05:11:20.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f859fbf5640 1 -- 172.21.15.139:0/203457100 shutdown_connections 2024-09-10T05:11:20.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f859fbf5640 1 -- 172.21.15.139:0/203457100 wait complete. 2024-09-10T05:11:20.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f8f93c50640 1 -- 172.21.15.139:0/3536805430 wait complete. 2024-09-10T05:11:20.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f13c5631640 1 -- 172.21.15.139:0/2031263134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13c012bec0 msgr2=0x7f13c012c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f13c5631640 1 --2- 172.21.15.139:0/2031263134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13c012bec0 0x7f13c012c2a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f13b00097f0 tx=0x7f13b002a1e0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f3e81f24640 1 -- 172.21.15.139:0/3303436148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c071380 msgr2=0x7f3e7c12bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f3e81f24640 1 --2- 172.21.15.139:0/3303436148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c071380 0x7f3e7c12bed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000bac0 tx=0x7f3e7002c8d0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f13c5631640 1 -- 172.21.15.139:0/2031263134 shutdown_connections 2024-09-10T05:11:20.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f13c5631640 1 --2- 172.21.15.139:0/2031263134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13c012bec0 0x7f13c012c2a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f3e81f24640 1 -- 172.21.15.139:0/3303436148 shutdown_connections 2024-09-10T05:11:20.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f3e81f24640 1 --2- 172.21.15.139:0/3303436148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c071380 0x7f3e7c12bed0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f3e81f24640 1 -- 172.21.15.139:0/3303436148 >> 172.21.15.139:0/3303436148 conn(0x7f3e7c09c640 msgr2=0x7f3e7c06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:20.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f13c5631640 1 -- 172.21.15.139:0/2031263134 >> 172.21.15.139:0/2031263134 conn(0x7f13c0071da0 msgr2=0x7f13c00721b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:20.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f3e81f24640 1 -- 172.21.15.139:0/3303436148 shutdown_connections 2024-09-10T05:11:20.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f3e81f24640 1 -- 172.21.15.139:0/3303436148 wait complete. 2024-09-10T05:11:20.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f13c5631640 1 -- 172.21.15.139:0/2031263134 shutdown_connections 2024-09-10T05:11:20.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.091+0000 7f13c5631640 1 -- 172.21.15.139:0/2031263134 wait complete. 2024-09-10T05:11:20.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.092+0000 7f859fbf5640 1 Processor -- start 2024-09-10T05:11:20.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.092+0000 7f8f93c50640 1 Processor -- start 2024-09-10T05:11:20.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.092+0000 7f859fbf5640 1 -- start start 2024-09-10T05:11:20.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.092+0000 7f8f93c50640 1 -- start start 2024-09-10T05:11:20.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.092+0000 7f3e81f24640 1 Processor -- start 2024-09-10T05:11:20.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.092+0000 7f13c5631640 1 Processor -- start 2024-09-10T05:11:20.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.092+0000 7f13c5631640 1 -- start start 2024-09-10T05:11:20.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.092+0000 7f3e81f24640 1 -- start start 2024-09-10T05:11:20.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.092+0000 7f8f93c50640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f8c071d10 0x7f8f8c116960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:20.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.092+0000 7f8f93c50640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c072980 con 0x7f8f8c071d10 2024-09-10T05:11:20.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.092+0000 7f859fbf5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8598072460 0x7f859812b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:20.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f859fbf5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8598134b90 con 0x7f8598072460 2024-09-10T05:11:20.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f8f919ec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f8c071d10 0x7f8f8c116960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:20.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f8f919ec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f8c071d10 0x7f8f8c116960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46452/0 (socket says 172.21.15.139:46452) 2024-09-10T05:11:20.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f8f919ec640 1 -- 172.21.15.139:0/974682171 learned_addr learned my addr 172.21.15.139:0/974682171 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:20.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f859d991640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8598072460 0x7f859812b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:20.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f13c5631640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13c012bec0 0x7f13c011a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:20.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f13c5631640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f13c012f970 con 0x7f13c012bec0 2024-09-10T05:11:20.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f859d991640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8598072460 0x7f859812b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46466/0 (socket says 172.21.15.139:46466) 2024-09-10T05:11:20.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f859d991640 1 -- 172.21.15.139:0/2518820870 learned_addr learned my addr 172.21.15.139:0/2518820870 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:20.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f3e81f24640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c071380 0x7f3e7c1bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:20.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f3e81f24640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c072b10 con 0x7f3e7c071380 2024-09-10T05:11:20.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f8f919ec640 1 -- 172.21.15.139:0/974682171 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c1199c0 con 0x7f8f8c071d10 2024-09-10T05:11:20.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f859d991640 1 -- 172.21.15.139:0/2518820870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859811e000 con 0x7f8598072460 2024-09-10T05:11:20.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f13beffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13c012bec0 0x7f13c011a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:20.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f13beffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13c012bec0 0x7f13c011a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46474/0 (socket says 172.21.15.139:46474) 2024-09-10T05:11:20.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f13beffd640 1 -- 172.21.15.139:0/1062753420 learned_addr learned my addr 172.21.15.139:0/1062753420 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:20.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f3e7b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c071380 0x7f3e7c1bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:20.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f3e7b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c071380 0x7f3e7c1bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46488/0 (socket says 172.21.15.139:46488) 2024-09-10T05:11:20.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f3e7b7fe640 1 -- 172.21.15.139:0/4164305957 learned_addr learned my addr 172.21.15.139:0/4164305957 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:20.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f8f919ec640 1 --2- 172.21.15.139:0/974682171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f8c071d10 0x7f8f8c116960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800c680 tx=0x7f8f8800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:20.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.093+0000 7f859d991640 1 --2- 172.21.15.139:0/2518820870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8598072460 0x7f859812b810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f859400c480 tx=0x7f859400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:20.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.094+0000 7f858e7fc640 1 -- 172.21.15.139:0/2518820870 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8594017070 con 0x7f8598072460 2024-09-10T05:11:20.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.094+0000 7f3e7b7fe640 1 -- 172.21.15.139:0/4164305957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c120a70 con 0x7f3e7c071380 2024-09-10T05:11:20.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.094+0000 7f859fbf5640 1 -- 172.21.15.139:0/2518820870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859811e490 con 0x7f8598072460 2024-09-10T05:11:20.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.094+0000 7f858e7fc640 1 -- 172.21.15.139:0/2518820870 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8594005200 con 0x7f8598072460 2024-09-10T05:11:20.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.094+0000 7f8f827fc640 1 -- 172.21.15.139:0/974682171 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f880058b0 con 0x7f8f8c071d10 2024-09-10T05:11:20.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.094+0000 7f8f827fc640 1 -- 172.21.15.139:0/974682171 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f88005a50 con 0x7f8f8c071d10 2024-09-10T05:11:20.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.094+0000 7f8f827fc640 1 -- 172.21.15.139:0/974682171 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f88005db0 con 0x7f8f8c071d10 2024-09-10T05:11:20.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.094+0000 7f859fbf5640 1 -- 172.21.15.139:0/2518820870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859812bf30 con 0x7f8598072460 2024-09-10T05:11:20.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.094+0000 7f8f93c50640 1 -- 172.21.15.139:0/974682171 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8c118010 con 0x7f8f8c071d10 2024-09-10T05:11:20.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.094+0000 7f8f93c50640 1 -- 172.21.15.139:0/974682171 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8c119380 con 0x7f8f8c071d10 2024-09-10T05:11:20.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.094+0000 7f13beffd640 1 -- 172.21.15.139:0/1062753420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c011ca30 con 0x7f13c012bec0 2024-09-10T05:11:20.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.094+0000 7f858e7fc640 1 -- 172.21.15.139:0/2518820870 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85940035f0 con 0x7f8598072460 2024-09-10T05:11:20.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f858e7fc640 1 -- 172.21.15.139:0/2518820870 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f859401a070 con 0x7f8598072460 2024-09-10T05:11:20.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f3e7b7fe640 1 --2- 172.21.15.139:0/4164305957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c071380 0x7f3e7c1bfa50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c480 tx=0x7f3e6c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:20.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f13beffd640 1 --2- 172.21.15.139:0/1062753420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13c012bec0 0x7f13c011a740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f13b0035040 tx=0x7f13b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:20.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f8f93c50640 1 -- 172.21.15.139:0/974682171 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f8c0720f0 con 0x7f8f8c071d10 2024-09-10T05:11:20.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f858e7fc640 1 --2- 172.21.15.139:0/2518820870 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f857c03de90 0x7f857c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:20.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f858e7fc640 1 -- 172.21.15.139:0/2518820870 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f85940516b0 con 0x7f8598072460 2024-09-10T05:11:20.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f859fbf5640 1 -- 172.21.15.139:0/2518820870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859809f340 con 0x7f8598072460 2024-09-10T05:11:20.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f3e63fff640 1 -- 172.21.15.139:0/4164305957 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c017070 con 0x7f3e7c071380 2024-09-10T05:11:20.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f13a77fe640 1 -- 172.21.15.139:0/1062753420 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b0041070 con 0x7f13c012bec0 2024-09-10T05:11:20.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f3e63fff640 1 -- 172.21.15.139:0/4164305957 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6c005200 con 0x7f3e7c071380 2024-09-10T05:11:20.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f3e63fff640 1 -- 172.21.15.139:0/4164305957 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c0035f0 con 0x7f3e7c071380 2024-09-10T05:11:20.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f13a77fe640 1 -- 172.21.15.139:0/1062753420 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b003c7a0 con 0x7f13c012bec0 2024-09-10T05:11:20.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f13a77fe640 1 -- 172.21.15.139:0/1062753420 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b0037040 con 0x7f13c012bec0 2024-09-10T05:11:20.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f13c5631640 1 -- 172.21.15.139:0/1062753420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c011d040 con 0x7f13c012bec0 2024-09-10T05:11:20.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f3e81f24640 1 -- 172.21.15.139:0/4164305957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e7c1bff90 con 0x7f3e7c071380 2024-09-10T05:11:20.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.095+0000 7f859d190640 1 --2- 172.21.15.139:0/2518820870 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f857c03de90 0x7f857c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:20.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.096+0000 7f8f827fc640 1 -- 172.21.15.139:0/974682171 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8f88007070 con 0x7f8f8c071d10 2024-09-10T05:11:20.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.096+0000 7f8f827fc640 1 --2- 172.21.15.139:0/974682171 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8f7003de90 0x7f8f70040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:20.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.096+0000 7f8f827fc640 1 -- 172.21.15.139:0/974682171 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f8f88051e50 con 0x7f8f8c071d10 2024-09-10T05:11:20.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.096+0000 7f859d190640 1 --2- 172.21.15.139:0/2518820870 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f857c03de90 0x7f857c040350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8588034000 tx=0x7f858802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:20.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.096+0000 7f3e81f24640 1 -- 172.21.15.139:0/4164305957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e7c1c0460 con 0x7f3e7c071380 2024-09-10T05:11:20.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.096+0000 7f8f911eb640 1 --2- 172.21.15.139:0/974682171 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8f7003de90 0x7f8f70040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:20.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.096+0000 7f13c5631640 1 -- 172.21.15.139:0/1062753420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c011ac80 con 0x7f13c012bec0 2024-09-10T05:11:20.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.097+0000 7f8f911eb640 1 --2- 172.21.15.139:0/974682171 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8f7003de90 0x7f8f70040350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c036000 tx=0x7f8f7c031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:20.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.097+0000 7f3e81f24640 1 -- 172.21.15.139:0/4164305957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e7c09f0f0 con 0x7f3e7c071380 2024-09-10T05:11:20.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.097+0000 7f13c5631640 1 -- 172.21.15.139:0/1062753420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c011be30 con 0x7f13c012bec0 2024-09-10T05:11:20.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.100+0000 7f858e7fc640 1 -- 172.21.15.139:0/2518820870 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f8594019cd0 con 0x7f8598072460 2024-09-10T05:11:20.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.101+0000 7f3e63fff640 1 -- 172.21.15.139:0/4164305957 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3e6c01a070 con 0x7f3e7c071380 2024-09-10T05:11:20.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.101+0000 7f3e63fff640 1 --2- 172.21.15.139:0/4164305957 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e6803df10 0x7f3e680403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:20.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.101+0000 7f3e7affd640 1 --2- 172.21.15.139:0/4164305957 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e6803df10 0x7f3e680403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:20.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.102+0000 7f3e7affd640 1 --2- 172.21.15.139:0/4164305957 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e6803df10 0x7f3e680403d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000bac0 tx=0x7f3e70008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:20.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.105+0000 7f8f827fc640 1 -- 172.21.15.139:0/974682171 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f8f8c1199c0 con 0x7f8f8c071d10 2024-09-10T05:11:20.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.105+0000 7f3e63fff640 1 -- 172.21.15.139:0/4164305957 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f3e6c011590 con 0x7f3e7c071380 2024-09-10T05:11:20.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.105+0000 7f13a77fe640 1 -- 172.21.15.139:0/1062753420 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f13b0044070 con 0x7f13c012bec0 2024-09-10T05:11:20.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.106+0000 7f13a77fe640 1 --2- 172.21.15.139:0/1062753420 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f13ac03df30 0x7f13ac0403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:20.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.106+0000 7f13a77fe640 1 -- 172.21.15.139:0/1062753420 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f13b00732d0 con 0x7f13c012bec0 2024-09-10T05:11:20.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.106+0000 7f13be7fc640 1 --2- 172.21.15.139:0/1062753420 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f13ac03df30 0x7f13ac0403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:20.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.106+0000 7f13be7fc640 1 --2- 172.21.15.139:0/1062753420 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f13ac03df30 0x7f13ac0403f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13b4001600 tx=0x7f13b40079f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:20.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.109+0000 7f3e63fff640 1 -- 172.21.15.139:0/4164305957 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f3e6c021020 con 0x7f3e7c071380 2024-09-10T05:11:20.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.114+0000 7f13a77fe640 1 -- 172.21.15.139:0/1062753420 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f13b0030cc0 con 0x7f13c012bec0 2024-09-10T05:11:20.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.294+0000 7f3e81f24640 1 -- 172.21.15.139:0/4164305957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3e7c068da0 con 0x7f3e7c071380 2024-09-10T05:11:20.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.294+0000 7f3e63fff640 1 -- 172.21.15.139:0/4164305957 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3e6c0199b0 con 0x7f3e7c071380 2024-09-10T05:11:20.295 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-09-10T05:11:20.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.296+0000 7f13c5631640 1 -- 172.21.15.139:0/1062753420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f13c012feb0 con 0x7f13c012bec0 2024-09-10T05:11:20.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.297+0000 7f13a77fe640 1 -- 172.21.15.139:0/1062753420 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13b0050480 con 0x7f13c012bec0 2024-09-10T05:11:20.298 INFO:teuthology.orchestra.run.smithi139.stdout:47244640259 2024-09-10T05:11:20.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.297+0000 7f3e81f24640 1 -- 172.21.15.139:0/4164305957 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e6803df10 msgr2=0x7f3e680403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.297+0000 7f3e81f24640 1 --2- 172.21.15.139:0/4164305957 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e6803df10 0x7f3e680403d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000bac0 tx=0x7f3e70008040 comp rx=0 tx=0).stop 2024-09-10T05:11:20.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.297+0000 7f3e81f24640 1 -- 172.21.15.139:0/4164305957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c071380 msgr2=0x7f3e7c1bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.297+0000 7f3e81f24640 1 --2- 172.21.15.139:0/4164305957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c071380 0x7f3e7c1bfa50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c480 tx=0x7f3e6c00c940 comp rx=0 tx=0).stop 2024-09-10T05:11:20.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.297+0000 7f3e81f24640 1 -- 172.21.15.139:0/4164305957 shutdown_connections 2024-09-10T05:11:20.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.297+0000 7f3e81f24640 1 --2- 172.21.15.139:0/4164305957 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e6803df10 0x7f3e680403d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.297+0000 7f3e81f24640 1 --2- 172.21.15.139:0/4164305957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c071380 0x7f3e7c1bfa50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.297+0000 7f3e81f24640 1 -- 172.21.15.139:0/4164305957 >> 172.21.15.139:0/4164305957 conn(0x7f3e7c09c640 msgr2=0x7f3e7c06f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:20.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.297+0000 7f3e81f24640 1 -- 172.21.15.139:0/4164305957 shutdown_connections 2024-09-10T05:11:20.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.298+0000 7f3e81f24640 1 -- 172.21.15.139:0/4164305957 wait complete. 2024-09-10T05:11:20.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.300+0000 7f13c5631640 1 -- 172.21.15.139:0/1062753420 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f13ac03df30 msgr2=0x7f13ac0403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.300+0000 7f13c5631640 1 --2- 172.21.15.139:0/1062753420 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f13ac03df30 0x7f13ac0403f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13b4001600 tx=0x7f13b40079f0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.300+0000 7f13c5631640 1 -- 172.21.15.139:0/1062753420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13c012bec0 msgr2=0x7f13c011a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.300+0000 7f13c5631640 1 --2- 172.21.15.139:0/1062753420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13c012bec0 0x7f13c011a740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f13b0035040 tx=0x7f13b00046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.300+0000 7f13c5631640 1 -- 172.21.15.139:0/1062753420 shutdown_connections 2024-09-10T05:11:20.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.300+0000 7f13c5631640 1 --2- 172.21.15.139:0/1062753420 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f13ac03df30 0x7f13ac0403f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.300+0000 7f13c5631640 1 --2- 172.21.15.139:0/1062753420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13c012bec0 0x7f13c011a740 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.300+0000 7f13c5631640 1 -- 172.21.15.139:0/1062753420 >> 172.21.15.139:0/1062753420 conn(0x7f13c0071da0 msgr2=0x7f13c009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:20.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.300+0000 7f13c5631640 1 -- 172.21.15.139:0/1062753420 shutdown_connections 2024-09-10T05:11:20.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.300+0000 7f13c5631640 1 -- 172.21.15.139:0/1062753420 wait complete. 2024-09-10T05:11:20.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.1 2024-09-10T05:11:20.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2024-09-10T05:11:20.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.315+0000 7f859fbf5640 1 -- 172.21.15.139:0/2518820870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8598050d60 con 0x7f8598072460 2024-09-10T05:11:20.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.315+0000 7f858e7fc640 1 -- 172.21.15.139:0/2518820870 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8594011590 con 0x7f8598072460 2024-09-10T05:11:20.316 INFO:teuthology.orchestra.run.smithi139.stdout:38654705668 2024-09-10T05:11:20.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.317+0000 7f859fbf5640 1 -- 172.21.15.139:0/2518820870 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f857c03de90 msgr2=0x7f857c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.317+0000 7f859fbf5640 1 --2- 172.21.15.139:0/2518820870 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f857c03de90 0x7f857c040350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8588034000 tx=0x7f858802e000 comp rx=0 tx=0).stop 2024-09-10T05:11:20.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.317+0000 7f859fbf5640 1 -- 172.21.15.139:0/2518820870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8598072460 msgr2=0x7f859812b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.317+0000 7f859fbf5640 1 --2- 172.21.15.139:0/2518820870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8598072460 0x7f859812b810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f859400c480 tx=0x7f859400c940 comp rx=0 tx=0).stop 2024-09-10T05:11:20.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.317+0000 7f859fbf5640 1 -- 172.21.15.139:0/2518820870 shutdown_connections 2024-09-10T05:11:20.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.317+0000 7f859fbf5640 1 --2- 172.21.15.139:0/2518820870 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f857c03de90 0x7f857c040350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.317+0000 7f859fbf5640 1 --2- 172.21.15.139:0/2518820870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8598072460 0x7f859812b810 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.317+0000 7f859fbf5640 1 -- 172.21.15.139:0/2518820870 >> 172.21.15.139:0/2518820870 conn(0x7f859809b880 msgr2=0x7f859806dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:20.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.317+0000 7f859fbf5640 1 -- 172.21.15.139:0/2518820870 shutdown_connections 2024-09-10T05:11:20.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.317+0000 7f859fbf5640 1 -- 172.21.15.139:0/2518820870 wait complete. 2024-09-10T05:11:20.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.319+0000 7f8f93c50640 1 -- 172.21.15.139:0/974682171 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8f8c119040 con 0x7f8f8c071d10 2024-09-10T05:11:20.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.320+0000 7f8f827fc640 1 -- 172.21.15.139:0/974682171 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8f8c073050 con 0x7f8f8c071d10 2024-09-10T05:11:20.321 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-09-10T05:11:20.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.322+0000 7f8f93c50640 1 -- 172.21.15.139:0/974682171 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8f7003de90 msgr2=0x7f8f70040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.322+0000 7f8f93c50640 1 --2- 172.21.15.139:0/974682171 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8f7003de90 0x7f8f70040350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c036000 tx=0x7f8f7c031000 comp rx=0 tx=0).stop 2024-09-10T05:11:20.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.322+0000 7f8f93c50640 1 -- 172.21.15.139:0/974682171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f8c071d10 msgr2=0x7f8f8c116960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:20.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.322+0000 7f8f93c50640 1 --2- 172.21.15.139:0/974682171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f8c071d10 0x7f8f8c116960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800c680 tx=0x7f8f8800cb40 comp rx=0 tx=0).stop 2024-09-10T05:11:20.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.322+0000 7f8f93c50640 1 -- 172.21.15.139:0/974682171 shutdown_connections 2024-09-10T05:11:20.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.322+0000 7f8f93c50640 1 --2- 172.21.15.139:0/974682171 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8f7003de90 0x7f8f70040350 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.322+0000 7f8f93c50640 1 --2- 172.21.15.139:0/974682171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f8c071d10 0x7f8f8c116960 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:20.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.322+0000 7f8f93c50640 1 -- 172.21.15.139:0/974682171 >> 172.21.15.139:0/974682171 conn(0x7f8f8c09c640 msgr2=0x7f8f8c1b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:20.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.322+0000 7f8f93c50640 1 -- 172.21.15.139:0/974682171 shutdown_connections 2024-09-10T05:11:20.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:20.322+0000 7f8f93c50640 1 -- 172.21.15.139:0/974682171 wait complete. 2024-09-10T05:11:20.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.0 2024-09-10T05:11:20.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2024-09-10T05:11:21.312 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T05:11:21.314 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T05:11:21.331 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T05:11:21.334 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T05:11:21.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.425+0000 7fb594c71640 1 Processor -- start 2024-09-10T05:11:21.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.425+0000 7fb594c71640 1 -- start start 2024-09-10T05:11:21.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.426+0000 7fb594c71640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb59006fe70 0x7fb590070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:21.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.426+0000 7fb594c71640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb590071680 con 0x7fb590070790 2024-09-10T05:11:21.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.426+0000 7fb594c71640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fb5900a30e0 con 0x7fb59006fe70 2024-09-10T05:11:21.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7fb58e59c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb59006fe70 0x7fb590070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:21.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7fb58dd9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb590070790 0x7fb59012ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60810/0 (socket says 172.21.15.139:60810) 2024-09-10T05:11:21.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7fb58dd9b640 1 -- 172.21.15.139:0/2893276604 learned_addr learned my addr 172.21.15.139:0/2893276604 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:21.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7f4796023640 1 Processor -- start 2024-09-10T05:11:21.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7f4796023640 1 -- start start 2024-09-10T05:11:21.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7fb58e59c640 1 -- 172.21.15.139:0/2893276604 >> v1:172.21.15.139:6789/0 conn(0x7fb590070790 legacy=0x7fb59012ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7fb58e59c640 1 -- 172.21.15.139:0/2893276604 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb590071dd0 con 0x7fb59006fe70 2024-09-10T05:11:21.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7f4796023640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f479009d390 0x7f4790129300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:21.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7f4796023640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4790129c90 con 0x7f4790129840 2024-09-10T05:11:21.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7f4796023640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f4790128fe0 con 0x7f479009d390 2024-09-10T05:11:21.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7f478f7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f479009d390 0x7f4790129300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:21.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7f478f7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f479009d390 0x7f4790129300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46498/0 (socket says 172.21.15.139:46498) 2024-09-10T05:11:21.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.428+0000 7f478f7fe640 1 -- 172.21.15.139:0/1341772048 learned_addr learned my addr 172.21.15.139:0/1341772048 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:21.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.427+0000 7f478effd640 1 --1- 172.21.15.139:0/1341772048 >> v1:172.21.15.139:6789/0 conn(0x7f4790129840 0x7f479012c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60812/0 (socket says 172.21.15.139:60812) 2024-09-10T05:11:21.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.428+0000 7f478f7fe640 1 -- 172.21.15.139:0/1341772048 >> v1:172.21.15.139:6789/0 conn(0x7f4790129840 legacy=0x7f479012c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.428+0000 7f478e7fc640 1 -- 172.21.15.139:0/1341772048 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 820234548 0 0) 0x7f4790129c90 con 0x7f4790129840 2024-09-10T05:11:21.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.428+0000 7f478f7fe640 1 -- 172.21.15.139:0/1341772048 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479009e0b0 con 0x7f479009d390 2024-09-10T05:11:21.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.428+0000 7fb58e59c640 1 --2- 172.21.15.139:0/2893276604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb59006fe70 0x7fb590070250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb580009720 tx=0x7fb58002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39f71e3e36211e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:21.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.428+0000 7fb58d59a640 1 -- 172.21.15.139:0/2893276604 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb580037070 con 0x7fb59006fe70 2024-09-10T05:11:21.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.428+0000 7fb58d59a640 1 -- 172.21.15.139:0/2893276604 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58002ad90 con 0x7fb59006fe70 2024-09-10T05:11:21.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.428+0000 7fb58d59a640 1 -- 172.21.15.139:0/2893276604 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb580032590 con 0x7fb59006fe70 2024-09-10T05:11:21.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.429+0000 7f478f7fe640 1 --2- 172.21.15.139:0/1341772048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f479009d390 0x7f4790129300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f47800097f0 tx=0x7f478002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b733ca6e775d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:21.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.429+0000 7f478e7fc640 1 -- 172.21.15.139:0/1341772048 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4780037070 con 0x7f479009d390 2024-09-10T05:11:21.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.429+0000 7f478e7fc640 1 -- 172.21.15.139:0/1341772048 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4780032440 con 0x7f479009d390 2024-09-10T05:11:21.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.429+0000 7f478e7fc640 1 -- 172.21.15.139:0/1341772048 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f478002ae60 con 0x7f479009d390 2024-09-10T05:11:21.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.429+0000 7fb594c71640 1 -- 172.21.15.139:0/2893276604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb59006fe70 msgr2=0x7fb590070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.429+0000 7fb594c71640 1 --2- 172.21.15.139:0/2893276604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb59006fe70 0x7fb590070250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb580009720 tx=0x7fb58002a110 comp rx=0 tx=0).stop 2024-09-10T05:11:21.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.429+0000 7fb594c71640 1 -- 172.21.15.139:0/2893276604 shutdown_connections 2024-09-10T05:11:21.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.429+0000 7fb594c71640 1 --2- 172.21.15.139:0/2893276604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb59006fe70 0x7fb590070250 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.429+0000 7fb594c71640 1 -- 172.21.15.139:0/2893276604 >> 172.21.15.139:0/2893276604 conn(0x7fb5900a0a50 msgr2=0x7fb59006e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:21.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.429+0000 7fb594c71640 1 -- 172.21.15.139:0/2893276604 shutdown_connections 2024-09-10T05:11:21.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.429+0000 7fb594c71640 1 -- 172.21.15.139:0/2893276604 wait complete. 2024-09-10T05:11:21.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.430+0000 7f4796023640 1 -- 172.21.15.139:0/1341772048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f479009d390 msgr2=0x7f4790129300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.430+0000 7f4796023640 1 --2- 172.21.15.139:0/1341772048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f479009d390 0x7f4790129300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f47800097f0 tx=0x7f478002a1e0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.430+0000 7f4796023640 1 -- 172.21.15.139:0/1341772048 shutdown_connections 2024-09-10T05:11:21.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.430+0000 7f4796023640 1 --2- 172.21.15.139:0/1341772048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f479009d390 0x7f4790129300 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.430+0000 7f4796023640 1 -- 172.21.15.139:0/1341772048 >> 172.21.15.139:0/1341772048 conn(0x7f4790071520 msgr2=0x7f479009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:21.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.430+0000 7f4796023640 1 -- 172.21.15.139:0/1341772048 shutdown_connections 2024-09-10T05:11:21.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.430+0000 7f4796023640 1 -- 172.21.15.139:0/1341772048 wait complete. 2024-09-10T05:11:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.430+0000 7fb594c71640 1 Processor -- start 2024-09-10T05:11:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.430+0000 7fb594c71640 1 -- start start 2024-09-10T05:11:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.431+0000 7fb594c71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb59006fe70 0x7fb59011f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.431+0000 7fb594c71640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb590075cc0 con 0x7fb59006fe70 2024-09-10T05:11:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.431+0000 7fb58e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb59006fe70 0x7fb59011f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.431+0000 7fb58e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb59006fe70 0x7fb59011f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46500/0 (socket says 172.21.15.139:46500) 2024-09-10T05:11:21.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.431+0000 7fb58e59c640 1 -- 172.21.15.139:0/639854777 learned_addr learned my addr 172.21.15.139:0/639854777 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:21.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.431+0000 7f4796023640 1 Processor -- start 2024-09-10T05:11:21.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.431+0000 7fb58e59c640 1 -- 172.21.15.139:0/639854777 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb590121300 con 0x7fb59006fe70 2024-09-10T05:11:21.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.431+0000 7f4796023640 1 -- start start 2024-09-10T05:11:21.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.431+0000 7fb58e59c640 1 --2- 172.21.15.139:0/639854777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb59006fe70 0x7fb59011f210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb580009840 tx=0x7fb5800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:21.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.432+0000 7fb57effd640 1 -- 172.21.15.139:0/639854777 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb580041070 con 0x7fb59006fe70 2024-09-10T05:11:21.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.432+0000 7fb57effd640 1 -- 172.21.15.139:0/639854777 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58003c460 con 0x7fb59006fe70 2024-09-10T05:11:21.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.432+0000 7fb594c71640 1 -- 172.21.15.139:0/639854777 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb590122560 con 0x7fb59006fe70 2024-09-10T05:11:21.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.432+0000 7fb57effd640 1 -- 172.21.15.139:0/639854777 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb580037040 con 0x7fb59006fe70 2024-09-10T05:11:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.432+0000 7f4796023640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f479009d390 0x7f47901be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.432+0000 7fb594c71640 1 -- 172.21.15.139:0/639854777 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb590122890 con 0x7fb59006fe70 2024-09-10T05:11:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.432+0000 7f4796023640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f479012cb20 con 0x7f479009d390 2024-09-10T05:11:21.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.432+0000 7f478f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f479009d390 0x7f47901be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:21.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.432+0000 7f478f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f479009d390 0x7f47901be870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46510/0 (socket says 172.21.15.139:46510) 2024-09-10T05:11:21.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.432+0000 7f478f7fe640 1 -- 172.21.15.139:0/279428306 learned_addr learned my addr 172.21.15.139:0/279428306 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:21.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.432+0000 7f478f7fe640 1 -- 172.21.15.139:0/279428306 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4790116010 con 0x7f479009d390 2024-09-10T05:11:21.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.433+0000 7f478f7fe640 1 --2- 172.21.15.139:0/279428306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f479009d390 0x7f47901be870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4780035040 tx=0x7f47800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:21.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.433+0000 7fb594c71640 1 -- 172.21.15.139:0/639854777 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb590070250 con 0x7fb59006fe70 2024-09-10T05:11:21.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.433+0000 7f4777fff640 1 -- 172.21.15.139:0/279428306 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4780037040 con 0x7f479009d390 2024-09-10T05:11:21.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.433+0000 7f4777fff640 1 -- 172.21.15.139:0/279428306 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4780004030 con 0x7f479009d390 2024-09-10T05:11:21.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.433+0000 7f4796023640 1 -- 172.21.15.139:0/279428306 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4790132480 con 0x7f479009d390 2024-09-10T05:11:21.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.433+0000 7f4796023640 1 -- 172.21.15.139:0/279428306 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4790115940 con 0x7f479009d390 2024-09-10T05:11:21.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.434+0000 7fb57effd640 1 -- 172.21.15.139:0/639854777 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb580044070 con 0x7fb59006fe70 2024-09-10T05:11:21.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.434+0000 7f4777fff640 1 -- 172.21.15.139:0/279428306 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4780004330 con 0x7f479009d390 2024-09-10T05:11:21.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.434+0000 7fb57effd640 1 --2- 172.21.15.139:0/639854777 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb57003de70 0x7fb570040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:21.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.434+0000 7fb57effd640 1 -- 172.21.15.139:0/639854777 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fb580072ce0 con 0x7fb59006fe70 2024-09-10T05:11:21.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.434+0000 7fb58dd9b640 1 --2- 172.21.15.139:0/639854777 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb57003de70 0x7fb570040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:21.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.434+0000 7f4796023640 1 -- 172.21.15.139:0/279428306 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4790131ed0 con 0x7f479009d390 2024-09-10T05:11:21.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.435+0000 7f4777fff640 1 -- 172.21.15.139:0/279428306 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f478003a040 con 0x7f479009d390 2024-09-10T05:11:21.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.435+0000 7f4777fff640 1 --2- 172.21.15.139:0/279428306 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f477c03dee0 0x7f477c0403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:21.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.435+0000 7f4777fff640 1 -- 172.21.15.139:0/279428306 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f47800729a0 con 0x7f479009d390 2024-09-10T05:11:21.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.435+0000 7f478effd640 1 --2- 172.21.15.139:0/279428306 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f477c03dee0 0x7f477c0403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:21.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.436+0000 7fb58dd9b640 1 --2- 172.21.15.139:0/639854777 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb57003de70 0x7fb570040330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb584007fd0 tx=0x7fb584007aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:21.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.436+0000 7f478effd640 1 --2- 172.21.15.139:0/279428306 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f477c03dee0 0x7f477c0403a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4784000c00 tx=0x7f47840078d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:21.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.440+0000 7fb57effd640 1 -- 172.21.15.139:0/639854777 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fb58004ed60 con 0x7fb59006fe70 2024-09-10T05:11:21.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.444+0000 7f4777fff640 1 -- 172.21.15.139:0/279428306 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f4790116010 con 0x7f479009d390 2024-09-10T05:11:21.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.466+0000 7f2783ed4640 1 Processor -- start 2024-09-10T05:11:21.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.466+0000 7f6c0a5aa640 1 Processor -- start 2024-09-10T05:11:21.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.466+0000 7f6c0a5aa640 1 -- start start 2024-09-10T05:11:21.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.466+0000 7f2783ed4640 1 -- start start 2024-09-10T05:11:21.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.466+0000 7f6c0a5aa640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6c04125960 0x7f6c04125d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:21.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.466+0000 7f6c0a5aa640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c04073a30 con 0x7f6c04114190 2024-09-10T05:11:21.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.466+0000 7f6c0a5aa640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f6c04117100 con 0x7f6c04125960 2024-09-10T05:11:21.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.466+0000 7f2783ed4640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f277c129b00 0x7f277c129ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:21.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f2783ed4640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f277c09e5b0 con 0x7f277c12a420 2024-09-10T05:11:21.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f2783ed4640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f277c09ef00 con 0x7f277c129b00 2024-09-10T05:11:21.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f6c037fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6c04114190 0x7f6c041145a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60814/0 (socket says 172.21.15.139:60814) 2024-09-10T05:11:21.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f6c037fe640 1 -- 172.21.15.139:0/3483032526 learned_addr learned my addr 172.21.15.139:0/3483032526 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:21.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f6c03fff640 1 --2- 172.21.15.139:0/3483032526 >> v2:172.21.15.139:3300/0 conn(0x7f6c04125960 0x7f6c04125d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:21.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f278146f640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f277c12a420 0x7f277c12d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60830/0 (socket says 172.21.15.139:60830) 2024-09-10T05:11:21.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f278146f640 1 -- 172.21.15.139:0/1379707798 learned_addr learned my addr 172.21.15.139:0/1379707798 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:21.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f2781c70640 1 --2- 172.21.15.139:0/1379707798 >> v2:172.21.15.139:3300/0 conn(0x7f277c129b00 0x7f277c129ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:21.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f6c02ffd640 1 -- 172.21.15.139:0/3483032526 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2819418349 0 0) 0x7f6c04073a30 con 0x7f6c04114190 2024-09-10T05:11:21.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f6c02ffd640 1 -- 172.21.15.139:0/3483032526 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bec003520 con 0x7f6c04114190 2024-09-10T05:11:21.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f6c03fff640 1 -- 172.21.15.139:0/3483032526 >> v1:172.21.15.139:6789/0 conn(0x7f6c04114190 legacy=0x7f6c041145a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f6c03fff640 1 -- 172.21.15.139:0/3483032526 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c04116d60 con 0x7f6c04125960 2024-09-10T05:11:21.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f2781c70640 1 -- 172.21.15.139:0/1379707798 >> v1:172.21.15.139:6789/0 conn(0x7f277c12a420 legacy=0x7f277c12d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.467+0000 7f2781c70640 1 -- 172.21.15.139:0/1379707798 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c09f390 con 0x7f277c129b00 2024-09-10T05:11:21.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.468+0000 7f6c03fff640 1 --2- 172.21.15.139:0/3483032526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c04125960 0x7f6c04125d40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4009750 tx=0x7f6bf402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceebf02a8c1c9086 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:21.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.468+0000 7f2781c70640 1 --2- 172.21.15.139:0/1379707798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277c129b00 0x7f277c129ee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2778009720 tx=0x7f277802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2fd74dad019379 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:21.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.468+0000 7f6c02ffd640 1 -- 172.21.15.139:0/3483032526 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf4037070 con 0x7f6c04125960 2024-09-10T05:11:21.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.468+0000 7f6c02ffd640 1 -- 172.21.15.139:0/3483032526 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf402ad80 con 0x7f6c04125960 2024-09-10T05:11:21.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.468+0000 7f6c02ffd640 1 -- 172.21.15.139:0/3483032526 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf4032570 con 0x7f6c04125960 2024-09-10T05:11:21.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.468+0000 7f2780c6e640 1 -- 172.21.15.139:0/1379707798 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2778037070 con 0x7f277c129b00 2024-09-10T05:11:21.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.468+0000 7f2780c6e640 1 -- 172.21.15.139:0/1379707798 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277802ae20 con 0x7f277c129b00 2024-09-10T05:11:21.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.468+0000 7f2780c6e640 1 -- 172.21.15.139:0/1379707798 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2778032590 con 0x7f277c129b00 2024-09-10T05:11:21.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/3483032526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c04125960 msgr2=0x7f6c04125d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f6c0a5aa640 1 --2- 172.21.15.139:0/3483032526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c04125960 0x7f6c04125d40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4009750 tx=0x7f6bf402a140 comp rx=0 tx=0).stop 2024-09-10T05:11:21.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f2783ed4640 1 -- 172.21.15.139:0/1379707798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277c129b00 msgr2=0x7f277c129ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f2783ed4640 1 --2- 172.21.15.139:0/1379707798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277c129b00 0x7f277c129ee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2778009720 tx=0x7f277802a1a0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/3483032526 shutdown_connections 2024-09-10T05:11:21.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f6c0a5aa640 1 --2- 172.21.15.139:0/3483032526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c04125960 0x7f6c04125d40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f2783ed4640 1 -- 172.21.15.139:0/1379707798 shutdown_connections 2024-09-10T05:11:21.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f2783ed4640 1 --2- 172.21.15.139:0/1379707798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277c129b00 0x7f277c129ee0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f2783ed4640 1 -- 172.21.15.139:0/1379707798 >> 172.21.15.139:0/1379707798 conn(0x7f277c071580 msgr2=0x7f277c09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:21.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/3483032526 >> 172.21.15.139:0/3483032526 conn(0x7f6c0406f8d0 msgr2=0x7f6c04071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:21.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/3483032526 shutdown_connections 2024-09-10T05:11:21.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/3483032526 wait complete. 2024-09-10T05:11:21.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f2783ed4640 1 -- 172.21.15.139:0/1379707798 shutdown_connections 2024-09-10T05:11:21.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.469+0000 7f2783ed4640 1 -- 172.21.15.139:0/1379707798 wait complete. 2024-09-10T05:11:21.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.470+0000 7f2783ed4640 1 Processor -- start 2024-09-10T05:11:21.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.470+0000 7f6c0a5aa640 1 Processor -- start 2024-09-10T05:11:21.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.470+0000 7f2783ed4640 1 -- start start 2024-09-10T05:11:21.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.470+0000 7f6c0a5aa640 1 -- start start 2024-09-10T05:11:21.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f2783ed4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277c129b00 0x7f277c1c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:21.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f2783ed4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f277c12a850 con 0x7f277c129b00 2024-09-10T05:11:21.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f2781c70640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277c129b00 0x7f277c1c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:21.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f2781c70640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277c129b00 0x7f277c1c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46542/0 (socket says 172.21.15.139:46542) 2024-09-10T05:11:21.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f2781c70640 1 -- 172.21.15.139:0/3670388616 learned_addr learned my addr 172.21.15.139:0/3670388616 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:21.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f6c0a5aa640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c04114190 0x7f6c04117330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:21.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f6c0a5aa640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6c041165f0 con 0x7f6c04114190 2024-09-10T05:11:21.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c04114190 0x7f6c04117330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:21.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c04114190 0x7f6c04117330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46548/0 (socket says 172.21.15.139:46548) 2024-09-10T05:11:21.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f6c03fff640 1 -- 172.21.15.139:0/363941933 learned_addr learned my addr 172.21.15.139:0/363941933 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:21.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f2781c70640 1 -- 172.21.15.139:0/3670388616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c06ed40 con 0x7f277c129b00 2024-09-10T05:11:21.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f2781c70640 1 --2- 172.21.15.139:0/3670388616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277c129b00 0x7f277c1c83b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f277802a1e0 tx=0x7f27780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:21.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f6c03fff640 1 -- 172.21.15.139:0/363941933 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c04118590 con 0x7f6c04114190 2024-09-10T05:11:21.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.471+0000 7f27727fc640 1 -- 172.21.15.139:0/3670388616 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2778042070 con 0x7f277c129b00 2024-09-10T05:11:21.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.472+0000 7f6c03fff640 1 --2- 172.21.15.139:0/363941933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c04114190 0x7f6c04117330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4009750 tx=0x7f6bf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:21.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.472+0000 7f27727fc640 1 -- 172.21.15.139:0/3670388616 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277803e590 con 0x7f277c129b00 2024-09-10T05:11:21.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.472+0000 7f27727fc640 1 -- 172.21.15.139:0/3670388616 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2778037040 con 0x7f277c129b00 2024-09-10T05:11:21.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.472+0000 7f2783ed4640 1 -- 172.21.15.139:0/3670388616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277c11be50 con 0x7f277c129b00 2024-09-10T05:11:21.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.472+0000 7f6c00ff9640 1 -- 172.21.15.139:0/363941933 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf4041020 con 0x7f6c04114190 2024-09-10T05:11:21.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.472+0000 7f6c00ff9640 1 -- 172.21.15.139:0/363941933 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf40044c0 con 0x7f6c04114190 2024-09-10T05:11:21.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.472+0000 7f6c00ff9640 1 -- 172.21.15.139:0/363941933 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf4037040 con 0x7f6c04114190 2024-09-10T05:11:21.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.472+0000 7f2783ed4640 1 -- 172.21.15.139:0/3670388616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277c11cc10 con 0x7f277c129b00 2024-09-10T05:11:21.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.472+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/363941933 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c04072f40 con 0x7f6c04114190 2024-09-10T05:11:21.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.473+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/363941933 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c04117870 con 0x7f6c04114190 2024-09-10T05:11:21.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.473+0000 7f27727fc640 1 -- 172.21.15.139:0/3670388616 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2778045070 con 0x7f277c129b00 2024-09-10T05:11:21.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.473+0000 7f2783ed4640 1 -- 172.21.15.139:0/3670388616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f277c129ee0 con 0x7f277c129b00 2024-09-10T05:11:21.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.473+0000 7f27727fc640 1 --2- 172.21.15.139:0/3670388616 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f276003dee0 0x7f27600403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:21.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.473+0000 7f27727fc640 1 -- 172.21.15.139:0/3670388616 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f2778072cb0 con 0x7f277c129b00 2024-09-10T05:11:21.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.474+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/363941933 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c040767d0 con 0x7f6c04114190 2024-09-10T05:11:21.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.474+0000 7f6c00ff9640 1 -- 172.21.15.139:0/363941933 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6bf4044020 con 0x7f6c04114190 2024-09-10T05:11:21.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.474+0000 7f278146f640 1 --2- 172.21.15.139:0/3670388616 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f276003dee0 0x7f27600403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:21.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.474+0000 7f6c00ff9640 1 --2- 172.21.15.139:0/363941933 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6bf003de40 0x7f6bf0040300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:21.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.474+0000 7f6c00ff9640 1 -- 172.21.15.139:0/363941933 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f6bf4072870 con 0x7f6c04114190 2024-09-10T05:11:21.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.474+0000 7f6c037fe640 1 --2- 172.21.15.139:0/363941933 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6bf003de40 0x7f6bf0040300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:21.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.474+0000 7f278146f640 1 --2- 172.21.15.139:0/3670388616 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f276003dee0 0x7f27600403a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f276c007fd0 tx=0x7f276c007aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:21.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.475+0000 7f6c037fe640 1 --2- 172.21.15.139:0/363941933 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6bf003de40 0x7f6bf0040300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8001610 tx=0x7f6bf80078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:21.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.482+0000 7f27727fc640 1 -- 172.21.15.139:0/3670388616 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f277803c430 con 0x7f277c129b00 2024-09-10T05:11:21.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.491+0000 7f6c00ff9640 1 -- 172.21.15.139:0/363941933 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f6bf404b030 con 0x7f6c04114190 2024-09-10T05:11:21.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.624+0000 7fb594c71640 1 -- 172.21.15.139:0/639854777 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb590120bb0 con 0x7fb59006fe70 2024-09-10T05:11:21.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.625+0000 7fb57effd640 1 -- 172.21.15.139:0/639854777 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb58003d3f0 con 0x7fb59006fe70 2024-09-10T05:11:21.626 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-09-10T05:11:21.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.627+0000 7fb594c71640 1 -- 172.21.15.139:0/639854777 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb57003de70 msgr2=0x7fb570040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.627+0000 7fb594c71640 1 --2- 172.21.15.139:0/639854777 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb57003de70 0x7fb570040330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb584007fd0 tx=0x7fb584007aa0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.627+0000 7fb594c71640 1 -- 172.21.15.139:0/639854777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb59006fe70 msgr2=0x7fb59011f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.627+0000 7fb594c71640 1 --2- 172.21.15.139:0/639854777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb59006fe70 0x7fb59011f210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb580009840 tx=0x7fb5800046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.627+0000 7fb594c71640 1 -- 172.21.15.139:0/639854777 shutdown_connections 2024-09-10T05:11:21.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.627+0000 7fb594c71640 1 --2- 172.21.15.139:0/639854777 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb57003de70 0x7fb570040330 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.627+0000 7fb594c71640 1 --2- 172.21.15.139:0/639854777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb59006fe70 0x7fb59011f210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.627+0000 7fb594c71640 1 -- 172.21.15.139:0/639854777 >> 172.21.15.139:0/639854777 conn(0x7fb5900a0a50 msgr2=0x7fb59012c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:21.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.627+0000 7fb594c71640 1 -- 172.21.15.139:0/639854777 shutdown_connections 2024-09-10T05:11:21.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.627+0000 7fb594c71640 1 -- 172.21.15.139:0/639854777 wait complete. 2024-09-10T05:11:21.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.1 2024-09-10T05:11:21.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.643+0000 7f4796023640 1 -- 172.21.15.139:0/279428306 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f479012d030 con 0x7f479009d390 2024-09-10T05:11:21.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.644+0000 7f4777fff640 1 -- 172.21.15.139:0/279428306 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4780042020 con 0x7f479009d390 2024-09-10T05:11:21.645 INFO:teuthology.orchestra.run.smithi139.stdout:47244640259 2024-09-10T05:11:21.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.646+0000 7f4796023640 1 -- 172.21.15.139:0/279428306 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f477c03dee0 msgr2=0x7f477c0403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.646+0000 7f4796023640 1 --2- 172.21.15.139:0/279428306 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f477c03dee0 0x7f477c0403a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4784000c00 tx=0x7f47840078d0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.646+0000 7f4796023640 1 -- 172.21.15.139:0/279428306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f479009d390 msgr2=0x7f47901be870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.646+0000 7f4796023640 1 --2- 172.21.15.139:0/279428306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f479009d390 0x7f47901be870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4780035040 tx=0x7f47800046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.646+0000 7f4796023640 1 -- 172.21.15.139:0/279428306 shutdown_connections 2024-09-10T05:11:21.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.646+0000 7f4796023640 1 --2- 172.21.15.139:0/279428306 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f477c03dee0 0x7f477c0403a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.646+0000 7f4796023640 1 --2- 172.21.15.139:0/279428306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f479009d390 0x7f47901be870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.646+0000 7f4796023640 1 -- 172.21.15.139:0/279428306 >> 172.21.15.139:0/279428306 conn(0x7f4790071520 msgr2=0x7f4790071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:21.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.647+0000 7f4796023640 1 -- 172.21.15.139:0/279428306 shutdown_connections 2024-09-10T05:11:21.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.647+0000 7f4796023640 1 -- 172.21.15.139:0/279428306 wait complete. 2024-09-10T05:11:21.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2024-09-10T05:11:21.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.684+0000 7f2783ed4640 1 -- 172.21.15.139:0/3670388616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f277c068da0 con 0x7f277c129b00 2024-09-10T05:11:21.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.685+0000 7f27727fc640 1 -- 172.21.15.139:0/3670388616 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f277802ae20 con 0x7f277c129b00 2024-09-10T05:11:21.686 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-09-10T05:11:21.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.687+0000 7f2783ed4640 1 -- 172.21.15.139:0/3670388616 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f276003dee0 msgr2=0x7f27600403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.687+0000 7f2783ed4640 1 --2- 172.21.15.139:0/3670388616 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f276003dee0 0x7f27600403a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f276c007fd0 tx=0x7f276c007aa0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.687+0000 7f2783ed4640 1 -- 172.21.15.139:0/3670388616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277c129b00 msgr2=0x7f277c1c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.687+0000 7f2783ed4640 1 --2- 172.21.15.139:0/3670388616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277c129b00 0x7f277c1c83b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f277802a1e0 tx=0x7f27780046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.687+0000 7f2783ed4640 1 -- 172.21.15.139:0/3670388616 shutdown_connections 2024-09-10T05:11:21.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.687+0000 7f2783ed4640 1 --2- 172.21.15.139:0/3670388616 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f276003dee0 0x7f27600403a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.687+0000 7f2783ed4640 1 --2- 172.21.15.139:0/3670388616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277c129b00 0x7f277c1c83b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.687+0000 7f2783ed4640 1 -- 172.21.15.139:0/3670388616 >> 172.21.15.139:0/3670388616 conn(0x7f277c071580 msgr2=0x7f277c127e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:21.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.687+0000 7f2783ed4640 1 -- 172.21.15.139:0/3670388616 shutdown_connections 2024-09-10T05:11:21.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.687+0000 7f2783ed4640 1 -- 172.21.15.139:0/3670388616 wait complete. 2024-09-10T05:11:21.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.694+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/363941933 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6c041231c0 con 0x7f6c04114190 2024-09-10T05:11:21.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.694+0000 7f6c00ff9640 1 -- 172.21.15.139:0/363941933 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6bf4032440 con 0x7f6c04114190 2024-09-10T05:11:21.695 INFO:teuthology.orchestra.run.smithi139.stdout:38654705669 2024-09-10T05:11:21.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.697+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/363941933 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6bf003de40 msgr2=0x7f6bf0040300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.697+0000 7f6c0a5aa640 1 --2- 172.21.15.139:0/363941933 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6bf003de40 0x7f6bf0040300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8001610 tx=0x7f6bf80078f0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.697+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/363941933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c04114190 msgr2=0x7f6c04117330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:21.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.697+0000 7f6c0a5aa640 1 --2- 172.21.15.139:0/363941933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c04114190 0x7f6c04117330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4009750 tx=0x7f6bf40046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.697+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/363941933 shutdown_connections 2024-09-10T05:11:21.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.697+0000 7f6c0a5aa640 1 --2- 172.21.15.139:0/363941933 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6bf003de40 0x7f6bf0040300 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.697+0000 7f6c0a5aa640 1 --2- 172.21.15.139:0/363941933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c04114190 0x7f6c04117330 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:21.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.697+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/363941933 >> 172.21.15.139:0/363941933 conn(0x7f6c0406f8d0 msgr2=0x7f6c0412f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:21.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.697+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/363941933 shutdown_connections 2024-09-10T05:11:21.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:21.697+0000 7f6c0a5aa640 1 -- 172.21.15.139:0/363941933 wait complete. 2024-09-10T05:11:21.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2024-09-10T05:11:21.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-09-10T05:11:22.641 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T05:11:22.659 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T05:11:22.701 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T05:11:22.710 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T05:11:22.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.755+0000 7f82f9e85640 1 Processor -- start 2024-09-10T05:11:22.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.756+0000 7f82f9e85640 1 -- start start 2024-09-10T05:11:22.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.756+0000 7f82f9e85640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f82f41325d0 0x7f82f41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:22.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.756+0000 7f82f9e85640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f4126380 con 0x7f82f4125890 2024-09-10T05:11:22.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.756+0000 7f82f9e85640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f82f4117030 con 0x7f82f41325d0 2024-09-10T05:11:22.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.756+0000 7f82f2ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f82f41325d0 0x7f82f41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:22.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.756+0000 7f82f37fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f82f4125890 0x7f82f4125c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:42152/0 (socket says 172.21.15.139:42152) 2024-09-10T05:11:22.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.756+0000 7f82f37fe640 1 -- 172.21.15.139:0/611935584 learned_addr learned my addr 172.21.15.139:0/611935584 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:22.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.756+0000 7f82f2ffd640 1 -- 172.21.15.139:0/611935584 >> v1:172.21.15.139:6789/0 conn(0x7f82f4125890 legacy=0x7f82f4125c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:22.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.756+0000 7f82f2ffd640 1 -- 172.21.15.139:0/611935584 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f406fe70 con 0x7f82f41325d0 2024-09-10T05:11:22.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.757+0000 7f82f2ffd640 1 --2- 172.21.15.139:0/611935584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82f41325d0 0x7f82f41349c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009750 tx=0x7f82e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad50322fa2df8f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:22.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.757+0000 7f82f27fc640 1 -- 172.21.15.139:0/611935584 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82e8037070 con 0x7f82f41325d0 2024-09-10T05:11:22.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.757+0000 7f82f27fc640 1 -- 172.21.15.139:0/611935584 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e802ae20 con 0x7f82f41325d0 2024-09-10T05:11:22.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.757+0000 7f82f27fc640 1 -- 172.21.15.139:0/611935584 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82e8032590 con 0x7f82f41325d0 2024-09-10T05:11:22.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.758+0000 7f82f9e85640 1 -- 172.21.15.139:0/611935584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82f41325d0 msgr2=0x7f82f41349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:22.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.758+0000 7f82f9e85640 1 --2- 172.21.15.139:0/611935584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82f41325d0 0x7f82f41349c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009750 tx=0x7f82e802a1e0 comp rx=0 tx=0).stop 2024-09-10T05:11:22.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.758+0000 7f82f9e85640 1 -- 172.21.15.139:0/611935584 shutdown_connections 2024-09-10T05:11:22.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.758+0000 7f82f9e85640 1 --2- 172.21.15.139:0/611935584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82f41325d0 0x7f82f41349c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:22.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.758+0000 7f82f9e85640 1 -- 172.21.15.139:0/611935584 >> 172.21.15.139:0/611935584 conn(0x7f82f4071580 msgr2=0x7f82f409aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:22.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.758+0000 7f82f9e85640 1 -- 172.21.15.139:0/611935584 shutdown_connections 2024-09-10T05:11:22.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.758+0000 7f82f9e85640 1 -- 172.21.15.139:0/611935584 wait complete. 2024-09-10T05:11:22.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.759+0000 7f82f9e85640 1 Processor -- start 2024-09-10T05:11:22.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.759+0000 7f82f9e85640 1 -- start start 2024-09-10T05:11:22.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.760+0000 7f82f9e85640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82f4125890 0x7f82f412f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:22.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.760+0000 7f82f9e85640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f82f40705d0 con 0x7f82f4125890 2024-09-10T05:11:22.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.760+0000 7f82f37fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82f4125890 0x7f82f412f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:22.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.760+0000 7f82f37fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82f4125890 0x7f82f412f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36396/0 (socket says 172.21.15.139:36396) 2024-09-10T05:11:22.762 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.760+0000 7f82f37fe640 1 -- 172.21.15.139:0/1143430486 learned_addr learned my addr 172.21.15.139:0/1143430486 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:22.762 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.760+0000 7f82f37fe640 1 -- 172.21.15.139:0/1143430486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f4117310 con 0x7f82f4125890 2024-09-10T05:11:22.762 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.760+0000 7f82f37fe640 1 --2- 172.21.15.139:0/1143430486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82f4125890 0x7f82f412f790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f82e400c480 tx=0x7f82e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:22.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.760+0000 7f82dbfff640 1 -- 172.21.15.139:0/1143430486 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82e4017070 con 0x7f82f4125890 2024-09-10T05:11:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.761+0000 7f82f9e85640 1 -- 172.21.15.139:0/1143430486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f41299b0 con 0x7f82f4125890 2024-09-10T05:11:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.761+0000 7f82dbfff640 1 -- 172.21.15.139:0/1143430486 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e4005c10 con 0x7f82f4125890 2024-09-10T05:11:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.761+0000 7f82f9e85640 1 -- 172.21.15.139:0/1143430486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f412fcd0 con 0x7f82f4125890 2024-09-10T05:11:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.761+0000 7f82dbfff640 1 -- 172.21.15.139:0/1143430486 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82e4007070 con 0x7f82f4125890 2024-09-10T05:11:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.762+0000 7f82f9e85640 1 -- 172.21.15.139:0/1143430486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f4125c70 con 0x7f82f4125890 2024-09-10T05:11:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.762+0000 7f82dbfff640 1 -- 172.21.15.139:0/1143430486 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f82e401a070 con 0x7f82f4125890 2024-09-10T05:11:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.762+0000 7f82dbfff640 1 --2- 172.21.15.139:0/1143430486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f82e003de40 0x7f82e0040300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.762+0000 7f82dbfff640 1 -- 172.21.15.139:0/1143430486 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f82e40514b0 con 0x7f82f4125890 2024-09-10T05:11:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.763+0000 7f82f2ffd640 1 --2- 172.21.15.139:0/1143430486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f82e003de40 0x7f82e0040300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.763+0000 7f82f2ffd640 1 --2- 172.21.15.139:0/1143430486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f82e003de40 0x7f82e0040300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82e8034000 tx=0x7f82e802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:22.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.771+0000 7f82dbfff640 1 -- 172.21.15.139:0/1143430486 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f82f41299b0 con 0x7f82f4125890 2024-09-10T05:11:22.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.811+0000 7fa64f4b8640 1 Processor -- start 2024-09-10T05:11:22.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.812+0000 7fa64f4b8640 1 -- start start 2024-09-10T05:11:22.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.812+0000 7fa64f4b8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa648070960 0x7fa648134780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:22.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.812+0000 7fa64f4b8640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa648071680 con 0x7fa64806fe70 2024-09-10T05:11:22.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.812+0000 7fa64f4b8640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fa6480a30e0 con 0x7fa648070960 2024-09-10T05:11:22.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.812+0000 7fa64ca53640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa648070960 0x7fa648134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:22.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.812+0000 7fa64ca53640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa648070960 0x7fa648134780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36400/0 (socket says 172.21.15.139:36400) 2024-09-10T05:11:22.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.812+0000 7fa64ca53640 1 -- 172.21.15.139:0/3713705771 learned_addr learned my addr 172.21.15.139:0/3713705771 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:22.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.812+0000 7fa64d254640 1 --1- 172.21.15.139:0/3713705771 >> v1:172.21.15.139:6789/0 conn(0x7fa64806fe70 0x7fa648070250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:42158/0 (socket says 172.21.15.139:42158) 2024-09-10T05:11:22.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.813+0000 7fa64ca53640 1 -- 172.21.15.139:0/3713705771 >> v1:172.21.15.139:6789/0 conn(0x7fa64806fe70 legacy=0x7fa648070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:22.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.813+0000 7fa64ca53640 1 -- 172.21.15.139:0/3713705771 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa648071dd0 con 0x7fa648070960 2024-09-10T05:11:22.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.813+0000 7fa64ca53640 1 --2- 172.21.15.139:0/3713705771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa648070960 0x7fa648134780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa6380097f0 tx=0x7fa63802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c4ec42add351e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:22.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.813+0000 7fa63ffff640 1 -- 172.21.15.139:0/3713705771 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa638037070 con 0x7fa648070960 2024-09-10T05:11:22.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.813+0000 7fa63ffff640 1 -- 172.21.15.139:0/3713705771 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa638032440 con 0x7fa648070960 2024-09-10T05:11:22.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.813+0000 7fa63ffff640 1 -- 172.21.15.139:0/3713705771 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63802ae60 con 0x7fa648070960 2024-09-10T05:11:22.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.814+0000 7fa64f4b8640 1 -- 172.21.15.139:0/3713705771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa648070960 msgr2=0x7fa648134780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:22.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.814+0000 7fa64f4b8640 1 --2- 172.21.15.139:0/3713705771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa648070960 0x7fa648134780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa6380097f0 tx=0x7fa63802a1e0 comp rx=0 tx=0).stop 2024-09-10T05:11:22.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.814+0000 7fa64f4b8640 1 -- 172.21.15.139:0/3713705771 shutdown_connections 2024-09-10T05:11:22.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.814+0000 7fa64f4b8640 1 --2- 172.21.15.139:0/3713705771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa648070960 0x7fa648134780 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:22.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.814+0000 7fa64f4b8640 1 -- 172.21.15.139:0/3713705771 >> 172.21.15.139:0/3713705771 conn(0x7fa6480a0a50 msgr2=0x7fa64806e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:22.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.815+0000 7fa64f4b8640 1 -- 172.21.15.139:0/3713705771 shutdown_connections 2024-09-10T05:11:22.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.815+0000 7fa64f4b8640 1 -- 172.21.15.139:0/3713705771 wait complete. 2024-09-10T05:11:22.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.816+0000 7fa64f4b8640 1 Processor -- start 2024-09-10T05:11:22.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.816+0000 7fa64f4b8640 1 -- start start 2024-09-10T05:11:22.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.816+0000 7fa64f4b8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64806fe70 0x7fa648119db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:22.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.816+0000 7fa64f4b8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa648075cc0 con 0x7fa64806fe70 2024-09-10T05:11:22.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.816+0000 7fa64d254640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64806fe70 0x7fa648119db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:22.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.817+0000 7fa64d254640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64806fe70 0x7fa648119db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36416/0 (socket says 172.21.15.139:36416) 2024-09-10T05:11:22.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.817+0000 7fa64d254640 1 -- 172.21.15.139:0/1217076517 learned_addr learned my addr 172.21.15.139:0/1217076517 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:22.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.817+0000 7fa64d254640 1 -- 172.21.15.139:0/1217076517 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa64811ce90 con 0x7fa64806fe70 2024-09-10T05:11:22.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.817+0000 7fa64d254640 1 --2- 172.21.15.139:0/1217076517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64806fe70 0x7fa648119db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c450 tx=0x7fa64400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:22.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.817+0000 7fa63dffb640 1 -- 172.21.15.139:0/1217076517 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa644007410 con 0x7fa64806fe70 2024-09-10T05:11:22.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.817+0000 7fa63dffb640 1 -- 172.21.15.139:0/1217076517 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6440075b0 con 0x7fa64806fe70 2024-09-10T05:11:22.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.817+0000 7fa63dffb640 1 -- 172.21.15.139:0/1217076517 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa644004910 con 0x7fa64806fe70 2024-09-10T05:11:22.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.817+0000 7fa64f4b8640 1 -- 172.21.15.139:0/1217076517 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa64811c1c0 con 0x7fa64806fe70 2024-09-10T05:11:22.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.818+0000 7fa64f4b8640 1 -- 172.21.15.139:0/1217076517 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa64811c850 con 0x7fa64806fe70 2024-09-10T05:11:22.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.819+0000 7fa64f4b8640 1 -- 172.21.15.139:0/1217076517 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa648070250 con 0x7fa64806fe70 2024-09-10T05:11:22.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.819+0000 7fa63dffb640 1 -- 172.21.15.139:0/1217076517 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa64401a020 con 0x7fa64806fe70 2024-09-10T05:11:22.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.820+0000 7fa63dffb640 1 --2- 172.21.15.139:0/1217076517 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa62c03de70 0x7fa62c040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:22.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.820+0000 7fa63dffb640 1 -- 172.21.15.139:0/1217076517 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fa6440521f0 con 0x7fa64806fe70 2024-09-10T05:11:22.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.820+0000 7fa64ca53640 1 --2- 172.21.15.139:0/1217076517 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa62c03de70 0x7fa62c040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:22.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.821+0000 7fa64ca53640 1 --2- 172.21.15.139:0/1217076517 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa62c03de70 0x7fa62c040330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa638034000 tx=0x7fa63802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:22.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.828+0000 7fa63dffb640 1 -- 172.21.15.139:0/1217076517 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fa644021070 con 0x7fa64806fe70 2024-09-10T05:11:22.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.840+0000 7f723cbcd640 1 Processor -- start 2024-09-10T05:11:22.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.840+0000 7f723cbcd640 1 -- start start 2024-09-10T05:11:22.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.840+0000 7f723cbcd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7238114190 0x7f7238114570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.840+0000 7f723cbcd640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7238116c70 con 0x7f7238116380 2024-09-10T05:11:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.840+0000 7f723cbcd640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f7238115620 con 0x7f7238114190 2024-09-10T05:11:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.841+0000 7f723659c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7238114190 0x7f7238114570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.841+0000 7f7235d9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f7238116380 0x7f7238125440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:42160/0 (socket says 172.21.15.139:42160) 2024-09-10T05:11:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.841+0000 7f7235d9b640 1 -- 172.21.15.139:0/4123943551 learned_addr learned my addr 172.21.15.139:0/4123943551 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.841+0000 7f723559a640 1 -- 172.21.15.139:0/4123943551 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1071761723 0 0) 0x7f7238116c70 con 0x7f7238116380 2024-09-10T05:11:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.841+0000 7f723559a640 1 -- 172.21.15.139:0/4123943551 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7220003520 con 0x7f7238116380 2024-09-10T05:11:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.841+0000 7f723659c640 1 -- 172.21.15.139:0/4123943551 >> v1:172.21.15.139:6789/0 conn(0x7f7238116380 legacy=0x7f7238125440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.841+0000 7f723659c640 1 -- 172.21.15.139:0/4123943551 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7238073880 con 0x7f7238114190 2024-09-10T05:11:22.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.842+0000 7f723659c640 1 --2- 172.21.15.139:0/4123943551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7238114190 0x7f7238114570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7228009720 tx=0x7f722802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e3079762857cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.842+0000 7f723559a640 1 -- 172.21.15.139:0/4123943551 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7228037070 con 0x7f7238114190 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.843+0000 7f723559a640 1 -- 172.21.15.139:0/4123943551 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722802ad90 con 0x7f7238114190 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.843+0000 7f723559a640 1 -- 172.21.15.139:0/4123943551 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7228037070 con 0x7f7238114190 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.843+0000 7f723cbcd640 1 -- 172.21.15.139:0/4123943551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7238114190 msgr2=0x7f7238114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.843+0000 7f723cbcd640 1 --2- 172.21.15.139:0/4123943551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7238114190 0x7f7238114570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7228009720 tx=0x7f722802a110 comp rx=0 tx=0).stop 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.844+0000 7f723cbcd640 1 -- 172.21.15.139:0/4123943551 shutdown_connections 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.844+0000 7f723cbcd640 1 --2- 172.21.15.139:0/4123943551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7238114190 0x7f7238114570 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.844+0000 7f723cbcd640 1 -- 172.21.15.139:0/4123943551 >> 172.21.15.139:0/4123943551 conn(0x7f723806f7e0 msgr2=0x7f7238071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.844+0000 7f723cbcd640 1 -- 172.21.15.139:0/4123943551 shutdown_connections 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.844+0000 7f723cbcd640 1 -- 172.21.15.139:0/4123943551 wait complete. 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.845+0000 7f723cbcd640 1 Processor -- start 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.845+0000 7f723cbcd640 1 -- start start 2024-09-10T05:11:22.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.846+0000 7f723cbcd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7238114190 0x7f7238118960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.846+0000 7f723cbcd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7238114c30 con 0x7f7238114190 2024-09-10T05:11:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.846+0000 7f723659c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7238114190 0x7f7238118960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.846+0000 7f723659c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7238114190 0x7f7238118960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36436/0 (socket says 172.21.15.139:36436) 2024-09-10T05:11:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.846+0000 7f723659c640 1 -- 172.21.15.139:0/2745014940 learned_addr learned my addr 172.21.15.139:0/2745014940 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.846+0000 7f723659c640 1 -- 172.21.15.139:0/2745014940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723811a240 con 0x7f7238114190 2024-09-10T05:11:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.847+0000 7f723659c640 1 --2- 172.21.15.139:0/2745014940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7238114190 0x7f7238118960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7228035040 tx=0x7f72280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.847+0000 7f7226ffd640 1 -- 172.21.15.139:0/2745014940 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7228037070 con 0x7f7238114190 2024-09-10T05:11:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.847+0000 7f723cbcd640 1 -- 172.21.15.139:0/2745014940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723811bae0 con 0x7f7238114190 2024-09-10T05:11:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.847+0000 7f7226ffd640 1 -- 172.21.15.139:0/2745014940 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7228004030 con 0x7f7238114190 2024-09-10T05:11:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.847+0000 7f723cbcd640 1 -- 172.21.15.139:0/2745014940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723811bf20 con 0x7f7238114190 2024-09-10T05:11:22.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.847+0000 7f7226ffd640 1 -- 172.21.15.139:0/2745014940 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7228004350 con 0x7f7238114190 2024-09-10T05:11:22.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.848+0000 7f723cbcd640 1 -- 172.21.15.139:0/2745014940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7238114570 con 0x7f7238114190 2024-09-10T05:11:22.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.848+0000 7f7226ffd640 1 -- 172.21.15.139:0/2745014940 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f722803c620 con 0x7f7238114190 2024-09-10T05:11:22.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.849+0000 7f7226ffd640 1 --2- 172.21.15.139:0/2745014940 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f721803e050 0x7f7218040510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:22.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.849+0000 7f7226ffd640 1 -- 172.21.15.139:0/2745014940 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f7228004350 con 0x7f7238114190 2024-09-10T05:11:22.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.849+0000 7f7235d9b640 1 --2- 172.21.15.139:0/2745014940 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f721803e050 0x7f7218040510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:22.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.849+0000 7f7235d9b640 1 --2- 172.21.15.139:0/2745014940 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f721803e050 0x7f7218040510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f722c001610 tx=0x7f722c0078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:22.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.853+0000 7ffa926fe640 1 Processor -- start 2024-09-10T05:11:22.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.853+0000 7ffa926fe640 1 -- start start 2024-09-10T05:11:22.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.854+0000 7ffa926fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ffa8c06fe70 0x7ffa8c070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:22.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.854+0000 7ffa926fe640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa8c071680 con 0x7ffa8c070790 2024-09-10T05:11:22.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.854+0000 7ffa926fe640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7ffa8c0a30e0 con 0x7ffa8c06fe70 2024-09-10T05:11:22.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.854+0000 7ffa8bfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ffa8c06fe70 0x7ffa8c070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:22.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.854+0000 7ffa83fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ffa8c070790 0x7ffa8c12ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:42162/0 (socket says 172.21.15.139:42162) 2024-09-10T05:11:22.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.854+0000 7ffa83fff640 1 -- 172.21.15.139:0/455866499 learned_addr learned my addr 172.21.15.139:0/455866499 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:22.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.854+0000 7ffa8bfff640 1 -- 172.21.15.139:0/455866499 >> v1:172.21.15.139:6789/0 conn(0x7ffa8c070790 legacy=0x7ffa8c12ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:22.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.854+0000 7ffa8bfff640 1 -- 172.21.15.139:0/455866499 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8c071dd0 con 0x7ffa8c06fe70 2024-09-10T05:11:22.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.855+0000 7ffa8bfff640 1 --2- 172.21.15.139:0/455866499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c06fe70 0x7ffa8c070250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009720 tx=0x7ffa7c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0fdd7304ea48e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:22.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.858+0000 7ffa8b7fe640 1 -- 172.21.15.139:0/455866499 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa7c037070 con 0x7ffa8c06fe70 2024-09-10T05:11:22.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.858+0000 7ffa8b7fe640 1 -- 172.21.15.139:0/455866499 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7c02ad90 con 0x7ffa8c06fe70 2024-09-10T05:11:22.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.858+0000 7ffa8b7fe640 1 -- 172.21.15.139:0/455866499 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa7c032590 con 0x7ffa8c06fe70 2024-09-10T05:11:22.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.858+0000 7f7226ffd640 1 -- 172.21.15.139:0/2745014940 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f7228042020 con 0x7f7238114190 2024-09-10T05:11:22.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.859+0000 7ffa926fe640 1 -- 172.21.15.139:0/455866499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c06fe70 msgr2=0x7ffa8c070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:22.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.859+0000 7ffa926fe640 1 --2- 172.21.15.139:0/455866499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c06fe70 0x7ffa8c070250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009720 tx=0x7ffa7c02a110 comp rx=0 tx=0).stop 2024-09-10T05:11:22.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.859+0000 7ffa926fe640 1 -- 172.21.15.139:0/455866499 shutdown_connections 2024-09-10T05:11:22.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.859+0000 7ffa926fe640 1 --2- 172.21.15.139:0/455866499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c06fe70 0x7ffa8c070250 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:22.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.859+0000 7ffa926fe640 1 -- 172.21.15.139:0/455866499 >> 172.21.15.139:0/455866499 conn(0x7ffa8c0a0a50 msgr2=0x7ffa8c06e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:22.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.859+0000 7ffa926fe640 1 -- 172.21.15.139:0/455866499 shutdown_connections 2024-09-10T05:11:22.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.859+0000 7ffa926fe640 1 -- 172.21.15.139:0/455866499 wait complete. 2024-09-10T05:11:22.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.860+0000 7ffa926fe640 1 Processor -- start 2024-09-10T05:11:22.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.860+0000 7ffa926fe640 1 -- start start 2024-09-10T05:11:22.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.861+0000 7ffa926fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c06fe70 0x7ffa8c11f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:22.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.861+0000 7ffa926fe640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c075cc0 con 0x7ffa8c06fe70 2024-09-10T05:11:22.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.861+0000 7ffa8bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c06fe70 0x7ffa8c11f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:22.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.861+0000 7ffa8bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c06fe70 0x7ffa8c11f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36452/0 (socket says 172.21.15.139:36452) 2024-09-10T05:11:22.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.861+0000 7ffa8bfff640 1 -- 172.21.15.139:0/2837222890 learned_addr learned my addr 172.21.15.139:0/2837222890 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:22.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.861+0000 7ffa8bfff640 1 -- 172.21.15.139:0/2837222890 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8c121300 con 0x7ffa8c06fe70 2024-09-10T05:11:22.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.862+0000 7ffa8bfff640 1 --2- 172.21.15.139:0/2837222890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c06fe70 0x7ffa8c11f210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009840 tx=0x7ffa7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:22.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.862+0000 7ffa897fa640 1 -- 172.21.15.139:0/2837222890 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa7c042020 con 0x7ffa8c06fe70 2024-09-10T05:11:22.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.862+0000 7ffa897fa640 1 -- 172.21.15.139:0/2837222890 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7c030640 con 0x7ffa8c06fe70 2024-09-10T05:11:22.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.862+0000 7ffa897fa640 1 -- 172.21.15.139:0/2837222890 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa7c037040 con 0x7ffa8c06fe70 2024-09-10T05:11:22.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.862+0000 7ffa926fe640 1 -- 172.21.15.139:0/2837222890 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8c122560 con 0x7ffa8c06fe70 2024-09-10T05:11:22.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.862+0000 7ffa926fe640 1 -- 172.21.15.139:0/2837222890 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa8c122890 con 0x7ffa8c06fe70 2024-09-10T05:11:22.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.863+0000 7ffa897fa640 1 -- 172.21.15.139:0/2837222890 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ffa7c045020 con 0x7ffa8c06fe70 2024-09-10T05:11:22.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.863+0000 7ffa897fa640 1 --2- 172.21.15.139:0/2837222890 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ffa6c03dec0 0x7ffa6c040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:22.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.863+0000 7ffa897fa640 1 -- 172.21.15.139:0/2837222890 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7ffa7c073280 con 0x7ffa8c06fe70 2024-09-10T05:11:22.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.863+0000 7ffa926fe640 1 -- 172.21.15.139:0/2837222890 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa8c070250 con 0x7ffa8c06fe70 2024-09-10T05:11:22.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.864+0000 7ffa83fff640 1 --2- 172.21.15.139:0/2837222890 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ffa6c03dec0 0x7ffa6c040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:22.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.864+0000 7ffa83fff640 1 --2- 172.21.15.139:0/2837222890 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ffa6c03dec0 0x7ffa6c040380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffa74007fd0 tx=0x7ffa74007aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:22.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.872+0000 7ffa897fa640 1 -- 172.21.15.139:0/2837222890 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7ffa7c04c030 con 0x7ffa8c06fe70 2024-09-10T05:11:22.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.962+0000 7f82f9e85640 1 -- 172.21.15.139:0/1143430486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f82f4117d90 con 0x7f82f4125890 2024-09-10T05:11:22.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.962+0000 7f82dbfff640 1 -- 172.21.15.139:0/1143430486 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82e4010ce0 con 0x7f82f4125890 2024-09-10T05:11:22.964 INFO:teuthology.orchestra.run.smithi139.stdout:47244640262 2024-09-10T05:11:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.965+0000 7f82f9e85640 1 -- 172.21.15.139:0/1143430486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f82e003de40 msgr2=0x7f82e0040300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.965+0000 7f82f9e85640 1 --2- 172.21.15.139:0/1143430486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f82e003de40 0x7f82e0040300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82e8034000 tx=0x7f82e802e000 comp rx=0 tx=0).stop 2024-09-10T05:11:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.965+0000 7f82f9e85640 1 -- 172.21.15.139:0/1143430486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82f4125890 msgr2=0x7f82f412f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.965+0000 7f82f9e85640 1 --2- 172.21.15.139:0/1143430486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82f4125890 0x7f82f412f790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f82e400c480 tx=0x7f82e400c940 comp rx=0 tx=0).stop 2024-09-10T05:11:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.965+0000 7f82f9e85640 1 -- 172.21.15.139:0/1143430486 shutdown_connections 2024-09-10T05:11:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.965+0000 7f82f9e85640 1 --2- 172.21.15.139:0/1143430486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f82e003de40 0x7f82e0040300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.965+0000 7f82f9e85640 1 --2- 172.21.15.139:0/1143430486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82f4125890 0x7f82f412f790 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f82e400c480 tx=0x7f82e400c940 comp rx=0 tx=0).stop 2024-09-10T05:11:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.965+0000 7f82f9e85640 1 -- 172.21.15.139:0/1143430486 >> 172.21.15.139:0/1143430486 conn(0x7f82f4071580 msgr2=0x7f82f4071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.965+0000 7f82f9e85640 1 -- 172.21.15.139:0/1143430486 shutdown_connections 2024-09-10T05:11:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:22.965+0000 7f82f9e85640 1 -- 172.21.15.139:0/1143430486 wait complete. 2024-09-10T05:11:22.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640262 for osd.1 2024-09-10T05:11:22.977 DEBUG:teuthology.parallel:result is None 2024-09-10T05:11:23.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.022+0000 7fa64f4b8640 1 -- 172.21.15.139:0/1217076517 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa64811b4e0 con 0x7fa64806fe70 2024-09-10T05:11:23.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.023+0000 7fa63dffb640 1 -- 172.21.15.139:0/1217076517 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa64811ce90 con 0x7fa64806fe70 2024-09-10T05:11:23.025 INFO:teuthology.orchestra.run.smithi139.stdout:47244640261 2024-09-10T05:11:23.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.025+0000 7fa64f4b8640 1 -- 172.21.15.139:0/1217076517 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa62c03de70 msgr2=0x7fa62c040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.025+0000 7fa64f4b8640 1 --2- 172.21.15.139:0/1217076517 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa62c03de70 0x7fa62c040330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa638034000 tx=0x7fa63802e000 comp rx=0 tx=0).stop 2024-09-10T05:11:23.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.025+0000 7fa64f4b8640 1 -- 172.21.15.139:0/1217076517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64806fe70 msgr2=0x7fa648119db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.025+0000 7fa64f4b8640 1 --2- 172.21.15.139:0/1217076517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64806fe70 0x7fa648119db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c450 tx=0x7fa64400c910 comp rx=0 tx=0).stop 2024-09-10T05:11:23.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.025+0000 7fa64f4b8640 1 -- 172.21.15.139:0/1217076517 shutdown_connections 2024-09-10T05:11:23.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.025+0000 7fa64f4b8640 1 --2- 172.21.15.139:0/1217076517 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa62c03de70 0x7fa62c040330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.025+0000 7fa64f4b8640 1 --2- 172.21.15.139:0/1217076517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64806fe70 0x7fa648119db0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.025+0000 7fa64f4b8640 1 -- 172.21.15.139:0/1217076517 >> 172.21.15.139:0/1217076517 conn(0x7fa6480a0a50 msgr2=0x7fa6480a0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:23.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.025+0000 7fa64f4b8640 1 -- 172.21.15.139:0/1217076517 shutdown_connections 2024-09-10T05:11:23.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.025+0000 7fa64f4b8640 1 -- 172.21.15.139:0/1217076517 wait complete. 2024-09-10T05:11:23.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640261 for osd.3 2024-09-10T05:11:23.038 DEBUG:teuthology.parallel:result is None 2024-09-10T05:11:23.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.065+0000 7f723cbcd640 1 -- 172.21.15.139:0/2745014940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f723811bcb0 con 0x7f7238114190 2024-09-10T05:11:23.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.066+0000 7f7226ffd640 1 -- 172.21.15.139:0/2745014940 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7228031b20 con 0x7f7238114190 2024-09-10T05:11:23.068 INFO:teuthology.orchestra.run.smithi139.stdout:47244640262 2024-09-10T05:11:23.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.068+0000 7f723cbcd640 1 -- 172.21.15.139:0/2745014940 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f721803e050 msgr2=0x7f7218040510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.068+0000 7f723cbcd640 1 --2- 172.21.15.139:0/2745014940 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f721803e050 0x7f7218040510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f722c001610 tx=0x7f722c0078f0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.068+0000 7f723cbcd640 1 -- 172.21.15.139:0/2745014940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7238114190 msgr2=0x7f7238118960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.068+0000 7f723cbcd640 1 --2- 172.21.15.139:0/2745014940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7238114190 0x7f7238118960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7228035040 tx=0x7f72280046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.068+0000 7f723cbcd640 1 -- 172.21.15.139:0/2745014940 shutdown_connections 2024-09-10T05:11:23.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.068+0000 7f723cbcd640 1 --2- 172.21.15.139:0/2745014940 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f721803e050 0x7f7218040510 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.068+0000 7f723cbcd640 1 --2- 172.21.15.139:0/2745014940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7238114190 0x7f7238118960 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.068+0000 7f723cbcd640 1 -- 172.21.15.139:0/2745014940 >> 172.21.15.139:0/2745014940 conn(0x7f723806f7e0 msgr2=0x7f72381288c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:23.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.068+0000 7f723cbcd640 1 -- 172.21.15.139:0/2745014940 shutdown_connections 2024-09-10T05:11:23.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.068+0000 7f723cbcd640 1 -- 172.21.15.139:0/2745014940 wait complete. 2024-09-10T05:11:23.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.075+0000 7ffa926fe640 1 -- 172.21.15.139:0/2837222890 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ffa8c120bb0 con 0x7ffa8c06fe70 2024-09-10T05:11:23.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.075+0000 7ffa897fa640 1 -- 172.21.15.139:0/2837222890 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffa7c0463b0 con 0x7ffa8c06fe70 2024-09-10T05:11:23.078 INFO:teuthology.orchestra.run.smithi139.stdout:38654705670 2024-09-10T05:11:23.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.078+0000 7ffa926fe640 1 -- 172.21.15.139:0/2837222890 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ffa6c03dec0 msgr2=0x7ffa6c040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.078+0000 7ffa926fe640 1 --2- 172.21.15.139:0/2837222890 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ffa6c03dec0 0x7ffa6c040380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffa74007fd0 tx=0x7ffa74007aa0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.078+0000 7ffa926fe640 1 -- 172.21.15.139:0/2837222890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c06fe70 msgr2=0x7ffa8c11f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.078+0000 7ffa926fe640 1 --2- 172.21.15.139:0/2837222890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c06fe70 0x7ffa8c11f210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009840 tx=0x7ffa7c0046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.078+0000 7ffa926fe640 1 -- 172.21.15.139:0/2837222890 shutdown_connections 2024-09-10T05:11:23.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.078+0000 7ffa926fe640 1 --2- 172.21.15.139:0/2837222890 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ffa6c03dec0 0x7ffa6c040380 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.078+0000 7ffa926fe640 1 --2- 172.21.15.139:0/2837222890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa8c06fe70 0x7ffa8c11f210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.078+0000 7ffa926fe640 1 -- 172.21.15.139:0/2837222890 >> 172.21.15.139:0/2837222890 conn(0x7ffa8c0a0a50 msgr2=0x7ffa8c12c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:23.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.078+0000 7ffa926fe640 1 -- 172.21.15.139:0/2837222890 shutdown_connections 2024-09-10T05:11:23.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.078+0000 7ffa926fe640 1 -- 172.21.15.139:0/2837222890 wait complete. 2024-09-10T05:11:23.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640262 for osd.2 2024-09-10T05:11:23.083 DEBUG:teuthology.parallel:result is None 2024-09-10T05:11:23.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-09-10T05:11:23.091 DEBUG:teuthology.parallel:result is None 2024-09-10T05:11:23.091 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T05:11:23.091 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:11:23.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.226+0000 7f57e4840640 1 Processor -- start 2024-09-10T05:11:23.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.226+0000 7f57e4840640 1 -- start start 2024-09-10T05:11:23.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.226+0000 7f57e4840640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f57e0112110 0x7f57e0130b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:23.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.226+0000 7f57e4840640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57e0112810 con 0x7f57e0111620 2024-09-10T05:11:23.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.226+0000 7f57e4840640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f57e0073a70 con 0x7f57e0112110 2024-09-10T05:11:23.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.226+0000 7f57ddd9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f57e0112110 0x7f57e0130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:23.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.226+0000 7f57de59c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f57e0111620 0x7f57e0111a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:42178/0 (socket says 172.21.15.139:42178) 2024-09-10T05:11:23.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.226+0000 7f57de59c640 1 -- 172.21.15.139:0/3810724595 learned_addr learned my addr 172.21.15.139:0/3810724595 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:23.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.227+0000 7f57ddd9b640 1 -- 172.21.15.139:0/3810724595 >> v1:172.21.15.139:6789/0 conn(0x7f57e0111620 legacy=0x7f57e0111a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.227+0000 7f57ddd9b640 1 -- 172.21.15.139:0/3810724595 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e0113340 con 0x7f57e0112110 2024-09-10T05:11:23.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.227+0000 7f57ddd9b640 1 --2- 172.21.15.139:0/3810724595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e0112110 0x7f57e0130b80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f57c800a8c0 tx=0x7f57c802b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537ef06d97bae465 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:23.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.227+0000 7f57dd59a640 1 -- 172.21.15.139:0/3810724595 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57c800b040 con 0x7f57e0112110 2024-09-10T05:11:23.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.228+0000 7f57dd59a640 1 -- 172.21.15.139:0/3810724595 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c8030640 con 0x7f57e0112110 2024-09-10T05:11:23.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.228+0000 7f57dd59a640 1 -- 172.21.15.139:0/3810724595 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57c8030940 con 0x7f57e0112110 2024-09-10T05:11:23.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.228+0000 7f57e4840640 1 -- 172.21.15.139:0/3810724595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e0112110 msgr2=0x7f57e0130b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.228+0000 7f57e4840640 1 --2- 172.21.15.139:0/3810724595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e0112110 0x7f57e0130b80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f57c800a8c0 tx=0x7f57c802b4d0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.228+0000 7f57e4840640 1 -- 172.21.15.139:0/3810724595 shutdown_connections 2024-09-10T05:11:23.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.228+0000 7f57e4840640 1 --2- 172.21.15.139:0/3810724595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e0112110 0x7f57e0130b80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.228+0000 7f57e4840640 1 -- 172.21.15.139:0/3810724595 >> 172.21.15.139:0/3810724595 conn(0x7f57e0070850 msgr2=0x7f57e0072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:23.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.228+0000 7f57e4840640 1 -- 172.21.15.139:0/3810724595 shutdown_connections 2024-09-10T05:11:23.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.228+0000 7f57e4840640 1 -- 172.21.15.139:0/3810724595 wait complete. 2024-09-10T05:11:23.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.229+0000 7f57e4840640 1 Processor -- start 2024-09-10T05:11:23.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.229+0000 7f57e4840640 1 -- start start 2024-09-10T05:11:23.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.230+0000 7f57e4840640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e0111620 0x7f57e01bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:23.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.230+0000 7f57e4840640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f57e0111120 con 0x7f57e0111620 2024-09-10T05:11:23.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.230+0000 7f57de59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e0111620 0x7f57e01bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:23.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.230+0000 7f57de59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e0111620 0x7f57e01bfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36462/0 (socket says 172.21.15.139:36462) 2024-09-10T05:11:23.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.230+0000 7f57de59c640 1 -- 172.21.15.139:0/2961575847 learned_addr learned my addr 172.21.15.139:0/2961575847 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:23.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.230+0000 7f57de59c640 1 -- 172.21.15.139:0/2961575847 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e0115d80 con 0x7f57e0111620 2024-09-10T05:11:23.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.230+0000 7f57de59c640 1 --2- 172.21.15.139:0/2961575847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e0111620 0x7f57e01bfbc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f57d800e8c0 tx=0x7f57d800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:23.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.230+0000 7f57d6ffd640 1 -- 172.21.15.139:0/2961575847 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57d8015070 con 0x7f57e0111620 2024-09-10T05:11:23.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.230+0000 7f57d6ffd640 1 -- 172.21.15.139:0/2961575847 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d8005ae0 con 0x7f57e0111620 2024-09-10T05:11:23.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.230+0000 7f57e4840640 1 -- 172.21.15.139:0/2961575847 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e01c0100 con 0x7f57e0111620 2024-09-10T05:11:23.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.230+0000 7f57d6ffd640 1 -- 172.21.15.139:0/2961575847 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57d8005dc0 con 0x7f57e0111620 2024-09-10T05:11:23.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.230+0000 7f57e4840640 1 -- 172.21.15.139:0/2961575847 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e01c05d0 con 0x7f57e0111620 2024-09-10T05:11:23.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.231+0000 7f57d6ffd640 1 -- 172.21.15.139:0/2961575847 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f57d8018070 con 0x7f57e0111620 2024-09-10T05:11:23.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.231+0000 7f57e4840640 1 -- 172.21.15.139:0/2961575847 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e0115370 con 0x7f57e0111620 2024-09-10T05:11:23.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.231+0000 7f57d6ffd640 1 --2- 172.21.15.139:0/2961575847 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f57c003de90 0x7f57c0040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:23.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.231+0000 7f57d6ffd640 1 -- 172.21.15.139:0/2961575847 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f57d8054480 con 0x7f57e0111620 2024-09-10T05:11:23.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.232+0000 7f57ddd9b640 1 --2- 172.21.15.139:0/2961575847 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f57c003de90 0x7f57c0040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:23.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.232+0000 7f57ddd9b640 1 --2- 172.21.15.139:0/2961575847 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f57c003de90 0x7f57c0040350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57c8035000 tx=0x7f57c8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:23.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.236+0000 7f57d6ffd640 1 -- 172.21.15.139:0/2961575847 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f57d800f360 con 0x7f57e0111620 2024-09-10T05:11:23.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.407+0000 7f57e4840640 1 -- 172.21.15.139:0/2961575847 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57e0125cf0 con 0x7f57c003de90 2024-09-10T05:11:23.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.408+0000 7f57d6ffd640 1 -- 172.21.15.139:0/2961575847 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32170 (secure 0 0 0) 0x7f57c8030690 con 0x7f57c003de90 2024-09-10T05:11:23.411 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:11:23.411 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-10T05:11:23.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.410+0000 7f57e4840640 1 -- 172.21.15.139:0/2961575847 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f57c003de90 msgr2=0x7f57c0040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.410+0000 7f57e4840640 1 --2- 172.21.15.139:0/2961575847 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f57c003de90 0x7f57c0040350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57c8035000 tx=0x7f57c8030000 comp rx=0 tx=0).stop 2024-09-10T05:11:23.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.410+0000 7f57e4840640 1 -- 172.21.15.139:0/2961575847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e0111620 msgr2=0x7f57e01bfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.410+0000 7f57e4840640 1 --2- 172.21.15.139:0/2961575847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e0111620 0x7f57e01bfbc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f57d800e8c0 tx=0x7f57d800ed80 comp rx=0 tx=0).stop 2024-09-10T05:11:23.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.411+0000 7f57e4840640 1 -- 172.21.15.139:0/2961575847 shutdown_connections 2024-09-10T05:11:23.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.411+0000 7f57e4840640 1 --2- 172.21.15.139:0/2961575847 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f57c003de90 0x7f57c0040350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.411+0000 7f57e4840640 1 --2- 172.21.15.139:0/2961575847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57e0111620 0x7f57e01bfbc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.411+0000 7f57e4840640 1 -- 172.21.15.139:0/2961575847 >> 172.21.15.139:0/2961575847 conn(0x7f57e0070850 msgr2=0x7f57e012b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:23.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.411+0000 7f57e4840640 1 -- 172.21.15.139:0/2961575847 shutdown_connections 2024-09-10T05:11:23.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.411+0000 7f57e4840640 1 -- 172.21.15.139:0/2961575847 wait complete. 2024-09-10T05:11:23.423 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T05:11:21.878520+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109928,"kb_used_data":1808,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377432,"statfs":{"total":386547056640,"available":386434490368,"internally_reserved":0,"allocated":1851392,"data_stored":1391362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.355518"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.533252+0000","last_change":"2024-09-10T05:11:18.533507+0000","last_active":"2024-09-10T05:11:18.533252+0000","last_peered":"2024-09-10T05:11:18.533252+0000","last_clean":"2024-09-10T05:11:18.533252+0000","last_became_active":"2024-09-10T05:11:16.531468+0000","last_became_peered":"2024-09-10T05:11:16.531468+0000","last_unstale":"2024-09-10T05:11:18.533252+0000","last_undegraded":"2024-09-10T05:11:18.533252+0000","last_fullsized":"2024-09-10T05:11:18.533252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:30:18.685084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001329722,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.534977+0000","last_change":"2024-09-10T05:11:18.534977+0000","last_active":"2024-09-10T05:11:18.534977+0000","last_peered":"2024-09-10T05:11:18.534977+0000","last_clean":"2024-09-10T05:11:18.534977+0000","last_became_active":"2024-09-10T05:11:16.531550+0000","last_became_peered":"2024-09-10T05:11:16.531550+0000","last_unstale":"2024-09-10T05:11:18.534977+0000","last_undegraded":"2024-09-10T05:11:18.534977+0000","last_fullsized":"2024-09-10T05:11:18.534977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:22.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063503699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.532394+0000","last_change":"2024-09-10T05:11:18.532627+0000","last_active":"2024-09-10T05:11:18.532394+0000","last_peered":"2024-09-10T05:11:18.532394+0000","last_clean":"2024-09-10T05:11:18.532394+0000","last_became_active":"2024-09-10T05:11:16.530746+0000","last_became_peered":"2024-09-10T05:11:16.530746+0000","last_unstale":"2024-09-10T05:11:18.532394+0000","last_undegraded":"2024-09-10T05:11:18.532394+0000","last_fullsized":"2024-09-10T05:11:18.532394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:33.333497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048256999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.534946+0000","last_change":"2024-09-10T05:11:18.534946+0000","last_active":"2024-09-10T05:11:18.534946+0000","last_peered":"2024-09-10T05:11:18.534946+0000","last_clean":"2024-09-10T05:11:18.534946+0000","last_became_active":"2024-09-10T05:11:16.532795+0000","last_became_peered":"2024-09-10T05:11:16.532795+0000","last_unstale":"2024-09-10T05:11:18.534946+0000","last_undegraded":"2024-09-10T05:11:18.534946+0000","last_fullsized":"2024-09-10T05:11:18.534946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:22.750871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060128199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.533201+0000","last_change":"2024-09-10T05:11:18.533201+0000","last_active":"2024-09-10T05:11:18.533201+0000","last_peered":"2024-09-10T05:11:18.533201+0000","last_clean":"2024-09-10T05:11:18.533201+0000","last_became_active":"2024-09-10T05:11:16.530756+0000","last_became_peered":"2024-09-10T05:11:16.530756+0000","last_unstale":"2024-09-10T05:11:18.533201+0000","last_undegraded":"2024-09-10T05:11:18.533201+0000","last_fullsized":"2024-09-10T05:11:18.533201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:46.741517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047784,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.530256+0000","last_change":"2024-09-10T05:11:18.530458+0000","last_active":"2024-09-10T05:11:18.530256+0000","last_peered":"2024-09-10T05:11:18.530256+0000","last_clean":"2024-09-10T05:11:18.530256+0000","last_became_active":"2024-09-10T05:11:16.530448+0000","last_became_peered":"2024-09-10T05:11:16.530448+0000","last_unstale":"2024-09-10T05:11:18.530256+0000","last_undegraded":"2024-09-10T05:11:18.530256+0000","last_fullsized":"2024-09-10T05:11:18.530256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:12.102135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036982300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.532338+0000","last_change":"2024-09-10T05:11:18.532549+0000","last_active":"2024-09-10T05:11:18.532338+0000","last_peered":"2024-09-10T05:11:18.532338+0000","last_clean":"2024-09-10T05:11:18.532338+0000","last_became_active":"2024-09-10T05:11:16.531911+0000","last_became_peered":"2024-09-10T05:11:16.531911+0000","last_unstale":"2024-09-10T05:11:18.532338+0000","last_undegraded":"2024-09-10T05:11:18.532338+0000","last_fullsized":"2024-09-10T05:11:18.532338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:51:16.716892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039105900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.533054+0000","last_change":"2024-09-10T05:11:18.533277+0000","last_active":"2024-09-10T05:11:18.533054+0000","last_peered":"2024-09-10T05:11:18.533054+0000","last_clean":"2024-09-10T05:11:18.533054+0000","last_became_active":"2024-09-10T05:11:16.531926+0000","last_became_peered":"2024-09-10T05:11:16.531926+0000","last_unstale":"2024-09-10T05:11:18.533054+0000","last_undegraded":"2024-09-10T05:11:18.533054+0000","last_fullsized":"2024-09-10T05:11:18.533054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:44.106335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121101,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:19.185879+0000","last_change":"2024-09-10T05:11:14.294244+0000","last_active":"2024-09-10T05:11:19.185879+0000","last_peered":"2024-09-10T05:11:19.185879+0000","last_clean":"2024-09-10T05:11:19.185879+0000","last_became_active":"2024-09-10T05:11:14.293121+0000","last_became_peered":"2024-09-10T05:11:14.293121+0000","last_unstale":"2024-09-10T05:11:19.185879+0000","last_undegraded":"2024-09-10T05:11:19.185879+0000","last_fullsized":"2024-09-10T05:11:19.185879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:12.494055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:12.494055+0000","last_clean_scrub_stamp":"2024-09-10T05:11:12.494055+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:00.347397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:11:23.425 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:11:23.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.520+0000 7fe6bebc6640 1 Processor -- start 2024-09-10T05:11:23.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.520+0000 7fe6bebc6640 1 -- start start 2024-09-10T05:11:23.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.520+0000 7fe6bebc6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe6b8111620 0x7fe6b8111a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:23.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.520+0000 7fe6bebc6640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b8112810 con 0x7fe6b8111f40 2024-09-10T05:11:23.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.520+0000 7fe6bebc6640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fe6b8073a70 con 0x7fe6b8111620 2024-09-10T05:11:23.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.521+0000 7fe6bc962640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe6b8111620 0x7fe6b8111a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:23.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.521+0000 7fe6affff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fe6b8111f40 0x7fe6b8121930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:42186/0 (socket says 172.21.15.139:42186) 2024-09-10T05:11:23.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.521+0000 7fe6affff640 1 -- 172.21.15.139:0/481077475 learned_addr learned my addr 172.21.15.139:0/481077475 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:23.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.521+0000 7fe6bc962640 1 -- 172.21.15.139:0/481077475 >> v1:172.21.15.139:6789/0 conn(0x7fe6b8111f40 legacy=0x7fe6b8121930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.521+0000 7fe6bc962640 1 -- 172.21.15.139:0/481077475 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b8113340 con 0x7fe6b8111620 2024-09-10T05:11:23.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.521+0000 7fe6af7fe640 1 -- 172.21.15.139:0/481077475 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603965982 0 0) 0x7fe6b8112810 con 0x7fe6b8111f40 2024-09-10T05:11:23.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.521+0000 7fe6bc962640 1 --2- 172.21.15.139:0/481077475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b8111620 0x7fe6b8111a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009720 tx=0x7fe6b402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abca9a3a55a0d9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.522+0000 7fe6af7fe640 1 -- 172.21.15.139:0/481077475 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4037070 con 0x7fe6b8111620 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.522+0000 7fe6af7fe640 1 -- 172.21.15.139:0/481077475 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b402ad90 con 0x7fe6b8111620 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.522+0000 7fe6af7fe640 1 -- 172.21.15.139:0/481077475 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4032590 con 0x7fe6b8111620 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.522+0000 7fe6bebc6640 1 -- 172.21.15.139:0/481077475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b8111620 msgr2=0x7fe6b8111a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.522+0000 7fe6bebc6640 1 --2- 172.21.15.139:0/481077475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b8111620 0x7fe6b8111a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009720 tx=0x7fe6b402a110 comp rx=0 tx=0).stop 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.522+0000 7fe6bebc6640 1 -- 172.21.15.139:0/481077475 shutdown_connections 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.522+0000 7fe6bebc6640 1 --2- 172.21.15.139:0/481077475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b8111620 0x7fe6b8111a00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.522+0000 7fe6bebc6640 1 -- 172.21.15.139:0/481077475 >> 172.21.15.139:0/481077475 conn(0x7fe6b8070850 msgr2=0x7fe6b8072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.522+0000 7fe6bebc6640 1 -- 172.21.15.139:0/481077475 shutdown_connections 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.522+0000 7fe6bebc6640 1 -- 172.21.15.139:0/481077475 wait complete. 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.523+0000 7fe6bebc6640 1 Processor -- start 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.523+0000 7fe6bebc6640 1 -- start start 2024-09-10T05:11:23.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.524+0000 7fe6bebc6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b8111620 0x7fe6b812f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:23.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.524+0000 7fe6bebc6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b8051660 con 0x7fe6b8111620 2024-09-10T05:11:23.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.524+0000 7fe6bc962640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b8111620 0x7fe6b812f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:23.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.524+0000 7fe6bc962640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b8111620 0x7fe6b812f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36480/0 (socket says 172.21.15.139:36480) 2024-09-10T05:11:23.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.524+0000 7fe6bc962640 1 -- 172.21.15.139:0/2547966801 learned_addr learned my addr 172.21.15.139:0/2547966801 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:23.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.524+0000 7fe6bc962640 1 -- 172.21.15.139:0/2547966801 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b81318f0 con 0x7fe6b8111620 2024-09-10T05:11:23.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.524+0000 7fe6bc962640 1 --2- 172.21.15.139:0/2547966801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b8111620 0x7fe6b812f1f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009720 tx=0x7fe6b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:23.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.524+0000 7fe6ad7fa640 1 -- 172.21.15.139:0/2547966801 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4041070 con 0x7fe6b8111620 2024-09-10T05:11:23.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.524+0000 7fe6ad7fa640 1 -- 172.21.15.139:0/2547966801 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b403c460 con 0x7fe6b8111620 2024-09-10T05:11:23.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.524+0000 7fe6bebc6640 1 -- 172.21.15.139:0/2547966801 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b8131b80 con 0x7fe6b8111620 2024-09-10T05:11:23.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.524+0000 7fe6ad7fa640 1 -- 172.21.15.139:0/2547966801 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4037040 con 0x7fe6b8111620 2024-09-10T05:11:23.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.524+0000 7fe6bebc6640 1 -- 172.21.15.139:0/2547966801 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b812f910 con 0x7fe6b8111620 2024-09-10T05:11:23.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.525+0000 7fe6bebc6640 1 -- 172.21.15.139:0/2547966801 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b81307e0 con 0x7fe6b8111620 2024-09-10T05:11:23.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.525+0000 7fe6ad7fa640 1 -- 172.21.15.139:0/2547966801 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe6b4044070 con 0x7fe6b8111620 2024-09-10T05:11:23.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.526+0000 7fe6ad7fa640 1 --2- 172.21.15.139:0/2547966801 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe6a403de90 0x7fe6a4040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:23.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.526+0000 7fe6ad7fa640 1 -- 172.21.15.139:0/2547966801 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fe6b4072a70 con 0x7fe6b8111620 2024-09-10T05:11:23.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.526+0000 7fe6affff640 1 --2- 172.21.15.139:0/2547966801 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe6a403de90 0x7fe6a4040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:23.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.526+0000 7fe6affff640 1 --2- 172.21.15.139:0/2547966801 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe6a403de90 0x7fe6a4040350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8000c00 tx=0x7fe6a80078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:23.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.530+0000 7fe6ad7fa640 1 -- 172.21.15.139:0/2547966801 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fe6b81307e0 con 0x7fe6b8111620 2024-09-10T05:11:23.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.702+0000 7fe6bebc6640 1 -- 172.21.15.139:0/2547966801 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6b8111a00 con 0x7fe6a403de90 2024-09-10T05:11:23.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.704+0000 7fe6ad7fa640 1 -- 172.21.15.139:0/2547966801 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32170 (secure 0 0 0) 0x7fe6b8111a00 con 0x7fe6a403de90 2024-09-10T05:11:23.706 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:11:23.706 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-10T05:11:23.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.706+0000 7fe6bebc6640 1 -- 172.21.15.139:0/2547966801 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe6a403de90 msgr2=0x7fe6a4040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.706+0000 7fe6bebc6640 1 --2- 172.21.15.139:0/2547966801 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe6a403de90 0x7fe6a4040350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8000c00 tx=0x7fe6a80078f0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.706+0000 7fe6bebc6640 1 -- 172.21.15.139:0/2547966801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b8111620 msgr2=0x7fe6b812f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.706+0000 7fe6bebc6640 1 --2- 172.21.15.139:0/2547966801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b8111620 0x7fe6b812f1f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009720 tx=0x7fe6b40046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.706+0000 7fe6bebc6640 1 -- 172.21.15.139:0/2547966801 shutdown_connections 2024-09-10T05:11:23.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.706+0000 7fe6bebc6640 1 --2- 172.21.15.139:0/2547966801 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe6a403de90 0x7fe6a4040350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.706+0000 7fe6bebc6640 1 --2- 172.21.15.139:0/2547966801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b8111620 0x7fe6b812f1f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.706+0000 7fe6bebc6640 1 -- 172.21.15.139:0/2547966801 >> 172.21.15.139:0/2547966801 conn(0x7fe6b8070850 msgr2=0x7fe6b8124920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:23.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.706+0000 7fe6bebc6640 1 -- 172.21.15.139:0/2547966801 shutdown_connections 2024-09-10T05:11:23.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.706+0000 7fe6bebc6640 1 -- 172.21.15.139:0/2547966801 wait complete. 2024-09-10T05:11:23.719 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T05:11:21.878520+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109928,"kb_used_data":1808,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377432,"statfs":{"total":386547056640,"available":386434490368,"internally_reserved":0,"allocated":1851392,"data_stored":1391362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.355518"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.533252+0000","last_change":"2024-09-10T05:11:18.533507+0000","last_active":"2024-09-10T05:11:18.533252+0000","last_peered":"2024-09-10T05:11:18.533252+0000","last_clean":"2024-09-10T05:11:18.533252+0000","last_became_active":"2024-09-10T05:11:16.531468+0000","last_became_peered":"2024-09-10T05:11:16.531468+0000","last_unstale":"2024-09-10T05:11:18.533252+0000","last_undegraded":"2024-09-10T05:11:18.533252+0000","last_fullsized":"2024-09-10T05:11:18.533252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:30:18.685084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001329722,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.534977+0000","last_change":"2024-09-10T05:11:18.534977+0000","last_active":"2024-09-10T05:11:18.534977+0000","last_peered":"2024-09-10T05:11:18.534977+0000","last_clean":"2024-09-10T05:11:18.534977+0000","last_became_active":"2024-09-10T05:11:16.531550+0000","last_became_peered":"2024-09-10T05:11:16.531550+0000","last_unstale":"2024-09-10T05:11:18.534977+0000","last_undegraded":"2024-09-10T05:11:18.534977+0000","last_fullsized":"2024-09-10T05:11:18.534977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:22.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063503699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.532394+0000","last_change":"2024-09-10T05:11:18.532627+0000","last_active":"2024-09-10T05:11:18.532394+0000","last_peered":"2024-09-10T05:11:18.532394+0000","last_clean":"2024-09-10T05:11:18.532394+0000","last_became_active":"2024-09-10T05:11:16.530746+0000","last_became_peered":"2024-09-10T05:11:16.530746+0000","last_unstale":"2024-09-10T05:11:18.532394+0000","last_undegraded":"2024-09-10T05:11:18.532394+0000","last_fullsized":"2024-09-10T05:11:18.532394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:33.333497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048256999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.534946+0000","last_change":"2024-09-10T05:11:18.534946+0000","last_active":"2024-09-10T05:11:18.534946+0000","last_peered":"2024-09-10T05:11:18.534946+0000","last_clean":"2024-09-10T05:11:18.534946+0000","last_became_active":"2024-09-10T05:11:16.532795+0000","last_became_peered":"2024-09-10T05:11:16.532795+0000","last_unstale":"2024-09-10T05:11:18.534946+0000","last_undegraded":"2024-09-10T05:11:18.534946+0000","last_fullsized":"2024-09-10T05:11:18.534946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:22.750871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060128199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.533201+0000","last_change":"2024-09-10T05:11:18.533201+0000","last_active":"2024-09-10T05:11:18.533201+0000","last_peered":"2024-09-10T05:11:18.533201+0000","last_clean":"2024-09-10T05:11:18.533201+0000","last_became_active":"2024-09-10T05:11:16.530756+0000","last_became_peered":"2024-09-10T05:11:16.530756+0000","last_unstale":"2024-09-10T05:11:18.533201+0000","last_undegraded":"2024-09-10T05:11:18.533201+0000","last_fullsized":"2024-09-10T05:11:18.533201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:46.741517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047784,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.530256+0000","last_change":"2024-09-10T05:11:18.530458+0000","last_active":"2024-09-10T05:11:18.530256+0000","last_peered":"2024-09-10T05:11:18.530256+0000","last_clean":"2024-09-10T05:11:18.530256+0000","last_became_active":"2024-09-10T05:11:16.530448+0000","last_became_peered":"2024-09-10T05:11:16.530448+0000","last_unstale":"2024-09-10T05:11:18.530256+0000","last_undegraded":"2024-09-10T05:11:18.530256+0000","last_fullsized":"2024-09-10T05:11:18.530256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:12.102135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036982300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.532338+0000","last_change":"2024-09-10T05:11:18.532549+0000","last_active":"2024-09-10T05:11:18.532338+0000","last_peered":"2024-09-10T05:11:18.532338+0000","last_clean":"2024-09-10T05:11:18.532338+0000","last_became_active":"2024-09-10T05:11:16.531911+0000","last_became_peered":"2024-09-10T05:11:16.531911+0000","last_unstale":"2024-09-10T05:11:18.532338+0000","last_undegraded":"2024-09-10T05:11:18.532338+0000","last_fullsized":"2024-09-10T05:11:18.532338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:51:16.716892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039105900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:18.533054+0000","last_change":"2024-09-10T05:11:18.533277+0000","last_active":"2024-09-10T05:11:18.533054+0000","last_peered":"2024-09-10T05:11:18.533054+0000","last_clean":"2024-09-10T05:11:18.533054+0000","last_became_active":"2024-09-10T05:11:16.531926+0000","last_became_peered":"2024-09-10T05:11:16.531926+0000","last_unstale":"2024-09-10T05:11:18.533054+0000","last_undegraded":"2024-09-10T05:11:18.533054+0000","last_fullsized":"2024-09-10T05:11:18.533054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:44.106335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121101,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-10T05:11:19.185879+0000","last_change":"2024-09-10T05:11:14.294244+0000","last_active":"2024-09-10T05:11:19.185879+0000","last_peered":"2024-09-10T05:11:19.185879+0000","last_clean":"2024-09-10T05:11:19.185879+0000","last_became_active":"2024-09-10T05:11:14.293121+0000","last_became_peered":"2024-09-10T05:11:14.293121+0000","last_unstale":"2024-09-10T05:11:19.185879+0000","last_undegraded":"2024-09-10T05:11:19.185879+0000","last_fullsized":"2024-09-10T05:11:19.185879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:12.494055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:12.494055+0000","last_clean_scrub_stamp":"2024-09-10T05:11:12.494055+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:00.347397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:11:23.720 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T05:11:23.720 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T05:11:23.720 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T05:11:23.721 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T05:11:23.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.815+0000 7fed272a9640 1 Processor -- start 2024-09-10T05:11:23.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.815+0000 7fed272a9640 1 -- start start 2024-09-10T05:11:23.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.815+0000 7fed272a9640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fed20113220 0x7fed20131380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:23.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.815+0000 7fed272a9640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed2006dc00 con 0x7fed20112730 2024-09-10T05:11:23.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.815+0000 7fed272a9640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fed20113630 con 0x7fed20113220 2024-09-10T05:11:23.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.815+0000 7fed24844640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fed20113220 0x7fed20131380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:23.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.815+0000 7fed25045640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fed20112730 0x7fed20112b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:42200/0 (socket says 172.21.15.139:42200) 2024-09-10T05:11:23.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.815+0000 7fed24844640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fed20113220 0x7fed20131380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36492/0 (socket says 172.21.15.139:36492) 2024-09-10T05:11:23.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.815+0000 7fed25045640 1 -- 172.21.15.139:0/1893233926 learned_addr learned my addr 172.21.15.139:0/1893233926 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:11:23.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.816+0000 7fed24844640 1 -- 172.21.15.139:0/1893233926 >> v1:172.21.15.139:6789/0 conn(0x7fed20112730 legacy=0x7fed20112b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.816+0000 7fed24844640 1 -- 172.21.15.139:0/1893233926 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed20113c00 con 0x7fed20113220 2024-09-10T05:11:23.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.816+0000 7fed24844640 1 --2- 172.21.15.139:0/1893233926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed20113220 0x7fed20131380 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed1400b9c0 tx=0x7fed1402c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcc361070b2d702 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:23.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.817+0000 7fed1ffff640 1 -- 172.21.15.139:0/1893233926 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed14031640 con 0x7fed20113220 2024-09-10T05:11:23.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.817+0000 7fed1ffff640 1 -- 172.21.15.139:0/1893233926 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed140317e0 con 0x7fed20113220 2024-09-10T05:11:23.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.817+0000 7fed1ffff640 1 -- 172.21.15.139:0/1893233926 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed14031ae0 con 0x7fed20113220 2024-09-10T05:11:23.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.817+0000 7fed272a9640 1 -- 172.21.15.139:0/1893233926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed20113220 msgr2=0x7fed20131380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:23.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.817+0000 7fed272a9640 1 --2- 172.21.15.139:0/1893233926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed20113220 0x7fed20131380 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed1400b9c0 tx=0x7fed1402c7e0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.817+0000 7fed272a9640 1 -- 172.21.15.139:0/1893233926 shutdown_connections 2024-09-10T05:11:23.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.817+0000 7fed272a9640 1 --2- 172.21.15.139:0/1893233926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed20113220 0x7fed20131380 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:23.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.817+0000 7fed272a9640 1 -- 172.21.15.139:0/1893233926 >> 172.21.15.139:0/1893233926 conn(0x7fed20070850 msgr2=0x7fed20072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:23.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.817+0000 7fed272a9640 1 -- 172.21.15.139:0/1893233926 shutdown_connections 2024-09-10T05:11:23.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.817+0000 7fed272a9640 1 -- 172.21.15.139:0/1893233926 wait complete. 2024-09-10T05:11:23.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.818+0000 7fed272a9640 1 Processor -- start 2024-09-10T05:11:23.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.818+0000 7fed272a9640 1 -- start start 2024-09-10T05:11:23.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.818+0000 7fed272a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed20112730 0x7fed20118af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:23.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.818+0000 7fed272a9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fed201117a0 con 0x7fed20112730 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.818+0000 7fed25045640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed20112730 0x7fed20118af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.818+0000 7fed25045640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed20112730 0x7fed20118af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36494/0 (socket says 172.21.15.139:36494) 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.818+0000 7fed25045640 1 -- 172.21.15.139:0/2865042019 learned_addr learned my addr 172.21.15.139:0/2865042019 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.819+0000 7fed25045640 1 -- 172.21.15.139:0/2865042019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2011a180 con 0x7fed20112730 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.819+0000 7fed25045640 1 --2- 172.21.15.139:0/2865042019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed20112730 0x7fed20118af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c480 tx=0x7fed1800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.819+0000 7fed1dffb640 1 -- 172.21.15.139:0/2865042019 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed18017070 con 0x7fed20112730 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.819+0000 7fed1dffb640 1 -- 172.21.15.139:0/2865042019 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed18005c10 con 0x7fed20112730 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.819+0000 7fed1dffb640 1 -- 172.21.15.139:0/2865042019 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed18007070 con 0x7fed20112730 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.819+0000 7fed272a9640 1 -- 172.21.15.139:0/2865042019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2011b2b0 con 0x7fed20112730 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.819+0000 7fed272a9640 1 -- 172.21.15.139:0/2865042019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed20119210 con 0x7fed20112730 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.820+0000 7fed1dffb640 1 -- 172.21.15.139:0/2865042019 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fed1801a070 con 0x7fed20112730 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.820+0000 7fed272a9640 1 -- 172.21.15.139:0/2865042019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2011ae30 con 0x7fed20112730 2024-09-10T05:11:23.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.820+0000 7fed1dffb640 1 --2- 172.21.15.139:0/2865042019 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fed0c03de90 0x7fed0c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:23.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.820+0000 7fed1dffb640 1 -- 172.21.15.139:0/2865042019 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fed18051490 con 0x7fed20112730 2024-09-10T05:11:23.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.820+0000 7fed24844640 1 --2- 172.21.15.139:0/2865042019 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fed0c03de90 0x7fed0c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:23.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.821+0000 7fed24844640 1 --2- 172.21.15.139:0/2865042019 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fed0c03de90 0x7fed0c040350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed14036000 tx=0x7fed14031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:23.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:23.825+0000 7fed1dffb640 1 -- 172.21.15.139:0/2865042019 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fed2011ae30 con 0x7fed20112730 2024-09-10T05:11:24.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:24.038+0000 7fed272a9640 1 -- 172.21.15.139:0/2865042019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fed20112b10 con 0x7fed20112730 2024-09-10T05:11:24.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:24.038+0000 7fed1dffb640 1 -- 172.21.15.139:0/2865042019 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fed1801ac60 con 0x7fed20112730 2024-09-10T05:11:24.041 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:11:24.041 INFO:teuthology.orchestra.run.smithi139.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T05:11:24.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:24.040+0000 7fed272a9640 1 -- 172.21.15.139:0/2865042019 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fed0c03de90 msgr2=0x7fed0c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:24.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:24.040+0000 7fed272a9640 1 --2- 172.21.15.139:0/2865042019 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fed0c03de90 0x7fed0c040350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed14036000 tx=0x7fed14031000 comp rx=0 tx=0).stop 2024-09-10T05:11:24.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:24.040+0000 7fed272a9640 1 -- 172.21.15.139:0/2865042019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed20112730 msgr2=0x7fed20118af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:24.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:24.040+0000 7fed272a9640 1 --2- 172.21.15.139:0/2865042019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed20112730 0x7fed20118af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c480 tx=0x7fed1800c940 comp rx=0 tx=0).stop 2024-09-10T05:11:24.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:24.040+0000 7fed272a9640 1 -- 172.21.15.139:0/2865042019 shutdown_connections 2024-09-10T05:11:24.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:24.040+0000 7fed272a9640 1 --2- 172.21.15.139:0/2865042019 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fed0c03de90 0x7fed0c040350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:24.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:24.040+0000 7fed272a9640 1 --2- 172.21.15.139:0/2865042019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed20112730 0x7fed20118af0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:24.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:24.040+0000 7fed272a9640 1 -- 172.21.15.139:0/2865042019 >> 172.21.15.139:0/2865042019 conn(0x7fed20070850 msgr2=0x7fed2012c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:24.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:24.040+0000 7fed272a9640 1 -- 172.21.15.139:0/2865042019 shutdown_connections 2024-09-10T05:11:24.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:11:24.040+0000 7fed272a9640 1 -- 172.21.15.139:0/2865042019 wait complete. 2024-09-10T05:11:24.054 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T05:11:24.054 INFO:teuthology.run_tasks:Running task rgw... 2024-09-10T05:11:24.072 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-10T05:11:24.072 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-10T05:11:24.076 INFO:tasks.rgw:Creating data pools 2024-09-10T05:11:24.076 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-10T05:11:24.076 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-10T05:11:24.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.186+0000 7fd398cbf640 1 Processor -- start 2024-09-10T05:11:24.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.186+0000 7fd398cbf640 1 -- start start 2024-09-10T05:11:24.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.186+0000 7fd398cbf640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd39410fff0 0x7fd3941103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:24.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.186+0000 7fd398cbf640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd394110af0 con 0x7fd394114dd0 2024-09-10T05:11:24.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.186+0000 7fd398cbf640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fd394115970 con 0x7fd39410fff0 2024-09-10T05:11:24.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.187+0000 7fd39259c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd39410fff0 0x7fd3941103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:24.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.187+0000 7fd391d9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd394114dd0 0x7fd394115260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:53990/0 (socket says 172.21.15.192:53990) 2024-09-10T05:11:24.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.187+0000 7fd391d9b640 1 -- 172.21.15.192:0/3212688520 learned_addr learned my addr 172.21.15.192:0/3212688520 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:24.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.187+0000 7fd39259c640 1 -- 172.21.15.192:0/3212688520 >> v1:172.21.15.139:6789/0 conn(0x7fd394114dd0 legacy=0x7fd394115260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:24.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.187+0000 7fd39259c640 1 -- 172.21.15.192:0/3212688520 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd394115b20 con 0x7fd39410fff0 2024-09-10T05:11:24.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.188+0000 7fd39259c640 1 --2- 172.21.15.192:0/3212688520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39410fff0 0x7fd3941103d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd384009720 tx=0x7fd38402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65f36ed90a4c51f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:24.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.188+0000 7fd39159a640 1 -- 172.21.15.192:0/3212688520 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd384037070 con 0x7fd39410fff0 2024-09-10T05:11:24.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.188+0000 7fd39159a640 1 -- 172.21.15.192:0/3212688520 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38402ad90 con 0x7fd39410fff0 2024-09-10T05:11:24.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.188+0000 7fd39159a640 1 -- 172.21.15.192:0/3212688520 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd384032590 con 0x7fd39410fff0 2024-09-10T05:11:24.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.188+0000 7fd398cbf640 1 -- 172.21.15.192:0/3212688520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39410fff0 msgr2=0x7fd3941103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:24.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.188+0000 7fd398cbf640 1 --2- 172.21.15.192:0/3212688520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39410fff0 0x7fd3941103d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd384009720 tx=0x7fd38402a110 comp rx=0 tx=0).stop 2024-09-10T05:11:24.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.188+0000 7fd398cbf640 1 -- 172.21.15.192:0/3212688520 shutdown_connections 2024-09-10T05:11:24.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.188+0000 7fd398cbf640 1 --2- 172.21.15.192:0/3212688520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39410fff0 0x7fd3941103d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:24.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.188+0000 7fd398cbf640 1 -- 172.21.15.192:0/3212688520 >> 172.21.15.192:0/3212688520 conn(0x7fd39406fef0 msgr2=0x7fd394072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:24.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.188+0000 7fd398cbf640 1 -- 172.21.15.192:0/3212688520 shutdown_connections 2024-09-10T05:11:24.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.188+0000 7fd398cbf640 1 -- 172.21.15.192:0/3212688520 wait complete. 2024-09-10T05:11:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.189+0000 7fd398cbf640 1 Processor -- start 2024-09-10T05:11:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.189+0000 7fd398cbf640 1 -- start start 2024-09-10T05:11:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.189+0000 7fd398cbf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39410fff0 0x7fd3941a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.190+0000 7fd398cbf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd3940742e0 con 0x7fd39410fff0 2024-09-10T05:11:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.190+0000 7fd39259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39410fff0 0x7fd3941a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.190+0000 7fd39259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39410fff0 0x7fd3941a5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59246/0 (socket says 172.21.15.192:59246) 2024-09-10T05:11:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.190+0000 7fd39259c640 1 -- 172.21.15.192:0/2672464291 learned_addr learned my addr 172.21.15.192:0/2672464291 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.190+0000 7fd39259c640 1 -- 172.21.15.192:0/2672464291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3941a5bd0 con 0x7fd39410fff0 2024-09-10T05:11:24.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.190+0000 7fd39259c640 1 --2- 172.21.15.192:0/2672464291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39410fff0 0x7fd3941a5600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd384009720 tx=0x7fd3840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:24.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.190+0000 7fd382ffd640 1 -- 172.21.15.192:0/2672464291 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd384041070 con 0x7fd39410fff0 2024-09-10T05:11:24.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.190+0000 7fd382ffd640 1 -- 172.21.15.192:0/2672464291 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38403c460 con 0x7fd39410fff0 2024-09-10T05:11:24.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.190+0000 7fd398cbf640 1 -- 172.21.15.192:0/2672464291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3941a5e60 con 0x7fd39410fff0 2024-09-10T05:11:24.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.190+0000 7fd382ffd640 1 -- 172.21.15.192:0/2672464291 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd384037040 con 0x7fd39410fff0 2024-09-10T05:11:24.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.190+0000 7fd398cbf640 1 -- 172.21.15.192:0/2672464291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3941aae30 con 0x7fd39410fff0 2024-09-10T05:11:24.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.192+0000 7fd382ffd640 1 -- 172.21.15.192:0/2672464291 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fd384044070 con 0x7fd39410fff0 2024-09-10T05:11:24.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.192+0000 7fd398cbf640 1 -- 172.21.15.192:0/2672464291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd394110450 con 0x7fd39410fff0 2024-09-10T05:11:24.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.192+0000 7fd382ffd640 1 --2- 172.21.15.192:0/2672464291 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd37403dec0 0x7fd374040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:24.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.192+0000 7fd382ffd640 1 -- 172.21.15.192:0/2672464291 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fd384072ad0 con 0x7fd39410fff0 2024-09-10T05:11:24.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.192+0000 7fd391d9b640 1 --2- 172.21.15.192:0/2672464291 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd37403dec0 0x7fd374040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:24.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.192+0000 7fd391d9b640 1 --2- 172.21.15.192:0/2672464291 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd37403dec0 0x7fd374040380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd388007fd0 tx=0x7fd388007aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:24.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.196+0000 7fd382ffd640 1 -- 172.21.15.192:0/2672464291 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fd38403cc60 con 0x7fd39410fff0 2024-09-10T05:11:24.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.379+0000 7fd398cbf640 1 -- 172.21.15.192:0/2672464291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) -- 0x7fd394114dd0 con 0x7fd39410fff0 2024-09-10T05:11:24.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.538+0000 7fd382ffd640 1 -- 172.21.15.192:0/2672464291 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v20) ==== 151+0+0 (secure 0 0 0) 0x7fd38403c740 con 0x7fd39410fff0 2024-09-10T05:11:24.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.540+0000 7fd398cbf640 1 -- 172.21.15.192:0/2672464291 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd37403dec0 msgr2=0x7fd374040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:24.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.540+0000 7fd398cbf640 1 --2- 172.21.15.192:0/2672464291 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd37403dec0 0x7fd374040380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd388007fd0 tx=0x7fd388007aa0 comp rx=0 tx=0).stop 2024-09-10T05:11:24.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.540+0000 7fd398cbf640 1 -- 172.21.15.192:0/2672464291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39410fff0 msgr2=0x7fd3941a5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:24.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.540+0000 7fd398cbf640 1 --2- 172.21.15.192:0/2672464291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39410fff0 0x7fd3941a5600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd384009720 tx=0x7fd3840046c0 comp rx=0 tx=0).stop 2024-09-10T05:11:24.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.540+0000 7fd398cbf640 1 -- 172.21.15.192:0/2672464291 shutdown_connections 2024-09-10T05:11:24.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.540+0000 7fd398cbf640 1 --2- 172.21.15.192:0/2672464291 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd37403dec0 0x7fd374040380 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:24.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.540+0000 7fd398cbf640 1 --2- 172.21.15.192:0/2672464291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39410fff0 0x7fd3941a5600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:24.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.540+0000 7fd398cbf640 1 -- 172.21.15.192:0/2672464291 >> 172.21.15.192:0/2672464291 conn(0x7fd39406fef0 msgr2=0x7fd394072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:24.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.540+0000 7fd398cbf640 1 -- 172.21.15.192:0/2672464291 shutdown_connections 2024-09-10T05:11:24.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.540+0000 7fd398cbf640 1 -- 172.21.15.192:0/2672464291 wait complete. 2024-09-10T05:11:24.552 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-10T05:11:24.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.650+0000 7f20afe0f640 1 Processor -- start 2024-09-10T05:11:24.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.650+0000 7f20afe0f640 1 -- start start 2024-09-10T05:11:24.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.650+0000 7f20afe0f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f20a8110490 0x7f20a811c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:24.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.650+0000 7f20afe0f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a8110940 con 0x7f20a8074b00 2024-09-10T05:11:24.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.650+0000 7f20afe0f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f20a8075060 con 0x7f20a8110490 2024-09-10T05:11:24.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.650+0000 7f20ad3aa640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f20a8110490 0x7f20a811c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:24.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.650+0000 7f20adbab640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f20a8074b00 0x7f20a810fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:53998/0 (socket says 172.21.15.192:53998) 2024-09-10T05:11:24.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.650+0000 7f20adbab640 1 -- 172.21.15.192:0/3420057351 learned_addr learned my addr 172.21.15.192:0/3420057351 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:24.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.651+0000 7f20ad3aa640 1 -- 172.21.15.192:0/3420057351 >> v1:172.21.15.139:6789/0 conn(0x7f20a8074b00 legacy=0x7f20a810fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:24.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.651+0000 7f20acba9640 1 -- 172.21.15.192:0/3420057351 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440992980 0 0) 0x7f20a8110940 con 0x7f20a8074b00 2024-09-10T05:11:24.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.651+0000 7f20ad3aa640 1 -- 172.21.15.192:0/3420057351 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a8110b40 con 0x7f20a8110490 2024-09-10T05:11:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.651+0000 7f20ad3aa640 1 --2- 172.21.15.192:0/3420057351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a8110490 0x7f20a811c110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2098009720 tx=0x7f209802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9215b1c15477bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.652+0000 7f20acba9640 1 -- 172.21.15.192:0/3420057351 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098037070 con 0x7f20a8110490 2024-09-10T05:11:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.652+0000 7f20acba9640 1 -- 172.21.15.192:0/3420057351 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209802ad90 con 0x7f20a8110490 2024-09-10T05:11:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.652+0000 7f20acba9640 1 -- 172.21.15.192:0/3420057351 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098032590 con 0x7f20a8110490 2024-09-10T05:11:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.652+0000 7f20afe0f640 1 -- 172.21.15.192:0/3420057351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a8110490 msgr2=0x7f20a811c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.652+0000 7f20afe0f640 1 --2- 172.21.15.192:0/3420057351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a8110490 0x7f20a811c110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2098009720 tx=0x7f209802a110 comp rx=0 tx=0).stop 2024-09-10T05:11:24.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.652+0000 7f20afe0f640 1 -- 172.21.15.192:0/3420057351 shutdown_connections 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.652+0000 7f20afe0f640 1 --2- 172.21.15.192:0/3420057351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a8110490 0x7f20a811c110 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.652+0000 7f20afe0f640 1 -- 172.21.15.192:0/3420057351 >> 172.21.15.192:0/3420057351 conn(0x7f20a806ff80 msgr2=0x7f20a80723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.652+0000 7f20afe0f640 1 -- 172.21.15.192:0/3420057351 shutdown_connections 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.652+0000 7f20afe0f640 1 -- 172.21.15.192:0/3420057351 wait complete. 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.653+0000 7f20afe0f640 1 Processor -- start 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.653+0000 7f20afe0f640 1 -- start start 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.653+0000 7f20afe0f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a8074b00 0x7f20a81a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.653+0000 7f20afe0f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f20a811cb30 con 0x7f20a8074b00 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.653+0000 7f20adbab640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a8074b00 0x7f20a81a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.653+0000 7f20adbab640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a8074b00 0x7f20a81a52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59264/0 (socket says 172.21.15.192:59264) 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.653+0000 7f20adbab640 1 -- 172.21.15.192:0/3303177076 learned_addr learned my addr 172.21.15.192:0/3303177076 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.654+0000 7f20adbab640 1 -- 172.21.15.192:0/3303177076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a81a58b0 con 0x7f20a8074b00 2024-09-10T05:11:24.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.654+0000 7f20adbab640 1 --2- 172.21.15.192:0/3303177076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a8074b00 0x7f20a81a52e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c3d0 tx=0x7f20a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:24.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.654+0000 7f209e7fc640 1 -- 172.21.15.192:0/3303177076 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a40074d0 con 0x7f20a8074b00 2024-09-10T05:11:24.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.654+0000 7f209e7fc640 1 -- 172.21.15.192:0/3303177076 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a40047e0 con 0x7f20a8074b00 2024-09-10T05:11:24.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.654+0000 7f20afe0f640 1 -- 172.21.15.192:0/3303177076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a81a5ba0 con 0x7f20a8074b00 2024-09-10T05:11:24.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.654+0000 7f209e7fc640 1 -- 172.21.15.192:0/3303177076 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a4007670 con 0x7f20a8074b00 2024-09-10T05:11:24.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.654+0000 7f20afe0f640 1 -- 172.21.15.192:0/3303177076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a81aad70 con 0x7f20a8074b00 2024-09-10T05:11:24.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.655+0000 7f209e7fc640 1 -- 172.21.15.192:0/3303177076 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f20a4011070 con 0x7f20a8074b00 2024-09-10T05:11:24.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.655+0000 7f20afe0f640 1 -- 172.21.15.192:0/3303177076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a81a5ee0 con 0x7f20a8074b00 2024-09-10T05:11:24.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.655+0000 7f209e7fc640 1 --2- 172.21.15.192:0/3303177076 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f208c03dec0 0x7f208c040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:24.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.655+0000 7f209e7fc640 1 -- 172.21.15.192:0/3303177076 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3802+0+0 (secure 0 0 0) 0x7f20a4051ff0 con 0x7f20a8074b00 2024-09-10T05:11:24.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.655+0000 7f20ad3aa640 1 --2- 172.21.15.192:0/3303177076 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f208c03dec0 0x7f208c040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:24.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.656+0000 7f20ad3aa640 1 --2- 172.21.15.192:0/3303177076 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f208c03dec0 0x7f208c040380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2098034000 tx=0x7f209802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:24.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.660+0000 7f209e7fc640 1 -- 172.21.15.192:0/3303177076 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f20a4012dd0 con 0x7f20a8074b00 2024-09-10T05:11:24.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:24.837+0000 7f20afe0f640 1 -- 172.21.15.192:0/3303177076 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f20a811d190 con 0x7f20a8074b00 2024-09-10T05:11:26.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.691+0000 7f209e7fc640 1 -- 172.21.15.192:0/3303177076 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v23) ==== 227+0+0 (secure 0 0 0) 0x7f20a4004df0 con 0x7f20a8074b00 2024-09-10T05:11:26.693 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'default.rgw.buckets.data' created 2024-09-10T05:11:26.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.694+0000 7f20afe0f640 1 -- 172.21.15.192:0/3303177076 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f208c03dec0 msgr2=0x7f208c040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:26.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.694+0000 7f20afe0f640 1 --2- 172.21.15.192:0/3303177076 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f208c03dec0 0x7f208c040380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2098034000 tx=0x7f209802e000 comp rx=0 tx=0).stop 2024-09-10T05:11:26.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.695+0000 7f20afe0f640 1 -- 172.21.15.192:0/3303177076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a8074b00 msgr2=0x7f20a81a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:26.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.695+0000 7f20afe0f640 1 --2- 172.21.15.192:0/3303177076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a8074b00 0x7f20a81a52e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c3d0 tx=0x7f20a400c890 comp rx=0 tx=0).stop 2024-09-10T05:11:26.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.695+0000 7f20afe0f640 1 -- 172.21.15.192:0/3303177076 shutdown_connections 2024-09-10T05:11:26.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.695+0000 7f20afe0f640 1 --2- 172.21.15.192:0/3303177076 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f208c03dec0 0x7f208c040380 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:26.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.695+0000 7f20afe0f640 1 --2- 172.21.15.192:0/3303177076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a8074b00 0x7f20a81a52e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:26.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.695+0000 7f20afe0f640 1 -- 172.21.15.192:0/3303177076 >> 172.21.15.192:0/3303177076 conn(0x7f20a806ff80 msgr2=0x7f20a8115e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:26.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.695+0000 7f20afe0f640 1 -- 172.21.15.192:0/3303177076 shutdown_connections 2024-09-10T05:11:26.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.695+0000 7f20afe0f640 1 -- 172.21.15.192:0/3303177076 wait complete. 2024-09-10T05:11:26.717 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-10T05:11:26.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.818+0000 7fb3f9c18640 1 Processor -- start 2024-09-10T05:11:26.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.818+0000 7fb3f9c18640 1 -- start start 2024-09-10T05:11:26.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.818+0000 7fb3f9c18640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb3f4110490 0x7fb3f411c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:26.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.818+0000 7fb3f9c18640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3f4110940 con 0x7fb3f4074b00 2024-09-10T05:11:26.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.818+0000 7fb3f9c18640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fb3f4075060 con 0x7fb3f4110490 2024-09-10T05:11:26.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.818+0000 7fb3f2ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb3f4110490 0x7fb3f411c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:26.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.818+0000 7fb3f2ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb3f4110490 0x7fb3f411c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59274/0 (socket says 172.21.15.192:59274) 2024-09-10T05:11:26.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.818+0000 7fb3f37fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb3f4074b00 0x7fb3f410fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:54010/0 (socket says 172.21.15.192:54010) 2024-09-10T05:11:26.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.818+0000 7fb3f2ffd640 1 -- 172.21.15.192:0/3925024009 learned_addr learned my addr 172.21.15.192:0/3925024009 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:26.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.819+0000 7fb3f2ffd640 1 -- 172.21.15.192:0/3925024009 >> v1:172.21.15.139:6789/0 conn(0x7fb3f4074b00 legacy=0x7fb3f410fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:26.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.819+0000 7fb3f2ffd640 1 -- 172.21.15.192:0/3925024009 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f4110b40 con 0x7fb3f4110490 2024-09-10T05:11:26.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.819+0000 7fb3f2ffd640 1 --2- 172.21.15.192:0/3925024009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3f4110490 0x7fb3f411c110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40097f0 tx=0x7fb3e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f4c2f2fa867e97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:26.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.820+0000 7fb3f27fc640 1 -- 172.21.15.192:0/3925024009 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e4037070 con 0x7fb3f4110490 2024-09-10T05:11:26.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.820+0000 7fb3f27fc640 1 -- 172.21.15.192:0/3925024009 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3e4032440 con 0x7fb3f4110490 2024-09-10T05:11:26.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.820+0000 7fb3f27fc640 1 -- 172.21.15.192:0/3925024009 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e402ae60 con 0x7fb3f4110490 2024-09-10T05:11:26.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.820+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3925024009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3f4110490 msgr2=0x7fb3f411c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:26.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.820+0000 7fb3f9c18640 1 --2- 172.21.15.192:0/3925024009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3f4110490 0x7fb3f411c110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40097f0 tx=0x7fb3e402a1e0 comp rx=0 tx=0).stop 2024-09-10T05:11:26.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.820+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3925024009 shutdown_connections 2024-09-10T05:11:26.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.820+0000 7fb3f9c18640 1 --2- 172.21.15.192:0/3925024009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3f4110490 0x7fb3f411c110 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:26.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.820+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3925024009 >> 172.21.15.192:0/3925024009 conn(0x7fb3f406ff80 msgr2=0x7fb3f40723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:26.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.820+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3925024009 shutdown_connections 2024-09-10T05:11:26.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.820+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3925024009 wait complete. 2024-09-10T05:11:26.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.821+0000 7fb3f9c18640 1 Processor -- start 2024-09-10T05:11:26.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.821+0000 7fb3f9c18640 1 -- start start 2024-09-10T05:11:26.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.821+0000 7fb3f9c18640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3f4074b00 0x7fb3f41a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:26.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.821+0000 7fb3f9c18640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f411cb30 con 0x7fb3f4074b00 2024-09-10T05:11:26.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.821+0000 7fb3f37fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3f4074b00 0x7fb3f41a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:26.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.821+0000 7fb3f37fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3f4074b00 0x7fb3f41a7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59288/0 (socket says 172.21.15.192:59288) 2024-09-10T05:11:26.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.821+0000 7fb3f37fe640 1 -- 172.21.15.192:0/3456602930 learned_addr learned my addr 172.21.15.192:0/3456602930 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:26.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.822+0000 7fb3f37fe640 1 -- 172.21.15.192:0/3456602930 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f41a7d40 con 0x7fb3f4074b00 2024-09-10T05:11:26.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.822+0000 7fb3f37fe640 1 --2- 172.21.15.192:0/3456602930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3f4074b00 0x7fb3f41a7770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800c450 tx=0x7fb3e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:26.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.822+0000 7fb3dbfff640 1 -- 172.21.15.192:0/3456602930 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e8007410 con 0x7fb3f4074b00 2024-09-10T05:11:26.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.822+0000 7fb3dbfff640 1 -- 172.21.15.192:0/3456602930 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3e80075b0 con 0x7fb3f4074b00 2024-09-10T05:11:26.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.822+0000 7fb3dbfff640 1 -- 172.21.15.192:0/3456602930 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e8004950 con 0x7fb3f4074b00 2024-09-10T05:11:26.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.822+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3456602930 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f41a8030 con 0x7fb3f4074b00 2024-09-10T05:11:26.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.822+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3456602930 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f41ad200 con 0x7fb3f4074b00 2024-09-10T05:11:26.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.823+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3456602930 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f41a8370 con 0x7fb3f4074b00 2024-09-10T05:11:26.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.823+0000 7fb3dbfff640 1 -- 172.21.15.192:0/3456602930 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb3e8004bc0 con 0x7fb3f4074b00 2024-09-10T05:11:26.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.823+0000 7fb3dbfff640 1 --2- 172.21.15.192:0/3456602930 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb3e003de40 0x7fb3e0040300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:26.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.824+0000 7fb3dbfff640 1 -- 172.21.15.192:0/3456602930 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4249+0+0 (secure 0 0 0) 0x7fb3e8051ac0 con 0x7fb3f4074b00 2024-09-10T05:11:26.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.824+0000 7fb3f2ffd640 1 --2- 172.21.15.192:0/3456602930 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb3e003de40 0x7fb3e0040300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:26.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.824+0000 7fb3f2ffd640 1 --2- 172.21.15.192:0/3456602930 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb3e003de40 0x7fb3e0040300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4034000 tx=0x7fb3e402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:26.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:26.829+0000 7fb3dbfff640 1 -- 172.21.15.192:0/3456602930 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fb3e8019310 con 0x7fb3f4074b00 2024-09-10T05:11:27.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.002+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3456602930 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7fb3f411d190 con 0x7fb3f4074b00 2024-09-10T05:11:27.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.692+0000 7fb3dbfff640 1 -- 172.21.15.192:0/3456602930 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v24) ==== 185+0+0 (secure 0 0 0) 0x7fb3e80194f0 con 0x7fb3f4074b00 2024-09-10T05:11:27.694 INFO:teuthology.orchestra.run.smithi192.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-10T05:11:27.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.695+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3456602930 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb3e003de40 msgr2=0x7fb3e0040300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:27.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.695+0000 7fb3f9c18640 1 --2- 172.21.15.192:0/3456602930 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb3e003de40 0x7fb3e0040300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4034000 tx=0x7fb3e402e000 comp rx=0 tx=0).stop 2024-09-10T05:11:27.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.695+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3456602930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3f4074b00 msgr2=0x7fb3f41a7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:27.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.695+0000 7fb3f9c18640 1 --2- 172.21.15.192:0/3456602930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3f4074b00 0x7fb3f41a7770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800c450 tx=0x7fb3e800c910 comp rx=0 tx=0).stop 2024-09-10T05:11:27.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.695+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3456602930 shutdown_connections 2024-09-10T05:11:27.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.695+0000 7fb3f9c18640 1 --2- 172.21.15.192:0/3456602930 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb3e003de40 0x7fb3e0040300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:27.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.695+0000 7fb3f9c18640 1 --2- 172.21.15.192:0/3456602930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3f4074b00 0x7fb3f41a7770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:27.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.695+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3456602930 >> 172.21.15.192:0/3456602930 conn(0x7fb3f406ff80 msgr2=0x7fb3f4111a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:27.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.696+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3456602930 shutdown_connections 2024-09-10T05:11:27.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.696+0000 7fb3f9c18640 1 -- 172.21.15.192:0/3456602930 wait complete. 2024-09-10T05:11:27.722 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-10T05:11:27.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.825+0000 7fe3ad9d1640 1 Processor -- start 2024-09-10T05:11:27.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.825+0000 7fe3ad9d1640 1 -- start start 2024-09-10T05:11:27.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.825+0000 7fe3ad9d1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe3a8110490 0x7fe3a811c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:27.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.825+0000 7fe3ad9d1640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a8110940 con 0x7fe3a8074b00 2024-09-10T05:11:27.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.825+0000 7fe3ad9d1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a8075060 con 0x7fe3a8110490 2024-09-10T05:11:27.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.825+0000 7fe3a67fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe3a8110490 0x7fe3a811c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:27.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.825+0000 7fe3a6ffd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fe3a8074b00 0x7fe3a810fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:54024/0 (socket says 172.21.15.192:54024) 2024-09-10T05:11:27.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.825+0000 7fe3a6ffd640 1 -- 172.21.15.192:0/3028787215 learned_addr learned my addr 172.21.15.192:0/3028787215 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:27.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.826+0000 7fe3a67fc640 1 -- 172.21.15.192:0/3028787215 >> v1:172.21.15.139:6789/0 conn(0x7fe3a8074b00 legacy=0x7fe3a810fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:27.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.826+0000 7fe3a67fc640 1 -- 172.21.15.192:0/3028787215 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a8110b40 con 0x7fe3a8110490 2024-09-10T05:11:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.827+0000 7fe3a67fc640 1 --2- 172.21.15.192:0/3028787215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3a8110490 0x7fe3a811c110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009720 tx=0x7fe39c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0d9362425b86a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.827+0000 7fe3a5ffb640 1 -- 172.21.15.192:0/3028787215 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe39c037070 con 0x7fe3a8110490 2024-09-10T05:11:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.827+0000 7fe3a5ffb640 1 -- 172.21.15.192:0/3028787215 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c02ad90 con 0x7fe3a8110490 2024-09-10T05:11:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.827+0000 7fe3a5ffb640 1 -- 172.21.15.192:0/3028787215 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe39c032590 con 0x7fe3a8110490 2024-09-10T05:11:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.827+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/3028787215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3a8110490 msgr2=0x7fe3a811c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.827+0000 7fe3ad9d1640 1 --2- 172.21.15.192:0/3028787215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3a8110490 0x7fe3a811c110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009720 tx=0x7fe39c02a110 comp rx=0 tx=0).stop 2024-09-10T05:11:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.827+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/3028787215 shutdown_connections 2024-09-10T05:11:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.827+0000 7fe3ad9d1640 1 --2- 172.21.15.192:0/3028787215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3a8110490 0x7fe3a811c110 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.827+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/3028787215 >> 172.21.15.192:0/3028787215 conn(0x7fe3a806ff80 msgr2=0x7fe3a80723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.827+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/3028787215 shutdown_connections 2024-09-10T05:11:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.827+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/3028787215 wait complete. 2024-09-10T05:11:27.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.828+0000 7fe3ad9d1640 1 Processor -- start 2024-09-10T05:11:27.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.828+0000 7fe3ad9d1640 1 -- start start 2024-09-10T05:11:27.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.828+0000 7fe3ad9d1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3a8074b00 0x7fe3a8110fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:27.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.828+0000 7fe3ad9d1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a811cb30 con 0x7fe3a8074b00 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.828+0000 7fe3a6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3a8074b00 0x7fe3a8110fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.829+0000 7fe3a6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3a8074b00 0x7fe3a8110fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59308/0 (socket says 172.21.15.192:59308) 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.829+0000 7fe3a6ffd640 1 -- 172.21.15.192:0/2445154588 learned_addr learned my addr 172.21.15.192:0/2445154588 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.829+0000 7fe3a6ffd640 1 -- 172.21.15.192:0/2445154588 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a8112eb0 con 0x7fe3a8074b00 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.829+0000 7fe3a6ffd640 1 --2- 172.21.15.192:0/2445154588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3a8074b00 0x7fe3a8110fb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe39800c480 tx=0x7fe39800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.829+0000 7fe38ffff640 1 -- 172.21.15.192:0/2445154588 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe398017070 con 0x7fe3a8074b00 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.829+0000 7fe38ffff640 1 -- 172.21.15.192:0/2445154588 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe398005c10 con 0x7fe3a8074b00 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.829+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/2445154588 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a8111550 con 0x7fe3a8074b00 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.829+0000 7fe38ffff640 1 -- 172.21.15.192:0/2445154588 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe398007070 con 0x7fe3a8074b00 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.829+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/2445154588 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a8111af0 con 0x7fe3a8074b00 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.830+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/2445154588 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a811d190 con 0x7fe3a8074b00 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.830+0000 7fe38ffff640 1 -- 172.21.15.192:0/2445154588 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe39801a070 con 0x7fe3a8074b00 2024-09-10T05:11:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.830+0000 7fe38ffff640 1 --2- 172.21.15.192:0/2445154588 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39403de70 0x7fe394040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:27.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.831+0000 7fe38ffff640 1 -- 172.21.15.192:0/2445154588 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4260+0+0 (secure 0 0 0) 0x7fe3980517e0 con 0x7fe3a8074b00 2024-09-10T05:11:27.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.831+0000 7fe3a67fc640 1 --2- 172.21.15.192:0/2445154588 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39403de70 0x7fe394040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:27.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.831+0000 7fe3a67fc640 1 --2- 172.21.15.192:0/2445154588 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39403de70 0x7fe394040330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe39c034000 tx=0x7fe39c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:27.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:27.835+0000 7fe38ffff640 1 -- 172.21.15.192:0/2445154588 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fe398019cd0 con 0x7fe3a8074b00 2024-09-10T05:11:28.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.009+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/2445154588 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fe3a8118f40 con 0x7fe3a8074b00 2024-09-10T05:11:28.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.702+0000 7fe38ffff640 1 -- 172.21.15.192:0/2445154588 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v25) ==== 169+0+0 (secure 0 0 0) 0x7fe39801b3b0 con 0x7fe3a8074b00 2024-09-10T05:11:28.704 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'default.rgw.buckets.index' created 2024-09-10T05:11:28.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.704+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/2445154588 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39403de70 msgr2=0x7fe394040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:28.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.704+0000 7fe3ad9d1640 1 --2- 172.21.15.192:0/2445154588 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39403de70 0x7fe394040330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe39c034000 tx=0x7fe39c02e000 comp rx=0 tx=0).stop 2024-09-10T05:11:28.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.704+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/2445154588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3a8074b00 msgr2=0x7fe3a8110fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:28.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.704+0000 7fe3ad9d1640 1 --2- 172.21.15.192:0/2445154588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3a8074b00 0x7fe3a8110fb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe39800c480 tx=0x7fe39800c940 comp rx=0 tx=0).stop 2024-09-10T05:11:28.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.704+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/2445154588 shutdown_connections 2024-09-10T05:11:28.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.704+0000 7fe3ad9d1640 1 --2- 172.21.15.192:0/2445154588 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39403de70 0x7fe394040330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:28.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.704+0000 7fe3ad9d1640 1 --2- 172.21.15.192:0/2445154588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3a8074b00 0x7fe3a8110fb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:28.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.704+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/2445154588 >> 172.21.15.192:0/2445154588 conn(0x7fe3a806ff80 msgr2=0x7fe3a8116110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:28.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.704+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/2445154588 shutdown_connections 2024-09-10T05:11:28.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.704+0000 7fe3ad9d1640 1 -- 172.21.15.192:0/2445154588 wait complete. 2024-09-10T05:11:28.723 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-10T05:11:28.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.821+0000 7fadd89f5640 1 Processor -- start 2024-09-10T05:11:28.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.821+0000 7fadd89f5640 1 -- start start 2024-09-10T05:11:28.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.821+0000 7fadd89f5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fadd4117e10 0x7fadd411a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:28.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.821+0000 7fadd89f5640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd411a740 con 0x7fadd410fff0 2024-09-10T05:11:28.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.821+0000 7fadd89f5640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fadd411b920 con 0x7fadd4117e10 2024-09-10T05:11:28.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.822+0000 7fadd1d9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fadd4117e10 0x7fadd411a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:28.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.822+0000 7fadd1d9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fadd4117e10 0x7fadd411a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59322/0 (socket says 172.21.15.192:59322) 2024-09-10T05:11:28.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.822+0000 7fadd1d9b640 1 -- 172.21.15.192:0/2717183906 learned_addr learned my addr 172.21.15.192:0/2717183906 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:28.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.822+0000 7fadd1d9b640 1 -- 172.21.15.192:0/2717183906 >> v1:172.21.15.139:6789/0 conn(0x7fadd410fff0 legacy=0x7fadd41103d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:28.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.822+0000 7fadd1d9b640 1 -- 172.21.15.192:0/2717183906 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd411baa0 con 0x7fadd4117e10 2024-09-10T05:11:28.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.823+0000 7fadd1d9b640 1 --2- 172.21.15.192:0/2717183906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadd4117e10 0x7fadd411a200 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fadc800a990 tx=0x7fadc802b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f226c463d5b7bb6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:28.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.823+0000 7fadd159a640 1 -- 172.21.15.192:0/2717183906 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc800b040 con 0x7fadd4117e10 2024-09-10T05:11:28.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.823+0000 7fadd159a640 1 -- 172.21.15.192:0/2717183906 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc8030640 con 0x7fadd4117e10 2024-09-10T05:11:28.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.823+0000 7fadd159a640 1 -- 172.21.15.192:0/2717183906 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc8030940 con 0x7fadd4117e10 2024-09-10T05:11:28.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.823+0000 7fadd89f5640 1 -- 172.21.15.192:0/2717183906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadd4117e10 msgr2=0x7fadd411a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:28.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.823+0000 7fadd89f5640 1 --2- 172.21.15.192:0/2717183906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadd4117e10 0x7fadd411a200 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fadc800a990 tx=0x7fadc802b5e0 comp rx=0 tx=0).stop 2024-09-10T05:11:28.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.823+0000 7fadd89f5640 1 -- 172.21.15.192:0/2717183906 shutdown_connections 2024-09-10T05:11:28.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.823+0000 7fadd89f5640 1 --2- 172.21.15.192:0/2717183906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadd4117e10 0x7fadd411a200 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:28.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.823+0000 7fadd89f5640 1 -- 172.21.15.192:0/2717183906 >> 172.21.15.192:0/2717183906 conn(0x7fadd406ff80 msgr2=0x7fadd40723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:28.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.824+0000 7fadd89f5640 1 -- 172.21.15.192:0/2717183906 shutdown_connections 2024-09-10T05:11:28.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.824+0000 7fadd89f5640 1 -- 172.21.15.192:0/2717183906 wait complete. 2024-09-10T05:11:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.824+0000 7fadd89f5640 1 Processor -- start 2024-09-10T05:11:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.824+0000 7fadd89f5640 1 -- start start 2024-09-10T05:11:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.824+0000 7fadd89f5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadd410fff0 0x7fadd41a5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.825+0000 7fadd89f5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fadd4074390 con 0x7fadd410fff0 2024-09-10T05:11:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.825+0000 7fadd259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadd410fff0 0x7fadd41a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.825+0000 7fadd259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadd410fff0 0x7fadd41a5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59332/0 (socket says 172.21.15.192:59332) 2024-09-10T05:11:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.825+0000 7fadd259c640 1 -- 172.21.15.192:0/2673785153 learned_addr learned my addr 172.21.15.192:0/2673785153 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.825+0000 7fadd259c640 1 -- 172.21.15.192:0/2673785153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd41a5b30 con 0x7fadd410fff0 2024-09-10T05:11:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.825+0000 7fadd259c640 1 --2- 172.21.15.192:0/2673785153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadd410fff0 0x7fadd41a5560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fadc400c3d0 tx=0x7fadc400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:28.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.825+0000 7fadc2ffd640 1 -- 172.21.15.192:0/2673785153 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc4017070 con 0x7fadd410fff0 2024-09-10T05:11:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.825+0000 7fadc2ffd640 1 -- 172.21.15.192:0/2673785153 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc4005240 con 0x7fadd410fff0 2024-09-10T05:11:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.825+0000 7fadc2ffd640 1 -- 172.21.15.192:0/2673785153 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc40035f0 con 0x7fadd410fff0 2024-09-10T05:11:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.826+0000 7fadd89f5640 1 -- 172.21.15.192:0/2673785153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd41a5e20 con 0x7fadd410fff0 2024-09-10T05:11:28.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.826+0000 7fadd89f5640 1 -- 172.21.15.192:0/2673785153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd41aaff0 con 0x7fadd410fff0 2024-09-10T05:11:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.827+0000 7fadd89f5640 1 -- 172.21.15.192:0/2673785153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd41a6160 con 0x7fadd410fff0 2024-09-10T05:11:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.827+0000 7fadc2ffd640 1 -- 172.21.15.192:0/2673785153 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fadc401a070 con 0x7fadd410fff0 2024-09-10T05:11:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.827+0000 7fadc2ffd640 1 --2- 172.21.15.192:0/2673785153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fadb403de70 0x7fadb4040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.827+0000 7fadc2ffd640 1 -- 172.21.15.192:0/2673785153 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4624+0+0 (secure 0 0 0) 0x7fadc40519e0 con 0x7fadd410fff0 2024-09-10T05:11:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.827+0000 7fadd1d9b640 1 --2- 172.21.15.192:0/2673785153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fadb403de70 0x7fadb4040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:28.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.827+0000 7fadd1d9b640 1 --2- 172.21.15.192:0/2673785153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fadb403de70 0x7fadb4040330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fadc8035000 tx=0x7fadc8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:28.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:28.832+0000 7fadc2ffd640 1 -- 172.21.15.192:0/2673785153 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fadc4003790 con 0x7fadd410fff0 2024-09-10T05:11:29.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:29.007+0000 7fadd89f5640 1 -- 172.21.15.192:0/2673785153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fadd4110450 con 0x7fadd410fff0 2024-09-10T05:11:29.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:29.703+0000 7fadc2ffd640 1 -- 172.21.15.192:0/2673785153 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v26) ==== 187+0+0 (secure 0 0 0) 0x7fadc4011590 con 0x7fadd410fff0 2024-09-10T05:11:29.705 INFO:teuthology.orchestra.run.smithi192.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-10T05:11:29.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:29.705+0000 7fadd89f5640 1 -- 172.21.15.192:0/2673785153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fadb403de70 msgr2=0x7fadb4040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:29.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:29.705+0000 7fadd89f5640 1 --2- 172.21.15.192:0/2673785153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fadb403de70 0x7fadb4040330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fadc8035000 tx=0x7fadc8030000 comp rx=0 tx=0).stop 2024-09-10T05:11:29.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:29.705+0000 7fadd89f5640 1 -- 172.21.15.192:0/2673785153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadd410fff0 msgr2=0x7fadd41a5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:29.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:29.705+0000 7fadd89f5640 1 --2- 172.21.15.192:0/2673785153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadd410fff0 0x7fadd41a5560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fadc400c3d0 tx=0x7fadc400c890 comp rx=0 tx=0).stop 2024-09-10T05:11:29.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:29.705+0000 7fadd89f5640 1 -- 172.21.15.192:0/2673785153 shutdown_connections 2024-09-10T05:11:29.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:29.705+0000 7fadd89f5640 1 --2- 172.21.15.192:0/2673785153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fadb403de70 0x7fadb4040330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:29.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:29.705+0000 7fadd89f5640 1 --2- 172.21.15.192:0/2673785153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fadd410fff0 0x7fadd41a5560 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:29.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:29.705+0000 7fadd89f5640 1 -- 172.21.15.192:0/2673785153 >> 172.21.15.192:0/2673785153 conn(0x7fadd406ff80 msgr2=0x7fadd4071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:29.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:29.706+0000 7fadd89f5640 1 -- 172.21.15.192:0/2673785153 shutdown_connections 2024-09-10T05:11:29.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:29.706+0000 7fadd89f5640 1 -- 172.21.15.192:0/2673785153 wait complete. 2024-09-10T05:11:29.728 DEBUG:tasks.rgw:Pools created 2024-09-10T05:11:29.728 INFO:tasks.rgw:Starting rgw... 2024-09-10T05:11:29.728 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-10T05:11:29.729 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-10T05:11:29.729 DEBUG:teuthology.orchestra.run.smithi192:> sudo echo -n http://smithi192.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-10T05:11:29.760 INFO:teuthology.orchestra.run.smithi192.stdout:http://smithi192.front.sepia.ceph.com:80 2024-09-10T05:11:29.760 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-10T05:11:29.826 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-10T05:11:29.826 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-10T05:11:29.868 INFO:tasks.rgw.client.0:Started 2024-09-10T05:11:29.868 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi192.front.sepia.ceph.com:80/ 2024-09-10T05:11:29.869 DEBUG:teuthology.orchestra.run.smithi192:> curl http://smithi192.front.sepia.ceph.com:80/ 2024-09-10T05:11:29.897 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T05:11:29.897 INFO:teuthology.orchestra.run.smithi192.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:11:29.897 INFO:teuthology.orchestra.run.smithi192.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:11:29.898 INFO:teuthology.orchestra.run.smithi192.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T05:11:29.898 INFO:teuthology.orchestra.run.smithi192.stderr:curl: (7) Failed to connect to smithi192.front.sepia.ceph.com port 80: Connection refused 2024-09-10T05:11:30.898 DEBUG:teuthology.orchestra.run.smithi192:> curl http://smithi192.front.sepia.ceph.com:80/ 2024-09-10T05:11:30.922 INFO:teuthology.orchestra.run.smithi192.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:11:30.923 INFO:teuthology.orchestra.run.smithi192.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:11:30.923 INFO:teuthology.orchestra.run.smithi192.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T05:11:30.923 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T05:11:30.924 INFO:teuthology.orchestra.run.smithi192.stderr:curl: (7) Failed to connect to smithi192.front.sepia.ceph.com port 80: Connection refused 2024-09-10T05:11:32.925 DEBUG:teuthology.orchestra.run.smithi192:> curl http://smithi192.front.sepia.ceph.com:80/ 2024-09-10T05:11:32.949 INFO:teuthology.orchestra.run.smithi192.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:11:32.949 INFO:teuthology.orchestra.run.smithi192.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:11:32.949 INFO:teuthology.orchestra.run.smithi192.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T05:11:32.950 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T05:11:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:curl: (7) Failed to connect to smithi192.front.sepia.ceph.com port 80: Connection refused 2024-09-10T05:11:36.952 DEBUG:teuthology.orchestra.run.smithi192:> curl http://smithi192.front.sepia.ceph.com:80/ 2024-09-10T05:11:36.976 INFO:teuthology.orchestra.run.smithi192.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:11:36.976 INFO:teuthology.orchestra.run.smithi192.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:11:36.977 INFO:teuthology.orchestra.run.smithi192.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T05:11:36.977 INFO:teuthology.orchestra.run.smithi192.stderr:curl: (7) Failed to connect to smithi192.front.sepia.ceph.com port 80: Connection refused 2024-09-10T05:11:36.977 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T05:11:44.978 DEBUG:teuthology.orchestra.run.smithi192:> curl http://smithi192.front.sepia.ceph.com:80/ 2024-09-10T05:11:45.002 INFO:teuthology.orchestra.run.smithi192.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:11:45.002 INFO:teuthology.orchestra.run.smithi192.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:11:45.004 INFO:teuthology.orchestra.run.smithi192.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-10T05:11:45.004 INFO:teuthology.orchestra.run.smithi192.stdout:anonymous 2024-09-10T05:11:45.005 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-10T05:11:45.088 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-10T05:11:45.088 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-10T05:11:45.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-10T05:11:45.088 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-10T05:11:45.137 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:45.137 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:45.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.136+0000 7fbf2d92e800 1 Processor -- start 2024-09-10T05:11:45.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.137+0000 7fbf2d92e800 1 -- start start 2024-09-10T05:11:45.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.137+0000 7fbf2d92e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x561d196a61f0 0x561d196abd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.137+0000 7fbf2d92e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d1954fe40 con 0x561d196a4de0 2024-09-10T05:11:45.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.137+0000 7fbf2d92e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x561d1951a680 con 0x561d196a61f0 2024-09-10T05:11:45.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.137+0000 7fbf28d6a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x561d196a61f0 0x561d196abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.137+0000 7fbf28d6a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x561d196a61f0 0x561d196abd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58618/0 (socket says 172.21.15.192:58618) 2024-09-10T05:11:45.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.137+0000 7fbf2956b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x561d196a4de0 0x561d196a5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36114/0 (socket says 172.21.15.192:36114) 2024-09-10T05:11:45.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.137+0000 7fbf28d6a640 1 -- 172.21.15.192:0/1641130164 learned_addr learned my addr 172.21.15.192:0/1641130164 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.138+0000 7fbf28d6a640 1 -- 172.21.15.192:0/1641130164 >> v1:172.21.15.139:6789/0 conn(0x561d196a4de0 legacy=0x561d196a5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.138+0000 7fbf1bfff640 1 -- 172.21.15.192:0/1641130164 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 769136794 0 0) 0x561d1954fe40 con 0x561d196a4de0 2024-09-10T05:11:45.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.138+0000 7fbf28d6a640 1 -- 172.21.15.192:0/1641130164 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d195366b0 con 0x561d196a61f0 2024-09-10T05:11:45.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.140+0000 7fbf28d6a640 1 --2- 172.21.15.192:0/1641130164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a61f0 0x561d196abd90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000a520 tx=0x7fbf20045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf0d891c674724a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.140+0000 7fbf1bfff640 1 -- 172.21.15.192:0/1641130164 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf20055070 con 0x561d196a61f0 2024-09-10T05:11:45.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.140+0000 7fbf1bfff640 1 -- 172.21.15.192:0/1641130164 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf200515b0 con 0x561d196a61f0 2024-09-10T05:11:45.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.140+0000 7fbf1bfff640 1 -- 172.21.15.192:0/1641130164 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf200518d0 con 0x561d196a61f0 2024-09-10T05:11:45.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.140+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1641130164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a61f0 msgr2=0x561d196abd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.140+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/1641130164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a61f0 0x561d196abd90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000a520 tx=0x7fbf20045ba0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.140+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1641130164 shutdown_connections 2024-09-10T05:11:45.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.140+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/1641130164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a61f0 0x561d196abd90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.140+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1641130164 >> 172.21.15.192:0/1641130164 conn(0x561d196a01b0 msgr2=0x561d196a2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.140+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1641130164 shutdown_connections 2024-09-10T05:11:45.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.140+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1641130164 wait complete. 2024-09-10T05:11:45.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.156+0000 7fbf2d92e800 1 Processor -- start 2024-09-10T05:11:45.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.156+0000 7fbf2d92e800 1 -- start start 2024-09-10T05:11:45.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.156+0000 7fbf2d92e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 0x561d19794340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.156+0000 7fbf2d92e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561d1953edd0 con 0x561d196a4de0 2024-09-10T05:11:45.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.156+0000 7fbf2956b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 0x561d19794340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.156+0000 7fbf2956b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 0x561d19794340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58626/0 (socket says 172.21.15.192:58626) 2024-09-10T05:11:45.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.156+0000 7fbf2956b640 1 -- 172.21.15.192:0/3912708937 learned_addr learned my addr 172.21.15.192:0/3912708937 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.157+0000 7fbf2956b640 1 -- 172.21.15.192:0/3912708937 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d19557e10 con 0x561d196a4de0 2024-09-10T05:11:45.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.157+0000 7fbf2956b640 1 --2- 172.21.15.192:0/3912708937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 0x561d19794340 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c006fa0 tx=0x7fbf1c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57954b6bb6c171a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.157+0000 7fbe17606640 1 -- 172.21.15.192:0/3912708937 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf1c003450 con 0x561d196a4de0 2024-09-10T05:11:45.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.157+0000 7fbe17606640 1 -- 172.21.15.192:0/3912708937 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c003610 con 0x561d196a4de0 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.157+0000 7fbe17606640 1 -- 172.21.15.192:0/3912708937 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf1c003970 con 0x561d196a4de0 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.158+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3912708937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 msgr2=0x561d19794340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.158+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/3912708937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 0x561d19794340 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c006fa0 tx=0x7fbf1c001b00 comp rx=0 tx=0).stop 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.158+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3912708937 shutdown_connections 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.158+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/3912708937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 0x561d19794340 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.158+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3912708937 >> 172.21.15.192:0/3912708937 conn(0x561d196a01b0 msgr2=0x561d1978fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.158+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3912708937 shutdown_connections 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.158+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3912708937 wait complete. 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.158+0000 7fbf2d92e800 1 Processor -- start 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.158+0000 7fbf2d92e800 1 -- start start 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.158+0000 7fbf2d92e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 0x561d1979bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.158+0000 7fbf2d92e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561d196a68e0 con 0x561d196a4de0 2024-09-10T05:11:45.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.159+0000 7fbf2956b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 0x561d1979bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.159+0000 7fbf2956b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 0x561d1979bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58632/0 (socket says 172.21.15.192:58632) 2024-09-10T05:11:45.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.159+0000 7fbf2956b640 1 -- 172.21.15.192:0/3945645910 learned_addr learned my addr 172.21.15.192:0/3945645910 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.159+0000 7fbf2956b640 1 -- 172.21.15.192:0/3945645910 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d1979c230 con 0x561d196a4de0 2024-09-10T05:11:45.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.159+0000 7fbf2956b640 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 0x561d1979bcd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c001330 tx=0x7fbf1c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.159+0000 7fbe15e03640 1 -- 172.21.15.192:0/3945645910 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf1c014990 con 0x561d196a4de0 2024-09-10T05:11:45.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.159+0000 7fbe15e03640 1 -- 172.21.15.192:0/3945645910 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c014b30 con 0x561d196a4de0 2024-09-10T05:11:45.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.159+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d1979c4c0 con 0x561d196a4de0 2024-09-10T05:11:45.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.159+0000 7fbe15e03640 1 -- 172.21.15.192:0/3945645910 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf1c014e10 con 0x561d196a4de0 2024-09-10T05:11:45.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.159+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d1979cec0 con 0x561d196a4de0 2024-09-10T05:11:45.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.160+0000 7fbe15e03640 1 -- 172.21.15.192:0/3945645910 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbf1c010070 con 0x561d196a4de0 2024-09-10T05:11:45.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.161+0000 7fbe15e03640 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbe1003c780 0x7fbe1003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.161+0000 7fbe15e03640 1 -- 172.21.15.192:0/3945645910 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fbf1c021030 con 0x561d196a4de0 2024-09-10T05:11:45.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.161+0000 7fbf28d6a640 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbe1003c780 0x7fbe1003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.161+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561d196a61f0 0x561d197a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.161+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197a2410 con 0x561d196a61f0 2024-09-10T05:11:45.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.161+0000 7fbf29d6c640 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561d196a61f0 0x561d197a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.161+0000 7fbf28d6a640 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbe1003c780 0x7fbe1003ec40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf20057000 tx=0x7fbf20052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.161+0000 7fbf29d6c640 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561d196a61f0 0x561d197a1ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.162+0000 7fbf29d6c640 1 -- 172.21.15.192:0/3945645910 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf240083e0 con 0x561d196a61f0 2024-09-10T05:11:45.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.162+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d1979d1b0 con 0x561d196a61f0 2024-09-10T05:11:45.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.162+0000 7fbf29d6c640 1 -- 172.21.15.192:0/3945645910 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf240083e0 con 0x561d196a61f0 2024-09-10T05:11:45.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.162+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561d197a46f0 0x561d197a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.162+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197a71b0 con 0x561d197a46f0 2024-09-10T05:11:45.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.162+0000 7fbf2956b640 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561d197a46f0 0x561d197a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.163+0000 7fbf2956b640 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561d197a46f0 0x561d197a6ae0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.163+0000 7fbf2956b640 1 -- 172.21.15.192:0/3945645910 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbf1c00f030 con 0x561d197a46f0 2024-09-10T05:11:45.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.163+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197a3590 con 0x561d196a61f0 2024-09-10T05:11:45.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.163+0000 7fbf29d6c640 1 -- 172.21.15.192:0/3945645910 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf240083e0 con 0x561d196a61f0 2024-09-10T05:11:45.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.163+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561d197a85f0 0x561d197aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.163+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197ab170 con 0x561d197a85f0 2024-09-10T05:11:45.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.164+0000 7fbf28d6a640 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561d197a85f0 0x561d197aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.164+0000 7fbf28d6a640 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561d197a85f0 0x561d197aa9e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.164+0000 7fbf28d6a640 1 -- 172.21.15.192:0/3945645910 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbf20057030 con 0x561d197a85f0 2024-09-10T05:11:45.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.165+0000 7fbf2d92e800 1 Processor -- start 2024-09-10T05:11:45.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.165+0000 7fbf2d92e800 1 -- start start 2024-09-10T05:11:45.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.165+0000 7fbf2d92e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197bd1a0 0x561d197bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.165+0000 7fbf2d92e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561d1959ca00 con 0x561d197bd1a0 2024-09-10T05:11:45.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.165+0000 7fbf2956b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197bd1a0 0x561d197bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.165+0000 7fbf2956b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197bd1a0 0x561d197bd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58648/0 (socket says 172.21.15.192:58648) 2024-09-10T05:11:45.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.165+0000 7fbf2956b640 1 -- 172.21.15.192:0/1678057754 learned_addr learned my addr 172.21.15.192:0/1678057754 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.165+0000 7fbf2956b640 1 -- 172.21.15.192:0/1678057754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d197bdc00 con 0x561d197bd1a0 2024-09-10T05:11:45.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.165+0000 7fbf2956b640 1 --2- 172.21.15.192:0/1678057754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197bd1a0 0x561d197bd5c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c012fd0 tx=0x7fbf1c010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.166+0000 7fbe0effd640 1 -- 172.21.15.192:0/1678057754 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf1c04f230 con 0x561d197bd1a0 2024-09-10T05:11:45.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.166+0000 7fbe0effd640 1 -- 172.21.15.192:0/1678057754 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c052040 con 0x561d197bd1a0 2024-09-10T05:11:45.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.166+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1678057754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d197be430 con 0x561d197bd1a0 2024-09-10T05:11:45.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.166+0000 7fbe0effd640 1 -- 172.21.15.192:0/1678057754 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf1c019940 con 0x561d197bd1a0 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.166+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1678057754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d197be9d0 con 0x561d197bd1a0 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.167+0000 7fbe0effd640 1 -- 172.21.15.192:0/1678057754 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbf1c019ae0 con 0x561d197bd1a0 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.167+0000 7fbe0effd640 1 --2- 172.21.15.192:0/1678057754 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbe0003c730 0x7fbe0003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.167+0000 7fbe0effd640 1 -- 172.21.15.192:0/1678057754 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fbf1c018040 con 0x561d197bd1a0 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.167+0000 7fbf28d6a640 1 --2- 172.21.15.192:0/1678057754 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbe0003c730 0x7fbe0003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.167+0000 7fbf2d92e800 1 Processor -- start 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.167+0000 7fbf2d92e800 1 -- start start 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.167+0000 7fbf28d6a640 1 --2- 172.21.15.192:0/1678057754 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbe0003c730 0x7fbe0003ebf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x561d197ab570 tx=0x7fbf20005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.167+0000 7fbf2d92e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 0x561d197c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.167+0000 7fbf2d92e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561d19794b90 con 0x561d197c9be0 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.168+0000 7fbf2956b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 0x561d197c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.168+0000 7fbf2956b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 0x561d197c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58650/0 (socket says 172.21.15.192:58650) 2024-09-10T05:11:45.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.168+0000 7fbf2956b640 1 -- 172.21.15.192:0/1253715037 learned_addr learned my addr 172.21.15.192:0/1253715037 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.168+0000 7fbf2956b640 1 -- 172.21.15.192:0/1253715037 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d197ca5d0 con 0x561d197c9be0 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.168+0000 7fbf2956b640 1 --2- 172.21.15.192:0/1253715037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 0x561d197c9fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c011c90 tx=0x7fbf1c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6505d0512d495a48 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.168+0000 7fbe0cff9640 1 -- 172.21.15.192:0/1253715037 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf1c03d070 con 0x561d197c9be0 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.168+0000 7fbe0cff9640 1 -- 172.21.15.192:0/1253715037 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c025570 con 0x561d197c9be0 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.168+0000 7fbe0cff9640 1 -- 172.21.15.192:0/1253715037 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf1c039d90 con 0x561d197c9be0 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.169+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1253715037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 msgr2=0x561d197c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.169+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/1253715037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 0x561d197c9fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c011c90 tx=0x7fbf1c011aa0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.169+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1253715037 shutdown_connections 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.169+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/1253715037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 0x561d197c9fe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.169+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1253715037 >> 172.21.15.192:0/1253715037 conn(0x561d197c5fe0 msgr2=0x561d197c4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.169+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1253715037 shutdown_connections 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.169+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1253715037 wait complete. 2024-09-10T05:11:45.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.169+0000 7fbf2d92e800 1 Processor -- start 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.169+0000 7fbf2d92e800 1 -- start start 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.169+0000 7fbf2d92e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 0x561d197d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.169+0000 7fbf2d92e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561d197caa40 con 0x561d197c9be0 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.170+0000 7fbf2956b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 0x561d197d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.170+0000 7fbf2956b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 0x561d197d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58656/0 (socket says 172.21.15.192:58656) 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.170+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 learned_addr learned my addr 172.21.15.192:0/656795422 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.170+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d197d1510 con 0x561d197c9be0 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.170+0000 7fbf2956b640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 0x561d197d0fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c011ae0 tx=0x7fbf1c030230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.170+0000 7fbdfeffd640 1 -- 172.21.15.192:0/656795422 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf1c0521f0 con 0x561d197c9be0 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.170+0000 7fbdfeffd640 1 -- 172.21.15.192:0/656795422 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c062030 con 0x561d197c9be0 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.170+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d197d1510 con 0x561d197c9be0 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.170+0000 7fbdfeffd640 1 -- 172.21.15.192:0/656795422 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf1c01a660 con 0x561d197c9be0 2024-09-10T05:11:45.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.170+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d197d1510 con 0x561d197c9be0 2024-09-10T05:11:45.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.171+0000 7fbdfeffd640 1 -- 172.21.15.192:0/656795422 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbf1c01a800 con 0x561d197c9be0 2024-09-10T05:11:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.172+0000 7fbf2d92e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.172+0000 7fbdfeffd640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbdf403c730 0x7fbdf403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.172+0000 7fbdfeffd640 1 -- 172.21.15.192:0/656795422 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fbf1c068c60 con 0x561d197c9be0 2024-09-10T05:11:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.172+0000 7fbf28d6a640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbdf403c730 0x7fbdf403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.172+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561d197dc3f0 0x561d197de880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.172+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197defd0 con 0x561d197dc3f0 2024-09-10T05:11:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.172+0000 7fbf29d6c640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561d197dc3f0 0x561d197de880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.172+0000 7fbf28d6a640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbdf403c730 0x7fbdf403ebf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf20077040 tx=0x7fbf20053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.172+0000 7fbf29d6c640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561d197dc3f0 0x561d197de880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf240083e0 con 0x561d197dc3f0 2024-09-10T05:11:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 20 realm 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197df3e0 con 0x561d197dc3f0 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf240083e0 con 0x561d197dc3f0 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf240083e0 con 0x561d197dc3f0 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197e0050 con 0x561d197dc3f0 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf240083e0 con 0x561d197dc3f0 2024-09-10T05:11:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561d197e07a0 0x561d197e2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.173+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197e3320 con 0x561d197e07a0 2024-09-10T05:11:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.174+0000 7fbf2956b640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561d197e07a0 0x561d197e2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.174+0000 7fbf2956b640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561d197e07a0 0x561d197e2b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.174+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.174+0000 7fbf2d92e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.174+0000 7fbf2d92e800 20 searching for the correct realm 2024-09-10T05:11:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.174+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561d197e5410 0x561d197e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.174+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197e7fa0 con 0x561d197e5410 2024-09-10T05:11:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.175+0000 7fbf28d6a640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561d197e5410 0x561d197e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.175+0000 7fbf28d6a640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561d197e5410 0x561d197e78d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.175+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.175+0000 7fbf28d6a640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fbf20069040 0x7fbf2006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.175+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197e7fa0 con 0x7fbf20069040 2024-09-10T05:11:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.175+0000 7fbf29d6c640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fbf20069040 0x7fbf2006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.176+0000 7fbf29d6c640 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fbf20069040 0x7fbf2006a940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.176+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbf240083e0 con 0x7fbf20069040 2024-09-10T05:11:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.176+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e07a0 2024-09-10T05:11:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.176+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.176+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.177+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf240083e0 con 0x561d197dc3f0 2024-09-10T05:11:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.177+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.177+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.177+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e07a0 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.177+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.177+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e07a0 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.177+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.177+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x7fbf20069040 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.178+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.178+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e5410 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.178+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.178+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.178+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.178+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e07a0 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.179+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.179+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.179+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.179+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x7fbf20069040 2024-09-10T05:11:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.179+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.179+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e5410 2024-09-10T05:11:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.179+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.179+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e5410 2024-09-10T05:11:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.180+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.180+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e07a0 2024-09-10T05:11:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.180+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.180+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e5410 2024-09-10T05:11:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.180+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.180+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e5410 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.180+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.180+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.181+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.181+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.181+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.181+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e07a0 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.181+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.181+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e5410 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.182+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.182+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x7fbf20069040 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.182+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.182+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.182+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.182+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e07a0 2024-09-10T05:11:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.182+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.182+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e5410 2024-09-10T05:11:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.183+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.183+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e07a0 2024-09-10T05:11:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.183+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.183+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x7fbf20069040 2024-09-10T05:11:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.183+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.183+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e5410 2024-09-10T05:11:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.184+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.184+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e07a0 2024-09-10T05:11:45.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.184+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.184+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.184+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.184+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x7fbf20069040 2024-09-10T05:11:45.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:45.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:45.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:45.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:45.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:45.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:45.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197e3cd0 con 0x561d197dc3f0 2024-09-10T05:11:45.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197e3cd0 con 0x561d197dc3f0 2024-09-10T05:11:45.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:45.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197e3ca0 con 0x7fbf20069040 2024-09-10T05:11:45.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:45.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 zone default found 2024-09-10T05:11:45.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 4 Realm: () 2024-09-10T05:11:45.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:45.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:45.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 zonegroup default 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.185+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197e40c0 con 0x561d197e07a0 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf2d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf2d92e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197e3c00 con 0x561d197e5410 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf2d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf2d92e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197e9e10 con 0x561d197e5410 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf2d92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf2d92e800 20 started sync module instance, tier type = 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf2d92e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.186+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197e92b0 con 0x7fbf20069040 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.187+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.187+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94682981767088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197e92b0 con 0x7fbf20069040 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.187+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197ea8e0 con 0x561d197dc3f0 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.189+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94682981767088] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.189+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.189+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94682981770192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197e92b0 con 0x561d197dc3f0 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.189+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197eb370 con 0x561d197e5410 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.190+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94682981770192] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.190+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.190+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94682981764608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197e9220 con 0x561d197e5410 2024-09-10T05:11:45.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.190+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197ec230 con 0x7fbf20069040 2024-09-10T05:11:45.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.191+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94682981764608] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.192+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.192+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94682981776768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197ec650 con 0x7fbf20069040 2024-09-10T05:11:45.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.192+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197ed010 con 0x561d197dc3f0 2024-09-10T05:11:45.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.194+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94682981776768] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.197+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.197+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94682981778304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197ed010 con 0x561d197dc3f0 2024-09-10T05:11:45.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.197+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197ed9d0 con 0x561d197e07a0 2024-09-10T05:11:45.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.198+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94682981778304] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.198+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.198+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94682981780320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197ecf80 con 0x561d197e07a0 2024-09-10T05:11:45.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.198+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e07a0 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.200+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94682981780320] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.200+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.200+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94682981785424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197eefa0 con 0x561d197e07a0 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.200+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197ef960 con 0x561d197e07a0 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.201+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.201+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94682981790896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197efd80 con 0x561d197e07a0 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.201+0000 7fbf2d92e800 20 add_watcher() i=0 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.201+0000 7fbf2d92e800 20 add_watcher() i=1 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.201+0000 7fbf2d92e800 20 add_watcher() i=2 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.201+0000 7fbf2d92e800 20 add_watcher() i=3 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.201+0000 7fbf2d92e800 20 add_watcher() i=4 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.201+0000 7fbf2d92e800 20 add_watcher() i=5 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.202+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94682981790896] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.203+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(57 notify.6 [watch watch cookie 94682981785424] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.203+0000 7fbf2d92e800 20 add_watcher() i=6 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.203+0000 7fbf2d92e800 20 add_watcher() i=7 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.203+0000 7fbf2d92e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.203+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561d197efd80 con 0x561d197dc3f0 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.203+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.203+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94682981791952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197efd20 con 0x561d197dc3f0 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.204+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94682981791952] v35'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.204+0000 7fbddffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.205+0000 7fbf2d92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.205+0000 7fbf2d92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.205+0000 7fbf2d92e800 5 note: GC not initialized 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.205+0000 7fbddefe5640 20 reqs_thread_entry: start 2024-09-10T05:11:45.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.205+0000 7fbf2d92e800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.205+0000 7fbf2d92e800 20 Filter name: none 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.205+0000 7fbddcfe1640 20 reqs_thread_entry: start 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.205+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d198256f0 con 0x561d197e5410 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.205+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(62 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.205+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d198256f0 con 0x561d197e5410 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.206+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(63 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.206+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d198256f0 con 0x561d197dc3f0 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.206+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(64 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.206+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.206+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.206+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x7fbf20069040 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.206+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(66 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.206+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e5410 2024-09-10T05:11:45.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.207+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(67 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.207+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.207+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.207+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e5410 2024-09-10T05:11:45.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.207+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(69 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.207+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x7fbf20069040 2024-09-10T05:11:45.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.207+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(70 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.207+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e5410 2024-09-10T05:11:45.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.208+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(71 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.208+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.208+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(72 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.208+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e07a0 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.208+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.208+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e07a0 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.208+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(74 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.208+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e5410 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.209+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(75 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.209+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e07a0 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.209+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(76 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.209+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e07a0 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.209+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(77 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.209+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e07a0 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.209+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(78 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.209+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e5410 2024-09-10T05:11:45.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.210+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(79 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.210+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x7fbf20069040 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.210+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(80 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.210+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197dc3f0 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.210+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(81 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.210+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197dc3f0 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.210+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(82 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.210+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e5410 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.211+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(83 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.211+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x7fbf20069040 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.211+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(84 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.211+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e07a0 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.211+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(85 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.211+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197dc3f0 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.211+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(86 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.211+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e07a0 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.212+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(87 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.212+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e5410 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.212+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(88 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.212+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x7fbf20069040 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.213+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(89 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.213+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e07a0 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.213+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(90 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.213+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197dc3f0 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.213+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(91 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.213+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x561d197e5410 2024-09-10T05:11:45.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.213+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(92 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.213+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561d197ee750 con 0x7fbf20069040 2024-09-10T05:11:45.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.214+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(93 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.214+0000 7fbddffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:45.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.214+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94682981791952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.215+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94682981791952] v35'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.215+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94682981767088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x7fbf20069040 2024-09-10T05:11:45.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.216+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94682981767088] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.216+0000 7fbf2d92e800 20 remove_watcher() i=0 2024-09-10T05:11:45.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.216+0000 7fbf2d92e800 2 removed watcher, disabling cache 2024-09-10T05:11:45.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.216+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94682981770192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197dc3f0 2024-09-10T05:11:45.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.218+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94682981770192] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.218+0000 7fbf2d92e800 20 remove_watcher() i=1 2024-09-10T05:11:45.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.218+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94682981764608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197dfcb0 con 0x561d197e5410 2024-09-10T05:11:45.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.219+0000 7fbf28d6a640 1 -- 172.21.15.192:0/656795422 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94682981764608] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf20057030 con 0x561d197e5410 2024-09-10T05:11:45.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.219+0000 7fbf2d92e800 20 remove_watcher() i=2 2024-09-10T05:11:45.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.219+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94682981776768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197e97b0 con 0x7fbf20069040 2024-09-10T05:11:45.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.221+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94682981776768] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x7fbf20069040 2024-09-10T05:11:45.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.221+0000 7fbf2d92e800 20 remove_watcher() i=3 2024-09-10T05:11:45.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.221+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94682981778304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197e8e00 con 0x561d197dc3f0 2024-09-10T05:11:45.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.222+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94682981778304] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf24026040 con 0x561d197dc3f0 2024-09-10T05:11:45.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.222+0000 7fbf2d92e800 20 remove_watcher() i=4 2024-09-10T05:11:45.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.222+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94682981780320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197ebd80 con 0x561d197e07a0 2024-09-10T05:11:45.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.223+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94682981780320] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.223+0000 7fbf2d92e800 20 remove_watcher() i=5 2024-09-10T05:11:45.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.223+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94682981785424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197e97b0 con 0x561d197e07a0 2024-09-10T05:11:45.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.224+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94682981785424] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.224+0000 7fbf2d92e800 20 remove_watcher() i=6 2024-09-10T05:11:45.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.224+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94682981790896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561d197ec380 con 0x561d197e07a0 2024-09-10T05:11:45.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2956b640 1 -- 172.21.15.192:0/656795422 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94682981790896] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1c06e070 con 0x561d197e07a0 2024-09-10T05:11:45.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 20 remove_watcher() i=7 2024-09-10T05:11:45.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561d197e07a0 msgr2=0x561d197e2b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561d197e07a0 0x561d197e2b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561d197dc3f0 msgr2=0x561d197de880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561d197dc3f0 0x561d197de880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fbf20069040 msgr2=0x7fbf2006a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fbf20069040 0x7fbf2006a940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561d197e5410 msgr2=0x561d197e78d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561d197e5410 0x561d197e78d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbdf403c730 msgr2=0x7fbdf403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbdf403c730 0x7fbdf403ebf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf20077040 tx=0x7fbf20053000 comp rx=0 tx=0).stop 2024-09-10T05:11:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 msgr2=0x561d197d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/656795422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197c9be0 0x561d197d0fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c011ae0 tx=0x7fbf1c030230 comp rx=0 tx=0).stop 2024-09-10T05:11:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 reap_dead start 2024-09-10T05:11:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf29d6c640 1 -- 172.21.15.192:0/656795422 reap_dead start 2024-09-10T05:11:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 shutdown_connections 2024-09-10T05:11:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 >> 172.21.15.192:0/656795422 conn(0x561d197c5fe0 msgr2=0x561d197c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 shutdown_connections 2024-09-10T05:11:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/656795422 wait complete. 2024-09-10T05:11:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1678057754 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbe0003c730 msgr2=0x7fbe0003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/1678057754 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbe0003c730 0x7fbe0003ebf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x561d197ab570 tx=0x7fbf20005ac0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1678057754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197bd1a0 msgr2=0x561d197bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/1678057754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197bd1a0 0x561d197bd5c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c012fd0 tx=0x7fbf1c010910 comp rx=0 tx=0).stop 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.225+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1678057754 shutdown_connections 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/1678057754 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbe0003c730 0x7fbe0003ebf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/1678057754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d197bd1a0 0x561d197bd5c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1678057754 >> 172.21.15.192:0/1678057754 conn(0x561d197ad140 msgr2=0x561d197ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1678057754 shutdown_connections 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 -- 172.21.15.192:0/1678057754 wait complete. 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561d197a46f0 msgr2=0x561d197a6ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561d197a46f0 0x561d197a6ae0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561d196a61f0 msgr2=0x561d197a1ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561d196a61f0 0x561d197a1ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561d197a85f0 msgr2=0x561d197aa9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561d197a85f0 0x561d197aa9e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbe1003c780 msgr2=0x7fbe1003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbe1003c780 0x7fbe1003ec40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf20057000 tx=0x7fbf20052000 comp rx=0 tx=0).stop 2024-09-10T05:11:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 msgr2=0x561d1979bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 --2- 172.21.15.192:0/3945645910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561d196a4de0 0x561d1979bcd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c001330 tx=0x7fbf1c001250 comp rx=0 tx=0).stop 2024-09-10T05:11:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf29d6c640 1 -- 172.21.15.192:0/3945645910 reap_dead start 2024-09-10T05:11:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 shutdown_connections 2024-09-10T05:11:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 >> 172.21.15.192:0/3945645910 conn(0x561d196a01b0 msgr2=0x561d19795620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 shutdown_connections 2024-09-10T05:11:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.226+0000 7fbf2d92e800 1 -- 172.21.15.192:0/3945645910 wait complete. 2024-09-10T05:11:45.236 INFO:teuthology.orchestra.run.smithi192.stdout:[] 2024-09-10T05:11:45.237 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T05:11:45.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-10T05:11:45.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-10T05:11:45.237 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-10T05:11:45.282 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:45.282 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:45.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.281+0000 7f13f59a9800 1 Processor -- start 2024-09-10T05:11:45.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.281+0000 7f13f59a9800 1 -- start start 2024-09-10T05:11:45.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.282+0000 7f13f59a9800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55e2b4853680 0x55e2b4855a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.282+0000 7f13f59a9800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e2b46fce40 con 0x55e2b4856010 2024-09-10T05:11:45.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.282+0000 7f13f59a9800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55e2b46c7680 con 0x55e2b4853680 2024-09-10T05:11:45.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.282+0000 7f13f3493640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55e2b4853680 0x55e2b4855a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.282+0000 7f13f2c92640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55e2b4856010 0x55e2b48584d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36128/0 (socket says 172.21.15.192:36128) 2024-09-10T05:11:45.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.282+0000 7f13f2c92640 1 -- 172.21.15.192:0/722529626 learned_addr learned my addr 172.21.15.192:0/722529626 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:45.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.282+0000 7f13f3493640 1 -- 172.21.15.192:0/722529626 >> v1:172.21.15.139:6789/0 conn(0x55e2b4856010 legacy=0x55e2b48584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.282+0000 7f13f3493640 1 -- 172.21.15.192:0/722529626 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b46e36b0 con 0x55e2b4853680 2024-09-10T05:11:45.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.284+0000 7f13f3493640 1 --2- 172.21.15.192:0/722529626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4853680 0x55e2b4855a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f13e400a470 tx=0x7f13e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255de0b65720c03c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.284+0000 7f13f2491640 1 -- 172.21.15.192:0/722529626 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e4053570 con 0x55e2b4853680 2024-09-10T05:11:45.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.284+0000 7f13f2491640 1 -- 172.21.15.192:0/722529626 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e4058070 con 0x55e2b4853680 2024-09-10T05:11:45.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.284+0000 7f13f2491640 1 -- 172.21.15.192:0/722529626 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e4053880 con 0x55e2b4853680 2024-09-10T05:11:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.285+0000 7f13f59a9800 1 -- 172.21.15.192:0/722529626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4853680 msgr2=0x55e2b4855a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.285+0000 7f13f59a9800 1 --2- 172.21.15.192:0/722529626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4853680 0x55e2b4855a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f13e400a470 tx=0x7f13e4045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.285+0000 7f13f59a9800 1 -- 172.21.15.192:0/722529626 shutdown_connections 2024-09-10T05:11:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.285+0000 7f13f59a9800 1 --2- 172.21.15.192:0/722529626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4853680 0x55e2b4855a70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.285+0000 7f13f59a9800 1 -- 172.21.15.192:0/722529626 >> 172.21.15.192:0/722529626 conn(0x55e2b484d1c0 msgr2=0x55e2b484f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.285+0000 7f13f59a9800 1 -- 172.21.15.192:0/722529626 shutdown_connections 2024-09-10T05:11:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.285+0000 7f13f59a9800 1 -- 172.21.15.192:0/722529626 wait complete. 2024-09-10T05:11:45.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.298+0000 7f13f59a9800 1 Processor -- start 2024-09-10T05:11:45.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.299+0000 7f13f59a9800 1 -- start start 2024-09-10T05:11:45.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.299+0000 7f13f59a9800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4853680 0x55e2b4852e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.299+0000 7f13f59a9800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e2b46ebdd0 con 0x55e2b4853680 2024-09-10T05:11:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.299+0000 7f13f3493640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4853680 0x55e2b4852e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.299+0000 7f13f3493640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4853680 0x55e2b4852e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58676/0 (socket says 172.21.15.192:58676) 2024-09-10T05:11:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.299+0000 7f13f3493640 1 -- 172.21.15.192:0/2776983337 learned_addr learned my addr 172.21.15.192:0/2776983337 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.299+0000 7f13f3493640 1 -- 172.21.15.192:0/2776983337 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b4704e10 con 0x55e2b4853680 2024-09-10T05:11:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.299+0000 7f13f3493640 1 --2- 172.21.15.192:0/2776983337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4853680 0x55e2b4852e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f13e4025c20 tx=0x7f13e4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332bee6345b08b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.300+0000 7f12e160a640 1 -- 172.21.15.192:0/2776983337 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e4053a20 con 0x55e2b4853680 2024-09-10T05:11:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.300+0000 7f12e160a640 1 -- 172.21.15.192:0/2776983337 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e4063070 con 0x55e2b4853680 2024-09-10T05:11:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.300+0000 7f12e160a640 1 -- 172.21.15.192:0/2776983337 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e4053cf0 con 0x55e2b4853680 2024-09-10T05:11:45.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.300+0000 7f13f59a9800 1 -- 172.21.15.192:0/2776983337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4853680 msgr2=0x55e2b4852e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.300+0000 7f13f59a9800 1 --2- 172.21.15.192:0/2776983337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4853680 0x55e2b4852e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f13e4025c20 tx=0x7f13e4051000 comp rx=0 tx=0).stop 2024-09-10T05:11:45.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.300+0000 7f13f59a9800 1 -- 172.21.15.192:0/2776983337 shutdown_connections 2024-09-10T05:11:45.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.300+0000 7f13f59a9800 1 --2- 172.21.15.192:0/2776983337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4853680 0x55e2b4852e10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.300+0000 7f13f59a9800 1 -- 172.21.15.192:0/2776983337 >> 172.21.15.192:0/2776983337 conn(0x55e2b484d1c0 msgr2=0x55e2b493e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.300+0000 7f13f59a9800 1 -- 172.21.15.192:0/2776983337 shutdown_connections 2024-09-10T05:11:45.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.300+0000 7f13f59a9800 1 -- 172.21.15.192:0/2776983337 wait complete. 2024-09-10T05:11:45.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.301+0000 7f13f59a9800 1 Processor -- start 2024-09-10T05:11:45.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.301+0000 7f13f59a9800 1 -- start start 2024-09-10T05:11:45.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.301+0000 7f13f59a9800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4856010 0x55e2b494c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.301+0000 7f13f59a9800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e2b485a030 con 0x55e2b4856010 2024-09-10T05:11:45.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.301+0000 7f13f3493640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4856010 0x55e2b494c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.301+0000 7f13f3493640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4856010 0x55e2b494c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58688/0 (socket says 172.21.15.192:58688) 2024-09-10T05:11:45.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.301+0000 7f13f3493640 1 -- 172.21.15.192:0/2565846145 learned_addr learned my addr 172.21.15.192:0/2565846145 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.302+0000 7f13f3493640 1 -- 172.21.15.192:0/2565846145 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b494c920 con 0x55e2b4856010 2024-09-10T05:11:45.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.302+0000 7f13f3493640 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4856010 0x55e2b494c3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f13e4025c20 tx=0x7f13e4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.302+0000 7f12dfe07640 1 -- 172.21.15.192:0/2565846145 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e40745b0 con 0x55e2b4856010 2024-09-10T05:11:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.302+0000 7f12dfe07640 1 -- 172.21.15.192:0/2565846145 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e4074750 con 0x55e2b4856010 2024-09-10T05:11:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.302+0000 7f12dfe07640 1 -- 172.21.15.192:0/2565846145 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e4074a30 con 0x55e2b4856010 2024-09-10T05:11:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.302+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2b494cbb0 con 0x55e2b4856010 2024-09-10T05:11:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.302+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2b494d7c0 con 0x55e2b4856010 2024-09-10T05:11:45.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.303+0000 7f12dfe07640 1 -- 172.21.15.192:0/2565846145 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f13e4074bd0 con 0x55e2b4856010 2024-09-10T05:11:45.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.303+0000 7f12dfe07640 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12d803c730 0x7f12d803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.303+0000 7f12dfe07640 1 -- 172.21.15.192:0/2565846145 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f13e4098190 con 0x55e2b4856010 2024-09-10T05:11:45.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.303+0000 7f13f2c92640 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12d803c730 0x7f12d803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.303+0000 7f13f59a9800 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e2b4951a00 0x55e2b4953df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.303+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4954330 con 0x55e2b4951a00 2024-09-10T05:11:45.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.304+0000 7f13f3c94640 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e2b4951a00 0x55e2b4953df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.304+0000 7f13f2c92640 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12d803c730 0x7f12d803ebf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f13dc001d70 tx=0x7f13dc0012d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.304+0000 7f13f3c94640 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e2b4951a00 0x55e2b4953df0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.304+0000 7f13f3c94640 1 -- 172.21.15.192:0/2565846145 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4951a00 2024-09-10T05:11:45.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.304+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49546d0 con 0x55e2b4951a00 2024-09-10T05:11:45.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.304+0000 7f13f3c94640 1 -- 172.21.15.192:0/2565846145 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4951a00 2024-09-10T05:11:45.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.304+0000 7f13f59a9800 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e2b49561d0 0x55e2b4958670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.304+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4958e00 con 0x55e2b49561d0 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.305+0000 7f13f3493640 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e2b49561d0 0x55e2b4958670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.305+0000 7f13f3493640 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e2b49561d0 0x55e2b4958670 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.305+0000 7f13f3493640 1 -- 172.21.15.192:0/2565846145 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f13e4051070 con 0x55e2b49561d0 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.305+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4954f20 con 0x55e2b4951a00 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.306+0000 7f13f3c94640 1 -- 172.21.15.192:0/2565846145 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4951a00 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.306+0000 7f13f59a9800 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e2b495a260 0x55e2b495c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.306+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b495cdc0 con 0x55e2b495a260 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.306+0000 7f13f2c92640 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e2b495a260 0x55e2b495c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.306+0000 7f13f2c92640 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e2b495a260 0x55e2b495c650 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.306+0000 7f13f2c92640 1 -- 172.21.15.192:0/2565846145 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b495a260 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.306+0000 7f13f59a9800 1 Processor -- start 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.307+0000 7f13f59a9800 1 -- start start 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.307+0000 7f13f59a9800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b496aa20 0x55e2b496ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.307+0000 7f13f59a9800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e2b4749a00 con 0x55e2b496aa20 2024-09-10T05:11:45.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.307+0000 7f13f3493640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b496aa20 0x55e2b496ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.307+0000 7f13f3493640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b496aa20 0x55e2b496ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58696/0 (socket says 172.21.15.192:58696) 2024-09-10T05:11:45.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.307+0000 7f13f3493640 1 -- 172.21.15.192:0/1683520671 learned_addr learned my addr 172.21.15.192:0/1683520671 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.307+0000 7f13f3493640 1 -- 172.21.15.192:0/1683520671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b496b480 con 0x55e2b496aa20 2024-09-10T05:11:45.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.307+0000 7f13f3493640 1 --2- 172.21.15.192:0/1683520671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b496aa20 0x55e2b496ae40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13e405db10 tx=0x7f13e405da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.308+0000 7f12dd602640 1 -- 172.21.15.192:0/1683520671 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e408b070 con 0x55e2b496aa20 2024-09-10T05:11:45.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.308+0000 7f12dd602640 1 -- 172.21.15.192:0/1683520671 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e4090b20 con 0x55e2b496aa20 2024-09-10T05:11:45.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.308+0000 7f13f59a9800 1 -- 172.21.15.192:0/1683520671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2b496bcb0 con 0x55e2b496aa20 2024-09-10T05:11:45.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.308+0000 7f12dd602640 1 -- 172.21.15.192:0/1683520671 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e4090e00 con 0x55e2b496aa20 2024-09-10T05:11:45.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.308+0000 7f13f59a9800 1 -- 172.21.15.192:0/1683520671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2b496c250 con 0x55e2b496aa20 2024-09-10T05:11:45.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.308+0000 7f12dd602640 1 -- 172.21.15.192:0/1683520671 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f13e408e070 con 0x55e2b496aa20 2024-09-10T05:11:45.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.309+0000 7f12dd602640 1 --2- 172.21.15.192:0/1683520671 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12cc03c780 0x7f12cc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.309+0000 7f12dd602640 1 -- 172.21.15.192:0/1683520671 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f13e40073e0 con 0x55e2b496aa20 2024-09-10T05:11:45.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.309+0000 7f13f2c92640 1 --2- 172.21.15.192:0/1683520671 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12cc03c780 0x7f12cc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.309+0000 7f13f59a9800 1 Processor -- start 2024-09-10T05:11:45.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.309+0000 7f13f59a9800 1 -- start start 2024-09-10T05:11:45.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.309+0000 7f13f2c92640 1 --2- 172.21.15.192:0/1683520671 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12cc03c780 0x7f12cc03ec40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00bf40 tx=0x7f13dc00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.309+0000 7f13f59a9800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 0x55e2b49776a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.309+0000 7f13f59a9800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e2b48516b0 con 0x55e2b49772c0 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.310+0000 7f13f3493640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 0x55e2b49776a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.310+0000 7f13f3493640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 0x55e2b49776a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58708/0 (socket says 172.21.15.192:58708) 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.310+0000 7f13f3493640 1 -- 172.21.15.192:0/3744602199 learned_addr learned my addr 172.21.15.192:0/3744602199 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.310+0000 7f13f3493640 1 -- 172.21.15.192:0/3744602199 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b4977c90 con 0x55e2b49772c0 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.310+0000 7f13f3493640 1 --2- 172.21.15.192:0/3744602199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 0x55e2b49776a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13e405f780 tx=0x7f13e405efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c531a5516bdba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.310+0000 7f12d6ffd640 1 -- 172.21.15.192:0/3744602199 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e40ab020 con 0x55e2b49772c0 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.310+0000 7f12d6ffd640 1 -- 172.21.15.192:0/3744602199 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e405c410 con 0x55e2b49772c0 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.310+0000 7f12d6ffd640 1 -- 172.21.15.192:0/3744602199 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e40968f0 con 0x55e2b49772c0 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f59a9800 1 -- 172.21.15.192:0/3744602199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 msgr2=0x55e2b49776a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f59a9800 1 --2- 172.21.15.192:0/3744602199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 0x55e2b49776a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f13e405f780 tx=0x7f13e405efb0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f59a9800 1 -- 172.21.15.192:0/3744602199 shutdown_connections 2024-09-10T05:11:45.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f59a9800 1 --2- 172.21.15.192:0/3744602199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 0x55e2b49776a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f59a9800 1 -- 172.21.15.192:0/3744602199 >> 172.21.15.192:0/3744602199 conn(0x55e2b49736c0 msgr2=0x55e2b4971900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f59a9800 1 -- 172.21.15.192:0/3744602199 shutdown_connections 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f59a9800 1 -- 172.21.15.192:0/3744602199 wait complete. 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f59a9800 1 Processor -- start 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f59a9800 1 -- start start 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f59a9800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 0x55e2b497e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f59a9800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e2b4978120 con 0x55e2b49772c0 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f3493640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 0x55e2b497e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f3493640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 0x55e2b497e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58716/0 (socket says 172.21.15.192:58716) 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.311+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 learned_addr learned my addr 172.21.15.192:0/1623425460 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.312+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b497ebc0 con 0x55e2b49772c0 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.312+0000 7f13f3493640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 0x55e2b497e660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f13e405d830 tx=0x7f13e4062fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.312+0000 7f12d57fa640 1 -- 172.21.15.192:0/1623425460 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e40b6070 con 0x55e2b49772c0 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.312+0000 7f12d57fa640 1 -- 172.21.15.192:0/1623425460 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e405c630 con 0x55e2b49772c0 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.312+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2b497ebc0 con 0x55e2b49772c0 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.312+0000 7f12d57fa640 1 -- 172.21.15.192:0/1623425460 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13e40ab040 con 0x55e2b49772c0 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.312+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2b497ebc0 con 0x55e2b49772c0 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.313+0000 7f12d57fa640 1 -- 172.21.15.192:0/1623425460 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f13e40b9070 con 0x55e2b49772c0 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.313+0000 7f12d57fa640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12bc03c730 0x7f12bc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.313+0000 7f12d57fa640 1 -- 172.21.15.192:0/1623425460 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f13e40be120 con 0x55e2b49772c0 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.313+0000 7f13f2c92640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12bc03c730 0x7f12bc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.314+0000 7f13f59a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.314+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e2b4989c20 0x55e2b498c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.314+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498c830 con 0x55e2b4989c20 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.314+0000 7f13f3c94640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e2b4989c20 0x55e2b498c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.314+0000 7f13f2c92640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12bc03c730 0x7f12bc03ebf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c010 tx=0x7f13dc010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.314+0000 7f13f3c94640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e2b4989c20 0x55e2b498c0e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.314+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.314+0000 7f13f59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.314+0000 7f13f59a9800 20 realm 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.314+0000 7f13f59a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.314+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498cc40 con 0x55e2b4989c20 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f59a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f59a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d510 con 0x55e2b4989c20 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f59a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4989c20 2024-09-10T05:11:45.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f59a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:45.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f59a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e2b498e610 0x55e2b4990a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4990fc0 con 0x55e2b498e610 2024-09-10T05:11:45.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.315+0000 7f13f3493640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e2b498e610 0x55e2b4990a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.316+0000 7f13f3493640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e2b498e610 0x55e2b4990a00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.316+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.316+0000 7f13f59a9800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:45.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.316+0000 7f13f59a9800 20 searching for the correct realm 2024-09-10T05:11:45.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.316+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e2b4992f90 0x55e2b4995420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.316+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4995af0 con 0x55e2b4992f90 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.316+0000 7f13f2c92640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e2b4992f90 0x55e2b4995420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.316+0000 7f13f2c92640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e2b4992f90 0x55e2b4995420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.317+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.317+0000 7f13f2c92640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f13dc037040 0x7f13dc036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.317+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4995af0 con 0x7f13dc037040 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.317+0000 7f13f3c94640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f13dc037040 0x7f13dc036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.317+0000 7f13f3c94640 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f13dc037040 0x7f13dc036410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.317+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.317+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b498e610 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.318+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.318+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4989c20 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.318+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.318+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4989c20 2024-09-10T05:11:45.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.318+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.318+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b498e610 2024-09-10T05:11:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.319+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.319+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b498e610 2024-09-10T05:11:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.319+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.319+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x7f13dc037040 2024-09-10T05:11:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.319+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.319+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4992f90 2024-09-10T05:11:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.319+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.319+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4989c20 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.319+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.320+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b498e610 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.320+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.320+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4989c20 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.320+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.320+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x7f13dc037040 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.320+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.320+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4992f90 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.321+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.321+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4992f90 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.321+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.321+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b498e610 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.321+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.321+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4992f90 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.321+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.321+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4992f90 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.321+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.321+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4989c20 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.322+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.322+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4989c20 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.322+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.322+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b498e610 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.322+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.322+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4992f90 2024-09-10T05:11:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.322+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.322+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x7f13dc037040 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.323+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.323+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4989c20 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.323+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.323+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b498e610 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.323+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.323+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4992f90 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.323+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.323+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b498e610 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.324+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.324+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x7f13dc037040 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.324+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.324+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4992f90 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.324+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.324+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b498e610 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x55e2b4989c20 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b498d8b0 con 0x7f13dc037040 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f59a9800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f59a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f59a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f59a9800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f59a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f59a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f59a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4991880 con 0x55e2b4989c20 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f59a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.325+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4991880 con 0x55e2b4989c20 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4991880 con 0x7f13dc037040 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 20 zone default found 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 4 Realm: () 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 20 zonegroup default 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49917f0 con 0x55e2b498e610 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.326+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4997960 con 0x55e2b4992f90 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.327+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.327+0000 7f13f59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.327+0000 7f13f59a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.327+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4997d00 con 0x55e2b4992f90 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.327+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.327+0000 7f13f59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.327+0000 7f13f59a9800 20 started sync module instance, tier type = 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.327+0000 7f13f59a9800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.327+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4996e00 con 0x7f13dc037040 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.328+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.328+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94432180924960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4996e00 con 0x7f13dc037040 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.328+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49986c0 con 0x55e2b4989c20 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.329+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.329+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94432180929040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4998b20 con 0x55e2b4989c20 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.330+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49995f0 con 0x55e2b4992f90 2024-09-10T05:11:45.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.331+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94432180929040] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.331+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94432180924960] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.333+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.333+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94432180922704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4998630 con 0x55e2b4992f90 2024-09-10T05:11:45.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.333+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b499a030 con 0x7f13dc037040 2024-09-10T05:11:45.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.334+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94432180922704] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.334+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.335+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94432180935552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b499a450 con 0x7f13dc037040 2024-09-10T05:11:45.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.335+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b499aca0 con 0x55e2b4989c20 2024-09-10T05:11:45.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.336+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.336+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94432180938352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b499b0f0 con 0x55e2b4989c20 2024-09-10T05:11:45.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.336+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b499bbf0 con 0x55e2b498e610 2024-09-10T05:11:45.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.339+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94432180935552] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.340+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.340+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94432180942560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b499c010 con 0x55e2b498e610 2024-09-10T05:11:45.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.340+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b499c9d0 con 0x55e2b498e610 2024-09-10T05:11:45.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.342+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94432180938352] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.342+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94432180942560] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.345+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.345+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94432180939504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b499c9d0 con 0x55e2b498e610 2024-09-10T05:11:45.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.346+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b499c9d0 con 0x55e2b498e610 2024-09-10T05:11:45.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94432180939504] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94432180946688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b499d150 con 0x55e2b498e610 2024-09-10T05:11:45.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f59a9800 20 add_watcher() i=0 2024-09-10T05:11:45.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f59a9800 20 add_watcher() i=1 2024-09-10T05:11:45.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f59a9800 20 add_watcher() i=2 2024-09-10T05:11:45.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f59a9800 20 add_watcher() i=3 2024-09-10T05:11:45.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f59a9800 20 add_watcher() i=4 2024-09-10T05:11:45.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f59a9800 20 add_watcher() i=5 2024-09-10T05:11:45.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f59a9800 20 add_watcher() i=6 2024-09-10T05:11:45.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94432180946688] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f59a9800 20 add_watcher() i=7 2024-09-10T05:11:45.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.347+0000 7f13f59a9800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:45.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.348+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49a0690 con 0x55e2b4989c20 2024-09-10T05:11:45.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.348+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.348+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94432180947936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b499dbb0 con 0x55e2b4989c20 2024-09-10T05:11:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.350+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94432180947936] v35'32 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.350+0000 7f12aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.350+0000 7f13f59a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.350+0000 7f13f59a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.351+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49a8f10 con 0x55e2b4989c20 2024-09-10T05:11:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.352+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'40 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.352+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49a95a0 con 0x55e2b498e610 2024-09-10T05:11:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.353+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.353+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49a95a0 con 0x55e2b4992f90 2024-09-10T05:11:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.354+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.354+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49aa060 con 0x55e2b4989c20 2024-09-10T05:11:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.355+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'33 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.355+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49a6d50 con 0x7f13dc037040 2024-09-10T05:11:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.356+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.356+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49a6d50 con 0x55e2b4992f90 2024-09-10T05:11:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.357+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'25 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.357+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab240 con 0x55e2b4989c20 2024-09-10T05:11:45.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.358+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.358+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab240 con 0x55e2b498e610 2024-09-10T05:11:45.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.359+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'19 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.359+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab240 con 0x7f13dc037040 2024-09-10T05:11:45.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.360+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.360+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab2d0 con 0x55e2b4992f90 2024-09-10T05:11:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.362+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.362+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab880 con 0x7f13dc037040 2024-09-10T05:11:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.363+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'27 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.363+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab840 con 0x55e2b498e610 2024-09-10T05:11:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.364+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.364+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab810 con 0x7f13dc037040 2024-09-10T05:11:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.366+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.366+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab810 con 0x55e2b498e610 2024-09-10T05:11:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.367+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.367+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab810 con 0x55e2b4989c20 2024-09-10T05:11:45.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.368+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.368+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab810 con 0x55e2b4992f90 2024-09-10T05:11:45.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.369+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.370+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab8a0 con 0x7f13dc037040 2024-09-10T05:11:45.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.370+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.371+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab8a0 con 0x55e2b4992f90 2024-09-10T05:11:45.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.371+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.371+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab9b0 con 0x55e2b4989c20 2024-09-10T05:11:45.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.373+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.373+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab970 con 0x55e2b4989c20 2024-09-10T05:11:45.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.373+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.374+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab970 con 0x55e2b4992f90 2024-09-10T05:11:45.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.375+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.375+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab9b0 con 0x7f13dc037040 2024-09-10T05:11:45.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.375+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.376+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab970 con 0x55e2b4992f90 2024-09-10T05:11:45.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.376+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.376+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab9b0 con 0x55e2b4992f90 2024-09-10T05:11:45.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.381+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.382+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab970 con 0x55e2b4992f90 2024-09-10T05:11:45.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.382+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'13 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.383+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab970 con 0x55e2b4992f90 2024-09-10T05:11:45.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.383+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.383+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab9f0 con 0x55e2b498e610 2024-09-10T05:11:45.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.385+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.385+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab9b0 con 0x55e2b4992f90 2024-09-10T05:11:45.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.386+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.386+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab9b0 con 0x55e2b498e610 2024-09-10T05:11:45.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.389+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.389+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab9f0 con 0x55e2b4992f90 2024-09-10T05:11:45.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.390+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.390+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49ab9b0 con 0x55e2b498e610 2024-09-10T05:11:45.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.391+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.391+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49aba30 con 0x7f13dc037040 2024-09-10T05:11:45.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.392+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.392+0000 7f12a97e2640 20 reqs_thread_entry: start 2024-09-10T05:11:45.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.392+0000 7f13f59a9800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:45.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.393+0000 7f13f59a9800 20 Filter name: none 2024-09-10T05:11:45.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.393+0000 7f12a27fc640 20 reqs_thread_entry: start 2024-09-10T05:11:45.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.393+0000 7f13f59a9800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T05:11:45.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.393+0000 7f13f59a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.393+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49d6a40 con 0x7f13dc037040 2024-09-10T05:11:45.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.393+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.393+0000 7f13f59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.393+0000 7f13f59a9800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-10T05:11:45.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.393+0000 7f13f59a9800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:11:45.395 INFO:teuthology.orchestra.run.smithi192.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T05:11:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.394+0000 7f12aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.394+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94432180947936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49a7d60 con 0x55e2b4989c20 2024-09-10T05:11:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.395+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94432180947936] v35'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.395+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94432180924960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b49a59a0 con 0x7f13dc037040 2024-09-10T05:11:45.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.396+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94432180924960] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.396+0000 7f13f59a9800 20 remove_watcher() i=0 2024-09-10T05:11:45.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.396+0000 7f13f59a9800 2 removed watcher, disabling cache 2024-09-10T05:11:45.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.396+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94432180929040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4997220 con 0x55e2b4989c20 2024-09-10T05:11:45.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.397+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94432180929040] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.397+0000 7f13f59a9800 20 remove_watcher() i=1 2024-09-10T05:11:45.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.397+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94432180922704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4997220 con 0x55e2b4992f90 2024-09-10T05:11:45.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.399+0000 7f13f2c92640 1 -- 172.21.15.192:0/1623425460 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94432180922704] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13dc009050 con 0x55e2b4992f90 2024-09-10T05:11:45.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.399+0000 7f13f59a9800 20 remove_watcher() i=2 2024-09-10T05:11:45.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.399+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94432180935552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4996950 con 0x7f13dc037040 2024-09-10T05:11:45.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.400+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94432180935552] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x7f13dc037040 2024-09-10T05:11:45.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.400+0000 7f13f59a9800 20 remove_watcher() i=3 2024-09-10T05:11:45.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.400+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94432180938352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4997220 con 0x55e2b4989c20 2024-09-10T05:11:45.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.402+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94432180938352] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13ec00a4d0 con 0x55e2b4989c20 2024-09-10T05:11:45.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.402+0000 7f13f59a9800 20 remove_watcher() i=4 2024-09-10T05:11:45.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.402+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94432180942560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4999b80 con 0x55e2b498e610 2024-09-10T05:11:45.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.404+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94432180942560] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.404+0000 7f13f59a9800 20 remove_watcher() i=5 2024-09-10T05:11:45.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.404+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94432180939504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b4996950 con 0x55e2b498e610 2024-09-10T05:11:45.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.405+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94432180939504] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.405+0000 7f13f59a9800 20 remove_watcher() i=6 2024-09-10T05:11:45.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.405+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94432180946688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b499a670 con 0x55e2b498e610 2024-09-10T05:11:45.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f3493640 1 -- 172.21.15.192:0/1623425460 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94432180946688] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13e40b8030 con 0x55e2b498e610 2024-09-10T05:11:45.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 20 remove_watcher() i=7 2024-09-10T05:11:45.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e2b498e610 msgr2=0x55e2b4990a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e2b498e610 0x55e2b4990a00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e2b4989c20 msgr2=0x55e2b498c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e2b4989c20 0x55e2b498c0e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f13dc037040 msgr2=0x7f13dc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f13dc037040 0x7f13dc036410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e2b4992f90 msgr2=0x55e2b4995420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e2b4992f90 0x55e2b4995420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12bc03c730 msgr2=0x7f12bc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12bc03c730 0x7f12bc03ebf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c010 tx=0x7f13dc010000 comp rx=0 tx=0).stop 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 msgr2=0x55e2b497e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f3c94640 1 -- 172.21.15.192:0/1623425460 reap_dead start 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 0x55e2b497e660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f13e405d830 tx=0x7f13e4062fa0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 shutdown_connections 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1623425460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b49772c0 0x55e2b497e660 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 >> 172.21.15.192:0/1623425460 conn(0x55e2b49736c0 msgr2=0x55e2b49718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 shutdown_connections 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.406+0000 7f13f59a9800 1 -- 172.21.15.192:0/1623425460 wait complete. 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/1683520671 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12cc03c780 msgr2=0x7f12cc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1683520671 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12cc03c780 0x7f12cc03ec40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00bf40 tx=0x7f13dc00f000 comp rx=0 tx=0).stop 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/1683520671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b496aa20 msgr2=0x55e2b496ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1683520671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b496aa20 0x55e2b496ae40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13e405db10 tx=0x7f13e405da50 comp rx=0 tx=0).stop 2024-09-10T05:11:45.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/1683520671 shutdown_connections 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1683520671 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12cc03c780 0x7f12cc03ec40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 --2- 172.21.15.192:0/1683520671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b496aa20 0x55e2b496ae40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/1683520671 >> 172.21.15.192:0/1683520671 conn(0x55e2b495edd0 msgr2=0x55e2b495f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/1683520671 shutdown_connections 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/1683520671 wait complete. 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e2b49561d0 msgr2=0x55e2b4958670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e2b49561d0 0x55e2b4958670 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e2b4951a00 msgr2=0x55e2b4953df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e2b4951a00 0x55e2b4953df0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e2b495a260 msgr2=0x55e2b495c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e2b495a260 0x55e2b495c650 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12d803c730 msgr2=0x7f12d803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f12d803c730 0x7f12d803ebf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f13dc001d70 tx=0x7f13dc0012d0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4856010 msgr2=0x55e2b494c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 --2- 172.21.15.192:0/2565846145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2b4856010 0x55e2b494c3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f13e4025c20 tx=0x7f13e4002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f3c94640 1 -- 172.21.15.192:0/2565846145 reap_dead start 2024-09-10T05:11:45.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 shutdown_connections 2024-09-10T05:11:45.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 >> 172.21.15.192:0/2565846145 conn(0x55e2b484d1c0 msgr2=0x55e2b493db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 shutdown_connections 2024-09-10T05:11:45.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.407+0000 7f13f59a9800 1 -- 172.21.15.192:0/2565846145 wait complete. 2024-09-10T05:11:45.416 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T05:11:45.417 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-10T05:11:45.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-10T05:11:45.417 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-10T05:11:45.461 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:45.461 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:45.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.461+0000 7f3d85936800 1 Processor -- start 2024-09-10T05:11:45.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.461+0000 7f3d85936800 1 -- start start 2024-09-10T05:11:45.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.461+0000 7f3d85936800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c186e2a230 0x55c186e2c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.461+0000 7f3d85936800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c186ccfe40 con 0x55c186e26720 2024-09-10T05:11:45.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.461+0000 7f3d85936800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55c186c9a680 con 0x55c186e2a230 2024-09-10T05:11:45.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.461+0000 7f3d7bfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c186e2a230 0x55c186e2c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.461+0000 7f3d816b7640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55c186e26720 0x55c186e28b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36142/0 (socket says 172.21.15.192:36142) 2024-09-10T05:11:45.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.461+0000 7f3d816b7640 1 -- 172.21.15.192:0/3072156558 learned_addr learned my addr 172.21.15.192:0/3072156558 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:45.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.461+0000 7f3d7bfff640 1 -- 172.21.15.192:0/3072156558 >> v1:172.21.15.139:6789/0 conn(0x55c186e26720 legacy=0x55c186e28b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.461+0000 7f3d80eb6640 1 -- 172.21.15.192:0/3072156558 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388853612 0 0) 0x55c186ccfe40 con 0x55c186e26720 2024-09-10T05:11:45.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.461+0000 7f3d7bfff640 1 -- 172.21.15.192:0/3072156558 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c186cb66b0 con 0x55c186e2a230 2024-09-10T05:11:45.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.463+0000 7f3d7bfff640 1 --2- 172.21.15.192:0/3072156558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e2a230 0x55c186e2c6c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00a470 tx=0x7f3d6c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b052bde8cf1be268 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.464+0000 7f3d80eb6640 1 -- 172.21.15.192:0/3072156558 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d6c053570 con 0x55c186e2a230 2024-09-10T05:11:45.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.464+0000 7f3d80eb6640 1 -- 172.21.15.192:0/3072156558 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6c058070 con 0x55c186e2a230 2024-09-10T05:11:45.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.464+0000 7f3d80eb6640 1 -- 172.21.15.192:0/3072156558 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d6c053880 con 0x55c186e2a230 2024-09-10T05:11:45.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.464+0000 7f3d85936800 1 -- 172.21.15.192:0/3072156558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e2a230 msgr2=0x55c186e2c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.464+0000 7f3d85936800 1 --2- 172.21.15.192:0/3072156558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e2a230 0x55c186e2c6c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00a470 tx=0x7f3d6c045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.464+0000 7f3d85936800 1 -- 172.21.15.192:0/3072156558 shutdown_connections 2024-09-10T05:11:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.464+0000 7f3d85936800 1 --2- 172.21.15.192:0/3072156558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e2a230 0x55c186e2c6c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.464+0000 7f3d85936800 1 -- 172.21.15.192:0/3072156558 >> 172.21.15.192:0/3072156558 conn(0x55c186e201c0 msgr2=0x55c186e22620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.464+0000 7f3d85936800 1 -- 172.21.15.192:0/3072156558 shutdown_connections 2024-09-10T05:11:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.464+0000 7f3d85936800 1 -- 172.21.15.192:0/3072156558 wait complete. 2024-09-10T05:11:45.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.478+0000 7f3d85936800 1 Processor -- start 2024-09-10T05:11:45.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.478+0000 7f3d85936800 1 -- start start 2024-09-10T05:11:45.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.478+0000 7f3d85936800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 0x55c186e25eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.478+0000 7f3d85936800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c186cbedd0 con 0x55c186e26720 2024-09-10T05:11:45.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.478+0000 7f3d816b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 0x55c186e25eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.478+0000 7f3d816b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 0x55c186e25eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58730/0 (socket says 172.21.15.192:58730) 2024-09-10T05:11:45.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.478+0000 7f3d816b7640 1 -- 172.21.15.192:0/951118388 learned_addr learned my addr 172.21.15.192:0/951118388 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.478+0000 7f3d816b7640 1 -- 172.21.15.192:0/951118388 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c186cd7e10 con 0x55c186e26720 2024-09-10T05:11:45.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.479+0000 7f3d816b7640 1 --2- 172.21.15.192:0/951118388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 0x55c186e25eb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3d74001ea0 tx=0x7f3d7400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc49f584c63cf1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.479+0000 7f3c6f606640 1 -- 172.21.15.192:0/951118388 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d74008070 con 0x55c186e26720 2024-09-10T05:11:45.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.479+0000 7f3c6f606640 1 -- 172.21.15.192:0/951118388 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7400d500 con 0x55c186e26720 2024-09-10T05:11:45.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.479+0000 7f3c6f606640 1 -- 172.21.15.192:0/951118388 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7400d880 con 0x55c186e26720 2024-09-10T05:11:45.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.479+0000 7f3d85936800 1 -- 172.21.15.192:0/951118388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 msgr2=0x55c186e25eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.479+0000 7f3d85936800 1 --2- 172.21.15.192:0/951118388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 0x55c186e25eb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3d74001ea0 tx=0x7f3d7400b6a0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.479+0000 7f3d85936800 1 -- 172.21.15.192:0/951118388 shutdown_connections 2024-09-10T05:11:45.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.479+0000 7f3d85936800 1 --2- 172.21.15.192:0/951118388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 0x55c186e25eb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.479+0000 7f3d85936800 1 -- 172.21.15.192:0/951118388 >> 172.21.15.192:0/951118388 conn(0x55c186e201c0 msgr2=0x55c186f10e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.480+0000 7f3d85936800 1 -- 172.21.15.192:0/951118388 shutdown_connections 2024-09-10T05:11:45.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.480+0000 7f3d85936800 1 -- 172.21.15.192:0/951118388 wait complete. 2024-09-10T05:11:45.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.480+0000 7f3d85936800 1 Processor -- start 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.480+0000 7f3d85936800 1 -- start start 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.480+0000 7f3d85936800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 0x55c186f1efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.480+0000 7f3d85936800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c186e2d040 con 0x55c186e26720 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.480+0000 7f3d816b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 0x55c186f1efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.480+0000 7f3d816b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 0x55c186f1efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58738/0 (socket says 172.21.15.192:58738) 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.480+0000 7f3d816b7640 1 -- 172.21.15.192:0/975617724 learned_addr learned my addr 172.21.15.192:0/975617724 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.480+0000 7f3d816b7640 1 -- 172.21.15.192:0/975617724 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c186f1f540 con 0x55c186e26720 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.481+0000 7f3d816b7640 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 0x55c186f1efe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d74000f60 tx=0x7f3d74000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.481+0000 7f3c6de03640 1 -- 172.21.15.192:0/975617724 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7400f8d0 con 0x55c186e26720 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.481+0000 7f3c6de03640 1 -- 172.21.15.192:0/975617724 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7400fa70 con 0x55c186e26720 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.481+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c186f1f7d0 con 0x55c186e26720 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.481+0000 7f3c6de03640 1 -- 172.21.15.192:0/975617724 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7400fd50 con 0x55c186e26720 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.481+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c186f201d0 con 0x55c186e26720 2024-09-10T05:11:45.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.482+0000 7f3c6de03640 1 -- 172.21.15.192:0/975617724 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3d74017040 con 0x55c186e26720 2024-09-10T05:11:45.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.482+0000 7f3c6de03640 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c6803c780 0x7f3c6803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.482+0000 7f3c6de03640 1 -- 172.21.15.192:0/975617724 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3d74015020 con 0x55c186e26720 2024-09-10T05:11:45.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.482+0000 7f3d7bfff640 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c6803c780 0x7f3c6803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.482+0000 7f3d85936800 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c186e2a230 0x55c186f26630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.482+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f26b70 con 0x55c186e2a230 2024-09-10T05:11:45.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.482+0000 7f3d81eb8640 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c186e2a230 0x55c186f26630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.482+0000 7f3d7bfff640 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c6803c780 0x7f3c6803ec40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c057000 tx=0x7f3d6c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.483+0000 7f3d81eb8640 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c186e2a230 0x55c186f26630 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.483+0000 7f3d81eb8640 1 -- 172.21.15.192:0/975617724 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186e2a230 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.483+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f26f10 con 0x55c186e2a230 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.483+0000 7f3d81eb8640 1 -- 172.21.15.192:0/975617724 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186e2a230 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.483+0000 7f3d85936800 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c186f289d0 0x55c186f2ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.483+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f2b5e0 con 0x55c186f289d0 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.484+0000 7f3d816b7640 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c186f289d0 0x55c186f2ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.484+0000 7f3d816b7640 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c186f289d0 0x55c186f2ae50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.484+0000 7f3d816b7640 1 -- 172.21.15.192:0/975617724 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3d7402d070 con 0x55c186f289d0 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.484+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f27760 con 0x55c186e2a230 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.485+0000 7f3d81eb8640 1 -- 172.21.15.192:0/975617724 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186e2a230 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.485+0000 7f3d85936800 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c186f2ca40 0x55c186f2ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.485+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f2f520 con 0x55c186f2ca40 2024-09-10T05:11:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.485+0000 7f3d7bfff640 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c186f2ca40 0x55c186f2ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.485+0000 7f3d7bfff640 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c186f2ca40 0x55c186f2ee30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.485+0000 7f3d7bfff640 1 -- 172.21.15.192:0/975617724 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3d6c051070 con 0x55c186f2ca40 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.486+0000 7f3d85936800 1 Processor -- start 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.486+0000 7f3d85936800 1 -- start start 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.486+0000 7f3d85936800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f3d180 0x55c186f3d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.486+0000 7f3d85936800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c186d1ca00 con 0x55c186f3d180 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.486+0000 7f3d816b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f3d180 0x55c186f3d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.486+0000 7f3d816b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f3d180 0x55c186f3d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58750/0 (socket says 172.21.15.192:58750) 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.486+0000 7f3d816b7640 1 -- 172.21.15.192:0/319058236 learned_addr learned my addr 172.21.15.192:0/319058236 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.486+0000 7f3d816b7640 1 -- 172.21.15.192:0/319058236 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c186f3dbe0 con 0x55c186f3d180 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.486+0000 7f3d816b7640 1 --2- 172.21.15.192:0/319058236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f3d180 0x55c186f3d5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400ffd0 tx=0x7f3d740187a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.487+0000 7f3c66ffd640 1 -- 172.21.15.192:0/319058236 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7401ae00 con 0x55c186f3d180 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.487+0000 7f3c66ffd640 1 -- 172.21.15.192:0/319058236 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d740445f0 con 0x55c186f3d180 2024-09-10T05:11:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.487+0000 7f3d85936800 1 -- 172.21.15.192:0/319058236 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c186f3e410 con 0x55c186f3d180 2024-09-10T05:11:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.487+0000 7f3c66ffd640 1 -- 172.21.15.192:0/319058236 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d740195a0 con 0x55c186f3d180 2024-09-10T05:11:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.487+0000 7f3d85936800 1 -- 172.21.15.192:0/319058236 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c186f3e9b0 con 0x55c186f3d180 2024-09-10T05:11:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.487+0000 7f3c66ffd640 1 -- 172.21.15.192:0/319058236 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3d74019740 con 0x55c186f3d180 2024-09-10T05:11:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.488+0000 7f3c66ffd640 1 --2- 172.21.15.192:0/319058236 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c5803c780 0x7f3c5803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.488+0000 7f3c66ffd640 1 -- 172.21.15.192:0/319058236 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3d7403c4d0 con 0x55c186f3d180 2024-09-10T05:11:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.488+0000 7f3d7bfff640 1 --2- 172.21.15.192:0/319058236 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c5803c780 0x7f3c5803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.488+0000 7f3d85936800 1 Processor -- start 2024-09-10T05:11:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.488+0000 7f3d85936800 1 -- start start 2024-09-10T05:11:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.488+0000 7f3d7bfff640 1 --2- 172.21.15.192:0/319058236 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c5803c780 0x7f3c5803ec40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55c186f210c0 tx=0x7f3d6c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.488+0000 7f3d85936800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 0x55c186f49fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.488+0000 7f3d85936800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c186e24750 con 0x55c186f49bc0 2024-09-10T05:11:45.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.488+0000 7f3d816b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 0x55c186f49fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.488+0000 7f3d816b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 0x55c186f49fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58766/0 (socket says 172.21.15.192:58766) 2024-09-10T05:11:45.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.488+0000 7f3d816b7640 1 -- 172.21.15.192:0/3651899687 learned_addr learned my addr 172.21.15.192:0/3651899687 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.489+0000 7f3d816b7640 1 -- 172.21.15.192:0/3651899687 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c186f4a5b0 con 0x55c186f49bc0 2024-09-10T05:11:45.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.489+0000 7f3d816b7640 1 --2- 172.21.15.192:0/3651899687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 0x55c186f49fc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d74042fd0 tx=0x7f3d7402e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aac765f766f804e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.489+0000 7f3c64ff9640 1 -- 172.21.15.192:0/3651899687 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7402f3e0 con 0x55c186f49bc0 2024-09-10T05:11:45.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.489+0000 7f3c64ff9640 1 -- 172.21.15.192:0/3651899687 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7402fe70 con 0x55c186f49bc0 2024-09-10T05:11:45.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.489+0000 7f3c64ff9640 1 -- 172.21.15.192:0/3651899687 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d74039410 con 0x55c186f49bc0 2024-09-10T05:11:45.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.489+0000 7f3d85936800 1 -- 172.21.15.192:0/3651899687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 msgr2=0x55c186f49fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.489+0000 7f3d85936800 1 --2- 172.21.15.192:0/3651899687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 0x55c186f49fc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d74042fd0 tx=0x7f3d7402e660 comp rx=0 tx=0).stop 2024-09-10T05:11:45.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.489+0000 7f3d85936800 1 -- 172.21.15.192:0/3651899687 shutdown_connections 2024-09-10T05:11:45.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.489+0000 7f3d85936800 1 --2- 172.21.15.192:0/3651899687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 0x55c186f49fc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.489+0000 7f3d85936800 1 -- 172.21.15.192:0/3651899687 >> 172.21.15.192:0/3651899687 conn(0x55c186f45fc0 msgr2=0x55c186f44200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.489+0000 7f3d85936800 1 -- 172.21.15.192:0/3651899687 shutdown_connections 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.489+0000 7f3d85936800 1 -- 172.21.15.192:0/3651899687 wait complete. 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.490+0000 7f3d85936800 1 Processor -- start 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.490+0000 7f3d85936800 1 -- start start 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.490+0000 7f3d85936800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 0x55c186f50fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.490+0000 7f3d85936800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c186f4aa20 con 0x55c186f49bc0 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.490+0000 7f3d816b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 0x55c186f50fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.490+0000 7f3d816b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 0x55c186f50fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58776/0 (socket says 172.21.15.192:58776) 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.490+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 learned_addr learned my addr 172.21.15.192:0/2808731350 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.490+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c186f51520 con 0x55c186f49bc0 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.491+0000 7f3d816b7640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 0x55c186f50fc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3d74039750 tx=0x7f3d7403a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.491+0000 7f3c56ffd640 1 -- 172.21.15.192:0/2808731350 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7406d070 con 0x55c186f49bc0 2024-09-10T05:11:45.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.491+0000 7f3c56ffd640 1 -- 172.21.15.192:0/2808731350 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7401aa80 con 0x55c186f49bc0 2024-09-10T05:11:45.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.491+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c186f51520 con 0x55c186f49bc0 2024-09-10T05:11:45.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.491+0000 7f3c56ffd640 1 -- 172.21.15.192:0/2808731350 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7402f5c0 con 0x55c186f49bc0 2024-09-10T05:11:45.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.491+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c186f51520 con 0x55c186f49bc0 2024-09-10T05:11:45.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.492+0000 7f3c56ffd640 1 -- 172.21.15.192:0/2808731350 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3d74070070 con 0x55c186f49bc0 2024-09-10T05:11:45.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.492+0000 7f3c56ffd640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c4c03c730 0x7f3c4c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.492+0000 7f3c56ffd640 1 -- 172.21.15.192:0/2808731350 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3d74065070 con 0x55c186f49bc0 2024-09-10T05:11:45.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.492+0000 7f3d7bfff640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c4c03c730 0x7f3c4c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.492+0000 7f3d7bfff640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c4c03c730 0x7f3c4c03ebf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c000c00 tx=0x7f3d6c053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.492+0000 7f3d85936800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.492+0000 7f3d85936800 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c186f5c550 0x55c186f5ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.492+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f5f160 con 0x55c186f5c550 2024-09-10T05:11:45.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.493+0000 7f3d81eb8640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c186f5c550 0x55c186f5ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.493+0000 7f3d81eb8640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c186f5c550 0x55c186f5ea10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.493+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.493+0000 7f3d85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.493+0000 7f3d85936800 20 realm 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.493+0000 7f3d85936800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.493+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f5f570 con 0x55c186f5c550 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.493+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.493+0000 7f3d85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.493+0000 7f3d85936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.493+0000 7f3d85936800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.493+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f5fe40 con 0x55c186f5c550 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.494+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.494+0000 7f3d85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.494+0000 7f3d85936800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.494+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f5c550 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.494+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.494+0000 7f3d85936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.494+0000 7f3d85936800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.494+0000 7f3d85936800 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c186f60f40 0x55c186f63330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.494+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f63980 con 0x55c186f60f40 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.494+0000 7f3d816b7640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c186f60f40 0x55c186f63330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.494+0000 7f3d816b7640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c186f60f40 0x55c186f63330 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.495+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.495+0000 7f3d85936800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.495+0000 7f3d85936800 20 searching for the correct realm 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.495+0000 7f3d85936800 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c186f65950 0x55c186f67e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.495+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f68490 con 0x55c186f65950 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.495+0000 7f3d7bfff640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c186f65950 0x55c186f67e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.495+0000 7f3d7bfff640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c186f65950 0x55c186f67e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.495+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.495+0000 7f3d7bfff640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3d6c05f040 0x7f3d6c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.495+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f68490 con 0x7f3d6c05f040 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.496+0000 7f3d81eb8640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3d6c05f040 0x7f3d6c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.496+0000 7f3d81eb8640 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3d6c05f040 0x7f3d6c06b410 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.496+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.496+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f60f40 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.496+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.496+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f5c550 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.497+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.497+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f5c550 2024-09-10T05:11:45.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.497+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.497+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f60f40 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.497+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.497+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f60f40 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.497+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.497+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x7f3d6c05f040 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.497+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.497+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f65950 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.498+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.498+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f5c550 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.498+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.498+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f60f40 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.498+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.498+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f5c550 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.498+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.499+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x7f3d6c05f040 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.499+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.499+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f65950 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.499+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.499+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f65950 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.499+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.499+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f60f40 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.500+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.500+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f65950 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.500+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.500+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f65950 2024-09-10T05:11:45.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.500+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.500+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f5c550 2024-09-10T05:11:45.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.500+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.500+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f5c550 2024-09-10T05:11:45.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.500+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.500+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f60f40 2024-09-10T05:11:45.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.501+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.501+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f65950 2024-09-10T05:11:45.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.501+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.501+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x7f3d6c05f040 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.501+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.501+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f5c550 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.501+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.501+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f60f40 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.502+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.502+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f65950 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.502+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.502+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f60f40 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.502+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.502+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x7f3d6c05f040 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.503+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.503+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f65950 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.503+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.503+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f60f40 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.503+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.503+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x55c186f5c550 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.503+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.503+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c186f601e0 con 0x7f3d6c05f040 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:45.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f64240 con 0x55c186f5c550 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f64240 con 0x55c186f5c550 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f64240 con 0x7f3d6c05f040 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:45.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 zone default found 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 4 Realm: () 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 zonegroup default 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.504+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f641b0 con 0x55c186f60f40 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d85936800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6a300 con 0x55c186f65950 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d85936800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6a6a0 con 0x55c186f65950 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d85936800 20 started sync module instance, tier type = 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d85936800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.505+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f697a0 con 0x7f3d6c05f040 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.506+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.506+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94289681357712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f697a0 con 0x7f3d6c05f040 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.506+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6af30 con 0x55c186f5c550 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.509+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94289681357712] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.509+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.509+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94289681361472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f697a0 con 0x55c186f5c550 2024-09-10T05:11:45.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.509+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6b9a0 con 0x55c186f65950 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.510+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94289681361472] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.510+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.510+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94289681355504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f69710 con 0x55c186f65950 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.510+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6c890 con 0x7f3d6c05f040 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.511+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.511+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94289681368512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6d030 con 0x7f3d6c05f040 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.511+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6db20 con 0x55c186f5c550 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.511+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94289681355504] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.512+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.512+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94289681372656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6dae0 con 0x55c186f5c550 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.512+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6e550 con 0x55c186f60f40 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.512+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94289681368512] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.513+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94289681372656] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.513+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.513+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94289681366464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6ca80 con 0x55c186f60f40 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.514+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6ee20 con 0x55c186f60f40 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.514+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94289681366464] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.515+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.515+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94289681375360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6f670 con 0x55c186f60f40 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.515+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f70030 con 0x55c186f60f40 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.516+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.516+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94289681382272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f70450 con 0x55c186f60f40 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.516+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94289681375360] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.516+0000 7f3d85936800 20 add_watcher() i=0 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.516+0000 7f3d85936800 20 add_watcher() i=1 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.516+0000 7f3d85936800 20 add_watcher() i=2 2024-09-10T05:11:45.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.516+0000 7f3d85936800 20 add_watcher() i=3 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.516+0000 7f3d85936800 20 add_watcher() i=4 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.516+0000 7f3d85936800 20 add_watcher() i=5 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.516+0000 7f3d85936800 20 add_watcher() i=6 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.517+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94289681382272] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.517+0000 7f3d85936800 20 add_watcher() i=7 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.517+0000 7f3d85936800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.517+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186f73480 con 0x55c186f5c550 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.517+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.517+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94289681383328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f708d0 con 0x55c186f5c550 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.518+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94289681383328] v35'37 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.518+0000 7f3c377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.518+0000 7f3d85936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:45.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.518+0000 7f3d85936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:45.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.518+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7bd30 con 0x55c186f5c550 2024-09-10T05:11:45.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.519+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'41 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.519+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7bd30 con 0x55c186f60f40 2024-09-10T05:11:45.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.520+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.520+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7bd30 con 0x55c186f65950 2024-09-10T05:11:45.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.521+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.521+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7c750 con 0x55c186f5c550 2024-09-10T05:11:45.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.522+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'38 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.522+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7ccc0 con 0x7f3d6c05f040 2024-09-10T05:11:45.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.523+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'29 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.523+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7d170 con 0x55c186f65950 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.524+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'27 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.524+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7d6e0 con 0x55c186f5c550 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.525+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.525+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7d770 con 0x55c186f60f40 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.526+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'21 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.526+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7d800 con 0x7f3d6c05f040 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.527+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.527+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7d900 con 0x55c186f65950 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.528+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.528+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7dfa0 con 0x7f3d6c05f040 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.529+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'30 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.529+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7dfa0 con 0x55c186f60f40 2024-09-10T05:11:45.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.530+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.530+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7dfa0 con 0x7f3d6c05f040 2024-09-10T05:11:45.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.531+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.531+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7dfa0 con 0x55c186f60f40 2024-09-10T05:11:45.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.532+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.532+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7dfa0 con 0x55c186f5c550 2024-09-10T05:11:45.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.533+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.533+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7dfa0 con 0x55c186f65950 2024-09-10T05:11:45.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.534+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.534+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e570 con 0x7f3d6c05f040 2024-09-10T05:11:45.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.535+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.535+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e510 con 0x55c186f65950 2024-09-10T05:11:45.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.536+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.536+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x55c186f5c550 2024-09-10T05:11:45.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.538+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.538+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x55c186f5c550 2024-09-10T05:11:45.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.538+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.538+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x55c186f65950 2024-09-10T05:11:45.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.539+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.540+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x7f3d6c05f040 2024-09-10T05:11:45.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.540+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.541+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x55c186f65950 2024-09-10T05:11:45.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.541+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.541+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x55c186f65950 2024-09-10T05:11:45.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.542+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.542+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x55c186f65950 2024-09-10T05:11:45.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.543+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'14 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.543+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x55c186f65950 2024-09-10T05:11:45.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.544+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.544+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x55c186f60f40 2024-09-10T05:11:45.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.546+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.546+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x55c186f65950 2024-09-10T05:11:45.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.547+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.547+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x55c186f60f40 2024-09-10T05:11:45.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.548+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.548+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x55c186f65950 2024-09-10T05:11:45.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.549+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.549+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x55c186f60f40 2024-09-10T05:11:45.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.550+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'34 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.550+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7e260 con 0x7f3d6c05f040 2024-09-10T05:11:45.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.551+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.551+0000 7f3c367e4640 20 reqs_thread_entry: start 2024-09-10T05:11:45.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.551+0000 7f3d85936800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:45.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.551+0000 7f3d85936800 20 Filter name: none 2024-09-10T05:11:45.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.551+0000 7f3ba7fff640 20 reqs_thread_entry: start 2024-09-10T05:11:45.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.552+0000 7f3d85936800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T05:11:45.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.552+0000 7f3d85936800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.552+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c186fa91b0 con 0x55c186f60f40 2024-09-10T05:11:45.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.552+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.552+0000 7f3d85936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.552+0000 7f3d85936800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-10T05:11:45.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.552+0000 7f3d85936800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T05:11:45.554 INFO:teuthology.orchestra.run.smithi192.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T05:11:45.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.553+0000 7f3c377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:45.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.553+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94289681383328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f7b3a0 con 0x55c186f5c550 2024-09-10T05:11:45.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.554+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94289681383328] v35'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.554+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94289681357712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6ffa0 con 0x7f3d6c05f040 2024-09-10T05:11:45.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.555+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94289681357712] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.555+0000 7f3d85936800 20 remove_watcher() i=0 2024-09-10T05:11:45.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.555+0000 7f3d85936800 2 removed watcher, disabling cache 2024-09-10T05:11:45.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.555+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94289681361472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6ffa0 con 0x55c186f5c550 2024-09-10T05:11:45.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.556+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94289681361472] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.556+0000 7f3d85936800 20 remove_watcher() i=1 2024-09-10T05:11:45.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.556+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94289681355504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6aa40 con 0x55c186f65950 2024-09-10T05:11:45.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.557+0000 7f3d7bfff640 1 -- 172.21.15.192:0/2808731350 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94289681355504] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c07c040 con 0x55c186f65950 2024-09-10T05:11:45.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.557+0000 7f3d85936800 20 remove_watcher() i=2 2024-09-10T05:11:45.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.557+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94289681368512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6ffa0 con 0x7f3d6c05f040 2024-09-10T05:11:45.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.558+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94289681368512] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x7f3d6c05f040 2024-09-10T05:11:45.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.558+0000 7f3d85936800 20 remove_watcher() i=3 2024-09-10T05:11:45.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.558+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94289681372656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f692f0 con 0x55c186f5c550 2024-09-10T05:11:45.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.559+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94289681372656] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x55c186f5c550 2024-09-10T05:11:45.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.559+0000 7f3d85936800 20 remove_watcher() i=4 2024-09-10T05:11:45.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.559+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94289681366464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6c5c0 con 0x55c186f60f40 2024-09-10T05:11:45.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.560+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94289681366464] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.560+0000 7f3d85936800 20 remove_watcher() i=5 2024-09-10T05:11:45.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.560+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94289681375360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f6ffa0 con 0x55c186f60f40 2024-09-10T05:11:45.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.561+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94289681375360] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.561+0000 7f3d85936800 20 remove_watcher() i=6 2024-09-10T05:11:45.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.561+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94289681382272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c186f692f0 con 0x55c186f60f40 2024-09-10T05:11:45.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d816b7640 1 -- 172.21.15.192:0/2808731350 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94289681382272] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7406f030 con 0x55c186f60f40 2024-09-10T05:11:45.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 20 remove_watcher() i=7 2024-09-10T05:11:45.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c186f60f40 msgr2=0x55c186f63330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c186f60f40 0x55c186f63330 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c186f5c550 msgr2=0x55c186f5ea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c186f5c550 0x55c186f5ea10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3d6c05f040 msgr2=0x7f3d6c06b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3d6c05f040 0x7f3d6c06b410 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c186f65950 msgr2=0x55c186f67e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c186f65950 0x55c186f67e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c4c03c730 msgr2=0x7f3c4c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c4c03c730 0x7f3c4c03ebf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c000c00 tx=0x7f3d6c053000 comp rx=0 tx=0).stop 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 msgr2=0x55c186f50fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d81eb8640 1 -- 172.21.15.192:0/2808731350 reap_dead start 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 0x55c186f50fc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3d74039750 tx=0x7f3d7403a810 comp rx=0 tx=0).stop 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 shutdown_connections 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 --2- 172.21.15.192:0/2808731350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f49bc0 0x55c186f50fc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.562+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 >> 172.21.15.192:0/2808731350 conn(0x55c186f45fc0 msgr2=0x55c186f441d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 shutdown_connections 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/2808731350 wait complete. 2024-09-10T05:11:45.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/319058236 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c5803c780 msgr2=0x7f3c5803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 --2- 172.21.15.192:0/319058236 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c5803c780 0x7f3c5803ec40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55c186f210c0 tx=0x7f3d6c005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/319058236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f3d180 msgr2=0x55c186f3d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 --2- 172.21.15.192:0/319058236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f3d180 0x55c186f3d5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400ffd0 tx=0x7f3d740187a0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/319058236 shutdown_connections 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 --2- 172.21.15.192:0/319058236 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c5803c780 0x7f3c5803ec40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 --2- 172.21.15.192:0/319058236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186f3d180 0x55c186f3d5a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/319058236 >> 172.21.15.192:0/319058236 conn(0x55c186f31530 msgr2=0x55c186f31910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/319058236 shutdown_connections 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/319058236 wait complete. 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c186f289d0 msgr2=0x55c186f2ae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c186f289d0 0x55c186f2ae50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c186e2a230 msgr2=0x55c186f26630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c186e2a230 0x55c186f26630 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c186f2ca40 msgr2=0x55c186f2ee30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c186f2ca40 0x55c186f2ee30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c6803c780 msgr2=0x7f3c6803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c6803c780 0x7f3c6803ec40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c057000 tx=0x7f3d6c052000 comp rx=0 tx=0).stop 2024-09-10T05:11:45.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 msgr2=0x55c186f1efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d85936800 1 --2- 172.21.15.192:0/975617724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c186e26720 0x55c186f1efe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d74000f60 tx=0x7f3d74000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.563+0000 7f3d81eb8640 1 -- 172.21.15.192:0/975617724 reap_dead start 2024-09-10T05:11:45.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.564+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 shutdown_connections 2024-09-10T05:11:45.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.564+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 >> 172.21.15.192:0/975617724 conn(0x55c186e201c0 msgr2=0x55c186f109a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.564+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 shutdown_connections 2024-09-10T05:11:45.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.564+0000 7f3d85936800 1 -- 172.21.15.192:0/975617724 wait complete. 2024-09-10T05:11:45.573 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T05:11:45.573 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T05:11:45.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T05:11:45.573 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T05:11:45.618 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:45.618 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:45.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.618+0000 7f7b15c2f800 1 Processor -- start 2024-09-10T05:11:45.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.618+0000 7f7b15c2f800 1 -- start start 2024-09-10T05:11:45.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.618+0000 7f7b15c2f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x560f0824a4c0 0x560f0824a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.618+0000 7f7b15c2f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560f080f5e40 con 0x560f0824ae00 2024-09-10T05:11:45.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.618+0000 7f7b15c2f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x560f080c0680 con 0x560f0824a4c0 2024-09-10T05:11:45.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.618+0000 7f7b13719640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x560f0824a4c0 0x560f0824a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.618+0000 7f7b12f18640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x560f0824ae00 0x560f0824b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36146/0 (socket says 172.21.15.192:36146) 2024-09-10T05:11:45.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.618+0000 7f7b12f18640 1 -- 172.21.15.192:0/3246802261 learned_addr learned my addr 172.21.15.192:0/3246802261 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:45.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.618+0000 7f7b13719640 1 -- 172.21.15.192:0/3246802261 >> v1:172.21.15.139:6789/0 conn(0x560f0824ae00 legacy=0x560f0824b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.618+0000 7f7b12717640 1 -- 172.21.15.192:0/3246802261 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773169479 0 0) 0x560f080f5e40 con 0x560f0824ae00 2024-09-10T05:11:45.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.618+0000 7f7b13719640 1 -- 172.21.15.192:0/3246802261 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f080dc6b0 con 0x560f0824a4c0 2024-09-10T05:11:45.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.620+0000 7f7b13719640 1 --2- 172.21.15.192:0/3246802261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f0824a8c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400a470 tx=0x7f7b04045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82256eaac6758dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.620+0000 7f7b12717640 1 -- 172.21.15.192:0/3246802261 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b04053570 con 0x560f0824a4c0 2024-09-10T05:11:45.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.620+0000 7f7b12717640 1 -- 172.21.15.192:0/3246802261 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b04058070 con 0x560f0824a4c0 2024-09-10T05:11:45.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.620+0000 7f7b12717640 1 -- 172.21.15.192:0/3246802261 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b04053880 con 0x560f0824a4c0 2024-09-10T05:11:45.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.621+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3246802261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 msgr2=0x560f0824a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.621+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3246802261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f0824a8c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400a470 tx=0x7f7b04045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:45.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.621+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3246802261 shutdown_connections 2024-09-10T05:11:45.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.621+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3246802261 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f0824a8c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.621+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3246802261 >> 172.21.15.192:0/3246802261 conn(0x560f082461f0 msgr2=0x560f08248630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.621+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3246802261 shutdown_connections 2024-09-10T05:11:45.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.621+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3246802261 wait complete. 2024-09-10T05:11:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.634+0000 7f7b15c2f800 1 Processor -- start 2024-09-10T05:11:45.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.635+0000 7f7b15c2f800 1 -- start start 2024-09-10T05:11:45.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.635+0000 7f7b15c2f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f0833d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.635+0000 7f7b15c2f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560f080e4dd0 con 0x560f0824a4c0 2024-09-10T05:11:45.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.635+0000 7f7b13719640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f0833d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.635+0000 7f7b13719640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f0833d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58790/0 (socket says 172.21.15.192:58790) 2024-09-10T05:11:45.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.635+0000 7f7b13719640 1 -- 172.21.15.192:0/3626847426 learned_addr learned my addr 172.21.15.192:0/3626847426 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.635+0000 7f7b13719640 1 -- 172.21.15.192:0/3626847426 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f080fde10 con 0x560f0824a4c0 2024-09-10T05:11:45.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.635+0000 7f7b13719640 1 --2- 172.21.15.192:0/3626847426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f0833d620 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400a470 tx=0x7f7b04051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4007f6201540cd87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.636+0000 7f7a0160a640 1 -- 172.21.15.192:0/3626847426 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b04053570 con 0x560f0824a4c0 2024-09-10T05:11:45.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.636+0000 7f7a0160a640 1 -- 172.21.15.192:0/3626847426 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b04063030 con 0x560f0824a4c0 2024-09-10T05:11:45.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.636+0000 7f7a0160a640 1 -- 172.21.15.192:0/3626847426 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b04053840 con 0x560f0824a4c0 2024-09-10T05:11:45.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.636+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3626847426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 msgr2=0x560f0833d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.636+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3626847426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f0833d620 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400a470 tx=0x7f7b04051000 comp rx=0 tx=0).stop 2024-09-10T05:11:45.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.636+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3626847426 shutdown_connections 2024-09-10T05:11:45.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.636+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3626847426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f0833d620 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.636+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3626847426 >> 172.21.15.192:0/3626847426 conn(0x560f082461f0 msgr2=0x560f08338fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.636+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3626847426 shutdown_connections 2024-09-10T05:11:45.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.636+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3626847426 wait complete. 2024-09-10T05:11:45.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.637+0000 7f7b15c2f800 1 Processor -- start 2024-09-10T05:11:45.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.637+0000 7f7b15c2f800 1 -- start start 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.637+0000 7f7b15c2f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f08344f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.637+0000 7f7b15c2f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560f0824bd20 con 0x560f0824a4c0 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.637+0000 7f7b13719640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f08344f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.637+0000 7f7b13719640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f08344f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58804/0 (socket says 172.21.15.192:58804) 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.637+0000 7f7b13719640 1 -- 172.21.15.192:0/3978289997 learned_addr learned my addr 172.21.15.192:0/3978289997 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.637+0000 7f7b13719640 1 -- 172.21.15.192:0/3978289997 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f08345460 con 0x560f0824a4c0 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.638+0000 7f7b13719640 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f08344f00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400a470 tx=0x7f7b04002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.638+0000 7f79ffe07640 1 -- 172.21.15.192:0/3978289997 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b04078070 con 0x560f0824a4c0 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.638+0000 7f79ffe07640 1 -- 172.21.15.192:0/3978289997 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b04068420 con 0x560f0824a4c0 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.638+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f083456f0 con 0x560f0824a4c0 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.638+0000 7f79ffe07640 1 -- 172.21.15.192:0/3978289997 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b04068700 con 0x560f0824a4c0 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.638+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f08346300 con 0x560f0824a4c0 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.639+0000 7f79ffe07640 1 -- 172.21.15.192:0/3978289997 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7b0407b070 con 0x560f0824a4c0 2024-09-10T05:11:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.639+0000 7f79ffe07640 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79f803c780 0x7f79f803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.639+0000 7f79ffe07640 1 -- 172.21.15.192:0/3978289997 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f7b040978d0 con 0x560f0824a4c0 2024-09-10T05:11:45.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.639+0000 7f7b12f18640 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79f803c780 0x7f79f803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.639+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f0824ae00 0x560f0834c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.639+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f0834ca90 con 0x560f0824ae00 2024-09-10T05:11:45.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.639+0000 7f7b13f1a640 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f0824ae00 0x560f0834c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.639+0000 7f7b12f18640 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79f803c780 0x7f79f803ec40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7b08000c00 tx=0x7f7b080013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.639+0000 7f7b13f1a640 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f0824ae00 0x560f0834c550 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.640+0000 7f7b13f1a640 1 -- 172.21.15.192:0/3978289997 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f0824ae00 2024-09-10T05:11:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.640+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f0834ce30 con 0x560f0824ae00 2024-09-10T05:11:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.640+0000 7f7b13f1a640 1 -- 172.21.15.192:0/3978289997 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f0824ae00 2024-09-10T05:11:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.640+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f0834e8b0 0x560f08350d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.640+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f083514e0 con 0x560f0834e8b0 2024-09-10T05:11:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.640+0000 7f7b13719640 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f0834e8b0 0x560f08350d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.640+0000 7f7b13719640 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f0834e8b0 0x560f08350d50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.641+0000 7f7b13719640 1 -- 172.21.15.192:0/3978289997 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b0407a030 con 0x560f0834e8b0 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.641+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f0834d680 con 0x560f0824ae00 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.641+0000 7f7b13f1a640 1 -- 172.21.15.192:0/3978289997 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f0824ae00 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.641+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560f08352940 0x560f08354d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.641+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f083553d0 con 0x560f08352940 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.641+0000 7f7b12f18640 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560f08352940 0x560f08354d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.641+0000 7f7b12f18640 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560f08352940 0x560f08354d30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.642+0000 7f7b12f18640 1 -- 172.21.15.192:0/3978289997 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b0800f670 con 0x560f08352940 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.642+0000 7f7b15c2f800 1 Processor -- start 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.642+0000 7f7b15c2f800 1 -- start start 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.642+0000 7f7b15c2f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f08363030 0x560f08363450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.642+0000 7f7b15c2f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560f08142a00 con 0x560f08363030 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.642+0000 7f7b13719640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f08363030 0x560f08363450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.642+0000 7f7b13719640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f08363030 0x560f08363450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58806/0 (socket says 172.21.15.192:58806) 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.642+0000 7f7b13719640 1 -- 172.21.15.192:0/3129425117 learned_addr learned my addr 172.21.15.192:0/3129425117 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.643+0000 7f7b13719640 1 -- 172.21.15.192:0/3129425117 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f08363a90 con 0x560f08363030 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.643+0000 7f7b13719640 1 --2- 172.21.15.192:0/3129425117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f08363030 0x560f08363450 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7b04067ff0 tx=0x7f7b0407cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.643+0000 7f79fd602640 1 -- 172.21.15.192:0/3129425117 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b04068ab0 con 0x560f08363030 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.643+0000 7f79fd602640 1 -- 172.21.15.192:0/3129425117 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b04068c50 con 0x560f08363030 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.643+0000 7f79fd602640 1 -- 172.21.15.192:0/3129425117 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0407c4e0 con 0x560f08363030 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.643+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3129425117 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f083642c0 con 0x560f08363030 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.643+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3129425117 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f08364860 con 0x560f08363030 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.644+0000 7f79fd602640 1 -- 172.21.15.192:0/3129425117 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7b0407c680 con 0x560f08363030 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.644+0000 7f79fd602640 1 --2- 172.21.15.192:0/3129425117 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79ec03c780 0x7f79ec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.644+0000 7f79fd602640 1 -- 172.21.15.192:0/3129425117 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f7b0408e070 con 0x560f08363030 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.644+0000 7f7b12f18640 1 --2- 172.21.15.192:0/3129425117 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79ec03c780 0x7f79ec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.644+0000 7f7b15c2f800 1 Processor -- start 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.644+0000 7f7b12f18640 1 --2- 172.21.15.192:0/3129425117 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79ec03c780 0x7f79ec03ec40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x560f08346fc0 tx=0x7f7b08006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.644+0000 7f7b15c2f800 1 -- start start 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.644+0000 7f7b15c2f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 0x560f0836fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.644+0000 7f7b15c2f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560f0833de10 con 0x560f0836f910 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.645+0000 7f7b13719640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 0x560f0836fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.645+0000 7f7b13719640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 0x560f0836fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58808/0 (socket says 172.21.15.192:58808) 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.645+0000 7f7b13719640 1 -- 172.21.15.192:0/2310136252 learned_addr learned my addr 172.21.15.192:0/2310136252 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.645+0000 7f7b13719640 1 -- 172.21.15.192:0/2310136252 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f083702e0 con 0x560f0836f910 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.645+0000 7f7b13719640 1 --2- 172.21.15.192:0/2310136252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 0x560f0836fcf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b04087fb0 tx=0x7f7b040970a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa89b85ee52e8dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.645+0000 7f79f6ffd640 1 -- 172.21.15.192:0/2310136252 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b040903b0 con 0x560f0836f910 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.645+0000 7f79f6ffd640 1 -- 172.21.15.192:0/2310136252 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b040a6070 con 0x560f0836f910 2024-09-10T05:11:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.645+0000 7f79f6ffd640 1 -- 172.21.15.192:0/2310136252 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b04089070 con 0x560f0836f910 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b15c2f800 1 -- 172.21.15.192:0/2310136252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 msgr2=0x560f0836fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/2310136252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 0x560f0836fcf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b04087fb0 tx=0x7f7b040970a0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b15c2f800 1 -- 172.21.15.192:0/2310136252 shutdown_connections 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/2310136252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 0x560f0836fcf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b15c2f800 1 -- 172.21.15.192:0/2310136252 >> 172.21.15.192:0/2310136252 conn(0x560f0836bd10 msgr2=0x560f08369f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b15c2f800 1 -- 172.21.15.192:0/2310136252 shutdown_connections 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b15c2f800 1 -- 172.21.15.192:0/2310136252 wait complete. 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b15c2f800 1 Processor -- start 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b15c2f800 1 -- start start 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b15c2f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 0x560f08376d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b15c2f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560f08370770 con 0x560f0836f910 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b13719640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 0x560f08376d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b13719640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 0x560f08376d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58812/0 (socket says 172.21.15.192:58812) 2024-09-10T05:11:45.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.646+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 learned_addr learned my addr 172.21.15.192:0/4165307831 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.647+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f083772b0 con 0x560f0836f910 2024-09-10T05:11:45.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.647+0000 7f7b13719640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 0x560f08376d50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7b0406cfd0 tx=0x7f7b0405cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.647+0000 7f79f57fa640 1 -- 172.21.15.192:0/4165307831 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0405ee60 con 0x560f0836f910 2024-09-10T05:11:45.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.647+0000 7f79f57fa640 1 -- 172.21.15.192:0/4165307831 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b04069c40 con 0x560f0836f910 2024-09-10T05:11:45.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.647+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f083772b0 con 0x560f0836f910 2024-09-10T05:11:45.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.647+0000 7f79f57fa640 1 -- 172.21.15.192:0/4165307831 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b040749f0 con 0x560f0836f910 2024-09-10T05:11:45.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.647+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f083772b0 con 0x560f0836f910 2024-09-10T05:11:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.648+0000 7f79f57fa640 1 -- 172.21.15.192:0/4165307831 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7b04074b90 con 0x560f0836f910 2024-09-10T05:11:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.648+0000 7f79f57fa640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79dc03c710 0x7f79dc03ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.648+0000 7f7b12f18640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79dc03c710 0x7f79dc03ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.648+0000 7f79f57fa640 1 -- 172.21.15.192:0/4165307831 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f7b040b3070 con 0x560f0836f910 2024-09-10T05:11:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.648+0000 7f7b12f18640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79dc03c710 0x7f79dc03ebd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800ffd0 tx=0x7f7b08023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.649+0000 7f7b15c2f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.649+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f08382230 0x560f083846f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.649+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f08384e40 con 0x560f08382230 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.649+0000 7f7b13f1a640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f08382230 0x560f083846f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.649+0000 7f7b13f1a640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f08382230 0x560f083846f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.649+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.649+0000 7f7b15c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.649+0000 7f7b15c2f800 20 realm 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.649+0000 7f7b15c2f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.649+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f08385250 con 0x560f08382230 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b15c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b15c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b15c2f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f08385b20 con 0x560f08382230 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b15c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b15c2f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08382230 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b15c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b15c2f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f08386c20 0x560f08389010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f083895d0 con 0x560f08386c20 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.650+0000 7f7b13719640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f08386c20 0x560f08389010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.651+0000 7f7b13719640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f08386c20 0x560f08389010 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.651+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.651+0000 7f7b15c2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.651+0000 7f7b15c2f800 20 searching for the correct realm 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.651+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560f0838b580 0x560f0838da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.651+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f0838e110 con 0x560f0838b580 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.651+0000 7f7b12f18640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560f0838b580 0x560f0838da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.651+0000 7f7b12f18640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560f0838b580 0x560f0838da40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.652+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.652+0000 7f7b12f18640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7b0802e910 0x7f7b0803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.652+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f0838e110 con 0x7f7b0802e910 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.652+0000 7f7b13f1a640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7b0802e910 0x7f7b0803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.652+0000 7f7b13f1a640 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7b0802e910 0x7f7b0803a3c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.652+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.652+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08386c20 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.653+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.653+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08382230 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.653+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.653+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08382230 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.653+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.653+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08386c20 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.653+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.653+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08386c20 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.653+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.653+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x7f7b0802e910 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.654+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.654+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f0838b580 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.654+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.654+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08382230 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.654+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.654+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08386c20 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.654+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.654+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08382230 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.655+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.655+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x7f7b0802e910 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.655+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.655+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f0838b580 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.655+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.655+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f0838b580 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.655+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.655+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08386c20 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.656+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.656+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f0838b580 2024-09-10T05:11:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.656+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.656+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f0838b580 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.656+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.656+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08382230 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.657+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.657+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08382230 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.657+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.657+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08386c20 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.657+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.657+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f0838b580 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.657+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.657+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x7f7b0802e910 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.658+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.658+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08382230 2024-09-10T05:11:45.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.658+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.658+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08386c20 2024-09-10T05:11:45.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.658+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.658+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f0838b580 2024-09-10T05:11:45.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.658+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.658+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08386c20 2024-09-10T05:11:45.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.659+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.659+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x7f7b0802e910 2024-09-10T05:11:45.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.659+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.659+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f0838b580 2024-09-10T05:11:45.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.659+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.659+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08386c20 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.659+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.659+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x560f08382230 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f08385ec0 con 0x7f7b0802e910 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b15c2f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b15c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b15c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b15c2f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b15c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b15c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b15c2f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f08389e90 con 0x560f08382230 2024-09-10T05:11:45.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b15c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b15c2f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f08389e90 con 0x560f08382230 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.660+0000 7f7b15c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f08389e90 con 0x7f7b0802e910 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 20 zone default found 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 4 Realm: () 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:45.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 20 zonegroup default 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f08389e90 con 0x560f08386c20 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f0838ff80 con 0x560f0838b580 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.661+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.662+0000 7f7b15c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.662+0000 7f7b15c2f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.662+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f08390320 con 0x560f0838b580 2024-09-10T05:11:45.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.662+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.662+0000 7f7b15c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.662+0000 7f7b15c2f800 20 started sync module instance, tier type = 2024-09-10T05:11:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.662+0000 7f7b15c2f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.662+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f0838f420 con 0x7f7b0802e910 2024-09-10T05:11:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.663+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.663+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94622562447488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f0838fa90 con 0x7f7b0802e910 2024-09-10T05:11:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.663+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08390ce0 con 0x560f08382230 2024-09-10T05:11:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.664+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94622562447488] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.664+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.664+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94622562448608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08390ce0 con 0x560f08382230 2024-09-10T05:11:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.664+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08391770 con 0x560f0838b580 2024-09-10T05:11:45.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.665+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.665+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94622562448608] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.665+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94622562456128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08392010 con 0x560f0838b580 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.665+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083925a0 con 0x7f7b0802e910 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.666+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94622562456128] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.666+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.666+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94622562453552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08392990 con 0x7f7b0802e910 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.666+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08393350 con 0x560f08382230 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.668+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.668+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94622562463392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083932c0 con 0x560f08382230 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.668+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08394300 con 0x560f08386c20 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.668+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94622562453552] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.669+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94622562463392] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.669+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.669+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94622562465600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08393de0 con 0x560f08386c20 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.669+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08394ba0 con 0x560f08386c20 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.670+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.670+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94622562465600] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.670+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94622562470096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08391c00 con 0x560f08386c20 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.670+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083958f0 con 0x560f08386c20 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.673+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.673+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94622562472912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08395da0 con 0x560f08386c20 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.673+0000 7f7b15c2f800 20 add_watcher() i=0 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.673+0000 7f7b15c2f800 20 add_watcher() i=1 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.673+0000 7f7b15c2f800 20 add_watcher() i=2 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.673+0000 7f7b15c2f800 20 add_watcher() i=3 2024-09-10T05:11:45.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.673+0000 7f7b15c2f800 20 add_watcher() i=4 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.673+0000 7f7b15c2f800 20 add_watcher() i=5 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.673+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94622562470096] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.673+0000 7f7b15c2f800 20 add_watcher() i=6 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.674+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94622562472912] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.674+0000 7f7b15c2f800 20 add_watcher() i=7 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.674+0000 7f7b15c2f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.674+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f08395da0 con 0x560f08382230 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.674+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.674+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94622562474224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08395d10 con 0x560f08382230 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.675+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94622562474224] v35'42 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.675+0000 7f79c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.675+0000 7f7b15c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.675+0000 7f7b15c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:45.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.675+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a1730 con 0x560f08382230 2024-09-10T05:11:45.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.676+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'42 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.677+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a1730 con 0x560f08386c20 2024-09-10T05:11:45.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.678+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.678+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a1730 con 0x560f0838b580 2024-09-10T05:11:45.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.679+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.679+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a0eb0 con 0x560f08382230 2024-09-10T05:11:45.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.680+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'43 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.680+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a0eb0 con 0x7f7b0802e910 2024-09-10T05:11:45.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.681+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'32 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.681+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a2ed0 con 0x560f0838b580 2024-09-10T05:11:45.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.682+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'29 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.682+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a3720 con 0x560f08382230 2024-09-10T05:11:45.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.683+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.683+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a3720 con 0x560f08386c20 2024-09-10T05:11:45.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.684+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'23 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.684+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a3820 con 0x7f7b0802e910 2024-09-10T05:11:45.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.685+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.685+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a3c20 con 0x560f0838b580 2024-09-10T05:11:45.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.687+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.687+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a4050 con 0x7f7b0802e910 2024-09-10T05:11:45.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.690+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'33 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.690+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a4030 con 0x560f08386c20 2024-09-10T05:11:45.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.692+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.692+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a4000 con 0x7f7b0802e910 2024-09-10T05:11:45.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.693+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.693+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a4000 con 0x560f08386c20 2024-09-10T05:11:45.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.695+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.695+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a3f70 con 0x560f08382230 2024-09-10T05:11:45.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.696+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.696+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a3f70 con 0x560f0838b580 2024-09-10T05:11:45.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.698+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.698+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a3f70 con 0x7f7b0802e910 2024-09-10T05:11:45.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.699+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.699+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a3f70 con 0x560f0838b580 2024-09-10T05:11:45.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.700+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.700+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a4040 con 0x560f08382230 2024-09-10T05:11:45.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.701+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.701+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a4480 con 0x560f08382230 2024-09-10T05:11:45.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.702+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.702+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a42b0 con 0x560f0838b580 2024-09-10T05:11:45.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.703+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.703+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a4210 con 0x7f7b0802e910 2024-09-10T05:11:45.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.704+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.704+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a4650 con 0x560f0838b580 2024-09-10T05:11:45.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.705+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.705+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a45f0 con 0x560f0838b580 2024-09-10T05:11:45.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.706+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.706+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a45d0 con 0x560f0838b580 2024-09-10T05:11:45.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.707+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'15 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.707+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a45d0 con 0x560f0838b580 2024-09-10T05:11:45.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.708+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.708+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a45d0 con 0x560f08386c20 2024-09-10T05:11:45.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.709+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.709+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a45d0 con 0x560f0838b580 2024-09-10T05:11:45.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.710+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.710+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a45d0 con 0x560f08386c20 2024-09-10T05:11:45.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.711+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.711+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a45d0 con 0x560f0838b580 2024-09-10T05:11:45.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.712+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.712+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a45d0 con 0x560f08386c20 2024-09-10T05:11:45.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.713+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'36 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.713+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a45d0 con 0x7f7b0802e910 2024-09-10T05:11:45.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.714+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.714+0000 7f79c8fe1640 20 reqs_thread_entry: start 2024-09-10T05:11:45.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.715+0000 7f7b15c2f800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:45.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.715+0000 7f7b15c2f800 20 Filter name: none 2024-09-10T05:11:45.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.715+0000 7f79427fc640 20 reqs_thread_entry: start 2024-09-10T05:11:45.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.715+0000 7f7b15c2f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:11:45.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.715+0000 7f7b15c2f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.715+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f083cf230 con 0x560f08386c20 2024-09-10T05:11:45.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.715+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.715+0000 7f7b15c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.715+0000 7f7b15c2f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T05:11:45.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.715+0000 7f7b15c2f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:11:45.717 INFO:teuthology.orchestra.run.smithi192.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T05:11:45.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.716+0000 7f79c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:45.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.716+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94622562474224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083a2150 con 0x560f08382230 2024-09-10T05:11:45.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.717+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94622562474224] v35'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.717+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94622562447488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083958f0 con 0x7f7b0802e910 2024-09-10T05:11:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.718+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94622562447488] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.718+0000 7f7b15c2f800 20 remove_watcher() i=0 2024-09-10T05:11:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.718+0000 7f7b15c2f800 2 removed watcher, disabling cache 2024-09-10T05:11:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.718+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94622562448608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083958f0 con 0x560f08382230 2024-09-10T05:11:45.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.719+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94622562448608] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.719+0000 7f7b15c2f800 20 remove_watcher() i=1 2024-09-10T05:11:45.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.719+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94622562456128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083958f0 con 0x560f0838b580 2024-09-10T05:11:45.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.720+0000 7f7b12f18640 1 -- 172.21.15.192:0/4165307831 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94622562456128] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b08037040 con 0x560f0838b580 2024-09-10T05:11:45.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.720+0000 7f7b15c2f800 20 remove_watcher() i=2 2024-09-10T05:11:45.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.720+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94622562453552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083958f0 con 0x7f7b0802e910 2024-09-10T05:11:45.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.721+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94622562453552] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x7f7b0802e910 2024-09-10T05:11:45.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.721+0000 7f7b15c2f800 20 remove_watcher() i=3 2024-09-10T05:11:45.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.721+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94622562463392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08390830 con 0x560f08382230 2024-09-10T05:11:45.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.723+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94622562463392] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c00a4d0 con 0x560f08382230 2024-09-10T05:11:45.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.724+0000 7f7b15c2f800 20 remove_watcher() i=4 2024-09-10T05:11:45.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.724+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94622562465600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f083958f0 con 0x560f08386c20 2024-09-10T05:11:45.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.724+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94622562465600] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.725+0000 7f7b15c2f800 20 remove_watcher() i=5 2024-09-10T05:11:45.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.725+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94622562470096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08392ea0 con 0x560f08386c20 2024-09-10T05:11:45.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.725+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94622562470096] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.725+0000 7f7b15c2f800 20 remove_watcher() i=6 2024-09-10T05:11:45.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.725+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94622562472912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f08390830 con 0x560f08386c20 2024-09-10T05:11:45.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.726+0000 7f7b13719640 1 -- 172.21.15.192:0/4165307831 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94622562472912] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b040bc020 con 0x560f08386c20 2024-09-10T05:11:45.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.726+0000 7f7b15c2f800 20 remove_watcher() i=7 2024-09-10T05:11:45.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f08386c20 msgr2=0x560f08389010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f08386c20 0x560f08389010 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f08382230 msgr2=0x560f083846f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f08382230 0x560f083846f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7b0802e910 msgr2=0x7f7b0803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7b0802e910 0x7f7b0803a3c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560f0838b580 msgr2=0x560f0838da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560f0838b580 0x560f0838da40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79dc03c710 msgr2=0x7f79dc03ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79dc03c710 0x7f79dc03ebd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800ffd0 tx=0x7f7b08023040 comp rx=0 tx=0).stop 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b13f1a640 1 -- 172.21.15.192:0/4165307831 reap_dead start 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 msgr2=0x560f08376d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 0x560f08376d50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7b0406cfd0 tx=0x7f7b0405cc60 comp rx=0 tx=0).stop 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 shutdown_connections 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/4165307831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0836f910 0x560f08376d50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 >> 172.21.15.192:0/4165307831 conn(0x560f0836bd10 msgr2=0x560f08369f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 shutdown_connections 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/4165307831 wait complete. 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3129425117 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79ec03c780 msgr2=0x7f79ec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3129425117 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79ec03c780 0x7f79ec03ec40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x560f08346fc0 tx=0x7f7b08006000 comp rx=0 tx=0).stop 2024-09-10T05:11:45.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3129425117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f08363030 msgr2=0x560f08363450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3129425117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f08363030 0x560f08363450 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7b04067ff0 tx=0x7f7b0407cac0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3129425117 shutdown_connections 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3129425117 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79ec03c780 0x7f79ec03ec40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3129425117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f08363030 0x560f08363450 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3129425117 >> 172.21.15.192:0/3129425117 conn(0x560f083573e0 msgr2=0x560f083577c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3129425117 shutdown_connections 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.727+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3129425117 wait complete. 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f0834e8b0 msgr2=0x560f08350d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f0834e8b0 0x560f08350d50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f0824ae00 msgr2=0x560f0834c550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f0824ae00 0x560f0834c550 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560f08352940 msgr2=0x560f08354d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560f08352940 0x560f08354d30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79f803c780 msgr2=0x7f79f803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79f803c780 0x7f79f803ec40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7b08000c00 tx=0x7f7b080013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 msgr2=0x560f08344f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 --2- 172.21.15.192:0/3978289997 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f0824a4c0 0x560f08344f00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400a470 tx=0x7f7b04002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b13f1a640 1 -- 172.21.15.192:0/3978289997 reap_dead start 2024-09-10T05:11:45.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 shutdown_connections 2024-09-10T05:11:45.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 >> 172.21.15.192:0/3978289997 conn(0x560f082461f0 msgr2=0x560f08337790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 shutdown_connections 2024-09-10T05:11:45.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.728+0000 7f7b15c2f800 1 -- 172.21.15.192:0/3978289997 wait complete. 2024-09-10T05:11:45.739 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T05:11:45.739 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T05:11:45.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T05:11:45.740 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T05:11:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.784+0000 7ff413d3d800 1 Processor -- start 2024-09-10T05:11:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.784+0000 7ff413d3d800 1 -- start start 2024-09-10T05:11:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.784+0000 7ff413d3d800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x559e62e36200 0x559e62e3bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.784+0000 7ff413d3d800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e62cdfe40 con 0x559e62e34df0 2024-09-10T05:11:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.784+0000 7ff413d3d800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x559e62caa680 con 0x559e62e36200 2024-09-10T05:11:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.785+0000 7ff40f229640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x559e62e36200 0x559e62e3bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.785+0000 7ff40fa2a640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x559e62e34df0 0x559e62e35af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36150/0 (socket says 172.21.15.192:36150) 2024-09-10T05:11:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.785+0000 7ff40fa2a640 1 -- 172.21.15.192:0/4219792077 learned_addr learned my addr 172.21.15.192:0/4219792077 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.785+0000 7ff40f229640 1 -- 172.21.15.192:0/4219792077 >> v1:172.21.15.139:6789/0 conn(0x559e62e34df0 legacy=0x559e62e35af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.785+0000 7ff40f229640 1 -- 172.21.15.192:0/4219792077 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e62cc66b0 con 0x559e62e36200 2024-09-10T05:11:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.785+0000 7ff40ea28640 1 -- 172.21.15.192:0/4219792077 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3395134258 0 0) 0x559e62cdfe40 con 0x559e62e34df0 2024-09-10T05:11:45.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.787+0000 7ff40f229640 1 --2- 172.21.15.192:0/4219792077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e36200 0x559e62e3bda0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff40400a470 tx=0x7ff404045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388e25a016587d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.787+0000 7ff40ea28640 1 -- 172.21.15.192:0/4219792077 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff404053570 con 0x559e62e36200 2024-09-10T05:11:45.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.787+0000 7ff40ea28640 1 -- 172.21.15.192:0/4219792077 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff404058070 con 0x559e62e36200 2024-09-10T05:11:45.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.787+0000 7ff40ea28640 1 -- 172.21.15.192:0/4219792077 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff404053880 con 0x559e62e36200 2024-09-10T05:11:45.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.787+0000 7ff413d3d800 1 -- 172.21.15.192:0/4219792077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e36200 msgr2=0x559e62e3bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.787+0000 7ff413d3d800 1 --2- 172.21.15.192:0/4219792077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e36200 0x559e62e3bda0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff40400a470 tx=0x7ff404045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.787+0000 7ff413d3d800 1 -- 172.21.15.192:0/4219792077 shutdown_connections 2024-09-10T05:11:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.787+0000 7ff413d3d800 1 --2- 172.21.15.192:0/4219792077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e36200 0x559e62e3bda0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.787+0000 7ff413d3d800 1 -- 172.21.15.192:0/4219792077 >> 172.21.15.192:0/4219792077 conn(0x559e62e301c0 msgr2=0x559e62e32620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.787+0000 7ff413d3d800 1 -- 172.21.15.192:0/4219792077 shutdown_connections 2024-09-10T05:11:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.787+0000 7ff413d3d800 1 -- 172.21.15.192:0/4219792077 wait complete. 2024-09-10T05:11:45.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.801+0000 7ff413d3d800 1 Processor -- start 2024-09-10T05:11:45.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.801+0000 7ff413d3d800 1 -- start start 2024-09-10T05:11:45.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.801+0000 7ff413d3d800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 0x559e62f27670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.801+0000 7ff413d3d800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559e62ccedd0 con 0x559e62e34df0 2024-09-10T05:11:45.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.801+0000 7ff40fa2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 0x559e62f27670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.801+0000 7ff40fa2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 0x559e62f27670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58822/0 (socket says 172.21.15.192:58822) 2024-09-10T05:11:45.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.801+0000 7ff40fa2a640 1 -- 172.21.15.192:0/1869104477 learned_addr learned my addr 172.21.15.192:0/1869104477 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.802+0000 7ff40fa2a640 1 -- 172.21.15.192:0/1869104477 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e62ce7e10 con 0x559e62e34df0 2024-09-10T05:11:45.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.802+0000 7ff40fa2a640 1 --2- 172.21.15.192:0/1869104477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 0x559e62f27670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff400001ea0 tx=0x7ff40000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f872393c445251f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.802+0000 7ff2fde0b640 1 -- 172.21.15.192:0/1869104477 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff400008070 con 0x559e62e34df0 2024-09-10T05:11:45.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.802+0000 7ff2fde0b640 1 -- 172.21.15.192:0/1869104477 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40000d500 con 0x559e62e34df0 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.802+0000 7ff2fde0b640 1 -- 172.21.15.192:0/1869104477 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff40000d880 con 0x559e62e34df0 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff413d3d800 1 -- 172.21.15.192:0/1869104477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 msgr2=0x559e62f27670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff413d3d800 1 --2- 172.21.15.192:0/1869104477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 0x559e62f27670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff400001ea0 tx=0x7ff40000b6a0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff413d3d800 1 -- 172.21.15.192:0/1869104477 shutdown_connections 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff413d3d800 1 --2- 172.21.15.192:0/1869104477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 0x559e62f27670 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff413d3d800 1 -- 172.21.15.192:0/1869104477 >> 172.21.15.192:0/1869104477 conn(0x559e62e301c0 msgr2=0x559e62f1ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff413d3d800 1 -- 172.21.15.192:0/1869104477 shutdown_connections 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff413d3d800 1 -- 172.21.15.192:0/1869104477 wait complete. 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff413d3d800 1 Processor -- start 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff413d3d800 1 -- start start 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff413d3d800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 0x559e62f2f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff413d3d800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559e62e368f0 con 0x559e62e34df0 2024-09-10T05:11:45.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff40fa2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 0x559e62f2f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff40fa2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 0x559e62f2f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58828/0 (socket says 172.21.15.192:58828) 2024-09-10T05:11:45.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.803+0000 7ff40fa2a640 1 -- 172.21.15.192:0/56118343 learned_addr learned my addr 172.21.15.192:0/56118343 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.804+0000 7ff40fa2a640 1 -- 172.21.15.192:0/56118343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e62f2f560 con 0x559e62e34df0 2024-09-10T05:11:45.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.804+0000 7ff40fa2a640 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 0x559e62f2f000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff400000f60 tx=0x7ff400000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.804+0000 7ff2f7fff640 1 -- 172.21.15.192:0/56118343 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff40000f8d0 con 0x559e62e34df0 2024-09-10T05:11:45.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.804+0000 7ff2f7fff640 1 -- 172.21.15.192:0/56118343 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40000fa70 con 0x559e62e34df0 2024-09-10T05:11:45.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.804+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e62f2f7f0 con 0x559e62e34df0 2024-09-10T05:11:45.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.804+0000 7ff2f7fff640 1 -- 172.21.15.192:0/56118343 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff40000fd50 con 0x559e62e34df0 2024-09-10T05:11:45.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.804+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e62f301f0 con 0x559e62e34df0 2024-09-10T05:11:45.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.805+0000 7ff2f7fff640 1 -- 172.21.15.192:0/56118343 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff400017040 con 0x559e62e34df0 2024-09-10T05:11:45.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.805+0000 7ff2f7fff640 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2f803c730 0x7ff2f803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.805+0000 7ff2f7fff640 1 -- 172.21.15.192:0/56118343 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7ff400015020 con 0x559e62e34df0 2024-09-10T05:11:45.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.805+0000 7ff40f229640 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2f803c730 0x7ff2f803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.805+0000 7ff413d3d800 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559e62e36200 0x559e62f36650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.805+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f36b90 con 0x559e62e36200 2024-09-10T05:11:45.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.805+0000 7ff41022b640 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559e62e36200 0x559e62f36650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.805+0000 7ff40f229640 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2f803c730 0x7ff2f803ebf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff404057000 tx=0x7ff404052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.806+0000 7ff41022b640 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559e62e36200 0x559e62f36650 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.806+0000 7ff41022b640 1 -- 172.21.15.192:0/56118343 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62e36200 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.806+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f36f30 con 0x559e62e36200 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.806+0000 7ff41022b640 1 -- 172.21.15.192:0/56118343 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62e36200 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.806+0000 7ff413d3d800 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559e62f38a30 0x559e62f3aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.806+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f3b640 con 0x559e62f38a30 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.806+0000 7ff40fa2a640 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559e62f38a30 0x559e62f3aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.807+0000 7ff40fa2a640 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559e62f38a30 0x559e62f3aeb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.807+0000 7ff40fa2a640 1 -- 172.21.15.192:0/56118343 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f38a30 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.807+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f37780 con 0x559e62e36200 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.807+0000 7ff41022b640 1 -- 172.21.15.192:0/56118343 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62e36200 2024-09-10T05:11:45.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.807+0000 7ff413d3d800 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x559e62f3caa0 0x559e62f3ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.807+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f3f600 con 0x559e62f3caa0 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.807+0000 7ff40f229640 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x559e62f3caa0 0x559e62f3ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.808+0000 7ff40f229640 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x559e62f3caa0 0x559e62f3ee90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.808+0000 7ff40f229640 1 -- 172.21.15.192:0/56118343 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff404051070 con 0x559e62f3caa0 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.808+0000 7ff413d3d800 1 Processor -- start 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.808+0000 7ff413d3d800 1 -- start start 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.808+0000 7ff413d3d800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f4d230 0x559e62f4d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.808+0000 7ff413d3d800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559e62d2ca00 con 0x559e62f4d230 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.809+0000 7ff40fa2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f4d230 0x559e62f4d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.809+0000 7ff40fa2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f4d230 0x559e62f4d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58836/0 (socket says 172.21.15.192:58836) 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.809+0000 7ff40fa2a640 1 -- 172.21.15.192:0/2431715444 learned_addr learned my addr 172.21.15.192:0/2431715444 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.809+0000 7ff40fa2a640 1 -- 172.21.15.192:0/2431715444 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e62f4dc90 con 0x559e62f4d230 2024-09-10T05:11:45.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.809+0000 7ff40fa2a640 1 --2- 172.21.15.192:0/2431715444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f4d230 0x559e62f4d650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff40000ea90 tx=0x7ff400018e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.809+0000 7ff2f57fa640 1 -- 172.21.15.192:0/2431715444 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff40004a070 con 0x559e62f4d230 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.809+0000 7ff2f57fa640 1 -- 172.21.15.192:0/2431715444 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40001a3c0 con 0x559e62f4d230 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.809+0000 7ff413d3d800 1 -- 172.21.15.192:0/2431715444 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e62f4e4c0 con 0x559e62f4d230 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.809+0000 7ff2f57fa640 1 -- 172.21.15.192:0/2431715444 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff400019470 con 0x559e62f4d230 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.809+0000 7ff413d3d800 1 -- 172.21.15.192:0/2431715444 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e62f4ea60 con 0x559e62f4d230 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.810+0000 7ff2f57fa640 1 -- 172.21.15.192:0/2431715444 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff400019610 con 0x559e62f4d230 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.810+0000 7ff2f57fa640 1 --2- 172.21.15.192:0/2431715444 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2e803c780 0x7ff2e803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.810+0000 7ff2f57fa640 1 -- 172.21.15.192:0/2431715444 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7ff40003bfd0 con 0x559e62f4d230 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.810+0000 7ff40f229640 1 --2- 172.21.15.192:0/2431715444 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2e803c780 0x7ff2e803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.811+0000 7ff413d3d800 1 Processor -- start 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.811+0000 7ff40f229640 1 --2- 172.21.15.192:0/2431715444 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2e803c780 0x7ff2e803ec40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff404045f20 tx=0x7ff404005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.811+0000 7ff413d3d800 1 -- start start 2024-09-10T05:11:45.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.811+0000 7ff413d3d800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 0x559e62f59e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.811+0000 7ff413d3d800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559e62f27ec0 con 0x559e62f59a20 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.811+0000 7ff40fa2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 0x559e62f59e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.811+0000 7ff40fa2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 0x559e62f59e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58838/0 (socket says 172.21.15.192:58838) 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.811+0000 7ff40fa2a640 1 -- 172.21.15.192:0/608687743 learned_addr learned my addr 172.21.15.192:0/608687743 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.811+0000 7ff40fa2a640 1 -- 172.21.15.192:0/608687743 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e62f5a410 con 0x559e62f59a20 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.811+0000 7ff40fa2a640 1 --2- 172.21.15.192:0/608687743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 0x559e62f59e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff400026fd0 tx=0x7ff40003e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c84329a645439 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.812+0000 7ff2eeffd640 1 -- 172.21.15.192:0/608687743 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff40004b260 con 0x559e62f59a20 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.812+0000 7ff2eeffd640 1 -- 172.21.15.192:0/608687743 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40002f3e0 con 0x559e62f59a20 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.812+0000 7ff2eeffd640 1 -- 172.21.15.192:0/608687743 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff400026430 con 0x559e62f59a20 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.812+0000 7ff413d3d800 1 -- 172.21.15.192:0/608687743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 msgr2=0x559e62f59e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.812+0000 7ff413d3d800 1 --2- 172.21.15.192:0/608687743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 0x559e62f59e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff400026fd0 tx=0x7ff40003e6c0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.812+0000 7ff413d3d800 1 -- 172.21.15.192:0/608687743 shutdown_connections 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.812+0000 7ff413d3d800 1 --2- 172.21.15.192:0/608687743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 0x559e62f59e20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.812+0000 7ff413d3d800 1 -- 172.21.15.192:0/608687743 >> 172.21.15.192:0/608687743 conn(0x559e62f55e20 msgr2=0x559e62f54060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.812+0000 7ff413d3d800 1 -- 172.21.15.192:0/608687743 shutdown_connections 2024-09-10T05:11:45.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.812+0000 7ff413d3d800 1 -- 172.21.15.192:0/608687743 wait complete. 2024-09-10T05:11:45.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.812+0000 7ff413d3d800 1 Processor -- start 2024-09-10T05:11:45.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.812+0000 7ff413d3d800 1 -- start start 2024-09-10T05:11:45.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.813+0000 7ff413d3d800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 0x559e62f60df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.813+0000 7ff413d3d800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559e62f5a880 con 0x559e62f59a20 2024-09-10T05:11:45.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.813+0000 7ff40fa2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 0x559e62f60df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.813+0000 7ff40fa2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 0x559e62f60df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58844/0 (socket says 172.21.15.192:58844) 2024-09-10T05:11:45.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.813+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 learned_addr learned my addr 172.21.15.192:0/736186164 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.813+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e62f61350 con 0x559e62f59a20 2024-09-10T05:11:45.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.813+0000 7ff40fa2a640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 0x559e62f60df0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff400032030 tx=0x7ff40003a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.813+0000 7ff2ed7fa640 1 -- 172.21.15.192:0/736186164 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff400030480 con 0x559e62f59a20 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.813+0000 7ff2ed7fa640 1 -- 172.21.15.192:0/736186164 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff400026430 con 0x559e62f59a20 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.813+0000 7ff2ed7fa640 1 -- 172.21.15.192:0/736186164 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff40004b540 con 0x559e62f59a20 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.813+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e62f61350 con 0x559e62f59a20 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.813+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e62f61350 con 0x559e62f59a20 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.814+0000 7ff2ed7fa640 1 -- 172.21.15.192:0/736186164 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff40002f9b0 con 0x559e62f59a20 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.814+0000 7ff2ed7fa640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2d803c780 0x7ff2d803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.814+0000 7ff2ed7fa640 1 -- 172.21.15.192:0/736186164 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7ff400069c40 con 0x559e62f59a20 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.814+0000 7ff40f229640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2d803c780 0x7ff2d803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.815+0000 7ff40f229640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2d803c780 0x7ff2d803ec40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff4040539f0 tx=0x7ff40406b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.815+0000 7ff413d3d800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.815+0000 7ff413d3d800 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559e62f6c2e0 0x559e62f6e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.815+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6eef0 con 0x559e62f6c2e0 2024-09-10T05:11:45.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.815+0000 7ff41022b640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559e62f6c2e0 0x559e62f6e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.815+0000 7ff41022b640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559e62f6c2e0 0x559e62f6e7a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 20 realm 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6f300 con 0x559e62f6c2e0 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6fbd0 con 0x559e62f6c2e0 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f6c2e0 2024-09-10T05:11:45.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:45.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559e62f70cd0 0x559e62f730c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.816+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f73680 con 0x559e62f70cd0 2024-09-10T05:11:45.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.817+0000 7ff40fa2a640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559e62f70cd0 0x559e62f730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.817+0000 7ff40fa2a640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559e62f70cd0 0x559e62f730c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.817+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.817+0000 7ff413d3d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:45.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.817+0000 7ff413d3d800 20 searching for the correct realm 2024-09-10T05:11:45.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.817+0000 7ff413d3d800 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x559e62f75630 0x559e62f77af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.817+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f781c0 con 0x559e62f75630 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.817+0000 7ff40f229640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x559e62f75630 0x559e62f77af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.818+0000 7ff40f229640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x559e62f75630 0x559e62f77af0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.818+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.818+0000 7ff40f229640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7ff40408a040 0x7ff40408a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.818+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f781c0 con 0x7ff40408a040 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.818+0000 7ff41022b640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7ff40408a040 0x7ff40408a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.818+0000 7ff41022b640 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7ff40408a040 0x7ff40408a420 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.818+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.818+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f70cd0 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.819+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.819+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f6c2e0 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.819+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.819+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f6c2e0 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.819+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.819+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f70cd0 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.819+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.819+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f70cd0 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.820+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.820+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x7ff40408a040 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.820+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.820+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f75630 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.820+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.820+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f6c2e0 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.820+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.820+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f70cd0 2024-09-10T05:11:45.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.821+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.821+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f6c2e0 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.821+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.821+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x7ff40408a040 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.821+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.821+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f75630 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.821+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.821+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f75630 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.821+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.821+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f70cd0 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.822+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.822+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f75630 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.822+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.822+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f75630 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.822+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.822+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f6c2e0 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.822+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.822+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f6c2e0 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.823+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.823+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f70cd0 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.823+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.823+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f75630 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.823+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.823+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x7ff40408a040 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.823+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.823+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f6c2e0 2024-09-10T05:11:45.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.824+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.824+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f70cd0 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.824+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.824+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f75630 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.824+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.824+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f70cd0 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.824+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.824+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x7ff40408a040 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.825+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.825+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f75630 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.825+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.825+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f70cd0 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.825+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.825+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x559e62f6c2e0 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.825+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.825+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e62f6ff70 con 0x7ff40408a040 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f73f40 con 0x559e62f6c2e0 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f73f40 con 0x559e62f6c2e0 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f73f40 con 0x7ff40408a040 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 zone default found 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 4 Realm: () 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 zonegroup default 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.826+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f747e0 con 0x559e62f70cd0 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff413d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff413d3d800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7a030 con 0x559e62f75630 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff413d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff413d3d800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7a3d0 con 0x559e62f75630 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff413d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff413d3d800 20 started sync module instance, tier type = 2024-09-10T05:11:45.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff413d3d800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:45.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.827+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f794d0 con 0x7ff40408a040 2024-09-10T05:11:45.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.828+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.828+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94138753587744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f794d0 con 0x7ff40408a040 2024-09-10T05:11:45.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.828+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7acc0 con 0x559e62f6c2e0 2024-09-10T05:11:45.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.831+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.831+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94138753591152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7acc0 con 0x559e62f6c2e0 2024-09-10T05:11:45.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.831+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7bcb0 con 0x559e62f75630 2024-09-10T05:11:45.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.831+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94138753587744] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.834+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.834+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94138753591152] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.834+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94138753595264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f79020 con 0x559e62f75630 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.834+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7c580 con 0x7ff40408a040 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.834+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94138753595264] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.835+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.835+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94138753597648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7c4f0 con 0x7ff40408a040 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.835+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7d440 con 0x559e62f6c2e0 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.836+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.836+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94138753601424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7d860 con 0x559e62f6c2e0 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.836+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7e310 con 0x559e62f70cd0 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.839+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94138753597648] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.839+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.839+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94138753599856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7e700 con 0x559e62f70cd0 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.839+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7f100 con 0x559e62f70cd0 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.842+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94138753601424] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.842+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.842+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94138753602480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7f9a0 con 0x559e62f70cd0 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.842+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f80270 con 0x559e62f70cd0 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.845+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.845+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94138753612192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7fdc0 con 0x559e62f70cd0 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.845+0000 7ff413d3d800 20 add_watcher() i=0 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.845+0000 7ff413d3d800 20 add_watcher() i=1 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.845+0000 7ff413d3d800 20 add_watcher() i=2 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.845+0000 7ff413d3d800 20 add_watcher() i=3 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.845+0000 7ff413d3d800 20 add_watcher() i=4 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.845+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(55 notify.5 [watch watch cookie 94138753599856] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.845+0000 7ff413d3d800 20 add_watcher() i=5 2024-09-10T05:11:45.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.848+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94138753612192] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.848+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(57 notify.6 [watch watch cookie 94138753602480] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.848+0000 7ff413d3d800 20 add_watcher() i=6 2024-09-10T05:11:45.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.848+0000 7ff413d3d800 20 add_watcher() i=7 2024-09-10T05:11:45.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.848+0000 7ff413d3d800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:45.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.848+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62f80660 con 0x559e62f6c2e0 2024-09-10T05:11:45.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.848+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.848+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94138753615456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7ddf0 con 0x559e62f6c2e0 2024-09-10T05:11:45.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.850+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94138753615456] v35'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.850+0000 7ff2c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:45.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.850+0000 7ff413d3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:45.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.850+0000 7ff413d3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:45.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.850+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8baf0 con 0x559e62f6c2e0 2024-09-10T05:11:45.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.851+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'43 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.851+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8baf0 con 0x559e62f70cd0 2024-09-10T05:11:45.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.853+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.853+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8baf0 con 0x559e62f75630 2024-09-10T05:11:45.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.854+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.854+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8b220 con 0x559e62f6c2e0 2024-09-10T05:11:45.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.855+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'48 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.855+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8b220 con 0x7ff40408a040 2024-09-10T05:11:45.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.856+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'35 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.856+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8d240 con 0x559e62f75630 2024-09-10T05:11:45.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.856+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'31 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.857+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8d600 con 0x559e62f6c2e0 2024-09-10T05:11:45.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.858+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.858+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8da40 con 0x559e62f70cd0 2024-09-10T05:11:45.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.859+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'25 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.859+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8da40 con 0x7ff40408a040 2024-09-10T05:11:45.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.860+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.860+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8da40 con 0x559e62f75630 2024-09-10T05:11:45.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.862+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.862+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8a280 con 0x7ff40408a040 2024-09-10T05:11:45.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.865+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'36 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.865+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8a240 con 0x559e62f70cd0 2024-09-10T05:11:45.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.866+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.867+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8a1e0 con 0x7ff40408a040 2024-09-10T05:11:45.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.867+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.867+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8a3b0 con 0x559e62f70cd0 2024-09-10T05:11:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.868+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.869+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8a3b0 con 0x559e62f6c2e0 2024-09-10T05:11:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.869+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.869+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8a3b0 con 0x559e62f75630 2024-09-10T05:11:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.871+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.871+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8a3b0 con 0x7ff40408a040 2024-09-10T05:11:45.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.871+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.872+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8a3b0 con 0x559e62f75630 2024-09-10T05:11:45.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.872+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.872+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8a3b0 con 0x559e62f6c2e0 2024-09-10T05:11:45.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.873+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.873+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x559e62f6c2e0 2024-09-10T05:11:45.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.874+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'50 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.875+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x559e62f75630 2024-09-10T05:11:45.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.876+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.876+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x7ff40408a040 2024-09-10T05:11:45.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.877+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.877+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x559e62f75630 2024-09-10T05:11:45.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.877+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.877+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x559e62f75630 2024-09-10T05:11:45.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.878+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.878+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x559e62f75630 2024-09-10T05:11:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.879+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'16 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.879+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x559e62f75630 2024-09-10T05:11:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.880+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.880+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x559e62f70cd0 2024-09-10T05:11:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.881+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.881+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x559e62f75630 2024-09-10T05:11:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.883+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.883+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x559e62f70cd0 2024-09-10T05:11:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.884+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.884+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x559e62f75630 2024-09-10T05:11:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.885+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.885+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x559e62f70cd0 2024-09-10T05:11:45.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.885+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'38 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.886+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f8e5a0 con 0x7ff40408a040 2024-09-10T05:11:45.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.887+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.887+0000 7ff2c4fe1640 20 reqs_thread_entry: start 2024-09-10T05:11:45.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.887+0000 7ff413d3d800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:45.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.887+0000 7ff413d3d800 20 Filter name: none 2024-09-10T05:11:45.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.887+0000 7ff23e7fc640 20 reqs_thread_entry: start 2024-09-10T05:11:45.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.887+0000 7ff413d3d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:45.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.887+0000 7ff413d3d800 20 rados->read ofs=0 len=0 2024-09-10T05:11:45.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.887+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e62fb9230 con 0x559e62f6c2e0 2024-09-10T05:11:45.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.887+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.887+0000 7ff413d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:45.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.887+0000 7ff413d3d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-10T05:11:45.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.887+0000 7ff413d3d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:45.889 INFO:teuthology.orchestra.run.smithi192.stderr:could not remove user: unable to remove user, user does not exist 2024-09-10T05:11:45.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.888+0000 7ff2c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:45.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.888+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94138753615456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f89250 con 0x559e62f6c2e0 2024-09-10T05:11:45.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.889+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94138753615456] v35'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.889+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94138753587744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f80660 con 0x7ff40408a040 2024-09-10T05:11:45.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.890+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94138753587744] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.890+0000 7ff413d3d800 20 remove_watcher() i=0 2024-09-10T05:11:45.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.890+0000 7ff413d3d800 2 removed watcher, disabling cache 2024-09-10T05:11:45.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.890+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94138753591152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f79a20 con 0x559e62f6c2e0 2024-09-10T05:11:45.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.891+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94138753591152] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.891+0000 7ff413d3d800 20 remove_watcher() i=1 2024-09-10T05:11:45.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.891+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94138753595264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f79a20 con 0x559e62f75630 2024-09-10T05:11:45.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.892+0000 7ff40f229640 1 -- 172.21.15.192:0/736186164 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94138753595264] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff404051070 con 0x559e62f75630 2024-09-10T05:11:45.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.892+0000 7ff413d3d800 20 remove_watcher() i=2 2024-09-10T05:11:45.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.892+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94138753597648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f79a20 con 0x7ff40408a040 2024-09-10T05:11:45.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.893+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94138753597648] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x7ff40408a040 2024-09-10T05:11:45.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.893+0000 7ff413d3d800 20 remove_watcher() i=3 2024-09-10T05:11:45.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.893+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94138753601424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7c0d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.894+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94138753601424] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40800a4d0 con 0x559e62f6c2e0 2024-09-10T05:11:45.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.894+0000 7ff413d3d800 20 remove_watcher() i=4 2024-09-10T05:11:45.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.894+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94138753599856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f79a20 con 0x559e62f70cd0 2024-09-10T05:11:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.895+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94138753599856] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.895+0000 7ff413d3d800 20 remove_watcher() i=5 2024-09-10T05:11:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.895+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94138753602480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7cf90 con 0x559e62f70cd0 2024-09-10T05:11:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.896+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94138753602480] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.896+0000 7ff413d3d800 20 remove_watcher() i=6 2024-09-10T05:11:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.896+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94138753612192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e62f7c0d0 con 0x559e62f70cd0 2024-09-10T05:11:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff40fa2a640 1 -- 172.21.15.192:0/736186164 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94138753612192] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff40002d070 con 0x559e62f70cd0 2024-09-10T05:11:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 20 remove_watcher() i=7 2024-09-10T05:11:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559e62f70cd0 msgr2=0x559e62f730c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559e62f70cd0 0x559e62f730c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559e62f6c2e0 msgr2=0x559e62f6e7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559e62f6c2e0 0x559e62f6e7a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7ff40408a040 msgr2=0x7ff40408a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7ff40408a040 0x7ff40408a420 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x559e62f75630 msgr2=0x559e62f77af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x559e62f75630 0x559e62f77af0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2d803c780 msgr2=0x7ff2d803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2d803c780 0x7ff2d803ec40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff4040539f0 tx=0x7ff40406b040 comp rx=0 tx=0).stop 2024-09-10T05:11:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 msgr2=0x559e62f60df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff413d3d800 1 --2- 172.21.15.192:0/736186164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f59a20 0x559e62f60df0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff400032030 tx=0x7ff40003a310 comp rx=0 tx=0).stop 2024-09-10T05:11:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.897+0000 7ff41022b640 1 -- 172.21.15.192:0/736186164 reap_dead start 2024-09-10T05:11:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 shutdown_connections 2024-09-10T05:11:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 >> 172.21.15.192:0/736186164 conn(0x559e62f55e20 msgr2=0x559e62f54030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 shutdown_connections 2024-09-10T05:11:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/736186164 wait complete. 2024-09-10T05:11:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/2431715444 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2e803c780 msgr2=0x7ff2e803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 --2- 172.21.15.192:0/2431715444 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2e803c780 0x7ff2e803ec40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff404045f20 tx=0x7ff404005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/2431715444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f4d230 msgr2=0x559e62f4d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 --2- 172.21.15.192:0/2431715444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f4d230 0x559e62f4d650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff40000ea90 tx=0x7ff400018e60 comp rx=0 tx=0).stop 2024-09-10T05:11:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/2431715444 shutdown_connections 2024-09-10T05:11:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 --2- 172.21.15.192:0/2431715444 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2e803c780 0x7ff2e803ec40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 --2- 172.21.15.192:0/2431715444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62f4d230 0x559e62f4d650 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/2431715444 >> 172.21.15.192:0/2431715444 conn(0x559e62f41590 msgr2=0x559e62f41970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/2431715444 shutdown_connections 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/2431715444 wait complete. 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559e62f38a30 msgr2=0x559e62f3aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559e62f38a30 0x559e62f3aeb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559e62e36200 msgr2=0x559e62f36650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559e62e36200 0x559e62f36650 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x559e62f3caa0 msgr2=0x559e62f3ee90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.898+0000 7ff413d3d800 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x559e62f3caa0 0x559e62f3ee90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.899+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2f803c730 msgr2=0x7ff2f803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.899+0000 7ff413d3d800 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff2f803c730 0x7ff2f803ebf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff404057000 tx=0x7ff404052000 comp rx=0 tx=0).stop 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.899+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 msgr2=0x559e62f2f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.899+0000 7ff413d3d800 1 --2- 172.21.15.192:0/56118343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e62e34df0 0x559e62f2f000 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff400000f60 tx=0x7ff400000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.899+0000 7ff41022b640 1 -- 172.21.15.192:0/56118343 reap_dead start 2024-09-10T05:11:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.899+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 shutdown_connections 2024-09-10T05:11:45.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.899+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 >> 172.21.15.192:0/56118343 conn(0x559e62e301c0 msgr2=0x559e62f28950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.899+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 shutdown_connections 2024-09-10T05:11:45.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.899+0000 7ff413d3d800 1 -- 172.21.15.192:0/56118343 wait complete. 2024-09-10T05:11:45.907 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T05:11:45.908 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T05:11:45.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T05:11:45.908 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-10T05:11:45.954 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:45.954 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:45.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.954+0000 7f5b0b92e800 1 Processor -- start 2024-09-10T05:11:45.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.954+0000 7f5b0b92e800 1 -- start start 2024-09-10T05:11:45.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.955+0000 7f5b0b92e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x563054557ed0 0x563054558bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.955+0000 7f5b0b92e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563054402e40 con 0x563054559110 2024-09-10T05:11:45.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.955+0000 7f5b0b92e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5630543cd680 con 0x563054557ed0 2024-09-10T05:11:45.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.955+0000 7f5b07564640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x563054557ed0 0x563054558bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.955+0000 7f5afffff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x563054559110 0x56305455de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36158/0 (socket says 172.21.15.192:36158) 2024-09-10T05:11:45.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.955+0000 7f5afffff640 1 -- 172.21.15.192:0/3720978184 learned_addr learned my addr 172.21.15.192:0/3720978184 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:45.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.955+0000 7f5b07564640 1 -- 172.21.15.192:0/3720978184 >> v1:172.21.15.139:6789/0 conn(0x563054559110 legacy=0x56305455de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.955+0000 7f5b07564640 1 -- 172.21.15.192:0/3720978184 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630543e96b0 con 0x563054557ed0 2024-09-10T05:11:45.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.955+0000 7f5b06d63640 1 -- 172.21.15.192:0/3720978184 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164324174 0 0) 0x563054402e40 con 0x563054559110 2024-09-10T05:11:45.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.957+0000 7f5b07564640 1 --2- 172.21.15.192:0/3720978184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054558bd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5af800a470 tx=0x7f5af8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957049d0283d2af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.957+0000 7f5b06d63640 1 -- 172.21.15.192:0/3720978184 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af8053570 con 0x563054557ed0 2024-09-10T05:11:45.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.957+0000 7f5b06d63640 1 -- 172.21.15.192:0/3720978184 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af8058070 con 0x563054557ed0 2024-09-10T05:11:45.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.957+0000 7f5b06d63640 1 -- 172.21.15.192:0/3720978184 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af8053880 con 0x563054557ed0 2024-09-10T05:11:45.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.957+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3720978184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 msgr2=0x563054558bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.957+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/3720978184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054558bd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5af800a470 tx=0x7f5af8045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:45.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.958+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3720978184 shutdown_connections 2024-09-10T05:11:45.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.958+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/3720978184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054558bd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.958+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3720978184 >> 172.21.15.192:0/3720978184 conn(0x5630545532c0 msgr2=0x563054555700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.958+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3720978184 shutdown_connections 2024-09-10T05:11:45.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.958+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3720978184 wait complete. 2024-09-10T05:11:45.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.971+0000 7f5b0b92e800 1 Processor -- start 2024-09-10T05:11:45.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.971+0000 7f5b0b92e800 1 -- start start 2024-09-10T05:11:45.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.971+0000 7f5b0b92e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054647480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.972+0000 7f5b0b92e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5630543f1dd0 con 0x563054557ed0 2024-09-10T05:11:45.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.972+0000 7f5b07564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054647480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.972+0000 7f5b07564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054647480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58868/0 (socket says 172.21.15.192:58868) 2024-09-10T05:11:45.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.972+0000 7f5b07564640 1 -- 172.21.15.192:0/2343473236 learned_addr learned my addr 172.21.15.192:0/2343473236 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.972+0000 7f5b07564640 1 -- 172.21.15.192:0/2343473236 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56305440ae10 con 0x563054557ed0 2024-09-10T05:11:45.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.972+0000 7f5b07564640 1 --2- 172.21.15.192:0/2343473236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054647480 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5af8025c20 tx=0x7f5af8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c455911a8a053db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.972+0000 7f59f560a640 1 -- 172.21.15.192:0/2343473236 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af805e2c0 con 0x563054557ed0 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.972+0000 7f59f560a640 1 -- 172.21.15.192:0/2343473236 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af805e8b0 con 0x563054557ed0 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.972+0000 7f59f560a640 1 -- 172.21.15.192:0/2343473236 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af805ebd0 con 0x563054557ed0 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.973+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2343473236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 msgr2=0x563054647480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.973+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/2343473236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054647480 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5af8025c20 tx=0x7f5af8051000 comp rx=0 tx=0).stop 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.973+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2343473236 shutdown_connections 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.973+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/2343473236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054647480 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.973+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2343473236 >> 172.21.15.192:0/2343473236 conn(0x5630545532c0 msgr2=0x563054642e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.973+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2343473236 shutdown_connections 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.973+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2343473236 wait complete. 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.973+0000 7f5b0b92e800 1 Processor -- start 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.974+0000 7f5b0b92e800 1 -- start start 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.974+0000 7f5b0b92e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054651fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.974+0000 7f5b0b92e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563054559800 con 0x563054557ed0 2024-09-10T05:11:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.974+0000 7f5b07564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054651fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.974+0000 7f5b07564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054651fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58876/0 (socket says 172.21.15.192:58876) 2024-09-10T05:11:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.974+0000 7f5b07564640 1 -- 172.21.15.192:0/2692901311 learned_addr learned my addr 172.21.15.192:0/2692901311 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.974+0000 7f5b07564640 1 -- 172.21.15.192:0/2692901311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563054652540 con 0x563054557ed0 2024-09-10T05:11:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.974+0000 7f5b07564640 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054651fe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5af8025c20 tx=0x7f5af8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.974+0000 7f59f3e07640 1 -- 172.21.15.192:0/2692901311 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af805ec50 con 0x563054557ed0 2024-09-10T05:11:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.975+0000 7f59f3e07640 1 -- 172.21.15.192:0/2692901311 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af8074070 con 0x563054557ed0 2024-09-10T05:11:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.975+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630546527d0 con 0x563054557ed0 2024-09-10T05:11:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.975+0000 7f59f3e07640 1 -- 172.21.15.192:0/2692901311 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af8053440 con 0x563054557ed0 2024-09-10T05:11:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.975+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630546531d0 con 0x563054557ed0 2024-09-10T05:11:45.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.975+0000 7f5b0b92e800 1 Processor -- start 2024-09-10T05:11:45.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.975+0000 7f5b0b92e800 1 -- start start 2024-09-10T05:11:45.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.975+0000 7f5b0b92e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 0x5630546618c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.975+0000 7f5b0b92e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56305444fa00 con 0x56305465f4d0 2024-09-10T05:11:45.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.975+0000 7f59f3e07640 1 -- 172.21.15.192:0/2692901311 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5af80535e0 con 0x563054557ed0 2024-09-10T05:11:45.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f5b07d65640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 0x5630546618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f5b07d65640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 0x5630546618c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58878/0 (socket says 172.21.15.192:58878) 2024-09-10T05:11:45.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f5b07d65640 1 -- 172.21.15.192:0/3013998773 learned_addr learned my addr 172.21.15.192:0/3013998773 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f59f3e07640 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59ec03c780 0x7f59ec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f59f3e07640 1 -- 172.21.15.192:0/2692901311 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5af8064070 con 0x563054557ed0 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f5b07564640 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59ec03c780 0x7f59ec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f5b07d65640 1 -- 172.21.15.192:0/3013998773 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563054661e90 con 0x56305465f4d0 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f5b07d65640 1 --2- 172.21.15.192:0/3013998773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 0x5630546618c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000a3e0 tx=0x7f5b0000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c00c3483c2853e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f59f1e03640 1 -- 172.21.15.192:0/3013998773 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b00015070 con 0x56305465f4d0 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f5b07564640 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59ec03c780 0x7f59ec03ec40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5af8067fd0 tx=0x7f5af8067f00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f59f1e03640 1 -- 172.21.15.192:0/3013998773 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b00001670 con 0x56305465f4d0 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f59f1e03640 1 -- 172.21.15.192:0/3013998773 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b00001990 con 0x56305465f4d0 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3013998773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 msgr2=0x5630546618c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.976+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/3013998773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 0x5630546618c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000a3e0 tx=0x7f5b0000a8a0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.977+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3013998773 shutdown_connections 2024-09-10T05:11:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.977+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/3013998773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 0x5630546618c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.977+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3013998773 >> 172.21.15.192:0/3013998773 conn(0x563054559110 msgr2=0x563054659df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.977+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3013998773 shutdown_connections 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.977+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3013998773 wait complete. 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.977+0000 7f5b0b92e800 1 Processor -- start 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.977+0000 7f5b0b92e800 1 -- start start 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.977+0000 7f5b0b92e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 0x5630546663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.977+0000 7f5b0b92e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563054662180 con 0x56305465f4d0 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.977+0000 7f5b07d65640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 0x5630546663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.977+0000 7f5b07d65640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 0x5630546663f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58884/0 (socket says 172.21.15.192:58884) 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.977+0000 7f5b07d65640 1 -- 172.21.15.192:0/1361547546 learned_addr learned my addr 172.21.15.192:0/1361547546 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.978+0000 7f5b07d65640 1 -- 172.21.15.192:0/1361547546 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563054666950 con 0x56305465f4d0 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.978+0000 7f5b07d65640 1 --2- 172.21.15.192:0/1361547546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 0x5630546663f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5b00013040 tx=0x7f5b00003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.978+0000 7f59e3fff640 1 -- 172.21.15.192:0/1361547546 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b00020020 con 0x56305465f4d0 2024-09-10T05:11:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.978+0000 7f59e3fff640 1 -- 172.21.15.192:0/1361547546 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b00010780 con 0x56305465f4d0 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.978+0000 7f5b0b92e800 1 -- 172.21.15.192:0/1361547546 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563054666be0 con 0x56305465f4d0 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.978+0000 7f59e3fff640 1 -- 172.21.15.192:0/1361547546 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b00015040 con 0x56305465f4d0 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.978+0000 7f5b0b92e800 1 -- 172.21.15.192:0/1361547546 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563054667560 con 0x56305465f4d0 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.979+0000 7f59e3fff640 1 -- 172.21.15.192:0/1361547546 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5b00023020 con 0x56305465f4d0 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.979+0000 7f59e3fff640 1 --2- 172.21.15.192:0/1361547546 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59e803c780 0x7f59e803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.979+0000 7f59e3fff640 1 -- 172.21.15.192:0/1361547546 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5b00053270 con 0x56305465f4d0 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.979+0000 7f5b0b92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.979+0000 7f5b0b92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.979+0000 7f5afffff640 1 --2- 172.21.15.192:0/1361547546 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59e803c780 0x7f59e803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.979+0000 7f5b0b92e800 1 Processor -- start 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.980+0000 7f5b0b92e800 1 -- start start 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.980+0000 7f5afffff640 1 --2- 172.21.15.192:0/1361547546 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59e803c780 0x7f59e803ec40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5af0000c00 tx=0x7f5af0001330 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.980+0000 7f5b0b92e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054680240 0x563054680660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.980+0000 7f5b0b92e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563054647c10 con 0x563054680240 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.980+0000 7f5b07564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054680240 0x563054680660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.980+0000 7f5b07564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054680240 0x563054680660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58898/0 (socket says 172.21.15.192:58898) 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.980+0000 7f5b07564640 1 -- 172.21.15.192:0/3533802233 learned_addr learned my addr 172.21.15.192:0/3533802233 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.980+0000 7f5b07564640 1 -- 172.21.15.192:0/3533802233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563054680ca0 con 0x563054680240 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.980+0000 7f5b07564640 1 --2- 172.21.15.192:0/3533802233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054680240 0x563054680660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5af8095860 tx=0x7f5af80677d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.980+0000 7f5987fff640 1 -- 172.21.15.192:0/3533802233 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af809c070 con 0x563054680240 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.981+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3533802233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630546814d0 con 0x563054680240 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.981+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3533802233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563054681a70 con 0x563054680240 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.981+0000 7f5987fff640 1 -- 172.21.15.192:0/3533802233 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af8078410 con 0x563054680240 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.981+0000 7f5987fff640 1 -- 172.21.15.192:0/3533802233 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af8094030 con 0x563054680240 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.981+0000 7f5987fff640 1 -- 172.21.15.192:0/3533802233 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5af809f070 con 0x563054680240 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.982+0000 7f5987fff640 1 --2- 172.21.15.192:0/3533802233 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f594803c6e0 0x7f594803eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.982+0000 7f5987fff640 1 -- 172.21.15.192:0/3533802233 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5af8095070 con 0x563054680240 2024-09-10T05:11:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.982+0000 7f5afffff640 1 --2- 172.21.15.192:0/3533802233 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f594803c6e0 0x7f594803eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.982+0000 7f5985ffb640 20 reqs_thread_entry: start 2024-09-10T05:11:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.982+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56305468db60 0x563054690020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.982+0000 7f5afffff640 1 --2- 172.21.15.192:0/3533802233 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f594803c6e0 0x7f594803eba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5af0000f60 tx=0x7f5af0006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.982+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630546906f0 con 0x56305468db60 2024-09-10T05:11:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.982+0000 7f5b07d65640 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56305468db60 0x563054690020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.982+0000 7f5b07d65640 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56305468db60 0x563054690020 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.983+0000 7f5b07d65640 1 -- 172.21.15.192:0/2692901311 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b0000e070 con 0x56305468db60 2024-09-10T05:11:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.983+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5630546924c0 0x5630546948b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.983+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:2 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563054694fb0 con 0x5630546924c0 2024-09-10T05:11:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.983+0000 7f5b07564640 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5630546924c0 0x5630546948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.983+0000 7f5b07564640 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5630546924c0 0x5630546948b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.984+0000 7f5b07564640 1 -- 172.21.15.192:0/2692901311 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(2 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5af809e030 con 0x5630546924c0 2024-09-10T05:11:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.984+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630546919c0 con 0x5630546924c0 2024-09-10T05:11:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.985+0000 7f5b07564640 1 -- 172.21.15.192:0/2692901311 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [stat,call,call,writefull 0~993] v35'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f5af809e030 con 0x5630546924c0 2024-09-10T05:11:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/1361547546 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59e803c780 msgr2=0x7f59e803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/1361547546 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59e803c780 0x7f59e803ec40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5af0000c00 tx=0x7f5af0001330 comp rx=0 tx=0).stop 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/1361547546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 msgr2=0x5630546663f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/1361547546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 0x5630546663f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5b00013040 tx=0x7f5b00003370 comp rx=0 tx=0).stop 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/1361547546 shutdown_connections 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/1361547546 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59e803c780 0x7f59e803ec40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/1361547546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56305465f4d0 0x5630546663f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/1361547546 >> 172.21.15.192:0/1361547546 conn(0x563054559110 msgr2=0x563054659dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/1361547546 shutdown_connections 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/1361547546 wait complete. 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3533802233 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f594803c6e0 msgr2=0x7f594803eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/3533802233 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f594803c6e0 0x7f594803eba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5af0000f60 tx=0x7f5af0006000 comp rx=0 tx=0).stop 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3533802233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054680240 msgr2=0x563054680660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/3533802233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054680240 0x563054680660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5af8095860 tx=0x7f5af80677d0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3533802233 shutdown_connections 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/3533802233 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f594803c6e0 0x7f594803eba0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/3533802233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054680240 0x563054680660 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3533802233 >> 172.21.15.192:0/3533802233 conn(0x563054675800 msgr2=0x563054675be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3533802233 shutdown_connections 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/3533802233 wait complete. 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5630546924c0 msgr2=0x5630546948b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5630546924c0 0x5630546948b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56305468db60 msgr2=0x563054690020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.986+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56305468db60 0x563054690020 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.987+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59ec03c780 msgr2=0x7f59ec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.987+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59ec03c780 0x7f59ec03ec40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5af8067fd0 tx=0x7f5af8067f00 comp rx=0 tx=0).stop 2024-09-10T05:11:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.987+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 msgr2=0x563054651fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.987+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054651fe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5af8025c20 tx=0x7f5af8002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.987+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 shutdown_connections 2024-09-10T05:11:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.987+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5630546924c0 0x5630546948b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.987+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56305468db60 0x563054690020 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.987+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59ec03c780 0x7f59ec03ec40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.987+0000 7f5b0b92e800 1 --2- 172.21.15.192:0/2692901311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563054557ed0 0x563054651fe0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.987+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 >> 172.21.15.192:0/2692901311 conn(0x5630545532c0 msgr2=0x563054648640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.987+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 shutdown_connections 2024-09-10T05:11:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:45.987+0000 7f5b0b92e800 1 -- 172.21.15.192:0/2692901311 wait complete. 2024-09-10T05:11:45.996 INFO:teuthology.orchestra.run.smithi192.stdout:{"id":"92aa256a-2802-419e-96e0-ba675846cbc3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T05:11:45.996 DEBUG:tasks.util.rgw: json result: {'id': '92aa256a-2802-419e-96e0-ba675846cbc3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T05:11:45.998 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-10T05:11:45.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-10T05:11:45.998 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-10T05:11:46.040 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:46.040 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:46.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.040+0000 7f2a28746800 1 Processor -- start 2024-09-10T05:11:46.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.040+0000 7f2a28746800 1 -- start start 2024-09-10T05:11:46.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.040+0000 7f2a28746800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5579c60071f0 0x5579c600cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.040+0000 7f2a28746800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5579c5eb0e40 con 0x5579c6005de0 2024-09-10T05:11:46.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.040+0000 7f2a28746800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5579c5e7b680 con 0x5579c60071f0 2024-09-10T05:11:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.040+0000 7f2a25a36640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5579c60071f0 0x5579c600cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.041+0000 7f2a26237640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5579c6005de0 0x5579c6006ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36160/0 (socket says 172.21.15.192:36160) 2024-09-10T05:11:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.041+0000 7f2a26237640 1 -- 172.21.15.192:0/1877852193 learned_addr learned my addr 172.21.15.192:0/1877852193 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.041+0000 7f2a25a36640 1 -- 172.21.15.192:0/1877852193 >> v1:172.21.15.139:6789/0 conn(0x5579c6005de0 legacy=0x5579c6006ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.041+0000 7f2a25a36640 1 -- 172.21.15.192:0/1877852193 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c5e976b0 con 0x5579c60071f0 2024-09-10T05:11:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.041+0000 7f2a25235640 1 -- 172.21.15.192:0/1877852193 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 828657963 0 0) 0x5579c5eb0e40 con 0x5579c6005de0 2024-09-10T05:11:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.043+0000 7f2a25a36640 1 --2- 172.21.15.192:0/1877852193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c60071f0 0x5579c600cd90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00a470 tx=0x7f2a1c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264e6db9b4d24eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.043+0000 7f2a25235640 1 -- 172.21.15.192:0/1877852193 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a1c053570 con 0x5579c60071f0 2024-09-10T05:11:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.043+0000 7f2a25235640 1 -- 172.21.15.192:0/1877852193 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a1c058070 con 0x5579c60071f0 2024-09-10T05:11:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.043+0000 7f2a25235640 1 -- 172.21.15.192:0/1877852193 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a1c053880 con 0x5579c60071f0 2024-09-10T05:11:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.043+0000 7f2a28746800 1 -- 172.21.15.192:0/1877852193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c60071f0 msgr2=0x5579c600cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.043+0000 7f2a28746800 1 --2- 172.21.15.192:0/1877852193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c60071f0 0x5579c600cd90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00a470 tx=0x7f2a1c045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.043+0000 7f2a28746800 1 -- 172.21.15.192:0/1877852193 shutdown_connections 2024-09-10T05:11:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.043+0000 7f2a28746800 1 --2- 172.21.15.192:0/1877852193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c60071f0 0x5579c600cd90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.043+0000 7f2a28746800 1 -- 172.21.15.192:0/1877852193 >> 172.21.15.192:0/1877852193 conn(0x5579c60011b0 msgr2=0x5579c6003610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.043+0000 7f2a28746800 1 -- 172.21.15.192:0/1877852193 shutdown_connections 2024-09-10T05:11:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.043+0000 7f2a28746800 1 -- 172.21.15.192:0/1877852193 wait complete. 2024-09-10T05:11:46.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.057+0000 7f2a28746800 1 Processor -- start 2024-09-10T05:11:46.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.057+0000 7f2a28746800 1 -- start start 2024-09-10T05:11:46.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.057+0000 7f2a28746800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 0x5579c60f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.057+0000 7f2a28746800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5579c5e9fdd0 con 0x5579c6005de0 2024-09-10T05:11:46.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.057+0000 7f2a26237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 0x5579c60f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.057+0000 7f2a26237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 0x5579c60f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58904/0 (socket says 172.21.15.192:58904) 2024-09-10T05:11:46.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.057+0000 7f2a26237640 1 -- 172.21.15.192:0/2275471001 learned_addr learned my addr 172.21.15.192:0/2275471001 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.058+0000 7f2a26237640 1 -- 172.21.15.192:0/2275471001 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c5eb8e10 con 0x5579c6005de0 2024-09-10T05:11:46.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.058+0000 7f2a26237640 1 --2- 172.21.15.192:0/2275471001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 0x5579c60f64b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a18006fa0 tx=0x7f2a18001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a5ded9bafebc6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.058+0000 7f2914608640 1 -- 172.21.15.192:0/2275471001 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a18003450 con 0x5579c6005de0 2024-09-10T05:11:46.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.058+0000 7f2914608640 1 -- 172.21.15.192:0/2275471001 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a18003610 con 0x5579c6005de0 2024-09-10T05:11:46.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.058+0000 7f2914608640 1 -- 172.21.15.192:0/2275471001 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a18003970 con 0x5579c6005de0 2024-09-10T05:11:46.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a28746800 1 -- 172.21.15.192:0/2275471001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 msgr2=0x5579c60f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a28746800 1 --2- 172.21.15.192:0/2275471001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 0x5579c60f64b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a18006fa0 tx=0x7f2a18001b00 comp rx=0 tx=0).stop 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a28746800 1 -- 172.21.15.192:0/2275471001 shutdown_connections 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a28746800 1 --2- 172.21.15.192:0/2275471001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 0x5579c60f64b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a28746800 1 -- 172.21.15.192:0/2275471001 >> 172.21.15.192:0/2275471001 conn(0x5579c60011b0 msgr2=0x5579c60f4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a28746800 1 -- 172.21.15.192:0/2275471001 shutdown_connections 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a28746800 1 -- 172.21.15.192:0/2275471001 wait complete. 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a28746800 1 Processor -- start 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a28746800 1 -- start start 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a28746800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 0x5579c60fddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a28746800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5579c60078e0 con 0x5579c6005de0 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a26237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 0x5579c60fddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a26237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 0x5579c60fddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58910/0 (socket says 172.21.15.192:58910) 2024-09-10T05:11:46.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.059+0000 7f2a26237640 1 -- 172.21.15.192:0/3364725754 learned_addr learned my addr 172.21.15.192:0/3364725754 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.060+0000 7f2a26237640 1 -- 172.21.15.192:0/3364725754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c60fe330 con 0x5579c6005de0 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.060+0000 7f2a26237640 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 0x5579c60fddd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2a18001330 tx=0x7f2a18001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.060+0000 7f2912e05640 1 -- 172.21.15.192:0/3364725754 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a18014a10 con 0x5579c6005de0 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.060+0000 7f2912e05640 1 -- 172.21.15.192:0/3364725754 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a18014bb0 con 0x5579c6005de0 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.060+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579c60fe5c0 con 0x5579c6005de0 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.060+0000 7f2912e05640 1 -- 172.21.15.192:0/3364725754 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a1801e3f0 con 0x5579c6005de0 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.060+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579c60fefc0 con 0x5579c6005de0 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.061+0000 7f2912e05640 1 -- 172.21.15.192:0/3364725754 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2a18010070 con 0x5579c6005de0 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.061+0000 7f2912e05640 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f290c03c780 0x7f290c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.061+0000 7f2912e05640 1 -- 172.21.15.192:0/3364725754 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f2a18018070 con 0x5579c6005de0 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.061+0000 7f2a25a36640 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f290c03c780 0x7f290c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.061+0000 7f2a28746800 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5579c60071f0 0x5579c6105420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.061+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6105960 con 0x5579c60071f0 2024-09-10T05:11:46.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.061+0000 7f2a26a38640 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5579c60071f0 0x5579c6105420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.061+0000 7f2a25a36640 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f290c03c780 0x7f290c03ec40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c057000 tx=0x7f2a1c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.062+0000 7f2a26a38640 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5579c60071f0 0x5579c6105420 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.062+0000 7f2a26a38640 1 -- 172.21.15.192:0/3364725754 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a200083e0 con 0x5579c60071f0 2024-09-10T05:11:46.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.062+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6105d00 con 0x5579c60071f0 2024-09-10T05:11:46.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.062+0000 7f2a26a38640 1 -- 172.21.15.192:0/3364725754 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a200083e0 con 0x5579c60071f0 2024-09-10T05:11:46.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.062+0000 7f2a28746800 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5579c61077c0 0x5579c6109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.062+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c610a3d0 con 0x5579c61077c0 2024-09-10T05:11:46.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.062+0000 7f2a26237640 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5579c61077c0 0x5579c6109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.063+0000 7f2a26237640 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5579c61077c0 0x5579c6109c40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.063+0000 7f2a26237640 1 -- 172.21.15.192:0/3364725754 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2a1801b070 con 0x5579c61077c0 2024-09-10T05:11:46.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.063+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6106550 con 0x5579c60071f0 2024-09-10T05:11:46.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.063+0000 7f2a26a38640 1 -- 172.21.15.192:0/3364725754 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a200083e0 con 0x5579c60071f0 2024-09-10T05:11:46.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.063+0000 7f2a28746800 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5579c610b830 0x5579c610dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.063+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c610e390 con 0x5579c610b830 2024-09-10T05:11:46.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.064+0000 7f2a25a36640 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5579c610b830 0x5579c610dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.064+0000 7f2a25a36640 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5579c610b830 0x5579c610dc20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.064+0000 7f2a25a36640 1 -- 172.21.15.192:0/3364725754 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2a1c051070 con 0x5579c610b830 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.064+0000 7f2a28746800 1 Processor -- start 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.064+0000 7f2a28746800 1 -- start start 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.065+0000 7f2a28746800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c611bfd0 0x5579c611c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.065+0000 7f2a28746800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5579c5efda00 con 0x5579c611bfd0 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.065+0000 7f2a26237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c611bfd0 0x5579c611c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.065+0000 7f2a26237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c611bfd0 0x5579c611c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58918/0 (socket says 172.21.15.192:58918) 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.065+0000 7f2a26237640 1 -- 172.21.15.192:0/771829156 learned_addr learned my addr 172.21.15.192:0/771829156 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.065+0000 7f2a26237640 1 -- 172.21.15.192:0/771829156 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c611ca30 con 0x5579c611bfd0 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.065+0000 7f2a26237640 1 --2- 172.21.15.192:0/771829156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c611bfd0 0x5579c611c3f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2a18014ff0 tx=0x7f2a18028ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.065+0000 7f290bfff640 1 -- 172.21.15.192:0/771829156 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a18036020 con 0x5579c611bfd0 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.065+0000 7f290bfff640 1 -- 172.21.15.192:0/771829156 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a1801d510 con 0x5579c611bfd0 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.065+0000 7f2a28746800 1 -- 172.21.15.192:0/771829156 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579c611d260 con 0x5579c611bfd0 2024-09-10T05:11:46.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.065+0000 7f290bfff640 1 -- 172.21.15.192:0/771829156 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a18053040 con 0x5579c611bfd0 2024-09-10T05:11:46.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.065+0000 7f2a28746800 1 -- 172.21.15.192:0/771829156 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579c611d800 con 0x5579c611bfd0 2024-09-10T05:11:46.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.066+0000 7f290bfff640 1 -- 172.21.15.192:0/771829156 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2a18039020 con 0x5579c611bfd0 2024-09-10T05:11:46.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.066+0000 7f290bfff640 1 --2- 172.21.15.192:0/771829156 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f290003c780 0x7f290003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.066+0000 7f290bfff640 1 -- 172.21.15.192:0/771829156 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f2a1803cc40 con 0x5579c611bfd0 2024-09-10T05:11:46.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.066+0000 7f2a25a36640 1 --2- 172.21.15.192:0/771829156 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f290003c780 0x7f290003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.067+0000 7f2a28746800 1 Processor -- start 2024-09-10T05:11:46.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.067+0000 7f2a28746800 1 -- start start 2024-09-10T05:11:46.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.067+0000 7f2a25a36640 1 --2- 172.21.15.192:0/771829156 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f290003c780 0x7f290003ec40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5579c610a770 tx=0x7f2a1c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.067+0000 7f2a28746800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 0x5579c6128e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.067+0000 7f2a28746800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5579c60f6d00 con 0x5579c6128a10 2024-09-10T05:11:46.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.067+0000 7f2a26237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 0x5579c6128e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.067+0000 7f2a26237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 0x5579c6128e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58924/0 (socket says 172.21.15.192:58924) 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.067+0000 7f2a26237640 1 -- 172.21.15.192:0/3886222375 learned_addr learned my addr 172.21.15.192:0/3886222375 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.067+0000 7f2a26237640 1 -- 172.21.15.192:0/3886222375 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c6129400 con 0x5579c6128a10 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.067+0000 7f2a26237640 1 --2- 172.21.15.192:0/3886222375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 0x5579c6128e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2a18010d60 tx=0x7f2a18011fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81cfb076cd8204d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.067+0000 7f2909ffb640 1 -- 172.21.15.192:0/3886222375 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a180266e0 con 0x5579c6128a10 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.068+0000 7f2909ffb640 1 -- 172.21.15.192:0/3886222375 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a180268a0 con 0x5579c6128a10 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.068+0000 7f2909ffb640 1 -- 172.21.15.192:0/3886222375 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a180113e0 con 0x5579c6128a10 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.068+0000 7f2a28746800 1 -- 172.21.15.192:0/3886222375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 msgr2=0x5579c6128e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.068+0000 7f2a28746800 1 --2- 172.21.15.192:0/3886222375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 0x5579c6128e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2a18010d60 tx=0x7f2a18011fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.068+0000 7f2a28746800 1 -- 172.21.15.192:0/3886222375 shutdown_connections 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.068+0000 7f2a28746800 1 --2- 172.21.15.192:0/3886222375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 0x5579c6128e10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.068+0000 7f2a28746800 1 -- 172.21.15.192:0/3886222375 >> 172.21.15.192:0/3886222375 conn(0x5579c6124e10 msgr2=0x5579c6123050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.068+0000 7f2a28746800 1 -- 172.21.15.192:0/3886222375 shutdown_connections 2024-09-10T05:11:46.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.068+0000 7f2a28746800 1 -- 172.21.15.192:0/3886222375 wait complete. 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.068+0000 7f2a28746800 1 Processor -- start 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.068+0000 7f2a28746800 1 -- start start 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.069+0000 7f2a28746800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 0x5579c612fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.069+0000 7f2a28746800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5579c6129870 con 0x5579c6128a10 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.069+0000 7f2a26237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 0x5579c612fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.069+0000 7f2a26237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 0x5579c612fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58940/0 (socket says 172.21.15.192:58940) 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.069+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 learned_addr learned my addr 172.21.15.192:0/1517413152 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.069+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c61303b0 con 0x5579c6128a10 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.069+0000 7f2a26237640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 0x5579c612fe50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2a18046fd0 tx=0x7f2a18046f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.069+0000 7f28f7fff640 1 -- 172.21.15.192:0/1517413152 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a1806f020 con 0x5579c6128a10 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.069+0000 7f28f7fff640 1 -- 172.21.15.192:0/1517413152 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a1804a440 con 0x5579c6128a10 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.069+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579c61303b0 con 0x5579c6128a10 2024-09-10T05:11:46.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.069+0000 7f28f7fff640 1 -- 172.21.15.192:0/1517413152 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a18026320 con 0x5579c6128a10 2024-09-10T05:11:46.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.069+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579c61303b0 con 0x5579c6128a10 2024-09-10T05:11:46.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.070+0000 7f28f7fff640 1 -- 172.21.15.192:0/1517413152 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2a18072020 con 0x5579c6128a10 2024-09-10T05:11:46.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.070+0000 7f28f7fff640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f28f003c6e0 0x7f28f003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.070+0000 7f28f7fff640 1 -- 172.21.15.192:0/1517413152 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f2a18065030 con 0x5579c6128a10 2024-09-10T05:11:46.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.070+0000 7f2a25a36640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f28f003c6e0 0x7f28f003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.071+0000 7f2a28746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.071+0000 7f2a28746800 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5579c613b3f0 0x5579c613d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.071+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c613e000 con 0x5579c613b3f0 2024-09-10T05:11:46.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.071+0000 7f2a26a38640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5579c613b3f0 0x5579c613d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.071+0000 7f2a25a36640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f28f003c6e0 0x7f28f003eba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c000c00 tx=0x7f2a1c053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.071+0000 7f2a26a38640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5579c613b3f0 0x5579c613d8b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.071+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a200083e0 con 0x5579c613b3f0 2024-09-10T05:11:46.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.071+0000 7f2a28746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.071+0000 7f2a28746800 20 realm 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.071+0000 7f2a28746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.071+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c613e410 con 0x5579c613b3f0 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a200083e0 con 0x5579c613b3f0 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a28746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a28746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a28746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613b3f0 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a200083e0 con 0x5579c613b3f0 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a28746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a28746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c613f080 con 0x5579c613b3f0 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a200083e0 con 0x5579c613b3f0 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a28746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a28746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a28746800 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5579c613f7d0 0x5579c6141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6142330 con 0x5579c613f7d0 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.072+0000 7f2a26237640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5579c613f7d0 0x5579c6141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.073+0000 7f2a26237640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5579c613f7d0 0x5579c6141bc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.073+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.073+0000 7f2a28746800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.073+0000 7f2a28746800 20 searching for the correct realm 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.073+0000 7f2a28746800 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5579c6144420 0x5579c61468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.073+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c6146fb0 con 0x5579c6144420 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.073+0000 7f2a25a36640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5579c6144420 0x5579c61468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.073+0000 7f2a25a36640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5579c6144420 0x5579c61468e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.073+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.073+0000 7f2a25a36640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f2a1c05f040 0x7f2a1c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.073+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c6146fb0 con 0x7f2a1c05f040 2024-09-10T05:11:46.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.074+0000 7f2a26a38640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f2a1c05f040 0x7f2a1c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.074+0000 7f2a26a38640 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f2a1c05f040 0x7f2a1c06b410 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.074+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2a200083e0 con 0x7f2a1c05f040 2024-09-10T05:11:46.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.074+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613f7d0 2024-09-10T05:11:46.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.074+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.074+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613b3f0 2024-09-10T05:11:46.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.075+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a200083e0 con 0x5579c613b3f0 2024-09-10T05:11:46.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.075+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613b3f0 2024-09-10T05:11:46.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.075+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.075+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613f7d0 2024-09-10T05:11:46.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.075+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.075+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613f7d0 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.075+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.075+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x7f2a1c05f040 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.076+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.076+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c6144420 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.076+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.076+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613b3f0 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.076+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.076+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613f7d0 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.076+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.076+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613b3f0 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.077+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.077+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x7f2a1c05f040 2024-09-10T05:11:46.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.077+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.077+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c6144420 2024-09-10T05:11:46.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.077+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.077+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c6144420 2024-09-10T05:11:46.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.077+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.077+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613f7d0 2024-09-10T05:11:46.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.078+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.078+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c6144420 2024-09-10T05:11:46.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.078+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.078+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c6144420 2024-09-10T05:11:46.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.078+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.078+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613b3f0 2024-09-10T05:11:46.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.078+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.078+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613b3f0 2024-09-10T05:11:46.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.079+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.079+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613f7d0 2024-09-10T05:11:46.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.079+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.079+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c6144420 2024-09-10T05:11:46.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.079+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.079+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x7f2a1c05f040 2024-09-10T05:11:46.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.079+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.079+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613b3f0 2024-09-10T05:11:46.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.080+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.080+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613f7d0 2024-09-10T05:11:46.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.080+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.080+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c6144420 2024-09-10T05:11:46.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.080+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.080+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613f7d0 2024-09-10T05:11:46.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.080+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.080+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x7f2a1c05f040 2024-09-10T05:11:46.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.081+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.081+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c6144420 2024-09-10T05:11:46.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.081+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.081+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613f7d0 2024-09-10T05:11:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.081+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.081+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x5579c613b3f0 2024-09-10T05:11:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.081+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.081+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579c613ece0 con 0x7f2a1c05f040 2024-09-10T05:11:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:46.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6142ce0 con 0x5579c613b3f0 2024-09-10T05:11:46.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6142ce0 con 0x5579c613b3f0 2024-09-10T05:11:46.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6142cb0 con 0x7f2a1c05f040 2024-09-10T05:11:46.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 zone default found 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 4 Realm: () 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 zonegroup default 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.082+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c61430d0 con 0x5579c613f7d0 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a28746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a28746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6142c60 con 0x5579c6144420 2024-09-10T05:11:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a28746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a28746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6148e20 con 0x5579c6144420 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a28746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a28746800 20 started sync module instance, tier type = 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a28746800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.083+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c61482c0 con 0x7f2a1c05f040 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.084+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.084+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93981502638016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c61482c0 con 0x7f2a1c05f040 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.084+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c61498a0 con 0x5579c613b3f0 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.085+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93981502638016] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.085+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.086+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93981502641040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c61482c0 con 0x5579c613b3f0 2024-09-10T05:11:46.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.086+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c614a330 con 0x5579c6144420 2024-09-10T05:11:46.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.088+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.088+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93981502641040] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.088+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93981502643712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c614ac00 con 0x5579c6144420 2024-09-10T05:11:46.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.088+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c6147e50 con 0x7f2a1c05f040 2024-09-10T05:11:46.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.089+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93981502643712] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.089+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.089+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93981502646096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c614b620 con 0x7f2a1c05f040 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.089+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c614bef0 con 0x5579c613b3f0 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.092+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.092+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93981502649888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c614ba40 con 0x5579c613b3f0 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.092+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c614cea0 con 0x5579c613f7d0 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.095+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93981502646096] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.095+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93981502649888] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.095+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.095+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93981502653152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c614c980 con 0x5579c613f7d0 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.095+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c614d740 con 0x5579c613f7d0 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.096+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93981502653152] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.096+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.096+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93981502657168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c614db60 con 0x5579c613f7d0 2024-09-10T05:11:46.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.096+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c614e520 con 0x5579c613f7d0 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.097+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.097+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93981502660720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c614e940 con 0x5579c613f7d0 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.097+0000 7f2a28746800 20 add_watcher() i=0 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.097+0000 7f2a28746800 20 add_watcher() i=1 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.097+0000 7f2a28746800 20 add_watcher() i=2 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.097+0000 7f2a28746800 20 add_watcher() i=3 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.097+0000 7f2a28746800 20 add_watcher() i=4 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.097+0000 7f2a28746800 20 add_watcher() i=5 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.097+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93981502657168] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.097+0000 7f2a28746800 20 add_watcher() i=6 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.098+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93981502660720] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.098+0000 7f2a28746800 20 add_watcher() i=7 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.098+0000 7f2a28746800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:46.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.098+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c614e940 con 0x5579c613b3f0 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.098+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.098+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93981502661776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c614e8b0 con 0x5579c613b3f0 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.099+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93981502661776] v35'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.099+0000 7f28dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.099+0000 7f2a28746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.099+0000 7f2a28746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.099+0000 7f2a28746800 5 note: GC not initialized 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.100+0000 7f28577fe640 20 reqs_thread_entry: start 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.100+0000 7f2a28746800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.100+0000 7f2a28746800 20 Filter name: none 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.100+0000 7f28557fa640 20 reqs_thread_entry: start 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.100+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185070 con 0x5579c613b3f0 2024-09-10T05:11:46.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.100+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.100+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185070 con 0x7f2a1c05f040 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.100+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.100+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613b3f0 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.101+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.101+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.101+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.101+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.101+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.101+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.101+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.101+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613b3f0 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.101+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.101+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613b3f0 2024-09-10T05:11:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.102+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.102+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.102+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.102+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.102+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.102+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613f7d0 2024-09-10T05:11:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.103+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.103+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613b3f0 2024-09-10T05:11:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.103+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.103+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x7f2a1c05f040 2024-09-10T05:11:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.103+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.103+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.103+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.103+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613f7d0 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.104+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.104+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613f7d0 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.104+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.104+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.104+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.104+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613f7d0 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.105+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.105+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613b3f0 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.105+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.105+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.105+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.105+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613f7d0 2024-09-10T05:11:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.105+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.105+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x7f2a1c05f040 2024-09-10T05:11:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.105+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.106+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613f7d0 2024-09-10T05:11:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.106+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.106+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613b3f0 2024-09-10T05:11:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.106+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.106+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613b3f0 2024-09-10T05:11:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.106+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.106+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.106+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.106+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613b3f0 2024-09-10T05:11:46.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.107+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.107+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613b3f0 2024-09-10T05:11:46.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.107+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.107+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.107+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.107+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.107+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.107+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.107+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.107+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613f7d0 2024-09-10T05:11:46.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.108+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.109+0000 7f28dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.109+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93981502661776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613b3f0 2024-09-10T05:11:46.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.110+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93981502661776] v35'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.110+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93981502638016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x7f2a1c05f040 2024-09-10T05:11:46.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.111+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93981502638016] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.111+0000 7f2a28746800 20 remove_watcher() i=0 2024-09-10T05:11:46.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.111+0000 7f2a28746800 2 removed watcher, disabling cache 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.111+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93981502641040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c6182420 con 0x5579c613b3f0 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.112+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93981502641040] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.112+0000 7f2a28746800 20 remove_watcher() i=1 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.112+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93981502643712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c6144420 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.113+0000 7f2a25a36640 1 -- 172.21.15.192:0/1517413152 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93981502643712] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a1c07c040 con 0x5579c6144420 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.113+0000 7f2a28746800 20 remove_watcher() i=2 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.113+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93981502646096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c6182420 con 0x7f2a1c05f040 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.114+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93981502646096] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x7f2a1c05f040 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.114+0000 7f2a28746800 20 remove_watcher() i=3 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.114+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93981502649888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613b3f0 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.115+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93981502649888] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a20026040 con 0x5579c613b3f0 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.115+0000 7f2a28746800 20 remove_watcher() i=4 2024-09-10T05:11:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.115+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93981502653152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c6182420 con 0x5579c613f7d0 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.116+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93981502653152] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.116+0000 7f2a28746800 20 remove_watcher() i=5 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.116+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93981502657168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c6185030 con 0x5579c613f7d0 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.117+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93981502657168] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.117+0000 7f2a28746800 20 remove_watcher() i=6 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.117+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93981502660720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579c6182420 con 0x5579c613f7d0 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a26237640 1 -- 172.21.15.192:0/1517413152 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93981502660720] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a18068070 con 0x5579c613f7d0 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 20 remove_watcher() i=7 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5579c613f7d0 msgr2=0x5579c6141bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5579c613f7d0 0x5579c6141bc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5579c613b3f0 msgr2=0x5579c613d8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5579c613b3f0 0x5579c613d8b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f2a1c05f040 msgr2=0x7f2a1c06b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f2a1c05f040 0x7f2a1c06b410 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5579c6144420 msgr2=0x5579c61468e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5579c6144420 0x5579c61468e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f28f003c6e0 msgr2=0x7f28f003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f28f003c6e0 0x7f28f003eba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c000c00 tx=0x7f2a1c053000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 msgr2=0x5579c612fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 0x5579c612fe50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2a18046fd0 tx=0x7f2a18046f60 comp rx=0 tx=0).stop 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a26a38640 1 -- 172.21.15.192:0/1517413152 reap_dead start 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 shutdown_connections 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 --2- 172.21.15.192:0/1517413152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6128a10 0x5579c612fe50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 >> 172.21.15.192:0/1517413152 conn(0x5579c6124e10 msgr2=0x5579c6123020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 shutdown_connections 2024-09-10T05:11:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 -- 172.21.15.192:0/1517413152 wait complete. 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 -- 172.21.15.192:0/771829156 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f290003c780 msgr2=0x7f290003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 --2- 172.21.15.192:0/771829156 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f290003c780 0x7f290003ec40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5579c610a770 tx=0x7f2a1c005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 -- 172.21.15.192:0/771829156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c611bfd0 msgr2=0x5579c611c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.118+0000 7f2a28746800 1 --2- 172.21.15.192:0/771829156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c611bfd0 0x5579c611c3f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2a18014ff0 tx=0x7f2a18028ea0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/771829156 shutdown_connections 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 --2- 172.21.15.192:0/771829156 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f290003c780 0x7f290003ec40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 --2- 172.21.15.192:0/771829156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c611bfd0 0x5579c611c3f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/771829156 >> 172.21.15.192:0/771829156 conn(0x5579c6110380 msgr2=0x5579c6110760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/771829156 shutdown_connections 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/771829156 wait complete. 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5579c61077c0 msgr2=0x5579c6109c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5579c61077c0 0x5579c6109c40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5579c60071f0 msgr2=0x5579c6105420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5579c60071f0 0x5579c6105420 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5579c610b830 msgr2=0x5579c610dc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5579c610b830 0x5579c610dc20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f290c03c780 msgr2=0x7f290c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f290c03c780 0x7f290c03ec40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c057000 tx=0x7f2a1c052000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 msgr2=0x5579c60fddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 --2- 172.21.15.192:0/3364725754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5579c6005de0 0x5579c60fddd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2a18001330 tx=0x7f2a18001250 comp rx=0 tx=0).stop 2024-09-10T05:11:46.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a26a38640 1 -- 172.21.15.192:0/3364725754 reap_dead start 2024-09-10T05:11:46.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 shutdown_connections 2024-09-10T05:11:46.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 >> 172.21.15.192:0/3364725754 conn(0x5579c60011b0 msgr2=0x5579c60ef510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 shutdown_connections 2024-09-10T05:11:46.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.119+0000 7f2a28746800 1 -- 172.21.15.192:0/3364725754 wait complete. 2024-09-10T05:11:46.128 INFO:teuthology.orchestra.run.smithi192.stdout:{"entries":[],"summary":[]} 2024-09-10T05:11:46.129 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-10T05:11:46.129 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:11:46.129 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:11:46.129 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:11:46.213 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:46.213 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:46.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.213+0000 7fb26ea0f800 1 Processor -- start 2024-09-10T05:11:46.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.213+0000 7fb26ea0f800 1 -- start start 2024-09-10T05:11:46.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.213+0000 7fb26ea0f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5616de737720 0x5616de739b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.213+0000 7fb26ea0f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5616de5e0e40 con 0x5616de73a050 2024-09-10T05:11:46.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.213+0000 7fb26ea0f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5616de5ab680 con 0x5616de737720 2024-09-10T05:11:46.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.214+0000 7fb26c500640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5616de737720 0x5616de739b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.214+0000 7fb26bcff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5616de73a050 0x5616de73c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36164/0 (socket says 172.21.15.192:36164) 2024-09-10T05:11:46.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.214+0000 7fb26c500640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5616de737720 0x5616de739b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58954/0 (socket says 172.21.15.192:58954) 2024-09-10T05:11:46.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.214+0000 7fb26bcff640 1 -- 172.21.15.192:0/3528624096 learned_addr learned my addr 172.21.15.192:0/3528624096 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:46.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.214+0000 7fb26c500640 1 -- 172.21.15.192:0/3528624096 >> v1:172.21.15.139:6789/0 conn(0x5616de73a050 legacy=0x5616de73c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.214+0000 7fb26b4fe640 1 -- 172.21.15.192:0/3528624096 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1969311914 0 0) 0x5616de5e0e40 con 0x5616de73a050 2024-09-10T05:11:46.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.214+0000 7fb26c500640 1 -- 172.21.15.192:0/3528624096 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616de5c76b0 con 0x5616de737720 2024-09-10T05:11:46.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.216+0000 7fb26c500640 1 --2- 172.21.15.192:0/3528624096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de739b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00a470 tx=0x7fb25c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eedd9f227497f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.216+0000 7fb26b4fe640 1 -- 172.21.15.192:0/3528624096 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c053570 con 0x5616de737720 2024-09-10T05:11:46.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.216+0000 7fb26b4fe640 1 -- 172.21.15.192:0/3528624096 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c058070 con 0x5616de737720 2024-09-10T05:11:46.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.216+0000 7fb26b4fe640 1 -- 172.21.15.192:0/3528624096 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c053880 con 0x5616de737720 2024-09-10T05:11:46.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.216+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3528624096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 msgr2=0x5616de739b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.216+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/3528624096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de739b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00a470 tx=0x7fb25c045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:46.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.216+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3528624096 shutdown_connections 2024-09-10T05:11:46.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.216+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/3528624096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de739b10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.216+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3528624096 >> 172.21.15.192:0/3528624096 conn(0x5616de7311c0 msgr2=0x5616de733620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.216+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3528624096 shutdown_connections 2024-09-10T05:11:46.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.216+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3528624096 wait complete. 2024-09-10T05:11:46.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.230+0000 7fb26ea0f800 1 Processor -- start 2024-09-10T05:11:46.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.230+0000 7fb26ea0f800 1 -- start start 2024-09-10T05:11:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.230+0000 7fb26ea0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de8264c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.230+0000 7fb26ea0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5616de5cfdd0 con 0x5616de737720 2024-09-10T05:11:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.231+0000 7fb26c500640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de8264c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.231+0000 7fb26c500640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de8264c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58966/0 (socket says 172.21.15.192:58966) 2024-09-10T05:11:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.231+0000 7fb26c500640 1 -- 172.21.15.192:0/2020388200 learned_addr learned my addr 172.21.15.192:0/2020388200 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.231+0000 7fb26c500640 1 -- 172.21.15.192:0/2020388200 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616de5e8e10 con 0x5616de737720 2024-09-10T05:11:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.231+0000 7fb26c500640 1 --2- 172.21.15.192:0/2020388200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de8264c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb25c025c20 tx=0x7fb25c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f0991601e4311e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.231+0000 7fb15a60c640 1 -- 172.21.15.192:0/2020388200 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c053a20 con 0x5616de737720 2024-09-10T05:11:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.231+0000 7fb15a60c640 1 -- 172.21.15.192:0/2020388200 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c063070 con 0x5616de737720 2024-09-10T05:11:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.231+0000 7fb15a60c640 1 -- 172.21.15.192:0/2020388200 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c053d30 con 0x5616de737720 2024-09-10T05:11:46.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.232+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2020388200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 msgr2=0x5616de8264c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.232+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/2020388200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de8264c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb25c025c20 tx=0x7fb25c051000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.232+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2020388200 shutdown_connections 2024-09-10T05:11:46.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.232+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/2020388200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de8264c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.232+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2020388200 >> 172.21.15.192:0/2020388200 conn(0x5616de7311c0 msgr2=0x5616de821e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.232+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2020388200 shutdown_connections 2024-09-10T05:11:46.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.232+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2020388200 wait complete. 2024-09-10T05:11:46.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.232+0000 7fb26ea0f800 1 Processor -- start 2024-09-10T05:11:46.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.232+0000 7fb26ea0f800 1 -- start start 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.233+0000 7fb26ea0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de82ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.233+0000 7fb26ea0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5616de73e040 con 0x5616de737720 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.233+0000 7fb26c500640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de82ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.233+0000 7fb26c500640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de82ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58978/0 (socket says 172.21.15.192:58978) 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.233+0000 7fb26c500640 1 -- 172.21.15.192:0/2237713658 learned_addr learned my addr 172.21.15.192:0/2237713658 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.233+0000 7fb26c500640 1 -- 172.21.15.192:0/2237713658 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616de82e310 con 0x5616de737720 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.233+0000 7fb26c500640 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de82ddb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb25c025c20 tx=0x7fb25c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.233+0000 7fb158e09640 1 -- 172.21.15.192:0/2237713658 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c078070 con 0x5616de737720 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.233+0000 7fb158e09640 1 -- 172.21.15.192:0/2237713658 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c073470 con 0x5616de737720 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.233+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616de82e5a0 con 0x5616de737720 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.233+0000 7fb158e09640 1 -- 172.21.15.192:0/2237713658 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c073750 con 0x5616de737720 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.233+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616de82f1b0 con 0x5616de737720 2024-09-10T05:11:46.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.234+0000 7fb158e09640 1 -- 172.21.15.192:0/2237713658 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb25c07b070 con 0x5616de737720 2024-09-10T05:11:46.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.234+0000 7fb158e09640 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb15403c730 0x7fb15403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.234+0000 7fb158e09640 1 -- 172.21.15.192:0/2237713658 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb25c097ba0 con 0x5616de737720 2024-09-10T05:11:46.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.234+0000 7fb26bcff640 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb15403c730 0x7fb15403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.235+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5616de73a050 0x5616de835400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.235+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de835940 con 0x5616de73a050 2024-09-10T05:11:46.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.235+0000 7fb26cd01640 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5616de73a050 0x5616de835400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.235+0000 7fb26bcff640 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb15403c730 0x7fb15403ebf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb260000c00 tx=0x7fb2600013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.235+0000 7fb26cd01640 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5616de73a050 0x5616de835400 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.235+0000 7fb26cd01640 1 -- 172.21.15.192:0/2237713658 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de73a050 2024-09-10T05:11:46.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.235+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de835ce0 con 0x5616de73a050 2024-09-10T05:11:46.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.236+0000 7fb26cd01640 1 -- 172.21.15.192:0/2237713658 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de73a050 2024-09-10T05:11:46.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.236+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5616de837760 0x5616de839be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.236+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de83a370 con 0x5616de837760 2024-09-10T05:11:46.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.236+0000 7fb26c500640 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5616de837760 0x5616de839be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.236+0000 7fb26c500640 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5616de837760 0x5616de839be0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.236+0000 7fb26c500640 1 -- 172.21.15.192:0/2237713658 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb25c07a030 con 0x5616de837760 2024-09-10T05:11:46.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.236+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de836530 con 0x5616de73a050 2024-09-10T05:11:46.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.237+0000 7fb26cd01640 1 -- 172.21.15.192:0/2237713658 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de73a050 2024-09-10T05:11:46.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.237+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5616de83b7d0 0x5616de83dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.237+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de83e300 con 0x5616de83b7d0 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.237+0000 7fb26bcff640 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5616de83b7d0 0x5616de83dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.237+0000 7fb26bcff640 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5616de83b7d0 0x5616de83dbc0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.237+0000 7fb26bcff640 1 -- 172.21.15.192:0/2237713658 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb26000f670 con 0x5616de83b7d0 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.238+0000 7fb26ea0f800 1 Processor -- start 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.238+0000 7fb26ea0f800 1 -- start start 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.238+0000 7fb26ea0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de736ec0 0x5616de735730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.238+0000 7fb26ea0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5616de62da00 con 0x5616de736ec0 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.238+0000 7fb26c500640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de736ec0 0x5616de735730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.238+0000 7fb26c500640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de736ec0 0x5616de735730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58986/0 (socket says 172.21.15.192:58986) 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.238+0000 7fb26c500640 1 -- 172.21.15.192:0/524155969 learned_addr learned my addr 172.21.15.192:0/524155969 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.238+0000 7fb26c500640 1 -- 172.21.15.192:0/524155969 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616de7373e0 con 0x5616de736ec0 2024-09-10T05:11:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.239+0000 7fb26c500640 1 --2- 172.21.15.192:0/524155969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de736ec0 0x5616de735730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb25c095f90 tx=0x7fb25c05d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.239+0000 7fb1527fc640 1 -- 172.21.15.192:0/524155969 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c07c780 con 0x5616de736ec0 2024-09-10T05:11:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.239+0000 7fb1527fc640 1 -- 172.21.15.192:0/524155969 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c068470 con 0x5616de736ec0 2024-09-10T05:11:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.239+0000 7fb1527fc640 1 -- 172.21.15.192:0/524155969 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c07c920 con 0x5616de736ec0 2024-09-10T05:11:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.239+0000 7fb26ea0f800 1 -- 172.21.15.192:0/524155969 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616de735c70 con 0x5616de736ec0 2024-09-10T05:11:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.239+0000 7fb26ea0f800 1 -- 172.21.15.192:0/524155969 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616de7361c0 con 0x5616de736ec0 2024-09-10T05:11:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.239+0000 7fb1527fc640 1 -- 172.21.15.192:0/524155969 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb25c068770 con 0x5616de736ec0 2024-09-10T05:11:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.240+0000 7fb1527fc640 1 --2- 172.21.15.192:0/524155969 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb14403c780 0x7fb14403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.240+0000 7fb1527fc640 1 -- 172.21.15.192:0/524155969 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb25c08f070 con 0x5616de736ec0 2024-09-10T05:11:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.240+0000 7fb26bcff640 1 --2- 172.21.15.192:0/524155969 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb14403c780 0x7fb14403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.240+0000 7fb26ea0f800 1 Processor -- start 2024-09-10T05:11:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.240+0000 7fb26bcff640 1 --2- 172.21.15.192:0/524155969 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb14403c780 0x7fb14403ec40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5616de82fe50 tx=0x7fb260006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.240+0000 7fb26ea0f800 1 -- start start 2024-09-10T05:11:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.240+0000 7fb26ea0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 0x5616de85ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.240+0000 7fb26ea0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5616de826cb0 con 0x5616de85a9c0 2024-09-10T05:11:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.240+0000 7fb26c500640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 0x5616de85ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.240+0000 7fb26c500640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 0x5616de85ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:58996/0 (socket says 172.21.15.192:58996) 2024-09-10T05:11:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.240+0000 7fb26c500640 1 -- 172.21.15.192:0/2702007614 learned_addr learned my addr 172.21.15.192:0/2702007614 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.241+0000 7fb26c500640 1 -- 172.21.15.192:0/2702007614 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616de85b390 con 0x5616de85a9c0 2024-09-10T05:11:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.241+0000 7fb26c500640 1 --2- 172.21.15.192:0/2702007614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 0x5616de85ada0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb25c06cfd0 tx=0x7fb25c05ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8ba23b52652ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.241+0000 7fb14b7fe640 1 -- 172.21.15.192:0/2702007614 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c05c870 con 0x5616de85a9c0 2024-09-10T05:11:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.241+0000 7fb14b7fe640 1 -- 172.21.15.192:0/2702007614 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c07d440 con 0x5616de85a9c0 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.241+0000 7fb14b7fe640 1 -- 172.21.15.192:0/2702007614 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c074040 con 0x5616de85a9c0 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.241+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2702007614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 msgr2=0x5616de85ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.241+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/2702007614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 0x5616de85ada0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb25c06cfd0 tx=0x7fb25c05ef00 comp rx=0 tx=0).stop 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.241+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2702007614 shutdown_connections 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.241+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/2702007614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 0x5616de85ada0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.241+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2702007614 >> 172.21.15.192:0/2702007614 conn(0x5616de856dc0 msgr2=0x5616de855000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.241+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2702007614 shutdown_connections 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.241+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2702007614 wait complete. 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.242+0000 7fb26ea0f800 1 Processor -- start 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.242+0000 7fb26ea0f800 1 -- start start 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.242+0000 7fb26ea0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 0x5616de861da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.242+0000 7fb26ea0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5616de85b820 con 0x5616de85a9c0 2024-09-10T05:11:46.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.242+0000 7fb26c500640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 0x5616de861da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.242+0000 7fb26c500640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 0x5616de861da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59010/0 (socket says 172.21.15.192:59010) 2024-09-10T05:11:46.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.242+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 learned_addr learned my addr 172.21.15.192:0/3040457055 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.242+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616de862300 con 0x5616de85a9c0 2024-09-10T05:11:46.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.243+0000 7fb26c500640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 0x5616de861da0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb25c05ef40 tx=0x7fb25c076ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.243+0000 7fb149ffb640 1 -- 172.21.15.192:0/3040457055 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c0bc070 con 0x5616de85a9c0 2024-09-10T05:11:46.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.243+0000 7fb149ffb640 1 -- 172.21.15.192:0/3040457055 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c052a10 con 0x5616de85a9c0 2024-09-10T05:11:46.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.243+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616de862300 con 0x5616de85a9c0 2024-09-10T05:11:46.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.243+0000 7fb149ffb640 1 -- 172.21.15.192:0/3040457055 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c052cf0 con 0x5616de85a9c0 2024-09-10T05:11:46.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.243+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616de862300 con 0x5616de85a9c0 2024-09-10T05:11:46.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.244+0000 7fb149ffb640 1 -- 172.21.15.192:0/3040457055 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb25c0bf070 con 0x5616de85a9c0 2024-09-10T05:11:46.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.244+0000 7fb149ffb640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb13403c780 0x7fb13403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.244+0000 7fb149ffb640 1 -- 172.21.15.192:0/3040457055 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb25c0a8070 con 0x5616de85a9c0 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.244+0000 7fb26bcff640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb13403c780 0x7fb13403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.244+0000 7fb26ea0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.244+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5616de86d2f0 0x5616de86f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.244+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de86ff00 con 0x5616de86d2f0 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.244+0000 7fb26cd01640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5616de86d2f0 0x5616de86f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.244+0000 7fb26bcff640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb13403c780 0x7fb13403ec40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb26000ffd0 tx=0x7fb260023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.244+0000 7fb26cd01640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5616de86d2f0 0x5616de86f7b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 20 realm 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de870310 con 0x5616de86d2f0 2024-09-10T05:11:46.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:46.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de870be0 con 0x5616de86d2f0 2024-09-10T05:11:46.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de86d2f0 2024-09-10T05:11:46.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5616de871a70 0x5616de873e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.245+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de8745a0 con 0x5616de871a70 2024-09-10T05:11:46.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.246+0000 7fb26c500640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5616de871a70 0x5616de873e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.246+0000 7fb26c500640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5616de871a70 0x5616de873e60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.246+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.246+0000 7fb26ea0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:46.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.246+0000 7fb26ea0f800 20 searching for the correct realm 2024-09-10T05:11:46.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.246+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5616de876640 0x5616de878b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.246+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de8791d0 con 0x5616de876640 2024-09-10T05:11:46.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.246+0000 7fb26bcff640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5616de876640 0x5616de878b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.247+0000 7fb26bcff640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5616de876640 0x5616de878b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.247+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.247+0000 7fb26bcff640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb26002e910 0x7fb26003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.247+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de8791d0 con 0x7fb26002e910 2024-09-10T05:11:46.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.247+0000 7fb26cd01640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb26002e910 0x7fb26003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.247+0000 7fb26cd01640 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb26002e910 0x7fb26003a3c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.247+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.247+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de871a70 2024-09-10T05:11:46.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.248+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.248+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de86d2f0 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.248+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.248+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de86d2f0 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.248+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.248+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de871a70 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.248+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.248+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de871a70 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.249+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.249+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x7fb26002e910 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.249+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.249+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de876640 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.249+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.249+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de86d2f0 2024-09-10T05:11:46.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.249+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.249+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de871a70 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.250+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.250+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de86d2f0 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.250+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.250+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x7fb26002e910 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.250+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.250+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de876640 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.250+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.250+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de876640 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.250+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.251+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de871a70 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.251+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.251+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de876640 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.251+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.251+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de876640 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.251+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.251+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de86d2f0 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.251+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.251+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de86d2f0 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.252+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.252+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de871a70 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.252+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.252+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de876640 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.252+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.252+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x7fb26002e910 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.252+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.252+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de86d2f0 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.253+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.253+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de871a70 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.253+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.253+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de876640 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.253+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.253+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de871a70 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.253+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.253+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x7fb26002e910 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.254+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.254+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de876640 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.254+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.254+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de871a70 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.254+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.254+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x5616de86d2f0 2024-09-10T05:11:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.254+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.254+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5616de870f80 con 0x7fb26002e910 2024-09-10T05:11:46.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:46.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:46.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:46.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:46.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:46.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:46.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de874f40 con 0x5616de86d2f0 2024-09-10T05:11:46.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de874f40 con 0x5616de86d2f0 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.255+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de874f10 con 0x7fb26002e910 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 20 zone default found 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 4 Realm: () 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 20 zonegroup default 2024-09-10T05:11:46.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de875330 con 0x5616de871a70 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de874d20 con 0x5616de876640 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de87b040 con 0x5616de876640 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 20 started sync module instance, tier type = 2024-09-10T05:11:46.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:46.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.256+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87a4e0 con 0x7fb26002e910 2024-09-10T05:11:46.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.257+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.257+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94656222702080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87b3e0 con 0x7fb26002e910 2024-09-10T05:11:46.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.257+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87bc30 con 0x5616de86d2f0 2024-09-10T05:11:46.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.258+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94656222702080] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.259+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.259+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94656222704608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87bcb0 con 0x5616de86d2f0 2024-09-10T05:11:46.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.259+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87c580 con 0x5616de876640 2024-09-10T05:11:46.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.260+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.260+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94656222707376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87ce20 con 0x5616de876640 2024-09-10T05:11:46.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.260+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87d8d0 con 0x7fb26002e910 2024-09-10T05:11:46.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.260+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94656222704608] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.261+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94656222707376] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.261+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.261+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94656222710128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87d3b0 con 0x7fb26002e910 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.261+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87e170 con 0x5616de86d2f0 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.262+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.262+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94656222714992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87e090 con 0x5616de86d2f0 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.262+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87f090 con 0x5616de871a70 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.262+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94656222710128] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.263+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.263+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94656222718848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87f050 con 0x5616de871a70 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.263+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94656222714992] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.263+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87e560 con 0x5616de871a70 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.264+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94656222718848] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.264+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.264+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94656222717280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87f5f0 con 0x5616de871a70 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.264+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87ffb0 con 0x5616de871a70 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.265+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.265+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94656222722816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de8803d0 con 0x5616de871a70 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.265+0000 7fb26ea0f800 20 add_watcher() i=0 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.265+0000 7fb26ea0f800 20 add_watcher() i=1 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.265+0000 7fb26ea0f800 20 add_watcher() i=2 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.265+0000 7fb26ea0f800 20 add_watcher() i=3 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.265+0000 7fb26ea0f800 20 add_watcher() i=4 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.265+0000 7fb26ea0f800 20 add_watcher() i=5 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.265+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94656222717280] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.265+0000 7fb26ea0f800 20 add_watcher() i=6 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.266+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94656222722816] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.266+0000 7fb26ea0f800 20 add_watcher() i=7 2024-09-10T05:11:46.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.266+0000 7fb26ea0f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.266+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de87b800 con 0x5616de86d2f0 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.266+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.266+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94656222723872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87b800 con 0x5616de86d2f0 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.267+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94656222723872] v35'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.268+0000 7fb1227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.268+0000 7fb26ea0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.268+0000 7fb26ea0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.268+0000 7fb26ea0f800 5 note: GC not initialized 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.268+0000 7fb1217e2640 20 reqs_thread_entry: start 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.268+0000 7fb26ea0f800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.268+0000 7fb26ea0f800 20 Filter name: none 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.268+0000 7fb092ffd640 20 reqs_thread_entry: start 2024-09-10T05:11:46.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.268+0000 7fb26ea0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.268+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5616de8b60d0 con 0x5616de86d2f0 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.268+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.268+0000 7fb26ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:could not fetch user info: no user info saved 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.269+0000 7fb1227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.269+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94656222723872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de8b6090 con 0x5616de86d2f0 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.270+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94656222723872] v35'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.270+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94656222702080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de8b6090 con 0x7fb26002e910 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.271+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94656222702080] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.271+0000 7fb26ea0f800 20 remove_watcher() i=0 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.271+0000 7fb26ea0f800 2 removed watcher, disabling cache 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.271+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94656222704608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de8b6090 con 0x5616de86d2f0 2024-09-10T05:11:46.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.273+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94656222704608] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.273+0000 7fb26ea0f800 20 remove_watcher() i=1 2024-09-10T05:11:46.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.273+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94656222707376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de8b6090 con 0x5616de876640 2024-09-10T05:11:46.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.274+0000 7fb26bcff640 1 -- 172.21.15.192:0/3040457055 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94656222707376] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260037040 con 0x5616de876640 2024-09-10T05:11:46.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.274+0000 7fb26ea0f800 20 remove_watcher() i=2 2024-09-10T05:11:46.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.274+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94656222710128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87b3e0 con 0x7fb26002e910 2024-09-10T05:11:46.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.275+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94656222710128] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x7fb26002e910 2024-09-10T05:11:46.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.275+0000 7fb26ea0f800 20 remove_watcher() i=3 2024-09-10T05:11:46.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.275+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94656222714992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87c970 con 0x5616de86d2f0 2024-09-10T05:11:46.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.276+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94656222714992] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26400a4d0 con 0x5616de86d2f0 2024-09-10T05:11:46.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.276+0000 7fb26ea0f800 20 remove_watcher() i=4 2024-09-10T05:11:46.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.276+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94656222718848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87b3e0 con 0x5616de871a70 2024-09-10T05:11:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.277+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94656222718848] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.277+0000 7fb26ea0f800 20 remove_watcher() i=5 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.277+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94656222717280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87dc70 con 0x5616de871a70 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.279+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94656222717280] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.279+0000 7fb26ea0f800 20 remove_watcher() i=6 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.279+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94656222722816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5616de87eb80 con 0x5616de871a70 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26c500640 1 -- 172.21.15.192:0/3040457055 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94656222722816] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c0be030 con 0x5616de871a70 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 20 remove_watcher() i=7 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5616de871a70 msgr2=0x5616de873e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5616de871a70 0x5616de873e60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5616de86d2f0 msgr2=0x5616de86f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5616de86d2f0 0x5616de86f7b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb26002e910 msgr2=0x7fb26003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb26002e910 0x7fb26003a3c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5616de876640 msgr2=0x5616de878b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5616de876640 0x5616de878b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb13403c780 msgr2=0x7fb13403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb13403c780 0x7fb13403ec40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb26000ffd0 tx=0x7fb260023040 comp rx=0 tx=0).stop 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 msgr2=0x5616de861da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26cd01640 1 -- 172.21.15.192:0/3040457055 reap_dead start 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 0x5616de861da0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb25c05ef40 tx=0x7fb25c076ef0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 shutdown_connections 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/3040457055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de85a9c0 0x5616de861da0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 >> 172.21.15.192:0/3040457055 conn(0x5616de856dc0 msgr2=0x5616de854fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 shutdown_connections 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.280+0000 7fb26ea0f800 1 -- 172.21.15.192:0/3040457055 wait complete. 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/524155969 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb14403c780 msgr2=0x7fb14403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/524155969 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb14403c780 0x7fb14403ec40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5616de82fe50 tx=0x7fb260006000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/524155969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de736ec0 msgr2=0x5616de735730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/524155969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de736ec0 0x5616de735730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb25c095f90 tx=0x7fb25c05d820 comp rx=0 tx=0).stop 2024-09-10T05:11:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/524155969 shutdown_connections 2024-09-10T05:11:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/524155969 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb14403c780 0x7fb14403ec40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/524155969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de736ec0 0x5616de735730 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/524155969 >> 172.21.15.192:0/524155969 conn(0x5616de8402f0 msgr2=0x5616de8406d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/524155969 shutdown_connections 2024-09-10T05:11:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/524155969 wait complete. 2024-09-10T05:11:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5616de837760 msgr2=0x5616de839be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5616de837760 0x5616de839be0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5616de73a050 msgr2=0x5616de835400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5616de73a050 0x5616de835400 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5616de83b7d0 msgr2=0x5616de83dbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5616de83b7d0 0x5616de83dbc0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb15403c730 msgr2=0x7fb15403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb15403c730 0x7fb15403ebf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb260000c00 tx=0x7fb2600013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 msgr2=0x5616de82ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 --2- 172.21.15.192:0/2237713658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616de737720 0x5616de82ddb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb25c025c20 tx=0x7fb25c002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26cd01640 1 -- 172.21.15.192:0/2237713658 reap_dead start 2024-09-10T05:11:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 shutdown_connections 2024-09-10T05:11:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 >> 172.21.15.192:0/2237713658 conn(0x5616de7311c0 msgr2=0x5616de827710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 shutdown_connections 2024-09-10T05:11:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.281+0000 7fb26ea0f800 1 -- 172.21.15.192:0/2237713658 wait complete. 2024-09-10T05:11:46.294 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T05:11:46.294 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-10T05:11:46.294 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-10T05:11:46.294 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-10T05:11:46.349 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:46.349 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:46.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.349+0000 7fc09cb39800 1 Processor -- start 2024-09-10T05:11:46.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.349+0000 7fc09cb39800 1 -- start start 2024-09-10T05:11:46.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.349+0000 7fc09cb39800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55ef2ac06520 0x55ef2ac06920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.349+0000 7fc09cb39800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ef2aab1e40 con 0x55ef2ac06e60 2024-09-10T05:11:46.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.349+0000 7fc09cb39800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55ef2aa7c680 con 0x55ef2ac06520 2024-09-10T05:11:46.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.349+0000 7fc0987c7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55ef2ac06520 0x55ef2ac06920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.349+0000 7fc08ffff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55ef2ac06e60 0x55ef2ac07310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36172/0 (socket says 172.21.15.192:36172) 2024-09-10T05:11:46.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.349+0000 7fc0987c7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55ef2ac06520 0x55ef2ac06920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59014/0 (socket says 172.21.15.192:59014) 2024-09-10T05:11:46.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.349+0000 7fc08ffff640 1 -- 172.21.15.192:0/3759305695 learned_addr learned my addr 172.21.15.192:0/3759305695 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:46.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.350+0000 7fc0987c7640 1 -- 172.21.15.192:0/3759305695 >> v1:172.21.15.139:6789/0 conn(0x55ef2ac06e60 legacy=0x55ef2ac07310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.350+0000 7fc0987c7640 1 -- 172.21.15.192:0/3759305695 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2aa986b0 con 0x55ef2ac06520 2024-09-10T05:11:46.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.350+0000 7fc097fc6640 1 -- 172.21.15.192:0/3759305695 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1831866531 0 0) 0x55ef2aab1e40 con 0x55ef2ac06e60 2024-09-10T05:11:46.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.351+0000 7fc0987c7640 1 --2- 172.21.15.192:0/3759305695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2ac06920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc08800a470 tx=0x7fc088045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8ab20dd73ac93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.351+0000 7fc097fc6640 1 -- 172.21.15.192:0/3759305695 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc088053570 con 0x55ef2ac06520 2024-09-10T05:11:46.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.352+0000 7fc097fc6640 1 -- 172.21.15.192:0/3759305695 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc088058070 con 0x55ef2ac06520 2024-09-10T05:11:46.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.352+0000 7fc097fc6640 1 -- 172.21.15.192:0/3759305695 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc088053880 con 0x55ef2ac06520 2024-09-10T05:11:46.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.352+0000 7fc09cb39800 1 -- 172.21.15.192:0/3759305695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 msgr2=0x55ef2ac06920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.352+0000 7fc09cb39800 1 --2- 172.21.15.192:0/3759305695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2ac06920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc08800a470 tx=0x7fc088045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:46.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.352+0000 7fc09cb39800 1 -- 172.21.15.192:0/3759305695 shutdown_connections 2024-09-10T05:11:46.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.352+0000 7fc09cb39800 1 --2- 172.21.15.192:0/3759305695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2ac06920 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.352+0000 7fc09cb39800 1 -- 172.21.15.192:0/3759305695 >> 172.21.15.192:0/3759305695 conn(0x55ef2ac02250 msgr2=0x55ef2ac04690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.352+0000 7fc09cb39800 1 -- 172.21.15.192:0/3759305695 shutdown_connections 2024-09-10T05:11:46.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.352+0000 7fc09cb39800 1 -- 172.21.15.192:0/3759305695 wait complete. 2024-09-10T05:11:46.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.366+0000 7fc09cb39800 1 Processor -- start 2024-09-10T05:11:46.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.366+0000 7fc09cb39800 1 -- start start 2024-09-10T05:11:46.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.366+0000 7fc09cb39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2acf9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.366+0000 7fc09cb39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ef2aaa0dd0 con 0x55ef2ac06520 2024-09-10T05:11:46.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.366+0000 7fc0987c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2acf9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.366+0000 7fc0987c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2acf9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59028/0 (socket says 172.21.15.192:59028) 2024-09-10T05:11:46.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.366+0000 7fc0987c7640 1 -- 172.21.15.192:0/1263664779 learned_addr learned my addr 172.21.15.192:0/1263664779 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.366+0000 7fc0987c7640 1 -- 172.21.15.192:0/1263664779 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2aab9e10 con 0x55ef2ac06520 2024-09-10T05:11:46.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.367+0000 7fc0987c7640 1 --2- 172.21.15.192:0/1263664779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2acf9780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc088025c20 tx=0x7fc088051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c48798c6327bf6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.367+0000 7fbf8660c640 1 -- 172.21.15.192:0/1263664779 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc088053a20 con 0x55ef2ac06520 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.367+0000 7fbf8660c640 1 -- 172.21.15.192:0/1263664779 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc088063070 con 0x55ef2ac06520 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.367+0000 7fbf8660c640 1 -- 172.21.15.192:0/1263664779 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc088053d30 con 0x55ef2ac06520 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc09cb39800 1 -- 172.21.15.192:0/1263664779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 msgr2=0x55ef2acf9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc09cb39800 1 --2- 172.21.15.192:0/1263664779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2acf9780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc088025c20 tx=0x7fc088051000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc09cb39800 1 -- 172.21.15.192:0/1263664779 shutdown_connections 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc09cb39800 1 --2- 172.21.15.192:0/1263664779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2acf9780 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc09cb39800 1 -- 172.21.15.192:0/1263664779 >> 172.21.15.192:0/1263664779 conn(0x55ef2ac02250 msgr2=0x55ef2acf5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc09cb39800 1 -- 172.21.15.192:0/1263664779 shutdown_connections 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc09cb39800 1 -- 172.21.15.192:0/1263664779 wait complete. 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc09cb39800 1 Processor -- start 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc09cb39800 1 -- start start 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc09cb39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2ad01050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc09cb39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ef2ac07d80 con 0x55ef2ac06520 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc0987c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2ad01050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc0987c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2ad01050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59040/0 (socket says 172.21.15.192:59040) 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.368+0000 7fc0987c7640 1 -- 172.21.15.192:0/1561661139 learned_addr learned my addr 172.21.15.192:0/1561661139 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.369+0000 7fc0987c7640 1 -- 172.21.15.192:0/1561661139 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2ad015b0 con 0x55ef2ac06520 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.369+0000 7fc0987c7640 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2ad01050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc088025c20 tx=0x7fc088002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.369+0000 7fbf84e09640 1 -- 172.21.15.192:0/1561661139 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc088078070 con 0x55ef2ac06520 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.369+0000 7fbf84e09640 1 -- 172.21.15.192:0/1561661139 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc088073470 con 0x55ef2ac06520 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.369+0000 7fbf84e09640 1 -- 172.21.15.192:0/1561661139 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc088073750 con 0x55ef2ac06520 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.369+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef2ad01840 con 0x55ef2ac06520 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.369+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef2ad02450 con 0x55ef2ac06520 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.370+0000 7fbf84e09640 1 -- 172.21.15.192:0/1561661139 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc08807b070 con 0x55ef2ac06520 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.370+0000 7fbf84e09640 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf8003c780 0x7fbf8003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.370+0000 7fbf84e09640 1 -- 172.21.15.192:0/1561661139 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fc088097ba0 con 0x55ef2ac06520 2024-09-10T05:11:46.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.370+0000 7fc08ffff640 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf8003c780 0x7fbf8003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.370+0000 7fc09cb39800 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ef2ac06e60 0x55ef2ad086a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.370+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad02e10 con 0x55ef2ac06e60 2024-09-10T05:11:46.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.370+0000 7fc098fc8640 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ef2ac06e60 0x55ef2ad086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.370+0000 7fc08ffff640 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf8003c780 0x7fbf8003ec40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc080000c00 tx=0x7fc0800013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.371+0000 7fc098fc8640 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ef2ac06e60 0x55ef2ad086a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.371+0000 7fc098fc8640 1 -- 172.21.15.192:0/1561661139 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ac06e60 2024-09-10T05:11:46.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.371+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad02790 con 0x55ef2ac06e60 2024-09-10T05:11:46.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.371+0000 7fc098fc8640 1 -- 172.21.15.192:0/1561661139 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ac06e60 2024-09-10T05:11:46.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.371+0000 7fc09cb39800 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ef2ad0aab0 0x55ef2ad0cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.371+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad0d570 con 0x55ef2ad0aab0 2024-09-10T05:11:46.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.371+0000 7fc0987c7640 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ef2ad0aab0 0x55ef2ad0cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.372+0000 7fc0987c7640 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ef2ad0aab0 0x55ef2ad0cea0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.372+0000 7fc0987c7640 1 -- 172.21.15.192:0/1561661139 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc08807a030 con 0x55ef2ad0aab0 2024-09-10T05:11:46.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.372+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad09950 con 0x55ef2ac06e60 2024-09-10T05:11:46.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.372+0000 7fc098fc8640 1 -- 172.21.15.192:0/1561661139 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ac06e60 2024-09-10T05:11:46.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.372+0000 7fc09cb39800 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ef2ad0e9b0 0x55ef2ad10da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.372+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad114e0 con 0x55ef2ad0e9b0 2024-09-10T05:11:46.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.372+0000 7fc08ffff640 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ef2ad0e9b0 0x55ef2ad10da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.373+0000 7fc08ffff640 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ef2ad0e9b0 0x55ef2ad10da0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.373+0000 7fc08ffff640 1 -- 172.21.15.192:0/1561661139 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc08000f670 con 0x55ef2ad0e9b0 2024-09-10T05:11:46.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.373+0000 7fc09cb39800 1 Processor -- start 2024-09-10T05:11:46.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.373+0000 7fc09cb39800 1 -- start start 2024-09-10T05:11:46.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.373+0000 7fc09cb39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad1f140 0x55ef2ad1f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.373+0000 7fc09cb39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ef2aafea00 con 0x55ef2ad1f140 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.374+0000 7fc0987c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad1f140 0x55ef2ad1f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.374+0000 7fc0987c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad1f140 0x55ef2ad1f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59048/0 (socket says 172.21.15.192:59048) 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.374+0000 7fc0987c7640 1 -- 172.21.15.192:0/3398064153 learned_addr learned my addr 172.21.15.192:0/3398064153 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.374+0000 7fc0987c7640 1 -- 172.21.15.192:0/3398064153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2ad1fba0 con 0x55ef2ad1f140 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.374+0000 7fc0987c7640 1 --2- 172.21.15.192:0/3398064153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad1f140 0x55ef2ad1f560 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc088068fd0 tx=0x7fc088096170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.374+0000 7fbf7dffb640 1 -- 172.21.15.192:0/3398064153 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc08805cd30 con 0x55ef2ad1f140 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.374+0000 7fbf7dffb640 1 -- 172.21.15.192:0/3398064153 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08805f950 con 0x55ef2ad1f140 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.374+0000 7fbf7dffb640 1 -- 172.21.15.192:0/3398064153 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc08805fc30 con 0x55ef2ad1f140 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.374+0000 7fc09cb39800 1 -- 172.21.15.192:0/3398064153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef2ad203d0 con 0x55ef2ad1f140 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.374+0000 7fc09cb39800 1 -- 172.21.15.192:0/3398064153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef2ad20970 con 0x55ef2ad1f140 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.375+0000 7fbf7dffb640 1 -- 172.21.15.192:0/3398064153 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc08805c410 con 0x55ef2ad1f140 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.375+0000 7fbf7dffb640 1 --2- 172.21.15.192:0/3398064153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf7003c730 0x7fbf7003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.375+0000 7fbf7dffb640 1 -- 172.21.15.192:0/3398064153 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fc088090070 con 0x55ef2ad1f140 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.375+0000 7fc08ffff640 1 --2- 172.21.15.192:0/3398064153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf7003c730 0x7fbf7003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.375+0000 7fc09cb39800 1 Processor -- start 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.375+0000 7fc09cb39800 1 -- start start 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.375+0000 7fc08ffff640 1 --2- 172.21.15.192:0/3398064153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf7003c730 0x7fbf7003ebf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55ef2ad08c80 tx=0x7fc080006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.376+0000 7fc09cb39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 0x55ef2ad2bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.376+0000 7fc09cb39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ef2acf9f70 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.376+0000 7fc0987c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 0x55ef2ad2bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.376+0000 7fc0987c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 0x55ef2ad2bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59060/0 (socket says 172.21.15.192:59060) 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.376+0000 7fc0987c7640 1 -- 172.21.15.192:0/3480589004 learned_addr learned my addr 172.21.15.192:0/3480589004 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.376+0000 7fc0987c7640 1 -- 172.21.15.192:0/3480589004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2ad2c390 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.376+0000 7fc0987c7640 1 --2- 172.21.15.192:0/3480589004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 0x55ef2ad2bda0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc088093bd0 tx=0x7fc08807ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d815fa193558c603 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.376+0000 7fbf6f7fe640 1 -- 172.21.15.192:0/3480589004 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0880af020 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.376+0000 7fbf6f7fe640 1 -- 172.21.15.192:0/3480589004 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08805fdd0 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.376+0000 7fbf6f7fe640 1 -- 172.21.15.192:0/3480589004 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc08807e450 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc09cb39800 1 -- 172.21.15.192:0/3480589004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 msgr2=0x55ef2ad2bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc09cb39800 1 --2- 172.21.15.192:0/3480589004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 0x55ef2ad2bda0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc088093bd0 tx=0x7fc08807ad70 comp rx=0 tx=0).stop 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc09cb39800 1 -- 172.21.15.192:0/3480589004 shutdown_connections 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc09cb39800 1 --2- 172.21.15.192:0/3480589004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 0x55ef2ad2bda0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc09cb39800 1 -- 172.21.15.192:0/3480589004 >> 172.21.15.192:0/3480589004 conn(0x55ef2ad27dc0 msgr2=0x55ef2ad26000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc09cb39800 1 -- 172.21.15.192:0/3480589004 shutdown_connections 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc09cb39800 1 -- 172.21.15.192:0/3480589004 wait complete. 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc09cb39800 1 Processor -- start 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc09cb39800 1 -- start start 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc09cb39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 0x55ef2ad32da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc09cb39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ef2ad2c820 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc0987c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 0x55ef2ad32da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc0987c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 0x55ef2ad32da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59076/0 (socket says 172.21.15.192:59076) 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.377+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 learned_addr learned my addr 172.21.15.192:0/466938729 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.378+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2ad33300 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.378+0000 7fc0987c7640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 0x55ef2ad32da0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc08805d010 tx=0x7fc088077fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.378+0000 7fbf6dffb640 1 -- 172.21.15.192:0/466938729 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0880c3070 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.378+0000 7fbf6dffb640 1 -- 172.21.15.192:0/466938729 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc088093e00 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.378+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef2ad33300 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.378+0000 7fbf6dffb640 1 -- 172.21.15.192:0/466938729 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0880974a0 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.378+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef2ad33300 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.379+0000 7fbf6dffb640 1 -- 172.21.15.192:0/466938729 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc0880c6070 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.379+0000 7fbf6dffb640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf6003c780 0x7fbf6003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.379+0000 7fbf6dffb640 1 -- 172.21.15.192:0/466938729 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fc0880bb050 con 0x55ef2ad2b9c0 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.379+0000 7fc08ffff640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf6003c780 0x7fbf6003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.380+0000 7fc08ffff640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf6003c780 0x7fbf6003ec40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc08000ffd0 tx=0x7fc080023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.380+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.380+0000 7fc09cb39800 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ef2ad3e0f0 0x55ef2ad405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.380+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad40d00 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.380+0000 7fc098fc8640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ef2ad3e0f0 0x55ef2ad405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.380+0000 7fc098fc8640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ef2ad3e0f0 0x55ef2ad405b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.380+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 20 realm 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41110 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad419e0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ef2ad42ae0 0x55ef2ad44ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad45490 con 0x55ef2ad42ae0 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.381+0000 7fc0987c7640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ef2ad42ae0 0x55ef2ad44ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.382+0000 7fc0987c7640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ef2ad42ae0 0x55ef2ad44ed0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.382+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.382+0000 7fc09cb39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.382+0000 7fc09cb39800 20 searching for the correct realm 2024-09-10T05:11:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.382+0000 7fc09cb39800 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ef2ad47440 0x55ef2ad49900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.382+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad49fd0 con 0x55ef2ad47440 2024-09-10T05:11:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.382+0000 7fc08ffff640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ef2ad47440 0x55ef2ad49900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.382+0000 7fc08ffff640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ef2ad47440 0x55ef2ad49900 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.383+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.383+0000 7fc08ffff640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc08002e910 0x7fc08003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.383+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad49fd0 con 0x7fc08002e910 2024-09-10T05:11:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.383+0000 7fc098fc8640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc08002e910 0x7fc08003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.383+0000 7fc098fc8640 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc08002e910 0x7fc08003a3c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.383+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.383+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad42ae0 2024-09-10T05:11:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.383+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.384+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.384+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.384+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.384+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.384+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad42ae0 2024-09-10T05:11:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.384+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.384+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad42ae0 2024-09-10T05:11:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.384+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.384+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x7fc08002e910 2024-09-10T05:11:46.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.385+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.385+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad47440 2024-09-10T05:11:46.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.385+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.385+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.385+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.385+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad42ae0 2024-09-10T05:11:46.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.385+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.385+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.386+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.386+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x7fc08002e910 2024-09-10T05:11:46.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.386+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.386+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad47440 2024-09-10T05:11:46.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.386+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.386+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad47440 2024-09-10T05:11:46.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.386+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.386+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad42ae0 2024-09-10T05:11:46.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.387+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.387+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad47440 2024-09-10T05:11:46.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.387+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.387+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad47440 2024-09-10T05:11:46.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.387+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.387+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.387+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.387+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.387+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.387+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad42ae0 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.388+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.388+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad47440 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.388+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.388+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x7fc08002e910 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.388+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.388+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.388+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.388+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad42ae0 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.389+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.389+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad47440 2024-09-10T05:11:46.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.389+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.389+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad42ae0 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.389+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.389+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x7fc08002e910 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.389+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.389+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad47440 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad42ae0 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad41d80 con 0x7fc08002e910 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc09cb39800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc09cb39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc09cb39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc09cb39800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc09cb39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc09cb39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.390+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad45d50 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad45d50 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad45d50 con 0x7fc08002e910 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 20 zone default found 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 4 Realm: () 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 20 zonegroup default 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.391+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad465f0 con 0x55ef2ad42ae0 2024-09-10T05:11:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc09cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4be40 con 0x55ef2ad47440 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc09cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4c1e0 con 0x55ef2ad47440 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc09cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc09cb39800 20 started sync module instance, tier type = 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc09cb39800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.392+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4b2e0 con 0x7fc08002e910 2024-09-10T05:11:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.393+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.393+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94485704128528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4b2e0 con 0x7fc08002e910 2024-09-10T05:11:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.393+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4cba0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.395+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.395+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94485704132336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4cfc0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.395+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4da80 con 0x55ef2ad47440 2024-09-10T05:11:46.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.396+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94485704132336] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.396+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.396+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94485704128528] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.396+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94485704126000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4cfc0 con 0x55ef2ad47440 2024-09-10T05:11:46.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.396+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4e350 con 0x7fc08002e910 2024-09-10T05:11:46.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.397+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94485704126000] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.397+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.397+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94485704138400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4e2c0 con 0x7fc08002e910 2024-09-10T05:11:46.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.397+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4f240 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.398+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94485704138400] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.398+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.398+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94485704140512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4f240 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.398+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4fc00 con 0x55ef2ad42ae0 2024-09-10T05:11:46.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.399+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.399+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94485704144720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad50020 con 0x55ef2ad42ae0 2024-09-10T05:11:46.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.399+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad50b00 con 0x55ef2ad42ae0 2024-09-10T05:11:46.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.399+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94485704140512] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.400+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.400+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94485704148496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad50b00 con 0x55ef2ad42ae0 2024-09-10T05:11:46.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.400+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad51520 con 0x55ef2ad42ae0 2024-09-10T05:11:46.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.401+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94485704144720] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.401+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94485704148496] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.401+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.401+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94485704142224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4fb70 con 0x55ef2ad42ae0 2024-09-10T05:11:46.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.401+0000 7fc09cb39800 20 add_watcher() i=0 2024-09-10T05:11:46.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.401+0000 7fc09cb39800 20 add_watcher() i=1 2024-09-10T05:11:46.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.401+0000 7fc09cb39800 20 add_watcher() i=2 2024-09-10T05:11:46.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.401+0000 7fc09cb39800 20 add_watcher() i=3 2024-09-10T05:11:46.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.401+0000 7fc09cb39800 20 add_watcher() i=4 2024-09-10T05:11:46.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.401+0000 7fc09cb39800 20 add_watcher() i=5 2024-09-10T05:11:46.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.401+0000 7fc09cb39800 20 add_watcher() i=6 2024-09-10T05:11:46.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.402+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94485704142224] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.402+0000 7fc09cb39800 20 add_watcher() i=7 2024-09-10T05:11:46.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.402+0000 7fc09cb39800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:46.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.402+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad54510 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.403+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.403+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94485704151056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad51990 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.403+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94485704151056] v35'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.404+0000 7fbf4e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.404+0000 7fc09cb39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:46.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.404+0000 7fc09cb39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:46.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.404+0000 7fc09cb39800 5 note: GC not initialized 2024-09-10T05:11:46.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.404+0000 7fbf4d7e2640 20 reqs_thread_entry: start 2024-09-10T05:11:46.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.404+0000 7fc09cb39800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:46.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.404+0000 7fc09cb39800 20 Filter name: none 2024-09-10T05:11:46.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.404+0000 7fbebeffd640 20 reqs_thread_entry: start 2024-09-10T05:11:46.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.404+0000 7fc09cb39800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:46.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.404+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.404+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad874a0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.404+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-10T05:11:46.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:46.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-10T05:11:46.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad85b40 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad85b40 con 0x55ef2ad42ae0 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.405+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad86460 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.406+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v35'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.406+0000 7fc09cb39800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.406+0000 7fc09cb39800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.406+0000 7fc09cb39800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.406+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94485704368048 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad8ade0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.407+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== watch-notify(notify (1) cookie 94485704140512 notify 150323855360 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55ef2ad86800 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.407+0000 7fbf6f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855360 cookie 94485704140512 notifier 4301 bl.length()=567 2024-09-10T05:11:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.407+0000 7fbf6f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.407+0000 7fbf6f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.407+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 notify.4 [notify cookie 94485704368048 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.407+0000 7fbf6f7fe640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbf5c003ea0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.407+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.407+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== watch-notify(notify_complete (2) cookie 94485704368048 notify 150323855360 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ef2ad86f70 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.407+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad85fb0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.408+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.408+0000 7fc09cb39800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.408+0000 7fc09cb39800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.408+0000 7fc09cb39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.408+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94485704368048 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad8af40 con 0x7fc08002e910 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.408+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== watch-notify(notify (1) cookie 94485704138400 notify 150323855360 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55ef2ad86f70 con 0x7fc08002e910 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.409+0000 7fbf6f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855360 cookie 94485704138400 notifier 4301 bl.length()=169 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.409+0000 7fbf6f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.409+0000 7fbf6f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.409+0000 7fbf6f7fe640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbf5c003ea0 con 0x7fc08002e910 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.409+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(69 notify.3 [notify cookie 94485704368048 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.409+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.409+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== watch-notify(notify_complete (2) cookie 94485704368048 notify 150323855360 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc090026620 con 0x7fc08002e910 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.409+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad88f20 con 0x55ef2ad42ae0 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.410+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.410+0000 7fc09cb39800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.410+0000 7fc09cb39800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.410+0000 7fc09cb39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.410+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94485704378640 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad8b3f0 con 0x7fc08002e910 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.410+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== watch-notify(notify (1) cookie 94485704138400 notify 150323855361 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fc090026620 con 0x7fc08002e910 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.410+0000 7fbf6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855361 cookie 94485704138400 notifier 4301 bl.length()=177 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.410+0000 7fbf6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.410+0000 7fbf6effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.410+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(72 notify.3 [notify cookie 94485704378640 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.410+0000 7fbf6effd640 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbecc003400 con 0x7fc08002e910 2024-09-10T05:11:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.411+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== watch-notify(notify_complete (2) cookie 94485704378640 notify 150323855361 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc090026ad0 con 0x7fc08002e910 2024-09-10T05:11:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.411+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.431 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:46.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.412+0000 7fbf4e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.412+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94485704151056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad85290 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.413+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94485704151056] v35'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.413+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94485704128528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad85290 con 0x7fc08002e910 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.413+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94485704128528] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.414+0000 7fc09cb39800 20 remove_watcher() i=0 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.414+0000 7fc09cb39800 2 removed watcher, disabling cache 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.414+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94485704132336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad85290 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.415+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94485704132336] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.415+0000 7fc09cb39800 20 remove_watcher() i=1 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.415+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94485704126000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad85290 con 0x55ef2ad47440 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.416+0000 7fc08ffff640 1 -- 172.21.15.192:0/466938729 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94485704126000] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc080037040 con 0x55ef2ad47440 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.416+0000 7fc09cb39800 20 remove_watcher() i=2 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.416+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94485704138400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4c6f0 con 0x7fc08002e910 2024-09-10T05:11:46.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.417+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94485704138400] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x7fc08002e910 2024-09-10T05:11:46.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.417+0000 7fc09cb39800 20 remove_watcher() i=3 2024-09-10T05:11:46.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.417+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94485704140512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4ae30 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.418+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94485704140512] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09000a4d0 con 0x55ef2ad3e0f0 2024-09-10T05:11:46.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.418+0000 7fc09cb39800 20 remove_watcher() i=4 2024-09-10T05:11:46.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.418+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94485704144720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4dea0 con 0x55ef2ad42ae0 2024-09-10T05:11:46.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.419+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94485704144720] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.419+0000 7fc09cb39800 20 remove_watcher() i=5 2024-09-10T05:11:46.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.419+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94485704148496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4c6f0 con 0x55ef2ad42ae0 2024-09-10T05:11:46.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.420+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94485704148496] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.420+0000 7fc09cb39800 20 remove_watcher() i=6 2024-09-10T05:11:46.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.420+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94485704142224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ef2ad4ae30 con 0x55ef2ad42ae0 2024-09-10T05:11:46.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc0987c7640 1 -- 172.21.15.192:0/466938729 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94485704142224] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc0880c5030 con 0x55ef2ad42ae0 2024-09-10T05:11:46.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 20 remove_watcher() i=7 2024-09-10T05:11:46.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ef2ad42ae0 msgr2=0x55ef2ad44ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ef2ad42ae0 0x55ef2ad44ed0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ef2ad3e0f0 msgr2=0x55ef2ad405b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ef2ad3e0f0 0x55ef2ad405b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc08002e910 msgr2=0x7fc08003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc08002e910 0x7fc08003a3c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ef2ad47440 msgr2=0x55ef2ad49900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ef2ad47440 0x55ef2ad49900 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf6003c780 msgr2=0x7fbf6003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf6003c780 0x7fbf6003ec40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc08000ffd0 tx=0x7fc080023040 comp rx=0 tx=0).stop 2024-09-10T05:11:46.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc098fc8640 1 -- 172.21.15.192:0/466938729 reap_dead start 2024-09-10T05:11:46.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 msgr2=0x55ef2ad32da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 0x55ef2ad32da0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc08805d010 tx=0x7fc088077fd0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 shutdown_connections 2024-09-10T05:11:46.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 --2- 172.21.15.192:0/466938729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad2b9c0 0x55ef2ad32da0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 >> 172.21.15.192:0/466938729 conn(0x55ef2ad27dc0 msgr2=0x55ef2ad25fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 shutdown_connections 2024-09-10T05:11:46.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.421+0000 7fc09cb39800 1 -- 172.21.15.192:0/466938729 wait complete. 2024-09-10T05:11:46.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/3398064153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf7003c730 msgr2=0x7fbf7003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 --2- 172.21.15.192:0/3398064153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf7003c730 0x7fbf7003ebf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55ef2ad08c80 tx=0x7fc080006000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/3398064153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad1f140 msgr2=0x55ef2ad1f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 --2- 172.21.15.192:0/3398064153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad1f140 0x55ef2ad1f560 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc088068fd0 tx=0x7fc088096170 comp rx=0 tx=0).stop 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/3398064153 shutdown_connections 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 --2- 172.21.15.192:0/3398064153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf7003c730 0x7fbf7003ebf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 --2- 172.21.15.192:0/3398064153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ad1f140 0x55ef2ad1f560 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/3398064153 >> 172.21.15.192:0/3398064153 conn(0x55ef2ad134f0 msgr2=0x55ef2ad138d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/3398064153 shutdown_connections 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/3398064153 wait complete. 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ef2ad0aab0 msgr2=0x55ef2ad0cea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ef2ad0aab0 0x55ef2ad0cea0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ef2ac06e60 msgr2=0x55ef2ad086a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ef2ac06e60 0x55ef2ad086a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ef2ad0e9b0 msgr2=0x55ef2ad10da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ef2ad0e9b0 0x55ef2ad10da0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf8003c780 msgr2=0x7fbf8003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbf8003c780 0x7fbf8003ec40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc080000c00 tx=0x7fc0800013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 msgr2=0x55ef2ad01050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 --2- 172.21.15.192:0/1561661139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef2ac06520 0x55ef2ad01050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc088025c20 tx=0x7fc088002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc098fc8640 1 -- 172.21.15.192:0/1561661139 reap_dead start 2024-09-10T05:11:46.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 shutdown_connections 2024-09-10T05:11:46.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 >> 172.21.15.192:0/1561661139 conn(0x55ef2ac02250 msgr2=0x55ef2acfa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 shutdown_connections 2024-09-10T05:11:46.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.422+0000 7fc09cb39800 1 -- 172.21.15.192:0/1561661139 wait complete. 2024-09-10T05:11:46.443 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:46.444 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-10T05:11:46.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-10T05:11:46.444 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-10T05:11:46.493 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:46.493 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:46.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.492+0000 7fb356214800 1 Processor -- start 2024-09-10T05:11:46.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.493+0000 7fb356214800 1 -- start start 2024-09-10T05:11:46.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.493+0000 7fb356214800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c97ef2c630 0x55c97ef2ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.493+0000 7fb356214800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c97edd5e40 con 0x55c97ef2f050 2024-09-10T05:11:46.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.493+0000 7fb356214800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55c97eda0680 con 0x55c97ef2c630 2024-09-10T05:11:46.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.493+0000 7fb3518cb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c97ef2c630 0x55c97ef2ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.493+0000 7fb3510ca640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55c97ef2f050 0x55c97ef31510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36186/0 (socket says 172.21.15.192:36186) 2024-09-10T05:11:46.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.493+0000 7fb3510ca640 1 -- 172.21.15.192:0/3723939446 learned_addr learned my addr 172.21.15.192:0/3723939446 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:46.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.493+0000 7fb3518cb640 1 -- 172.21.15.192:0/3723939446 >> v1:172.21.15.139:6789/0 conn(0x55c97ef2f050 legacy=0x55c97ef31510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.493+0000 7fb3508c9640 1 -- 172.21.15.192:0/3723939446 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2452782317 0 0) 0x55c97edd5e40 con 0x55c97ef2f050 2024-09-10T05:11:46.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.493+0000 7fb3518cb640 1 -- 172.21.15.192:0/3723939446 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97edbc6b0 con 0x55c97ef2c630 2024-09-10T05:11:46.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.495+0000 7fb3518cb640 1 --2- 172.21.15.192:0/3723939446 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97ef2ea20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb34c005fd0 tx=0x7fb34c045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97140d8ceef3942 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.495+0000 7fb3508c9640 1 -- 172.21.15.192:0/3723939446 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb34c058530 con 0x55c97ef2c630 2024-09-10T05:11:46.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.495+0000 7fb3508c9640 1 -- 172.21.15.192:0/3723939446 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb34c0586d0 con 0x55c97ef2c630 2024-09-10T05:11:46.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.495+0000 7fb3508c9640 1 -- 172.21.15.192:0/3723939446 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb34c0589d0 con 0x55c97ef2c630 2024-09-10T05:11:46.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.496+0000 7fb356214800 1 -- 172.21.15.192:0/3723939446 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 msgr2=0x55c97ef2ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.496+0000 7fb356214800 1 --2- 172.21.15.192:0/3723939446 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97ef2ea20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb34c005fd0 tx=0x7fb34c045c30 comp rx=0 tx=0).stop 2024-09-10T05:11:46.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.496+0000 7fb356214800 1 -- 172.21.15.192:0/3723939446 shutdown_connections 2024-09-10T05:11:46.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.496+0000 7fb356214800 1 --2- 172.21.15.192:0/3723939446 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97ef2ea20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.496+0000 7fb356214800 1 -- 172.21.15.192:0/3723939446 >> 172.21.15.192:0/3723939446 conn(0x55c97ef26210 msgr2=0x55c97ef28650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.496+0000 7fb356214800 1 -- 172.21.15.192:0/3723939446 shutdown_connections 2024-09-10T05:11:46.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.496+0000 7fb356214800 1 -- 172.21.15.192:0/3723939446 wait complete. 2024-09-10T05:11:46.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.510+0000 7fb356214800 1 Processor -- start 2024-09-10T05:11:46.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.510+0000 7fb356214800 1 -- start start 2024-09-10T05:11:46.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.510+0000 7fb356214800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97f01b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.510+0000 7fb356214800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c97edc4dd0 con 0x55c97ef2c630 2024-09-10T05:11:46.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.510+0000 7fb3518cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97f01b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.510+0000 7fb3518cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97f01b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59094/0 (socket says 172.21.15.192:59094) 2024-09-10T05:11:46.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.510+0000 7fb3518cb640 1 -- 172.21.15.192:0/3570852083 learned_addr learned my addr 172.21.15.192:0/3570852083 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.511+0000 7fb3518cb640 1 -- 172.21.15.192:0/3570852083 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97eddde10 con 0x55c97ef2c630 2024-09-10T05:11:46.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.511+0000 7fb3518cb640 1 --2- 172.21.15.192:0/3570852083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97f01b4d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb34c025a60 tx=0x7fb34c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d95770bc928431 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.511+0000 7fb23fe07640 1 -- 172.21.15.192:0/3570852083 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb34c068070 con 0x55c97ef2c630 2024-09-10T05:11:46.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.511+0000 7fb23fe07640 1 -- 172.21.15.192:0/3570852083 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb34c058880 con 0x55c97ef2c630 2024-09-10T05:11:46.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.511+0000 7fb23fe07640 1 -- 172.21.15.192:0/3570852083 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb34c058ba0 con 0x55c97ef2c630 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb356214800 1 -- 172.21.15.192:0/3570852083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 msgr2=0x55c97f01b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb356214800 1 --2- 172.21.15.192:0/3570852083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97f01b4d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb34c025a60 tx=0x7fb34c051000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb356214800 1 -- 172.21.15.192:0/3570852083 shutdown_connections 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb356214800 1 --2- 172.21.15.192:0/3570852083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97f01b4d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb356214800 1 -- 172.21.15.192:0/3570852083 >> 172.21.15.192:0/3570852083 conn(0x55c97ef26210 msgr2=0x55c97f016e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb356214800 1 -- 172.21.15.192:0/3570852083 shutdown_connections 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb356214800 1 -- 172.21.15.192:0/3570852083 wait complete. 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb356214800 1 Processor -- start 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb356214800 1 -- start start 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb356214800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97ef2bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb356214800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c97ef33070 con 0x55c97ef2c630 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb3518cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97ef2bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb3518cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97ef2bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59102/0 (socket says 172.21.15.192:59102) 2024-09-10T05:11:46.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.512+0000 7fb3518cb640 1 -- 172.21.15.192:0/2951419896 learned_addr learned my addr 172.21.15.192:0/2951419896 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.513+0000 7fb3518cb640 1 -- 172.21.15.192:0/2951419896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97ef2c2b0 con 0x55c97ef2c630 2024-09-10T05:11:46.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.513+0000 7fb3518cb640 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97ef2bd50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb34c025a60 tx=0x7fb34c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.513+0000 7fb23e604640 1 -- 172.21.15.192:0/2951419896 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb34c068040 con 0x55c97ef2c630 2024-09-10T05:11:46.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.513+0000 7fb23e604640 1 -- 172.21.15.192:0/2951419896 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb34c071070 con 0x55c97ef2c630 2024-09-10T05:11:46.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.513+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c97ef2a660 con 0x55c97ef2c630 2024-09-10T05:11:46.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.513+0000 7fb23e604640 1 -- 172.21.15.192:0/2951419896 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb34c0637b0 con 0x55c97ef2c630 2024-09-10T05:11:46.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.513+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c97ef2abc0 con 0x55c97ef2c630 2024-09-10T05:11:46.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.514+0000 7fb23e604640 1 -- 172.21.15.192:0/2951419896 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb34c063950 con 0x55c97ef2c630 2024-09-10T05:11:46.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.514+0000 7fb23e604640 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb23803c780 0x7fb23803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.514+0000 7fb23e604640 1 -- 172.21.15.192:0/2951419896 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb34c097390 con 0x55c97ef2c630 2024-09-10T05:11:46.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.514+0000 7fb3510ca640 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb23803c780 0x7fb23803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.514+0000 7fb356214800 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c97ef2f050 0x55c97f02c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.514+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f02c800 con 0x55c97ef2f050 2024-09-10T05:11:46.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.514+0000 7fb3520cc640 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c97ef2f050 0x55c97f02c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.515+0000 7fb3510ca640 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb23803c780 0x7fb23803ec40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb33c000c00 tx=0x7fb33c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.515+0000 7fb3520cc640 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c97ef2f050 0x55c97f02c2c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.515+0000 7fb3520cc640 1 -- 172.21.15.192:0/2951419896 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3440083e0 con 0x55c97ef2f050 2024-09-10T05:11:46.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.515+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97ef2b080 con 0x55c97ef2f050 2024-09-10T05:11:46.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.515+0000 7fb3520cc640 1 -- 172.21.15.192:0/2951419896 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3440083e0 con 0x55c97ef2f050 2024-09-10T05:11:46.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.515+0000 7fb356214800 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c97f02eaf0 0x55c97f030ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.515+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f031580 con 0x55c97f02eaf0 2024-09-10T05:11:46.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.515+0000 7fb3518cb640 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c97f02eaf0 0x55c97f030ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.516+0000 7fb3518cb640 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c97f02eaf0 0x55c97f030ee0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.516+0000 7fb3518cb640 1 -- 172.21.15.192:0/2951419896 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb34c0769d0 con 0x55c97f02eaf0 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.516+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f02d960 con 0x55c97ef2f050 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.516+0000 7fb3520cc640 1 -- 172.21.15.192:0/2951419896 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3440083e0 con 0x55c97ef2f050 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.516+0000 7fb356214800 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c97f0329c0 0x55c97f034db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.516+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f035520 con 0x55c97f0329c0 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.517+0000 7fb3510ca640 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c97f0329c0 0x55c97f034db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.517+0000 7fb3510ca640 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c97f0329c0 0x55c97f034db0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.517+0000 7fb3510ca640 1 -- 172.21.15.192:0/2951419896 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb33c00f670 con 0x55c97f0329c0 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.517+0000 7fb356214800 1 Processor -- start 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.517+0000 7fb356214800 1 -- start start 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.518+0000 7fb356214800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f043120 0x55c97f043540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.518+0000 7fb356214800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c97ee22a00 con 0x55c97f043120 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.518+0000 7fb3518cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f043120 0x55c97f043540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.518+0000 7fb3518cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f043120 0x55c97f043540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59106/0 (socket says 172.21.15.192:59106) 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.518+0000 7fb3518cb640 1 -- 172.21.15.192:0/2540678226 learned_addr learned my addr 172.21.15.192:0/2540678226 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.518+0000 7fb3518cb640 1 -- 172.21.15.192:0/2540678226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97f043b80 con 0x55c97f043120 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.518+0000 7fb3518cb640 1 --2- 172.21.15.192:0/2540678226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f043120 0x55c97f043540 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb34c095860 tx=0x7fb34c06e390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.518+0000 7fb2377fe640 1 -- 172.21.15.192:0/2540678226 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb34c094360 con 0x55c97f043120 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.518+0000 7fb2377fe640 1 -- 172.21.15.192:0/2540678226 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb34c086070 con 0x55c97f043120 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.518+0000 7fb356214800 1 -- 172.21.15.192:0/2540678226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c97f0443b0 con 0x55c97f043120 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.518+0000 7fb2377fe640 1 -- 172.21.15.192:0/2540678226 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb34c06b8b0 con 0x55c97f043120 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.518+0000 7fb356214800 1 -- 172.21.15.192:0/2540678226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c97f044950 con 0x55c97f043120 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.519+0000 7fb2377fe640 1 -- 172.21.15.192:0/2540678226 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb34c088030 con 0x55c97f043120 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.519+0000 7fb2377fe640 1 --2- 172.21.15.192:0/2540678226 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb22c03c780 0x7fb22c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.519+0000 7fb2377fe640 1 -- 172.21.15.192:0/2540678226 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb34c08bc50 con 0x55c97f043120 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.519+0000 7fb3510ca640 1 --2- 172.21.15.192:0/2540678226 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb22c03c780 0x7fb22c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.520+0000 7fb356214800 1 Processor -- start 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.520+0000 7fb356214800 1 -- start start 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.520+0000 7fb3510ca640 1 --2- 172.21.15.192:0/2540678226 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb22c03c780 0x7fb22c03ec40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55c97f02cca0 tx=0x7fb33c006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.520+0000 7fb356214800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 0x55c97f04fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.520+0000 7fb356214800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c97f01bc60 con 0x55c97f04fa00 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.520+0000 7fb3518cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 0x55c97f04fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.520+0000 7fb3518cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 0x55c97f04fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59116/0 (socket says 172.21.15.192:59116) 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.520+0000 7fb3518cb640 1 -- 172.21.15.192:0/2756981344 learned_addr learned my addr 172.21.15.192:0/2756981344 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.520+0000 7fb3518cb640 1 -- 172.21.15.192:0/2756981344 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97f0503d0 con 0x55c97f04fa00 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.520+0000 7fb3518cb640 1 --2- 172.21.15.192:0/2756981344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 0x55c97f04fde0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb34c08dfd0 tx=0x7fb34c084f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ab282e5709d44f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.521+0000 7fb2357fa640 1 -- 172.21.15.192:0/2756981344 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb34c0a6070 con 0x55c97f04fa00 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.521+0000 7fb2357fa640 1 -- 172.21.15.192:0/2756981344 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb34c06ba50 con 0x55c97f04fa00 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.521+0000 7fb2357fa640 1 -- 172.21.15.192:0/2756981344 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb34c065720 con 0x55c97f04fa00 2024-09-10T05:11:46.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.521+0000 7fb356214800 1 -- 172.21.15.192:0/2756981344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 msgr2=0x55c97f04fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.521+0000 7fb356214800 1 --2- 172.21.15.192:0/2756981344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 0x55c97f04fde0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb34c08dfd0 tx=0x7fb34c084f90 comp rx=0 tx=0).stop 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.521+0000 7fb356214800 1 -- 172.21.15.192:0/2756981344 shutdown_connections 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.521+0000 7fb356214800 1 --2- 172.21.15.192:0/2756981344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 0x55c97f04fde0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.521+0000 7fb356214800 1 -- 172.21.15.192:0/2756981344 >> 172.21.15.192:0/2756981344 conn(0x55c97f04be00 msgr2=0x55c97f04a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.521+0000 7fb356214800 1 -- 172.21.15.192:0/2756981344 shutdown_connections 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.521+0000 7fb356214800 1 -- 172.21.15.192:0/2756981344 wait complete. 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.521+0000 7fb356214800 1 Processor -- start 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.521+0000 7fb356214800 1 -- start start 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.522+0000 7fb356214800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 0x55c97f056e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.522+0000 7fb356214800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c97f050860 con 0x55c97f04fa00 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.522+0000 7fb3518cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 0x55c97f056e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.522+0000 7fb3518cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 0x55c97f056e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59132/0 (socket says 172.21.15.192:59132) 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.522+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 learned_addr learned my addr 172.21.15.192:0/922512773 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.522+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97f057360 con 0x55c97f04fa00 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.522+0000 7fb3518cb640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 0x55c97f056e00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb34c04efd0 tx=0x7fb34c057f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.522+0000 7fb2237fe640 1 -- 172.21.15.192:0/922512773 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb34c065900 con 0x55c97f04fa00 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.522+0000 7fb2237fe640 1 -- 172.21.15.192:0/922512773 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb34c097dd0 con 0x55c97f04fa00 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.522+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c97f057360 con 0x55c97f04fa00 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.522+0000 7fb2237fe640 1 -- 172.21.15.192:0/922512773 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb34c097a30 con 0x55c97f04fa00 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.523+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c97f057360 con 0x55c97f04fa00 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.523+0000 7fb2237fe640 1 -- 172.21.15.192:0/922512773 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb34c0bc030 con 0x55c97f04fa00 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.523+0000 7fb2237fe640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb21c03c780 0x7fb21c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.524+0000 7fb2237fe640 1 -- 172.21.15.192:0/922512773 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb34c0ba070 con 0x55c97f04fa00 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.524+0000 7fb3510ca640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb21c03c780 0x7fb21c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.524+0000 7fb3510ca640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb21c03c780 0x7fb21c03ec40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00ffd0 tx=0x7fb33c023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.524+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.524+0000 7fb356214800 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c97f062350 0x55c97f064810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.524+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f064f60 con 0x55c97f062350 2024-09-10T05:11:46.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.524+0000 7fb3520cc640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c97f062350 0x55c97f064810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb3520cc640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c97f062350 0x55c97f064810 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3440083e0 con 0x55c97f062350 2024-09-10T05:11:46.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 20 realm 2024-09-10T05:11:46.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065370 con 0x55c97f062350 2024-09-10T05:11:46.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3440083e0 con 0x55c97f062350 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f062350 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3440083e0 con 0x55c97f062350 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065fe0 con 0x55c97f062350 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3440083e0 con 0x55c97f062350 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c97f0669a0 0x55c97f068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.525+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0693e0 con 0x55c97f0669a0 2024-09-10T05:11:46.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.526+0000 7fb3518cb640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c97f0669a0 0x55c97f068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.526+0000 7fb3518cb640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c97f0669a0 0x55c97f068d90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.526+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.526+0000 7fb356214800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.526+0000 7fb356214800 20 searching for the correct realm 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.526+0000 7fb356214800 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c97f06b370 0x55c97f06d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.526+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f06deb0 con 0x55c97f06b370 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.526+0000 7fb3510ca640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c97f06b370 0x55c97f06d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.527+0000 7fb3510ca640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c97f06b370 0x55c97f06d830 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.527+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.527+0000 7fb3510ca640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb33c02e910 0x7fb33c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.527+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f06deb0 con 0x7fb33c02e910 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.527+0000 7fb3520cc640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb33c02e910 0x7fb33c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.527+0000 7fb3520cc640 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb33c02e910 0x7fb33c03a3c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.528+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb3440083e0 con 0x7fb33c02e910 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.528+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f0669a0 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.528+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.528+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f062350 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.528+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3440083e0 con 0x55c97f062350 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.528+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f062350 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.528+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.528+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f0669a0 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.528+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.529+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f0669a0 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.529+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.529+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x7fb33c02e910 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.529+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb344026040 con 0x7fb33c02e910 2024-09-10T05:11:46.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.529+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f06b370 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.529+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.529+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f062350 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.529+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.529+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f0669a0 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.530+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.530+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f062350 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.530+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.530+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x7fb33c02e910 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.530+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb344026040 con 0x7fb33c02e910 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.530+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f06b370 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.530+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.530+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f06b370 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.531+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.531+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f0669a0 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.531+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.531+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f06b370 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.531+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.531+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f06b370 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.531+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.531+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f062350 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.532+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.532+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f062350 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.532+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.532+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f0669a0 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.532+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.532+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f06b370 2024-09-10T05:11:46.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.532+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.532+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x7fb33c02e910 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.532+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb344026040 con 0x7fb33c02e910 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.532+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f062350 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.533+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.533+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f0669a0 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.533+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.533+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f06b370 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.533+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.533+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f0669a0 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.533+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.533+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x7fb33c02e910 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.534+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb344026040 con 0x7fb33c02e910 2024-09-10T05:11:46.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.534+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f06b370 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.534+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.534+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f0669a0 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.534+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.534+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x55c97f062350 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.534+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.534+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c97f065c40 con 0x7fb33c02e910 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb344026040 con 0x7fb33c02e910 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:46.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f069780 con 0x55c97f062350 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f069780 con 0x55c97f062350 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f069780 con 0x7fb33c02e910 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb344026040 con 0x7fb33c02e910 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 zone default found 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 4 Realm: () 2024-09-10T05:11:46.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.535+0000 7fb356214800 20 zonegroup default 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f069c00 con 0x55c97f0669a0 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb356214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f06fd20 con 0x55c97f06b370 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb356214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0700c0 con 0x55c97f06b370 2024-09-10T05:11:46.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb356214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb356214800 20 started sync module instance, tier type = 2024-09-10T05:11:46.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb356214800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:46.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.536+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f06f1c0 con 0x7fb33c02e910 2024-09-10T05:11:46.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.537+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb344026040 con 0x7fb33c02e910 2024-09-10T05:11:46.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.537+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94323907950304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f06f1c0 con 0x7fb33c02e910 2024-09-10T05:11:46.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.538+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f070a80 con 0x55c97f062350 2024-09-10T05:11:46.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.539+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.539+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94323907954128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f070ee0 con 0x55c97f062350 2024-09-10T05:11:46.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.539+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0719e0 con 0x55c97f06b370 2024-09-10T05:11:46.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.540+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94323907954128] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.543+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94323907950304] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb344026040 con 0x7fb33c02e910 2024-09-10T05:11:46.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.543+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.543+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94323907947792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0709f0 con 0x55c97f06b370 2024-09-10T05:11:46.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.543+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f072280 con 0x7fb33c02e910 2024-09-10T05:11:46.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.546+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb344026040 con 0x7fb33c02e910 2024-09-10T05:11:46.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.546+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94323907960752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f072b20 con 0x7fb33c02e910 2024-09-10T05:11:46.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.546+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0735f0 con 0x55c97f062350 2024-09-10T05:11:46.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.546+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94323907947792] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.547+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.547+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94323907965152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0735b0 con 0x55c97f062350 2024-09-10T05:11:46.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.547+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f074030 con 0x55c97f0669a0 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.547+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94323907960752] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb344026040 con 0x7fb33c02e910 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.548+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94323907965152] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.549+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.549+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94323907957968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f072670 con 0x55c97f0669a0 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.549+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0748d0 con 0x55c97f0669a0 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.551+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.551+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94323907972208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f075540 con 0x55c97f0669a0 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.551+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f075f40 con 0x55c97f0669a0 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.554+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.554+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(55 notify.5 [watch watch cookie 94323907957968] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.554+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94323907975760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f073c00 con 0x55c97f0669a0 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.554+0000 7fb356214800 20 add_watcher() i=0 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.554+0000 7fb356214800 20 add_watcher() i=1 2024-09-10T05:11:46.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.554+0000 7fb356214800 20 add_watcher() i=2 2024-09-10T05:11:46.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.554+0000 7fb356214800 20 add_watcher() i=3 2024-09-10T05:11:46.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.554+0000 7fb356214800 20 add_watcher() i=4 2024-09-10T05:11:46.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.554+0000 7fb356214800 20 add_watcher() i=5 2024-09-10T05:11:46.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.557+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94323907975760] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.557+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(57 notify.6 [watch watch cookie 94323907972208] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.557+0000 7fb356214800 20 add_watcher() i=6 2024-09-10T05:11:46.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.557+0000 7fb356214800 20 add_watcher() i=7 2024-09-10T05:11:46.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.557+0000 7fb356214800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:46.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.557+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f076040 con 0x55c97f062350 2024-09-10T05:11:46.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.557+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.557+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94323907973264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f076040 con 0x55c97f062350 2024-09-10T05:11:46.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.559+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94323907973264] v35'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.559+0000 7fb2037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.560+0000 7fb356214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:46.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.560+0000 7fb356214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:46.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.560+0000 7fb356214800 5 note: GC not initialized 2024-09-10T05:11:46.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.560+0000 7fb2027fc640 20 reqs_thread_entry: start 2024-09-10T05:11:46.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.560+0000 7fb356214800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:46.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.560+0000 7fb356214800 20 Filter name: none 2024-09-10T05:11:46.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.560+0000 7fb173fff640 20 reqs_thread_entry: start 2024-09-10T05:11:46.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.560+0000 7fb356214800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:11:46.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.560+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.560+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0ac1f0 con 0x55c97f0669a0 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0aa890 con 0x55c97f062350 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 20 rados_obj.operate() r=0 bl.length=7 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-10T05:11:46.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:46.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0aac80 con 0x55c97f062350 2024-09-10T05:11:46.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:46.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:46.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:46.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:46.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-10T05:11:46.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.561+0000 7fb356214800 20 get_user_info_from_index found 0 xattrs 2024-09-10T05:11:46.566 INFO:teuthology.orchestra.run.smithi192.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-10T05:11:46.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.562+0000 7fb2037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.562+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94323907973264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f05ea10 con 0x55c97f062350 2024-09-10T05:11:46.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.563+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94323907973264] v35'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.563+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94323907950304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0aa050 con 0x7fb33c02e910 2024-09-10T05:11:46.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.564+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94323907950304] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb344026040 con 0x7fb33c02e910 2024-09-10T05:11:46.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.564+0000 7fb356214800 20 remove_watcher() i=0 2024-09-10T05:11:46.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.564+0000 7fb356214800 2 removed watcher, disabling cache 2024-09-10T05:11:46.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.564+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94323907954128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0aa050 con 0x55c97f062350 2024-09-10T05:11:46.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.566+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94323907954128] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.566+0000 7fb356214800 20 remove_watcher() i=1 2024-09-10T05:11:46.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.566+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94323907947792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0aa050 con 0x55c97f06b370 2024-09-10T05:11:46.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.567+0000 7fb3510ca640 1 -- 172.21.15.192:0/922512773 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94323907947792] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb33c037040 con 0x55c97f06b370 2024-09-10T05:11:46.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.567+0000 7fb356214800 20 remove_watcher() i=2 2024-09-10T05:11:46.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.567+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94323907960752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0705d0 con 0x7fb33c02e910 2024-09-10T05:11:46.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.568+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94323907960752] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb344026040 con 0x7fb33c02e910 2024-09-10T05:11:46.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.568+0000 7fb356214800 20 remove_watcher() i=3 2024-09-10T05:11:46.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.568+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94323907965152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f06ed10 con 0x55c97f062350 2024-09-10T05:11:46.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.569+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94323907965152] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb344026040 con 0x55c97f062350 2024-09-10T05:11:46.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.569+0000 7fb356214800 20 remove_watcher() i=4 2024-09-10T05:11:46.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.569+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94323907957968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f071fb0 con 0x55c97f0669a0 2024-09-10T05:11:46.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.570+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94323907957968] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.570+0000 7fb356214800 20 remove_watcher() i=5 2024-09-10T05:11:46.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.570+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94323907972208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0705d0 con 0x55c97f0669a0 2024-09-10T05:11:46.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.573+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94323907972208] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.573+0000 7fb356214800 20 remove_watcher() i=6 2024-09-10T05:11:46.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.573+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94323907975760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c97f0714d0 con 0x55c97f0669a0 2024-09-10T05:11:46.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb3518cb640 1 -- 172.21.15.192:0/922512773 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94323907975760] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34c0a8030 con 0x55c97f0669a0 2024-09-10T05:11:46.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 20 remove_watcher() i=7 2024-09-10T05:11:46.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c97f0669a0 msgr2=0x55c97f068d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c97f0669a0 0x55c97f068d90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c97f062350 msgr2=0x55c97f064810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c97f062350 0x55c97f064810 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb33c02e910 msgr2=0x7fb33c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb33c02e910 0x7fb33c03a3c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c97f06b370 msgr2=0x55c97f06d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c97f06b370 0x55c97f06d830 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb21c03c780 msgr2=0x7fb21c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb21c03c780 0x7fb21c03ec40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00ffd0 tx=0x7fb33c023040 comp rx=0 tx=0).stop 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 msgr2=0x55c97f056e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 --2- 172.21.15.192:0/922512773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f04fa00 0x55c97f056e00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb34c04efd0 tx=0x7fb34c057f80 comp rx=0 tx=0).stop 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 reap_dead start 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb3520cc640 1 -- 172.21.15.192:0/922512773 reap_dead start 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 shutdown_connections 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 >> 172.21.15.192:0/922512773 conn(0x55c97f04be00 msgr2=0x55c97f04a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 shutdown_connections 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/922512773 wait complete. 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/2540678226 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb22c03c780 msgr2=0x7fb22c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 --2- 172.21.15.192:0/2540678226 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb22c03c780 0x7fb22c03ec40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55c97f02cca0 tx=0x7fb33c006000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/2540678226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f043120 msgr2=0x55c97f043540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 --2- 172.21.15.192:0/2540678226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f043120 0x55c97f043540 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb34c095860 tx=0x7fb34c06e390 comp rx=0 tx=0).stop 2024-09-10T05:11:46.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/2540678226 shutdown_connections 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 --2- 172.21.15.192:0/2540678226 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb22c03c780 0x7fb22c03ec40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 --2- 172.21.15.192:0/2540678226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97f043120 0x55c97f043540 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/2540678226 >> 172.21.15.192:0/2540678226 conn(0x55c97f0374d0 msgr2=0x55c97f0378b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/2540678226 shutdown_connections 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.574+0000 7fb356214800 1 -- 172.21.15.192:0/2540678226 wait complete. 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c97f02eaf0 msgr2=0x55c97f030ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c97f02eaf0 0x55c97f030ee0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c97ef2f050 msgr2=0x55c97f02c2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c97ef2f050 0x55c97f02c2c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c97f0329c0 msgr2=0x55c97f034db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c97f0329c0 0x55c97f034db0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb23803c780 msgr2=0x7fb23803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb23803c780 0x7fb23803ec40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb33c000c00 tx=0x7fb33c0013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 msgr2=0x55c97ef2bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 --2- 172.21.15.192:0/2951419896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c97ef2c630 0x55c97ef2bd50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb34c025a60 tx=0x7fb34c003330 comp rx=0 tx=0).stop 2024-09-10T05:11:46.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb3520cc640 1 -- 172.21.15.192:0/2951419896 reap_dead start 2024-09-10T05:11:46.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 shutdown_connections 2024-09-10T05:11:46.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 >> 172.21.15.192:0/2951419896 conn(0x55c97ef26210 msgr2=0x55c97f01c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 shutdown_connections 2024-09-10T05:11:46.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.575+0000 7fb356214800 1 -- 172.21.15.192:0/2951419896 wait complete. 2024-09-10T05:11:46.584 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-10T05:11:46.585 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:11:46.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:11:46.585 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:11:46.629 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:46.629 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:46.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.629+0000 7f395e20e800 1 Processor -- start 2024-09-10T05:11:46.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.629+0000 7f395e20e800 1 -- start start 2024-09-10T05:11:46.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.629+0000 7f395e20e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55779aebf200 0x55779aec16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.629+0000 7f395e20e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55779ad64e40 con 0x55779aebb600 2024-09-10T05:11:46.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.629+0000 7f395e20e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55779ad2f680 con 0x55779aebf200 2024-09-10T05:11:46.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.629+0000 7f3953fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55779aebf200 0x55779aec16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.629+0000 7f395996b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55779aebb600 0x55779aebd9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36200/0 (socket says 172.21.15.192:36200) 2024-09-10T05:11:46.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.629+0000 7f395996b640 1 -- 172.21.15.192:0/283238234 learned_addr learned my addr 172.21.15.192:0/283238234 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:46.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.630+0000 7f3953fff640 1 -- 172.21.15.192:0/283238234 >> v1:172.21.15.139:6789/0 conn(0x55779aebb600 legacy=0x55779aebd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.630+0000 7f395916a640 1 -- 172.21.15.192:0/283238234 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2030486781 0 0) 0x55779ad64e40 con 0x55779aebb600 2024-09-10T05:11:46.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.630+0000 7f3953fff640 1 -- 172.21.15.192:0/283238234 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779ad4b6b0 con 0x55779aebf200 2024-09-10T05:11:46.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.631+0000 7f3953fff640 1 --2- 172.21.15.192:0/283238234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebf200 0x55779aec16c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f394400a470 tx=0x7f3944045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53ed312ea2e3189 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.632+0000 7f395916a640 1 -- 172.21.15.192:0/283238234 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3944053570 con 0x55779aebf200 2024-09-10T05:11:46.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.632+0000 7f395916a640 1 -- 172.21.15.192:0/283238234 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3944058070 con 0x55779aebf200 2024-09-10T05:11:46.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.632+0000 7f395916a640 1 -- 172.21.15.192:0/283238234 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3944053880 con 0x55779aebf200 2024-09-10T05:11:46.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.632+0000 7f395e20e800 1 -- 172.21.15.192:0/283238234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebf200 msgr2=0x55779aec16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.632+0000 7f395e20e800 1 --2- 172.21.15.192:0/283238234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebf200 0x55779aec16c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f394400a470 tx=0x7f3944045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:46.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.632+0000 7f395e20e800 1 -- 172.21.15.192:0/283238234 shutdown_connections 2024-09-10T05:11:46.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.632+0000 7f395e20e800 1 --2- 172.21.15.192:0/283238234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebf200 0x55779aec16c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.632+0000 7f395e20e800 1 -- 172.21.15.192:0/283238234 >> 172.21.15.192:0/283238234 conn(0x55779aeb51c0 msgr2=0x55779aeb7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.632+0000 7f395e20e800 1 -- 172.21.15.192:0/283238234 shutdown_connections 2024-09-10T05:11:46.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.632+0000 7f395e20e800 1 -- 172.21.15.192:0/283238234 wait complete. 2024-09-10T05:11:46.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.646+0000 7f395e20e800 1 Processor -- start 2024-09-10T05:11:46.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.646+0000 7f395e20e800 1 -- start start 2024-09-10T05:11:46.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.646+0000 7f395e20e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 0x55779afaa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.646+0000 7f395e20e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55779ad53dd0 con 0x55779aebb600 2024-09-10T05:11:46.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.646+0000 7f395996b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 0x55779afaa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.646+0000 7f395996b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 0x55779afaa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59152/0 (socket says 172.21.15.192:59152) 2024-09-10T05:11:46.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.646+0000 7f395996b640 1 -- 172.21.15.192:0/556357860 learned_addr learned my addr 172.21.15.192:0/556357860 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.646+0000 7f395996b640 1 -- 172.21.15.192:0/556357860 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779ad6ce10 con 0x55779aebb600 2024-09-10T05:11:46.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.647+0000 7f395996b640 1 --2- 172.21.15.192:0/556357860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 0x55779afaa4d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f394c001ea0 tx=0x7f394c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897956fc54987166 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.647+0000 7f3847e07640 1 -- 172.21.15.192:0/556357860 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394c008070 con 0x55779aebb600 2024-09-10T05:11:46.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.647+0000 7f3847e07640 1 -- 172.21.15.192:0/556357860 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394c00d500 con 0x55779aebb600 2024-09-10T05:11:46.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.647+0000 7f3847e07640 1 -- 172.21.15.192:0/556357860 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394c00d880 con 0x55779aebb600 2024-09-10T05:11:46.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.647+0000 7f395e20e800 1 -- 172.21.15.192:0/556357860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 msgr2=0x55779afaa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.647+0000 7f395e20e800 1 --2- 172.21.15.192:0/556357860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 0x55779afaa4d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f394c001ea0 tx=0x7f394c00b6a0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395e20e800 1 -- 172.21.15.192:0/556357860 shutdown_connections 2024-09-10T05:11:46.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395e20e800 1 --2- 172.21.15.192:0/556357860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 0x55779afaa4d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395e20e800 1 -- 172.21.15.192:0/556357860 >> 172.21.15.192:0/556357860 conn(0x55779aeb51c0 msgr2=0x55779afa5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395e20e800 1 -- 172.21.15.192:0/556357860 shutdown_connections 2024-09-10T05:11:46.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395e20e800 1 -- 172.21.15.192:0/556357860 wait complete. 2024-09-10T05:11:46.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395e20e800 1 Processor -- start 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395e20e800 1 -- start start 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395e20e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 0x55779afb1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395e20e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55779aec2040 con 0x55779aebb600 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395996b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 0x55779afb1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395996b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 0x55779afb1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59160/0 (socket says 172.21.15.192:59160) 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395996b640 1 -- 172.21.15.192:0/607764888 learned_addr learned my addr 172.21.15.192:0/607764888 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.648+0000 7f395996b640 1 -- 172.21.15.192:0/607764888 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779afb2340 con 0x55779aebb600 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.649+0000 7f395996b640 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 0x55779afb1de0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f394c0012f0 tx=0x7f394c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.649+0000 7f3846604640 1 -- 172.21.15.192:0/607764888 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394c00f9d0 con 0x55779aebb600 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.649+0000 7f3846604640 1 -- 172.21.15.192:0/607764888 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394c00fb70 con 0x55779aebb600 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.649+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55779afb25d0 con 0x55779aebb600 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.649+0000 7f3846604640 1 -- 172.21.15.192:0/607764888 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394c00fe50 con 0x55779aebb600 2024-09-10T05:11:46.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.649+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55779afb2fd0 con 0x55779aebb600 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.650+0000 7f3846604640 1 -- 172.21.15.192:0/607764888 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f394c017040 con 0x55779aebb600 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.650+0000 7f3846604640 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f384003c920 0x7f384003ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.650+0000 7f3846604640 1 -- 172.21.15.192:0/607764888 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f394c015020 con 0x55779aebb600 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.650+0000 7f3953fff640 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f384003c920 0x7f384003ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.650+0000 7f395e20e800 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55779aebf200 0x55779afb9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.650+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779afb9970 con 0x55779aebf200 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.650+0000 7f395a16c640 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55779aebf200 0x55779afb9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.650+0000 7f3953fff640 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f384003c920 0x7f384003ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3944057000 tx=0x7f3944052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.650+0000 7f395a16c640 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55779aebf200 0x55779afb9430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.651+0000 7f395a16c640 1 -- 172.21.15.192:0/607764888 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aebf200 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.651+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779afb9d10 con 0x55779aebf200 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.651+0000 7f395a16c640 1 -- 172.21.15.192:0/607764888 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aebf200 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.651+0000 7f395e20e800 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55779afbb810 0x55779afbdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.651+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779afbe420 con 0x55779afbb810 2024-09-10T05:11:46.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.651+0000 7f395996b640 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55779afbb810 0x55779afbdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.652+0000 7f395996b640 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55779afbb810 0x55779afbdc90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.652+0000 7f395996b640 1 -- 172.21.15.192:0/607764888 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f394c02d070 con 0x55779afbb810 2024-09-10T05:11:46.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.652+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779afba560 con 0x55779aebf200 2024-09-10T05:11:46.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.652+0000 7f395a16c640 1 -- 172.21.15.192:0/607764888 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aebf200 2024-09-10T05:11:46.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.652+0000 7f395e20e800 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55779afbf880 0x55779afc1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.652+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779afc23e0 con 0x55779afbf880 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.652+0000 7f3953fff640 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55779afbf880 0x55779afc1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.653+0000 7f3953fff640 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55779afbf880 0x55779afc1c70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.653+0000 7f3953fff640 1 -- 172.21.15.192:0/607764888 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3944051070 con 0x55779afbf880 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.653+0000 7f395e20e800 1 Processor -- start 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.653+0000 7f395e20e800 1 -- start start 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.654+0000 7f395e20e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afd0010 0x55779afd0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.654+0000 7f395e20e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55779adb1a00 con 0x55779afd0010 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.654+0000 7f395996b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afd0010 0x55779afd0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.654+0000 7f395996b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afd0010 0x55779afd0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59164/0 (socket says 172.21.15.192:59164) 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.654+0000 7f395996b640 1 -- 172.21.15.192:0/511190609 learned_addr learned my addr 172.21.15.192:0/511190609 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.654+0000 7f395996b640 1 -- 172.21.15.192:0/511190609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779afd0a70 con 0x55779afd0010 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.654+0000 7f395996b640 1 --2- 172.21.15.192:0/511190609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afd0010 0x55779afd0430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f394c00e660 tx=0x7f394c018e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.654+0000 7f383f7fe640 1 -- 172.21.15.192:0/511190609 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394c048020 con 0x55779afd0010 2024-09-10T05:11:46.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.654+0000 7f383f7fe640 1 -- 172.21.15.192:0/511190609 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394c04b310 con 0x55779afd0010 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.654+0000 7f395e20e800 1 -- 172.21.15.192:0/511190609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55779afd12a0 con 0x55779afd0010 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.654+0000 7f383f7fe640 1 -- 172.21.15.192:0/511190609 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394c01a4f0 con 0x55779afd0010 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.654+0000 7f395e20e800 1 -- 172.21.15.192:0/511190609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55779afd1840 con 0x55779afd0010 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.655+0000 7f383f7fe640 1 -- 172.21.15.192:0/511190609 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f394c04b020 con 0x55779afd0010 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.655+0000 7f383f7fe640 1 --2- 172.21.15.192:0/511190609 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f383403c6e0 0x7f383403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.655+0000 7f383f7fe640 1 -- 172.21.15.192:0/511190609 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f394c03c520 con 0x55779afd0010 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.655+0000 7f3953fff640 1 --2- 172.21.15.192:0/511190609 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f383403c6e0 0x7f383403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.655+0000 7f395e20e800 1 Processor -- start 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.656+0000 7f3953fff640 1 --2- 172.21.15.192:0/511190609 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f383403c6e0 0x7f383403eba0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3944000c00 tx=0x7f3944005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.656+0000 7f395e20e800 1 -- start start 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.656+0000 7f395e20e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 0x55779afdcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.656+0000 7f395e20e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55779afaad20 con 0x55779afdc830 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.656+0000 7f395996b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 0x55779afdcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.656+0000 7f395996b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 0x55779afdcc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59166/0 (socket says 172.21.15.192:59166) 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.656+0000 7f395996b640 1 -- 172.21.15.192:0/559348698 learned_addr learned my addr 172.21.15.192:0/559348698 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.656+0000 7f395996b640 1 -- 172.21.15.192:0/559348698 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779afdd220 con 0x55779afdc830 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.656+0000 7f395996b640 1 --2- 172.21.15.192:0/559348698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 0x55779afdcc30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f394c0145c0 tx=0x7f394c014520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd7c4091dafe990 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.656+0000 7f383d7fa640 1 -- 172.21.15.192:0/559348698 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394c035070 con 0x55779afdc830 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f383d7fa640 1 -- 172.21.15.192:0/559348698 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394c044910 con 0x55779afdc830 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f383d7fa640 1 -- 172.21.15.192:0/559348698 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394c019470 con 0x55779afdc830 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f395e20e800 1 -- 172.21.15.192:0/559348698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 msgr2=0x55779afdcc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f395e20e800 1 --2- 172.21.15.192:0/559348698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 0x55779afdcc30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f394c0145c0 tx=0x7f394c014520 comp rx=0 tx=0).stop 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f395e20e800 1 -- 172.21.15.192:0/559348698 shutdown_connections 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f395e20e800 1 --2- 172.21.15.192:0/559348698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 0x55779afdcc30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f395e20e800 1 -- 172.21.15.192:0/559348698 >> 172.21.15.192:0/559348698 conn(0x55779afd8c30 msgr2=0x55779afd6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f395e20e800 1 -- 172.21.15.192:0/559348698 shutdown_connections 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f395e20e800 1 -- 172.21.15.192:0/559348698 wait complete. 2024-09-10T05:11:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f395e20e800 1 Processor -- start 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f395e20e800 1 -- start start 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f395e20e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 0x55779aebad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.657+0000 7f395e20e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55779afdd690 con 0x55779afdc830 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.658+0000 7f395996b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 0x55779aebad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.658+0000 7f395996b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 0x55779aebad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59180/0 (socket says 172.21.15.192:59180) 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.658+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 learned_addr learned my addr 172.21.15.192:0/3469494159 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.658+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779aebb260 con 0x55779afdc830 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.658+0000 7f395996b640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 0x55779aebad00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f394c01cbf0 tx=0x7f394c03a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.658+0000 7f382b7fe640 1 -- 172.21.15.192:0/3469494159 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394c028e20 con 0x55779afdc830 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.658+0000 7f382b7fe640 1 -- 172.21.15.192:0/3469494159 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394c065070 con 0x55779afdc830 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.658+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55779aebb260 con 0x55779afdc830 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.658+0000 7f382b7fe640 1 -- 172.21.15.192:0/3469494159 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394c03c1a0 con 0x55779afdc830 2024-09-10T05:11:46.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.658+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55779aebb260 con 0x55779afdc830 2024-09-10T05:11:46.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.659+0000 7f382b7fe640 1 -- 172.21.15.192:0/3469494159 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f394c026430 con 0x55779afdc830 2024-09-10T05:11:46.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.659+0000 7f382b7fe640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f382403c780 0x7f382403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.659+0000 7f382b7fe640 1 -- 172.21.15.192:0/3469494159 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f394c06bcb0 con 0x55779afdc830 2024-09-10T05:11:46.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.659+0000 7f3953fff640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f382403c780 0x7f382403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.660+0000 7f395e20e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.660+0000 7f395e20e800 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55779aff13b0 0x55779aff3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.660+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779aff3fc0 con 0x55779aff13b0 2024-09-10T05:11:46.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.660+0000 7f3953fff640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f382403c780 0x7f382403ec40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55779afc27e0 tx=0x7f3944053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.660+0000 7f395a16c640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55779aff13b0 0x55779aff3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.660+0000 7f395a16c640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55779aff13b0 0x55779aff3870 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.660+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.660+0000 7f395e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.660+0000 7f395e20e800 20 realm 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.660+0000 7f395e20e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.660+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779aff43d0 con 0x55779aff13b0 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395e20e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395e20e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779aff4ca0 con 0x55779aff13b0 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395e20e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff13b0 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395e20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395e20e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395e20e800 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55779aff5b30 0x55779aff7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779aff8660 con 0x55779aff5b30 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.661+0000 7f395996b640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55779aff5b30 0x55779aff7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.662+0000 7f395996b640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55779aff5b30 0x55779aff7f20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.662+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.662+0000 7f395e20e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.662+0000 7f395e20e800 20 searching for the correct realm 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.662+0000 7f395e20e800 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55779affa700 0x55779affcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.662+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779affd290 con 0x55779affa700 2024-09-10T05:11:46.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.662+0000 7f3953fff640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55779affa700 0x55779affcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.663+0000 7f3953fff640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55779affa700 0x55779affcbc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.663+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.663+0000 7f3953fff640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f394405f040 0x7f394406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.663+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779affd290 con 0x7f394405f040 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.663+0000 7f395a16c640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f394405f040 0x7f394406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.663+0000 7f395a16c640 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f394405f040 0x7f394406b410 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.663+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.663+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff5b30 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.664+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.664+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff13b0 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.664+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.664+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff13b0 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.664+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.664+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff5b30 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.664+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.665+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff5b30 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.665+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.665+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x7f394405f040 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.665+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.665+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779affa700 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.665+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.665+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff13b0 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.665+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.665+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff5b30 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.666+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.666+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff13b0 2024-09-10T05:11:46.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.666+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.666+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x7f394405f040 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.666+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.666+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779affa700 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.666+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.666+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779affa700 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.666+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.666+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff5b30 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.667+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.667+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779affa700 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.667+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.667+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779affa700 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.667+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.667+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff13b0 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.667+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.667+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff13b0 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.668+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.668+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff5b30 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.668+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.668+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779affa700 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.668+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.668+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x7f394405f040 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.668+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.668+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff13b0 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.668+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.669+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff5b30 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.669+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.669+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779affa700 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.669+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.669+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff5b30 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.669+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.669+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x7f394405f040 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.670+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.670+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779affa700 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.670+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.670+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff5b30 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.670+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.670+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x55779aff13b0 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.670+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.670+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55779aff5040 con 0x7f394405f040 2024-09-10T05:11:46.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779aff9000 con 0x55779aff13b0 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779aff9000 con 0x55779aff13b0 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779aff8fd0 con 0x7f394405f040 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 zone default found 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 4 Realm: () 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 zonegroup default 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.671+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779aff93f0 con 0x55779aff5b30 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f395e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f395e20e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779aff8de0 con 0x55779affa700 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f395e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f395e20e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779afff100 con 0x55779affa700 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f395e20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f395e20e800 20 started sync module instance, tier type = 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f395e20e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.672+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779affe5a0 con 0x7f394405f040 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.673+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.673+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93972189932240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779affe5a0 con 0x7f394405f040 2024-09-10T05:11:46.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.673+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779afffba0 con 0x55779aff13b0 2024-09-10T05:11:46.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.675+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.675+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93972189935248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779afffb60 con 0x55779aff13b0 2024-09-10T05:11:46.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.675+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b000b80 con 0x55779affa700 2024-09-10T05:11:46.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.676+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93972189935248] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.676+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93972189932240] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.676+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.676+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93972189929712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779affff90 con 0x55779affa700 2024-09-10T05:11:46.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.676+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b001420 con 0x7f394405f040 2024-09-10T05:11:46.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.677+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.677+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93972189929712] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.677+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93972189942096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b001cc0 con 0x7f394405f040 2024-09-10T05:11:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.677+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b0006b0 con 0x55779aff13b0 2024-09-10T05:11:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.678+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.678+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93972189946368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b0006b0 con 0x55779aff13b0 2024-09-10T05:11:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.678+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b003150 con 0x55779aff5b30 2024-09-10T05:11:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.679+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93972189942096] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.679+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93972189946368] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.679+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.679+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93972189947424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b001810 con 0x55779aff5b30 2024-09-10T05:11:46.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.679+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b0039f0 con 0x55779aff5b30 2024-09-10T05:11:46.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.680+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.680+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93972189953424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b004660 con 0x55779aff5b30 2024-09-10T05:11:46.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.680+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93972189947424] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.680+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b002c40 con 0x55779aff5b30 2024-09-10T05:11:46.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.681+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93972189953424] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.681+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.681+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93972189954480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b0045d0 con 0x55779aff5b30 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.681+0000 7f395e20e800 20 add_watcher() i=0 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.681+0000 7f395e20e800 20 add_watcher() i=1 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.681+0000 7f395e20e800 20 add_watcher() i=2 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.681+0000 7f395e20e800 20 add_watcher() i=3 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.681+0000 7f395e20e800 20 add_watcher() i=4 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.681+0000 7f395e20e800 20 add_watcher() i=5 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.681+0000 7f395e20e800 20 add_watcher() i=6 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.682+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93972189954480] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.682+0000 7f395e20e800 20 add_watcher() i=7 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.682+0000 7f395e20e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.682+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779b008050 con 0x55779aff13b0 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.683+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.683+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93972189956976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b005550 con 0x55779aff13b0 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.683+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93972189956976] v35'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.683+0000 7f380bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.684+0000 7f395e20e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.684+0000 7f395e20e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.684+0000 7f395e20e800 5 note: GC not initialized 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.684+0000 7f380affd640 20 reqs_thread_entry: start 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.684+0000 7f395e20e800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.684+0000 7f395e20e800 20 Filter name: none 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.684+0000 7f3808ff9640 20 reqs_thread_entry: start 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.684+0000 7f395e20e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.684+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55779b03ac00 con 0x55779aff13b0 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.684+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.684+0000 7f395e20e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:46.696 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:46.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.685+0000 7f380bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.685+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93972189956976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b039ab0 con 0x55779aff13b0 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.686+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93972189956976] v35'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.686+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93972189932240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b004b70 con 0x7f394405f040 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.687+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93972189932240] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.687+0000 7f395e20e800 20 remove_watcher() i=0 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.687+0000 7f395e20e800 2 removed watcher, disabling cache 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.687+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93972189935248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b004b70 con 0x55779aff13b0 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.688+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93972189935248] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.688+0000 7f395e20e800 20 remove_watcher() i=1 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.688+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93972189929712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b004b70 con 0x55779affa700 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.689+0000 7f3953fff640 1 -- 172.21.15.192:0/3469494159 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93972189929712] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f394407c040 con 0x55779affa700 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.689+0000 7f395e20e800 20 remove_watcher() i=2 2024-09-10T05:11:46.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.689+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93972189942096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779affe0f0 con 0x7f394405f040 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.690+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93972189942096] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x7f394405f040 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.690+0000 7f395e20e800 20 remove_watcher() i=3 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.690+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93972189946368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b004b70 con 0x55779aff13b0 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.691+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93972189946368] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395400a4d0 con 0x55779aff13b0 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.691+0000 7f395e20e800 20 remove_watcher() i=4 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.691+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93972189947424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b001150 con 0x55779aff5b30 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.692+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93972189947424] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.692+0000 7f395e20e800 20 remove_watcher() i=5 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.692+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93972189953424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779affe0f0 con 0x55779aff5b30 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.694+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93972189953424] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.694+0000 7f395e20e800 20 remove_watcher() i=6 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.694+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93972189954480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55779b004b70 con 0x55779aff5b30 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395996b640 1 -- 172.21.15.192:0/3469494159 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93972189954480] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f394c037070 con 0x55779aff5b30 2024-09-10T05:11:46.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 20 remove_watcher() i=7 2024-09-10T05:11:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55779aff5b30 msgr2=0x55779aff7f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55779aff5b30 0x55779aff7f20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55779aff13b0 msgr2=0x55779aff3870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55779aff13b0 0x55779aff3870 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f394405f040 msgr2=0x7f394406b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f394405f040 0x7f394406b410 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55779affa700 msgr2=0x55779affcbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55779affa700 0x55779affcbc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f382403c780 msgr2=0x7f382403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f382403c780 0x7f382403ec40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55779afc27e0 tx=0x7f3944053000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 msgr2=0x55779aebad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 0x55779aebad00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f394c01cbf0 tx=0x7f394c03a8a0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395a16c640 1 -- 172.21.15.192:0/3469494159 reap_dead start 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 shutdown_connections 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 --2- 172.21.15.192:0/3469494159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afdc830 0x55779aebad00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 >> 172.21.15.192:0/3469494159 conn(0x55779afd8c30 msgr2=0x55779afd6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 shutdown_connections 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/3469494159 wait complete. 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/511190609 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f383403c6e0 msgr2=0x7f383403eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 --2- 172.21.15.192:0/511190609 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f383403c6e0 0x7f383403eba0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3944000c00 tx=0x7f3944005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/511190609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afd0010 msgr2=0x55779afd0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 --2- 172.21.15.192:0/511190609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afd0010 0x55779afd0430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f394c00e660 tx=0x7f394c018e20 comp rx=0 tx=0).stop 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/511190609 shutdown_connections 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 --2- 172.21.15.192:0/511190609 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f383403c6e0 0x7f383403eba0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 --2- 172.21.15.192:0/511190609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779afd0010 0x55779afd0430 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/511190609 >> 172.21.15.192:0/511190609 conn(0x55779afc4370 msgr2=0x55779afc4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/511190609 shutdown_connections 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.695+0000 7f395e20e800 1 -- 172.21.15.192:0/511190609 wait complete. 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55779afbb810 msgr2=0x55779afbdc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55779afbb810 0x55779afbdc90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55779aebf200 msgr2=0x55779afb9430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55779aebf200 0x55779afb9430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55779afbf880 msgr2=0x55779afc1c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55779afbf880 0x55779afc1c70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f384003c920 msgr2=0x7f384003ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f384003c920 0x7f384003ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3944057000 tx=0x7f3944052000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 msgr2=0x55779afb1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 --2- 172.21.15.192:0/607764888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55779aebb600 0x55779afb1de0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f394c0012f0 tx=0x7f394c000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395a16c640 1 -- 172.21.15.192:0/607764888 reap_dead start 2024-09-10T05:11:46.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 shutdown_connections 2024-09-10T05:11:46.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 >> 172.21.15.192:0/607764888 conn(0x55779aeb51c0 msgr2=0x55779afab7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 shutdown_connections 2024-09-10T05:11:46.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.696+0000 7f395e20e800 1 -- 172.21.15.192:0/607764888 wait complete. 2024-09-10T05:11:46.707 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:46.707 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-10T05:11:46.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-10T05:11:46.707 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-10T05:11:46.751 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:46.751 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:46.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.751+0000 7fa96e698800 1 Processor -- start 2024-09-10T05:11:46.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.751+0000 7fa96e698800 1 -- start start 2024-09-10T05:11:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.751+0000 7fa96e698800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x559da7a99df0 0x559da7a9aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.751+0000 7fa96e698800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559da7944e40 con 0x559da7a9b030 2024-09-10T05:11:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.751+0000 7fa96e698800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x559da790f680 con 0x559da7a99df0 2024-09-10T05:11:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.751+0000 7fa96c182640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x559da7a99df0 0x559da7a9aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.751+0000 7fa96b981640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x559da7a9b030 0x559da7a9fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36206/0 (socket says 172.21.15.192:36206) 2024-09-10T05:11:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.751+0000 7fa96b981640 1 -- 172.21.15.192:0/1875595415 learned_addr learned my addr 172.21.15.192:0/1875595415 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.752+0000 7fa96c182640 1 -- 172.21.15.192:0/1875595415 >> v1:172.21.15.139:6789/0 conn(0x559da7a9b030 legacy=0x559da7a9fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.752+0000 7fa96b180640 1 -- 172.21.15.192:0/1875595415 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 25088437 0 0) 0x559da7944e40 con 0x559da7a9b030 2024-09-10T05:11:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.752+0000 7fa96c182640 1 -- 172.21.15.192:0/1875595415 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da792b6b0 con 0x559da7a99df0 2024-09-10T05:11:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.753+0000 7fa96c182640 1 --2- 172.21.15.192:0/1875595415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7a9aaf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00a470 tx=0x7fa95c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0548e7a3d5c5f53 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.754+0000 7fa96b180640 1 -- 172.21.15.192:0/1875595415 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c053570 con 0x559da7a99df0 2024-09-10T05:11:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.754+0000 7fa96b180640 1 -- 172.21.15.192:0/1875595415 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c058070 con 0x559da7a99df0 2024-09-10T05:11:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.754+0000 7fa96b180640 1 -- 172.21.15.192:0/1875595415 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c053880 con 0x559da7a99df0 2024-09-10T05:11:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.754+0000 7fa96e698800 1 -- 172.21.15.192:0/1875595415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 msgr2=0x559da7a9aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.754+0000 7fa96e698800 1 --2- 172.21.15.192:0/1875595415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7a9aaf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00a470 tx=0x7fa95c045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.754+0000 7fa96e698800 1 -- 172.21.15.192:0/1875595415 shutdown_connections 2024-09-10T05:11:46.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.754+0000 7fa96e698800 1 --2- 172.21.15.192:0/1875595415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7a9aaf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.754+0000 7fa96e698800 1 -- 172.21.15.192:0/1875595415 >> 172.21.15.192:0/1875595415 conn(0x559da7a951c0 msgr2=0x559da7a97620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.754+0000 7fa96e698800 1 -- 172.21.15.192:0/1875595415 shutdown_connections 2024-09-10T05:11:46.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.754+0000 7fa96e698800 1 -- 172.21.15.192:0/1875595415 wait complete. 2024-09-10T05:11:46.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.768+0000 7fa96e698800 1 Processor -- start 2024-09-10T05:11:46.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.768+0000 7fa96e698800 1 -- start start 2024-09-10T05:11:46.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.768+0000 7fa96e698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7a0dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.768+0000 7fa96e698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559da7933dd0 con 0x559da7a99df0 2024-09-10T05:11:46.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.769+0000 7fa96c182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7a0dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.769+0000 7fa96c182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7a0dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59210/0 (socket says 172.21.15.192:59210) 2024-09-10T05:11:46.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.769+0000 7fa96c182640 1 -- 172.21.15.192:0/2749052974 learned_addr learned my addr 172.21.15.192:0/2749052974 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.769+0000 7fa96c182640 1 -- 172.21.15.192:0/2749052974 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da794ce10 con 0x559da7a99df0 2024-09-10T05:11:46.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.769+0000 7fa96c182640 1 --2- 172.21.15.192:0/2749052974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7a0dd10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa95c025c20 tx=0x7fa95c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5223c5360fed90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.769+0000 7fa85a60c640 1 -- 172.21.15.192:0/2749052974 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c053a20 con 0x559da7a99df0 2024-09-10T05:11:46.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.769+0000 7fa85a60c640 1 -- 172.21.15.192:0/2749052974 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c063070 con 0x559da7a99df0 2024-09-10T05:11:46.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.769+0000 7fa85a60c640 1 -- 172.21.15.192:0/2749052974 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c053d30 con 0x559da7a99df0 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.770+0000 7fa96e698800 1 -- 172.21.15.192:0/2749052974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 msgr2=0x559da7a0dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.770+0000 7fa96e698800 1 --2- 172.21.15.192:0/2749052974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7a0dd10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa95c025c20 tx=0x7fa95c051000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.770+0000 7fa96e698800 1 -- 172.21.15.192:0/2749052974 shutdown_connections 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.770+0000 7fa96e698800 1 --2- 172.21.15.192:0/2749052974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7a0dd10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.770+0000 7fa96e698800 1 -- 172.21.15.192:0/2749052974 >> 172.21.15.192:0/2749052974 conn(0x559da7a951c0 msgr2=0x559da7b84d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.770+0000 7fa96e698800 1 -- 172.21.15.192:0/2749052974 shutdown_connections 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.770+0000 7fa96e698800 1 -- 172.21.15.192:0/2749052974 wait complete. 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.770+0000 7fa96e698800 1 Processor -- start 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.770+0000 7fa96e698800 1 -- start start 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.770+0000 7fa96e698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7b93fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.770+0000 7fa96e698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559da7a9b720 con 0x559da7a99df0 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.771+0000 7fa96c182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7b93fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.771+0000 7fa96c182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7b93fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59214/0 (socket says 172.21.15.192:59214) 2024-09-10T05:11:46.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.771+0000 7fa96c182640 1 -- 172.21.15.192:0/2091623003 learned_addr learned my addr 172.21.15.192:0/2091623003 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.771+0000 7fa96c182640 1 -- 172.21.15.192:0/2091623003 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da7b94500 con 0x559da7a99df0 2024-09-10T05:11:46.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.771+0000 7fa96c182640 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7b93fa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa95c025c20 tx=0x7fa95c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.771+0000 7fa858e09640 1 -- 172.21.15.192:0/2091623003 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c078070 con 0x559da7a99df0 2024-09-10T05:11:46.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.771+0000 7fa858e09640 1 -- 172.21.15.192:0/2091623003 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c073470 con 0x559da7a99df0 2024-09-10T05:11:46.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.771+0000 7fa858e09640 1 -- 172.21.15.192:0/2091623003 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c073750 con 0x559da7a99df0 2024-09-10T05:11:46.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.771+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559da7b94790 con 0x559da7a99df0 2024-09-10T05:11:46.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.771+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559da7b953a0 con 0x559da7a99df0 2024-09-10T05:11:46.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.772+0000 7fa858e09640 1 -- 172.21.15.192:0/2091623003 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa95c07b070 con 0x559da7a99df0 2024-09-10T05:11:46.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.772+0000 7fa858e09640 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa85403c780 0x7fa85403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.772+0000 7fa858e09640 1 -- 172.21.15.192:0/2091623003 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa95c097ac0 con 0x559da7a99df0 2024-09-10T05:11:46.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.772+0000 7fa96b981640 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa85403c780 0x7fa85403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.773+0000 7fa96e698800 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559da7a9b030 0x559da7b9b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.773+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7b95d60 con 0x559da7a9b030 2024-09-10T05:11:46.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.773+0000 7fa96c983640 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559da7a9b030 0x559da7b9b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.773+0000 7fa96b981640 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa85403c780 0x7fa85403ec40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa960000c00 tx=0x7fa9600013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.773+0000 7fa96c983640 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559da7a9b030 0x559da7b9b5f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.773+0000 7fa96c983640 1 -- 172.21.15.192:0/2091623003 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7a9b030 2024-09-10T05:11:46.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.773+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7b95710 con 0x559da7a9b030 2024-09-10T05:11:46.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.774+0000 7fa96c983640 1 -- 172.21.15.192:0/2091623003 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7a9b030 2024-09-10T05:11:46.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.774+0000 7fa96e698800 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559da7b9da60 0x559da7b9fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.774+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7ba0520 con 0x559da7b9da60 2024-09-10T05:11:46.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.774+0000 7fa96c182640 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559da7b9da60 0x559da7b9fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.774+0000 7fa96c182640 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559da7b9da60 0x559da7b9fe50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.775+0000 7fa96c182640 1 -- 172.21.15.192:0/2091623003 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7b9da60 2024-09-10T05:11:46.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.775+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7b9c900 con 0x559da7a9b030 2024-09-10T05:11:46.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.775+0000 7fa96c983640 1 -- 172.21.15.192:0/2091623003 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7a9b030 2024-09-10T05:11:46.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.775+0000 7fa96e698800 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x559da7ba1960 0x559da7ba3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.775+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7ba4490 con 0x559da7ba1960 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.775+0000 7fa96b981640 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x559da7ba1960 0x559da7ba3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.775+0000 7fa96b981640 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x559da7ba1960 0x559da7ba3d50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.775+0000 7fa96b981640 1 -- 172.21.15.192:0/2091623003 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa96000f670 con 0x559da7ba1960 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.776+0000 7fa96e698800 1 Processor -- start 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.776+0000 7fa96e698800 1 -- start start 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.776+0000 7fa96e698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bb20f0 0x559da7bb2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.776+0000 7fa96e698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559da7991a00 con 0x559da7bb20f0 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.776+0000 7fa96c182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bb20f0 0x559da7bb2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.776+0000 7fa96c182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bb20f0 0x559da7bb2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59224/0 (socket says 172.21.15.192:59224) 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.776+0000 7fa96c182640 1 -- 172.21.15.192:0/1199854991 learned_addr learned my addr 172.21.15.192:0/1199854991 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.777+0000 7fa96c182640 1 -- 172.21.15.192:0/1199854991 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da7bb2b50 con 0x559da7bb20f0 2024-09-10T05:11:46.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.777+0000 7fa96c182640 1 --2- 172.21.15.192:0/1199854991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bb20f0 0x559da7bb2510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa95c095f30 tx=0x7fa95c07cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.777+0000 7fa8527fc640 1 -- 172.21.15.192:0/1199854991 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c068470 con 0x559da7bb20f0 2024-09-10T05:11:46.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.777+0000 7fa8527fc640 1 -- 172.21.15.192:0/1199854991 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c068610 con 0x559da7bb20f0 2024-09-10T05:11:46.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.777+0000 7fa8527fc640 1 -- 172.21.15.192:0/1199854991 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c068910 con 0x559da7bb20f0 2024-09-10T05:11:46.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.777+0000 7fa96e698800 1 -- 172.21.15.192:0/1199854991 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559da7bb3380 con 0x559da7bb20f0 2024-09-10T05:11:46.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.777+0000 7fa96e698800 1 -- 172.21.15.192:0/1199854991 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559da7bb3920 con 0x559da7bb20f0 2024-09-10T05:11:46.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.778+0000 7fa8527fc640 1 -- 172.21.15.192:0/1199854991 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa95c0738f0 con 0x559da7bb20f0 2024-09-10T05:11:46.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.778+0000 7fa8527fc640 1 --2- 172.21.15.192:0/1199854991 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa84403c780 0x7fa84403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.778+0000 7fa8527fc640 1 -- 172.21.15.192:0/1199854991 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa95c08f070 con 0x559da7bb20f0 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.778+0000 7fa96b981640 1 --2- 172.21.15.192:0/1199854991 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa84403c780 0x7fa84403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.778+0000 7fa96e698800 1 Processor -- start 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.778+0000 7fa96e698800 1 -- start start 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.778+0000 7fa96b981640 1 --2- 172.21.15.192:0/1199854991 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa84403c780 0x7fa84403ec40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x559da7b9bc00 tx=0x7fa960006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.778+0000 7fa96e698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 0x559da7bbed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.778+0000 7fa96e698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559da7b8f450 con 0x559da7bbe970 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.779+0000 7fa96c182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 0x559da7bbed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.779+0000 7fa96c182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 0x559da7bbed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59240/0 (socket says 172.21.15.192:59240) 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.779+0000 7fa96c182640 1 -- 172.21.15.192:0/3281874190 learned_addr learned my addr 172.21.15.192:0/3281874190 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.779+0000 7fa96c182640 1 -- 172.21.15.192:0/3281874190 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da7bbf340 con 0x559da7bbe970 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.779+0000 7fa96c182640 1 --2- 172.21.15.192:0/3281874190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 0x559da7bbed50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa95c068ab0 tx=0x7fa95c052ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0dfb0e1784c73d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.779+0000 7fa84b7fe640 1 -- 172.21.15.192:0/3281874190 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c061d70 con 0x559da7bbe970 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.779+0000 7fa84b7fe640 1 -- 172.21.15.192:0/3281874190 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c0523a0 con 0x559da7bbe970 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.779+0000 7fa84b7fe640 1 -- 172.21.15.192:0/3281874190 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c05c870 con 0x559da7bbe970 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96e698800 1 -- 172.21.15.192:0/3281874190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 msgr2=0x559da7bbed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96e698800 1 --2- 172.21.15.192:0/3281874190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 0x559da7bbed50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa95c068ab0 tx=0x7fa95c052ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96e698800 1 -- 172.21.15.192:0/3281874190 shutdown_connections 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96e698800 1 --2- 172.21.15.192:0/3281874190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 0x559da7bbed50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96e698800 1 -- 172.21.15.192:0/3281874190 >> 172.21.15.192:0/3281874190 conn(0x559da7bbad70 msgr2=0x559da7bb8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96e698800 1 -- 172.21.15.192:0/3281874190 shutdown_connections 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96e698800 1 -- 172.21.15.192:0/3281874190 wait complete. 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96e698800 1 Processor -- start 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96e698800 1 -- start start 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96e698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 0x559da7bc5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96e698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559da7bbf7d0 con 0x559da7bbe970 2024-09-10T05:11:46.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96c182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 0x559da7bc5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96c182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 0x559da7bc5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59250/0 (socket says 172.21.15.192:59250) 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.780+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 learned_addr learned my addr 172.21.15.192:0/488129593 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.781+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da7bc6310 con 0x559da7bbe970 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.781+0000 7fa96c182640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 0x559da7bc5db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa95c068ab0 tx=0x7fa95c091f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.781+0000 7fa849ffb640 1 -- 172.21.15.192:0/488129593 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c092800 con 0x559da7bbe970 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.781+0000 7fa849ffb640 1 -- 172.21.15.192:0/488129593 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c0929a0 con 0x559da7bbe970 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.781+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559da7bc6310 con 0x559da7bbe970 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.781+0000 7fa849ffb640 1 -- 172.21.15.192:0/488129593 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95c092c80 con 0x559da7bbe970 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.781+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559da7bc6310 con 0x559da7bbe970 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.782+0000 7fa849ffb640 1 -- 172.21.15.192:0/488129593 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa95c0bd030 con 0x559da7bbe970 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.782+0000 7fa849ffb640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa83403c780 0x7fa83403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.782+0000 7fa849ffb640 1 -- 172.21.15.192:0/488129593 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa95c0bb070 con 0x559da7bbe970 2024-09-10T05:11:46.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.782+0000 7fa96b981640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa83403c780 0x7fa83403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.783+0000 7fa96b981640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa83403c780 0x7fa83403ec40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa96000ffd0 tx=0x7fa960023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.783+0000 7fa96e698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.783+0000 7fa96e698800 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559da7bd12f0 0x559da7bd37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.783+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd3f00 con 0x559da7bd12f0 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.783+0000 7fa96c983640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559da7bd12f0 0x559da7bd37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.783+0000 7fa96c983640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559da7bd12f0 0x559da7bd37b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 20 realm 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4310 con 0x559da7bd12f0 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:46.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4be0 con 0x559da7bd12f0 2024-09-10T05:11:46.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd12f0 2024-09-10T05:11:46.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559da7bd5ce0 0x559da7bd80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.784+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd8690 con 0x559da7bd5ce0 2024-09-10T05:11:46.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.785+0000 7fa96c182640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559da7bd5ce0 0x559da7bd80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.785+0000 7fa96c182640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559da7bd5ce0 0x559da7bd80d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.785+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.785+0000 7fa96e698800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:46.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.785+0000 7fa96e698800 20 searching for the correct realm 2024-09-10T05:11:46.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.785+0000 7fa96e698800 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x559da7bda640 0x559da7bdcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.785+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bdd1d0 con 0x559da7bda640 2024-09-10T05:11:46.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.785+0000 7fa96b981640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x559da7bda640 0x559da7bdcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.786+0000 7fa96b981640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x559da7bda640 0x559da7bdcb00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.786+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.786+0000 7fa96b981640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa96002e910 0x7fa96003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.786+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bdd1d0 con 0x7fa96002e910 2024-09-10T05:11:46.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.786+0000 7fa96c983640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa96002e910 0x7fa96003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.786+0000 7fa96c983640 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa96002e910 0x7fa96003a3c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.787+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.787+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd5ce0 2024-09-10T05:11:46.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.787+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.787+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd12f0 2024-09-10T05:11:46.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.787+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.787+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd12f0 2024-09-10T05:11:46.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.787+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.787+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd5ce0 2024-09-10T05:11:46.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.788+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.788+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd5ce0 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.788+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.788+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x7fa96002e910 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.788+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.788+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bda640 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.788+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.788+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd12f0 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.789+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.789+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd5ce0 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.789+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.789+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd12f0 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.789+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.789+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x7fa96002e910 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.789+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.789+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bda640 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.789+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.789+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bda640 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.790+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.790+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd5ce0 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.790+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.790+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bda640 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.790+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.790+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bda640 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.790+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.790+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd12f0 2024-09-10T05:11:46.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.791+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.791+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd12f0 2024-09-10T05:11:46.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.791+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.791+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd5ce0 2024-09-10T05:11:46.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.791+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.791+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bda640 2024-09-10T05:11:46.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.791+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.791+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x7fa96002e910 2024-09-10T05:11:46.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.791+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.791+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd12f0 2024-09-10T05:11:46.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.792+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.792+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd5ce0 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.792+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.792+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bda640 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.792+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.792+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd5ce0 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.793+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.793+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x7fa96002e910 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.793+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.793+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bda640 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.793+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.793+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd5ce0 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.793+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.793+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x559da7bd12f0 2024-09-10T05:11:46.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd4f80 con 0x7fa96002e910 2024-09-10T05:11:46.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:46.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:46.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:46.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:46.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:46.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:46.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd8f50 con 0x559da7bd12f0 2024-09-10T05:11:46.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd8f50 con 0x559da7bd12f0 2024-09-10T05:11:46.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.794+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd8f50 con 0x7fa96002e910 2024-09-10T05:11:46.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:46.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 20 zone default found 2024-09-10T05:11:46.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 4 Realm: () 2024-09-10T05:11:46.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:46.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:46.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:46.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 20 zonegroup default 2024-09-10T05:11:46.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7bd8f30 con 0x559da7bd5ce0 2024-09-10T05:11:46.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7bdf040 con 0x559da7bda640 2024-09-10T05:11:46.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7bdf3e0 con 0x559da7bda640 2024-09-10T05:11:46.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 20 started sync module instance, tier type = 2024-09-10T05:11:46.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:46.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.795+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7bde4e0 con 0x7fa96002e910 2024-09-10T05:11:46.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.796+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.796+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94135612467712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7bde4e0 con 0x7fa96002e910 2024-09-10T05:11:46.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.797+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7bdfda0 con 0x559da7bd12f0 2024-09-10T05:11:46.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.797+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.797+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94135612467712] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.797+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94135612471536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be0200 con 0x559da7bd12f0 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.798+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7bde030 con 0x559da7bda640 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.798+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94135612471536] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.799+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.799+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94135612472592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be0ca0 con 0x559da7bda640 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.799+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be1660 con 0x7fa96002e910 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.799+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94135612472592] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.800+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.800+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94135612477872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be1a80 con 0x7fa96002e910 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.800+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be2440 con 0x559da7bd12f0 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.801+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94135612477872] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.801+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.801+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94135612479408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be2440 con 0x559da7bd12f0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.801+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be2e00 con 0x559da7bd5ce0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.802+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.802+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94135612483920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be3220 con 0x559da7bd5ce0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.802+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be3ce0 con 0x559da7bd5ce0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.802+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94135612479408] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.804+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.804+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94135612487600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be3ca0 con 0x559da7bd5ce0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.804+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be4740 con 0x559da7bd5ce0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.805+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94135612483920] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94135612487600] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94135612481424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be2d70 con 0x559da7bd5ce0 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96e698800 20 add_watcher() i=0 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96e698800 20 add_watcher() i=1 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96e698800 20 add_watcher() i=2 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96e698800 20 add_watcher() i=3 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96e698800 20 add_watcher() i=4 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96e698800 20 add_watcher() i=5 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96e698800 20 add_watcher() i=6 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94135612481424] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96e698800 20 add_watcher() i=7 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.806+0000 7fa96e698800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.807+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7be7730 con 0x559da7bd12f0 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.807+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.807+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94135612490256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be4bb0 con 0x559da7bd12f0 2024-09-10T05:11:46.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.808+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94135612490256] v35'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.808+0000 7fa8227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.808+0000 7fa96e698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.808+0000 7fa96e698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.808+0000 7fa96e698800 5 note: GC not initialized 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.808+0000 7fa8217e2640 20 reqs_thread_entry: start 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.808+0000 7fa96e698800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.808+0000 7fa96e698800 20 Filter name: none 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.808+0000 7fa792ffd640 20 reqs_thread_entry: start 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.808+0000 7fa96e698800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.808+0000 7fa96e698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.808+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7c1a6a0 con 0x559da7bd12f0 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.809+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.809+0000 7fa96e698800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.809+0000 7fa96e698800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.809+0000 7fa96e698800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.809+0000 7fa96e698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.809+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7c1cfd0 con 0x7fa96002e910 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.809+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.809+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7c20700 con 0x559da7bd12f0 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.810+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v35'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.810+0000 7fa96e698800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.810+0000 7fa96e698800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.810+0000 7fa96e698800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.810+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94135612735712 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559da7c1bfc0 con 0x559da7bd12f0 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.810+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 94135612479408 notify 150323855361 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fa964026410 con 0x559da7bd12f0 2024-09-10T05:11:46.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.810+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(65 notify.4 [notify cookie 94135612735712 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.810+0000 7fa84affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855361 cookie 94135612479408 notifier 4322 bl.length()=567 2024-09-10T05:11:46.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.810+0000 7fa84affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:46.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.810+0000 7fa84affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:46.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.810+0000 7fa84affd640 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa7a0003430 con 0x559da7bd12f0 2024-09-10T05:11:46.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.811+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.811+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== watch-notify(notify_complete (2) cookie 94135612735712 notify 150323855361 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa9640265e0 con 0x559da7bd12f0 2024-09-10T05:11:46.824 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:46.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.812+0000 7fa8227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.812+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94135612490256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7c18500 con 0x559da7bd12f0 2024-09-10T05:11:46.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.813+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94135612490256] v35'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.813+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94135612467712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7c18500 con 0x7fa96002e910 2024-09-10T05:11:46.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.814+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94135612467712] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.814+0000 7fa96e698800 20 remove_watcher() i=0 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.814+0000 7fa96e698800 2 removed watcher, disabling cache 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.814+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94135612471536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7c18500 con 0x559da7bd12f0 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.815+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94135612471536] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.815+0000 7fa96e698800 20 remove_watcher() i=1 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.815+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94135612472592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7c18500 con 0x559da7bda640 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.816+0000 7fa96b981640 1 -- 172.21.15.192:0/488129593 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94135612472592] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa960037040 con 0x559da7bda640 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.816+0000 7fa96e698800 20 remove_watcher() i=2 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.816+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94135612477872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be4210 con 0x7fa96002e910 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.817+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94135612477872] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x7fa96002e910 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.817+0000 7fa96e698800 20 remove_watcher() i=3 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.817+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94135612479408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be4210 con 0x559da7bd12f0 2024-09-10T05:11:46.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.818+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94135612479408] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96400a4d0 con 0x559da7bd12f0 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.818+0000 7fa96e698800 20 remove_watcher() i=4 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.818+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94135612483920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be17b0 con 0x559da7bd5ce0 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.819+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94135612483920] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.819+0000 7fa96e698800 20 remove_watcher() i=5 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.819+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94135612487600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be4210 con 0x559da7bd5ce0 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.820+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94135612487600] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.820+0000 7fa96e698800 20 remove_watcher() i=6 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.820+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94135612481424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559da7be2950 con 0x559da7bd5ce0 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.820+0000 7fa96c182640 1 -- 172.21.15.192:0/488129593 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94135612481424] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95c07a030 con 0x559da7bd5ce0 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.820+0000 7fa96e698800 20 remove_watcher() i=7 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559da7bd5ce0 msgr2=0x559da7bd80d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559da7bd5ce0 0x559da7bd80d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559da7bd12f0 msgr2=0x559da7bd37b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559da7bd12f0 0x559da7bd37b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa96002e910 msgr2=0x7fa96003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa96002e910 0x7fa96003a3c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x559da7bda640 msgr2=0x559da7bdcb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x559da7bda640 0x559da7bdcb00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa83403c780 msgr2=0x7fa83403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa83403c780 0x7fa83403ec40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa96000ffd0 tx=0x7fa960023040 comp rx=0 tx=0).stop 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 msgr2=0x559da7bc5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96c983640 1 -- 172.21.15.192:0/488129593 reap_dead start 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 0x559da7bc5db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa95c068ab0 tx=0x7fa95c091f40 comp rx=0 tx=0).stop 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 shutdown_connections 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 --2- 172.21.15.192:0/488129593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bbe970 0x559da7bc5db0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 >> 172.21.15.192:0/488129593 conn(0x559da7bbad70 msgr2=0x559da7bb8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 shutdown_connections 2024-09-10T05:11:46.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/488129593 wait complete. 2024-09-10T05:11:46.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/1199854991 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa84403c780 msgr2=0x7fa84403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 --2- 172.21.15.192:0/1199854991 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa84403c780 0x7fa84403ec40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x559da7b9bc00 tx=0x7fa960006000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/1199854991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bb20f0 msgr2=0x559da7bb2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 --2- 172.21.15.192:0/1199854991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bb20f0 0x559da7bb2510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa95c095f30 tx=0x7fa95c07cdf0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/1199854991 shutdown_connections 2024-09-10T05:11:46.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 --2- 172.21.15.192:0/1199854991 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa84403c780 0x7fa84403ec40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 --2- 172.21.15.192:0/1199854991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7bb20f0 0x559da7bb2510 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/1199854991 >> 172.21.15.192:0/1199854991 conn(0x559da7ba64a0 msgr2=0x559da7ba6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/1199854991 shutdown_connections 2024-09-10T05:11:46.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.821+0000 7fa96e698800 1 -- 172.21.15.192:0/1199854991 wait complete. 2024-09-10T05:11:46.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559da7b9da60 msgr2=0x559da7b9fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x559da7b9da60 0x559da7b9fe50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559da7a9b030 msgr2=0x559da7b9b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x559da7a9b030 0x559da7b9b5f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x559da7ba1960 msgr2=0x559da7ba3d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x559da7ba1960 0x559da7ba3d50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa85403c780 msgr2=0x7fa85403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa85403c780 0x7fa85403ec40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa960000c00 tx=0x7fa9600013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 msgr2=0x559da7b93fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 --2- 172.21.15.192:0/2091623003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559da7a99df0 0x559da7b93fa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa95c025c20 tx=0x7fa95c002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96c983640 1 -- 172.21.15.192:0/2091623003 reap_dead start 2024-09-10T05:11:46.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 shutdown_connections 2024-09-10T05:11:46.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 >> 172.21.15.192:0/2091623003 conn(0x559da7a951c0 msgr2=0x559da7b83500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 shutdown_connections 2024-09-10T05:11:46.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.822+0000 7fa96e698800 1 -- 172.21.15.192:0/2091623003 wait complete. 2024-09-10T05:11:46.839 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:46.840 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:11:46.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:11:46.840 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:11:46.884 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:46.884 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:46.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.884+0000 7f1d134bb800 1 Processor -- start 2024-09-10T05:11:46.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.884+0000 7f1d134bb800 1 -- start start 2024-09-10T05:11:46.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.884+0000 7f1d134bb800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x561969f15490 0x561969f15890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.884+0000 7f1d134bb800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561969dc0e40 con 0x561969f15dd0 2024-09-10T05:11:46.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.884+0000 7f1d134bb800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x561969d8b680 con 0x561969f15490 2024-09-10T05:11:46.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.885+0000 7f1d10fa5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x561969f15490 0x561969f15890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.885+0000 7f1d10fa5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x561969f15490 0x561969f15890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59254/0 (socket says 172.21.15.192:59254) 2024-09-10T05:11:46.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.885+0000 7f1d0bfff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x561969f15dd0 0x561969f16280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36220/0 (socket says 172.21.15.192:36220) 2024-09-10T05:11:46.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.885+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1633874801 learned_addr learned my addr 172.21.15.192:0/1633874801 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.885+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1633874801 >> v1:172.21.15.139:6789/0 conn(0x561969f15dd0 legacy=0x561969f16280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.885+0000 7f1d0b7fe640 1 -- 172.21.15.192:0/1633874801 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2311467246 0 0) 0x561969dc0e40 con 0x561969f15dd0 2024-09-10T05:11:46.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.885+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1633874801 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561969da76b0 con 0x561969f15490 2024-09-10T05:11:46.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.887+0000 7f1d10fa5640 1 --2- 172.21.15.192:0/1633874801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x561969f15890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400a520 tx=0x7f1d04045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e2d3caf1f5d592 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.887+0000 7f1d0b7fe640 1 -- 172.21.15.192:0/1633874801 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04055070 con 0x561969f15490 2024-09-10T05:11:46.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.887+0000 7f1d0b7fe640 1 -- 172.21.15.192:0/1633874801 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d040515b0 con 0x561969f15490 2024-09-10T05:11:46.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.887+0000 7f1d0b7fe640 1 -- 172.21.15.192:0/1633874801 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d040518d0 con 0x561969f15490 2024-09-10T05:11:46.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.887+0000 7f1d134bb800 1 -- 172.21.15.192:0/1633874801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 msgr2=0x561969f15890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.887+0000 7f1d134bb800 1 --2- 172.21.15.192:0/1633874801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x561969f15890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400a520 tx=0x7f1d04045ba0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.887+0000 7f1d134bb800 1 -- 172.21.15.192:0/1633874801 shutdown_connections 2024-09-10T05:11:46.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.887+0000 7f1d134bb800 1 --2- 172.21.15.192:0/1633874801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x561969f15890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.887+0000 7f1d134bb800 1 -- 172.21.15.192:0/1633874801 >> 172.21.15.192:0/1633874801 conn(0x561969f111c0 msgr2=0x561969f13620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.887+0000 7f1d134bb800 1 -- 172.21.15.192:0/1633874801 shutdown_connections 2024-09-10T05:11:46.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.887+0000 7f1d134bb800 1 -- 172.21.15.192:0/1633874801 wait complete. 2024-09-10T05:11:46.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.901+0000 7f1d134bb800 1 Processor -- start 2024-09-10T05:11:46.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.901+0000 7f1d134bb800 1 -- start start 2024-09-10T05:11:46.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.901+0000 7f1d134bb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x56196a0086c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.901+0000 7f1d134bb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561969dafdd0 con 0x561969f15490 2024-09-10T05:11:46.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.902+0000 7f1d10fa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x56196a0086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.902+0000 7f1d10fa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x56196a0086c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59258/0 (socket says 172.21.15.192:59258) 2024-09-10T05:11:46.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.902+0000 7f1d10fa5640 1 -- 172.21.15.192:0/312862884 learned_addr learned my addr 172.21.15.192:0/312862884 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.902+0000 7f1d10fa5640 1 -- 172.21.15.192:0/312862884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561969dc8e10 con 0x561969f15490 2024-09-10T05:11:46.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.902+0000 7f1d10fa5640 1 --2- 172.21.15.192:0/312862884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x56196a0086c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1d04025da0 tx=0x7f1d04051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285dda5d31df6296 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.902+0000 7f1bfee05640 1 -- 172.21.15.192:0/312862884 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04051950 con 0x561969f15490 2024-09-10T05:11:46.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.902+0000 7f1bfee05640 1 -- 172.21.15.192:0/312862884 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04051af0 con 0x561969f15490 2024-09-10T05:11:46.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.902+0000 7f1bfee05640 1 -- 172.21.15.192:0/312862884 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04051dd0 con 0x561969f15490 2024-09-10T05:11:46.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.903+0000 7f1d134bb800 1 -- 172.21.15.192:0/312862884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 msgr2=0x56196a0086c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.903+0000 7f1d134bb800 1 --2- 172.21.15.192:0/312862884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x56196a0086c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1d04025da0 tx=0x7f1d04051000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.903+0000 7f1d134bb800 1 -- 172.21.15.192:0/312862884 shutdown_connections 2024-09-10T05:11:46.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.903+0000 7f1d134bb800 1 --2- 172.21.15.192:0/312862884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x56196a0086c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.903+0000 7f1d134bb800 1 -- 172.21.15.192:0/312862884 >> 172.21.15.192:0/312862884 conn(0x561969f111c0 msgr2=0x56196a004040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.903+0000 7f1d134bb800 1 -- 172.21.15.192:0/312862884 shutdown_connections 2024-09-10T05:11:46.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.903+0000 7f1d134bb800 1 -- 172.21.15.192:0/312862884 wait complete. 2024-09-10T05:11:46.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.903+0000 7f1d134bb800 1 Processor -- start 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.904+0000 7f1d134bb800 1 -- start start 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.904+0000 7f1d134bb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x56196a00fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.904+0000 7f1d134bb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561969f16d50 con 0x561969f15490 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.904+0000 7f1d10fa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x56196a00fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.904+0000 7f1d10fa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x56196a00fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59272/0 (socket says 172.21.15.192:59272) 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.904+0000 7f1d10fa5640 1 -- 172.21.15.192:0/3675706212 learned_addr learned my addr 172.21.15.192:0/3675706212 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.904+0000 7f1d10fa5640 1 -- 172.21.15.192:0/3675706212 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56196a0103d0 con 0x561969f15490 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.904+0000 7f1d10fa5640 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x56196a00fe70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1d04025da0 tx=0x7f1d04002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.904+0000 7f1bfd602640 1 -- 172.21.15.192:0/3675706212 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0405a600 con 0x561969f15490 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.904+0000 7f1bfd602640 1 -- 172.21.15.192:0/3675706212 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04073070 con 0x561969f15490 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.904+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56196a010660 con 0x561969f15490 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.904+0000 7f1bfd602640 1 -- 172.21.15.192:0/3675706212 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0405a910 con 0x561969f15490 2024-09-10T05:11:46.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.905+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56196a011270 con 0x561969f15490 2024-09-10T05:11:46.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.905+0000 7f1bfd602640 1 -- 172.21.15.192:0/3675706212 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1d04058070 con 0x561969f15490 2024-09-10T05:11:46.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.905+0000 7f1bfd602640 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1bf803c730 0x7f1bf803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.906+0000 7f1bfd602640 1 -- 172.21.15.192:0/3675706212 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1d0406b040 con 0x561969f15490 2024-09-10T05:11:46.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.906+0000 7f1d0bfff640 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1bf803c730 0x7f1bf803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.906+0000 7f1d134bb800 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561969f15dd0 0x56196a0174c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.906+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a017a00 con 0x561969f15dd0 2024-09-10T05:11:46.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.906+0000 7f1d117a6640 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561969f15dd0 0x56196a0174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.906+0000 7f1d0bfff640 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1bf803c730 0x7f1bf803ebf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc000c00 tx=0x7f1cfc0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.906+0000 7f1d117a6640 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561969f15dd0 0x56196a0174c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.906+0000 7f1d117a6640 1 -- 172.21.15.192:0/3675706212 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x561969f15dd0 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.906+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a017da0 con 0x561969f15dd0 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.907+0000 7f1d117a6640 1 -- 172.21.15.192:0/3675706212 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x561969f15dd0 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.907+0000 7f1d134bb800 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56196a0198a0 0x56196a01bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.907+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a01c4d0 con 0x56196a0198a0 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.907+0000 7f1d10fa5640 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56196a0198a0 0x56196a01bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.907+0000 7f1d10fa5640 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56196a0198a0 0x56196a01bd40 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.908+0000 7f1d10fa5640 1 -- 172.21.15.192:0/3675706212 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d04057030 con 0x56196a0198a0 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.908+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a0185f0 con 0x561969f15dd0 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.908+0000 7f1d117a6640 1 -- 172.21.15.192:0/3675706212 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x561969f15dd0 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.908+0000 7f1d134bb800 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56196a01d930 0x56196a01fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.908+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a020490 con 0x56196a01d930 2024-09-10T05:11:46.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.908+0000 7f1d0bfff640 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56196a01d930 0x56196a01fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.908+0000 7f1d0bfff640 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56196a01d930 0x56196a01fd20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.909+0000 7f1d0bfff640 1 -- 172.21.15.192:0/3675706212 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1cfc00f670 con 0x56196a01d930 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.909+0000 7f1d134bb800 1 Processor -- start 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.909+0000 7f1d134bb800 1 -- start start 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.909+0000 7f1d134bb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a02e0c0 0x56196a02e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.909+0000 7f1d134bb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561969e0da00 con 0x56196a02e0c0 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.909+0000 7f1d10fa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a02e0c0 0x56196a02e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.909+0000 7f1d10fa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a02e0c0 0x56196a02e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59286/0 (socket says 172.21.15.192:59286) 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.909+0000 7f1d10fa5640 1 -- 172.21.15.192:0/694298342 learned_addr learned my addr 172.21.15.192:0/694298342 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.910+0000 7f1d10fa5640 1 -- 172.21.15.192:0/694298342 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56196a02eb20 con 0x56196a02e0c0 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.910+0000 7f1d10fa5640 1 --2- 172.21.15.192:0/694298342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a02e0c0 0x56196a02e4e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1d04095c50 tx=0x7f1d0405af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.910+0000 7f1bf67fc640 1 -- 172.21.15.192:0/694298342 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d040946c0 con 0x56196a02e0c0 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.910+0000 7f1bf67fc640 1 -- 172.21.15.192:0/694298342 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d040979c0 con 0x56196a02e0c0 2024-09-10T05:11:46.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.910+0000 7f1d134bb800 1 -- 172.21.15.192:0/694298342 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56196a02f350 con 0x56196a02e0c0 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.910+0000 7f1bf67fc640 1 -- 172.21.15.192:0/694298342 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04094860 con 0x56196a02e0c0 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.910+0000 7f1d134bb800 1 -- 172.21.15.192:0/694298342 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56196a02f8f0 con 0x56196a02e0c0 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.911+0000 7f1bf67fc640 1 -- 172.21.15.192:0/694298342 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1d0404f070 con 0x56196a02e0c0 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.911+0000 7f1bf67fc640 1 --2- 172.21.15.192:0/694298342 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1be803c780 0x7f1be803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.911+0000 7f1bf67fc640 1 -- 172.21.15.192:0/694298342 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1d04089070 con 0x56196a02e0c0 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.911+0000 7f1d0bfff640 1 --2- 172.21.15.192:0/694298342 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1be803c780 0x7f1be803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.911+0000 7f1d134bb800 1 Processor -- start 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.911+0000 7f1d134bb800 1 -- start start 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.911+0000 7f1d0bfff640 1 --2- 172.21.15.192:0/694298342 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1be803c780 0x7f1be803ec40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56196a020890 tx=0x7f1cfc006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.911+0000 7f1d134bb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 0x56196a03acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.911+0000 7f1d134bb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56196a008e50 con 0x56196a03a8e0 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.911+0000 7f1d10fa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 0x56196a03acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.912+0000 7f1d10fa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 0x56196a03acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59290/0 (socket says 172.21.15.192:59290) 2024-09-10T05:11:46.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.912+0000 7f1d10fa5640 1 -- 172.21.15.192:0/3925412982 learned_addr learned my addr 172.21.15.192:0/3925412982 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.912+0000 7f1d10fa5640 1 -- 172.21.15.192:0/3925412982 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56196a03b2b0 con 0x56196a03a8e0 2024-09-10T05:11:46.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.912+0000 7f1d10fa5640 1 --2- 172.21.15.192:0/3925412982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 0x56196a03acc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1d0407c000 tx=0x7f1d0406eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b6745484462c08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.912+0000 7f1be7fff640 1 -- 172.21.15.192:0/3925412982 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0406ee60 con 0x56196a03a8e0 2024-09-10T05:11:46.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.912+0000 7f1be7fff640 1 -- 172.21.15.192:0/3925412982 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04002c90 con 0x56196a03a8e0 2024-09-10T05:11:46.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.912+0000 7f1be7fff640 1 -- 172.21.15.192:0/3925412982 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0406ec80 con 0x56196a03a8e0 2024-09-10T05:11:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.912+0000 7f1d134bb800 1 -- 172.21.15.192:0/3925412982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 msgr2=0x56196a03acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.912+0000 7f1d134bb800 1 --2- 172.21.15.192:0/3925412982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 0x56196a03acc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1d0407c000 tx=0x7f1d0406eb40 comp rx=0 tx=0).stop 2024-09-10T05:11:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.912+0000 7f1d134bb800 1 -- 172.21.15.192:0/3925412982 shutdown_connections 2024-09-10T05:11:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.912+0000 7f1d134bb800 1 --2- 172.21.15.192:0/3925412982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 0x56196a03acc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.912+0000 7f1d134bb800 1 -- 172.21.15.192:0/3925412982 >> 172.21.15.192:0/3925412982 conn(0x56196a036ce0 msgr2=0x56196a034f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.913+0000 7f1d134bb800 1 -- 172.21.15.192:0/3925412982 shutdown_connections 2024-09-10T05:11:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.913+0000 7f1d134bb800 1 -- 172.21.15.192:0/3925412982 wait complete. 2024-09-10T05:11:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.913+0000 7f1d134bb800 1 Processor -- start 2024-09-10T05:11:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.913+0000 7f1d134bb800 1 -- start start 2024-09-10T05:11:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.913+0000 7f1d134bb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 0x56196a041d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.913+0000 7f1d134bb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56196a03b740 con 0x56196a03a8e0 2024-09-10T05:11:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.913+0000 7f1d10fa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 0x56196a041d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.913+0000 7f1d10fa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 0x56196a041d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59296/0 (socket says 172.21.15.192:59296) 2024-09-10T05:11:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.913+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 learned_addr learned my addr 172.21.15.192:0/1148147152 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.913+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56196a042270 con 0x56196a03a8e0 2024-09-10T05:11:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.914+0000 7f1d10fa5640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 0x56196a041d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1d04077fb0 tx=0x7f1d0407eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.914+0000 7f1be67fc640 1 -- 172.21.15.192:0/1148147152 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d040ba020 con 0x56196a03a8e0 2024-09-10T05:11:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.914+0000 7f1be67fc640 1 -- 172.21.15.192:0/1148147152 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04081940 con 0x56196a03a8e0 2024-09-10T05:11:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.914+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56196a042270 con 0x56196a03a8e0 2024-09-10T05:11:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.914+0000 7f1be67fc640 1 -- 172.21.15.192:0/1148147152 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d0406ec80 con 0x56196a03a8e0 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.914+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56196a042270 con 0x56196a03a8e0 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.915+0000 7f1be67fc640 1 -- 172.21.15.192:0/1148147152 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1d04081c60 con 0x56196a03a8e0 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.915+0000 7f1be67fc640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1bdc03c780 0x7f1bdc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.915+0000 7f1be67fc640 1 -- 172.21.15.192:0/1148147152 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1d040a7030 con 0x56196a03a8e0 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.915+0000 7f1d0bfff640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1bdc03c780 0x7f1bdc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.915+0000 7f1d134bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.915+0000 7f1d134bb800 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56196a04d280 0x56196a04f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.915+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a04fe90 con 0x56196a04d280 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.915+0000 7f1d117a6640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56196a04d280 0x56196a04f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.915+0000 7f1d0bfff640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1bdc03c780 0x7f1bdc03ec40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00ffd0 tx=0x7f1cfc023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d117a6640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56196a04d280 0x56196a04f740 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d134bb800 20 realm 2024-09-10T05:11:46.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d134bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a0502a0 con 0x56196a04d280 2024-09-10T05:11:46.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d134bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:46.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d134bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a050b70 con 0x56196a04d280 2024-09-10T05:11:46.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d134bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.916+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a04d280 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.917+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.917+0000 7f1d134bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.917+0000 7f1d134bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.917+0000 7f1d134bb800 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56196a051a00 0x56196a053df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.917+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a054530 con 0x56196a051a00 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.917+0000 7f1d10fa5640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56196a051a00 0x56196a053df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.917+0000 7f1d10fa5640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56196a051a00 0x56196a053df0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.917+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.917+0000 7f1d134bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.917+0000 7f1d134bb800 20 searching for the correct realm 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.917+0000 7f1d134bb800 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56196a0565d0 0x56196a058a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.917+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a059160 con 0x56196a0565d0 2024-09-10T05:11:46.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.918+0000 7f1d0bfff640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56196a0565d0 0x56196a058a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.918+0000 7f1d0bfff640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56196a0565d0 0x56196a058a90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.918+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.918+0000 7f1d0bfff640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1cfc02e910 0x7f1cfc03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.918+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a059160 con 0x7f1cfc02e910 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.918+0000 7f1d117a6640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1cfc02e910 0x7f1cfc03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.918+0000 7f1d117a6640 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1cfc02e910 0x7f1cfc03a3c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.919+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.919+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a051a00 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.919+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.919+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a04d280 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.919+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.919+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a04d280 2024-09-10T05:11:46.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.919+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.919+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a051a00 2024-09-10T05:11:46.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.920+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.920+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a051a00 2024-09-10T05:11:46.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.920+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.920+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x7f1cfc02e910 2024-09-10T05:11:46.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.920+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.920+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a0565d0 2024-09-10T05:11:46.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.920+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.920+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a04d280 2024-09-10T05:11:46.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.921+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.921+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a051a00 2024-09-10T05:11:46.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.921+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.921+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a04d280 2024-09-10T05:11:46.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.921+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.921+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x7f1cfc02e910 2024-09-10T05:11:46.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.921+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.921+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a0565d0 2024-09-10T05:11:46.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.921+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.921+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a0565d0 2024-09-10T05:11:46.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.922+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.922+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a051a00 2024-09-10T05:11:46.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.922+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.922+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a0565d0 2024-09-10T05:11:46.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.922+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.922+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a0565d0 2024-09-10T05:11:46.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.922+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.922+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a04d280 2024-09-10T05:11:46.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.922+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.922+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a04d280 2024-09-10T05:11:46.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.923+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.923+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a051a00 2024-09-10T05:11:46.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.923+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.923+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a0565d0 2024-09-10T05:11:46.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.923+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.923+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x7f1cfc02e910 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.923+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.923+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a04d280 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.924+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.924+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a051a00 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.924+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.924+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a0565d0 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.924+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.924+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a051a00 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.924+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.924+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x7f1cfc02e910 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.925+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.925+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a0565d0 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.925+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.925+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a051a00 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.925+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.925+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x56196a04d280 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56196a050f10 con 0x7f1cfc02e910 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:46.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a054ed0 con 0x56196a04d280 2024-09-10T05:11:46.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a054ed0 con 0x56196a04d280 2024-09-10T05:11:46.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:46.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.926+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a054ed0 con 0x7f1cfc02e910 2024-09-10T05:11:46.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:46.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 20 zone default found 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 4 Realm: () 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 20 zonegroup default 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a0552c0 con 0x56196a051a00 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a054c50 con 0x56196a0565d0 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a05afd0 con 0x56196a0565d0 2024-09-10T05:11:46.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:46.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 20 started sync module instance, tier type = 2024-09-10T05:11:46.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:46.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.927+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05a470 con 0x7f1cfc02e910 2024-09-10T05:11:46.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.929+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.929+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94667152927088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05a470 con 0x7f1cfc02e910 2024-09-10T05:11:46.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.929+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05ba30 con 0x56196a04d280 2024-09-10T05:11:46.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.929+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94667152927088] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.930+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.930+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94667152930064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05a470 con 0x56196a04d280 2024-09-10T05:11:46.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.930+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05c4a0 con 0x56196a0565d0 2024-09-10T05:11:46.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.931+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94667152930064] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.931+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.931+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94667152924608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05a3e0 con 0x56196a0565d0 2024-09-10T05:11:46.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.931+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05d360 con 0x7f1cfc02e910 2024-09-10T05:11:46.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.932+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.932+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94667152937136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05dc00 con 0x7f1cfc02e910 2024-09-10T05:11:46.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.932+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05e680 con 0x56196a04d280 2024-09-10T05:11:46.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.932+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94667152924608] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.933+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94667152937136] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.933+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.933+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94667152941456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05d650 con 0x56196a04d280 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.933+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05ef50 con 0x56196a051a00 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.934+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.934+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94667152943776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05d650 con 0x56196a051a00 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.934+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05fe20 con 0x56196a051a00 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.934+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94667152941456] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.935+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.935+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94667152935056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a060670 con 0x56196a051a00 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.935+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a061030 con 0x56196a051a00 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.935+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94667152943776] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.936+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94667152935056] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.936+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.936+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94667152949696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a0605e0 con 0x56196a051a00 2024-09-10T05:11:46.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.936+0000 7f1d134bb800 20 add_watcher() i=0 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.936+0000 7f1d134bb800 20 add_watcher() i=1 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.936+0000 7f1d134bb800 20 add_watcher() i=2 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.936+0000 7f1d134bb800 20 add_watcher() i=3 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.936+0000 7f1d134bb800 20 add_watcher() i=4 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.936+0000 7f1d134bb800 20 add_watcher() i=5 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.936+0000 7f1d134bb800 20 add_watcher() i=6 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.937+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94667152949696] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.937+0000 7f1d134bb800 20 add_watcher() i=7 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.937+0000 7f1d134bb800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.937+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a064060 con 0x56196a04d280 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.937+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.938+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94667152952192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a061450 con 0x56196a04d280 2024-09-10T05:11:46.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.939+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94667152952192] v35'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.939+0000 7f1bc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.939+0000 7f1d134bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:46.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.939+0000 7f1d134bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:46.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.939+0000 7f1d134bb800 5 note: GC not initialized 2024-09-10T05:11:46.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.939+0000 7f1bc67e4640 20 reqs_thread_entry: start 2024-09-10T05:11:46.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.939+0000 7f1d134bb800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:46.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.939+0000 7f1d134bb800 20 Filter name: none 2024-09-10T05:11:46.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.939+0000 7f1bbf7fe640 20 reqs_thread_entry: start 2024-09-10T05:11:46.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.939+0000 7f1d134bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:46.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.939+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56196a096ab0 con 0x56196a04d280 2024-09-10T05:11:46.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.940+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.940+0000 7f1d134bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:46.954 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.941+0000 7f1bc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.941+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94667152952192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a095450 con 0x56196a04d280 2024-09-10T05:11:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.941+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94667152952192] v35'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.942+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94667152927088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a095450 con 0x7f1cfc02e910 2024-09-10T05:11:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.942+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94667152927088] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.942+0000 7f1d134bb800 20 remove_watcher() i=0 2024-09-10T05:11:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.942+0000 7f1d134bb800 2 removed watcher, disabling cache 2024-09-10T05:11:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.942+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94667152930064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05a970 con 0x56196a04d280 2024-09-10T05:11:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.943+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94667152930064] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.943+0000 7f1d134bb800 20 remove_watcher() i=1 2024-09-10T05:11:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.943+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94667152924608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05a970 con 0x56196a0565d0 2024-09-10T05:11:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.944+0000 7f1d0bfff640 1 -- 172.21.15.192:0/1148147152 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94667152924608] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cfc037040 con 0x56196a0565d0 2024-09-10T05:11:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.944+0000 7f1d134bb800 20 remove_watcher() i=2 2024-09-10T05:11:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.944+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94667152937136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a059fc0 con 0x7f1cfc02e910 2024-09-10T05:11:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.945+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94667152937136] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x7f1cfc02e910 2024-09-10T05:11:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.945+0000 7f1d134bb800 20 remove_watcher() i=3 2024-09-10T05:11:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.945+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94667152941456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a059fc0 con 0x56196a04d280 2024-09-10T05:11:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.946+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94667152941456] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d0c00a4d0 con 0x56196a04d280 2024-09-10T05:11:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.946+0000 7f1d134bb800 20 remove_watcher() i=4 2024-09-10T05:11:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.946+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94667152943776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05e190 con 0x56196a051a00 2024-09-10T05:11:46.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.947+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94667152943776] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.947+0000 7f1d134bb800 20 remove_watcher() i=5 2024-09-10T05:11:46.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.947+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94667152935056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a059fc0 con 0x56196a051a00 2024-09-10T05:11:46.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.948+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94667152935056] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.948+0000 7f1d134bb800 20 remove_watcher() i=6 2024-09-10T05:11:46.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.948+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94667152949696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56196a05c890 con 0x56196a051a00 2024-09-10T05:11:46.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d10fa5640 1 -- 172.21.15.192:0/1148147152 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94667152949696] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040bc020 con 0x56196a051a00 2024-09-10T05:11:46.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 20 remove_watcher() i=7 2024-09-10T05:11:46.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56196a051a00 msgr2=0x56196a053df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56196a051a00 0x56196a053df0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56196a04d280 msgr2=0x56196a04f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56196a04d280 0x56196a04f740 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1cfc02e910 msgr2=0x7f1cfc03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1cfc02e910 0x7f1cfc03a3c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56196a0565d0 msgr2=0x56196a058a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56196a0565d0 0x56196a058a90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1bdc03c780 msgr2=0x7f1bdc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1bdc03c780 0x7f1bdc03ec40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00ffd0 tx=0x7f1cfc023040 comp rx=0 tx=0).stop 2024-09-10T05:11:46.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 msgr2=0x56196a041d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 --2- 172.21.15.192:0/1148147152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a03a8e0 0x56196a041d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1d04077fb0 tx=0x7f1d0407eeb0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 reap_dead start 2024-09-10T05:11:46.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d117a6640 1 -- 172.21.15.192:0/1148147152 reap_dead start 2024-09-10T05:11:46.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 shutdown_connections 2024-09-10T05:11:46.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 >> 172.21.15.192:0/1148147152 conn(0x56196a036ce0 msgr2=0x56196a034ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 shutdown_connections 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.949+0000 7f1d134bb800 1 -- 172.21.15.192:0/1148147152 wait complete. 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/694298342 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1be803c780 msgr2=0x7f1be803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 --2- 172.21.15.192:0/694298342 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1be803c780 0x7f1be803ec40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56196a020890 tx=0x7f1cfc006000 comp rx=0 tx=0).stop 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/694298342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a02e0c0 msgr2=0x56196a02e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 --2- 172.21.15.192:0/694298342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a02e0c0 0x56196a02e4e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1d04095c50 tx=0x7f1d0405af10 comp rx=0 tx=0).stop 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/694298342 shutdown_connections 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 --2- 172.21.15.192:0/694298342 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1be803c780 0x7f1be803ec40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 --2- 172.21.15.192:0/694298342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56196a02e0c0 0x56196a02e4e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/694298342 >> 172.21.15.192:0/694298342 conn(0x56196a022420 msgr2=0x56196a022800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/694298342 shutdown_connections 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/694298342 wait complete. 2024-09-10T05:11:46.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56196a0198a0 msgr2=0x56196a01bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56196a0198a0 0x56196a01bd40 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561969f15dd0 msgr2=0x56196a0174c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561969f15dd0 0x56196a0174c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56196a01d930 msgr2=0x56196a01fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56196a01d930 0x56196a01fd20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1bf803c730 msgr2=0x7f1bf803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1bf803c730 0x7f1bf803ebf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc000c00 tx=0x7f1cfc0013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 msgr2=0x56196a00fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 --2- 172.21.15.192:0/3675706212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561969f15490 0x56196a00fe70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1d04025da0 tx=0x7f1d04002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d117a6640 1 -- 172.21.15.192:0/3675706212 reap_dead start 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 shutdown_connections 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 >> 172.21.15.192:0/3675706212 conn(0x561969f111c0 msgr2=0x56196a002830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:46.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 shutdown_connections 2024-09-10T05:11:46.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:46.950+0000 7f1d134bb800 1 -- 172.21.15.192:0/3675706212 wait complete. 2024-09-10T05:11:46.965 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:46.966 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-10T05:11:46.966 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-10T05:11:46.966 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-10T05:11:47.010 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:47.010 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:47.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.010+0000 7f2841139800 1 Processor -- start 2024-09-10T05:11:47.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.010+0000 7f2841139800 1 -- start start 2024-09-10T05:11:47.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.010+0000 7f2841139800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55de5a2142e0 0x55de5a219e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.010+0000 7f2841139800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de5a0bce40 con 0x55de5a212ed0 2024-09-10T05:11:47.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.010+0000 7f2841139800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55de5a087680 con 0x55de5a2142e0 2024-09-10T05:11:47.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.011+0000 7f28345c6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55de5a2142e0 0x55de5a219e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.011+0000 7f283cdc7640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55de5a212ed0 0x55de5a213bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36226/0 (socket says 172.21.15.192:36226) 2024-09-10T05:11:47.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.011+0000 7f283cdc7640 1 -- 172.21.15.192:0/1519479314 learned_addr learned my addr 172.21.15.192:0/1519479314 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:47.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.011+0000 7f28345c6640 1 -- 172.21.15.192:0/1519479314 >> v1:172.21.15.139:6789/0 conn(0x55de5a212ed0 legacy=0x55de5a213bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.011+0000 7f28345c6640 1 -- 172.21.15.192:0/1519479314 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5a0a36b0 con 0x55de5a2142e0 2024-09-10T05:11:47.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.013+0000 7f28345c6640 1 --2- 172.21.15.192:0/1519479314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a2142e0 0x55de5a219e80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f282400a470 tx=0x7f2824045880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516814fe4ad5a72b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.013+0000 7f2837fff640 1 -- 172.21.15.192:0/1519479314 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2824059070 con 0x55de5a2142e0 2024-09-10T05:11:47.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.013+0000 7f2837fff640 1 -- 172.21.15.192:0/1519479314 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2824054570 con 0x55de5a2142e0 2024-09-10T05:11:47.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.013+0000 7f2837fff640 1 -- 172.21.15.192:0/1519479314 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2824054870 con 0x55de5a2142e0 2024-09-10T05:11:47.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.013+0000 7f2841139800 1 -- 172.21.15.192:0/1519479314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a2142e0 msgr2=0x55de5a219e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.013+0000 7f2841139800 1 --2- 172.21.15.192:0/1519479314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a2142e0 0x55de5a219e80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f282400a470 tx=0x7f2824045880 comp rx=0 tx=0).stop 2024-09-10T05:11:47.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.013+0000 7f2841139800 1 -- 172.21.15.192:0/1519479314 shutdown_connections 2024-09-10T05:11:47.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.013+0000 7f2841139800 1 --2- 172.21.15.192:0/1519479314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a2142e0 0x55de5a219e80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.013+0000 7f2841139800 1 -- 172.21.15.192:0/1519479314 >> 172.21.15.192:0/1519479314 conn(0x55de5a20e300 msgr2=0x55de5a210720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.013+0000 7f2841139800 1 -- 172.21.15.192:0/1519479314 shutdown_connections 2024-09-10T05:11:47.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.013+0000 7f2841139800 1 -- 172.21.15.192:0/1519479314 wait complete. 2024-09-10T05:11:47.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.027+0000 7f2841139800 1 Processor -- start 2024-09-10T05:11:47.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.027+0000 7f2841139800 1 -- start start 2024-09-10T05:11:47.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.027+0000 7f2841139800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 0x55de5a187e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.027+0000 7f2841139800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55de5a0abdd0 con 0x55de5a212ed0 2024-09-10T05:11:47.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.028+0000 7f283cdc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 0x55de5a187e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.028+0000 7f283cdc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 0x55de5a187e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59306/0 (socket says 172.21.15.192:59306) 2024-09-10T05:11:47.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.028+0000 7f283cdc7640 1 -- 172.21.15.192:0/670013866 learned_addr learned my addr 172.21.15.192:0/670013866 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.028+0000 7f283cdc7640 1 -- 172.21.15.192:0/670013866 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5a0c4e10 con 0x55de5a212ed0 2024-09-10T05:11:47.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.028+0000 7f283cdc7640 1 --2- 172.21.15.192:0/670013866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 0x55de5a187e90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f282c00b510 tx=0x7f282c00b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317599b579a7ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.028+0000 7f272ae0d640 1 -- 172.21.15.192:0/670013866 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282c008070 con 0x55de5a212ed0 2024-09-10T05:11:47.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.028+0000 7f272ae0d640 1 -- 172.21.15.192:0/670013866 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c00d5c0 con 0x55de5a212ed0 2024-09-10T05:11:47.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.028+0000 7f272ae0d640 1 -- 172.21.15.192:0/670013866 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282c00d8e0 con 0x55de5a212ed0 2024-09-10T05:11:47.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.029+0000 7f2841139800 1 -- 172.21.15.192:0/670013866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 msgr2=0x55de5a187e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.029+0000 7f2841139800 1 --2- 172.21.15.192:0/670013866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 0x55de5a187e90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f282c00b510 tx=0x7f282c00b9d0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.029+0000 7f2841139800 1 -- 172.21.15.192:0/670013866 shutdown_connections 2024-09-10T05:11:47.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.029+0000 7f2841139800 1 --2- 172.21.15.192:0/670013866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 0x55de5a187e90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.029+0000 7f2841139800 1 -- 172.21.15.192:0/670013866 >> 172.21.15.192:0/670013866 conn(0x55de5a20e300 msgr2=0x55de5a2fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.029+0000 7f2841139800 1 -- 172.21.15.192:0/670013866 shutdown_connections 2024-09-10T05:11:47.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.029+0000 7f2841139800 1 -- 172.21.15.192:0/670013866 wait complete. 2024-09-10T05:11:47.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.029+0000 7f2841139800 1 Processor -- start 2024-09-10T05:11:47.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.029+0000 7f2841139800 1 -- start start 2024-09-10T05:11:47.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.029+0000 7f2841139800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 0x55de5a30c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.029+0000 7f2841139800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55de5a2149d0 con 0x55de5a212ed0 2024-09-10T05:11:47.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.030+0000 7f283cdc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 0x55de5a30c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.030+0000 7f283cdc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 0x55de5a30c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59320/0 (socket says 172.21.15.192:59320) 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.030+0000 7f283cdc7640 1 -- 172.21.15.192:0/1776514133 learned_addr learned my addr 172.21.15.192:0/1776514133 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.030+0000 7f283cdc7640 1 -- 172.21.15.192:0/1776514133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5a30c6f0 con 0x55de5a212ed0 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.030+0000 7f283cdc7640 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 0x55de5a30c190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55de5a1879c0 tx=0x7f282c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.030+0000 7f272960a640 1 -- 172.21.15.192:0/1776514133 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282c00fac0 con 0x55de5a212ed0 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.030+0000 7f272960a640 1 -- 172.21.15.192:0/1776514133 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c020030 con 0x55de5a212ed0 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.030+0000 7f272960a640 1 -- 172.21.15.192:0/1776514133 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282c00fdd0 con 0x55de5a212ed0 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.030+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de5a30c980 con 0x55de5a212ed0 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.030+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de5a30d590 con 0x55de5a212ed0 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.031+0000 7f272960a640 1 -- 172.21.15.192:0/1776514133 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f282c01b430 con 0x55de5a212ed0 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.031+0000 7f272960a640 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f272403c780 0x7f272403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.031+0000 7f272960a640 1 -- 172.21.15.192:0/1776514133 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f282c054200 con 0x55de5a212ed0 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.031+0000 7f28345c6640 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f272403c780 0x7f272403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.031+0000 7f2841139800 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de5a2142e0 0x55de5a3137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.031+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a313d20 con 0x55de5a2142e0 2024-09-10T05:11:47.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.032+0000 7f283d5c8640 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de5a2142e0 0x55de5a3137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.032+0000 7f28345c6640 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f272403c780 0x7f272403ec40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2824056000 tx=0x7f2824050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.032+0000 7f283d5c8640 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de5a2142e0 0x55de5a3137e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.032+0000 7f283d5c8640 1 -- 172.21.15.192:0/1776514133 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a2142e0 2024-09-10T05:11:47.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.032+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a3140c0 con 0x55de5a2142e0 2024-09-10T05:11:47.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.032+0000 7f283d5c8640 1 -- 172.21.15.192:0/1776514133 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a2142e0 2024-09-10T05:11:47.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.032+0000 7f2841139800 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de5a315bc0 0x55de5a318060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.032+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a3187f0 con 0x55de5a315bc0 2024-09-10T05:11:47.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.033+0000 7f283cdc7640 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de5a315bc0 0x55de5a318060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.033+0000 7f283cdc7640 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de5a315bc0 0x55de5a318060 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.033+0000 7f283cdc7640 1 -- 172.21.15.192:0/1776514133 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f282c02c070 con 0x55de5a315bc0 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.033+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a314910 con 0x55de5a2142e0 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.034+0000 7f283d5c8640 1 -- 172.21.15.192:0/1776514133 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a2142e0 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.034+0000 7f2841139800 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55de5a319c50 0x55de5a31c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.034+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a31c7b0 con 0x55de5a319c50 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.034+0000 7f28345c6640 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55de5a319c50 0x55de5a31c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.034+0000 7f28345c6640 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55de5a319c50 0x55de5a31c040 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.034+0000 7f28345c6640 1 -- 172.21.15.192:0/1776514133 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f282405c040 con 0x55de5a319c50 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.035+0000 7f2841139800 1 Processor -- start 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.035+0000 7f2841139800 1 -- start start 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.035+0000 7f2841139800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a32a410 0x55de5a32a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.035+0000 7f2841139800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55de5a109a00 con 0x55de5a32a410 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.035+0000 7f283cdc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a32a410 0x55de5a32a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.035+0000 7f283cdc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a32a410 0x55de5a32a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59334/0 (socket says 172.21.15.192:59334) 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.035+0000 7f283cdc7640 1 -- 172.21.15.192:0/3013657531 learned_addr learned my addr 172.21.15.192:0/3013657531 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.035+0000 7f283cdc7640 1 -- 172.21.15.192:0/3013657531 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5a32ae70 con 0x55de5a32a410 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.035+0000 7f283cdc7640 1 --2- 172.21.15.192:0/3013657531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a32a410 0x55de5a32a830 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f282c052580 tx=0x7f282c00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.035+0000 7f27227fc640 1 -- 172.21.15.192:0/3013657531 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282c019960 con 0x55de5a32a410 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.036+0000 7f27227fc640 1 -- 172.21.15.192:0/3013657531 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c019b00 con 0x55de5a32a410 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.036+0000 7f27227fc640 1 -- 172.21.15.192:0/3013657531 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282c019e20 con 0x55de5a32a410 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.036+0000 7f2841139800 1 -- 172.21.15.192:0/3013657531 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de5a32b6a0 con 0x55de5a32a410 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.036+0000 7f2841139800 1 -- 172.21.15.192:0/3013657531 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de5a32bc40 con 0x55de5a32a410 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.036+0000 7f27227fc640 1 -- 172.21.15.192:0/3013657531 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f282c052960 con 0x55de5a32a410 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.036+0000 7f27227fc640 1 --2- 172.21.15.192:0/3013657531 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f271403c730 0x7f271403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.037+0000 7f27227fc640 1 -- 172.21.15.192:0/3013657531 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f282c03b8f0 con 0x55de5a32a410 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.037+0000 7f28345c6640 1 --2- 172.21.15.192:0/3013657531 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f271403c730 0x7f271403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.037+0000 7f2841139800 1 Processor -- start 2024-09-10T05:11:47.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.037+0000 7f2841139800 1 -- start start 2024-09-10T05:11:47.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.037+0000 7f28345c6640 1 --2- 172.21.15.192:0/3013657531 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f271403c730 0x7f271403ebf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55de5a318b90 tx=0x7f2824005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.037+0000 7f2841139800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 0x55de5a3370d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.037+0000 7f2841139800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55de5a186730 con 0x55de5a336cd0 2024-09-10T05:11:47.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.037+0000 7f283cdc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 0x55de5a3370d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.037+0000 7f283cdc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 0x55de5a3370d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59336/0 (socket says 172.21.15.192:59336) 2024-09-10T05:11:47.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.037+0000 7f283cdc7640 1 -- 172.21.15.192:0/3022596305 learned_addr learned my addr 172.21.15.192:0/3022596305 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.038+0000 7f283cdc7640 1 -- 172.21.15.192:0/3022596305 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5a3376c0 con 0x55de5a336cd0 2024-09-10T05:11:47.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.038+0000 7f283cdc7640 1 --2- 172.21.15.192:0/3022596305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 0x55de5a3370d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f282c041f00 tx=0x7f282c01b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5765865b371b0932 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.038+0000 7f2713fff640 1 -- 172.21.15.192:0/3022596305 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282c038c90 con 0x55de5a336cd0 2024-09-10T05:11:47.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.038+0000 7f2713fff640 1 -- 172.21.15.192:0/3022596305 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c0255e0 con 0x55de5a336cd0 2024-09-10T05:11:47.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.038+0000 7f2713fff640 1 -- 172.21.15.192:0/3022596305 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282c0514f0 con 0x55de5a336cd0 2024-09-10T05:11:47.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.038+0000 7f2841139800 1 -- 172.21.15.192:0/3022596305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 msgr2=0x55de5a3370d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.038+0000 7f2841139800 1 --2- 172.21.15.192:0/3022596305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 0x55de5a3370d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f282c041f00 tx=0x7f282c01b820 comp rx=0 tx=0).stop 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.038+0000 7f2841139800 1 -- 172.21.15.192:0/3022596305 shutdown_connections 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.038+0000 7f2841139800 1 --2- 172.21.15.192:0/3022596305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 0x55de5a3370d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.038+0000 7f2841139800 1 -- 172.21.15.192:0/3022596305 >> 172.21.15.192:0/3022596305 conn(0x55de5a3330d0 msgr2=0x55de5a331310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.038+0000 7f2841139800 1 -- 172.21.15.192:0/3022596305 shutdown_connections 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.039+0000 7f2841139800 1 -- 172.21.15.192:0/3022596305 wait complete. 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.039+0000 7f2841139800 1 Processor -- start 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.039+0000 7f2841139800 1 -- start start 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.039+0000 7f2841139800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 0x55de5a33e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.039+0000 7f2841139800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55de5a337b30 con 0x55de5a336cd0 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.039+0000 7f283cdc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 0x55de5a33e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.039+0000 7f283cdc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 0x55de5a33e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59350/0 (socket says 172.21.15.192:59350) 2024-09-10T05:11:47.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.039+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 learned_addr learned my addr 172.21.15.192:0/701298185 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.039+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de5a33e690 con 0x55de5a336cd0 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.040+0000 7f283cdc7640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 0x55de5a33e130 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f282c0257d0 tx=0x7f282c041e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.040+0000 7f27127fc640 1 -- 172.21.15.192:0/701298185 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282c06c070 con 0x55de5a336cd0 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.040+0000 7f27127fc640 1 -- 172.21.15.192:0/701298185 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c025a70 con 0x55de5a336cd0 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.040+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de5a33e690 con 0x55de5a336cd0 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.040+0000 7f27127fc640 1 -- 172.21.15.192:0/701298185 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f282c038c90 con 0x55de5a336cd0 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.040+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de5a33e690 con 0x55de5a336cd0 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.041+0000 7f27127fc640 1 -- 172.21.15.192:0/701298185 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f282c06f070 con 0x55de5a336cd0 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.041+0000 7f27127fc640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f270803c780 0x7f270803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.041+0000 7f27127fc640 1 -- 172.21.15.192:0/701298185 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f282c063030 con 0x55de5a336cd0 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.041+0000 7f28345c6640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f270803c780 0x7f270803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.041+0000 7f2841139800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.041+0000 7f2841139800 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de5a3496b0 0x55de5a34bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.041+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34c2c0 con 0x55de5a3496b0 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.041+0000 7f28345c6640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f270803c780 0x7f270803ec40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2824054fd0 tx=0x7f2824051000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.042+0000 7f283d5c8640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de5a3496b0 0x55de5a34bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.042+0000 7f283d5c8640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de5a3496b0 0x55de5a34bb70 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.042+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.042+0000 7f2841139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.042+0000 7f2841139800 20 realm 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.042+0000 7f2841139800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.042+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34c6d0 con 0x55de5a3496b0 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.042+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.042+0000 7f2841139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.042+0000 7f2841139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:47.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.042+0000 7f2841139800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.042+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34cfa0 con 0x55de5a3496b0 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.043+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.043+0000 7f2841139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.043+0000 7f2841139800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.043+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x55de5a3496b0 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.043+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.043+0000 7f2841139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.043+0000 7f2841139800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.043+0000 7f2841139800 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de5a34e0a0 0x55de5a350490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.043+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a350a50 con 0x55de5a34e0a0 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.043+0000 7f283cdc7640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de5a34e0a0 0x55de5a350490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.043+0000 7f283cdc7640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de5a34e0a0 0x55de5a350490 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.044+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.044+0000 7f2841139800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:47.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.044+0000 7f2841139800 20 searching for the correct realm 2024-09-10T05:11:47.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.044+0000 7f2841139800 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55de5a352a00 0x55de5a354ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.044+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a355590 con 0x55de5a352a00 2024-09-10T05:11:47.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.044+0000 7f28345c6640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55de5a352a00 0x55de5a354ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.044+0000 7f28345c6640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55de5a352a00 0x55de5a354ec0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.044+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.044+0000 7f28345c6640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f2824077040 0x7f2824084920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.044+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a355590 con 0x7f2824077040 2024-09-10T05:11:47.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.044+0000 7f283d5c8640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f2824077040 0x7f2824084920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.045+0000 7f283d5c8640 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f2824077040 0x7f2824084920 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.045+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.045+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x55de5a34e0a0 2024-09-10T05:11:47.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.046+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.046+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x55de5a3496b0 2024-09-10T05:11:47.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.046+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.046+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x55de5a3496b0 2024-09-10T05:11:47.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.046+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.046+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x55de5a34e0a0 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.046+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.046+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x55de5a34e0a0 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.046+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.047+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x7f2824077040 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.047+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.047+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x55de5a352a00 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.047+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.047+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x55de5a3496b0 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.047+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.047+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x55de5a34e0a0 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.047+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.048+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x55de5a3496b0 2024-09-10T05:11:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.048+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.048+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x7f2824077040 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.048+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.048+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55de5a34d340 con 0x55de5a352a00 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.048+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.048+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a352a00 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.048+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.048+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a34e0a0 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.049+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.049+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a352a00 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.049+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.049+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a352a00 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.049+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.049+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a3496b0 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.049+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.049+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a3496b0 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.050+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.050+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a34e0a0 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.050+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.050+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a352a00 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.050+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.050+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x7f2824077040 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.050+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.050+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a3496b0 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.051+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.051+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a34e0a0 2024-09-10T05:11:47.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.051+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.051+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a352a00 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.051+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.051+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a34e0a0 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.051+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.051+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x7f2824077040 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.052+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.052+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a352a00 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.052+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.052+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a34e0a0 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.052+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.052+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x55de5a3496b0 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.052+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.052+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f2824091040 con 0x7f2824077040 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a351310 con 0x55de5a3496b0 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a351310 con 0x55de5a3496b0 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a351310 con 0x7f2824077040 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 zone default found 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 4 Realm: () 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 zonegroup default 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.053+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a3512c0 con 0x55de5a34e0a0 2024-09-10T05:11:47.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f2841139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f2841139800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a357400 con 0x55de5a352a00 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f2841139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f2841139800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a3577a0 con 0x55de5a352a00 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f2841139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f2841139800 20 started sync module instance, tier type = 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f2841139800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.054+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a3568a0 con 0x7f2824077040 2024-09-10T05:11:47.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.055+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.055+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94413484551312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a3568a0 con 0x7f2824077040 2024-09-10T05:11:47.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.055+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a358160 con 0x55de5a3496b0 2024-09-10T05:11:47.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.056+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94413484551312] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.057+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.057+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94413484549616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a358160 con 0x55de5a3496b0 2024-09-10T05:11:47.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.057+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a358b20 con 0x55de5a352a00 2024-09-10T05:11:47.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.058+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94413484549616] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.058+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.058+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94413484555440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a3580d0 con 0x55de5a352a00 2024-09-10T05:11:47.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.058+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a359a10 con 0x7f2824077040 2024-09-10T05:11:47.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.059+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.059+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94413484562240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a35a1b0 con 0x7f2824077040 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.059+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a35acd0 con 0x55de5a3496b0 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.059+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94413484555440] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.060+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.060+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94413484562240] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.060+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94413484566432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a35ac90 con 0x55de5a3496b0 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.060+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a359c60 con 0x55de5a34e0a0 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.061+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.061+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94413484569136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a35bb00 con 0x55de5a34e0a0 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.061+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a35c4c0 con 0x55de5a34e0a0 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.061+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94413484566432] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.062+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94413484569136] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.062+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.062+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94413484572688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a35c860 con 0x55de5a34e0a0 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.062+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a35d0b0 con 0x55de5a34e0a0 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.063+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94413484572688] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.063+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.063+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94413484574816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a35d130 con 0x55de5a34e0a0 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.063+0000 7f2841139800 20 add_watcher() i=0 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.063+0000 7f2841139800 20 add_watcher() i=1 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.063+0000 7f2841139800 20 add_watcher() i=2 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.063+0000 7f2841139800 20 add_watcher() i=3 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.063+0000 7f2841139800 20 add_watcher() i=4 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.063+0000 7f2841139800 20 add_watcher() i=5 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.063+0000 7f2841139800 20 add_watcher() i=6 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.064+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94413484574816] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.064+0000 7f2841139800 20 add_watcher() i=7 2024-09-10T05:11:47.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.064+0000 7f2841139800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:47.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.064+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a360480 con 0x55de5a3496b0 2024-09-10T05:11:47.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.064+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.064+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94413484576240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a35d6c0 con 0x55de5a3496b0 2024-09-10T05:11:47.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.065+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94413484576240] v35'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.065+0000 7f26f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.065+0000 7f2841139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:47.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.065+0000 7f2841139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:47.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.065+0000 7f2841139800 5 note: GC not initialized 2024-09-10T05:11:47.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f26f27e4640 20 reqs_thread_entry: start 2024-09-10T05:11:47.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f2841139800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:47.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f2841139800 20 Filter name: none 2024-09-10T05:11:47.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f26ebfff640 20 reqs_thread_entry: start 2024-09-10T05:11:47.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f2841139800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:47.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f2841139800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a3935a0 con 0x55de5a3496b0 2024-09-10T05:11:47.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f2841139800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f2841139800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f2841139800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f2841139800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.066+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a395ed0 con 0x7f2824077040 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.067+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.067+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a399610 con 0x55de5a3496b0 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v35'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f2841139800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f2841139800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f2841139800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94413484822480 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55de5a394ec0 con 0x55de5a3496b0 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 94413484566432 notify 150323855362 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f2838045430 con 0x55de5a3496b0 2024-09-10T05:11:47.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f2713fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855362 cookie 94413484566432 notifier 4336 bl.length()=567 2024-09-10T05:11:47.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f2713fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:47.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f2713fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(65 notify.4 [notify cookie 94413484822480 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f2713fff640 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2700003ea0 con 0x55de5a3496b0 2024-09-10T05:11:47.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.068+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== watch-notify(notify_complete (2) cookie 94413484822480 notify 150323855362 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2838045600 con 0x55de5a3496b0 2024-09-10T05:11:47.081 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:47.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.069+0000 7f26f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.069+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94413484576240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a391460 con 0x55de5a3496b0 2024-09-10T05:11:47.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.070+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94413484576240] v35'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.070+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94413484551312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a391460 con 0x7f2824077040 2024-09-10T05:11:47.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.071+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94413484551312] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.071+0000 7f2841139800 20 remove_watcher() i=0 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.071+0000 7f2841139800 2 removed watcher, disabling cache 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.071+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94413484549616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a391460 con 0x55de5a3496b0 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.073+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94413484549616] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.073+0000 7f2841139800 20 remove_watcher() i=1 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.073+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94413484555440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a391460 con 0x55de5a352a00 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.074+0000 7f28345c6640 1 -- 172.21.15.192:0/701298185 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94413484555440] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2824082070 con 0x55de5a352a00 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.074+0000 7f2841139800 20 remove_watcher() i=2 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.074+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94413484562240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a356c90 con 0x7f2824077040 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.075+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94413484562240] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x7f2824077040 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.075+0000 7f2841139800 20 remove_watcher() i=3 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.075+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94413484566432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a357cb0 con 0x55de5a3496b0 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.076+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94413484566432] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283800a4d0 con 0x55de5a3496b0 2024-09-10T05:11:47.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.076+0000 7f2841139800 20 remove_watcher() i=4 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.076+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94413484569136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a359740 con 0x55de5a34e0a0 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.077+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94413484569136] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.077+0000 7f2841139800 20 remove_watcher() i=5 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.077+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94413484572688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a356c90 con 0x55de5a34e0a0 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.078+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94413484572688] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.078+0000 7f2841139800 20 remove_watcher() i=6 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.078+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94413484574816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55de5a35a7a0 con 0x55de5a34e0a0 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f283cdc7640 1 -- 172.21.15.192:0/701298185 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94413484574816] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f282c06e030 con 0x55de5a34e0a0 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 20 remove_watcher() i=7 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de5a34e0a0 msgr2=0x55de5a350490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de5a34e0a0 0x55de5a350490 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de5a3496b0 msgr2=0x55de5a34bb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de5a3496b0 0x55de5a34bb70 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f2824077040 msgr2=0x7f2824084920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f2824077040 0x7f2824084920 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55de5a352a00 msgr2=0x55de5a354ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55de5a352a00 0x55de5a354ec0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f270803c780 msgr2=0x7f270803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f270803c780 0x7f270803ec40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2824054fd0 tx=0x7f2824051000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 msgr2=0x55de5a33e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 --2- 172.21.15.192:0/701298185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a336cd0 0x55de5a33e130 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f282c0257d0 tx=0x7f282c041e90 comp rx=0 tx=0).stop 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 reap_dead start 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f283d5c8640 1 -- 172.21.15.192:0/701298185 reap_dead start 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 shutdown_connections 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 >> 172.21.15.192:0/701298185 conn(0x55de5a3330d0 msgr2=0x55de5a3312e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 shutdown_connections 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.079+0000 7f2841139800 1 -- 172.21.15.192:0/701298185 wait complete. 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/3013657531 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f271403c730 msgr2=0x7f271403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 --2- 172.21.15.192:0/3013657531 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f271403c730 0x7f271403ebf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55de5a318b90 tx=0x7f2824005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/3013657531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a32a410 msgr2=0x55de5a32a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 --2- 172.21.15.192:0/3013657531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a32a410 0x55de5a32a830 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f282c052580 tx=0x7f282c00e940 comp rx=0 tx=0).stop 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/3013657531 shutdown_connections 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 --2- 172.21.15.192:0/3013657531 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f271403c730 0x7f271403ebf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 --2- 172.21.15.192:0/3013657531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a32a410 0x55de5a32a830 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/3013657531 >> 172.21.15.192:0/3013657531 conn(0x55de5a31e7c0 msgr2=0x55de5a31eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/3013657531 shutdown_connections 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/3013657531 wait complete. 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de5a315bc0 msgr2=0x55de5a318060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de5a315bc0 0x55de5a318060 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de5a2142e0 msgr2=0x55de5a3137e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de5a2142e0 0x55de5a3137e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55de5a319c50 msgr2=0x55de5a31c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55de5a319c50 0x55de5a31c040 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f272403c780 msgr2=0x7f272403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f272403c780 0x7f272403ec40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2824056000 tx=0x7f2824050000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 msgr2=0x55de5a30c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 --2- 172.21.15.192:0/1776514133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de5a212ed0 0x55de5a30c190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55de5a1879c0 tx=0x7f282c000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f283d5c8640 1 -- 172.21.15.192:0/1776514133 reap_dead start 2024-09-10T05:11:47.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 shutdown_connections 2024-09-10T05:11:47.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 >> 172.21.15.192:0/1776514133 conn(0x55de5a20e300 msgr2=0x55de5a2fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 shutdown_connections 2024-09-10T05:11:47.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.080+0000 7f2841139800 1 -- 172.21.15.192:0/1776514133 wait complete. 2024-09-10T05:11:47.092 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:47.092 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:11:47.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:11:47.093 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:11:47.137 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:47.137 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:47.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.137+0000 7f5ba7f46800 1 Processor -- start 2024-09-10T05:11:47.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.137+0000 7f5ba7f46800 1 -- start start 2024-09-10T05:11:47.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.137+0000 7f5ba7f46800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b94d989450 0x55b94d98fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.137+0000 7f5ba7f46800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b94d833e40 con 0x55b94d98a660 2024-09-10T05:11:47.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.137+0000 7f5ba7f46800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55b94d7fe680 con 0x55b94d989450 2024-09-10T05:11:47.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.137+0000 7f5ba522f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b94d989450 0x55b94d98fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.137+0000 7f5ba522f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b94d989450 0x55b94d98fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59356/0 (socket says 172.21.15.192:59356) 2024-09-10T05:11:47.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.137+0000 7f5ba5a30640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55b94d98a660 0x55b94d988d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36234/0 (socket says 172.21.15.192:36234) 2024-09-10T05:11:47.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.137+0000 7f5ba522f640 1 -- 172.21.15.192:0/1227027278 learned_addr learned my addr 172.21.15.192:0/1227027278 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.137+0000 7f5ba522f640 1 -- 172.21.15.192:0/1227027278 >> v1:172.21.15.139:6789/0 conn(0x55b94d98a660 legacy=0x55b94d988d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.137+0000 7f5ba522f640 1 -- 172.21.15.192:0/1227027278 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b94d81a6b0 con 0x55b94d989450 2024-09-10T05:11:47.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.137+0000 7f5ba4a2e640 1 -- 172.21.15.192:0/1227027278 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217273508 0 0) 0x55b94d833e40 con 0x55b94d98a660 2024-09-10T05:11:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.139+0000 7f5ba522f640 1 --2- 172.21.15.192:0/1227027278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94d98fdb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000a520 tx=0x7f5b90045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e617861e8e0d73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.139+0000 7f5ba4a2e640 1 -- 172.21.15.192:0/1227027278 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b90055070 con 0x55b94d989450 2024-09-10T05:11:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.139+0000 7f5ba4a2e640 1 -- 172.21.15.192:0/1227027278 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b900515b0 con 0x55b94d989450 2024-09-10T05:11:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.139+0000 7f5ba4a2e640 1 -- 172.21.15.192:0/1227027278 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b900518d0 con 0x55b94d989450 2024-09-10T05:11:47.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.140+0000 7f5ba7f46800 1 -- 172.21.15.192:0/1227027278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 msgr2=0x55b94d98fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.140+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/1227027278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94d98fdb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000a520 tx=0x7f5b90045ba0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.140+0000 7f5ba7f46800 1 -- 172.21.15.192:0/1227027278 shutdown_connections 2024-09-10T05:11:47.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.140+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/1227027278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94d98fdb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.140+0000 7f5ba7f46800 1 -- 172.21.15.192:0/1227027278 >> 172.21.15.192:0/1227027278 conn(0x55b94d983920 msgr2=0x55b94d985da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.140+0000 7f5ba7f46800 1 -- 172.21.15.192:0/1227027278 shutdown_connections 2024-09-10T05:11:47.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.140+0000 7f5ba7f46800 1 -- 172.21.15.192:0/1227027278 wait complete. 2024-09-10T05:11:47.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.154+0000 7f5ba7f46800 1 Processor -- start 2024-09-10T05:11:47.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.154+0000 7f5ba7f46800 1 -- start start 2024-09-10T05:11:47.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.154+0000 7f5ba7f46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94d988540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.154+0000 7f5ba7f46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b94d822dd0 con 0x55b94d989450 2024-09-10T05:11:47.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.154+0000 7f5ba5a30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94d988540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.154+0000 7f5ba5a30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94d988540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59372/0 (socket says 172.21.15.192:59372) 2024-09-10T05:11:47.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.154+0000 7f5ba5a30640 1 -- 172.21.15.192:0/1440301056 learned_addr learned my addr 172.21.15.192:0/1440301056 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.155+0000 7f5ba5a30640 1 -- 172.21.15.192:0/1440301056 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b94d83be10 con 0x55b94d989450 2024-09-10T05:11:47.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.155+0000 7f5ba5a30640 1 --2- 172.21.15.192:0/1440301056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94d988540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5b98006fc0 tx=0x7f5b98001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f923b0e147df024 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.155+0000 7f5a93e07640 1 -- 172.21.15.192:0/1440301056 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b98004480 con 0x55b94d989450 2024-09-10T05:11:47.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.155+0000 7f5a93e07640 1 -- 172.21.15.192:0/1440301056 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b98004620 con 0x55b94d989450 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.155+0000 7f5a93e07640 1 -- 172.21.15.192:0/1440301056 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b980049c0 con 0x55b94d989450 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba7f46800 1 -- 172.21.15.192:0/1440301056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 msgr2=0x55b94d988540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/1440301056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94d988540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5b98006fc0 tx=0x7f5b98001b00 comp rx=0 tx=0).stop 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba7f46800 1 -- 172.21.15.192:0/1440301056 shutdown_connections 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/1440301056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94d988540 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba7f46800 1 -- 172.21.15.192:0/1440301056 >> 172.21.15.192:0/1440301056 conn(0x55b94d983920 msgr2=0x55b94da73f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba7f46800 1 -- 172.21.15.192:0/1440301056 shutdown_connections 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba7f46800 1 -- 172.21.15.192:0/1440301056 wait complete. 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba7f46800 1 Processor -- start 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba7f46800 1 -- start start 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba7f46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94da831b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba7f46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b94d9902f0 con 0x55b94d989450 2024-09-10T05:11:47.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba5a30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94da831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba5a30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94da831b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59388/0 (socket says 172.21.15.192:59388) 2024-09-10T05:11:47.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.156+0000 7f5ba5a30640 1 -- 172.21.15.192:0/2501964598 learned_addr learned my addr 172.21.15.192:0/2501964598 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.157+0000 7f5ba5a30640 1 -- 172.21.15.192:0/2501964598 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b94da83710 con 0x55b94d989450 2024-09-10T05:11:47.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.157+0000 7f5ba5a30640 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94da831b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5b98000f80 tx=0x7f5b98001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.157+0000 7f5a92604640 1 -- 172.21.15.192:0/2501964598 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b98004390 con 0x55b94d989450 2024-09-10T05:11:47.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.157+0000 7f5a92604640 1 -- 172.21.15.192:0/2501964598 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b98014780 con 0x55b94d989450 2024-09-10T05:11:47.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.157+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b94da839a0 con 0x55b94d989450 2024-09-10T05:11:47.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.157+0000 7f5a92604640 1 -- 172.21.15.192:0/2501964598 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b98014aa0 con 0x55b94d989450 2024-09-10T05:11:47.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.157+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b94da843a0 con 0x55b94d989450 2024-09-10T05:11:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.158+0000 7f5a92604640 1 -- 172.21.15.192:0/2501964598 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5b98010070 con 0x55b94d989450 2024-09-10T05:11:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.158+0000 7f5a92604640 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a8c03c780 0x7f5a8c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.158+0000 7f5a92604640 1 -- 172.21.15.192:0/2501964598 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5b98018070 con 0x55b94d989450 2024-09-10T05:11:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.158+0000 7f5ba522f640 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a8c03c780 0x7f5a8c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.158+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b94d98a660 0x55b94da8a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.158+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94da8ad40 con 0x55b94d98a660 2024-09-10T05:11:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.158+0000 7f5ba6231640 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b94d98a660 0x55b94da8a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.159+0000 7f5ba522f640 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a8c03c780 0x7f5a8c03ec40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5b90057000 tx=0x7f5b90052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.159+0000 7f5ba6231640 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b94d98a660 0x55b94da8a800 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.159+0000 7f5ba6231640 1 -- 172.21.15.192:0/2501964598 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ba00083e0 con 0x55b94d98a660 2024-09-10T05:11:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.159+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94da8b0e0 con 0x55b94d98a660 2024-09-10T05:11:47.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.159+0000 7f5ba6231640 1 -- 172.21.15.192:0/2501964598 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5ba00083e0 con 0x55b94d98a660 2024-09-10T05:11:47.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.159+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b94da8cba0 0x55b94da8f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.159+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94da8f7b0 con 0x55b94da8cba0 2024-09-10T05:11:47.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.160+0000 7f5ba5a30640 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b94da8cba0 0x55b94da8f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.160+0000 7f5ba5a30640 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b94da8cba0 0x55b94da8f020 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.160+0000 7f5ba5a30640 1 -- 172.21.15.192:0/2501964598 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b9801b030 con 0x55b94da8cba0 2024-09-10T05:11:47.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.160+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94da8b930 con 0x55b94d98a660 2024-09-10T05:11:47.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.160+0000 7f5ba6231640 1 -- 172.21.15.192:0/2501964598 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5ba00083e0 con 0x55b94d98a660 2024-09-10T05:11:47.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.160+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b94da90c10 0x55b94da93000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.160+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94da93770 con 0x55b94da90c10 2024-09-10T05:11:47.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.161+0000 7f5ba522f640 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b94da90c10 0x55b94da93000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.161+0000 7f5ba522f640 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b94da90c10 0x55b94da93000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.161+0000 7f5ba522f640 1 -- 172.21.15.192:0/2501964598 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b90057030 con 0x55b94da90c10 2024-09-10T05:11:47.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.161+0000 7f5ba7f46800 1 Processor -- start 2024-09-10T05:11:47.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.162+0000 7f5ba7f46800 1 -- start start 2024-09-10T05:11:47.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.162+0000 7f5ba7f46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daa13b0 0x55b94daa17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.162+0000 7f5ba7f46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b94d880a00 con 0x55b94daa13b0 2024-09-10T05:11:47.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.162+0000 7f5ba5a30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daa13b0 0x55b94daa17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.162+0000 7f5ba5a30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daa13b0 0x55b94daa17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59390/0 (socket says 172.21.15.192:59390) 2024-09-10T05:11:47.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.162+0000 7f5ba5a30640 1 -- 172.21.15.192:0/4038768723 learned_addr learned my addr 172.21.15.192:0/4038768723 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.162+0000 7f5ba5a30640 1 -- 172.21.15.192:0/4038768723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b94daa1e10 con 0x55b94daa13b0 2024-09-10T05:11:47.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.162+0000 7f5ba5a30640 1 --2- 172.21.15.192:0/4038768723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daa13b0 0x55b94daa17d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5b98002170 tx=0x7f5b9804b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.163+0000 7f5a8b7fe640 1 -- 172.21.15.192:0/4038768723 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b98037070 con 0x55b94daa13b0 2024-09-10T05:11:47.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.163+0000 7f5a8b7fe640 1 -- 172.21.15.192:0/4038768723 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b98029d40 con 0x55b94daa13b0 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.163+0000 7f5ba7f46800 1 -- 172.21.15.192:0/4038768723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b94daa2640 con 0x55b94daa13b0 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.163+0000 7f5a8b7fe640 1 -- 172.21.15.192:0/4038768723 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b98011400 con 0x55b94daa13b0 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.163+0000 7f5ba7f46800 1 -- 172.21.15.192:0/4038768723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b94daa2be0 con 0x55b94daa13b0 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.163+0000 7f5a8b7fe640 1 -- 172.21.15.192:0/4038768723 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5b98053d10 con 0x55b94daa13b0 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.164+0000 7f5a8b7fe640 1 --2- 172.21.15.192:0/4038768723 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a8003c730 0x7f5a8003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.164+0000 7f5a8b7fe640 1 -- 172.21.15.192:0/4038768723 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5b9803dc90 con 0x55b94daa13b0 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.164+0000 7f5ba522f640 1 --2- 172.21.15.192:0/4038768723 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a8003c730 0x7f5a8003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.164+0000 7f5ba7f46800 1 Processor -- start 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.164+0000 7f5ba7f46800 1 -- start start 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.164+0000 7f5ba522f640 1 --2- 172.21.15.192:0/4038768723 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a8003c730 0x7f5a8003ebf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55b94da8fb50 tx=0x7f5b90005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.164+0000 7f5ba7f46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 0x55b94daae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.164+0000 7f5ba7f46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b94da7e660 con 0x55b94daaddf0 2024-09-10T05:11:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.164+0000 7f5ba5a30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 0x55b94daae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.164+0000 7f5ba5a30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 0x55b94daae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59398/0 (socket says 172.21.15.192:59398) 2024-09-10T05:11:47.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.164+0000 7f5ba5a30640 1 -- 172.21.15.192:0/2558118204 learned_addr learned my addr 172.21.15.192:0/2558118204 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.165+0000 7f5ba5a30640 1 -- 172.21.15.192:0/2558118204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b94daae7e0 con 0x55b94daaddf0 2024-09-10T05:11:47.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.165+0000 7f5ba5a30640 1 --2- 172.21.15.192:0/2558118204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 0x55b94daae1f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5b98011e80 tx=0x7f5b9801f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf96ff2aa63b9525 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.165+0000 7f5a897fa640 1 -- 172.21.15.192:0/2558118204 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b98041030 con 0x55b94daaddf0 2024-09-10T05:11:47.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.165+0000 7f5a897fa640 1 -- 172.21.15.192:0/2558118204 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b980268a0 con 0x55b94daaddf0 2024-09-10T05:11:47.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.165+0000 7f5a897fa640 1 -- 172.21.15.192:0/2558118204 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b98010c80 con 0x55b94daaddf0 2024-09-10T05:11:47.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.165+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2558118204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 msgr2=0x55b94daae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.165+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/2558118204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 0x55b94daae1f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5b98011e80 tx=0x7f5b9801f7d0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.165+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2558118204 shutdown_connections 2024-09-10T05:11:47.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.165+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/2558118204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 0x55b94daae1f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.165+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2558118204 >> 172.21.15.192:0/2558118204 conn(0x55b94daaa1f0 msgr2=0x55b94daa8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.165+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2558118204 shutdown_connections 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.165+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2558118204 wait complete. 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.166+0000 7f5ba7f46800 1 Processor -- start 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.166+0000 7f5ba7f46800 1 -- start start 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.166+0000 7f5ba7f46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 0x55b94dab51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.166+0000 7f5ba7f46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b94daaec50 con 0x55b94daaddf0 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.166+0000 7f5ba5a30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 0x55b94dab51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.166+0000 7f5ba5a30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 0x55b94dab51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59400/0 (socket says 172.21.15.192:59400) 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.166+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 learned_addr learned my addr 172.21.15.192:0/3177381955 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.166+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b94dab5750 con 0x55b94daaddf0 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.167+0000 7f5ba5a30640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 0x55b94dab51f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5b98012fd0 tx=0x7f5b98033f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.167+0000 7f5a777fe640 1 -- 172.21.15.192:0/3177381955 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b980539b0 con 0x55b94daaddf0 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.167+0000 7f5a777fe640 1 -- 172.21.15.192:0/3177381955 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b98011620 con 0x55b94daaddf0 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.167+0000 7f5a777fe640 1 -- 172.21.15.192:0/3177381955 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b98026500 con 0x55b94daaddf0 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.167+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b94dab5750 con 0x55b94daaddf0 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.167+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b94dab5750 con 0x55b94daaddf0 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.167+0000 7f5a777fe640 1 -- 172.21.15.192:0/3177381955 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5b98064040 con 0x55b94daaddf0 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.168+0000 7f5a777fe640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a7003c780 0x7f5a7003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.168+0000 7f5a777fe640 1 -- 172.21.15.192:0/3177381955 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5b98062020 con 0x55b94daaddf0 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.168+0000 7f5ba522f640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a7003c780 0x7f5a7003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.168+0000 7f5ba7f46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.168+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b94dac0750 0x55b94dac2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.168+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac3360 con 0x55b94dac0750 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.168+0000 7f5ba6231640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b94dac0750 0x55b94dac2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.168+0000 7f5ba522f640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a7003c780 0x7f5a7003ec40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b90000c00 tx=0x7f5b90053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba6231640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b94dac0750 0x55b94dac2c10 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ba00083e0 con 0x55b94dac0750 2024-09-10T05:11:47.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 20 realm 2024-09-10T05:11:47.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac3770 con 0x55b94dac0750 2024-09-10T05:11:47.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ba00083e0 con 0x55b94dac0750 2024-09-10T05:11:47.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:47.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac0750 2024-09-10T05:11:47.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ba00083e0 con 0x55b94dac0750 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac43e0 con 0x55b94dac0750 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5ba00083e0 con 0x55b94dac0750 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b94dac4b30 0x55b94dac6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.169+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac7690 con 0x55b94dac4b30 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.170+0000 7f5ba5a30640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b94dac4b30 0x55b94dac6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.170+0000 7f5ba5a30640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b94dac4b30 0x55b94dac6f20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.170+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.170+0000 7f5ba7f46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:47.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.170+0000 7f5ba7f46800 20 searching for the correct realm 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.170+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b94dac9780 0x55b94dacbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.170+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dacc310 con 0x55b94dac9780 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.170+0000 7f5ba522f640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b94dac9780 0x55b94dacbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.171+0000 7f5ba522f640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b94dac9780 0x55b94dacbc40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.171+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.171+0000 7f5ba522f640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5b90069040 0x7f5b9006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.171+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dacc310 con 0x7f5b90069040 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.171+0000 7f5ba6231640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5b90069040 0x7f5b9006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.171+0000 7f5ba6231640 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5b90069040 0x7f5b9006a940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.172+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5ba00083e0 con 0x7f5b90069040 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.172+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac4b30 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.172+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.172+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac0750 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.172+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba00083e0 con 0x55b94dac0750 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.172+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac0750 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.172+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.172+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac4b30 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.173+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.173+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac4b30 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.173+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.173+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x7f5b90069040 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.173+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba0026040 con 0x7f5b90069040 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.173+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac9780 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.173+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.173+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac0750 2024-09-10T05:11:47.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.173+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.173+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac4b30 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.174+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.174+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac0750 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.174+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.174+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x7f5b90069040 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.174+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5ba0026040 con 0x7f5b90069040 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.174+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac9780 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.175+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.175+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac9780 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.175+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.175+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac4b30 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.175+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.175+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac9780 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.175+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.175+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac9780 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.175+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.175+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac0750 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.176+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.176+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac0750 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.176+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.176+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac4b30 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.176+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.176+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac9780 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.176+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.176+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x7f5b90069040 2024-09-10T05:11:47.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.177+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba0026040 con 0x7f5b90069040 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.177+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac0750 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.177+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.177+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac4b30 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.177+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.177+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac9780 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.177+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.177+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac4b30 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.178+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.178+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x7f5b90069040 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.178+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba0026040 con 0x7f5b90069040 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.178+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac9780 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.178+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.178+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac4b30 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.178+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x55b94dac0750 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac4040 con 0x7f5b90069040 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba0026040 con 0x7f5b90069040 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac8040 con 0x55b94dac0750 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac8040 con 0x55b94dac0750 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.179+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac8010 con 0x7f5b90069040 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5ba0026040 con 0x7f5b90069040 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 20 zone default found 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 4 Realm: () 2024-09-10T05:11:47.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:47.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:47.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:47.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 20 zonegroup default 2024-09-10T05:11:47.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac8430 con 0x55b94dac4b30 2024-09-10T05:11:47.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94dac7f70 con 0x55b94dac9780 2024-09-10T05:11:47.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.180+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94dace180 con 0x55b94dac9780 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.181+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.181+0000 7f5ba7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.181+0000 7f5ba7f46800 20 started sync module instance, tier type = 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.181+0000 7f5ba7f46800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.181+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dacd620 con 0x7f5b90069040 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.182+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x7f5b90069040 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.182+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94254360484672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dacd620 con 0x7f5b90069040 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.182+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dacec20 con 0x55b94dac0750 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.183+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94254360484672] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x7f5b90069040 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.183+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.183+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94254360487696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dacd620 con 0x55b94dac0750 2024-09-10T05:11:47.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.183+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dacf6c0 con 0x55b94dac9780 2024-09-10T05:11:47.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.184+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.184+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94254360487696] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.184+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94254360482160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dacd590 con 0x55b94dac9780 2024-09-10T05:11:47.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.184+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad05b0 con 0x7f5b90069040 2024-09-10T05:11:47.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.185+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94254360482160] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.185+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x7f5b90069040 2024-09-10T05:11:47.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.185+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94254360494336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad09d0 con 0x7f5b90069040 2024-09-10T05:11:47.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.185+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad1390 con 0x55b94dac0750 2024-09-10T05:11:47.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.186+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.186+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94254360497888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad1300 con 0x55b94dac0750 2024-09-10T05:11:47.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.186+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad2300 con 0x55b94dac4b30 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.186+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94254360494336] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x7f5b90069040 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.187+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.187+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94254360501712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad26f0 con 0x55b94dac4b30 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.187+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad30b0 con 0x55b94dac4b30 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.187+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94254360497888] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.188+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94254360501712] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.188+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.188+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94254360500096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad30b0 con 0x55b94dac4b30 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.188+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad3950 con 0x55b94dac4b30 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.189+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94254360500096] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.189+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.189+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94254360505344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad30a0 con 0x55b94dac4b30 2024-09-10T05:11:47.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.189+0000 7f5ba7f46800 20 add_watcher() i=0 2024-09-10T05:11:47.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.189+0000 7f5ba7f46800 20 add_watcher() i=1 2024-09-10T05:11:47.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.189+0000 7f5ba7f46800 20 add_watcher() i=2 2024-09-10T05:11:47.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.189+0000 7f5ba7f46800 20 add_watcher() i=3 2024-09-10T05:11:47.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.189+0000 7f5ba7f46800 20 add_watcher() i=4 2024-09-10T05:11:47.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.189+0000 7f5ba7f46800 20 add_watcher() i=5 2024-09-10T05:11:47.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.189+0000 7f5ba7f46800 20 add_watcher() i=6 2024-09-10T05:11:47.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.190+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94254360505344] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.190+0000 7f5ba7f46800 20 add_watcher() i=7 2024-09-10T05:11:47.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.190+0000 7f5ba7f46800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:47.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.190+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad71d0 con 0x55b94dac0750 2024-09-10T05:11:47.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.190+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.190+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94254360509680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad45f0 con 0x55b94dac0750 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.191+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94254360509680] v35'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.191+0000 7f5a577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.191+0000 7f5ba7f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.191+0000 7f5ba7f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.191+0000 7f5ba7f46800 5 note: GC not initialized 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.191+0000 7f5a567fc640 20 reqs_thread_entry: start 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.192+0000 7f5ba7f46800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.192+0000 7f5ba7f46800 20 Filter name: none 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.192+0000 7f59c7fff640 20 reqs_thread_entry: start 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.192+0000 7f5ba7f46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.192+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b94db09c30 con 0x55b94dac0750 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.192+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.192+0000 7f5ba7f46800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:47.206 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:47.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.193+0000 7f5a577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.193+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94254360509680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94db085d0 con 0x55b94dac0750 2024-09-10T05:11:47.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.194+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94254360509680] v35'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.194+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94254360484672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad3cf0 con 0x7f5b90069040 2024-09-10T05:11:47.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.195+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94254360484672] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x7f5b90069040 2024-09-10T05:11:47.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.195+0000 7f5ba7f46800 20 remove_watcher() i=0 2024-09-10T05:11:47.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.195+0000 7f5ba7f46800 2 removed watcher, disabling cache 2024-09-10T05:11:47.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.195+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94254360487696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad3cf0 con 0x55b94dac0750 2024-09-10T05:11:47.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.196+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94254360487696] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.196+0000 7f5ba7f46800 20 remove_watcher() i=1 2024-09-10T05:11:47.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.196+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94254360482160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad3cf0 con 0x55b94dac9780 2024-09-10T05:11:47.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.197+0000 7f5ba522f640 1 -- 172.21.15.192:0/3177381955 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94254360482160] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b90057030 con 0x55b94dac9780 2024-09-10T05:11:47.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.197+0000 7f5ba7f46800 20 remove_watcher() i=2 2024-09-10T05:11:47.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.197+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94254360494336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dacd170 con 0x7f5b90069040 2024-09-10T05:11:47.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.198+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94254360494336] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x7f5b90069040 2024-09-10T05:11:47.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.198+0000 7f5ba7f46800 20 remove_watcher() i=3 2024-09-10T05:11:47.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.198+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94254360497888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad0100 con 0x55b94dac0750 2024-09-10T05:11:47.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.199+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94254360497888] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba0026040 con 0x55b94dac0750 2024-09-10T05:11:47.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.199+0000 7f5ba7f46800 20 remove_watcher() i=4 2024-09-10T05:11:47.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.199+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94254360501712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dacd170 con 0x55b94dac4b30 2024-09-10T05:11:47.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.200+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94254360501712] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.200+0000 7f5ba7f46800 20 remove_watcher() i=5 2024-09-10T05:11:47.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.200+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94254360500096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad0ee0 con 0x55b94dac4b30 2024-09-10T05:11:47.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.201+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94254360500096] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.201+0000 7f5ba7f46800 20 remove_watcher() i=6 2024-09-10T05:11:47.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.201+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94254360505344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b94dad0100 con 0x55b94dac4b30 2024-09-10T05:11:47.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba5a30640 1 -- 172.21.15.192:0/3177381955 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94254360505344] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b98077020 con 0x55b94dac4b30 2024-09-10T05:11:47.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 20 remove_watcher() i=7 2024-09-10T05:11:47.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b94dac4b30 msgr2=0x55b94dac6f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b94dac4b30 0x55b94dac6f20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b94dac0750 msgr2=0x55b94dac2c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b94dac0750 0x55b94dac2c10 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5b90069040 msgr2=0x7f5b9006a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5b90069040 0x7f5b9006a940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b94dac9780 msgr2=0x55b94dacbc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b94dac9780 0x55b94dacbc40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a7003c780 msgr2=0x7f5a7003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a7003c780 0x7f5a7003ec40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b90000c00 tx=0x7f5b90053000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 msgr2=0x55b94dab51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba6231640 1 -- 172.21.15.192:0/3177381955 reap_dead start 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 0x55b94dab51f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5b98012fd0 tx=0x7f5b98033f40 comp rx=0 tx=0).stop 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 shutdown_connections 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/3177381955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daaddf0 0x55b94dab51f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 >> 172.21.15.192:0/3177381955 conn(0x55b94daaa1f0 msgr2=0x55b94daa8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 shutdown_connections 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.202+0000 7f5ba7f46800 1 -- 172.21.15.192:0/3177381955 wait complete. 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/4038768723 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a8003c730 msgr2=0x7f5a8003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/4038768723 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a8003c730 0x7f5a8003ebf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55b94da8fb50 tx=0x7f5b90005ac0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/4038768723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daa13b0 msgr2=0x55b94daa17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/4038768723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daa13b0 0x55b94daa17d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5b98002170 tx=0x7f5b9804b260 comp rx=0 tx=0).stop 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/4038768723 shutdown_connections 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/4038768723 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a8003c730 0x7f5a8003ebf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/4038768723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94daa13b0 0x55b94daa17d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/4038768723 >> 172.21.15.192:0/4038768723 conn(0x55b94da95760 msgr2=0x55b94da95b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/4038768723 shutdown_connections 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/4038768723 wait complete. 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b94da8cba0 msgr2=0x55b94da8f020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b94da8cba0 0x55b94da8f020 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b94d98a660 msgr2=0x55b94da8a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b94d98a660 0x55b94da8a800 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b94da90c10 msgr2=0x55b94da93000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b94da90c10 0x55b94da93000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a8c03c780 msgr2=0x7f5a8c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a8c03c780 0x7f5a8c03ec40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5b90057000 tx=0x7f5b90052000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 msgr2=0x55b94da831b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 --2- 172.21.15.192:0/2501964598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b94d989450 0x55b94da831b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5b98000f80 tx=0x7f5b98001250 comp rx=0 tx=0).stop 2024-09-10T05:11:47.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba6231640 1 -- 172.21.15.192:0/2501964598 reap_dead start 2024-09-10T05:11:47.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 shutdown_connections 2024-09-10T05:11:47.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 >> 172.21.15.192:0/2501964598 conn(0x55b94d983920 msgr2=0x55b94da72710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 shutdown_connections 2024-09-10T05:11:47.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.203+0000 7f5ba7f46800 1 -- 172.21.15.192:0/2501964598 wait complete. 2024-09-10T05:11:47.217 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:47.217 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-10T05:11:47.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-10T05:11:47.217 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-10T05:11:47.266 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:47.266 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:47.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.266+0000 7f4a8dbaf800 1 Processor -- start 2024-09-10T05:11:47.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.266+0000 7f4a8dbaf800 1 -- start start 2024-09-10T05:11:47.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.266+0000 7f4a8dbaf800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b99e6347d0 0x55b99e63c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.266+0000 7f4a8dbaf800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b99e4dfe40 con 0x55b99e634260 2024-09-10T05:11:47.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.266+0000 7f4a8dbaf800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55b99e4aa680 con 0x55b99e6347d0 2024-09-10T05:11:47.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.266+0000 7f4a8ae98640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b99e6347d0 0x55b99e63c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.266+0000 7f4a8b699640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55b99e634260 0x55b99e638f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36240/0 (socket says 172.21.15.192:36240) 2024-09-10T05:11:47.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.266+0000 7f4a8b699640 1 -- 172.21.15.192:0/3782379300 learned_addr learned my addr 172.21.15.192:0/3782379300 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:47.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.267+0000 7f4a8ae98640 1 -- 172.21.15.192:0/3782379300 >> v1:172.21.15.139:6789/0 conn(0x55b99e634260 legacy=0x55b99e638f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.267+0000 7f4a8a697640 1 -- 172.21.15.192:0/3782379300 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72528164 0 0) 0x55b99e4dfe40 con 0x55b99e634260 2024-09-10T05:11:47.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.267+0000 7f4a8ae98640 1 -- 172.21.15.192:0/3782379300 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99e4c66b0 con 0x55b99e6347d0 2024-09-10T05:11:47.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.268+0000 7f4a8ae98640 1 --2- 172.21.15.192:0/3782379300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e6347d0 0x55b99e63c6d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400a470 tx=0x7f4a74045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c701a7955f59b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.269+0000 7f4a8a697640 1 -- 172.21.15.192:0/3782379300 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a74053570 con 0x55b99e6347d0 2024-09-10T05:11:47.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.269+0000 7f4a8a697640 1 -- 172.21.15.192:0/3782379300 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a74058070 con 0x55b99e6347d0 2024-09-10T05:11:47.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.269+0000 7f4a8a697640 1 -- 172.21.15.192:0/3782379300 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a74053880 con 0x55b99e6347d0 2024-09-10T05:11:47.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.269+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/3782379300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e6347d0 msgr2=0x55b99e63c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.269+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/3782379300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e6347d0 0x55b99e63c6d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400a470 tx=0x7f4a74045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:47.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.269+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/3782379300 shutdown_connections 2024-09-10T05:11:47.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.269+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/3782379300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e6347d0 0x55b99e63c6d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.269+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/3782379300 >> 172.21.15.192:0/3782379300 conn(0x55b99e62f940 msgr2=0x55b99e631dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.269+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/3782379300 shutdown_connections 2024-09-10T05:11:47.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.269+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/3782379300 wait complete. 2024-09-10T05:11:47.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.283+0000 7f4a8dbaf800 1 Processor -- start 2024-09-10T05:11:47.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.283+0000 7f4a8dbaf800 1 -- start start 2024-09-10T05:11:47.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.283+0000 7f4a8dbaf800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 0x55b99e7255a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.283+0000 7f4a8dbaf800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b99e4cedd0 con 0x55b99e634260 2024-09-10T05:11:47.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.283+0000 7f4a8b699640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 0x55b99e7255a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.283+0000 7f4a8b699640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 0x55b99e7255a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59412/0 (socket says 172.21.15.192:59412) 2024-09-10T05:11:47.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.283+0000 7f4a8b699640 1 -- 172.21.15.192:0/3474420144 learned_addr learned my addr 172.21.15.192:0/3474420144 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.284+0000 7f4a8b699640 1 -- 172.21.15.192:0/3474420144 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99e4e7e10 con 0x55b99e634260 2024-09-10T05:11:47.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.284+0000 7f4a8b699640 1 --2- 172.21.15.192:0/3474420144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 0x55b99e7255a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c001ea0 tx=0x7f4a7c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7d0ab998a5685d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.284+0000 7f497960a640 1 -- 172.21.15.192:0/3474420144 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7c008070 con 0x55b99e634260 2024-09-10T05:11:47.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.284+0000 7f497960a640 1 -- 172.21.15.192:0/3474420144 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7c00d500 con 0x55b99e634260 2024-09-10T05:11:47.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.284+0000 7f497960a640 1 -- 172.21.15.192:0/3474420144 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7c00d880 con 0x55b99e634260 2024-09-10T05:11:47.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/3474420144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 msgr2=0x55b99e7255a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/3474420144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 0x55b99e7255a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c001ea0 tx=0x7f4a7c00b6a0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/3474420144 shutdown_connections 2024-09-10T05:11:47.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/3474420144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 0x55b99e7255a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/3474420144 >> 172.21.15.192:0/3474420144 conn(0x55b99e62f940 msgr2=0x55b99e720f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/3474420144 shutdown_connections 2024-09-10T05:11:47.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/3474420144 wait complete. 2024-09-10T05:11:47.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8dbaf800 1 Processor -- start 2024-09-10T05:11:47.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8dbaf800 1 -- start start 2024-09-10T05:11:47.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8dbaf800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 0x55b99e72ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8dbaf800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b99e63d050 con 0x55b99e634260 2024-09-10T05:11:47.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8b699640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 0x55b99e72ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8b699640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 0x55b99e72ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59428/0 (socket says 172.21.15.192:59428) 2024-09-10T05:11:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.285+0000 7f4a8b699640 1 -- 172.21.15.192:0/2225598803 learned_addr learned my addr 172.21.15.192:0/2225598803 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.286+0000 7f4a8b699640 1 -- 172.21.15.192:0/2225598803 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99e72d3f0 con 0x55b99e634260 2024-09-10T05:11:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.286+0000 7f4a8b699640 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 0x55b99e72ce90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c000f60 tx=0x7f4a7c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.286+0000 7f4977e07640 1 -- 172.21.15.192:0/2225598803 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7c00f8d0 con 0x55b99e634260 2024-09-10T05:11:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.286+0000 7f4977e07640 1 -- 172.21.15.192:0/2225598803 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7c00fa70 con 0x55b99e634260 2024-09-10T05:11:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.286+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b99e72d680 con 0x55b99e634260 2024-09-10T05:11:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.286+0000 7f4977e07640 1 -- 172.21.15.192:0/2225598803 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7c00fd50 con 0x55b99e634260 2024-09-10T05:11:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.286+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b99e72e080 con 0x55b99e634260 2024-09-10T05:11:47.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.287+0000 7f4977e07640 1 -- 172.21.15.192:0/2225598803 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4a7c017040 con 0x55b99e634260 2024-09-10T05:11:47.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.287+0000 7f4977e07640 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f497003c780 0x7f497003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.287+0000 7f4977e07640 1 -- 172.21.15.192:0/2225598803 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f4a7c015020 con 0x55b99e634260 2024-09-10T05:11:47.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.287+0000 7f4a8ae98640 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f497003c780 0x7f497003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.287+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b99e6347d0 0x55b99e7344e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.287+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e734a20 con 0x55b99e6347d0 2024-09-10T05:11:47.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.287+0000 7f4a8be9a640 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b99e6347d0 0x55b99e7344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.288+0000 7f4a8ae98640 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f497003c780 0x7f497003ec40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a74057000 tx=0x7f4a74052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.288+0000 7f4a8be9a640 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b99e6347d0 0x55b99e7344e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.288+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2225598803 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e6347d0 2024-09-10T05:11:47.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.288+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e734dc0 con 0x55b99e6347d0 2024-09-10T05:11:47.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.288+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2225598803 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e6347d0 2024-09-10T05:11:47.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.288+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b99e736880 0x55b99e738d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.288+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e739490 con 0x55b99e736880 2024-09-10T05:11:47.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.288+0000 7f4a8b699640 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b99e736880 0x55b99e738d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.289+0000 7f4a8b699640 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b99e736880 0x55b99e738d00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.289+0000 7f4a8b699640 1 -- 172.21.15.192:0/2225598803 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4a7c02d070 con 0x55b99e736880 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.289+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e735610 con 0x55b99e6347d0 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.289+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2225598803 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e6347d0 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.289+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b99e73a8f0 0x55b99e73cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.289+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e73d3d0 con 0x55b99e73a8f0 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.289+0000 7f4a8ae98640 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b99e73a8f0 0x55b99e73cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.290+0000 7f4a8ae98640 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b99e73a8f0 0x55b99e73cce0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.290+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2225598803 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4a74051070 con 0x55b99e73a8f0 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.290+0000 7f4a8dbaf800 1 Processor -- start 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.290+0000 7f4a8dbaf800 1 -- start start 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.290+0000 7f4a8dbaf800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e74b030 0x55b99e74b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.290+0000 7f4a8dbaf800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b99e52ca00 con 0x55b99e74b030 2024-09-10T05:11:47.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.291+0000 7f4a8b699640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e74b030 0x55b99e74b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.291+0000 7f4a8b699640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e74b030 0x55b99e74b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59434/0 (socket says 172.21.15.192:59434) 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.291+0000 7f4a8b699640 1 -- 172.21.15.192:0/4017151800 learned_addr learned my addr 172.21.15.192:0/4017151800 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.291+0000 7f4a8b699640 1 -- 172.21.15.192:0/4017151800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99e74ba90 con 0x55b99e74b030 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.291+0000 7f4a8b699640 1 --2- 172.21.15.192:0/4017151800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e74b030 0x55b99e74b450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00b6e0 tx=0x7f4a7c052e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.291+0000 7f4975602640 1 -- 172.21.15.192:0/4017151800 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7c018880 con 0x55b99e74b030 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.291+0000 7f4975602640 1 -- 172.21.15.192:0/4017151800 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7c019d10 con 0x55b99e74b030 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.291+0000 7f4975602640 1 -- 172.21.15.192:0/4017151800 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7c0441a0 con 0x55b99e74b030 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.291+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/4017151800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b99e74c2c0 con 0x55b99e74b030 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.291+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/4017151800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b99e74c860 con 0x55b99e74b030 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.292+0000 7f4975602640 1 -- 172.21.15.192:0/4017151800 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4a7c044340 con 0x55b99e74b030 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.292+0000 7f4975602640 1 --2- 172.21.15.192:0/4017151800 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f496403c920 0x7f496403ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.292+0000 7f4975602640 1 -- 172.21.15.192:0/4017151800 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f4a7c03d470 con 0x55b99e74b030 2024-09-10T05:11:47.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.292+0000 7f4a8ae98640 1 --2- 172.21.15.192:0/4017151800 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f496403c920 0x7f496403ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.292+0000 7f4a8dbaf800 1 Processor -- start 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.293+0000 7f4a8ae98640 1 --2- 172.21.15.192:0/4017151800 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f496403c920 0x7f496403ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55b99e72ef70 tx=0x7f4a74005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.293+0000 7f4a8dbaf800 1 -- start start 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.293+0000 7f4a8dbaf800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 0x55b99e635350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.293+0000 7f4a8dbaf800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b99e725df0 con 0x55b99e634f50 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.293+0000 7f4a8b699640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 0x55b99e635350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.293+0000 7f4a8b699640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 0x55b99e635350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59442/0 (socket says 172.21.15.192:59442) 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.293+0000 7f4a8b699640 1 -- 172.21.15.192:0/2315188848 learned_addr learned my addr 172.21.15.192:0/2315188848 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.293+0000 7f4a8b699640 1 -- 172.21.15.192:0/2315188848 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99e635940 con 0x55b99e634f50 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.293+0000 7f4a8b699640 1 --2- 172.21.15.192:0/2315188848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 0x55b99e635350 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c02fb30 tx=0x7f4a7c01a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af862a4ae46f5bea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.293+0000 7f496effd640 1 -- 172.21.15.192:0/2315188848 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7c026d50 con 0x55b99e634f50 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.293+0000 7f496effd640 1 -- 172.21.15.192:0/2315188848 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7c019470 con 0x55b99e634f50 2024-09-10T05:11:47.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.293+0000 7f496effd640 1 -- 172.21.15.192:0/2315188848 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7c0448e0 con 0x55b99e634f50 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.294+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2315188848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 msgr2=0x55b99e635350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.294+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2315188848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 0x55b99e635350 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c02fb30 tx=0x7f4a7c01a480 comp rx=0 tx=0).stop 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.294+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2315188848 shutdown_connections 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.294+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2315188848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 0x55b99e635350 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.294+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2315188848 >> 172.21.15.192:0/2315188848 conn(0x55b99e753e30 msgr2=0x55b99e752070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.294+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2315188848 shutdown_connections 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.294+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2315188848 wait complete. 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.294+0000 7f4a8dbaf800 1 Processor -- start 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.294+0000 7f4a8dbaf800 1 -- start start 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.294+0000 7f4a8dbaf800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 0x55b99e760ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.294+0000 7f4a8dbaf800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b99e635e30 con 0x55b99e634f50 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.295+0000 7f4a8b699640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 0x55b99e760ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.295+0000 7f4a8b699640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 0x55b99e760ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59448/0 (socket says 172.21.15.192:59448) 2024-09-10T05:11:47.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.295+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 learned_addr learned my addr 172.21.15.192:0/2529051206 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.295+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b99e761550 con 0x55b99e634f50 2024-09-10T05:11:47.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.295+0000 7f4a8b699640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 0x55b99e760ff0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c01a570 tx=0x7f4a7c03b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.295+0000 7f496d7fa640 1 -- 172.21.15.192:0/2529051206 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7c065070 con 0x55b99e634f50 2024-09-10T05:11:47.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.295+0000 7f496d7fa640 1 -- 172.21.15.192:0/2529051206 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7c044a10 con 0x55b99e634f50 2024-09-10T05:11:47.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.295+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b99e761550 con 0x55b99e634f50 2024-09-10T05:11:47.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.295+0000 7f496d7fa640 1 -- 172.21.15.192:0/2529051206 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7c026560 con 0x55b99e634f50 2024-09-10T05:11:47.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.295+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b99e761550 con 0x55b99e634f50 2024-09-10T05:11:47.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.296+0000 7f496d7fa640 1 -- 172.21.15.192:0/2529051206 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4a7c068070 con 0x55b99e634f50 2024-09-10T05:11:47.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.296+0000 7f496d7fa640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f495403c730 0x7f495403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.296+0000 7f496d7fa640 1 -- 172.21.15.192:0/2529051206 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f4a7c06bc90 con 0x55b99e634f50 2024-09-10T05:11:47.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.296+0000 7f4a8ae98640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f495403c730 0x7f495403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.297+0000 7f4a8ae98640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f495403c730 0x7f495403ebf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4a74000c00 tx=0x7f4a74053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.297+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.297+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b99e76c5b0 0x55b99e76ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.297+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e76f1c0 con 0x55b99e76c5b0 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.297+0000 7f4a8be9a640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b99e76c5b0 0x55b99e76ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.297+0000 7f4a8be9a640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b99e76c5b0 0x55b99e76ea70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 20 realm 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e76f5d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e76fea0 con 0x55b99e76c5b0 2024-09-10T05:11:47.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e76c5b0 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b99e770fa0 0x55b99e773390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.298+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7739e0 con 0x55b99e770fa0 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.299+0000 7f4a8b699640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b99e770fa0 0x55b99e773390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.299+0000 7f4a8b699640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b99e770fa0 0x55b99e773390 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.299+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.299+0000 7f4a8dbaf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:47.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.299+0000 7f4a8dbaf800 20 searching for the correct realm 2024-09-10T05:11:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.299+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b99e7759b0 0x55b99e777e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.299+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7784f0 con 0x55b99e7759b0 2024-09-10T05:11:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.299+0000 7f4a8ae98640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b99e7759b0 0x55b99e777e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.300+0000 7f4a8ae98640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b99e7759b0 0x55b99e777e70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.300+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.300+0000 7f4a8ae98640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f4a7405f040 0x7f4a7406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.300+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7784f0 con 0x7f4a7405f040 2024-09-10T05:11:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.300+0000 7f4a8be9a640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f4a7405f040 0x7f4a7406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.300+0000 7f4a8be9a640 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f4a7405f040 0x7f4a7406b410 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.301+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.301+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e770fa0 2024-09-10T05:11:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.301+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.301+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e76c5b0 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.301+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.301+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e76c5b0 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.301+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.301+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e770fa0 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.302+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.302+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e770fa0 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.302+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.302+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x7f4a7405f040 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.302+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.302+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e7759b0 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.302+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.302+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e76c5b0 2024-09-10T05:11:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.303+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.303+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e770fa0 2024-09-10T05:11:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.303+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.303+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e76c5b0 2024-09-10T05:11:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.303+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.303+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x7f4a7405f040 2024-09-10T05:11:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.303+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.303+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e7759b0 2024-09-10T05:11:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.303+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.304+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e7759b0 2024-09-10T05:11:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.304+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.304+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e770fa0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.304+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.304+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e7759b0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.304+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.304+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e7759b0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.304+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.304+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e76c5b0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.305+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.305+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e76c5b0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.305+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.305+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e770fa0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.305+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.305+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e7759b0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.305+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.305+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x7f4a7405f040 2024-09-10T05:11:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.305+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.305+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e76c5b0 2024-09-10T05:11:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.306+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.306+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e770fa0 2024-09-10T05:11:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.306+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.306+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e7759b0 2024-09-10T05:11:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.306+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.306+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e770fa0 2024-09-10T05:11:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.306+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.307+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x7f4a7405f040 2024-09-10T05:11:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.307+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.307+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e7759b0 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.307+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.307+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e770fa0 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.307+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.307+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x55b99e76c5b0 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b99e770240 con 0x7f4a7405f040 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:47.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7742a0 con 0x55b99e76c5b0 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7742a0 con 0x55b99e76c5b0 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.308+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7742a0 con 0x7f4a7405f040 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:47.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 20 zone default found 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 4 Realm: () 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 20 zonegroup default 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e774740 con 0x55b99e770fa0 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77a360 con 0x55b99e7759b0 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77a700 con 0x55b99e7759b0 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 20 started sync module instance, tier type = 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.309+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e779800 con 0x7f4a7405f040 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.310+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.310+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94255715949600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e779800 con 0x7f4a7405f040 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.310+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77af50 con 0x55b99e76c5b0 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.311+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94255715949600] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.312+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.312+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94255715953792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e779800 con 0x55b99e76c5b0 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.312+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77b9d0 con 0x55b99e7759b0 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.313+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.313+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94255715955936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77c270 con 0x55b99e7759b0 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.313+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77cd60 con 0x7f4a7405f040 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.313+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94255715953792] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.314+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.314+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94255715960880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77d150 con 0x7f4a7405f040 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.314+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77db50 con 0x55b99e76c5b0 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.314+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94255715955936] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.315+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94255715960880] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.315+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.315+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94255715947344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77d660 con 0x55b99e76c5b0 2024-09-10T05:11:47.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.315+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77e3f0 con 0x55b99e770fa0 2024-09-10T05:11:47.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.316+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94255715947344] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.316+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.316+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94255715958208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77d660 con 0x55b99e770fa0 2024-09-10T05:11:47.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.316+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77ee10 con 0x55b99e770fa0 2024-09-10T05:11:47.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.317+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94255715958208] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.317+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.317+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94255715966784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e77f6b0 con 0x55b99e770fa0 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.317+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e780070 con 0x55b99e770fa0 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.318+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94255715966784] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.318+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.318+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94255715974080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e780490 con 0x55b99e770fa0 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.318+0000 7f4a8dbaf800 20 add_watcher() i=0 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.318+0000 7f4a8dbaf800 20 add_watcher() i=1 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.318+0000 7f4a8dbaf800 20 add_watcher() i=2 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.318+0000 7f4a8dbaf800 20 add_watcher() i=3 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.318+0000 7f4a8dbaf800 20 add_watcher() i=4 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.318+0000 7f4a8dbaf800 20 add_watcher() i=5 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.318+0000 7f4a8dbaf800 20 add_watcher() i=6 2024-09-10T05:11:47.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.319+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94255715974080] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.319+0000 7f4a8dbaf800 20 add_watcher() i=7 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.319+0000 7f4a8dbaf800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.319+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e783730 con 0x55b99e76c5b0 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.319+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.319+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94255715975504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e780a20 con 0x55b99e76c5b0 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.320+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94255715975504] v35'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.320+0000 7f4941fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.320+0000 7f4a8dbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.320+0000 7f4a8dbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.320+0000 7f4a8dbaf800 5 note: GC not initialized 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.320+0000 7f4940fe1640 20 reqs_thread_entry: start 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8dbaf800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:47.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8dbaf800 20 Filter name: none 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f48ba7fc640 20 reqs_thread_entry: start 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8dbaf800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7b68e0 con 0x55b99e76c5b0 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8dbaf800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8dbaf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8dbaf800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8dbaf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8dbaf800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8dbaf800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.321+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7b71f0 con 0x55b99e770fa0 2024-09-10T05:11:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.322+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.322+0000 7f4a8dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.322+0000 7f4a8dbaf800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.322+0000 7f4a8dbaf800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.322+0000 7f4a8dbaf800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.322+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7bcba0 con 0x55b99e76c5b0 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.323+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v35'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.323+0000 7f4a8dbaf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.323+0000 7f4a8dbaf800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.323+0000 7f4a8dbaf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.323+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94255716222368 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7b8280 con 0x55b99e76c5b0 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.323+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 94255715947344 notify 150323855363 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f4a84018d20 con 0x55b99e76c5b0 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.323+0000 7f496effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855363 cookie 94255715947344 notifier 4350 bl.length()=678 2024-09-10T05:11:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.323+0000 7f496effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.323+0000 7f496effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.323+0000 7f496effd640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4950003ea0 con 0x55b99e76c5b0 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.323+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(65 notify.4 [notify cookie 94255716222368 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.324+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.324+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== watch-notify(notify_complete (2) cookie 94255716222368 notify 150323855363 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4a84045430 con 0x55b99e76c5b0 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.324+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7bc5a0 con 0x55b99e770fa0 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.325+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.325+0000 7f4a8dbaf800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.325+0000 7f4a8dbaf800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.325+0000 7f4a8dbaf800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.325+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94255716222368 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7b7dd0 con 0x55b99e7759b0 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.325+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== watch-notify(notify (1) cookie 94255715955936 notify 150323855360 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55b99e4c66b0 con 0x55b99e7759b0 2024-09-10T05:11:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.325+0000 7f496e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855360 cookie 94255715955936 notifier 4350 bl.length()=177 2024-09-10T05:11:47.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.325+0000 7f496e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:11:47.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.325+0000 7f496e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:11:47.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.325+0000 7f496e7fc640 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f48c0003400 con 0x55b99e7759b0 2024-09-10T05:11:47.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.325+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(68 notify.2 [notify cookie 94255716222368 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.326+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== watch-notify(notify_complete (2) cookie 94255716222368 notify 150323855360 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4a74075c70 con 0x55b99e7759b0 2024-09-10T05:11:47.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.326+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.340 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T05:11:47.323053Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:47.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.327+0000 7f4941fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.327+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94255715975504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7bb210 con 0x55b99e76c5b0 2024-09-10T05:11:47.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.328+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94255715975504] v35'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.328+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94255715949600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7b46f0 con 0x7f4a7405f040 2024-09-10T05:11:47.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.329+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94255715949600] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.329+0000 7f4a8dbaf800 20 remove_watcher() i=0 2024-09-10T05:11:47.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.329+0000 7f4a8dbaf800 2 removed watcher, disabling cache 2024-09-10T05:11:47.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.329+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94255715953792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7b46f0 con 0x55b99e76c5b0 2024-09-10T05:11:47.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.330+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94255715953792] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.330+0000 7f4a8dbaf800 20 remove_watcher() i=1 2024-09-10T05:11:47.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.330+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94255715955936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7b46f0 con 0x55b99e7759b0 2024-09-10T05:11:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.331+0000 7f4a8ae98640 1 -- 172.21.15.192:0/2529051206 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94255715955936] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7407c040 con 0x55b99e7759b0 2024-09-10T05:11:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.331+0000 7f4a8dbaf800 20 remove_watcher() i=2 2024-09-10T05:11:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.331+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94255715960880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7b46f0 con 0x7f4a7405f040 2024-09-10T05:11:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.331+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94255715960880] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x7f4a7405f040 2024-09-10T05:11:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.332+0000 7f4a8dbaf800 20 remove_watcher() i=3 2024-09-10T05:11:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.332+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94255715947344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7b46f0 con 0x55b99e76c5b0 2024-09-10T05:11:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.332+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94255715947344] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8400a4d0 con 0x55b99e76c5b0 2024-09-10T05:11:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.332+0000 7f4a8dbaf800 20 remove_watcher() i=4 2024-09-10T05:11:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.332+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94255715958208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7b46f0 con 0x55b99e770fa0 2024-09-10T05:11:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.333+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94255715958208] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.333+0000 7f4a8dbaf800 20 remove_watcher() i=5 2024-09-10T05:11:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.333+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94255715966784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7b46f0 con 0x55b99e770fa0 2024-09-10T05:11:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.334+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94255715966784] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.334+0000 7f4a8dbaf800 20 remove_watcher() i=6 2024-09-10T05:11:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.334+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94255715974080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b99e7b46f0 con 0x55b99e770fa0 2024-09-10T05:11:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8b699640 1 -- 172.21.15.192:0/2529051206 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94255715974080] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c071070 con 0x55b99e770fa0 2024-09-10T05:11:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 20 remove_watcher() i=7 2024-09-10T05:11:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b99e770fa0 msgr2=0x55b99e773390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b99e770fa0 0x55b99e773390 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b99e76c5b0 msgr2=0x55b99e76ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b99e76c5b0 0x55b99e76ea70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f4a7405f040 msgr2=0x7f4a7406b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f4a7405f040 0x7f4a7406b410 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b99e7759b0 msgr2=0x55b99e777e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b99e7759b0 0x55b99e777e70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f495403c730 msgr2=0x7f495403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f495403c730 0x7f495403ebf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4a74000c00 tx=0x7f4a74053000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 msgr2=0x55b99e760ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2529051206 reap_dead start 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.335+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 0x55b99e760ff0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c01a570 tx=0x7f4a7c03b7b0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 shutdown_connections 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2529051206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634f50 0x55b99e760ff0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 >> 172.21.15.192:0/2529051206 conn(0x55b99e753e30 msgr2=0x55b99e752040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 shutdown_connections 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2529051206 wait complete. 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/4017151800 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f496403c920 msgr2=0x7f496403ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/4017151800 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f496403c920 0x7f496403ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55b99e72ef70 tx=0x7f4a74005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/4017151800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e74b030 msgr2=0x55b99e74b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/4017151800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e74b030 0x55b99e74b450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00b6e0 tx=0x7f4a7c052e30 comp rx=0 tx=0).stop 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/4017151800 shutdown_connections 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/4017151800 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f496403c920 0x7f496403ede0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/4017151800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e74b030 0x55b99e74b450 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/4017151800 >> 172.21.15.192:0/4017151800 conn(0x55b99e73f3e0 msgr2=0x55b99e73f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/4017151800 shutdown_connections 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/4017151800 wait complete. 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b99e736880 msgr2=0x55b99e738d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b99e736880 0x55b99e738d00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b99e6347d0 msgr2=0x55b99e7344e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b99e6347d0 0x55b99e7344e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b99e73a8f0 msgr2=0x55b99e73cce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b99e73a8f0 0x55b99e73cce0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f497003c780 msgr2=0x7f497003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f497003c780 0x7f497003ec40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a74057000 tx=0x7f4a74052000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 msgr2=0x55b99e72ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.336+0000 7f4a8dbaf800 1 --2- 172.21.15.192:0/2225598803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b99e634260 0x55b99e72ce90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c000f60 tx=0x7f4a7c000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.337+0000 7f4a8be9a640 1 -- 172.21.15.192:0/2225598803 reap_dead start 2024-09-10T05:11:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.337+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 shutdown_connections 2024-09-10T05:11:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.337+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 >> 172.21.15.192:0/2225598803 conn(0x55b99e62f940 msgr2=0x55b99e726880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.337+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 shutdown_connections 2024-09-10T05:11:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.337+0000 7f4a8dbaf800 1 -- 172.21.15.192:0/2225598803 wait complete. 2024-09-10T05:11:47.351 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T05:11:47.323053Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:47.352 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:11:47.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:11:47.352 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:11:47.396 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:47.396 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:47.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.396+0000 7f834aabb800 1 Processor -- start 2024-09-10T05:11:47.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.396+0000 7f834aabb800 1 -- start start 2024-09-10T05:11:47.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.396+0000 7f834aabb800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5644d510c200 0x5644d510e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.396+0000 7f834aabb800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5644d4fb1e40 con 0x5644d5108690 2024-09-10T05:11:47.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.396+0000 7f834aabb800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5644d4f7c680 con 0x5644d510c200 2024-09-10T05:11:47.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.396+0000 7f833ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5644d510c200 0x5644d510e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.396+0000 7f83485a5640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5644d5108690 0x5644d510aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36252/0 (socket says 172.21.15.192:36252) 2024-09-10T05:11:47.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.397+0000 7f83485a5640 1 -- 172.21.15.192:0/2026663334 learned_addr learned my addr 172.21.15.192:0/2026663334 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:47.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.397+0000 7f833ffff640 1 -- 172.21.15.192:0/2026663334 >> v1:172.21.15.139:6789/0 conn(0x5644d5108690 legacy=0x5644d510aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.397+0000 7f833ffff640 1 -- 172.21.15.192:0/2026663334 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d4f986b0 con 0x5644d510c200 2024-09-10T05:11:47.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.397+0000 7f8347da4640 1 -- 172.21.15.192:0/2026663334 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122779760 0 0) 0x5644d4fb1e40 con 0x5644d5108690 2024-09-10T05:11:47.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.399+0000 7f833ffff640 1 --2- 172.21.15.192:0/2026663334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d510c200 0x5644d510e6c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f833000a470 tx=0x7f8330045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671a128aa507ed89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.399+0000 7f8347da4640 1 -- 172.21.15.192:0/2026663334 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8330053570 con 0x5644d510c200 2024-09-10T05:11:47.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.399+0000 7f8347da4640 1 -- 172.21.15.192:0/2026663334 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8330058070 con 0x5644d510c200 2024-09-10T05:11:47.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.399+0000 7f8347da4640 1 -- 172.21.15.192:0/2026663334 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8330053880 con 0x5644d510c200 2024-09-10T05:11:47.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.399+0000 7f834aabb800 1 -- 172.21.15.192:0/2026663334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d510c200 msgr2=0x5644d510e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.399+0000 7f834aabb800 1 --2- 172.21.15.192:0/2026663334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d510c200 0x5644d510e6c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f833000a470 tx=0x7f8330045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:47.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.399+0000 7f834aabb800 1 -- 172.21.15.192:0/2026663334 shutdown_connections 2024-09-10T05:11:47.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.399+0000 7f834aabb800 1 --2- 172.21.15.192:0/2026663334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d510c200 0x5644d510e6c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.399+0000 7f834aabb800 1 -- 172.21.15.192:0/2026663334 >> 172.21.15.192:0/2026663334 conn(0x5644d51021f0 msgr2=0x5644d5104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.399+0000 7f834aabb800 1 -- 172.21.15.192:0/2026663334 shutdown_connections 2024-09-10T05:11:47.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.399+0000 7f834aabb800 1 -- 172.21.15.192:0/2026663334 wait complete. 2024-09-10T05:11:47.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.413+0000 7f834aabb800 1 Processor -- start 2024-09-10T05:11:47.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.413+0000 7f834aabb800 1 -- start start 2024-09-10T05:11:47.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.413+0000 7f834aabb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d5108690 0x5644d5107e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.413+0000 7f834aabb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5644d4fa0dd0 con 0x5644d5108690 2024-09-10T05:11:47.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.414+0000 7f83485a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d5108690 0x5644d5107e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.414+0000 7f83485a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d5108690 0x5644d5107e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59464/0 (socket says 172.21.15.192:59464) 2024-09-10T05:11:47.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.414+0000 7f83485a5640 1 -- 172.21.15.192:0/4105724631 learned_addr learned my addr 172.21.15.192:0/4105724631 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.414+0000 7f83485a5640 1 -- 172.21.15.192:0/4105724631 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d4fb9e10 con 0x5644d5108690 2024-09-10T05:11:47.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.414+0000 7f83485a5640 1 --2- 172.21.15.192:0/4105724631 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d5108690 0x5644d5107e20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8338001ea0 tx=0x7f833800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec7d23b4659f82c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.414+0000 7f823660c640 1 -- 172.21.15.192:0/4105724631 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338008070 con 0x5644d5108690 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.414+0000 7f823660c640 1 -- 172.21.15.192:0/4105724631 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f833800d500 con 0x5644d5108690 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.414+0000 7f823660c640 1 -- 172.21.15.192:0/4105724631 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f833800d880 con 0x5644d5108690 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.415+0000 7f834aabb800 1 -- 172.21.15.192:0/4105724631 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d5108690 msgr2=0x5644d5107e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.415+0000 7f834aabb800 1 --2- 172.21.15.192:0/4105724631 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d5108690 0x5644d5107e20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8338001ea0 tx=0x7f833800b6a0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.415+0000 7f834aabb800 1 -- 172.21.15.192:0/4105724631 shutdown_connections 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.415+0000 7f834aabb800 1 --2- 172.21.15.192:0/4105724631 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d5108690 0x5644d5107e20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.415+0000 7f834aabb800 1 -- 172.21.15.192:0/4105724631 >> 172.21.15.192:0/4105724631 conn(0x5644d51021f0 msgr2=0x5644d51f2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.415+0000 7f834aabb800 1 -- 172.21.15.192:0/4105724631 shutdown_connections 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.415+0000 7f834aabb800 1 -- 172.21.15.192:0/4105724631 wait complete. 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.415+0000 7f834aabb800 1 Processor -- start 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f834aabb800 1 -- start start 2024-09-10T05:11:47.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f834aabb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d510c200 0x5644d5201200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f834aabb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5644d510f040 con 0x5644d510c200 2024-09-10T05:11:47.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f83485a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d510c200 0x5644d5201200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f83485a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d510c200 0x5644d5201200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59480/0 (socket says 172.21.15.192:59480) 2024-09-10T05:11:47.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f83485a5640 1 -- 172.21.15.192:0/824682986 learned_addr learned my addr 172.21.15.192:0/824682986 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f83485a5640 1 -- 172.21.15.192:0/824682986 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d5201760 con 0x5644d510c200 2024-09-10T05:11:47.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f83485a5640 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d510c200 0x5644d5201200 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f83380012f0 tx=0x7f8338000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f8234e09640 1 -- 172.21.15.192:0/824682986 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f833800de50 con 0x5644d510c200 2024-09-10T05:11:47.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f8234e09640 1 -- 172.21.15.192:0/824682986 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f833800f930 con 0x5644d510c200 2024-09-10T05:11:47.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644d52019f0 con 0x5644d510c200 2024-09-10T05:11:47.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f8234e09640 1 -- 172.21.15.192:0/824682986 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f833800fc30 con 0x5644d510c200 2024-09-10T05:11:47.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.416+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644d52023f0 con 0x5644d510c200 2024-09-10T05:11:47.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.417+0000 7f8234e09640 1 -- 172.21.15.192:0/824682986 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8338017040 con 0x5644d510c200 2024-09-10T05:11:47.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.417+0000 7f8234e09640 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f823003c920 0x7f823003ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.418+0000 7f8234e09640 1 -- 172.21.15.192:0/824682986 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f8338015020 con 0x5644d510c200 2024-09-10T05:11:47.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.418+0000 7f833ffff640 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f823003c920 0x7f823003ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.418+0000 7f834aabb800 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5644d5202ef0 0x5644d5208850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.418+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5208dd0 con 0x5644d5202ef0 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.418+0000 7f8348da6640 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5644d5202ef0 0x5644d5208850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.418+0000 7f833ffff640 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f823003c920 0x7f823003ede0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8330057000 tx=0x7f8330052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.418+0000 7f8348da6640 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5644d5202ef0 0x5644d5208850 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.418+0000 7f8348da6640 1 -- 172.21.15.192:0/824682986 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d5202ef0 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.418+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d52028a0 con 0x5644d5202ef0 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.419+0000 7f8348da6640 1 -- 172.21.15.192:0/824682986 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d5202ef0 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.419+0000 7f834aabb800 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5644d520b120 0x5644d520d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.419+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d520dbe0 con 0x5644d520b120 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.419+0000 7f83485a5640 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5644d520b120 0x5644d520d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.419+0000 7f83485a5640 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5644d520b120 0x5644d520d510 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.419+0000 7f83485a5640 1 -- 172.21.15.192:0/824682986 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f833802d070 con 0x5644d520b120 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.419+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5209fc0 con 0x5644d5202ef0 2024-09-10T05:11:47.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.420+0000 7f8348da6640 1 -- 172.21.15.192:0/824682986 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d5202ef0 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.420+0000 7f834aabb800 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5644d520f020 0x5644d5211410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.420+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5211b50 con 0x5644d520f020 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.420+0000 7f833ffff640 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5644d520f020 0x5644d5211410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.420+0000 7f833ffff640 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5644d520f020 0x5644d5211410 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.420+0000 7f833ffff640 1 -- 172.21.15.192:0/824682986 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8330051070 con 0x5644d520f020 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.421+0000 7f834aabb800 1 Processor -- start 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.421+0000 7f834aabb800 1 -- start start 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.421+0000 7f834aabb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d521f7b0 0x5644d521fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.421+0000 7f834aabb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5644d4ffea00 con 0x5644d521f7b0 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.421+0000 7f83485a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d521f7b0 0x5644d521fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.421+0000 7f83485a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d521f7b0 0x5644d521fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59494/0 (socket says 172.21.15.192:59494) 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.421+0000 7f83485a5640 1 -- 172.21.15.192:0/271665605 learned_addr learned my addr 172.21.15.192:0/271665605 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.422+0000 7f83485a5640 1 -- 172.21.15.192:0/271665605 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d5220210 con 0x5644d521f7b0 2024-09-10T05:11:47.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.422+0000 7f83485a5640 1 --2- 172.21.15.192:0/271665605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d521f7b0 0x5644d521fbd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f833800bd10 tx=0x7f833804be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.422+0000 7f822dffb640 1 -- 172.21.15.192:0/271665605 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338010070 con 0x5644d521f7b0 2024-09-10T05:11:47.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.422+0000 7f822dffb640 1 -- 172.21.15.192:0/271665605 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8338019470 con 0x5644d521f7b0 2024-09-10T05:11:47.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.422+0000 7f834aabb800 1 -- 172.21.15.192:0/271665605 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644d5220a40 con 0x5644d521f7b0 2024-09-10T05:11:47.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.422+0000 7f822dffb640 1 -- 172.21.15.192:0/271665605 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338010210 con 0x5644d521f7b0 2024-09-10T05:11:47.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.422+0000 7f834aabb800 1 -- 172.21.15.192:0/271665605 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644d5220fe0 con 0x5644d521f7b0 2024-09-10T05:11:47.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.423+0000 7f822dffb640 1 -- 172.21.15.192:0/271665605 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f833804b320 con 0x5644d521f7b0 2024-09-10T05:11:47.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.423+0000 7f822dffb640 1 --2- 172.21.15.192:0/271665605 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f822003c730 0x7f822003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.423+0000 7f822dffb640 1 -- 172.21.15.192:0/271665605 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f833803c490 con 0x5644d521f7b0 2024-09-10T05:11:47.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.423+0000 7f833ffff640 1 --2- 172.21.15.192:0/271665605 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f822003c730 0x7f822003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.423+0000 7f834aabb800 1 Processor -- start 2024-09-10T05:11:47.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.423+0000 7f834aabb800 1 -- start start 2024-09-10T05:11:47.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.423+0000 7f833ffff640 1 --2- 172.21.15.192:0/271665605 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f822003c730 0x7f822003ebf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x5644d52092a0 tx=0x7f8330005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.424+0000 7f834aabb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 0x5644d522c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.424+0000 7f834aabb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5644d51066c0 con 0x5644d522c250 2024-09-10T05:11:47.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.424+0000 7f83485a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 0x5644d522c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.424+0000 7f83485a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 0x5644d522c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59500/0 (socket says 172.21.15.192:59500) 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.424+0000 7f83485a5640 1 -- 172.21.15.192:0/3090831150 learned_addr learned my addr 172.21.15.192:0/3090831150 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.424+0000 7f83485a5640 1 -- 172.21.15.192:0/3090831150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d522cc40 con 0x5644d522c250 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.424+0000 7f83485a5640 1 --2- 172.21.15.192:0/3090831150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 0x5644d522c650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f833802d040 tx=0x7f833801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2a5d6d06118ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.424+0000 7f82277fe640 1 -- 172.21.15.192:0/3090831150 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338058020 con 0x5644d522c250 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.424+0000 7f82277fe640 1 -- 172.21.15.192:0/3090831150 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8338018c70 con 0x5644d522c250 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.424+0000 7f82277fe640 1 -- 172.21.15.192:0/3090831150 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338035040 con 0x5644d522c250 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f834aabb800 1 -- 172.21.15.192:0/3090831150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 msgr2=0x5644d522c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f834aabb800 1 --2- 172.21.15.192:0/3090831150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 0x5644d522c650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f833802d040 tx=0x7f833801cc70 comp rx=0 tx=0).stop 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f834aabb800 1 -- 172.21.15.192:0/3090831150 shutdown_connections 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f834aabb800 1 --2- 172.21.15.192:0/3090831150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 0x5644d522c650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f834aabb800 1 -- 172.21.15.192:0/3090831150 >> 172.21.15.192:0/3090831150 conn(0x5644d5228650 msgr2=0x5644d5226890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f834aabb800 1 -- 172.21.15.192:0/3090831150 shutdown_connections 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f834aabb800 1 -- 172.21.15.192:0/3090831150 wait complete. 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f834aabb800 1 Processor -- start 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f834aabb800 1 -- start start 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f834aabb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 0x5644d5233690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f834aabb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5644d522d0b0 con 0x5644d522c250 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f83485a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 0x5644d5233690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f83485a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 0x5644d5233690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59516/0 (socket says 172.21.15.192:59516) 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.425+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 learned_addr learned my addr 172.21.15.192:0/3510140475 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.426+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644d5233bf0 con 0x5644d522c250 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.426+0000 7f83485a5640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 0x5644d5233690 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f833801cd40 tx=0x7f8338031fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.426+0000 7f8225ffb640 1 -- 172.21.15.192:0/3510140475 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f833806c070 con 0x5644d522c250 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.426+0000 7f8225ffb640 1 -- 172.21.15.192:0/3510140475 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83380393e0 con 0x5644d522c250 2024-09-10T05:11:47.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.426+0000 7f8225ffb640 1 -- 172.21.15.192:0/3510140475 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338035040 con 0x5644d522c250 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.426+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644d5233bf0 con 0x5644d522c250 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.426+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644d5233bf0 con 0x5644d522c250 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.427+0000 7f8225ffb640 1 -- 172.21.15.192:0/3510140475 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f833806f070 con 0x5644d522c250 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.427+0000 7f8225ffb640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f821803c780 0x7f821803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.427+0000 7f8225ffb640 1 -- 172.21.15.192:0/3510140475 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f8338072c80 con 0x5644d522c250 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.427+0000 7f833ffff640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f821803c780 0x7f821803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.427+0000 7f834aabb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.427+0000 7f834aabb800 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5644d523ea50 0x5644d5240f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.427+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5241610 con 0x5644d523ea50 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.427+0000 7f8348da6640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5644d523ea50 0x5644d5240f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f833ffff640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f821803c780 0x7f821803ec40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8330000c00 tx=0x7f8330053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f8348da6640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5644d523ea50 0x5644d5240f10 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f834aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f834aabb800 20 realm 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f834aabb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5241a20 con 0x5644d523ea50 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f834aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f834aabb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f834aabb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d52422f0 con 0x5644d523ea50 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f834aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f834aabb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.428+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d523ea50 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.429+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.429+0000 7f834aabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.429+0000 7f834aabb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.429+0000 7f834aabb800 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5644d5243180 0x5644d5245570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.429+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5245cb0 con 0x5644d5243180 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.429+0000 7f83485a5640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5644d5243180 0x5644d5245570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.429+0000 7f83485a5640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5644d5243180 0x5644d5245570 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.429+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.429+0000 7f834aabb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.429+0000 7f834aabb800 20 searching for the correct realm 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.429+0000 7f834aabb800 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5644d5247d50 0x5644d524a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.429+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d524a8e0 con 0x5644d5247d50 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.430+0000 7f833ffff640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5644d5247d50 0x5644d524a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.430+0000 7f833ffff640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5644d5247d50 0x5644d524a210 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.430+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.430+0000 7f833ffff640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f833005f040 0x7f833006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.430+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d524a8e0 con 0x7f833005f040 2024-09-10T05:11:47.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.430+0000 7f8348da6640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f833005f040 0x7f833006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.431+0000 7f8348da6640 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f833005f040 0x7f833006b410 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.431+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.431+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5243180 2024-09-10T05:11:47.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.431+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.431+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d523ea50 2024-09-10T05:11:47.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.431+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.431+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d523ea50 2024-09-10T05:11:47.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.432+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.432+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5243180 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.432+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.432+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5243180 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.432+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.432+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x7f833005f040 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.432+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.432+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5247d50 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.433+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.433+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d523ea50 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.433+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.433+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5243180 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.433+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.433+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d523ea50 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.433+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.433+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x7f833005f040 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.433+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.433+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5247d50 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.434+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.434+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5247d50 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.434+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.434+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5243180 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.434+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.434+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5247d50 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.434+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.434+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5247d50 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.435+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.435+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d523ea50 2024-09-10T05:11:47.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.435+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.435+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d523ea50 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.435+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.435+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5243180 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.436+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.436+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5247d50 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.436+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.436+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x7f833005f040 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.436+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.436+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d523ea50 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.436+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.436+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5243180 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.437+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.437+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5247d50 2024-09-10T05:11:47.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.437+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.437+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5243180 2024-09-10T05:11:47.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.437+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.437+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x7f833005f040 2024-09-10T05:11:47.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.437+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.437+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5247d50 2024-09-10T05:11:47.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d5243180 2024-09-10T05:11:47.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x5644d523ea50 2024-09-10T05:11:47.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5644d5242690 con 0x7f833005f040 2024-09-10T05:11:47.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f834aabb800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:47.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f834aabb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f834aabb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f834aabb800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f834aabb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f834aabb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f834aabb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.438+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5246650 con 0x5644d523ea50 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5246650 con 0x5644d523ea50 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5246620 con 0x7f833005f040 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 20 zone default found 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 4 Realm: () 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 20 zonegroup default 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.439+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5246a40 con 0x5644d5243180 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f834aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f834aabb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5246430 con 0x5644d5247d50 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f834aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f834aabb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d524c750 con 0x5644d5247d50 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f834aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f834aabb800 20 started sync module instance, tier type = 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f834aabb800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.440+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d524bbf0 con 0x7f833005f040 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.441+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.441+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94853633720608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d524bbf0 con 0x7f833005f040 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.441+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d524d1f0 con 0x5644d523ea50 2024-09-10T05:11:47.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.442+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94853633720608] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.442+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.442+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94853633723616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d524bbf0 con 0x5644d523ea50 2024-09-10T05:11:47.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.442+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d524dc80 con 0x5644d5247d50 2024-09-10T05:11:47.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.443+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.443+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94853633723616] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.443+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94853633726288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d524e070 con 0x5644d5247d50 2024-09-10T05:11:47.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.443+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d524ea70 con 0x7f833005f040 2024-09-10T05:11:47.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.444+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.444+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94853633729920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d524f310 con 0x7f833005f040 2024-09-10T05:11:47.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.444+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d524fdd0 con 0x5644d523ea50 2024-09-10T05:11:47.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.445+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94853633726288] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.445+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.445+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94853633734816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d524fd90 con 0x5644d523ea50 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.445+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d52507e0 con 0x5644d5243180 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.446+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94853633729920] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.446+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94853633734816] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.446+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.446+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94853633718080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d524ee30 con 0x5644d5243180 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.446+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5251030 con 0x5644d5243180 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.447+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94853633718080] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.447+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.447+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94853633737520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5251880 con 0x5644d5243180 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.447+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5252240 con 0x5644d5243180 2024-09-10T05:11:47.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.448+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.448+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94853633737520] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.448+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94853633744752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5252960 con 0x5644d5243180 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.448+0000 7f834aabb800 20 add_watcher() i=0 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.448+0000 7f834aabb800 20 add_watcher() i=1 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.448+0000 7f834aabb800 20 add_watcher() i=2 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.448+0000 7f834aabb800 20 add_watcher() i=3 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.448+0000 7f834aabb800 20 add_watcher() i=4 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.448+0000 7f834aabb800 20 add_watcher() i=5 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.448+0000 7f834aabb800 20 add_watcher() i=6 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.449+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94853633744752] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.449+0000 7f834aabb800 20 add_watcher() i=7 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.449+0000 7f834aabb800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.449+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d52514c0 con 0x5644d523ea50 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.450+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.450+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94853633745936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5253230 con 0x5644d523ea50 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.451+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94853633745936] v35'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.451+0000 7f81fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.451+0000 7f834aabb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.451+0000 7f834aabb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.451+0000 7f834aabb800 5 note: GC not initialized 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.451+0000 7f81fd7e2640 20 reqs_thread_entry: start 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.451+0000 7f834aabb800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.451+0000 7f834aabb800 20 Filter name: none 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.451+0000 7f816effd640 20 reqs_thread_entry: start 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.451+0000 7f834aabb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.451+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5644d5288580 con 0x5644d523ea50 2024-09-10T05:11:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.452+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.452+0000 7f834aabb800 20 rados_obj.operate() r=0 bl.length=502 2024-09-10T05:11:47.464 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T05:11:47.323053Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:47.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.453+0000 7f81fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.453+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94853633745936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5287030 con 0x5644d523ea50 2024-09-10T05:11:47.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.453+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94853633745936] v35'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.453+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94853633720608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5286460 con 0x7f833005f040 2024-09-10T05:11:47.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.454+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94853633720608] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.454+0000 7f834aabb800 20 remove_watcher() i=0 2024-09-10T05:11:47.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.454+0000 7f834aabb800 2 removed watcher, disabling cache 2024-09-10T05:11:47.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.454+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94853633723616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5286460 con 0x5644d523ea50 2024-09-10T05:11:47.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.455+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94853633723616] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.455+0000 7f834aabb800 20 remove_watcher() i=1 2024-09-10T05:11:47.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.455+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94853633726288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5286460 con 0x5644d5247d50 2024-09-10T05:11:47.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.456+0000 7f833ffff640 1 -- 172.21.15.192:0/3510140475 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94853633726288] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833007c040 con 0x5644d5247d50 2024-09-10T05:11:47.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.456+0000 7f834aabb800 20 remove_watcher() i=2 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.456+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94853633729920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5286460 con 0x7f833005f040 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.457+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94853633729920] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x7f833005f040 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.457+0000 7f834aabb800 20 remove_watcher() i=3 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.457+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94853633734816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5286460 con 0x5644d523ea50 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.458+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94853633734816] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f834000a4d0 con 0x5644d523ea50 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.458+0000 7f834aabb800 20 remove_watcher() i=4 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.458+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94853633718080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5286460 con 0x5644d5243180 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.459+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94853633718080] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.459+0000 7f834aabb800 20 remove_watcher() i=5 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.459+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94853633737520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5286460 con 0x5644d5243180 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.460+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94853633737520] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.460+0000 7f834aabb800 20 remove_watcher() i=6 2024-09-10T05:11:47.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.460+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94853633744752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5644d5286460 con 0x5644d5243180 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f83485a5640 1 -- 172.21.15.192:0/3510140475 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94853633744752] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f833806e030 con 0x5644d5243180 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 20 remove_watcher() i=7 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5644d5243180 msgr2=0x5644d5245570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5644d5243180 0x5644d5245570 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5644d523ea50 msgr2=0x5644d5240f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5644d523ea50 0x5644d5240f10 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f833005f040 msgr2=0x7f833006b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f833005f040 0x7f833006b410 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5644d5247d50 msgr2=0x5644d524a210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5644d5247d50 0x5644d524a210 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f821803c780 msgr2=0x7f821803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f821803c780 0x7f821803ec40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8330000c00 tx=0x7f8330053000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 msgr2=0x5644d5233690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f8348da6640 1 -- 172.21.15.192:0/3510140475 reap_dead start 2024-09-10T05:11:47.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.461+0000 7f834aabb800 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 0x5644d5233690 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f833801cd40 tx=0x7f8338031fc0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 shutdown_connections 2024-09-10T05:11:47.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 --2- 172.21.15.192:0/3510140475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d522c250 0x5644d5233690 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 >> 172.21.15.192:0/3510140475 conn(0x5644d5228650 msgr2=0x5644d5226860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 shutdown_connections 2024-09-10T05:11:47.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/3510140475 wait complete. 2024-09-10T05:11:47.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/271665605 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f822003c730 msgr2=0x7f822003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 --2- 172.21.15.192:0/271665605 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f822003c730 0x7f822003ebf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x5644d52092a0 tx=0x7f8330005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:47.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/271665605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d521f7b0 msgr2=0x5644d521fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 --2- 172.21.15.192:0/271665605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d521f7b0 0x5644d521fbd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f833800bd10 tx=0x7f833804be50 comp rx=0 tx=0).stop 2024-09-10T05:11:47.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/271665605 shutdown_connections 2024-09-10T05:11:47.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 --2- 172.21.15.192:0/271665605 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f822003c730 0x7f822003ebf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 --2- 172.21.15.192:0/271665605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d521f7b0 0x5644d521fbd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/271665605 >> 172.21.15.192:0/271665605 conn(0x5644d5213b60 msgr2=0x5644d5213f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/271665605 shutdown_connections 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/271665605 wait complete. 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5644d520b120 msgr2=0x5644d520d510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5644d520b120 0x5644d520d510 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5644d5202ef0 msgr2=0x5644d5208850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5644d5202ef0 0x5644d5208850 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5644d520f020 msgr2=0x5644d5211410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5644d520f020 0x5644d5211410 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f823003c920 msgr2=0x7f823003ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f823003c920 0x7f823003ede0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8330057000 tx=0x7f8330052000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d510c200 msgr2=0x5644d5201200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f834aabb800 1 --2- 172.21.15.192:0/824682986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5644d510c200 0x5644d5201200 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f83380012f0 tx=0x7f8338000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.462+0000 7f8348da6640 1 -- 172.21.15.192:0/824682986 reap_dead start 2024-09-10T05:11:47.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.463+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 shutdown_connections 2024-09-10T05:11:47.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.463+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 >> 172.21.15.192:0/824682986 conn(0x5644d51021f0 msgr2=0x5644d51f2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.463+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 shutdown_connections 2024-09-10T05:11:47.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.463+0000 7f834aabb800 1 -- 172.21.15.192:0/824682986 wait complete. 2024-09-10T05:11:47.475 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T05:11:47.323053Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:47.475 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-10T05:11:47.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-10T05:11:47.475 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-10T05:11:47.521 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:47.567 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:47.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.521+0000 7fc5ecb1f800 1 Processor -- start 2024-09-10T05:11:47.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.521+0000 7fc5ecb1f800 1 -- start start 2024-09-10T05:11:47.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.522+0000 7fc5ecb1f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5564f281a4d0 0x5564f281a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.522+0000 7fc5ecb1f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5564f26c5e40 con 0x5564f281ae10 2024-09-10T05:11:47.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.522+0000 7fc5ecb1f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5564f2690680 con 0x5564f281a4d0 2024-09-10T05:11:47.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.522+0000 7fc5e88a9640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5564f281a4d0 0x5564f281a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.522+0000 7fc5e3fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5564f281ae10 0x5564f281b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36260/0 (socket says 172.21.15.192:36260) 2024-09-10T05:11:47.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.522+0000 7fc5e3fff640 1 -- 172.21.15.192:0/2193181124 learned_addr learned my addr 172.21.15.192:0/2193181124 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.522+0000 7fc5e88a9640 1 -- 172.21.15.192:0/2193181124 >> v1:172.21.15.139:6789/0 conn(0x5564f281ae10 legacy=0x5564f281b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.522+0000 7fc5e88a9640 1 -- 172.21.15.192:0/2193181124 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f26ac6b0 con 0x5564f281a4d0 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.522+0000 7fc5e37fe640 1 -- 172.21.15.192:0/2193181124 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1777956251 0 0) 0x5564f26c5e40 con 0x5564f281ae10 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.524+0000 7fc5e88a9640 1 --2- 172.21.15.192:0/2193181124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f281a8d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00a470 tx=0x7fc5dc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3f90f1318de620 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.524+0000 7fc5e37fe640 1 -- 172.21.15.192:0/2193181124 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc053570 con 0x5564f281a4d0 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.524+0000 7fc5e37fe640 1 -- 172.21.15.192:0/2193181124 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc058070 con 0x5564f281a4d0 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.524+0000 7fc5e37fe640 1 -- 172.21.15.192:0/2193181124 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc053880 con 0x5564f281a4d0 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.525+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/2193181124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 msgr2=0x5564f281a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.525+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/2193181124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f281a8d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00a470 tx=0x7fc5dc045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.525+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/2193181124 shutdown_connections 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.525+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/2193181124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f281a8d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.525+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/2193181124 >> 172.21.15.192:0/2193181124 conn(0x5564f2816200 msgr2=0x5564f2818640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.525+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/2193181124 shutdown_connections 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.525+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/2193181124 wait complete. 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.538+0000 7fc5ecb1f800 1 Processor -- start 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.538+0000 7fc5ecb1f800 1 -- start start 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.538+0000 7fc5ecb1f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f290d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.538+0000 7fc5ecb1f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5564f26b4dd0 con 0x5564f281a4d0 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.539+0000 7fc5e88a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f290d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.539+0000 7fc5e88a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f290d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59544/0 (socket says 172.21.15.192:59544) 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.539+0000 7fc5e88a9640 1 -- 172.21.15.192:0/819034639 learned_addr learned my addr 172.21.15.192:0/819034639 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.539+0000 7fc5e88a9640 1 -- 172.21.15.192:0/819034639 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f26cde10 con 0x5564f281a4d0 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.539+0000 7fc5e88a9640 1 --2- 172.21.15.192:0/819034639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f290d6d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc025c20 tx=0x7fc5dc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70e2722c8215424 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.539+0000 7fc4d6e05640 1 -- 172.21.15.192:0/819034639 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc053a20 con 0x5564f281a4d0 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.539+0000 7fc4d6e05640 1 -- 172.21.15.192:0/819034639 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc063070 con 0x5564f281a4d0 2024-09-10T05:11:47.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.539+0000 7fc4d6e05640 1 -- 172.21.15.192:0/819034639 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc053d30 con 0x5564f281a4d0 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.540+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/819034639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 msgr2=0x5564f290d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.540+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/819034639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f290d6d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc025c20 tx=0x7fc5dc051000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.540+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/819034639 shutdown_connections 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.540+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/819034639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f290d6d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.540+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/819034639 >> 172.21.15.192:0/819034639 conn(0x5564f2816200 msgr2=0x5564f2909050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.540+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/819034639 shutdown_connections 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.540+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/819034639 wait complete. 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.540+0000 7fc5ecb1f800 1 Processor -- start 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.541+0000 7fc5ecb1f800 1 -- start start 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.541+0000 7fc5ecb1f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f2914fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.541+0000 7fc5ecb1f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5564f281bd30 con 0x5564f281a4d0 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.541+0000 7fc5e88a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f2914fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.541+0000 7fc5e88a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f2914fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59556/0 (socket says 172.21.15.192:59556) 2024-09-10T05:11:47.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.541+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3676520397 learned_addr learned my addr 172.21.15.192:0/3676520397 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.541+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3676520397 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f2915500 con 0x5564f281a4d0 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.541+0000 7fc5e88a9640 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f2914fa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc025c20 tx=0x7fc5dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.541+0000 7fc4d5602640 1 -- 172.21.15.192:0/3676520397 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc078070 con 0x5564f281a4d0 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.541+0000 7fc4d5602640 1 -- 172.21.15.192:0/3676520397 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc073470 con 0x5564f281a4d0 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.541+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564f2915790 con 0x5564f281a4d0 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.541+0000 7fc4d5602640 1 -- 172.21.15.192:0/3676520397 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc073750 con 0x5564f281a4d0 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.542+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564f29163a0 con 0x5564f281a4d0 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.542+0000 7fc4d5602640 1 -- 172.21.15.192:0/3676520397 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc5dc07b070 con 0x5564f281a4d0 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.542+0000 7fc4d5602640 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4d003c780 0x7fc4d003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.543+0000 7fc4d5602640 1 -- 172.21.15.192:0/3676520397 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fc5dc097b80 con 0x5564f281a4d0 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.543+0000 7fc5e3fff640 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4d003c780 0x7fc4d003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.543+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5564f281ae10 0x5564f291c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.543+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2916d60 con 0x5564f281ae10 2024-09-10T05:11:47.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.543+0000 7fc5e90aa640 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5564f281ae10 0x5564f291c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.543+0000 7fc5e3fff640 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4d003c780 0x7fc4d003ec40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4000c00 tx=0x7fc5d40013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.543+0000 7fc5e90aa640 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5564f281ae10 0x5564f291c5f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.543+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3676520397 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f281ae10 2024-09-10T05:11:47.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.543+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2916710 con 0x5564f281ae10 2024-09-10T05:11:47.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.544+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3676520397 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f281ae10 2024-09-10T05:11:47.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.544+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5564f291ea60 0x5564f2920e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.544+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2921520 con 0x5564f291ea60 2024-09-10T05:11:47.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.544+0000 7fc5e88a9640 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5564f291ea60 0x5564f2920e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.544+0000 7fc5e88a9640 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5564f291ea60 0x5564f2920e50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.544+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3676520397 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f291ea60 2024-09-10T05:11:47.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.545+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f291d900 con 0x5564f281ae10 2024-09-10T05:11:47.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.545+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3676520397 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f281ae10 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.545+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5564f2922960 0x5564f2924d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.545+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2925490 con 0x5564f2922960 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.545+0000 7fc5e3fff640 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5564f2922960 0x5564f2924d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.545+0000 7fc5e3fff640 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5564f2922960 0x5564f2924d50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.546+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3676520397 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc5d400f670 con 0x5564f2922960 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.546+0000 7fc5ecb1f800 1 Processor -- start 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.546+0000 7fc5ecb1f800 1 -- start start 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.546+0000 7fc5ecb1f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f29330f0 0x5564f2933510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.546+0000 7fc5ecb1f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5564f2712a00 con 0x5564f29330f0 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.546+0000 7fc5e88a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f29330f0 0x5564f2933510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.546+0000 7fc5e88a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f29330f0 0x5564f2933510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59558/0 (socket says 172.21.15.192:59558) 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.546+0000 7fc5e88a9640 1 -- 172.21.15.192:0/138582730 learned_addr learned my addr 172.21.15.192:0/138582730 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.546+0000 7fc5e88a9640 1 -- 172.21.15.192:0/138582730 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f2933b50 con 0x5564f29330f0 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.547+0000 7fc5e88a9640 1 --2- 172.21.15.192:0/138582730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f29330f0 0x5564f2933510 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc095f00 tx=0x7fc5dc05de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.547+0000 7fc4ce7fc640 1 -- 172.21.15.192:0/138582730 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc07c6a0 con 0x5564f29330f0 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.547+0000 7fc4ce7fc640 1 -- 172.21.15.192:0/138582730 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc07c840 con 0x5564f29330f0 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.547+0000 7fc4ce7fc640 1 -- 172.21.15.192:0/138582730 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc0685e0 con 0x5564f29330f0 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.547+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/138582730 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564f2934380 con 0x5564f29330f0 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.547+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/138582730 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564f2934920 con 0x5564f29330f0 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.548+0000 7fc4ce7fc640 1 -- 172.21.15.192:0/138582730 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc5dc068780 con 0x5564f29330f0 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.548+0000 7fc4ce7fc640 1 --2- 172.21.15.192:0/138582730 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4c003c780 0x7fc4c003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.548+0000 7fc4ce7fc640 1 -- 172.21.15.192:0/138582730 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fc5dc08f070 con 0x5564f29330f0 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.548+0000 7fc5e3fff640 1 --2- 172.21.15.192:0/138582730 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4c003c780 0x7fc4c003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.548+0000 7fc5ecb1f800 1 Processor -- start 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.548+0000 7fc5ecb1f800 1 -- start start 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.548+0000 7fc5e3fff640 1 --2- 172.21.15.192:0/138582730 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4c003c780 0x7fc4c003ec40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5564f291cc00 tx=0x7fc5d4006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.548+0000 7fc5ecb1f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 0x5564f293fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.548+0000 7fc5ecb1f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5564f290dec0 con 0x5564f293f970 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.548+0000 7fc5e88a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 0x5564f293fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.548+0000 7fc5e88a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 0x5564f293fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59562/0 (socket says 172.21.15.192:59562) 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.548+0000 7fc5e88a9640 1 -- 172.21.15.192:0/2186648317 learned_addr learned my addr 172.21.15.192:0/2186648317 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.549+0000 7fc5e88a9640 1 -- 172.21.15.192:0/2186648317 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f2940320 con 0x5564f293f970 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.549+0000 7fc5e88a9640 1 --2- 172.21.15.192:0/2186648317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 0x5564f293fd50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc04d0b0 tx=0x7fc5dc04d1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7666c1d3cee544fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.549+0000 7fc4bffff640 1 -- 172.21.15.192:0/2186648317 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc05c870 con 0x5564f293f970 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.549+0000 7fc4bffff640 1 -- 172.21.15.192:0/2186648317 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc0923c0 con 0x5564f293f970 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.549+0000 7fc4bffff640 1 -- 172.21.15.192:0/2186648317 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc073ad0 con 0x5564f293f970 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.549+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/2186648317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 msgr2=0x5564f293fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.549+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/2186648317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 0x5564f293fd50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc04d0b0 tx=0x7fc5dc04d1a0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.549+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/2186648317 shutdown_connections 2024-09-10T05:11:47.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.549+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/2186648317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 0x5564f293fd50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.549+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/2186648317 >> 172.21.15.192:0/2186648317 conn(0x5564f293bd70 msgr2=0x5564f2939fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.549+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/2186648317 shutdown_connections 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.549+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/2186648317 wait complete. 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.550+0000 7fc5ecb1f800 1 Processor -- start 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.550+0000 7fc5ecb1f800 1 -- start start 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.550+0000 7fc5ecb1f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 0x5564f2946d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.550+0000 7fc5ecb1f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5564f29407d0 con 0x5564f293f970 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.550+0000 7fc5e88a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 0x5564f2946d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.550+0000 7fc5e88a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 0x5564f2946d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59576/0 (socket says 172.21.15.192:59576) 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.550+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 learned_addr learned my addr 172.21.15.192:0/3254592316 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.551+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f2947290 con 0x5564f293f970 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.551+0000 7fc5e88a9640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 0x5564f2946d30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc053730 tx=0x7fc5dc05af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.551+0000 7fc4be7fc640 1 -- 172.21.15.192:0/3254592316 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc052bf0 con 0x5564f293f970 2024-09-10T05:11:47.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.551+0000 7fc4be7fc640 1 -- 172.21.15.192:0/3254592316 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc0bb070 con 0x5564f293f970 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.551+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564f2947290 con 0x5564f293f970 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.551+0000 7fc4be7fc640 1 -- 172.21.15.192:0/3254592316 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5dc07d660 con 0x5564f293f970 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.551+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564f2947290 con 0x5564f293f970 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.552+0000 7fc4be7fc640 1 -- 172.21.15.192:0/3254592316 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc5dc07d800 con 0x5564f293f970 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.552+0000 7fc4be7fc640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4b403c780 0x7fc4b403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.552+0000 7fc4be7fc640 1 -- 172.21.15.192:0/3254592316 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fc5dc0ba180 con 0x5564f293f970 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.552+0000 7fc5e3fff640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4b403c780 0x7fc4b403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.553+0000 7fc5e3fff640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4b403c780 0x7fc4b403ec40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400ffd0 tx=0x7fc5d4023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.553+0000 7fc5ecb1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.553+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5564f2952320 0x5564f29547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.553+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2954f30 con 0x5564f2952320 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.553+0000 7fc5e90aa640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5564f2952320 0x5564f29547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.553+0000 7fc5e90aa640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5564f2952320 0x5564f29547e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 20 realm 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955340 con 0x5564f2952320 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955c10 con 0x5564f2952320 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2952320 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5564f2956d10 0x5564f2959100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f29596c0 con 0x5564f2956d10 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.554+0000 7fc5e88a9640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5564f2956d10 0x5564f2959100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.555+0000 7fc5e88a9640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5564f2956d10 0x5564f2959100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.555+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.555+0000 7fc5ecb1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.555+0000 7fc5ecb1f800 20 searching for the correct realm 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.555+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5564f295b670 0x5564f295db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.555+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f295e200 con 0x5564f295b670 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.555+0000 7fc5e3fff640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5564f295b670 0x5564f295db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.555+0000 7fc5e3fff640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5564f295b670 0x5564f295db30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.556+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.556+0000 7fc5e3fff640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc5d402e910 0x7fc5d403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.556+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f295e200 con 0x7fc5d402e910 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.556+0000 7fc5e90aa640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc5d402e910 0x7fc5d403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.556+0000 7fc5e90aa640 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc5d402e910 0x7fc5d403a3c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.556+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.556+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2956d10 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.557+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.557+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2952320 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.557+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.557+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2952320 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.557+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.557+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2956d10 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.557+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.557+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2956d10 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.557+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.557+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x7fc5d402e910 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.558+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.558+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f295b670 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.558+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.558+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2952320 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.558+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.558+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2956d10 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.558+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.558+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2952320 2024-09-10T05:11:47.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.559+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.559+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x7fc5d402e910 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.559+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.559+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f295b670 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.559+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.559+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f295b670 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.559+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.559+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2956d10 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.560+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.560+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f295b670 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.560+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.560+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f295b670 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.560+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.560+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2952320 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.560+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.560+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2952320 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.560+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.560+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2956d10 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.561+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.561+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f295b670 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.561+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.561+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x7fc5d402e910 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.561+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.561+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2952320 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.561+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.561+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2956d10 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.562+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.562+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f295b670 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.562+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.562+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2956d10 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.562+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.562+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x7fc5d402e910 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.562+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f295b670 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2956d10 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x5564f2952320 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5564f2955fb0 con 0x7fc5d402e910 2024-09-10T05:11:47.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5ecb1f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:47.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5ecb1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:47.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5ecb1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:47.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5ecb1f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:47.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.563+0000 7fc5ecb1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:47.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:47.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2959f80 con 0x5564f2952320 2024-09-10T05:11:47.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2959f80 con 0x5564f2952320 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2959f80 con 0x7fc5d402e910 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 20 zone default found 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 4 Realm: () 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 20 zonegroup default 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.564+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f295a820 con 0x5564f2956d10 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5ecb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5ecb1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2960070 con 0x5564f295b670 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5ecb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5ecb1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2960410 con 0x5564f295b670 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5ecb1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5ecb1f800 20 started sync module instance, tier type = 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5ecb1f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:47.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.565+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f295f510 con 0x7fc5d402e910 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.566+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.566+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93892055003536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f295fbd0 con 0x7fc5d402e910 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.566+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2960dd0 con 0x5564f2952320 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.567+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93892055003536] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.567+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.567+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93892055010048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f295fb90 con 0x5564f2952320 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.567+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f29617e0 con 0x5564f295b670 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.568+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93892055010048] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.569+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.569+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93892055004896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2961c00 con 0x5564f295b670 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.569+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f29625c0 con 0x7fc5d402e910 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.570+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.570+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93892055016208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2962e60 con 0x7fc5d402e910 2024-09-10T05:11:47.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.570+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f29638d0 con 0x5564f2952320 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.570+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93892055004896] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.571+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93892055016208] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.571+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.571+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93892055020448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2962930 con 0x5564f2952320 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.571+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2964170 con 0x5564f2956d10 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.572+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93892055020448] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.572+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.572+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93892055017648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2963cc0 con 0x5564f2956d10 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.572+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f29647e0 con 0x5564f2956d10 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.573+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93892055017648] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.573+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.573+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93892055024304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f29647a0 con 0x5564f2956d10 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.573+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2965210 con 0x5564f2956d10 2024-09-10T05:11:47.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.574+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93892055024304] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.574+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.574+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93892055026912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f29651d0 con 0x5564f2956d10 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.574+0000 7fc5ecb1f800 20 add_watcher() i=0 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.574+0000 7fc5ecb1f800 20 add_watcher() i=1 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.574+0000 7fc5ecb1f800 20 add_watcher() i=2 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.574+0000 7fc5ecb1f800 20 add_watcher() i=3 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.574+0000 7fc5ecb1f800 20 add_watcher() i=4 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.574+0000 7fc5ecb1f800 20 add_watcher() i=5 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.574+0000 7fc5ecb1f800 20 add_watcher() i=6 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.575+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93892055026912] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.575+0000 7fc5ecb1f800 20 add_watcher() i=7 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.575+0000 7fc5ecb1f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.575+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f2968690 con 0x5564f2952320 2024-09-10T05:11:47.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.576+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.576+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93892055005952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2965bb0 con 0x5564f2952320 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.576+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93892055005952] v35'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.577+0000 7fc49efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.577+0000 7fc5ecb1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.577+0000 7fc5ecb1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.577+0000 7fc5ecb1f800 5 note: GC not initialized 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.577+0000 7fc49dfe3640 20 reqs_thread_entry: start 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.577+0000 7fc5ecb1f800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.577+0000 7fc5ecb1f800 20 Filter name: none 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.577+0000 7fc40f7fe640 20 reqs_thread_entry: start 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.577+0000 7fc5ecb1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.577+0000 7fc5ecb1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.577+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f299b700 con 0x5564f2952320 2024-09-10T05:11:47.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.577+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.578+0000 7fc5ecb1f800 20 rados_obj.operate() r=0 bl.length=502 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.578+0000 7fc5ecb1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.578+0000 7fc5ecb1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.578+0000 7fc5ecb1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.578+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f29a1be0 con 0x5564f2952320 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v35'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc5ecb1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc5ecb1f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc5ecb1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93892055275040 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f299d2e0 con 0x5564f2952320 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 93892055020448 notify 150323855364 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fc5e40266e0 con 0x5564f2952320 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc4bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855364 cookie 93892055020448 notifier 4364 bl.length()=567 2024-09-10T05:11:47.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc4bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:47.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc4bffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc4bffff640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc4ac003ea0 con 0x5564f2952320 2024-09-10T05:11:47.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(64 notify.4 [notify cookie 93892055275040 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== watch-notify(notify_complete (2) cookie 93892055275040 notify 150323855364 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc5e4018d40 con 0x5564f2952320 2024-09-10T05:11:47.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.579+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f29a1620 con 0x5564f2956d10 2024-09-10T05:11:47.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.581+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v35'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.581+0000 7fc5ecb1f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:11:47.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.581+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93892055275040 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5564f299ce30 con 0x5564f295b670 2024-09-10T05:11:47.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.581+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== watch-notify(notify (1) cookie 93892055004896 notify 150323855361 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7fc5d4018040 con 0x5564f295b670 2024-09-10T05:11:47.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.581+0000 7fc4bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855361 cookie 93892055004896 notifier 4364 bl.length()=170 2024-09-10T05:11:47.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.581+0000 7fc4bf7fe640 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc41c0032c0 con 0x5564f295b670 2024-09-10T05:11:47.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.581+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 notify.2 [notify cookie 93892055275040 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.581+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.581+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== watch-notify(notify_complete (2) cookie 93892055275040 notify 150323855361 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc5d401fb40 con 0x5564f295b670 2024-09-10T05:11:47.622 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:47.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.582+0000 7fc49efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.582+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93892055005952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2999550 con 0x5564f2952320 2024-09-10T05:11:47.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.583+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93892055005952] v35'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.583+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93892055003536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2999550 con 0x7fc5d402e910 2024-09-10T05:11:47.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.584+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93892055003536] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.584+0000 7fc5ecb1f800 20 remove_watcher() i=0 2024-09-10T05:11:47.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.584+0000 7fc5ecb1f800 2 removed watcher, disabling cache 2024-09-10T05:11:47.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.584+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93892055010048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2999550 con 0x5564f2952320 2024-09-10T05:11:47.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.585+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93892055010048] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.585+0000 7fc5ecb1f800 20 remove_watcher() i=1 2024-09-10T05:11:47.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.585+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93892055004896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2999550 con 0x5564f295b670 2024-09-10T05:11:47.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.586+0000 7fc5e3fff640 1 -- 172.21.15.192:0/3254592316 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93892055004896] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5d4037040 con 0x5564f295b670 2024-09-10T05:11:47.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.586+0000 7fc5ecb1f800 20 remove_watcher() i=2 2024-09-10T05:11:47.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.586+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93892055016208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2999550 con 0x7fc5d402e910 2024-09-10T05:11:47.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.587+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93892055016208] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x7fc5d402e910 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.587+0000 7fc5ecb1f800 20 remove_watcher() i=3 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.587+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93892055020448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2999550 con 0x5564f2952320 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.588+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93892055020448] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e400a4d0 con 0x5564f2952320 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.588+0000 7fc5ecb1f800 20 remove_watcher() i=4 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.588+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93892055017648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2999550 con 0x5564f2956d10 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.589+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93892055017648] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.589+0000 7fc5ecb1f800 20 remove_watcher() i=5 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.589+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93892055024304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2999550 con 0x5564f2956d10 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.590+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93892055024304] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.590+0000 7fc5ecb1f800 20 remove_watcher() i=6 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.590+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93892055026912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5564f2999550 con 0x5564f2956d10 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5e88a9640 1 -- 172.21.15.192:0/3254592316 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93892055026912] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5dc07a030 con 0x5564f2956d10 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 20 remove_watcher() i=7 2024-09-10T05:11:47.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5564f2956d10 msgr2=0x5564f2959100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5564f2956d10 0x5564f2959100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5564f2952320 msgr2=0x5564f29547e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5564f2952320 0x5564f29547e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc5d402e910 msgr2=0x7fc5d403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc5d402e910 0x7fc5d403a3c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5564f295b670 msgr2=0x5564f295db30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5564f295b670 0x5564f295db30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4b403c780 msgr2=0x7fc4b403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4b403c780 0x7fc4b403ec40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400ffd0 tx=0x7fc5d4023040 comp rx=0 tx=0).stop 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 msgr2=0x5564f2946d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 0x5564f2946d30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc053730 tx=0x7fc5dc05af90 comp rx=0 tx=0).stop 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3254592316 reap_dead start 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 shutdown_connections 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3254592316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f293f970 0x5564f2946d30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 >> 172.21.15.192:0/3254592316 conn(0x5564f293bd70 msgr2=0x5564f2939f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 shutdown_connections 2024-09-10T05:11:47.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3254592316 wait complete. 2024-09-10T05:11:47.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/138582730 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4c003c780 msgr2=0x7fc4c003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/138582730 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4c003c780 0x7fc4c003ec40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5564f291cc00 tx=0x7fc5d4006000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/138582730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f29330f0 msgr2=0x5564f2933510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.591+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/138582730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f29330f0 0x5564f2933510 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc095f00 tx=0x7fc5dc05de70 comp rx=0 tx=0).stop 2024-09-10T05:11:47.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/138582730 shutdown_connections 2024-09-10T05:11:47.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/138582730 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4c003c780 0x7fc4c003ec40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/138582730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f29330f0 0x5564f2933510 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/138582730 >> 172.21.15.192:0/138582730 conn(0x5564f29274a0 msgr2=0x5564f2927880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/138582730 shutdown_connections 2024-09-10T05:11:47.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/138582730 wait complete. 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5564f291ea60 msgr2=0x5564f2920e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5564f291ea60 0x5564f2920e50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5564f281ae10 msgr2=0x5564f291c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5564f281ae10 0x5564f291c5f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5564f2922960 msgr2=0x5564f2924d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5564f2922960 0x5564f2924d50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4d003c780 msgr2=0x7fc4d003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc4d003c780 0x7fc4d003ec40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4000c00 tx=0x7fc5d40013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 msgr2=0x5564f2914fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 --2- 172.21.15.192:0/3676520397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564f281a4d0 0x5564f2914fa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc025c20 tx=0x7fc5dc002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5e90aa640 1 -- 172.21.15.192:0/3676520397 reap_dead start 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 shutdown_connections 2024-09-10T05:11:47.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 >> 172.21.15.192:0/3676520397 conn(0x5564f2816200 msgr2=0x5564f290e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 shutdown_connections 2024-09-10T05:11:47.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.592+0000 7fc5ecb1f800 1 -- 172.21.15.192:0/3676520397 wait complete. 2024-09-10T05:11:47.633 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:47.633 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-10T05:11:47.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-10T05:11:47.633 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-10T05:11:47.680 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:47.680 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:47.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.680+0000 7f0c84742800 1 Processor -- start 2024-09-10T05:11:47.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.680+0000 7f0c84742800 1 -- start start 2024-09-10T05:11:47.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.680+0000 7f0c84742800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5641e1781fc0 0x5641e178aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.680+0000 7f0c84742800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641e162be40 con 0x5641e17804a0 2024-09-10T05:11:47.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.680+0000 7f0c84742800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5641e15f6680 con 0x5641e1781fc0 2024-09-10T05:11:47.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.680+0000 7f0c77c85640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5641e1781fc0 0x5641e178aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.680+0000 7f0c80486640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5641e17804a0 0x5641e17808a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36268/0 (socket says 172.21.15.192:36268) 2024-09-10T05:11:47.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.680+0000 7f0c80486640 1 -- 172.21.15.192:0/2689949970 learned_addr learned my addr 172.21.15.192:0/2689949970 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:47.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.680+0000 7f0c77c85640 1 -- 172.21.15.192:0/2689949970 >> v1:172.21.15.139:6789/0 conn(0x5641e17804a0 legacy=0x5641e17808a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.680+0000 7f0c7fc85640 1 -- 172.21.15.192:0/2689949970 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261595516 0 0) 0x5641e162be40 con 0x5641e17804a0 2024-09-10T05:11:47.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.680+0000 7f0c77c85640 1 -- 172.21.15.192:0/2689949970 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e16126b0 con 0x5641e1781fc0 2024-09-10T05:11:47.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.682+0000 7f0c77c85640 1 --2- 172.21.15.192:0/2689949970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e1781fc0 0x5641e178aae0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800a470 tx=0x7f0c68045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb65f959da3e324 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.682+0000 7f0c7fc85640 1 -- 172.21.15.192:0/2689949970 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c68053570 con 0x5641e1781fc0 2024-09-10T05:11:47.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.682+0000 7f0c7fc85640 1 -- 172.21.15.192:0/2689949970 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c68058070 con 0x5641e1781fc0 2024-09-10T05:11:47.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.682+0000 7f0c7fc85640 1 -- 172.21.15.192:0/2689949970 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c68053880 con 0x5641e1781fc0 2024-09-10T05:11:47.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.683+0000 7f0c84742800 1 -- 172.21.15.192:0/2689949970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e1781fc0 msgr2=0x5641e178aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.683+0000 7f0c84742800 1 --2- 172.21.15.192:0/2689949970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e1781fc0 0x5641e178aae0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800a470 tx=0x7f0c68045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:47.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.683+0000 7f0c84742800 1 -- 172.21.15.192:0/2689949970 shutdown_connections 2024-09-10T05:11:47.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.683+0000 7f0c84742800 1 --2- 172.21.15.192:0/2689949970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e1781fc0 0x5641e178aae0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.683+0000 7f0c84742800 1 -- 172.21.15.192:0/2689949970 >> 172.21.15.192:0/2689949970 conn(0x5641e177c1d0 msgr2=0x5641e177e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.683+0000 7f0c84742800 1 -- 172.21.15.192:0/2689949970 shutdown_connections 2024-09-10T05:11:47.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.683+0000 7f0c84742800 1 -- 172.21.15.192:0/2689949970 wait complete. 2024-09-10T05:11:47.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.697+0000 7f0c84742800 1 Processor -- start 2024-09-10T05:11:47.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.697+0000 7f0c84742800 1 -- start start 2024-09-10T05:11:47.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.697+0000 7f0c84742800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 0x5641e1873680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.697+0000 7f0c84742800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5641e161add0 con 0x5641e17804a0 2024-09-10T05:11:47.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.697+0000 7f0c80486640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 0x5641e1873680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.698+0000 7f0c80486640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 0x5641e1873680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59604/0 (socket says 172.21.15.192:59604) 2024-09-10T05:11:47.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.698+0000 7f0c80486640 1 -- 172.21.15.192:0/460241711 learned_addr learned my addr 172.21.15.192:0/460241711 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.698+0000 7f0c80486640 1 -- 172.21.15.192:0/460241711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e1633e10 con 0x5641e17804a0 2024-09-10T05:11:47.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.698+0000 7f0c80486640 1 --2- 172.21.15.192:0/460241711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 0x5641e1873680 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0c70001ea0 tx=0x7f0c7000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63ddf9c575280dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.698+0000 7f0b6e60c640 1 -- 172.21.15.192:0/460241711 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c70008070 con 0x5641e17804a0 2024-09-10T05:11:47.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.698+0000 7f0b6e60c640 1 -- 172.21.15.192:0/460241711 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7000d500 con 0x5641e17804a0 2024-09-10T05:11:47.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.698+0000 7f0b6e60c640 1 -- 172.21.15.192:0/460241711 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c7000d880 con 0x5641e17804a0 2024-09-10T05:11:47.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.699+0000 7f0c84742800 1 -- 172.21.15.192:0/460241711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 msgr2=0x5641e1873680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.699+0000 7f0c84742800 1 --2- 172.21.15.192:0/460241711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 0x5641e1873680 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0c70001ea0 tx=0x7f0c7000b6a0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.699+0000 7f0c84742800 1 -- 172.21.15.192:0/460241711 shutdown_connections 2024-09-10T05:11:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.699+0000 7f0c84742800 1 --2- 172.21.15.192:0/460241711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 0x5641e1873680 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.699+0000 7f0c84742800 1 -- 172.21.15.192:0/460241711 >> 172.21.15.192:0/460241711 conn(0x5641e177c1d0 msgr2=0x5641e186f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.699+0000 7f0c84742800 1 -- 172.21.15.192:0/460241711 shutdown_connections 2024-09-10T05:11:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.699+0000 7f0c84742800 1 -- 172.21.15.192:0/460241711 wait complete. 2024-09-10T05:11:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.699+0000 7f0c84742800 1 Processor -- start 2024-09-10T05:11:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.699+0000 7f0c84742800 1 -- start start 2024-09-10T05:11:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.699+0000 7f0c84742800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 0x5641e187afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.699+0000 7f0c84742800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5641e178b2f0 con 0x5641e17804a0 2024-09-10T05:11:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.699+0000 7f0c80486640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 0x5641e187afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.700+0000 7f0c80486640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 0x5641e187afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59610/0 (socket says 172.21.15.192:59610) 2024-09-10T05:11:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.700+0000 7f0c80486640 1 -- 172.21.15.192:0/1084219796 learned_addr learned my addr 172.21.15.192:0/1084219796 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.700+0000 7f0c80486640 1 -- 172.21.15.192:0/1084219796 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e187b540 con 0x5641e17804a0 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.700+0000 7f0c80486640 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 0x5641e187afe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0c700012f0 tx=0x7f0c70000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.700+0000 7f0b6ce09640 1 -- 172.21.15.192:0/1084219796 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c7000f9d0 con 0x5641e17804a0 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.700+0000 7f0b6ce09640 1 -- 172.21.15.192:0/1084219796 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7000fb70 con 0x5641e17804a0 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.700+0000 7f0b6ce09640 1 -- 172.21.15.192:0/1084219796 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c7000fe50 con 0x5641e17804a0 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.700+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641e187b7d0 con 0x5641e17804a0 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.700+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e187c1d0 con 0x5641e17804a0 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.701+0000 7f0b6ce09640 1 -- 172.21.15.192:0/1084219796 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0c70017040 con 0x5641e17804a0 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.701+0000 7f0b6ce09640 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b6803c920 0x7f0b6803ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.701+0000 7f0b6ce09640 1 -- 172.21.15.192:0/1084219796 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f0c70015020 con 0x5641e17804a0 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.701+0000 7f0c77c85640 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b6803c920 0x7f0b6803ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.701+0000 7f0c84742800 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5641e1781fc0 0x5641e1882630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.701+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e1882b70 con 0x5641e1781fc0 2024-09-10T05:11:47.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.702+0000 7f0c80c87640 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5641e1781fc0 0x5641e1882630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.702+0000 7f0c77c85640 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b6803c920 0x7f0b6803ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0c68057000 tx=0x7f0c68052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.702+0000 7f0c80c87640 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5641e1781fc0 0x5641e1882630 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.702+0000 7f0c80c87640 1 -- 172.21.15.192:0/1084219796 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e1781fc0 2024-09-10T05:11:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.702+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e1882f10 con 0x5641e1781fc0 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.702+0000 7f0c80c87640 1 -- 172.21.15.192:0/1084219796 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e1781fc0 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.702+0000 7f0c84742800 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5641e1884a10 0x5641e1886e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.702+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e1887620 con 0x5641e1884a10 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.703+0000 7f0c80486640 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5641e1884a10 0x5641e1886e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.703+0000 7f0c80486640 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5641e1884a10 0x5641e1886e90 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.703+0000 7f0c80486640 1 -- 172.21.15.192:0/1084219796 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c7002d070 con 0x5641e1884a10 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.703+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e1883760 con 0x5641e1781fc0 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.703+0000 7f0c80c87640 1 -- 172.21.15.192:0/1084219796 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e1781fc0 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.703+0000 7f0c84742800 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5641e1888a80 0x5641e188ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.703+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e188b5e0 con 0x5641e1888a80 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.704+0000 7f0c77c85640 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5641e1888a80 0x5641e188ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.704+0000 7f0c77c85640 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5641e1888a80 0x5641e188ae70 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.704+0000 7f0c77c85640 1 -- 172.21.15.192:0/1084219796 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0c68051070 con 0x5641e1888a80 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0c84742800 1 Processor -- start 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0c84742800 1 -- start start 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0c84742800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e1899210 0x5641e1899630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0c84742800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5641e1678a00 con 0x5641e1899210 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0c80486640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e1899210 0x5641e1899630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0c80486640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e1899210 0x5641e1899630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59616/0 (socket says 172.21.15.192:59616) 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0c80486640 1 -- 172.21.15.192:0/1521145756 learned_addr learned my addr 172.21.15.192:0/1521145756 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0c80486640 1 -- 172.21.15.192:0/1521145756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e1899c70 con 0x5641e1899210 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0c80486640 1 --2- 172.21.15.192:0/1521145756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e1899210 0x5641e1899630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000e660 tx=0x7f0c70018860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0b65ffb640 1 -- 172.21.15.192:0/1521145756 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c700511b0 con 0x5641e1899210 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0b65ffb640 1 -- 172.21.15.192:0/1521145756 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c70044910 con 0x5641e1899210 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0c84742800 1 -- 172.21.15.192:0/1521145756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641e189a4a0 con 0x5641e1899210 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.705+0000 7f0b65ffb640 1 -- 172.21.15.192:0/1521145756 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c70044bf0 con 0x5641e1899210 2024-09-10T05:11:47.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.706+0000 7f0c84742800 1 -- 172.21.15.192:0/1521145756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e189aa40 con 0x5641e1899210 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.706+0000 7f0b65ffb640 1 -- 172.21.15.192:0/1521145756 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0c7003f8e0 con 0x5641e1899210 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.706+0000 7f0b65ffb640 1 --2- 172.21.15.192:0/1521145756 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b5803c780 0x7f0b5803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.706+0000 7f0b65ffb640 1 -- 172.21.15.192:0/1521145756 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f0c7003d0e0 con 0x5641e1899210 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.706+0000 7f0c77c85640 1 --2- 172.21.15.192:0/1521145756 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b5803c780 0x7f0b5803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.707+0000 7f0c84742800 1 Processor -- start 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.707+0000 7f0c84742800 1 -- start start 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.707+0000 7f0c77c85640 1 --2- 172.21.15.192:0/1521145756 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b5803c780 0x7f0b5803ec40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c68045f20 tx=0x7f0c68005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.707+0000 7f0c84742800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 0x5641e18a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.707+0000 7f0c84742800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5641e1873ed0 con 0x5641e18a5a90 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.707+0000 7f0c80486640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 0x5641e18a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.707+0000 7f0c80486640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 0x5641e18a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59622/0 (socket says 172.21.15.192:59622) 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.707+0000 7f0c80486640 1 -- 172.21.15.192:0/574536706 learned_addr learned my addr 172.21.15.192:0/574536706 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.707+0000 7f0c80486640 1 -- 172.21.15.192:0/574536706 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e18a6480 con 0x5641e18a5a90 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.707+0000 7f0c80486640 1 --2- 172.21.15.192:0/574536706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 0x5641e18a5e90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0c7003b490 tx=0x7f0c7004ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45ba769c92d0cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.708+0000 7f0b5f7fe640 1 -- 172.21.15.192:0/574536706 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c70044d90 con 0x5641e18a5a90 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.708+0000 7f0b5f7fe640 1 -- 172.21.15.192:0/574536706 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c70026430 con 0x5641e18a5a90 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.708+0000 7f0b5f7fe640 1 -- 172.21.15.192:0/574536706 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c7002f3e0 con 0x5641e18a5a90 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.708+0000 7f0c84742800 1 -- 172.21.15.192:0/574536706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 msgr2=0x5641e18a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.708+0000 7f0c84742800 1 --2- 172.21.15.192:0/574536706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 0x5641e18a5e90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0c7003b490 tx=0x7f0c7004ba70 comp rx=0 tx=0).stop 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.708+0000 7f0c84742800 1 -- 172.21.15.192:0/574536706 shutdown_connections 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.708+0000 7f0c84742800 1 --2- 172.21.15.192:0/574536706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 0x5641e18a5e90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.708+0000 7f0c84742800 1 -- 172.21.15.192:0/574536706 >> 172.21.15.192:0/574536706 conn(0x5641e18a1e90 msgr2=0x5641e18a00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.708+0000 7f0c84742800 1 -- 172.21.15.192:0/574536706 shutdown_connections 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.708+0000 7f0c84742800 1 -- 172.21.15.192:0/574536706 wait complete. 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.708+0000 7f0c84742800 1 Processor -- start 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.708+0000 7f0c84742800 1 -- start start 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.709+0000 7f0c84742800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 0x5641e18acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.709+0000 7f0c84742800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5641e18a68f0 con 0x5641e18a5a90 2024-09-10T05:11:47.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.709+0000 7f0c80486640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 0x5641e18acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.709+0000 7f0c80486640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 0x5641e18acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59630/0 (socket says 172.21.15.192:59630) 2024-09-10T05:11:47.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.709+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 learned_addr learned my addr 172.21.15.192:0/2253902589 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.709+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e18ad450 con 0x5641e18a5a90 2024-09-10T05:11:47.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.709+0000 7f0c80486640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 0x5641e18acef0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0c7003e780 tx=0x7f0c7003b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.709+0000 7f0b5dffb640 1 -- 172.21.15.192:0/2253902589 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c70070070 con 0x5641e18a5a90 2024-09-10T05:11:47.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.709+0000 7f0b5dffb640 1 -- 172.21.15.192:0/2253902589 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7004b550 con 0x5641e18a5a90 2024-09-10T05:11:47.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.709+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641e18ad450 con 0x5641e18a5a90 2024-09-10T05:11:47.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.709+0000 7f0b5dffb640 1 -- 172.21.15.192:0/2253902589 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c70026cc0 con 0x5641e18a5a90 2024-09-10T05:11:47.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.709+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e18ada50 con 0x5641e18a5a90 2024-09-10T05:11:47.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.710+0000 7f0b5dffb640 1 -- 172.21.15.192:0/2253902589 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0c70073070 con 0x5641e18a5a90 2024-09-10T05:11:47.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.710+0000 7f0b5dffb640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b5003c6e0 0x7f0b5003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.710+0000 7f0b5dffb640 1 -- 172.21.15.192:0/2253902589 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f0c70068070 con 0x5641e18a5a90 2024-09-10T05:11:47.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.710+0000 7f0c77c85640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b5003c6e0 0x7f0b5003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.711+0000 7f0c77c85640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b5003c6e0 0x7f0b5003eba0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0c680539f0 tx=0x7f0c6806b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.711+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.711+0000 7f0c84742800 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5641e18b84e0 0x5641e18ba9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.711+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bb0f0 con 0x5641e18b84e0 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.711+0000 7f0c80c87640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5641e18b84e0 0x5641e18ba9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.711+0000 7f0c80c87640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5641e18b84e0 0x5641e18ba9a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 20 realm 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bb500 con 0x5641e18b84e0 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:47.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bbdd0 con 0x5641e18b84e0 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18b84e0 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5641e18bced0 0x5641e18bf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bf880 con 0x5641e18bced0 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.712+0000 7f0c80486640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5641e18bced0 0x5641e18bf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.713+0000 7f0c80486640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5641e18bced0 0x5641e18bf2c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.713+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.713+0000 7f0c84742800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.713+0000 7f0c84742800 20 searching for the correct realm 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.713+0000 7f0c84742800 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5641e18c1830 0x5641e18c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.713+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c43c0 con 0x5641e18c1830 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.713+0000 7f0c77c85640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5641e18c1830 0x5641e18c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.713+0000 7f0c77c85640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5641e18c1830 0x5641e18c3cf0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.714+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.714+0000 7f0c77c85640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0c6808a040 0x7f0c6808a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.714+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c43c0 con 0x7f0c6808a040 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.714+0000 7f0c80c87640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0c6808a040 0x7f0c6808a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.714+0000 7f0c80c87640 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0c6808a040 0x7f0c6808a420 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.714+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.714+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18bced0 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.715+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.715+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18b84e0 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.715+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.715+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18b84e0 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.715+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.715+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18bced0 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.715+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.715+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18bced0 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.716+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.716+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x7f0c6808a040 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.716+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.716+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18c1830 2024-09-10T05:11:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.716+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.716+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18b84e0 2024-09-10T05:11:47.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.716+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.716+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18bced0 2024-09-10T05:11:47.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.717+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.717+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18b84e0 2024-09-10T05:11:47.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.717+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.717+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x7f0c6808a040 2024-09-10T05:11:47.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.717+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.717+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18c1830 2024-09-10T05:11:47.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.717+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.717+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18c1830 2024-09-10T05:11:47.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.718+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.718+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18bced0 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.718+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.718+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18c1830 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.718+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.718+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18c1830 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.718+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.718+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18b84e0 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.719+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.719+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18b84e0 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.719+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.719+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18bced0 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.719+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.719+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18c1830 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.719+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.719+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x7f0c6808a040 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.720+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.720+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18b84e0 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.720+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.720+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18bced0 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.720+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.720+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18c1830 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.720+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.720+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18bced0 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.721+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.721+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x7f0c6808a040 2024-09-10T05:11:47.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.721+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.721+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18c1830 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.721+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.721+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18bced0 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.721+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.721+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x5641e18b84e0 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5641e18bc170 con 0x7f0c6808a040 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:47.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c0140 con 0x5641e18b84e0 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c0140 con 0x5641e18b84e0 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.722+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c0140 con 0x7f0c6808a040 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:47.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 20 zone default found 2024-09-10T05:11:47.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 4 Realm: () 2024-09-10T05:11:47.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:47.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:47.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:47.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 20 zonegroup default 2024-09-10T05:11:47.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c0140 con 0x5641e18bced0 2024-09-10T05:11:47.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c6230 con 0x5641e18c1830 2024-09-10T05:11:47.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.723+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c65d0 con 0x5641e18c1830 2024-09-10T05:11:47.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.724+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.724+0000 7f0c84742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.724+0000 7f0c84742800 20 started sync module instance, tier type = 2024-09-10T05:11:47.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.724+0000 7f0c84742800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:47.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.724+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c56d0 con 0x7f0c6808a040 2024-09-10T05:11:47.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.725+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.725+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94840956935200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c56d0 con 0x7f0c6808a040 2024-09-10T05:11:47.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.725+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c6f90 con 0x5641e18b84e0 2024-09-10T05:11:47.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.726+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94840956935200] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.726+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.726+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94840956933120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c6f90 con 0x5641e18b84e0 2024-09-10T05:11:47.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.726+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c7990 con 0x5641e18c1830 2024-09-10T05:11:47.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.727+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.727+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94840956941472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c8230 con 0x5641e18c1830 2024-09-10T05:11:47.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.727+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c8cd0 con 0x7f0c6808a040 2024-09-10T05:11:47.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.727+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94840956933120] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.728+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94840956941472] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.728+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.728+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94840956943744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c6ae0 con 0x7f0c6808a040 2024-09-10T05:11:47.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.728+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c95a0 con 0x5641e18b84e0 2024-09-10T05:11:47.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.729+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94840956943744] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.729+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.729+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94840956946336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c9550 con 0x5641e18b84e0 2024-09-10T05:11:47.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.729+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c9fb0 con 0x5641e18bced0 2024-09-10T05:11:47.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.730+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.730+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94840956951296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18ca850 con 0x5641e18bced0 2024-09-10T05:11:47.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.730+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18cb2a0 con 0x5641e18bced0 2024-09-10T05:11:47.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.730+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94840956946336] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.731+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94840956951296] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.731+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.731+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94840956956048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18cb6c0 con 0x5641e18bced0 2024-09-10T05:11:47.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.731+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18cbf10 con 0x5641e18bced0 2024-09-10T05:11:47.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.732+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.732+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94840956956048] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.732+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94840956958880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c9140 con 0x5641e18bced0 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.732+0000 7f0c84742800 20 add_watcher() i=0 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.732+0000 7f0c84742800 20 add_watcher() i=1 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.732+0000 7f0c84742800 20 add_watcher() i=2 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.732+0000 7f0c84742800 20 add_watcher() i=3 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.732+0000 7f0c84742800 20 add_watcher() i=4 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.732+0000 7f0c84742800 20 add_watcher() i=5 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.732+0000 7f0c84742800 20 add_watcher() i=6 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.733+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94840956958880] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.733+0000 7f0c84742800 20 add_watcher() i=7 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.733+0000 7f0c84742800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.733+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e18cf2e0 con 0x5641e18b84e0 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.734+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.734+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94840956959936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18cc830 con 0x5641e18b84e0 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.735+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94840956959936] v35'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.735+0000 7f0b367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.735+0000 7f0c84742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.735+0000 7f0c84742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.735+0000 7f0c84742800 5 note: GC not initialized 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.735+0000 7f0b357e2640 20 reqs_thread_entry: start 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.735+0000 7f0c84742800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.735+0000 7f0c84742800 20 Filter name: none 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0aa6ffd640 20 reqs_thread_entry: start 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0c84742800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e19023b0 con 0x5641e18b84e0 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0c84742800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0c84742800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0c84742800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0c84742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0c84742800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0c84742800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e1902cc0 con 0x5641e18b84e0 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.736+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.737+0000 7f0c84742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.737+0000 7f0c84742800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.737+0000 7f0c84742800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.737+0000 7f0c84742800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.737+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e1908680 con 0x5641e18b84e0 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v35'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0c84742800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0c84742800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0c84742800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94840957206720 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e1903cd0 con 0x5641e18b84e0 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== watch-notify(notify (1) cookie 94840956946336 notify 150323855365 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f0c78026780 con 0x5641e18b84e0 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0b5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855365 cookie 94840956946336 notifier 4371 bl.length()=732 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(65 notify.4 [notify cookie 94840957206720 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0b5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0b5f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0b5f7fe640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f0b44003ea0 con 0x5641e18b84e0 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== watch-notify(notify_complete (2) cookie 94840957206720 notify 150323855365 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0c78018ca0 con 0x5641e18b84e0 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.738+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e19080c0 con 0x5641e18b84e0 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.739+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.739+0000 7f0c84742800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-10T05:11:47.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.739+0000 7f0c84742800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T05:11:47.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.739+0000 7f0c84742800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-10T05:11:47.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.739+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94840957206720 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5641e1903820 con 0x7f0c6808a040 2024-09-10T05:11:47.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.740+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== watch-notify(notify (1) cookie 94840956935200 notify 150323855362 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f0c78018ca0 con 0x7f0c6808a040 2024-09-10T05:11:47.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.740+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(68 notify.0 [notify cookie 94840957206720 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.740+0000 7f0b5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855362 cookie 94840956935200 notifier 4371 bl.length()=166 2024-09-10T05:11:47.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.740+0000 7f0b5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-10T05:11:47.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.740+0000 7f0b5f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-10T05:11:47.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.740+0000 7f0b5f7fe640 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f0b44003ea0 con 0x7f0c6808a040 2024-09-10T05:11:47.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.740+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== watch-notify(notify_complete (2) cookie 94840957206720 notify 150323855362 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0c780050f0 con 0x7f0c6808a040 2024-09-10T05:11:47.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.740+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.755 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"vTCAy4IT40PQ6vmNiAIt11Z7UIzW17tNmI099rHr","active":true,"create_date":"2024-09-10T05:11:47.737747Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:47.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.741+0000 7f0b367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.741+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94840956959936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e1900250 con 0x5641e18b84e0 2024-09-10T05:11:47.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.742+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94840956959936] v35'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.742+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94840956935200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e1900250 con 0x7f0c6808a040 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.743+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94840956935200] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.743+0000 7f0c84742800 20 remove_watcher() i=0 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.743+0000 7f0c84742800 2 removed watcher, disabling cache 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.743+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94840956933120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e1900250 con 0x5641e18b84e0 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.744+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94840956933120] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.744+0000 7f0c84742800 20 remove_watcher() i=1 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.744+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94840956941472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e1900250 con 0x5641e18c1830 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.745+0000 7f0c77c85640 1 -- 172.21.15.192:0/2253902589 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94840956941472] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68051070 con 0x5641e18c1830 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.745+0000 7f0c84742800 20 remove_watcher() i=2 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.745+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94840956943744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c5400 con 0x7f0c6808a040 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.746+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94840956943744] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x7f0c6808a040 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.746+0000 7f0c84742800 20 remove_watcher() i=3 2024-09-10T05:11:47.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.746+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94840956946336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c5400 con 0x5641e18b84e0 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.747+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94840956946336] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c7800a4d0 con 0x5641e18b84e0 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.747+0000 7f0c84742800 20 remove_watcher() i=4 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.747+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94840956951296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c5400 con 0x5641e18bced0 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.748+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94840956951296] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.748+0000 7f0c84742800 20 remove_watcher() i=5 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.748+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94840956956048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18c5400 con 0x5641e18bced0 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.749+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94840956956048] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.749+0000 7f0c84742800 20 remove_watcher() i=6 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.749+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94840956958880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5641e18cad90 con 0x5641e18bced0 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c80486640 1 -- 172.21.15.192:0/2253902589 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94840956958880] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c70072030 con 0x5641e18bced0 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 20 remove_watcher() i=7 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5641e18bced0 msgr2=0x5641e18bf2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5641e18bced0 0x5641e18bf2c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5641e18b84e0 msgr2=0x5641e18ba9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5641e18b84e0 0x5641e18ba9a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0c6808a040 msgr2=0x7f0c6808a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0c6808a040 0x7f0c6808a420 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5641e18c1830 msgr2=0x5641e18c3cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5641e18c1830 0x5641e18c3cf0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b5003c6e0 msgr2=0x7f0b5003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b5003c6e0 0x7f0b5003eba0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0c680539f0 tx=0x7f0c6806b040 comp rx=0 tx=0).stop 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 msgr2=0x5641e18acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 --2- 172.21.15.192:0/2253902589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e18a5a90 0x5641e18acef0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0c7003e780 tx=0x7f0c7003b420 comp rx=0 tx=0).stop 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 reap_dead start 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c80c87640 1 -- 172.21.15.192:0/2253902589 reap_dead start 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 shutdown_connections 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 >> 172.21.15.192:0/2253902589 conn(0x5641e18a1e90 msgr2=0x5641e18a00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 shutdown_connections 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.750+0000 7f0c84742800 1 -- 172.21.15.192:0/2253902589 wait complete. 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1521145756 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b5803c780 msgr2=0x7f0b5803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 --2- 172.21.15.192:0/1521145756 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b5803c780 0x7f0b5803ec40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c68045f20 tx=0x7f0c68005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1521145756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e1899210 msgr2=0x5641e1899630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 --2- 172.21.15.192:0/1521145756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e1899210 0x5641e1899630 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000e660 tx=0x7f0c70018860 comp rx=0 tx=0).stop 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1521145756 shutdown_connections 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 --2- 172.21.15.192:0/1521145756 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b5803c780 0x7f0b5803ec40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 --2- 172.21.15.192:0/1521145756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e1899210 0x5641e1899630 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1521145756 >> 172.21.15.192:0/1521145756 conn(0x5641e188d570 msgr2=0x5641e188d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1521145756 shutdown_connections 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1521145756 wait complete. 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5641e1884a10 msgr2=0x5641e1886e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5641e1884a10 0x5641e1886e90 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5641e1781fc0 msgr2=0x5641e1882630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5641e1781fc0 0x5641e1882630 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5641e1888a80 msgr2=0x5641e188ae70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5641e1888a80 0x5641e188ae70 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b6803c920 msgr2=0x7f0b6803ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0b6803c920 0x7f0b6803ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0c68057000 tx=0x7f0c68052000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 msgr2=0x5641e187afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 --2- 172.21.15.192:0/1084219796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641e17804a0 0x5641e187afe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0c700012f0 tx=0x7f0c70000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c80c87640 1 -- 172.21.15.192:0/1084219796 reap_dead start 2024-09-10T05:11:47.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 shutdown_connections 2024-09-10T05:11:47.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 >> 172.21.15.192:0/1084219796 conn(0x5641e177c1d0 msgr2=0x5641e1874960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 shutdown_connections 2024-09-10T05:11:47.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.751+0000 7f0c84742800 1 -- 172.21.15.192:0/1084219796 wait complete. 2024-09-10T05:11:47.765 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'vTCAy4IT40PQ6vmNiAIt11Z7UIzW17tNmI099rHr', 'active': True, 'create_date': '2024-09-10T05:11:47.737747Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:47.765 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-10T05:11:47.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-10T05:11:47.766 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-10T05:11:47.814 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:47.814 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:47.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.813+0000 7f774d71f800 1 Processor -- start 2024-09-10T05:11:47.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.813+0000 7f774d71f800 1 -- start start 2024-09-10T05:11:47.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.814+0000 7f774d71f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c261da14c0 0x55c261da18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.814+0000 7f774d71f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c261c4ce40 con 0x55c261da1e00 2024-09-10T05:11:47.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.814+0000 7f774d71f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55c261c17680 con 0x55c261da14c0 2024-09-10T05:11:47.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.814+0000 7f77494a2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c261da14c0 0x55c261da18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.814+0000 7f7748ca1640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55c261da1e00 0x55c261da22b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36282/0 (socket says 172.21.15.192:36282) 2024-09-10T05:11:47.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.814+0000 7f7748ca1640 1 -- 172.21.15.192:0/2786230900 learned_addr learned my addr 172.21.15.192:0/2786230900 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:47.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.814+0000 7f77494a2640 1 -- 172.21.15.192:0/2786230900 >> v1:172.21.15.139:6789/0 conn(0x55c261da1e00 legacy=0x55c261da22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.814+0000 7f7743fff640 1 -- 172.21.15.192:0/2786230900 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1121663415 0 0) 0x55c261c4ce40 con 0x55c261da1e00 2024-09-10T05:11:47.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.814+0000 7f77494a2640 1 -- 172.21.15.192:0/2786230900 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c261c336b0 con 0x55c261da14c0 2024-09-10T05:11:47.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.816+0000 7f77494a2640 1 --2- 172.21.15.192:0/2786230900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261da18c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7744005fd0 tx=0x7f7744045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8275c703fb1c8a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.816+0000 7f7743fff640 1 -- 172.21.15.192:0/2786230900 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7744058530 con 0x55c261da14c0 2024-09-10T05:11:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.816+0000 7f7743fff640 1 -- 172.21.15.192:0/2786230900 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77440586d0 con 0x55c261da14c0 2024-09-10T05:11:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.816+0000 7f7743fff640 1 -- 172.21.15.192:0/2786230900 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77440589d0 con 0x55c261da14c0 2024-09-10T05:11:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.816+0000 7f774d71f800 1 -- 172.21.15.192:0/2786230900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 msgr2=0x55c261da18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.816+0000 7f774d71f800 1 --2- 172.21.15.192:0/2786230900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261da18c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7744005fd0 tx=0x7f7744045c30 comp rx=0 tx=0).stop 2024-09-10T05:11:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.817+0000 7f774d71f800 1 -- 172.21.15.192:0/2786230900 shutdown_connections 2024-09-10T05:11:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.817+0000 7f774d71f800 1 --2- 172.21.15.192:0/2786230900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261da18c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.817+0000 7f774d71f800 1 -- 172.21.15.192:0/2786230900 >> 172.21.15.192:0/2786230900 conn(0x55c261d9d210 msgr2=0x55c261d9f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.817+0000 7f774d71f800 1 -- 172.21.15.192:0/2786230900 shutdown_connections 2024-09-10T05:11:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.817+0000 7f774d71f800 1 -- 172.21.15.192:0/2786230900 wait complete. 2024-09-10T05:11:47.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.830+0000 7f774d71f800 1 Processor -- start 2024-09-10T05:11:47.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.830+0000 7f774d71f800 1 -- start start 2024-09-10T05:11:47.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.830+0000 7f774d71f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261e94760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.830+0000 7f774d71f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c261c3bdd0 con 0x55c261da14c0 2024-09-10T05:11:47.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.831+0000 7f77494a2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261e94760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.831+0000 7f77494a2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261e94760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59650/0 (socket says 172.21.15.192:59650) 2024-09-10T05:11:47.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.831+0000 7f77494a2640 1 -- 172.21.15.192:0/2991545142 learned_addr learned my addr 172.21.15.192:0/2991545142 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.831+0000 7f77494a2640 1 -- 172.21.15.192:0/2991545142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c261c54e10 con 0x55c261da14c0 2024-09-10T05:11:47.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.831+0000 7f77494a2640 1 --2- 172.21.15.192:0/2991545142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261e94760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7744025a60 tx=0x7f7744051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450338bd98f8acaa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.831+0000 7f7637606640 1 -- 172.21.15.192:0/2991545142 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7744068070 con 0x55c261da14c0 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.831+0000 7f7637606640 1 -- 172.21.15.192:0/2991545142 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7744058880 con 0x55c261da14c0 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.831+0000 7f7637606640 1 -- 172.21.15.192:0/2991545142 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7744058ba0 con 0x55c261da14c0 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.832+0000 7f774d71f800 1 -- 172.21.15.192:0/2991545142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 msgr2=0x55c261e94760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.832+0000 7f774d71f800 1 --2- 172.21.15.192:0/2991545142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261e94760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7744025a60 tx=0x7f7744051000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.832+0000 7f774d71f800 1 -- 172.21.15.192:0/2991545142 shutdown_connections 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.832+0000 7f774d71f800 1 --2- 172.21.15.192:0/2991545142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261e94760 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.832+0000 7f774d71f800 1 -- 172.21.15.192:0/2991545142 >> 172.21.15.192:0/2991545142 conn(0x55c261d9d210 msgr2=0x55c261e900e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.832+0000 7f774d71f800 1 -- 172.21.15.192:0/2991545142 shutdown_connections 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.832+0000 7f774d71f800 1 -- 172.21.15.192:0/2991545142 wait complete. 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.832+0000 7f774d71f800 1 Processor -- start 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.833+0000 7f774d71f800 1 -- start start 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.833+0000 7f774d71f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261e9c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.833+0000 7f774d71f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c261da2d80 con 0x55c261da14c0 2024-09-10T05:11:47.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.833+0000 7f77494a2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261e9c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.833+0000 7f77494a2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261e9c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59662/0 (socket says 172.21.15.192:59662) 2024-09-10T05:11:47.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.833+0000 7f77494a2640 1 -- 172.21.15.192:0/747892308 learned_addr learned my addr 172.21.15.192:0/747892308 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.833+0000 7f77494a2640 1 -- 172.21.15.192:0/747892308 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c261e9c590 con 0x55c261da14c0 2024-09-10T05:11:47.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.833+0000 7f77494a2640 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261e9c030 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7744025a60 tx=0x7f7744003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.833+0000 7f7635e03640 1 -- 172.21.15.192:0/747892308 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7744068040 con 0x55c261da14c0 2024-09-10T05:11:47.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.833+0000 7f7635e03640 1 -- 172.21.15.192:0/747892308 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7744071070 con 0x55c261da14c0 2024-09-10T05:11:47.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.834+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c261e9c820 con 0x55c261da14c0 2024-09-10T05:11:47.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.834+0000 7f7635e03640 1 -- 172.21.15.192:0/747892308 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77440637b0 con 0x55c261da14c0 2024-09-10T05:11:47.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.834+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c261e9d1a0 con 0x55c261da14c0 2024-09-10T05:11:47.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.834+0000 7f7635e03640 1 -- 172.21.15.192:0/747892308 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7744063950 con 0x55c261da14c0 2024-09-10T05:11:47.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.835+0000 7f7635e03640 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f763003c780 0x7f763003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.835+0000 7f7635e03640 1 -- 172.21.15.192:0/747892308 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f7744097390 con 0x55c261da14c0 2024-09-10T05:11:47.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.835+0000 7f7748ca1640 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f763003c780 0x7f763003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.835+0000 7f774d71f800 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c261da1e00 0x55c261ea3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.835+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261e9ddf0 con 0x55c261da1e00 2024-09-10T05:11:47.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.835+0000 7f7749ca3640 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c261da1e00 0x55c261ea3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.835+0000 7f7748ca1640 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f763003c780 0x7f763003ec40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7734000c00 tx=0x7f77340013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.835+0000 7f7749ca3640 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c261da1e00 0x55c261ea3680 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.835+0000 7f7749ca3640 1 -- 172.21.15.192:0/747892308 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f773c0083e0 con 0x55c261da1e00 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.835+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261e9d680 con 0x55c261da1e00 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.836+0000 7f7749ca3640 1 -- 172.21.15.192:0/747892308 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f773c0083e0 con 0x55c261da1e00 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.836+0000 7f774d71f800 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c261ea5b30 0x55c261ea7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.836+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261ea85f0 con 0x55c261ea5b30 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.836+0000 7f77494a2640 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c261ea5b30 0x55c261ea7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.836+0000 7f77494a2640 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c261ea5b30 0x55c261ea7f20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.837+0000 7f77494a2640 1 -- 172.21.15.192:0/747892308 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f77440769d0 con 0x55c261ea5b30 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.837+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261ea49d0 con 0x55c261da1e00 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.837+0000 7f7749ca3640 1 -- 172.21.15.192:0/747892308 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f773c0083e0 con 0x55c261da1e00 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.837+0000 7f774d71f800 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c261ea9a30 0x55c261eabe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.837+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261eac5b0 con 0x55c261ea9a30 2024-09-10T05:11:47.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.837+0000 7f7748ca1640 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c261ea9a30 0x55c261eabe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.837+0000 7f7748ca1640 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c261ea9a30 0x55c261eabe20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.837+0000 7f7748ca1640 1 -- 172.21.15.192:0/747892308 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f773400f670 con 0x55c261ea9a30 2024-09-10T05:11:47.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.838+0000 7f774d71f800 1 Processor -- start 2024-09-10T05:11:47.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.838+0000 7f774d71f800 1 -- start start 2024-09-10T05:11:47.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.838+0000 7f774d71f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261eba170 0x55c261eba590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.838+0000 7f774d71f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c261c99a00 con 0x55c261eba170 2024-09-10T05:11:47.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.838+0000 7f77494a2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261eba170 0x55c261eba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.838+0000 7f77494a2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261eba170 0x55c261eba590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59666/0 (socket says 172.21.15.192:59666) 2024-09-10T05:11:47.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.838+0000 7f77494a2640 1 -- 172.21.15.192:0/3956344315 learned_addr learned my addr 172.21.15.192:0/3956344315 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.839+0000 7f77494a2640 1 -- 172.21.15.192:0/3956344315 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c261ebabd0 con 0x55c261eba170 2024-09-10T05:11:47.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.839+0000 7f77494a2640 1 --2- 172.21.15.192:0/3956344315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261eba170 0x55c261eba590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7744095860 tx=0x7f774406e390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.839+0000 7f762effd640 1 -- 172.21.15.192:0/3956344315 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7744094360 con 0x55c261eba170 2024-09-10T05:11:47.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.839+0000 7f762effd640 1 -- 172.21.15.192:0/3956344315 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7744086070 con 0x55c261eba170 2024-09-10T05:11:47.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.839+0000 7f762effd640 1 -- 172.21.15.192:0/3956344315 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774406b8b0 con 0x55c261eba170 2024-09-10T05:11:47.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.839+0000 7f774d71f800 1 -- 172.21.15.192:0/3956344315 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c261ebb400 con 0x55c261eba170 2024-09-10T05:11:47.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.839+0000 7f774d71f800 1 -- 172.21.15.192:0/3956344315 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c261ebb9a0 con 0x55c261eba170 2024-09-10T05:11:47.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.839+0000 7f762effd640 1 -- 172.21.15.192:0/3956344315 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7744088030 con 0x55c261eba170 2024-09-10T05:11:47.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.840+0000 7f762effd640 1 --2- 172.21.15.192:0/3956344315 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f762003c780 0x7f762003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.840+0000 7f762effd640 1 -- 172.21.15.192:0/3956344315 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f774408bc50 con 0x55c261eba170 2024-09-10T05:11:47.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.840+0000 7f7748ca1640 1 --2- 172.21.15.192:0/3956344315 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f762003c780 0x7f762003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.840+0000 7f774d71f800 1 Processor -- start 2024-09-10T05:11:47.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.840+0000 7f7748ca1640 1 --2- 172.21.15.192:0/3956344315 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f762003c780 0x7f762003ec40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55c261eac9b0 tx=0x7f7734006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.840+0000 7f774d71f800 1 -- start start 2024-09-10T05:11:47.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.840+0000 7f774d71f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 0x55c261ec6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.840+0000 7f774d71f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c261e94ef0 con 0x55c261ec6a50 2024-09-10T05:11:47.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.840+0000 7f77494a2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 0x55c261ec6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.840+0000 7f77494a2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 0x55c261ec6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59672/0 (socket says 172.21.15.192:59672) 2024-09-10T05:11:47.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.841+0000 7f77494a2640 1 -- 172.21.15.192:0/1681048405 learned_addr learned my addr 172.21.15.192:0/1681048405 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.841+0000 7f77494a2640 1 -- 172.21.15.192:0/1681048405 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c261ec7420 con 0x55c261ec6a50 2024-09-10T05:11:47.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.841+0000 7f77494a2640 1 --2- 172.21.15.192:0/1681048405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 0x55c261ec6e30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f774404e720 tx=0x7f77440958e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f90b6952d45b6ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.841+0000 7f762cff9640 1 -- 172.21.15.192:0/1681048405 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77440a6070 con 0x55c261ec6a50 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.841+0000 7f762cff9640 1 -- 172.21.15.192:0/1681048405 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7744097db0 con 0x55c261ec6a50 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.841+0000 7f762cff9640 1 -- 172.21.15.192:0/1681048405 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7744065940 con 0x55c261ec6a50 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.841+0000 7f774d71f800 1 -- 172.21.15.192:0/1681048405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 msgr2=0x55c261ec6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.841+0000 7f774d71f800 1 --2- 172.21.15.192:0/1681048405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 0x55c261ec6e30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f774404e720 tx=0x7f77440958e0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.841+0000 7f774d71f800 1 -- 172.21.15.192:0/1681048405 shutdown_connections 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.841+0000 7f774d71f800 1 --2- 172.21.15.192:0/1681048405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 0x55c261ec6e30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.841+0000 7f774d71f800 1 -- 172.21.15.192:0/1681048405 >> 172.21.15.192:0/1681048405 conn(0x55c261ec2e50 msgr2=0x55c261ec1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.841+0000 7f774d71f800 1 -- 172.21.15.192:0/1681048405 shutdown_connections 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.842+0000 7f774d71f800 1 -- 172.21.15.192:0/1681048405 wait complete. 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.842+0000 7f774d71f800 1 Processor -- start 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.842+0000 7f774d71f800 1 -- start start 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.842+0000 7f774d71f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 0x55c261ecdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.842+0000 7f774d71f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c261ec78b0 con 0x55c261ec6a50 2024-09-10T05:11:47.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.842+0000 7f77494a2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 0x55c261ecdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.842+0000 7f77494a2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 0x55c261ecdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59682/0 (socket says 172.21.15.192:59682) 2024-09-10T05:11:47.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.842+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 learned_addr learned my addr 172.21.15.192:0/3046540004 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.842+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c261ece340 con 0x55c261ec6a50 2024-09-10T05:11:47.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.843+0000 7f77494a2640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 0x55c261ecdde0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f774404e720 tx=0x7f7744069ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.843+0000 7f761effd640 1 -- 172.21.15.192:0/3046540004 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77440bb070 con 0x55c261ec6a50 2024-09-10T05:11:47.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.843+0000 7f761effd640 1 -- 172.21.15.192:0/3046540004 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7744097bb0 con 0x55c261ec6a50 2024-09-10T05:11:47.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.843+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c261ece340 con 0x55c261ec6a50 2024-09-10T05:11:47.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.843+0000 7f761effd640 1 -- 172.21.15.192:0/3046540004 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77440a6040 con 0x55c261ec6a50 2024-09-10T05:11:47.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.843+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c261ece340 con 0x55c261ec6a50 2024-09-10T05:11:47.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.844+0000 7f761effd640 1 -- 172.21.15.192:0/3046540004 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f77440be070 con 0x55c261ec6a50 2024-09-10T05:11:47.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.844+0000 7f761effd640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f761403c780 0x7f761403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.844+0000 7f761effd640 1 -- 172.21.15.192:0/3046540004 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f77440b2030 con 0x55c261ec6a50 2024-09-10T05:11:47.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.844+0000 7f7748ca1640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f761403c780 0x7f761403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.845+0000 7f7748ca1640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f761403c780 0x7f761403ec40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f773400ffd0 tx=0x7f7734023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.845+0000 7f774d71f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.845+0000 7f774d71f800 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c261ed9350 0x55c261edb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.845+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261edbf60 con 0x55c261ed9350 2024-09-10T05:11:47.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.845+0000 7f7749ca3640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c261ed9350 0x55c261edb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.845+0000 7f7749ca3640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c261ed9350 0x55c261edb810 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.845+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f773c0083e0 con 0x55c261ed9350 2024-09-10T05:11:47.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.845+0000 7f774d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.845+0000 7f774d71f800 20 realm 2024-09-10T05:11:47.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.845+0000 7f774d71f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.845+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261edc370 con 0x55c261ed9350 2024-09-10T05:11:47.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f773c0083e0 con 0x55c261ed9350 2024-09-10T05:11:47.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f774d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f774d71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:47.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f774d71f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ed9350 2024-09-10T05:11:47.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f773c0083e0 con 0x55c261ed9350 2024-09-10T05:11:47.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f774d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f774d71f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcfe0 con 0x55c261ed9350 2024-09-10T05:11:47.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f773c0083e0 con 0x55c261ed9350 2024-09-10T05:11:47.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f774d71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f774d71f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f774d71f800 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c261edd9a0 0x55c261edfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee03e0 con 0x55c261edd9a0 2024-09-10T05:11:47.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f77494a2640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c261edd9a0 0x55c261edfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.846+0000 7f77494a2640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c261edd9a0 0x55c261edfd90 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.847+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.847+0000 7f774d71f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:47.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.847+0000 7f774d71f800 20 searching for the correct realm 2024-09-10T05:11:47.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.847+0000 7f774d71f800 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c261ee2370 0x55c261ee4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.847+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee4eb0 con 0x55c261ee2370 2024-09-10T05:11:47.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.847+0000 7f7748ca1640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c261ee2370 0x55c261ee4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.847+0000 7f7748ca1640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c261ee2370 0x55c261ee4830 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.847+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.847+0000 7f7748ca1640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f773402e910 0x7f773403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.848+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee4eb0 con 0x7f773402e910 2024-09-10T05:11:47.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.848+0000 7f7749ca3640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f773402e910 0x7f773403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.848+0000 7f7749ca3640 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f773402e910 0x7f773403a3c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.848+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f773c0083e0 con 0x7f773402e910 2024-09-10T05:11:47.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.848+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261edd9a0 2024-09-10T05:11:47.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.848+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.848+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ed9350 2024-09-10T05:11:47.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.849+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f773c0083e0 con 0x55c261ed9350 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.849+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ed9350 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.849+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.849+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261edd9a0 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.849+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.849+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261edd9a0 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.849+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.849+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x7f773402e910 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.850+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f773c026040 con 0x7f773402e910 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.850+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ee2370 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.850+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.850+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ed9350 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.850+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.850+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261edd9a0 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.850+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.850+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ed9350 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.851+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.851+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x7f773402e910 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.851+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f773c026040 con 0x7f773402e910 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.851+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ee2370 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.851+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.851+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ee2370 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.851+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.851+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261edd9a0 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.852+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.852+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ee2370 2024-09-10T05:11:47.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.852+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.852+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ee2370 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.852+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.852+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ed9350 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.852+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.852+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ed9350 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.852+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.852+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261edd9a0 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.853+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.853+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ee2370 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.853+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.853+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x7f773402e910 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.853+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f773c026040 con 0x7f773402e910 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.853+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ed9350 2024-09-10T05:11:47.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.853+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.853+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261edd9a0 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.854+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.854+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ee2370 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.854+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.854+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261edd9a0 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.854+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.854+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x7f773402e910 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.854+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f773c026040 con 0x7f773402e910 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ee2370 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261edd9a0 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x55c261ed9350 2024-09-10T05:11:47.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c261edcc40 con 0x7f773402e910 2024-09-10T05:11:47.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f773c026040 con 0x7f773402e910 2024-09-10T05:11:47.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f774d71f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:47.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f774d71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:47.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f774d71f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:47.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f774d71f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:47.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f774d71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:47.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f774d71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:47.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.855+0000 7f774d71f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee0780 con 0x55c261ed9350 2024-09-10T05:11:47.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee0780 con 0x55c261ed9350 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee0780 con 0x7f773402e910 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f773c026040 con 0x7f773402e910 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 20 zone default found 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 4 Realm: () 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:47.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 20 zonegroup default 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.856+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee10d0 con 0x55c261edd9a0 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f774d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f774d71f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee6d20 con 0x55c261ee2370 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f774d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f774d71f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee70c0 con 0x55c261ee2370 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f774d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f774d71f800 20 started sync module instance, tier type = 2024-09-10T05:11:47.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f774d71f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:47.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.857+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee61c0 con 0x7f773402e910 2024-09-10T05:11:47.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.858+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x7f773402e910 2024-09-10T05:11:47.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.858+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293355030208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee61c0 con 0x7f773402e910 2024-09-10T05:11:47.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.858+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee7a80 con 0x55c261ed9350 2024-09-10T05:11:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.859+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94293355030208] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x7f773402e910 2024-09-10T05:11:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.859+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.859+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94293355028208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee7a80 con 0x55c261ed9350 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.859+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee8440 con 0x55c261ee2370 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.860+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.860+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94293355036560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee8ce0 con 0x55c261ee2370 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.860+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee9780 con 0x7f773402e910 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.860+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94293355028208] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.861+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94293355036560] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.861+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x7f773402e910 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.861+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94293355038768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee75d0 con 0x7f773402e910 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.861+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261eea060 con 0x55c261ed9350 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.862+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.862+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94293355043568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261eea450 con 0x55c261ed9350 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.862+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261eeaf70 con 0x55c261edd9a0 2024-09-10T05:11:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.862+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94293355038768] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x7f773402e910 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.863+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94293355043568] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.863+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.863+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94293355044624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee9250 con 0x55c261edd9a0 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.863+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261eeb810 con 0x55c261edd9a0 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.864+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.864+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94293355051952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261eec480 con 0x55c261edd9a0 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.864+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261eecef0 con 0x55c261edd9a0 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.865+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94293355044624] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.865+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94293355051952] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.865+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.865+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94293355055552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261eec010 con 0x55c261edd9a0 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.865+0000 7f774d71f800 20 add_watcher() i=0 2024-09-10T05:11:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.865+0000 7f774d71f800 20 add_watcher() i=1 2024-09-10T05:11:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.865+0000 7f774d71f800 20 add_watcher() i=2 2024-09-10T05:11:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.865+0000 7f774d71f800 20 add_watcher() i=3 2024-09-10T05:11:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.865+0000 7f774d71f800 20 add_watcher() i=4 2024-09-10T05:11:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.865+0000 7f774d71f800 20 add_watcher() i=5 2024-09-10T05:11:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.865+0000 7f774d71f800 20 add_watcher() i=6 2024-09-10T05:11:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.866+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94293355055552] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.866+0000 7f774d71f800 20 add_watcher() i=7 2024-09-10T05:11:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.866+0000 7f774d71f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.866+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261eefff0 con 0x55c261ed9350 2024-09-10T05:11:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.866+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.867+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94293355047488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261eed470 con 0x55c261ed9350 2024-09-10T05:11:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.867+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94293355047488] v35'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.867+0000 7f75ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.868+0000 7f774d71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.868+0000 7f774d71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.868+0000 7f774d71f800 5 note: GC not initialized 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.868+0000 7f75fe7e4640 20 reqs_thread_entry: start 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.868+0000 7f774d71f800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.868+0000 7f774d71f800 20 Filter name: none 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.868+0000 7f756ffff640 20 reqs_thread_entry: start 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.868+0000 7f774d71f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.868+0000 7f774d71f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.868+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261f22e10 con 0x55c261ed9350 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.869+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.869+0000 7f774d71f800 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T05:11:47.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.869+0000 7f774d71f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.869+0000 7f774d71f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.869+0000 7f774d71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.869+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261f29390 con 0x55c261ed9350 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v35'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f774d71f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f774d71f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f774d71f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94293355302288 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c261f24a30 con 0x55c261ed9350 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 94293355043568 notify 150323855366 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f773c010040 con 0x55c261ed9350 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f762cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855366 cookie 94293355043568 notifier 4378 bl.length()=732 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f762cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f762cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(64 notify.4 [notify cookie 94293355302288 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f762cff9640 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f760c003ea0 con 0x55c261ed9350 2024-09-10T05:11:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.870+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== watch-notify(notify_complete (2) cookie 94293355302288 notify 150323855366 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f773c00a8b0 con 0x55c261ed9350 2024-09-10T05:11:47.886 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.871+0000 7f75ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.871+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94293355047488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261f24e60 con 0x55c261ed9350 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.872+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94293355047488] v35'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.872+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94293355030208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261f20c30 con 0x7f773402e910 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.873+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94293355030208] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x7f773402e910 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.873+0000 7f774d71f800 20 remove_watcher() i=0 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.873+0000 7f774d71f800 2 removed watcher, disabling cache 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.873+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94293355028208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261f20c30 con 0x55c261ed9350 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.874+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94293355028208] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.874+0000 7f774d71f800 20 remove_watcher() i=1 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.874+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94293355036560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261f20c30 con 0x55c261ee2370 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.875+0000 7f7748ca1640 1 -- 172.21.15.192:0/3046540004 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94293355036560] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7734037040 con 0x55c261ee2370 2024-09-10T05:11:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.875+0000 7f774d71f800 20 remove_watcher() i=2 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.875+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94293355038768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee5ef0 con 0x7f773402e910 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.876+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94293355038768] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x7f773402e910 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.876+0000 7f774d71f800 20 remove_watcher() i=3 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.876+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94293355043568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee7f90 con 0x55c261ed9350 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.877+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94293355043568] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f773c026040 con 0x55c261ed9350 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.877+0000 7f774d71f800 20 remove_watcher() i=4 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.877+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94293355044624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee8830 con 0x55c261edd9a0 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.878+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94293355044624] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.878+0000 7f774d71f800 20 remove_watcher() i=5 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.878+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94293355051952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee5ef0 con 0x55c261edd9a0 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.879+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94293355051952] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.879+0000 7f774d71f800 20 remove_watcher() i=6 2024-09-10T05:11:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.879+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94293355055552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c261ee7f90 con 0x55c261edd9a0 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.880+0000 7f77494a2640 1 -- 172.21.15.192:0/3046540004 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94293355055552] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77440bd030 con 0x55c261edd9a0 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.880+0000 7f774d71f800 20 remove_watcher() i=7 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.880+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c261edd9a0 msgr2=0x55c261edfd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.880+0000 7f774d71f800 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c261edd9a0 0x55c261edfd90 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.880+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c261ed9350 msgr2=0x55c261edb810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.880+0000 7f774d71f800 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c261ed9350 0x55c261edb810 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.880+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f773402e910 msgr2=0x7f773403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.880+0000 7f774d71f800 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f773402e910 0x7f773403a3c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.880+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c261ee2370 msgr2=0x55c261ee4830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.880+0000 7f774d71f800 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c261ee2370 0x55c261ee4830 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f761403c780 msgr2=0x7f761403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f761403c780 0x7f761403ec40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f773400ffd0 tx=0x7f7734023040 comp rx=0 tx=0).stop 2024-09-10T05:11:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 msgr2=0x55c261ecdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f7749ca3640 1 -- 172.21.15.192:0/3046540004 reap_dead start 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 0x55c261ecdde0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f774404e720 tx=0x7f7744069ef0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 shutdown_connections 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 --2- 172.21.15.192:0/3046540004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261ec6a50 0x55c261ecdde0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 >> 172.21.15.192:0/3046540004 conn(0x55c261ec2e50 msgr2=0x55c261ec1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 shutdown_connections 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/3046540004 wait complete. 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/3956344315 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f762003c780 msgr2=0x7f762003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 --2- 172.21.15.192:0/3956344315 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f762003c780 0x7f762003ec40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55c261eac9b0 tx=0x7f7734006000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/3956344315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261eba170 msgr2=0x55c261eba590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 --2- 172.21.15.192:0/3956344315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261eba170 0x55c261eba590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7744095860 tx=0x7f774406e390 comp rx=0 tx=0).stop 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/3956344315 shutdown_connections 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 --2- 172.21.15.192:0/3956344315 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f762003c780 0x7f762003ec40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 --2- 172.21.15.192:0/3956344315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261eba170 0x55c261eba590 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/3956344315 >> 172.21.15.192:0/3956344315 conn(0x55c261eae520 msgr2=0x55c261eae900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/3956344315 shutdown_connections 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/3956344315 wait complete. 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c261ea5b30 msgr2=0x55c261ea7f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c261ea5b30 0x55c261ea7f20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c261da1e00 msgr2=0x55c261ea3680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c261da1e00 0x55c261ea3680 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c261ea9a30 msgr2=0x55c261eabe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.881+0000 7f774d71f800 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c261ea9a30 0x55c261eabe20 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.882+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f763003c780 msgr2=0x7f763003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.882+0000 7f774d71f800 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f763003c780 0x7f763003ec40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7734000c00 tx=0x7f77340013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.882+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 msgr2=0x55c261e9c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.882+0000 7f774d71f800 1 --2- 172.21.15.192:0/747892308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c261da14c0 0x55c261e9c030 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7744025a60 tx=0x7f7744003330 comp rx=0 tx=0).stop 2024-09-10T05:11:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.882+0000 7f7749ca3640 1 -- 172.21.15.192:0/747892308 reap_dead start 2024-09-10T05:11:47.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.882+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 shutdown_connections 2024-09-10T05:11:47.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.882+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 >> 172.21.15.192:0/747892308 conn(0x55c261d9d210 msgr2=0x55c261e95920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.882+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 shutdown_connections 2024-09-10T05:11:47.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.882+0000 7f774d71f800 1 -- 172.21.15.192:0/747892308 wait complete. 2024-09-10T05:11:47.897 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:47.897 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:11:47.897 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:11:47.897 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:11:47.941 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:47.941 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:47.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.941+0000 7efe50f25800 1 Processor -- start 2024-09-10T05:11:47.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.941+0000 7efe50f25800 1 -- start start 2024-09-10T05:11:47.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.941+0000 7efe50f25800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55e890791720 0x55e890793b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.941+0000 7efe50f25800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e89063ae40 con 0x55e890794050 2024-09-10T05:11:47.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.942+0000 7efe50f25800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55e890605680 con 0x55e890791720 2024-09-10T05:11:47.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.942+0000 7efe4cb33640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55e890791720 0x55e890793b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.942+0000 7efe44332640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55e890794050 0x55e8907964e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36292/0 (socket says 172.21.15.192:36292) 2024-09-10T05:11:47.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.942+0000 7efe44332640 1 -- 172.21.15.192:0/1183672089 learned_addr learned my addr 172.21.15.192:0/1183672089 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:47.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.942+0000 7efe4cb33640 1 -- 172.21.15.192:0/1183672089 >> v1:172.21.15.139:6789/0 conn(0x55e890794050 legacy=0x55e8907964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.942+0000 7efe4cb33640 1 -- 172.21.15.192:0/1183672089 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8906216b0 con 0x55e890791720 2024-09-10T05:11:47.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.942+0000 7efe47fff640 1 -- 172.21.15.192:0/1183672089 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914190888 0 0) 0x55e89063ae40 con 0x55e890794050 2024-09-10T05:11:47.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.944+0000 7efe4cb33640 1 --2- 172.21.15.192:0/1183672089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890791720 0x55e890793b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00a470 tx=0x7efe3c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905cb5d02bd85dbf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.944+0000 7efe47fff640 1 -- 172.21.15.192:0/1183672089 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe3c053570 con 0x55e890791720 2024-09-10T05:11:47.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.944+0000 7efe47fff640 1 -- 172.21.15.192:0/1183672089 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c058070 con 0x55e890791720 2024-09-10T05:11:47.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.944+0000 7efe47fff640 1 -- 172.21.15.192:0/1183672089 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe3c053880 con 0x55e890791720 2024-09-10T05:11:47.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.944+0000 7efe50f25800 1 -- 172.21.15.192:0/1183672089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890791720 msgr2=0x55e890793b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.944+0000 7efe50f25800 1 --2- 172.21.15.192:0/1183672089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890791720 0x55e890793b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00a470 tx=0x7efe3c045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:47.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.944+0000 7efe50f25800 1 -- 172.21.15.192:0/1183672089 shutdown_connections 2024-09-10T05:11:47.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.944+0000 7efe50f25800 1 --2- 172.21.15.192:0/1183672089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890791720 0x55e890793b10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.944+0000 7efe50f25800 1 -- 172.21.15.192:0/1183672089 >> 172.21.15.192:0/1183672089 conn(0x55e89078b1c0 msgr2=0x55e89078d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.944+0000 7efe50f25800 1 -- 172.21.15.192:0/1183672089 shutdown_connections 2024-09-10T05:11:47.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.944+0000 7efe50f25800 1 -- 172.21.15.192:0/1183672089 wait complete. 2024-09-10T05:11:47.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.958+0000 7efe50f25800 1 Processor -- start 2024-09-10T05:11:47.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.958+0000 7efe50f25800 1 -- start start 2024-09-10T05:11:47.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.958+0000 7efe50f25800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 0x55e890790eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.958+0000 7efe50f25800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e890629dd0 con 0x55e890794050 2024-09-10T05:11:47.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.959+0000 7efe4cb33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 0x55e890790eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.959+0000 7efe4cb33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 0x55e890790eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59704/0 (socket says 172.21.15.192:59704) 2024-09-10T05:11:47.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.959+0000 7efe4cb33640 1 -- 172.21.15.192:0/2918953959 learned_addr learned my addr 172.21.15.192:0/2918953959 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.959+0000 7efe4cb33640 1 -- 172.21.15.192:0/2918953959 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e890642e10 con 0x55e890794050 2024-09-10T05:11:47.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.959+0000 7efe4cb33640 1 --2- 172.21.15.192:0/2918953959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 0x55e890790eb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efe3c045ed0 tx=0x7efe3c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd52b1488ad0509 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.959+0000 7efd3ae0d640 1 -- 172.21.15.192:0/2918953959 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe3c053930 con 0x55e890794050 2024-09-10T05:11:47.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.959+0000 7efd3ae0d640 1 -- 172.21.15.192:0/2918953959 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c063070 con 0x55e890794050 2024-09-10T05:11:47.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.959+0000 7efd3ae0d640 1 -- 172.21.15.192:0/2918953959 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe3c053c00 con 0x55e890794050 2024-09-10T05:11:47.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.960+0000 7efe50f25800 1 -- 172.21.15.192:0/2918953959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 msgr2=0x55e890790eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.960+0000 7efe50f25800 1 --2- 172.21.15.192:0/2918953959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 0x55e890790eb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efe3c045ed0 tx=0x7efe3c051000 comp rx=0 tx=0).stop 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.960+0000 7efe50f25800 1 -- 172.21.15.192:0/2918953959 shutdown_connections 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.960+0000 7efe50f25800 1 --2- 172.21.15.192:0/2918953959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 0x55e890790eb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.960+0000 7efe50f25800 1 -- 172.21.15.192:0/2918953959 >> 172.21.15.192:0/2918953959 conn(0x55e89078b1c0 msgr2=0x55e89087bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.960+0000 7efe50f25800 1 -- 172.21.15.192:0/2918953959 shutdown_connections 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.960+0000 7efe50f25800 1 -- 172.21.15.192:0/2918953959 wait complete. 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.960+0000 7efe50f25800 1 Processor -- start 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.960+0000 7efe50f25800 1 -- start start 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.961+0000 7efe50f25800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 0x55e89088a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.961+0000 7efe50f25800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e890798040 con 0x55e890794050 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.961+0000 7efe4cb33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 0x55e89088a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.961+0000 7efe4cb33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 0x55e89088a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59706/0 (socket says 172.21.15.192:59706) 2024-09-10T05:11:47.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.961+0000 7efe4cb33640 1 -- 172.21.15.192:0/1374908200 learned_addr learned my addr 172.21.15.192:0/1374908200 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.961+0000 7efe4cb33640 1 -- 172.21.15.192:0/1374908200 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89088a670 con 0x55e890794050 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.961+0000 7efe4cb33640 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 0x55e89088a110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efe3c045ed0 tx=0x7efe3c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.961+0000 7efd3960a640 1 -- 172.21.15.192:0/1374908200 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe3c0685a0 con 0x55e890794050 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.961+0000 7efd3960a640 1 -- 172.21.15.192:0/1374908200 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c068740 con 0x55e890794050 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.961+0000 7efd3960a640 1 -- 172.21.15.192:0/1374908200 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe3c068a20 con 0x55e890794050 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.961+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e89088a900 con 0x55e890794050 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.961+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e89088b300 con 0x55e890794050 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.962+0000 7efd3960a640 1 -- 172.21.15.192:0/1374908200 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7efe3c068bc0 con 0x55e890794050 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.962+0000 7efd3960a640 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd3403c780 0x7efd3403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.962+0000 7efd3960a640 1 -- 172.21.15.192:0/1374908200 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7efe3c06f030 con 0x55e890794050 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.962+0000 7efe44332640 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd3403c780 0x7efd3403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.963+0000 7efe50f25800 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e89088be20 0x55e890891760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.963+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e890891ce0 con 0x55e89088be20 2024-09-10T05:11:47.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.963+0000 7efe4d334640 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e89088be20 0x55e890891760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.963+0000 7efe44332640 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd3403c780 0x7efd3403ec40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efe34000c00 tx=0x7efe340013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.963+0000 7efe4d334640 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e89088be20 0x55e890891760 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.963+0000 7efe4d334640 1 -- 172.21.15.192:0/1374908200 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e89088be20 2024-09-10T05:11:47.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.963+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e89088b7d0 con 0x55e89088be20 2024-09-10T05:11:47.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.963+0000 7efe4d334640 1 -- 172.21.15.192:0/1374908200 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e89088be20 2024-09-10T05:11:47.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.964+0000 7efe50f25800 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e890893ff0 0x55e8908963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.964+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e890896ab0 con 0x55e890893ff0 2024-09-10T05:11:47.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.964+0000 7efe4cb33640 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e890893ff0 0x55e8908963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.964+0000 7efe4cb33640 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e890893ff0 0x55e8908963e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.964+0000 7efe4cb33640 1 -- 172.21.15.192:0/1374908200 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efe3c051070 con 0x55e890893ff0 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.964+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e890892e60 con 0x55e89088be20 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.965+0000 7efe4d334640 1 -- 172.21.15.192:0/1374908200 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e89088be20 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.965+0000 7efe50f25800 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e890897ef0 0x55e89089a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.965+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e89089aa20 con 0x55e890897ef0 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.965+0000 7efe44332640 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e890897ef0 0x55e89089a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.965+0000 7efe44332640 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e890897ef0 0x55e89089a2e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.965+0000 7efe44332640 1 -- 172.21.15.192:0/1374908200 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efe3400f670 con 0x55e890897ef0 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.966+0000 7efe50f25800 1 Processor -- start 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.966+0000 7efe50f25800 1 -- start start 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.966+0000 7efe50f25800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908a8600 0x55e8908a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.966+0000 7efe50f25800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e890687a00 con 0x55e8908a8600 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.966+0000 7efe4cb33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908a8600 0x55e8908a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.966+0000 7efe4cb33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908a8600 0x55e8908a8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59710/0 (socket says 172.21.15.192:59710) 2024-09-10T05:11:47.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.966+0000 7efe4cb33640 1 -- 172.21.15.192:0/456844555 learned_addr learned my addr 172.21.15.192:0/456844555 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.966+0000 7efe4cb33640 1 -- 172.21.15.192:0/456844555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8908a9060 con 0x55e8908a8600 2024-09-10T05:11:47.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.966+0000 7efe4cb33640 1 --2- 172.21.15.192:0/456844555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908a8600 0x55e8908a8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0964e0 tx=0x7efe3c05d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.966+0000 7efd327fc640 1 -- 172.21.15.192:0/456844555 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe3c052a60 con 0x55e8908a8600 2024-09-10T05:11:47.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.966+0000 7efd327fc640 1 -- 172.21.15.192:0/456844555 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c052c00 con 0x55e8908a8600 2024-09-10T05:11:47.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.966+0000 7efe50f25800 1 -- 172.21.15.192:0/456844555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8908a9890 con 0x55e8908a8600 2024-09-10T05:11:47.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.967+0000 7efd327fc640 1 -- 172.21.15.192:0/456844555 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe3c08fae0 con 0x55e8908a8600 2024-09-10T05:11:47.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.967+0000 7efe50f25800 1 -- 172.21.15.192:0/456844555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8908a9e30 con 0x55e8908a8600 2024-09-10T05:11:47.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.967+0000 7efd327fc640 1 -- 172.21.15.192:0/456844555 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7efe3c085070 con 0x55e8908a8600 2024-09-10T05:11:47.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.967+0000 7efd327fc640 1 --2- 172.21.15.192:0/456844555 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd2403c780 0x7efd2403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.967+0000 7efd327fc640 1 -- 172.21.15.192:0/456844555 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7efe3c09ec70 con 0x55e8908a8600 2024-09-10T05:11:47.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.968+0000 7efe44332640 1 --2- 172.21.15.192:0/456844555 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd2403c780 0x7efd2403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.968+0000 7efe50f25800 1 Processor -- start 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.968+0000 7efe44332640 1 --2- 172.21.15.192:0/456844555 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd2403c780 0x7efd2403ec40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55e890892190 tx=0x7efe34006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.968+0000 7efe50f25800 1 -- start start 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.968+0000 7efe50f25800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 0x55e8908b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.968+0000 7efe50f25800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e89078f750 con 0x55e8908b4f20 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.968+0000 7efe4cb33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 0x55e8908b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.968+0000 7efe4cb33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 0x55e8908b5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59718/0 (socket says 172.21.15.192:59718) 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.968+0000 7efe4cb33640 1 -- 172.21.15.192:0/3226880320 learned_addr learned my addr 172.21.15.192:0/3226880320 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.968+0000 7efe4cb33640 1 -- 172.21.15.192:0/3226880320 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8908b58f0 con 0x55e8908b4f20 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.969+0000 7efe4cb33640 1 --2- 172.21.15.192:0/3226880320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 0x55e8908b5300 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efe3c09d000 tx=0x7efe3c0866f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c3dd03b0b9f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.969+0000 7efd23fff640 1 -- 172.21.15.192:0/3226880320 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe3c0ab020 con 0x55e8908b4f20 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.969+0000 7efd23fff640 1 -- 172.21.15.192:0/3226880320 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c07b350 con 0x55e8908b4f20 2024-09-10T05:11:47.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.969+0000 7efd23fff640 1 -- 172.21.15.192:0/3226880320 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe3c04d0b0 con 0x55e8908b4f20 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.969+0000 7efe50f25800 1 -- 172.21.15.192:0/3226880320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 msgr2=0x55e8908b5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.969+0000 7efe50f25800 1 --2- 172.21.15.192:0/3226880320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 0x55e8908b5300 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efe3c09d000 tx=0x7efe3c0866f0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.969+0000 7efe50f25800 1 -- 172.21.15.192:0/3226880320 shutdown_connections 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.969+0000 7efe50f25800 1 --2- 172.21.15.192:0/3226880320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 0x55e8908b5300 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.969+0000 7efe50f25800 1 -- 172.21.15.192:0/3226880320 >> 172.21.15.192:0/3226880320 conn(0x55e8908b1320 msgr2=0x55e8908af560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.969+0000 7efe50f25800 1 -- 172.21.15.192:0/3226880320 shutdown_connections 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.969+0000 7efe50f25800 1 -- 172.21.15.192:0/3226880320 wait complete. 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.970+0000 7efe50f25800 1 Processor -- start 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.970+0000 7efe50f25800 1 -- start start 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.970+0000 7efe50f25800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 0x55e8908bc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.970+0000 7efe50f25800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e8908b5d80 con 0x55e8908b4f20 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.970+0000 7efe4cb33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 0x55e8908bc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.970+0000 7efe4cb33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 0x55e8908bc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59726/0 (socket says 172.21.15.192:59726) 2024-09-10T05:11:47.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.970+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 learned_addr learned my addr 172.21.15.192:0/644110693 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:47.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.970+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8908bc900 con 0x55e8908b4f20 2024-09-10T05:11:47.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.970+0000 7efe4cb33640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 0x55e8908bc3a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efe3c09eee0 tx=0x7efe3c087f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.971+0000 7efd227fc640 1 -- 172.21.15.192:0/644110693 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe3c0c0070 con 0x55e8908b4f20 2024-09-10T05:11:47.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.971+0000 7efd227fc640 1 -- 172.21.15.192:0/644110693 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c073420 con 0x55e8908b4f20 2024-09-10T05:11:47.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.971+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8908bc900 con 0x55e8908b4f20 2024-09-10T05:11:47.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.971+0000 7efd227fc640 1 -- 172.21.15.192:0/644110693 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe3c08fdb0 con 0x55e8908b4f20 2024-09-10T05:11:47.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.971+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8908bc900 con 0x55e8908b4f20 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.971+0000 7efd227fc640 1 -- 172.21.15.192:0/644110693 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7efe3c0c3070 con 0x55e8908b4f20 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.972+0000 7efd227fc640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd1803c780 0x7efd1803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.972+0000 7efd227fc640 1 -- 172.21.15.192:0/644110693 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7efe3c0b6030 con 0x55e8908b4f20 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.972+0000 7efe44332640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd1803c780 0x7efd1803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.972+0000 7efe50f25800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.972+0000 7efe50f25800 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e8908c7810 0x55e8908c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.972+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8908ca420 con 0x55e8908c7810 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.972+0000 7efe4d334640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e8908c7810 0x55e8908c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.972+0000 7efe44332640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd1803c780 0x7efd1803ec40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efe3400ffd0 tx=0x7efe34023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.972+0000 7efe4d334640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e8908c7810 0x55e8908c9cd0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.972+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.972+0000 7efe50f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 20 realm 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8908ca830 con 0x55e8908c7810 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb100 con 0x55e8908c7810 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908c7810 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e8908cbf90 0x55e8908ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8908ceac0 con 0x55e8908cbf90 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.973+0000 7efe4cb33640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e8908cbf90 0x55e8908ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.974+0000 7efe4cb33640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e8908cbf90 0x55e8908ce380 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.974+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.974+0000 7efe50f25800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.974+0000 7efe50f25800 20 searching for the correct realm 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.974+0000 7efe50f25800 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e8908d0b60 0x55e8908d3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.974+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d36f0 con 0x55e8908d0b60 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.974+0000 7efe44332640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e8908d0b60 0x55e8908d3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.974+0000 7efe44332640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e8908d0b60 0x55e8908d3020 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.975+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.975+0000 7efe44332640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7efe3402e910 0x7efe3403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.975+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d36f0 con 0x7efe3402e910 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.975+0000 7efe4d334640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7efe3402e910 0x7efe3403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.975+0000 7efe4d334640 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7efe3402e910 0x7efe3403a3c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.975+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.975+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908cbf90 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.976+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.976+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908c7810 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.976+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.976+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908c7810 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.976+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.976+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908cbf90 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.976+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.976+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908cbf90 2024-09-10T05:11:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.977+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.977+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x7efe3402e910 2024-09-10T05:11:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.977+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.977+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908d0b60 2024-09-10T05:11:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.977+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.977+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908c7810 2024-09-10T05:11:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.977+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.977+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908cbf90 2024-09-10T05:11:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.977+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.977+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908c7810 2024-09-10T05:11:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.978+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.978+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x7efe3402e910 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.978+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.978+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908d0b60 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.978+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.978+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908d0b60 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.978+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.978+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908cbf90 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.979+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.979+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908d0b60 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.979+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.979+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908d0b60 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.979+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.979+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908c7810 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.979+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.979+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908c7810 2024-09-10T05:11:47.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.979+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.979+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908cbf90 2024-09-10T05:11:47.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.980+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:47.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.980+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908d0b60 2024-09-10T05:11:47.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.980+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:47.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.980+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x7efe3402e910 2024-09-10T05:11:47.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.980+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:47.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.980+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908c7810 2024-09-10T05:11:47.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.980+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.980+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908cbf90 2024-09-10T05:11:47.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.981+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:47.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.981+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908d0b60 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.981+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.981+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908cbf90 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.981+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.981+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x7efe3402e910 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.981+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.981+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908d0b60 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.981+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.981+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908cbf90 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x55e8908c7810 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cb4a0 con 0x7efe3402e910 2024-09-10T05:11:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe50f25800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe50f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe50f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe50f25800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe50f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe50f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe50f25800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cf460 con 0x55e8908c7810 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe50f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe50f25800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.982+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cf460 con 0x55e8908c7810 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe50f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe50f25800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cf460 con 0x7efe3402e910 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe50f25800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe50f25800 20 zone default found 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe50f25800 4 Realm: () 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe50f25800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe50f25800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe50f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe50f25800 20 zonegroup default 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe50f25800 20 rados->read ofs=0 len=0 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.983+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cf850 con 0x55e8908cbf90 2024-09-10T05:11:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe50f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe50f25800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8908cf1e0 con 0x55e8908d0b60 2024-09-10T05:11:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe50f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe50f25800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d5560 con 0x55e8908d0b60 2024-09-10T05:11:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe50f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe50f25800 20 started sync module instance, tier type = 2024-09-10T05:11:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe50f25800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.984+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d4a00 con 0x7efe3402e910 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.985+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.985+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94457345953616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d4a00 con 0x7efe3402e910 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.985+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d5fd0 con 0x55e8908c7810 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.986+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94457345953616] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.986+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.986+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94457345956512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d4a00 con 0x55e8908c7810 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.986+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d6a60 con 0x55e8908d0b60 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.987+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94457345956512] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.987+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.987+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94457345951056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d4970 con 0x55e8908d0b60 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.987+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d7920 con 0x7efe3402e910 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.988+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94457345951056] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.988+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:48.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.988+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94457345963120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d7d40 con 0x7efe3402e910 2024-09-10T05:11:48.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.988+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d8610 con 0x55e8908c7810 2024-09-10T05:11:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.989+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.989+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94457345965376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d8160 con 0x55e8908c7810 2024-09-10T05:11:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.989+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d9590 con 0x55e8908cbf90 2024-09-10T05:11:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.990+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94457345963120] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.990+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94457345965376] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.991+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.991+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94457345968640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d7890 con 0x55e8908cbf90 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.991+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d9e60 con 0x55e8908cbf90 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.991+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.992+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94457345972576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908da270 con 0x55e8908cbf90 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.992+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908dad90 con 0x55e8908cbf90 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.992+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94457345968640] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.992+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94457345972576] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.992+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.992+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94457345976416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d9d80 con 0x55e8908cbf90 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.993+0000 7efe50f25800 20 add_watcher() i=0 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.993+0000 7efe50f25800 20 add_watcher() i=1 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.993+0000 7efe50f25800 20 add_watcher() i=2 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.993+0000 7efe50f25800 20 add_watcher() i=3 2024-09-10T05:11:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.993+0000 7efe50f25800 20 add_watcher() i=4 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.993+0000 7efe50f25800 20 add_watcher() i=5 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.993+0000 7efe50f25800 20 add_watcher() i=6 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.993+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94457345976416] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.993+0000 7efe50f25800 20 add_watcher() i=7 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.993+0000 7efe50f25800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.993+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8908ddd80 con 0x55e8908c7810 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.994+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.994+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94457345970336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908db230 con 0x55e8908c7810 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.995+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94457345970336] v35'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.995+0000 7efd037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.995+0000 7efe50f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.995+0000 7efe50f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.995+0000 7efe50f25800 5 note: GC not initialized 2024-09-10T05:11:48.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.995+0000 7efd027e4640 20 reqs_thread_entry: start 2024-09-10T05:11:48.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.995+0000 7efe50f25800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:48.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.995+0000 7efe50f25800 20 Filter name: none 2024-09-10T05:11:48.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.995+0000 7efcfbfff640 20 reqs_thread_entry: start 2024-09-10T05:11:48.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.995+0000 7efe50f25800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.995+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e890910940 con 0x55e8908c7810 2024-09-10T05:11:48.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.996+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:48.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.996+0000 7efe50f25800 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T05:11:48.008 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:48.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.997+0000 7efd037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.997+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94457345970336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e89090f410 con 0x55e8908c7810 2024-09-10T05:11:48.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.998+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94457345970336] v35'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:48.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.998+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94457345953616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e89090e840 con 0x7efe3402e910 2024-09-10T05:11:48.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.999+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94457345953616] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:48.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.999+0000 7efe50f25800 20 remove_watcher() i=0 2024-09-10T05:11:48.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.999+0000 7efe50f25800 2 removed watcher, disabling cache 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:47.999+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94457345956512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e89090e840 con 0x55e8908c7810 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.000+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94457345956512] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.000+0000 7efe50f25800 20 remove_watcher() i=1 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.000+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94457345951056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e89090e840 con 0x55e8908d0b60 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.001+0000 7efe44332640 1 -- 172.21.15.192:0/644110693 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94457345951056] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe34037040 con 0x55e8908d0b60 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.001+0000 7efe50f25800 20 remove_watcher() i=2 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.001+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94457345963120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d4f50 con 0x7efe3402e910 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.002+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94457345963120] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x7efe3402e910 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.002+0000 7efe50f25800 20 remove_watcher() i=3 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.002+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94457345965376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d4550 con 0x55e8908c7810 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.003+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94457345965376] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4800a4d0 con 0x55e8908c7810 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.003+0000 7efe50f25800 20 remove_watcher() i=4 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.003+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94457345968640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d7470 con 0x55e8908cbf90 2024-09-10T05:11:48.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.004+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94457345968640] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.004+0000 7efe50f25800 20 remove_watcher() i=5 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.004+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94457345972576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d4f50 con 0x55e8908cbf90 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.005+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94457345972576] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.005+0000 7efe50f25800 20 remove_watcher() i=6 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.005+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94457345976416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8908d7d40 con 0x55e8908cbf90 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe4cb33640 1 -- 172.21.15.192:0/644110693 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94457345976416] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe3c0c2030 con 0x55e8908cbf90 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 20 remove_watcher() i=7 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e8908cbf90 msgr2=0x55e8908ce380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e8908cbf90 0x55e8908ce380 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e8908c7810 msgr2=0x55e8908c9cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e8908c7810 0x55e8908c9cd0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7efe3402e910 msgr2=0x7efe3403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7efe3402e910 0x7efe3403a3c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e8908d0b60 msgr2=0x55e8908d3020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e8908d0b60 0x55e8908d3020 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd1803c780 msgr2=0x7efd1803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd1803c780 0x7efd1803ec40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efe3400ffd0 tx=0x7efe34023040 comp rx=0 tx=0).stop 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe4d334640 1 -- 172.21.15.192:0/644110693 reap_dead start 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 msgr2=0x55e8908bc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 0x55e8908bc3a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efe3c09eee0 tx=0x7efe3c087f20 comp rx=0 tx=0).stop 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 shutdown_connections 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 --2- 172.21.15.192:0/644110693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908b4f20 0x55e8908bc3a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 >> 172.21.15.192:0/644110693 conn(0x55e8908b1320 msgr2=0x55e8908af530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 shutdown_connections 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 -- 172.21.15.192:0/644110693 wait complete. 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 -- 172.21.15.192:0/456844555 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd2403c780 msgr2=0x7efd2403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 --2- 172.21.15.192:0/456844555 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd2403c780 0x7efd2403ec40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55e890892190 tx=0x7efe34006000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 -- 172.21.15.192:0/456844555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908a8600 msgr2=0x55e8908a8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.006+0000 7efe50f25800 1 --2- 172.21.15.192:0/456844555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908a8600 0x55e8908a8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0964e0 tx=0x7efe3c05d4a0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/456844555 shutdown_connections 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 --2- 172.21.15.192:0/456844555 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd2403c780 0x7efd2403ec40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 --2- 172.21.15.192:0/456844555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8908a8600 0x55e8908a8a20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/456844555 >> 172.21.15.192:0/456844555 conn(0x55e89089c9b0 msgr2=0x55e89089cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/456844555 shutdown_connections 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/456844555 wait complete. 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e890893ff0 msgr2=0x55e8908963e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e890893ff0 0x55e8908963e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e89088be20 msgr2=0x55e890891760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e89088be20 0x55e890891760 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e890897ef0 msgr2=0x55e89089a2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e890897ef0 0x55e89089a2e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd3403c780 msgr2=0x7efd3403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efd3403c780 0x7efd3403ec40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efe34000c00 tx=0x7efe340013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 msgr2=0x55e89088a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 --2- 172.21.15.192:0/1374908200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e890794050 0x55e89088a110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efe3c045ed0 tx=0x7efe3c002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe4d334640 1 -- 172.21.15.192:0/1374908200 reap_dead start 2024-09-10T05:11:48.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 shutdown_connections 2024-09-10T05:11:48.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 >> 172.21.15.192:0/1374908200 conn(0x55e89078b1c0 msgr2=0x55e89087ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 shutdown_connections 2024-09-10T05:11:48.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.007+0000 7efe50f25800 1 -- 172.21.15.192:0/1374908200 wait complete. 2024-09-10T05:11:48.019 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:48.019 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:11:48.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:11:48.019 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:11:48.064 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:48.064 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:48.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.063+0000 7fc817f2e800 1 Processor -- start 2024-09-10T05:11:48.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.063+0000 7fc817f2e800 1 -- start start 2024-09-10T05:11:48.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.064+0000 7fc817f2e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5569560e04c0 0x5569560e08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.064+0000 7fc817f2e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556955f8be40 con 0x5569560e0e00 2024-09-10T05:11:48.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.064+0000 7fc817f2e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x556955f56680 con 0x5569560e04c0 2024-09-10T05:11:48.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.064+0000 7fc813b64640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5569560e04c0 0x5569560e08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.064+0000 7fc813b64640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5569560e04c0 0x5569560e08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59738/0 (socket says 172.21.15.192:59738) 2024-09-10T05:11:48.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.064+0000 7fc813b64640 1 -- 172.21.15.192:0/780837973 learned_addr learned my addr 172.21.15.192:0/780837973 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.064+0000 7fc80bfff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5569560e0e00 0x5569560e12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36294/0 (socket says 172.21.15.192:36294) 2024-09-10T05:11:48.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.064+0000 7fc813b64640 1 -- 172.21.15.192:0/780837973 >> v1:172.21.15.139:6789/0 conn(0x5569560e0e00 legacy=0x5569560e12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.064+0000 7fc813363640 1 -- 172.21.15.192:0/780837973 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050596463 0 0) 0x556955f8be40 con 0x5569560e0e00 2024-09-10T05:11:48.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.064+0000 7fc813b64640 1 -- 172.21.15.192:0/780837973 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556955f726b0 con 0x5569560e04c0 2024-09-10T05:11:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.066+0000 7fc813b64640 1 --2- 172.21.15.192:0/780837973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569560e08c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc80400a520 tx=0x7fc804045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4296c5be66f7ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.066+0000 7fc813363640 1 -- 172.21.15.192:0/780837973 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc804055070 con 0x5569560e04c0 2024-09-10T05:11:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.066+0000 7fc813363640 1 -- 172.21.15.192:0/780837973 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8040515b0 con 0x5569560e04c0 2024-09-10T05:11:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.066+0000 7fc813363640 1 -- 172.21.15.192:0/780837973 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8040518d0 con 0x5569560e04c0 2024-09-10T05:11:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.067+0000 7fc817f2e800 1 -- 172.21.15.192:0/780837973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 msgr2=0x5569560e08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.067+0000 7fc817f2e800 1 --2- 172.21.15.192:0/780837973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569560e08c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc80400a520 tx=0x7fc804045ba0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.067+0000 7fc817f2e800 1 -- 172.21.15.192:0/780837973 shutdown_connections 2024-09-10T05:11:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.067+0000 7fc817f2e800 1 --2- 172.21.15.192:0/780837973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569560e08c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.067+0000 7fc817f2e800 1 -- 172.21.15.192:0/780837973 >> 172.21.15.192:0/780837973 conn(0x5569560dc1b0 msgr2=0x5569560de610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.067+0000 7fc817f2e800 1 -- 172.21.15.192:0/780837973 shutdown_connections 2024-09-10T05:11:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.067+0000 7fc817f2e800 1 -- 172.21.15.192:0/780837973 wait complete. 2024-09-10T05:11:48.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.080+0000 7fc817f2e800 1 Processor -- start 2024-09-10T05:11:48.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.081+0000 7fc817f2e800 1 -- start start 2024-09-10T05:11:48.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.081+0000 7fc817f2e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569561d36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.081+0000 7fc817f2e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556955f7add0 con 0x5569560e04c0 2024-09-10T05:11:48.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.081+0000 7fc813b64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569561d36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.081+0000 7fc813b64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569561d36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59748/0 (socket says 172.21.15.192:59748) 2024-09-10T05:11:48.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.081+0000 7fc813b64640 1 -- 172.21.15.192:0/3515752269 learned_addr learned my addr 172.21.15.192:0/3515752269 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.081+0000 7fc813b64640 1 -- 172.21.15.192:0/3515752269 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556955f93e10 con 0x5569560e04c0 2024-09-10T05:11:48.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.081+0000 7fc813b64640 1 --2- 172.21.15.192:0/3515752269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569561d36a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc804025da0 tx=0x7fc804051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd695326e636c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.082+0000 7fc701e0b640 1 -- 172.21.15.192:0/3515752269 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc804051950 con 0x5569560e04c0 2024-09-10T05:11:48.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.082+0000 7fc701e0b640 1 -- 172.21.15.192:0/3515752269 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc804051af0 con 0x5569560e04c0 2024-09-10T05:11:48.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.082+0000 7fc701e0b640 1 -- 172.21.15.192:0/3515752269 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc804051dd0 con 0x5569560e04c0 2024-09-10T05:11:48.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.082+0000 7fc817f2e800 1 -- 172.21.15.192:0/3515752269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 msgr2=0x5569561d36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.082+0000 7fc817f2e800 1 --2- 172.21.15.192:0/3515752269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569561d36a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc804025da0 tx=0x7fc804051000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.082+0000 7fc817f2e800 1 -- 172.21.15.192:0/3515752269 shutdown_connections 2024-09-10T05:11:48.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.082+0000 7fc817f2e800 1 --2- 172.21.15.192:0/3515752269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569561d36a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.082+0000 7fc817f2e800 1 -- 172.21.15.192:0/3515752269 >> 172.21.15.192:0/3515752269 conn(0x5569560dc1b0 msgr2=0x5569561cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.082+0000 7fc817f2e800 1 -- 172.21.15.192:0/3515752269 shutdown_connections 2024-09-10T05:11:48.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.082+0000 7fc817f2e800 1 -- 172.21.15.192:0/3515752269 wait complete. 2024-09-10T05:11:48.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.083+0000 7fc817f2e800 1 Processor -- start 2024-09-10T05:11:48.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.083+0000 7fc817f2e800 1 -- start start 2024-09-10T05:11:48.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.083+0000 7fc817f2e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569561dae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.083+0000 7fc817f2e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5569560e1d20 con 0x5569560e04c0 2024-09-10T05:11:48.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.083+0000 7fc813b64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569561dae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.083+0000 7fc813b64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569561dae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59752/0 (socket says 172.21.15.192:59752) 2024-09-10T05:11:48.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.083+0000 7fc813b64640 1 -- 172.21.15.192:0/4098258367 learned_addr learned my addr 172.21.15.192:0/4098258367 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.083+0000 7fc813b64640 1 -- 172.21.15.192:0/4098258367 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569561db390 con 0x5569560e04c0 2024-09-10T05:11:48.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.084+0000 7fc813b64640 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569561dae30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc804025da0 tx=0x7fc804002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.084+0000 7fc6fbfff640 1 -- 172.21.15.192:0/4098258367 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc80405a600 con 0x5569560e04c0 2024-09-10T05:11:48.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.084+0000 7fc6fbfff640 1 -- 172.21.15.192:0/4098258367 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc804073070 con 0x5569560e04c0 2024-09-10T05:11:48.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.084+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569561db620 con 0x5569560e04c0 2024-09-10T05:11:48.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.084+0000 7fc6fbfff640 1 -- 172.21.15.192:0/4098258367 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc80405a910 con 0x5569560e04c0 2024-09-10T05:11:48.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.084+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569561dc230 con 0x5569560e04c0 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.085+0000 7fc6fbfff640 1 -- 172.21.15.192:0/4098258367 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc804058070 con 0x5569560e04c0 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.085+0000 7fc6fbfff640 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6fc03c780 0x7fc6fc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.085+0000 7fc6fbfff640 1 -- 172.21.15.192:0/4098258367 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fc80406b040 con 0x5569560e04c0 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.085+0000 7fc80bfff640 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6fc03c780 0x7fc6fc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.085+0000 7fc817f2e800 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5569560e0e00 0x5569561e2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.085+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569561e29c0 con 0x5569560e0e00 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.085+0000 7fc814365640 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5569560e0e00 0x5569561e2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.085+0000 7fc80bfff640 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6fc03c780 0x7fc6fc03ec40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc000c00 tx=0x7fc7fc0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.085+0000 7fc814365640 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5569560e0e00 0x5569561e2480 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.086+0000 7fc814365640 1 -- 172.21.15.192:0/4098258367 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x5569560e0e00 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.086+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569561e2d60 con 0x5569560e0e00 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.086+0000 7fc814365640 1 -- 172.21.15.192:0/4098258367 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc80c00a4d0 con 0x5569560e0e00 2024-09-10T05:11:48.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.086+0000 7fc817f2e800 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5569561e4860 0x5569561e6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.086+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569561e7490 con 0x5569561e4860 2024-09-10T05:11:48.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.086+0000 7fc813b64640 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5569561e4860 0x5569561e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.086+0000 7fc813b64640 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5569561e4860 0x5569561e6d00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.087+0000 7fc813b64640 1 -- 172.21.15.192:0/4098258367 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc804057030 con 0x5569561e4860 2024-09-10T05:11:48.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.087+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569561e35b0 con 0x5569560e0e00 2024-09-10T05:11:48.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.087+0000 7fc814365640 1 -- 172.21.15.192:0/4098258367 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc80c00a4d0 con 0x5569560e0e00 2024-09-10T05:11:48.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.087+0000 7fc817f2e800 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5569561e88f0 0x5569561eace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.087+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569561eb450 con 0x5569561e88f0 2024-09-10T05:11:48.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.087+0000 7fc80bfff640 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5569561e88f0 0x5569561eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.088+0000 7fc80bfff640 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5569561e88f0 0x5569561eace0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.088+0000 7fc80bfff640 1 -- 172.21.15.192:0/4098258367 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7fc00f670 con 0x5569561e88f0 2024-09-10T05:11:48.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.088+0000 7fc817f2e800 1 Processor -- start 2024-09-10T05:11:48.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.088+0000 7fc817f2e800 1 -- start start 2024-09-10T05:11:48.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.088+0000 7fc817f2e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569561f90b0 0x5569561f94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.088+0000 7fc817f2e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556955fd8a00 con 0x5569561f90b0 2024-09-10T05:11:48.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.089+0000 7fc813b64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569561f90b0 0x5569561f94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.089+0000 7fc813b64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569561f90b0 0x5569561f94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59764/0 (socket says 172.21.15.192:59764) 2024-09-10T05:11:48.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.089+0000 7fc813b64640 1 -- 172.21.15.192:0/1124996223 learned_addr learned my addr 172.21.15.192:0/1124996223 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.089+0000 7fc813b64640 1 -- 172.21.15.192:0/1124996223 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569561f9b10 con 0x5569561f90b0 2024-09-10T05:11:48.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.089+0000 7fc813b64640 1 --2- 172.21.15.192:0/1124996223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569561f90b0 0x5569561f94d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc8040507d0 tx=0x7fc804064b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.089+0000 7fc6f97fa640 1 -- 172.21.15.192:0/1124996223 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc804000ed0 con 0x5569561f90b0 2024-09-10T05:11:48.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.089+0000 7fc6f97fa640 1 -- 172.21.15.192:0/1124996223 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc804001090 con 0x5569561f90b0 2024-09-10T05:11:48.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.089+0000 7fc6f97fa640 1 -- 172.21.15.192:0/1124996223 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8040785b0 con 0x5569561f90b0 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.089+0000 7fc817f2e800 1 -- 172.21.15.192:0/1124996223 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569561fa340 con 0x5569561f90b0 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.089+0000 7fc817f2e800 1 -- 172.21.15.192:0/1124996223 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569561fa8e0 con 0x5569561f90b0 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.090+0000 7fc6f97fa640 1 -- 172.21.15.192:0/1124996223 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc80404f070 con 0x5569561f90b0 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.090+0000 7fc6f97fa640 1 --2- 172.21.15.192:0/1124996223 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6ec03c780 0x7fc6ec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.090+0000 7fc6f97fa640 1 -- 172.21.15.192:0/1124996223 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fc80408e070 con 0x5569561f90b0 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.090+0000 7fc80bfff640 1 --2- 172.21.15.192:0/1124996223 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6ec03c780 0x7fc6ec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.090+0000 7fc817f2e800 1 Processor -- start 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.091+0000 7fc817f2e800 1 -- start start 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.091+0000 7fc80bfff640 1 --2- 172.21.15.192:0/1124996223 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6ec03c780 0x7fc6ec03ec40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5569561e7830 tx=0x7fc7fc006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.091+0000 7fc817f2e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 0x556956205cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.091+0000 7fc817f2e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5569561d3e30 con 0x5569562058d0 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.091+0000 7fc813b64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 0x556956205cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.091+0000 7fc813b64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 0x556956205cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59772/0 (socket says 172.21.15.192:59772) 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.091+0000 7fc813b64640 1 -- 172.21.15.192:0/1071942872 learned_addr learned my addr 172.21.15.192:0/1071942872 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.091+0000 7fc813b64640 1 -- 172.21.15.192:0/1071942872 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569562062a0 con 0x5569562058d0 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.091+0000 7fc813b64640 1 --2- 172.21.15.192:0/1071942872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 0x556956205cb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc8040948b0 tx=0x7fc80406e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c22b941e6d7b82f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.091+0000 7fc6f2ffd640 1 -- 172.21.15.192:0/1071942872 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc80406ee00 con 0x5569562058d0 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.091+0000 7fc6f2ffd640 1 -- 172.21.15.192:0/1071942872 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8040944a0 con 0x5569562058d0 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.091+0000 7fc6f2ffd640 1 -- 172.21.15.192:0/1071942872 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8040940c0 con 0x5569562058d0 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc817f2e800 1 -- 172.21.15.192:0/1071942872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 msgr2=0x556956205cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc817f2e800 1 --2- 172.21.15.192:0/1071942872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 0x556956205cb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc8040948b0 tx=0x7fc80406e8c0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc817f2e800 1 -- 172.21.15.192:0/1071942872 shutdown_connections 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc817f2e800 1 --2- 172.21.15.192:0/1071942872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 0x556956205cb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc817f2e800 1 -- 172.21.15.192:0/1071942872 >> 172.21.15.192:0/1071942872 conn(0x556956201cd0 msgr2=0x5569561fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc817f2e800 1 -- 172.21.15.192:0/1071942872 shutdown_connections 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc817f2e800 1 -- 172.21.15.192:0/1071942872 wait complete. 2024-09-10T05:11:48.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc817f2e800 1 Processor -- start 2024-09-10T05:11:48.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc817f2e800 1 -- start start 2024-09-10T05:11:48.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc817f2e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 0x55695620cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc817f2e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556956206730 con 0x5569562058d0 2024-09-10T05:11:48.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc813b64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 0x55695620cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.092+0000 7fc813b64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 0x55695620cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59782/0 (socket says 172.21.15.192:59782) 2024-09-10T05:11:48.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.093+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 learned_addr learned my addr 172.21.15.192:0/2687434375 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.093+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695620d260 con 0x5569562058d0 2024-09-10T05:11:48.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.093+0000 7fc813b64640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 0x55695620cd00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc804005570 tx=0x7fc804050f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.093+0000 7fc6f17fa640 1 -- 172.21.15.192:0/2687434375 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8040bb070 con 0x5569562058d0 2024-09-10T05:11:48.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.093+0000 7fc6f17fa640 1 -- 172.21.15.192:0/2687434375 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80406ee00 con 0x5569562058d0 2024-09-10T05:11:48.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.093+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55695620d260 con 0x5569562058d0 2024-09-10T05:11:48.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.093+0000 7fc6f17fa640 1 -- 172.21.15.192:0/2687434375 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc80407b430 con 0x5569562058d0 2024-09-10T05:11:48.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.093+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695620d260 con 0x5569562058d0 2024-09-10T05:11:48.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.094+0000 7fc6f17fa640 1 -- 172.21.15.192:0/2687434375 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc8040be070 con 0x5569562058d0 2024-09-10T05:11:48.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.094+0000 7fc6f17fa640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6dc03c6e0 0x7fc6dc03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.094+0000 7fc6f17fa640 1 -- 172.21.15.192:0/2687434375 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fc804062070 con 0x5569562058d0 2024-09-10T05:11:48.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.094+0000 7fc817f2e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.094+0000 7fc80bfff640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6dc03c6e0 0x7fc6dc03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.095+0000 7fc817f2e800 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556956218030 0x55695621a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.095+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55695621abf0 con 0x556956218030 2024-09-10T05:11:48.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.095+0000 7fc814365640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556956218030 0x55695621a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.095+0000 7fc80bfff640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6dc03c6e0 0x7fc6dc03eba0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00ffd0 tx=0x7fc7fc023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.095+0000 7fc814365640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556956218030 0x55695621a4a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.095+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.095+0000 7fc817f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.095+0000 7fc817f2e800 20 realm 2024-09-10T05:11:48.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.095+0000 7fc817f2e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.095+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55695621b000 con 0x556956218030 2024-09-10T05:11:48.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc817f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc817f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc817f2e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55695621b8d0 con 0x556956218030 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc817f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc817f2e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956218030 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc817f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc817f2e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc817f2e800 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55695621c760 0x55695621eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55695621f290 con 0x55695621c760 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.096+0000 7fc813b64640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55695621c760 0x55695621eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.097+0000 7fc813b64640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55695621c760 0x55695621eb50 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.097+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.097+0000 7fc817f2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.097+0000 7fc817f2e800 20 searching for the correct realm 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.097+0000 7fc817f2e800 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556956221330 0x5569562237f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.097+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556956223ec0 con 0x556956221330 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.097+0000 7fc80bfff640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556956221330 0x5569562237f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.098+0000 7fc80bfff640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556956221330 0x5569562237f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.098+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.098+0000 7fc80bfff640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc7fc02e910 0x7fc7fc03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.098+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556956223ec0 con 0x7fc7fc02e910 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.098+0000 7fc814365640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc7fc02e910 0x7fc7fc03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.098+0000 7fc814365640 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc7fc02e910 0x7fc7fc03a3c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.099+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.099+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x55695621c760 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.099+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.099+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956218030 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.099+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.099+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956218030 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.099+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.099+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x55695621c760 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.100+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.100+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x55695621c760 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.100+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.100+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x7fc7fc02e910 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.100+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.100+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956221330 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.100+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.100+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956218030 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.101+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.101+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x55695621c760 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.101+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.101+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956218030 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.101+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.101+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x7fc7fc02e910 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.101+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.101+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956221330 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.101+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.101+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956221330 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.102+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.102+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x55695621c760 2024-09-10T05:11:48.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.102+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.102+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956221330 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.102+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.102+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956221330 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.102+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.102+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956218030 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.103+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.103+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956218030 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.103+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.103+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x55695621c760 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.103+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.103+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956221330 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.103+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.103+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x7fc7fc02e910 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.103+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.103+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956218030 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.104+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.104+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x55695621c760 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.104+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.104+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956221330 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.104+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.104+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x55695621c760 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.104+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.104+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x7fc7fc02e910 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.105+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.105+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956221330 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.105+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.105+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x55695621c760 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.105+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.105+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x556956218030 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.105+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.105+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55695621bc70 con 0x7fc7fc02e910 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55695621fc30 con 0x556956218030 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55695621fc30 con 0x556956218030 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55695621fc30 con 0x7fc7fc02e910 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.106+0000 7fc817f2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 20 zone default found 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 4 Realm: () 2024-09-10T05:11:48.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 20 zonegroup default 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556956220020 con 0x55695621c760 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55695621fbf0 con 0x556956221330 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556956225d30 con 0x556956221330 2024-09-10T05:11:48.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 20 started sync module instance, tier type = 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.107+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569562251d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.109+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.109+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93910905018064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569562251d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.109+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956226780 con 0x556956218030 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.110+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93910905018064] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.110+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.110+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93910905021072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569562251d0 con 0x556956218030 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.110+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956227220 con 0x556956221330 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.111+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93910905021072] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.111+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.111+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93910905015584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956225140 con 0x556956221330 2024-09-10T05:11:48.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.111+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569562280e0 con 0x7fc7fc02e910 2024-09-10T05:11:48.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.112+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93910905015584] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.112+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.112+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93910905027632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956228500 con 0x7fc7fc02e910 2024-09-10T05:11:48.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.112+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956228ec0 con 0x556956218030 2024-09-10T05:11:48.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.113+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93910905027632] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.113+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.113+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93910905031664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956228500 con 0x556956218030 2024-09-10T05:11:48.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.113+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569562298d0 con 0x55695621c760 2024-09-10T05:11:48.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.114+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.114+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93910905031664] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.114+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93910905028688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956228470 con 0x55695621c760 2024-09-10T05:11:48.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.114+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55695622a650 con 0x55695621c760 2024-09-10T05:11:48.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.115+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.115+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93910905039344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55695622b2c0 con 0x55695621c760 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.115+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55695622bd10 con 0x55695621c760 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.118+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.118+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93910905042944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55695622c180 con 0x55695621c760 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.118+0000 7fc817f2e800 20 add_watcher() i=0 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.118+0000 7fc817f2e800 20 add_watcher() i=1 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.118+0000 7fc817f2e800 20 add_watcher() i=2 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.118+0000 7fc817f2e800 20 add_watcher() i=3 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.118+0000 7fc817f2e800 20 add_watcher() i=4 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.118+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(55 notify.5 [watch watch cookie 93910905028688] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.118+0000 7fc817f2e800 20 add_watcher() i=5 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.118+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93910905039344] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.118+0000 7fc817f2e800 20 add_watcher() i=6 2024-09-10T05:11:48.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.119+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93910905042944] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.119+0000 7fc817f2e800 20 add_watcher() i=7 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.119+0000 7fc817f2e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.119+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55695622ae10 con 0x556956218030 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.119+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.119+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93910905044176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55695622ae10 con 0x556956218030 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.120+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93910905044176] v35'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.120+0000 7fc6ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.120+0000 7fc817f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.120+0000 7fc817f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.120+0000 7fc817f2e800 5 note: GC not initialized 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.120+0000 7fc6c97e2640 20 reqs_thread_entry: start 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.121+0000 7fc817f2e800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:48.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.121+0000 7fc817f2e800 20 Filter name: none 2024-09-10T05:11:48.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.121+0000 7fc6c27fc640 20 reqs_thread_entry: start 2024-09-10T05:11:48.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.121+0000 7fc817f2e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.121+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556956261950 con 0x556956218030 2024-09-10T05:11:48.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.121+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.121+0000 7fc817f2e800 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T05:11:48.130 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:48.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.122+0000 7fc6ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.122+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93910905044176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956260440 con 0x556956218030 2024-09-10T05:11:48.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.123+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93910905044176] v35'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.123+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93910905018064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55695622bcd0 con 0x7fc7fc02e910 2024-09-10T05:11:48.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.124+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93910905018064] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.124+0000 7fc817f2e800 20 remove_watcher() i=0 2024-09-10T05:11:48.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.124+0000 7fc817f2e800 2 removed watcher, disabling cache 2024-09-10T05:11:48.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.124+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93910905021072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569562256d0 con 0x556956218030 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.125+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93910905021072] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.125+0000 7fc817f2e800 20 remove_watcher() i=1 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.125+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93910905015584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55695622bcd0 con 0x556956221330 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.126+0000 7fc80bfff640 1 -- 172.21.15.192:0/2687434375 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93910905015584] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7fc037040 con 0x556956221330 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.126+0000 7fc817f2e800 20 remove_watcher() i=2 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.126+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93910905027632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956226290 con 0x7fc7fc02e910 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.127+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93910905027632] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x7fc7fc02e910 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.127+0000 7fc817f2e800 20 remove_watcher() i=3 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.127+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93910905031664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956224d20 con 0x556956218030 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.128+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93910905031664] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc80c00a4d0 con 0x556956218030 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.128+0000 7fc817f2e800 20 remove_watcher() i=4 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.128+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93910905028688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956227c30 con 0x55695621c760 2024-09-10T05:11:48.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.129+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93910905028688] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.129+0000 7fc817f2e800 20 remove_watcher() i=5 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.129+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93910905039344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956226290 con 0x55695621c760 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.130+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93910905039344] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.130+0000 7fc817f2e800 20 remove_watcher() i=6 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.130+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93910905042944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556956224d20 con 0x55695621c760 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc813b64640 1 -- 172.21.15.192:0/2687434375 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93910905042944] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8040bd030 con 0x55695621c760 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 20 remove_watcher() i=7 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55695621c760 msgr2=0x55695621eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55695621c760 0x55695621eb50 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556956218030 msgr2=0x55695621a4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556956218030 0x55695621a4a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc7fc02e910 msgr2=0x7fc7fc03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fc7fc02e910 0x7fc7fc03a3c0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556956221330 msgr2=0x5569562237f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556956221330 0x5569562237f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6dc03c6e0 msgr2=0x7fc6dc03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6dc03c6e0 0x7fc6dc03eba0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00ffd0 tx=0x7fc7fc023040 comp rx=0 tx=0).stop 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 msgr2=0x55695620cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 --2- 172.21.15.192:0/2687434375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569562058d0 0x55695620cd00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc804005570 tx=0x7fc804050f10 comp rx=0 tx=0).stop 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 reap_dead start 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc814365640 1 -- 172.21.15.192:0/2687434375 reap_dead start 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 shutdown_connections 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 >> 172.21.15.192:0/2687434375 conn(0x556956201cd0 msgr2=0x5569561ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 shutdown_connections 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 -- 172.21.15.192:0/2687434375 wait complete. 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 -- 172.21.15.192:0/1124996223 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6ec03c780 msgr2=0x7fc6ec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 --2- 172.21.15.192:0/1124996223 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6ec03c780 0x7fc6ec03ec40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5569561e7830 tx=0x7fc7fc006000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 -- 172.21.15.192:0/1124996223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569561f90b0 msgr2=0x5569561f94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.131+0000 7fc817f2e800 1 --2- 172.21.15.192:0/1124996223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569561f90b0 0x5569561f94d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc8040507d0 tx=0x7fc804064b00 comp rx=0 tx=0).stop 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/1124996223 shutdown_connections 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 --2- 172.21.15.192:0/1124996223 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6ec03c780 0x7fc6ec03ec40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 --2- 172.21.15.192:0/1124996223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569561f90b0 0x5569561f94d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/1124996223 >> 172.21.15.192:0/1124996223 conn(0x5569561ed460 msgr2=0x5569561ed840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/1124996223 shutdown_connections 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/1124996223 wait complete. 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5569561e4860 msgr2=0x5569561e6d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5569561e4860 0x5569561e6d00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5569560e0e00 msgr2=0x5569561e2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5569560e0e00 0x5569561e2480 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5569561e88f0 msgr2=0x5569561eace0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5569561e88f0 0x5569561eace0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6fc03c780 msgr2=0x7fc6fc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc6fc03c780 0x7fc6fc03ec40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc000c00 tx=0x7fc7fc0013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 msgr2=0x5569561dae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 --2- 172.21.15.192:0/4098258367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569560e04c0 0x5569561dae30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc804025da0 tx=0x7fc804002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc814365640 1 -- 172.21.15.192:0/4098258367 reap_dead start 2024-09-10T05:11:48.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 shutdown_connections 2024-09-10T05:11:48.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 >> 172.21.15.192:0/4098258367 conn(0x5569560dc1b0 msgr2=0x5569561cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 shutdown_connections 2024-09-10T05:11:48.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.132+0000 7fc817f2e800 1 -- 172.21.15.192:0/4098258367 wait complete. 2024-09-10T05:11:48.142 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:48.142 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-10T05:11:48.142 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-10T05:11:48.142 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-10T05:11:48.191 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:48.191 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:48.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.191+0000 7fab7b1a9800 1 Processor -- start 2024-09-10T05:11:48.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.191+0000 7fab7b1a9800 1 -- start start 2024-09-10T05:11:48.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.191+0000 7fab7b1a9800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x556a1e3c5620 0x556a1e3c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.191+0000 7fab7b1a9800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556a1e26ee40 con 0x556a1e3c8040 2024-09-10T05:11:48.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.191+0000 7fab7b1a9800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x556a1e239680 con 0x556a1e3c5620 2024-09-10T05:11:48.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.191+0000 7fab78c93640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x556a1e3c5620 0x556a1e3c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.191+0000 7fab73fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x556a1e3c8040 0x556a1e3ca500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36306/0 (socket says 172.21.15.192:36306) 2024-09-10T05:11:48.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.191+0000 7fab73fff640 1 -- 172.21.15.192:0/1528092033 learned_addr learned my addr 172.21.15.192:0/1528092033 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:48.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.191+0000 7fab78c93640 1 -- 172.21.15.192:0/1528092033 >> v1:172.21.15.139:6789/0 conn(0x556a1e3c8040 legacy=0x556a1e3ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.192+0000 7fab737fe640 1 -- 172.21.15.192:0/1528092033 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 587560468 0 0) 0x556a1e26ee40 con 0x556a1e3c8040 2024-09-10T05:11:48.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.192+0000 7fab78c93640 1 -- 172.21.15.192:0/1528092033 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a1e2556b0 con 0x556a1e3c5620 2024-09-10T05:11:48.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.193+0000 7fab78c93640 1 --2- 172.21.15.192:0/1528092033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e3c7a10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00a470 tx=0x7fab6c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a28462a0b902ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.193+0000 7fab737fe640 1 -- 172.21.15.192:0/1528092033 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c053570 con 0x556a1e3c5620 2024-09-10T05:11:48.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.193+0000 7fab737fe640 1 -- 172.21.15.192:0/1528092033 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c058070 con 0x556a1e3c5620 2024-09-10T05:11:48.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.193+0000 7fab737fe640 1 -- 172.21.15.192:0/1528092033 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c053880 con 0x556a1e3c5620 2024-09-10T05:11:48.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.194+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1528092033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 msgr2=0x556a1e3c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.194+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/1528092033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e3c7a10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00a470 tx=0x7fab6c045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:48.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.194+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1528092033 shutdown_connections 2024-09-10T05:11:48.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.194+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/1528092033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e3c7a10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.194+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1528092033 >> 172.21.15.192:0/1528092033 conn(0x556a1e3bf1e0 msgr2=0x556a1e3c1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.194+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1528092033 shutdown_connections 2024-09-10T05:11:48.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.194+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1528092033 wait complete. 2024-09-10T05:11:48.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.208+0000 7fab7b1a9800 1 Processor -- start 2024-09-10T05:11:48.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.208+0000 7fab7b1a9800 1 -- start start 2024-09-10T05:11:48.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.208+0000 7fab7b1a9800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e3c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.208+0000 7fab7b1a9800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556a1e25ddd0 con 0x556a1e3c5620 2024-09-10T05:11:48.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.208+0000 7fab78c93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e3c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.208+0000 7fab78c93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e3c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59794/0 (socket says 172.21.15.192:59794) 2024-09-10T05:11:48.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.208+0000 7fab78c93640 1 -- 172.21.15.192:0/4010255746 learned_addr learned my addr 172.21.15.192:0/4010255746 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.209+0000 7fab78c93640 1 -- 172.21.15.192:0/4010255746 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a1e276e10 con 0x556a1e3c5620 2024-09-10T05:11:48.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.209+0000 7fab78c93640 1 --2- 172.21.15.192:0/4010255746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e3c4d90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fab6c025c20 tx=0x7fab6c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768a632d94c2b57d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.209+0000 7faa66e05640 1 -- 172.21.15.192:0/4010255746 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c053a20 con 0x556a1e3c5620 2024-09-10T05:11:48.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.209+0000 7faa66e05640 1 -- 172.21.15.192:0/4010255746 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c063070 con 0x556a1e3c5620 2024-09-10T05:11:48.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.209+0000 7faa66e05640 1 -- 172.21.15.192:0/4010255746 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c053d30 con 0x556a1e3c5620 2024-09-10T05:11:48.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab7b1a9800 1 -- 172.21.15.192:0/4010255746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 msgr2=0x556a1e3c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/4010255746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e3c4d90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fab6c025c20 tx=0x7fab6c051000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab7b1a9800 1 -- 172.21.15.192:0/4010255746 shutdown_connections 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/4010255746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e3c4d90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab7b1a9800 1 -- 172.21.15.192:0/4010255746 >> 172.21.15.192:0/4010255746 conn(0x556a1e3bf1e0 msgr2=0x556a1e4afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab7b1a9800 1 -- 172.21.15.192:0/4010255746 shutdown_connections 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab7b1a9800 1 -- 172.21.15.192:0/4010255746 wait complete. 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab7b1a9800 1 Processor -- start 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab7b1a9800 1 -- start start 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab7b1a9800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e4be0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab7b1a9800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556a1e3cc060 con 0x556a1e3c5620 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab78c93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e4be0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab78c93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e4be0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59806/0 (socket says 172.21.15.192:59806) 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.210+0000 7fab78c93640 1 -- 172.21.15.192:0/2090681571 learned_addr learned my addr 172.21.15.192:0/2090681571 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.211+0000 7fab78c93640 1 -- 172.21.15.192:0/2090681571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a1e4be600 con 0x556a1e3c5620 2024-09-10T05:11:48.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.211+0000 7fab78c93640 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e4be0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fab6c025c20 tx=0x7fab6c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.211+0000 7faa65602640 1 -- 172.21.15.192:0/2090681571 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c078070 con 0x556a1e3c5620 2024-09-10T05:11:48.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.211+0000 7faa65602640 1 -- 172.21.15.192:0/2090681571 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c073470 con 0x556a1e3c5620 2024-09-10T05:11:48.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.211+0000 7faa65602640 1 -- 172.21.15.192:0/2090681571 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c073750 con 0x556a1e3c5620 2024-09-10T05:11:48.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.211+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a1e4be890 con 0x556a1e3c5620 2024-09-10T05:11:48.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.211+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a1e4bf450 con 0x556a1e3c5620 2024-09-10T05:11:48.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.212+0000 7faa65602640 1 -- 172.21.15.192:0/2090681571 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fab6c07b070 con 0x556a1e3c5620 2024-09-10T05:11:48.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.212+0000 7faa65602640 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa6003c780 0x7faa6003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.212+0000 7faa65602640 1 -- 172.21.15.192:0/2090681571 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fab6c097ac0 con 0x556a1e3c5620 2024-09-10T05:11:48.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.212+0000 7fab73fff640 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa6003c780 0x7faa6003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.212+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556a1e3c8040 0x556a1e4c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.212+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4bfe10 con 0x556a1e3c8040 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.212+0000 7fab79494640 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556a1e3c8040 0x556a1e4c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.213+0000 7fab73fff640 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa6003c780 0x7faa6003ec40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab64000c00 tx=0x7fab640013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.213+0000 7fab79494640 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556a1e3c8040 0x556a1e4c56a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.213+0000 7fab79494640 1 -- 172.21.15.192:0/2090681571 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e3c8040 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.213+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4bf7c0 con 0x556a1e3c8040 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.213+0000 7fab79494640 1 -- 172.21.15.192:0/2090681571 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e3c8040 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.213+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556a1e4c7b10 0x556a1e4c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.213+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ca5d0 con 0x556a1e4c7b10 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.213+0000 7fab78c93640 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556a1e4c7b10 0x556a1e4c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.214+0000 7fab78c93640 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556a1e4c7b10 0x556a1e4c9f00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.214+0000 7fab78c93640 1 -- 172.21.15.192:0/2090681571 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4c7b10 2024-09-10T05:11:48.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.214+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4c69b0 con 0x556a1e3c8040 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.214+0000 7fab79494640 1 -- 172.21.15.192:0/2090681571 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e3c8040 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.214+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556a1e4cba10 0x556a1e4cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.214+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ce540 con 0x556a1e4cba10 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.214+0000 7fab73fff640 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556a1e4cba10 0x556a1e4cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.215+0000 7fab73fff640 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556a1e4cba10 0x556a1e4cde00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.215+0000 7fab73fff640 1 -- 172.21.15.192:0/2090681571 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab6400f670 con 0x556a1e4cba10 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.215+0000 7fab7b1a9800 1 Processor -- start 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.215+0000 7fab7b1a9800 1 -- start start 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.216+0000 7fab7b1a9800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4dc1a0 0x556a1e4dc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.216+0000 7fab7b1a9800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556a1e2bba00 con 0x556a1e4dc1a0 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.216+0000 7fab78c93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4dc1a0 0x556a1e4dc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.216+0000 7fab78c93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4dc1a0 0x556a1e4dc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59808/0 (socket says 172.21.15.192:59808) 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.216+0000 7fab78c93640 1 -- 172.21.15.192:0/1039808849 learned_addr learned my addr 172.21.15.192:0/1039808849 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.216+0000 7fab78c93640 1 -- 172.21.15.192:0/1039808849 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a1e4dcc00 con 0x556a1e4dc1a0 2024-09-10T05:11:48.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.216+0000 7fab78c93640 1 --2- 172.21.15.192:0/1039808849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4dc1a0 0x556a1e4dc5c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fab6c095f30 tx=0x7fab6c07cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.216+0000 7faa5effd640 1 -- 172.21.15.192:0/1039808849 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c068470 con 0x556a1e4dc1a0 2024-09-10T05:11:48.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.216+0000 7faa5effd640 1 -- 172.21.15.192:0/1039808849 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c068610 con 0x556a1e4dc1a0 2024-09-10T05:11:48.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.216+0000 7faa5effd640 1 -- 172.21.15.192:0/1039808849 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c068910 con 0x556a1e4dc1a0 2024-09-10T05:11:48.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.216+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1039808849 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a1e4dd430 con 0x556a1e4dc1a0 2024-09-10T05:11:48.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.216+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1039808849 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a1e4dd9d0 con 0x556a1e4dc1a0 2024-09-10T05:11:48.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.217+0000 7faa5effd640 1 -- 172.21.15.192:0/1039808849 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fab6c0738f0 con 0x556a1e4dc1a0 2024-09-10T05:11:48.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.217+0000 7faa5effd640 1 --2- 172.21.15.192:0/1039808849 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa5003c780 0x7faa5003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.217+0000 7faa5effd640 1 -- 172.21.15.192:0/1039808849 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fab6c08f070 con 0x556a1e4dc1a0 2024-09-10T05:11:48.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.217+0000 7fab73fff640 1 --2- 172.21.15.192:0/1039808849 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa5003c780 0x7faa5003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7fab7b1a9800 1 Processor -- start 2024-09-10T05:11:48.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7fab7b1a9800 1 -- start start 2024-09-10T05:11:48.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7fab73fff640 1 --2- 172.21.15.192:0/1039808849 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa5003c780 0x7faa5003ec40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x556a1e4c5cb0 tx=0x7fab64006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7fab7b1a9800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 0x556a1e4e8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7fab7b1a9800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556a1e3c3630 con 0x556a1e4e8a20 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7fab78c93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 0x556a1e4e8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7fab78c93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 0x556a1e4e8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59822/0 (socket says 172.21.15.192:59822) 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7fab78c93640 1 -- 172.21.15.192:0/1271020510 learned_addr learned my addr 172.21.15.192:0/1271020510 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7fab78c93640 1 -- 172.21.15.192:0/1271020510 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a1e4e93f0 con 0x556a1e4e8a20 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7fab78c93640 1 --2- 172.21.15.192:0/1271020510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 0x556a1e4e8e00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fab6c068ab0 tx=0x7fab6c052ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40497fd631e7437 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7faa5cff9640 1 -- 172.21.15.192:0/1271020510 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c061d70 con 0x556a1e4e8a20 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7faa5cff9640 1 -- 172.21.15.192:0/1271020510 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c0523a0 con 0x556a1e4e8a20 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.218+0000 7faa5cff9640 1 -- 172.21.15.192:0/1271020510 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c05c870 con 0x556a1e4e8a20 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.219+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1271020510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 msgr2=0x556a1e4e8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.219+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/1271020510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 0x556a1e4e8e00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fab6c068ab0 tx=0x7fab6c052ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.219+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1271020510 shutdown_connections 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.219+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/1271020510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 0x556a1e4e8e00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.219+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1271020510 >> 172.21.15.192:0/1271020510 conn(0x556a1e4e4e20 msgr2=0x556a1e4e3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.219+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1271020510 shutdown_connections 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.219+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1271020510 wait complete. 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.219+0000 7fab7b1a9800 1 Processor -- start 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.219+0000 7fab7b1a9800 1 -- start start 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.219+0000 7fab7b1a9800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 0x556a1e4efe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.219+0000 7fab7b1a9800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556a1e4e9880 con 0x556a1e4e8a20 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.220+0000 7fab78c93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 0x556a1e4efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.220+0000 7fab78c93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 0x556a1e4efe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59836/0 (socket says 172.21.15.192:59836) 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.220+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 learned_addr learned my addr 172.21.15.192:0/899778976 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.220+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a1e4f03c0 con 0x556a1e4e8a20 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.220+0000 7fab78c93640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 0x556a1e4efe60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fab6c068ab0 tx=0x7fab6c091f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.220+0000 7faa567fc640 1 -- 172.21.15.192:0/899778976 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c092800 con 0x556a1e4e8a20 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.220+0000 7faa567fc640 1 -- 172.21.15.192:0/899778976 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c0929a0 con 0x556a1e4e8a20 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.220+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a1e4f03c0 con 0x556a1e4e8a20 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.220+0000 7faa567fc640 1 -- 172.21.15.192:0/899778976 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab6c092c80 con 0x556a1e4e8a20 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.220+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a1e4f03c0 con 0x556a1e4e8a20 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.221+0000 7faa567fc640 1 -- 172.21.15.192:0/899778976 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fab6c0bd030 con 0x556a1e4e8a20 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.221+0000 7faa567fc640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa4003c6e0 0x7faa4003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.221+0000 7faa567fc640 1 -- 172.21.15.192:0/899778976 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fab6c0bb070 con 0x556a1e4e8a20 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.221+0000 7fab73fff640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa4003c6e0 0x7faa4003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.222+0000 7fab73fff640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa4003c6e0 0x7faa4003eba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fab6400ffd0 tx=0x7fab64023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.222+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.222+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556a1e4fb3f0 0x556a1e4fd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.222+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4fe000 con 0x556a1e4fb3f0 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.222+0000 7fab79494640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556a1e4fb3f0 0x556a1e4fd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.222+0000 7fab79494640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556a1e4fb3f0 0x556a1e4fd8b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 20 realm 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4fe410 con 0x556a1e4fb3f0 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4fece0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4fb3f0 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556a1e4ffde0 0x556a1e5021d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.223+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e502790 con 0x556a1e4ffde0 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.224+0000 7fab78c93640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556a1e4ffde0 0x556a1e5021d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.224+0000 7fab78c93640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556a1e4ffde0 0x556a1e5021d0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.224+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.224+0000 7fab7b1a9800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.224+0000 7fab7b1a9800 20 searching for the correct realm 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.224+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556a1e504740 0x556a1e506c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.224+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e5072d0 con 0x556a1e504740 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.224+0000 7fab73fff640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556a1e504740 0x556a1e506c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.225+0000 7fab73fff640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556a1e504740 0x556a1e506c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.225+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.225+0000 7fab73fff640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fab6402e910 0x7fab6403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.225+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e5072d0 con 0x7fab6402e910 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.225+0000 7fab79494640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fab6402e910 0x7fab6403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.225+0000 7fab79494640 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fab6402e910 0x7fab6403a3c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.226+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.226+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4ffde0 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.226+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.226+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4fb3f0 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.226+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.226+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4fb3f0 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.226+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.226+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4ffde0 2024-09-10T05:11:48.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.227+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.227+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4ffde0 2024-09-10T05:11:48.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.227+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.227+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x7fab6402e910 2024-09-10T05:11:48.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.227+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.227+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e504740 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.228+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.228+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4fb3f0 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.228+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.228+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4ffde0 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.228+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.228+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4fb3f0 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.228+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.228+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x7fab6402e910 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.228+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.228+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e504740 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.229+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.229+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e504740 2024-09-10T05:11:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.229+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.229+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4ffde0 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.229+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.229+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e504740 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.229+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.229+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e504740 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.230+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.230+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4fb3f0 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.230+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.230+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4fb3f0 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.230+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.230+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4ffde0 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.231+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.231+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e504740 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.231+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.231+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x7fab6402e910 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.231+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.231+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4fb3f0 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.231+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.231+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4ffde0 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.232+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.232+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e504740 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.232+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.232+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4ffde0 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.232+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.232+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x7fab6402e910 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.232+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.232+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e504740 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.233+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.233+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4ffde0 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.233+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.233+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x556a1e4fb3f0 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.233+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.233+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556a1e4ff080 con 0x7fab6402e910 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e503050 con 0x556a1e4fb3f0 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e503050 con 0x556a1e4fb3f0 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e503050 con 0x7fab6402e910 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 zone default found 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 4 Realm: () 2024-09-10T05:11:48.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 zonegroup default 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.234+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e503050 con 0x556a1e4ffde0 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab7b1a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e509140 con 0x556a1e504740 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab7b1a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e5094e0 con 0x556a1e504740 2024-09-10T05:11:48.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab7b1a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab7b1a9800 20 started sync module instance, tier type = 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab7b1a9800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.235+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e5085e0 con 0x7fab6402e910 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.236+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.236+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93914263487040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e508c40 con 0x7fab6402e910 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.236+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e509ea0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.238+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.238+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93914263493104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e509e50 con 0x556a1e4fb3f0 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.238+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93914263487040] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.238+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50aca0 con 0x556a1e504740 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.239+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93914263493104] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.239+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.239+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93914263496688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e509e10 con 0x556a1e504740 2024-09-10T05:11:48.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.239+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50b700 con 0x7fab6402e910 2024-09-10T05:11:48.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.240+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.240+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93914263499232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50bfa0 con 0x7fab6402e910 2024-09-10T05:11:48.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.240+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50ca60 con 0x556a1e4fb3f0 2024-09-10T05:11:48.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.240+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93914263496688] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.241+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93914263499232] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.241+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.241+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93914263504176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50ba00 con 0x556a1e4fb3f0 2024-09-10T05:11:48.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.241+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50d300 con 0x556a1e4ffde0 2024-09-10T05:11:48.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.242+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93914263504176] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.242+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.242+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93914263495312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50ba00 con 0x556a1e4ffde0 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.242+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50d920 con 0x556a1e4ffde0 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.243+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.243+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93914263508080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50dd80 con 0x556a1e4ffde0 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.243+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50e8a0 con 0x556a1e4ffde0 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.243+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93914263495312] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.244+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93914263508080] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.244+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.244+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93914263511920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50d890 con 0x556a1e4ffde0 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.244+0000 7fab7b1a9800 20 add_watcher() i=0 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.244+0000 7fab7b1a9800 20 add_watcher() i=1 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.244+0000 7fab7b1a9800 20 add_watcher() i=2 2024-09-10T05:11:48.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.244+0000 7fab7b1a9800 20 add_watcher() i=3 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.244+0000 7fab7b1a9800 20 add_watcher() i=4 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.244+0000 7fab7b1a9800 20 add_watcher() i=5 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.244+0000 7fab7b1a9800 20 add_watcher() i=6 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.245+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93914263511920] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.245+0000 7fab7b1a9800 20 add_watcher() i=7 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.245+0000 7fab7b1a9800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.245+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e511890 con 0x556a1e4fb3f0 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.245+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.246+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93914263506432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50ed10 con 0x556a1e4fb3f0 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.246+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93914263506432] v35'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.246+0000 7faa2f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:48.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 5 note: GC not initialized 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7faa2e7dc640 20 reqs_thread_entry: start 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 20 Filter name: none 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fa99ffff640 20 reqs_thread_entry: start 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e5448b0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:48.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.247+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e5454d0 con 0x7fab6402e910 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.248+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.248+0000 7fab7b1a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.248+0000 7fab7b1a9800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.248+0000 7fab7b1a9800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.248+0000 7fab7b1a9800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.248+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e54b1b0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v35'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7fab7b1a9800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7fab7b1a9800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7fab7b1a9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:48.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93914263759856 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e547dc0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 93914263504176 notify 150323855367 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7fab740267f0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7faa5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855367 cookie 93914263504176 notifier 4399 bl.length()=849 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7faa5cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7faa5cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7faa5cff9640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7faa44003ea0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(65 notify.4 [notify cookie 93914263759856 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.249+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== watch-notify(notify_complete (2) cookie 93914263759856 notify 150323855367 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fab74018ca0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.250+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e54abf0 con 0x7fab6402e910 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7fab7b1a9800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7fab7b1a9800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7fab7b1a9800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-10T05:11:48.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93914263759856 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556a1e545870 con 0x7fab6402e910 2024-09-10T05:11:48.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== watch-notify(notify (1) cookie 93914263487040 notify 150323855363 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fab74018ca0 con 0x7fab6402e910 2024-09-10T05:11:48.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7faa577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855363 cookie 93914263487040 notifier 4399 bl.length()=166 2024-09-10T05:11:48.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7faa577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-10T05:11:48.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7faa577fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-10T05:11:48.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7faa577fe640 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa9ac003400 con 0x7fab6402e910 2024-09-10T05:11:48.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(68 notify.0 [notify cookie 93914263759856 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== watch-notify(notify_complete (2) cookie 93914263759856 notify 150323855363 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fab74026a90 con 0x7fab6402e910 2024-09-10T05:11:48.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.251+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.261 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T05:11:48.248949Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:48.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.252+0000 7faa2f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.252+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93914263506432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e5426d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.253+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93914263506432] v35'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.253+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93914263487040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e5426d0 con 0x7fab6402e910 2024-09-10T05:11:48.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.254+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93914263487040] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.254+0000 7fab7b1a9800 20 remove_watcher() i=0 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.254+0000 7fab7b1a9800 2 removed watcher, disabling cache 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.254+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93914263493104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e5426d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.256+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93914263493104] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.256+0000 7fab7b1a9800 20 remove_watcher() i=1 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.256+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93914263496688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e5426d0 con 0x556a1e504740 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.257+0000 7fab73fff640 1 -- 172.21.15.192:0/899778976 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93914263496688] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab64037040 con 0x556a1e504740 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.257+0000 7fab7b1a9800 20 remove_watcher() i=2 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.257+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93914263499232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e508240 con 0x7fab6402e910 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.258+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93914263499232] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x7fab6402e910 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.258+0000 7fab7b1a9800 20 remove_watcher() i=3 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.258+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93914263504176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e5099f0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.259+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93914263504176] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7400a4d0 con 0x556a1e4fb3f0 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.259+0000 7fab7b1a9800 20 remove_watcher() i=4 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.259+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93914263495312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e508240 con 0x556a1e4ffde0 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.260+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93914263495312] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.260+0000 7fab7b1a9800 20 remove_watcher() i=5 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.260+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93914263508080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e50c530 con 0x556a1e4ffde0 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.261+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93914263508080] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.261+0000 7fab7b1a9800 20 remove_watcher() i=6 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.261+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93914263511920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556a1e5099f0 con 0x556a1e4ffde0 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab78c93640 1 -- 172.21.15.192:0/899778976 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93914263511920] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab6c07a030 con 0x556a1e4ffde0 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 20 remove_watcher() i=7 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556a1e4ffde0 msgr2=0x556a1e5021d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556a1e4ffde0 0x556a1e5021d0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556a1e4fb3f0 msgr2=0x556a1e4fd8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556a1e4fb3f0 0x556a1e4fd8b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fab6402e910 msgr2=0x7fab6403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fab6402e910 0x7fab6403a3c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556a1e504740 msgr2=0x556a1e506c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556a1e504740 0x556a1e506c00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa4003c6e0 msgr2=0x7faa4003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa4003c6e0 0x7faa4003eba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fab6400ffd0 tx=0x7fab64023040 comp rx=0 tx=0).stop 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 msgr2=0x556a1e4efe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab79494640 1 -- 172.21.15.192:0/899778976 reap_dead start 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 0x556a1e4efe60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fab6c068ab0 tx=0x7fab6c091f40 comp rx=0 tx=0).stop 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 shutdown_connections 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/899778976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4e8a20 0x556a1e4efe60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 >> 172.21.15.192:0/899778976 conn(0x556a1e4e4e20 msgr2=0x556a1e4e3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 shutdown_connections 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.262+0000 7fab7b1a9800 1 -- 172.21.15.192:0/899778976 wait complete. 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1039808849 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa5003c780 msgr2=0x7faa5003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/1039808849 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa5003c780 0x7faa5003ec40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x556a1e4c5cb0 tx=0x7fab64006000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1039808849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4dc1a0 msgr2=0x556a1e4dc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/1039808849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4dc1a0 0x556a1e4dc5c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fab6c095f30 tx=0x7fab6c07cdf0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1039808849 shutdown_connections 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/1039808849 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa5003c780 0x7faa5003ec40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/1039808849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e4dc1a0 0x556a1e4dc5c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1039808849 >> 172.21.15.192:0/1039808849 conn(0x556a1e4d0550 msgr2=0x556a1e4d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1039808849 shutdown_connections 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/1039808849 wait complete. 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556a1e4c7b10 msgr2=0x556a1e4c9f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556a1e4c7b10 0x556a1e4c9f00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556a1e3c8040 msgr2=0x556a1e4c56a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556a1e3c8040 0x556a1e4c56a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556a1e4cba10 msgr2=0x556a1e4cde00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556a1e4cba10 0x556a1e4cde00 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa6003c780 msgr2=0x7faa6003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faa6003c780 0x7faa6003ec40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab64000c00 tx=0x7fab640013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 msgr2=0x556a1e4be0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 --2- 172.21.15.192:0/2090681571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556a1e3c5620 0x556a1e4be0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fab6c025c20 tx=0x7fab6c002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab79494640 1 -- 172.21.15.192:0/2090681571 reap_dead start 2024-09-10T05:11:48.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 shutdown_connections 2024-09-10T05:11:48.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 >> 172.21.15.192:0/2090681571 conn(0x556a1e3bf1e0 msgr2=0x556a1e4afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 shutdown_connections 2024-09-10T05:11:48.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.263+0000 7fab7b1a9800 1 -- 172.21.15.192:0/2090681571 wait complete. 2024-09-10T05:11:48.273 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T05:11:48.248949Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:48.273 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:11:48.273 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:11:48.273 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:11:48.317 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:48.318 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:48.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.317+0000 7f267832c800 1 Processor -- start 2024-09-10T05:11:48.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.317+0000 7f267832c800 1 -- start start 2024-09-10T05:11:48.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.318+0000 7f267832c800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c258a064c0 0x55c258a068c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.318+0000 7f267832c800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2588b1e40 con 0x55c258a06e00 2024-09-10T05:11:48.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.318+0000 7f267832c800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55c25887c680 con 0x55c258a064c0 2024-09-10T05:11:48.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.318+0000 7f2673f61640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c258a064c0 0x55c258a068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.318+0000 7f2673760640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55c258a06e00 0x55c258a072b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36314/0 (socket says 172.21.15.192:36314) 2024-09-10T05:11:48.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.318+0000 7f2673760640 1 -- 172.21.15.192:0/4146225801 learned_addr learned my addr 172.21.15.192:0/4146225801 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:48.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.318+0000 7f2673f61640 1 -- 172.21.15.192:0/4146225801 >> v1:172.21.15.139:6789/0 conn(0x55c258a06e00 legacy=0x55c258a072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.318+0000 7f2673f61640 1 -- 172.21.15.192:0/4146225801 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2588986b0 con 0x55c258a064c0 2024-09-10T05:11:48.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.318+0000 7f2672f5f640 1 -- 172.21.15.192:0/4146225801 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1830412378 0 0) 0x55c2588b1e40 con 0x55c258a06e00 2024-09-10T05:11:48.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.320+0000 7f2673f61640 1 --2- 172.21.15.192:0/4146225801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258a068c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2664005fd0 tx=0x7f2664045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5507489f52ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.320+0000 7f2672f5f640 1 -- 172.21.15.192:0/4146225801 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664058530 con 0x55c258a064c0 2024-09-10T05:11:48.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.320+0000 7f2672f5f640 1 -- 172.21.15.192:0/4146225801 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26640586d0 con 0x55c258a064c0 2024-09-10T05:11:48.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.320+0000 7f2672f5f640 1 -- 172.21.15.192:0/4146225801 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640589d0 con 0x55c258a064c0 2024-09-10T05:11:48.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.320+0000 7f267832c800 1 -- 172.21.15.192:0/4146225801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 msgr2=0x55c258a068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.320+0000 7f267832c800 1 --2- 172.21.15.192:0/4146225801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258a068c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2664005fd0 tx=0x7f2664045c30 comp rx=0 tx=0).stop 2024-09-10T05:11:48.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.321+0000 7f267832c800 1 -- 172.21.15.192:0/4146225801 shutdown_connections 2024-09-10T05:11:48.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.321+0000 7f267832c800 1 --2- 172.21.15.192:0/4146225801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258a068c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.321+0000 7f267832c800 1 -- 172.21.15.192:0/4146225801 >> 172.21.15.192:0/4146225801 conn(0x55c258a021f0 msgr2=0x55c258a04630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.321+0000 7f267832c800 1 -- 172.21.15.192:0/4146225801 shutdown_connections 2024-09-10T05:11:48.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.321+0000 7f267832c800 1 -- 172.21.15.192:0/4146225801 wait complete. 2024-09-10T05:11:48.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.334+0000 7f267832c800 1 Processor -- start 2024-09-10T05:11:48.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.334+0000 7f267832c800 1 -- start start 2024-09-10T05:11:48.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.335+0000 7f267832c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258af96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.335+0000 7f267832c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c2588a0dd0 con 0x55c258a064c0 2024-09-10T05:11:48.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.335+0000 7f2673f61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258af96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.335+0000 7f2673f61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258af96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59850/0 (socket says 172.21.15.192:59850) 2024-09-10T05:11:48.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.335+0000 7f2673f61640 1 -- 172.21.15.192:0/909868624 learned_addr learned my addr 172.21.15.192:0/909868624 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.335+0000 7f2673f61640 1 -- 172.21.15.192:0/909868624 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2588b9e10 con 0x55c258a064c0 2024-09-10T05:11:48.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.335+0000 7f2673f61640 1 --2- 172.21.15.192:0/909868624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258af96b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2664025a60 tx=0x7f2664051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a165620f087eb814 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.335+0000 7f2561e0b640 1 -- 172.21.15.192:0/909868624 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664068070 con 0x55c258a064c0 2024-09-10T05:11:48.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.335+0000 7f2561e0b640 1 -- 172.21.15.192:0/909868624 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2664058880 con 0x55c258a064c0 2024-09-10T05:11:48.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.336+0000 7f2561e0b640 1 -- 172.21.15.192:0/909868624 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664058ba0 con 0x55c258a064c0 2024-09-10T05:11:48.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.336+0000 7f267832c800 1 -- 172.21.15.192:0/909868624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 msgr2=0x55c258af96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.336+0000 7f267832c800 1 --2- 172.21.15.192:0/909868624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258af96b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2664025a60 tx=0x7f2664051000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.336+0000 7f267832c800 1 -- 172.21.15.192:0/909868624 shutdown_connections 2024-09-10T05:11:48.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.336+0000 7f267832c800 1 --2- 172.21.15.192:0/909868624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258af96b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.336+0000 7f267832c800 1 -- 172.21.15.192:0/909868624 >> 172.21.15.192:0/909868624 conn(0x55c258a021f0 msgr2=0x55c258af5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.336+0000 7f267832c800 1 -- 172.21.15.192:0/909868624 shutdown_connections 2024-09-10T05:11:48.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.336+0000 7f267832c800 1 -- 172.21.15.192:0/909868624 wait complete. 2024-09-10T05:11:48.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.337+0000 7f267832c800 1 Processor -- start 2024-09-10T05:11:48.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.337+0000 7f267832c800 1 -- start start 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.337+0000 7f267832c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258b00f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.337+0000 7f267832c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c258a07d20 con 0x55c258a064c0 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.337+0000 7f2673f61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258b00f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.337+0000 7f2673f61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258b00f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59856/0 (socket says 172.21.15.192:59856) 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.337+0000 7f2673f61640 1 -- 172.21.15.192:0/79599112 learned_addr learned my addr 172.21.15.192:0/79599112 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.337+0000 7f2673f61640 1 -- 172.21.15.192:0/79599112 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c258b014b0 con 0x55c258a064c0 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.337+0000 7f2673f61640 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258b00f50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2664025a60 tx=0x7f2664003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.337+0000 7f255bfff640 1 -- 172.21.15.192:0/79599112 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664068040 con 0x55c258a064c0 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.338+0000 7f255bfff640 1 -- 172.21.15.192:0/79599112 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2664071070 con 0x55c258a064c0 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.338+0000 7f255bfff640 1 -- 172.21.15.192:0/79599112 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640637b0 con 0x55c258a064c0 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.338+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c258b01740 con 0x55c258a064c0 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.338+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c258b02070 con 0x55c258a064c0 2024-09-10T05:11:48.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.338+0000 7f255bfff640 1 -- 172.21.15.192:0/79599112 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2664063950 con 0x55c258a064c0 2024-09-10T05:11:48.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.339+0000 7f255bfff640 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f255c03c780 0x7f255c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.339+0000 7f255bfff640 1 -- 172.21.15.192:0/79599112 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f2664097410 con 0x55c258a064c0 2024-09-10T05:11:48.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.339+0000 7f2673760640 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f255c03c780 0x7f255c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.339+0000 7f267832c800 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c258a06e00 0x55c258b08550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.339+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b02cc0 con 0x55c258a06e00 2024-09-10T05:11:48.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.339+0000 7f2674762640 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c258a06e00 0x55c258b08550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.339+0000 7f2673760640 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f255c03c780 0x7f255c03ec40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f265c000c00 tx=0x7f265c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.339+0000 7f2674762640 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c258a06e00 0x55c258b08550 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.339+0000 7f2674762640 1 -- 172.21.15.192:0/79599112 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c0083e0 con 0x55c258a06e00 2024-09-10T05:11:48.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.339+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b02550 con 0x55c258a06e00 2024-09-10T05:11:48.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.340+0000 7f2674762640 1 -- 172.21.15.192:0/79599112 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f266c0083e0 con 0x55c258a06e00 2024-09-10T05:11:48.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.340+0000 7f267832c800 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c258b0aa00 0x55c258b0cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.340+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b0d4c0 con 0x55c258b0aa00 2024-09-10T05:11:48.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.340+0000 7f2673f61640 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c258b0aa00 0x55c258b0cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.340+0000 7f2673f61640 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c258b0aa00 0x55c258b0cdf0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.341+0000 7f2673f61640 1 -- 172.21.15.192:0/79599112 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b0aa00 2024-09-10T05:11:48.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.341+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b098a0 con 0x55c258a06e00 2024-09-10T05:11:48.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.341+0000 7f2674762640 1 -- 172.21.15.192:0/79599112 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f266c0083e0 con 0x55c258a06e00 2024-09-10T05:11:48.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.341+0000 7f267832c800 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c258b0e900 0x55c258b10cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.341+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b11480 con 0x55c258b0e900 2024-09-10T05:11:48.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.341+0000 7f2673760640 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c258b0e900 0x55c258b10cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.341+0000 7f2673760640 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c258b0e900 0x55c258b10cf0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.342+0000 7f2673760640 1 -- 172.21.15.192:0/79599112 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f265c00f670 con 0x55c258b0e900 2024-09-10T05:11:48.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.342+0000 7f267832c800 1 Processor -- start 2024-09-10T05:11:48.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.342+0000 7f267832c800 1 -- start start 2024-09-10T05:11:48.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.342+0000 7f267832c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b1f0e0 0x55c258b1f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.342+0000 7f267832c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c2588fea00 con 0x55c258b1f0e0 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.342+0000 7f2673f61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b1f0e0 0x55c258b1f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.342+0000 7f2673f61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b1f0e0 0x55c258b1f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59860/0 (socket says 172.21.15.192:59860) 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.342+0000 7f2673f61640 1 -- 172.21.15.192:0/767811287 learned_addr learned my addr 172.21.15.192:0/767811287 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.343+0000 7f2673f61640 1 -- 172.21.15.192:0/767811287 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c258b1fb40 con 0x55c258b1f0e0 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.343+0000 7f2673f61640 1 --2- 172.21.15.192:0/767811287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b1f0e0 0x55c258b1f500 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2664095800 tx=0x7f266406e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.343+0000 7f25597fa640 1 -- 172.21.15.192:0/767811287 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664094150 con 0x55c258b1f0e0 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.343+0000 7f25597fa640 1 -- 172.21.15.192:0/767811287 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2664086070 con 0x55c258b1f0e0 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.343+0000 7f25597fa640 1 -- 172.21.15.192:0/767811287 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664095b70 con 0x55c258b1f0e0 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.343+0000 7f267832c800 1 -- 172.21.15.192:0/767811287 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c258b20370 con 0x55c258b1f0e0 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.343+0000 7f267832c800 1 -- 172.21.15.192:0/767811287 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c258b20910 con 0x55c258b1f0e0 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.344+0000 7f25597fa640 1 -- 172.21.15.192:0/767811287 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2664088020 con 0x55c258b1f0e0 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.344+0000 7f25597fa640 1 --2- 172.21.15.192:0/767811287 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f254c03c780 0x7f254c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.344+0000 7f25597fa640 1 -- 172.21.15.192:0/767811287 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f2664001250 con 0x55c258b1f0e0 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.344+0000 7f2673760640 1 --2- 172.21.15.192:0/767811287 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f254c03c780 0x7f254c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.344+0000 7f267832c800 1 Processor -- start 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.344+0000 7f267832c800 1 -- start start 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.344+0000 7f2673760640 1 --2- 172.21.15.192:0/767811287 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f254c03c780 0x7f254c03ec40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55c258b08bf0 tx=0x7f265c006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.344+0000 7f267832c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 0x55c258b2bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.344+0000 7f267832c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c258af9e40 con 0x55c258b2b980 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.345+0000 7f2673f61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 0x55c258b2bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.345+0000 7f2673f61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 0x55c258b2bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59876/0 (socket says 172.21.15.192:59876) 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.345+0000 7f2673f61640 1 -- 172.21.15.192:0/2498248748 learned_addr learned my addr 172.21.15.192:0/2498248748 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.345+0000 7f2673f61640 1 -- 172.21.15.192:0/2498248748 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c258b2c350 con 0x55c258b2b980 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.345+0000 7f2673f61640 1 --2- 172.21.15.192:0/2498248748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 0x55c258b2bd60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f266406bc00 tx=0x7f2664065b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ff439aaf655a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.345+0000 7f2552ffd640 1 -- 172.21.15.192:0/2498248748 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640a6070 con 0x55c258b2b980 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.345+0000 7f2552ffd640 1 -- 172.21.15.192:0/2498248748 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266406e640 con 0x55c258b2b980 2024-09-10T05:11:48.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.345+0000 7f2552ffd640 1 -- 172.21.15.192:0/2498248748 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266406e480 con 0x55c258b2b980 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f267832c800 1 -- 172.21.15.192:0/2498248748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 msgr2=0x55c258b2bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f267832c800 1 --2- 172.21.15.192:0/2498248748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 0x55c258b2bd60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f266406bc00 tx=0x7f2664065b60 comp rx=0 tx=0).stop 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f267832c800 1 -- 172.21.15.192:0/2498248748 shutdown_connections 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f267832c800 1 --2- 172.21.15.192:0/2498248748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 0x55c258b2bd60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f267832c800 1 -- 172.21.15.192:0/2498248748 >> 172.21.15.192:0/2498248748 conn(0x55c258b27d80 msgr2=0x55c258b25fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f267832c800 1 -- 172.21.15.192:0/2498248748 shutdown_connections 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f267832c800 1 -- 172.21.15.192:0/2498248748 wait complete. 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f267832c800 1 Processor -- start 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f267832c800 1 -- start start 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f267832c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 0x55c258b32d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f267832c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c258b2c7e0 con 0x55c258b2b980 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f2673f61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 0x55c258b32d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f2673f61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 0x55c258b32d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59886/0 (socket says 172.21.15.192:59886) 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.346+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 learned_addr learned my addr 172.21.15.192:0/1101010888 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.347+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c258b332c0 con 0x55c258b2b980 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.347+0000 7f2673f61640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 0x55c258b32d60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f266406e830 tx=0x7f266406bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.347+0000 7f25517fa640 1 -- 172.21.15.192:0/1101010888 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664065900 con 0x55c258b2b980 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.347+0000 7f25517fa640 1 -- 172.21.15.192:0/1101010888 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266406b760 con 0x55c258b2b980 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.347+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c258b332c0 con 0x55c258b2b980 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.347+0000 7f25517fa640 1 -- 172.21.15.192:0/1101010888 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266406ee50 con 0x55c258b2b980 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.347+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c258b332c0 con 0x55c258b2b980 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.348+0000 7f25517fa640 1 -- 172.21.15.192:0/1101010888 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f26640bd060 con 0x55c258b2b980 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.348+0000 7f25517fa640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f253c03c730 0x7f253c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.348+0000 7f25517fa640 1 -- 172.21.15.192:0/1101010888 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f26640c0c40 con 0x55c258b2b980 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.348+0000 7f2673760640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f253c03c730 0x7f253c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.348+0000 7f267832c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.348+0000 7f267832c800 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c258b3e310 0x55c258b407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.348+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b40f20 con 0x55c258b3e310 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.348+0000 7f2674762640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c258b3e310 0x55c258b407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f2673760640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f253c03c730 0x7f253c03ebf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f265c00ffd0 tx=0x7f265c023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f2674762640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c258b3e310 0x55c258b407d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c0083e0 con 0x55c258b3e310 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f267832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f267832c800 20 realm 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f267832c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41330 con 0x55c258b3e310 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c0083e0 con 0x55c258b3e310 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f267832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f267832c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:48.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f267832c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b3e310 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c0083e0 con 0x55c258b3e310 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f267832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f267832c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.349+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41fa0 con 0x55c258b3e310 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.350+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f266c0083e0 con 0x55c258b3e310 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.350+0000 7f267832c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.350+0000 7f267832c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.350+0000 7f267832c800 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c258b426f0 0x55c258b44ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.350+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b45270 con 0x55c258b426f0 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.350+0000 7f2673f61640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c258b426f0 0x55c258b44ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.350+0000 7f2673f61640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c258b426f0 0x55c258b44ae0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.351+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.351+0000 7f267832c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:48.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.351+0000 7f267832c800 20 searching for the correct realm 2024-09-10T05:11:48.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.351+0000 7f267832c800 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c258b47360 0x55c258b49820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.351+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b49ef0 con 0x55c258b47360 2024-09-10T05:11:48.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.351+0000 7f2673760640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c258b47360 0x55c258b49820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.351+0000 7f2673760640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c258b47360 0x55c258b49820 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.351+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.351+0000 7f2673760640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f265c02e910 0x7f265c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.351+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b49ef0 con 0x7f265c02e910 2024-09-10T05:11:48.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.351+0000 7f2674762640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f265c02e910 0x7f265c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.352+0000 7f2674762640 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f265c02e910 0x7f265c03a3c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.352+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f266c0083e0 con 0x7f265c02e910 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.352+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b426f0 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.352+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.352+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b3e310 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.353+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c0083e0 con 0x55c258b3e310 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.353+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b3e310 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.353+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.353+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b426f0 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.353+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.353+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b426f0 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.353+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.353+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x7f265c02e910 2024-09-10T05:11:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.353+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x7f265c02e910 2024-09-10T05:11:48.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.354+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b47360 2024-09-10T05:11:48.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.354+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.354+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b3e310 2024-09-10T05:11:48.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.354+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.354+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b426f0 2024-09-10T05:11:48.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.354+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.354+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b3e310 2024-09-10T05:11:48.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.355+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.355+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x7f265c02e910 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.355+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f266c026040 con 0x7f265c02e910 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.355+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b47360 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.355+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.355+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b47360 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.355+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.355+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b426f0 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.356+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.356+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b47360 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.356+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.356+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b47360 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.356+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.356+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b3e310 2024-09-10T05:11:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.356+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.356+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b3e310 2024-09-10T05:11:48.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.356+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.356+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b426f0 2024-09-10T05:11:48.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.357+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.357+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b47360 2024-09-10T05:11:48.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.357+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.357+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x7f265c02e910 2024-09-10T05:11:48.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.357+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x7f265c02e910 2024-09-10T05:11:48.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.357+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b3e310 2024-09-10T05:11:48.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.357+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.357+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b426f0 2024-09-10T05:11:48.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.358+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.358+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b47360 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.358+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.358+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b426f0 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.358+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.358+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x7f265c02e910 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.358+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x7f265c02e910 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b47360 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b426f0 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x55c258b3e310 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c258b41c00 con 0x7f265c02e910 2024-09-10T05:11:48.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x7f265c02e910 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f267832c800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f267832c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f267832c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f267832c800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f267832c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f267832c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f267832c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.359+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b45c20 con 0x55c258b3e310 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b45c20 con 0x55c258b3e310 2024-09-10T05:11:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b45bf0 con 0x7f265c02e910 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f266c026040 con 0x7f265c02e910 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 20 zone default found 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 4 Realm: () 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 20 zonegroup default 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.360+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b46010 con 0x55c258b426f0 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f267832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f267832c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b45b80 con 0x55c258b47360 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f267832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f267832c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4bd60 con 0x55c258b47360 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f267832c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f267832c800 20 started sync module instance, tier type = 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f267832c800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.361+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4b200 con 0x7f265c02e910 2024-09-10T05:11:48.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.362+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x7f265c02e910 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.362+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293200254720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4b200 con 0x7f265c02e910 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.362+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4c7d0 con 0x55c258b3e310 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.363+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94293200254720] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x7f265c02e910 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.363+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.363+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94293200257696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4b200 con 0x55c258b3e310 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.363+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4d260 con 0x55c258b47360 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.364+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94293200257696] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.365+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.365+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94293200252240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4b170 con 0x55c258b47360 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.365+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4e120 con 0x7f265c02e910 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.366+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x7f265c02e910 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.366+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94293200264816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4e9c0 con 0x7f265c02e910 2024-09-10T05:11:48.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.366+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4f470 con 0x55c258b3e310 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.366+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94293200252240] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.367+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94293200264816] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x7f265c02e910 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.367+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.367+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94293200262736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4e410 con 0x55c258b3e310 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.367+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4fd10 con 0x55c258b426f0 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.368+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94293200262736] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.368+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.368+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94293200271456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4e410 con 0x55c258b426f0 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.368+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b506d0 con 0x55c258b426f0 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.369+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94293200271456] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.369+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.369+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94293200269136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b50f20 con 0x55c258b426f0 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.369+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b517d0 con 0x55c258b426f0 2024-09-10T05:11:48.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.370+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.370+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94293200269136] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.370+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94293200277280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b51340 con 0x55c258b426f0 2024-09-10T05:11:48.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.370+0000 7f267832c800 20 add_watcher() i=0 2024-09-10T05:11:48.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.370+0000 7f267832c800 20 add_watcher() i=1 2024-09-10T05:11:48.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.370+0000 7f267832c800 20 add_watcher() i=2 2024-09-10T05:11:48.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.370+0000 7f267832c800 20 add_watcher() i=3 2024-09-10T05:11:48.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.370+0000 7f267832c800 20 add_watcher() i=4 2024-09-10T05:11:48.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.370+0000 7f267832c800 20 add_watcher() i=5 2024-09-10T05:11:48.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.370+0000 7f267832c800 20 add_watcher() i=6 2024-09-10T05:11:48.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.373+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94293200277280] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.373+0000 7f267832c800 20 add_watcher() i=7 2024-09-10T05:11:48.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.373+0000 7f267832c800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:48.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.373+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b50b30 con 0x55c258b3e310 2024-09-10T05:11:48.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.373+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.373+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94293200280560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b524c0 con 0x55c258b3e310 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.374+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94293200280560] v35'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.374+0000 7f2529fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.374+0000 7f267832c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.374+0000 7f267832c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.374+0000 7f267832c800 5 note: GC not initialized 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.375+0000 7f2528fe1640 20 reqs_thread_entry: start 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.375+0000 7f267832c800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.375+0000 7f267832c800 20 Filter name: none 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.375+0000 7f24a27fc640 20 reqs_thread_entry: start 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.375+0000 7f267832c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.375+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c258b878e0 con 0x55c258b3e310 2024-09-10T05:11:48.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.375+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.375+0000 7f267832c800 20 rados_obj.operate() r=0 bl.length=673 2024-09-10T05:11:48.385 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T05:11:48.248949Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:48.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.376+0000 7f2529fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.376+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94293200280560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b87cf0 con 0x55c258b3e310 2024-09-10T05:11:48.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.377+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94293200280560] v35'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.377+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94293200254720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b87cf0 con 0x7f265c02e910 2024-09-10T05:11:48.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.378+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94293200254720] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x7f265c02e910 2024-09-10T05:11:48.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.378+0000 7f267832c800 20 remove_watcher() i=0 2024-09-10T05:11:48.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.378+0000 7f267832c800 2 removed watcher, disabling cache 2024-09-10T05:11:48.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.378+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94293200257696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4b700 con 0x55c258b3e310 2024-09-10T05:11:48.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.379+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94293200257696] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.379+0000 7f267832c800 20 remove_watcher() i=1 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.379+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94293200252240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4b700 con 0x55c258b47360 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.380+0000 7f2673760640 1 -- 172.21.15.192:0/1101010888 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94293200252240] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c037040 con 0x55c258b47360 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.380+0000 7f267832c800 20 remove_watcher() i=2 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.380+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94293200264816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4ad50 con 0x7f265c02e910 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.381+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94293200264816] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x7f265c02e910 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.381+0000 7f267832c800 20 remove_watcher() i=3 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.381+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94293200262736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4ad50 con 0x55c258b3e310 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.382+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94293200262736] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x55c258b3e310 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.382+0000 7f267832c800 20 remove_watcher() i=4 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.382+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94293200271456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4ad50 con 0x55c258b426f0 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.383+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94293200271456] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.383+0000 7f267832c800 20 remove_watcher() i=5 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.383+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94293200269136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4f860 con 0x55c258b426f0 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.384+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94293200269136] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.384+0000 7f267832c800 20 remove_watcher() i=6 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.384+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94293200277280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c258b4ef50 con 0x55c258b426f0 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f2673f61640 1 -- 172.21.15.192:0/1101010888 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94293200277280] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26640970b0 con 0x55c258b426f0 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 20 remove_watcher() i=7 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c258b426f0 msgr2=0x55c258b44ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c258b426f0 0x55c258b44ae0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c258b3e310 msgr2=0x55c258b407d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c258b3e310 0x55c258b407d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f265c02e910 msgr2=0x7f265c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f265c02e910 0x7f265c03a3c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c258b47360 msgr2=0x55c258b49820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c258b47360 0x55c258b49820 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f253c03c730 msgr2=0x7f253c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f253c03c730 0x7f253c03ebf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f265c00ffd0 tx=0x7f265c023040 comp rx=0 tx=0).stop 2024-09-10T05:11:48.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f2674762640 1 -- 172.21.15.192:0/1101010888 reap_dead start 2024-09-10T05:11:48.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 msgr2=0x55c258b32d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 0x55c258b32d60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f266406e830 tx=0x7f266406bb90 comp rx=0 tx=0).stop 2024-09-10T05:11:48.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 shutdown_connections 2024-09-10T05:11:48.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 --2- 172.21.15.192:0/1101010888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b2b980 0x55c258b32d60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 >> 172.21.15.192:0/1101010888 conn(0x55c258b27d80 msgr2=0x55c258b25f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 shutdown_connections 2024-09-10T05:11:48.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.385+0000 7f267832c800 1 -- 172.21.15.192:0/1101010888 wait complete. 2024-09-10T05:11:48.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/767811287 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f254c03c780 msgr2=0x7f254c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 --2- 172.21.15.192:0/767811287 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f254c03c780 0x7f254c03ec40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55c258b08bf0 tx=0x7f265c006000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/767811287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b1f0e0 msgr2=0x55c258b1f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 --2- 172.21.15.192:0/767811287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b1f0e0 0x55c258b1f500 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2664095800 tx=0x7f266406e160 comp rx=0 tx=0).stop 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/767811287 shutdown_connections 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 --2- 172.21.15.192:0/767811287 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f254c03c780 0x7f254c03ec40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 --2- 172.21.15.192:0/767811287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258b1f0e0 0x55c258b1f500 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/767811287 >> 172.21.15.192:0/767811287 conn(0x55c258b13490 msgr2=0x55c258b13870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/767811287 shutdown_connections 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/767811287 wait complete. 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c258b0aa00 msgr2=0x55c258b0cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c258b0aa00 0x55c258b0cdf0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c258a06e00 msgr2=0x55c258b08550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c258a06e00 0x55c258b08550 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c258b0e900 msgr2=0x55c258b10cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c258b0e900 0x55c258b10cf0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f255c03c780 msgr2=0x7f255c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f255c03c780 0x7f255c03ec40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f265c000c00 tx=0x7f265c0013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 msgr2=0x55c258b00f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 --2- 172.21.15.192:0/79599112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c258a064c0 0x55c258b00f50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2664025a60 tx=0x7f2664003330 comp rx=0 tx=0).stop 2024-09-10T05:11:48.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f2674762640 1 -- 172.21.15.192:0/79599112 reap_dead start 2024-09-10T05:11:48.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 shutdown_connections 2024-09-10T05:11:48.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 >> 172.21.15.192:0/79599112 conn(0x55c258a021f0 msgr2=0x55c258afa870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 shutdown_connections 2024-09-10T05:11:48.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.386+0000 7f267832c800 1 -- 172.21.15.192:0/79599112 wait complete. 2024-09-10T05:11:48.396 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T05:11:48.248949Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:48.396 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-10T05:11:48.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-10T05:11:48.397 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-10T05:11:48.444 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:48.444 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:48.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.444+0000 7f5174f39800 1 Processor -- start 2024-09-10T05:11:48.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.444+0000 7f5174f39800 1 -- start start 2024-09-10T05:11:48.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.444+0000 7f5174f39800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5584b31f0ff0 0x5584b31f9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.444+0000 7f5174f39800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5584b309ae40 con 0x5584b31ef4d0 2024-09-10T05:11:48.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.444+0000 7f5174f39800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5584b3065680 con 0x5584b31f0ff0 2024-09-10T05:11:48.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.444+0000 7f516bfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5584b31f0ff0 0x5584b31f9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.444+0000 7f5170bce640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5584b31ef4d0 0x5584b31ef8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36330/0 (socket says 172.21.15.192:36330) 2024-09-10T05:11:48.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.444+0000 7f5170bce640 1 -- 172.21.15.192:0/708295532 learned_addr learned my addr 172.21.15.192:0/708295532 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:48.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.444+0000 7f516bfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5584b31f0ff0 0x5584b31f9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59900/0 (socket says 172.21.15.192:59900) 2024-09-10T05:11:48.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.444+0000 7f516bfff640 1 -- 172.21.15.192:0/708295532 >> v1:172.21.15.139:6789/0 conn(0x5584b31ef4d0 legacy=0x5584b31ef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.444+0000 7f516bfff640 1 -- 172.21.15.192:0/708295532 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b30816b0 con 0x5584b31f0ff0 2024-09-10T05:11:48.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.446+0000 7f516bfff640 1 --2- 172.21.15.192:0/708295532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31f0ff0 0x5584b31f9b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f515c00a470 tx=0x7f515c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792adfc676e90769 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.446+0000 7f516b7fe640 1 -- 172.21.15.192:0/708295532 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f515c053570 con 0x5584b31f0ff0 2024-09-10T05:11:48.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.446+0000 7f516b7fe640 1 -- 172.21.15.192:0/708295532 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f515c058070 con 0x5584b31f0ff0 2024-09-10T05:11:48.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.446+0000 7f516b7fe640 1 -- 172.21.15.192:0/708295532 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f515c053880 con 0x5584b31f0ff0 2024-09-10T05:11:48.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.447+0000 7f5174f39800 1 -- 172.21.15.192:0/708295532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31f0ff0 msgr2=0x5584b31f9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.447+0000 7f5174f39800 1 --2- 172.21.15.192:0/708295532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31f0ff0 0x5584b31f9b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f515c00a470 tx=0x7f515c045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:48.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.447+0000 7f5174f39800 1 -- 172.21.15.192:0/708295532 shutdown_connections 2024-09-10T05:11:48.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.447+0000 7f5174f39800 1 --2- 172.21.15.192:0/708295532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31f0ff0 0x5584b31f9b10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.447+0000 7f5174f39800 1 -- 172.21.15.192:0/708295532 >> 172.21.15.192:0/708295532 conn(0x5584b31eb200 msgr2=0x5584b31ed640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.447+0000 7f5174f39800 1 -- 172.21.15.192:0/708295532 shutdown_connections 2024-09-10T05:11:48.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.447+0000 7f5174f39800 1 -- 172.21.15.192:0/708295532 wait complete. 2024-09-10T05:11:48.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.461+0000 7f5174f39800 1 Processor -- start 2024-09-10T05:11:48.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.461+0000 7f5174f39800 1 -- start start 2024-09-10T05:11:48.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.461+0000 7f5174f39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 0x5584b32e2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.461+0000 7f5174f39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5584b3089dd0 con 0x5584b31ef4d0 2024-09-10T05:11:48.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.461+0000 7f5170bce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 0x5584b32e2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.461+0000 7f5170bce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 0x5584b32e2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59914/0 (socket says 172.21.15.192:59914) 2024-09-10T05:11:48.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.461+0000 7f5170bce640 1 -- 172.21.15.192:0/4054740890 learned_addr learned my addr 172.21.15.192:0/4054740890 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.461+0000 7f5170bce640 1 -- 172.21.15.192:0/4054740890 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b30a2e10 con 0x5584b31ef4d0 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.462+0000 7f5170bce640 1 --2- 172.21.15.192:0/4054740890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 0x5584b32e2840 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5164001e40 tx=0x7f5164001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a931121506bced server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.462+0000 7f505ee05640 1 -- 172.21.15.192:0/4054740890 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5164012020 con 0x5584b31ef4d0 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.462+0000 7f505ee05640 1 -- 172.21.15.192:0/4054740890 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f516400e5a0 con 0x5584b31ef4d0 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.462+0000 7f505ee05640 1 -- 172.21.15.192:0/4054740890 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f516400e8a0 con 0x5584b31ef4d0 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.462+0000 7f5174f39800 1 -- 172.21.15.192:0/4054740890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 msgr2=0x5584b32e2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.462+0000 7f5174f39800 1 --2- 172.21.15.192:0/4054740890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 0x5584b32e2840 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5164001e40 tx=0x7f5164001e70 comp rx=0 tx=0).stop 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.462+0000 7f5174f39800 1 -- 172.21.15.192:0/4054740890 shutdown_connections 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.462+0000 7f5174f39800 1 --2- 172.21.15.192:0/4054740890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 0x5584b32e2840 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.462+0000 7f5174f39800 1 -- 172.21.15.192:0/4054740890 >> 172.21.15.192:0/4054740890 conn(0x5584b31eb200 msgr2=0x5584b32de1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.462+0000 7f5174f39800 1 -- 172.21.15.192:0/4054740890 shutdown_connections 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.462+0000 7f5174f39800 1 -- 172.21.15.192:0/4054740890 wait complete. 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.463+0000 7f5174f39800 1 Processor -- start 2024-09-10T05:11:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.463+0000 7f5174f39800 1 -- start start 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.463+0000 7f5174f39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 0x5584b32ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.463+0000 7f5174f39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5584b31fa350 con 0x5584b31ef4d0 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.463+0000 7f5170bce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 0x5584b32ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.463+0000 7f5170bce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 0x5584b32ea1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59922/0 (socket says 172.21.15.192:59922) 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.463+0000 7f5170bce640 1 -- 172.21.15.192:0/2731053630 learned_addr learned my addr 172.21.15.192:0/2731053630 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.463+0000 7f5170bce640 1 -- 172.21.15.192:0/2731053630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b32ea750 con 0x5584b31ef4d0 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.463+0000 7f5170bce640 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 0x5584b32ea1f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f516400c010 tx=0x7f5164000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.464+0000 7f505d602640 1 -- 172.21.15.192:0/2731053630 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5164012030 con 0x5584b31ef4d0 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.464+0000 7f505d602640 1 -- 172.21.15.192:0/2731053630 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51640014a0 con 0x5584b31ef4d0 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.464+0000 7f505d602640 1 -- 172.21.15.192:0/2731053630 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f516401a7a0 con 0x5584b31ef4d0 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.464+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584b32ea9e0 con 0x5584b31ef4d0 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.464+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b32eb3e0 con 0x5584b31ef4d0 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.464+0000 7f505d602640 1 -- 172.21.15.192:0/2731053630 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5164015020 con 0x5584b31ef4d0 2024-09-10T05:11:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.465+0000 7f505d602640 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f505803c780 0x7f505803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.465+0000 7f505d602640 1 -- 172.21.15.192:0/2731053630 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5164020030 con 0x5584b31ef4d0 2024-09-10T05:11:48.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.465+0000 7f516bfff640 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f505803c780 0x7f505803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.465+0000 7f5174f39800 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5584b31f0ff0 0x5584b32f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.465+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b32ebf90 con 0x5584b31f0ff0 2024-09-10T05:11:48.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.465+0000 7f51713cf640 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5584b31f0ff0 0x5584b32f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.465+0000 7f516bfff640 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f505803c780 0x7f505803ec40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f515c057000 tx=0x7f515c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.465+0000 7f51713cf640 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5584b31f0ff0 0x5584b32f1840 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.465+0000 7f51713cf640 1 -- 172.21.15.192:0/2731053630 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b31f0ff0 2024-09-10T05:11:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.466+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b32eb870 con 0x5584b31f0ff0 2024-09-10T05:11:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.466+0000 7f51713cf640 1 -- 172.21.15.192:0/2731053630 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b31f0ff0 2024-09-10T05:11:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.466+0000 7f5174f39800 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5584b32f3cb0 0x5584b32f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.466+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b32f6770 con 0x5584b32f3cb0 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.466+0000 7f5170bce640 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5584b32f3cb0 0x5584b32f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.466+0000 7f5170bce640 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5584b32f3cb0 0x5584b32f60a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.467+0000 7f5170bce640 1 -- 172.21.15.192:0/2731053630 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f51640187b0 con 0x5584b32f3cb0 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.467+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b32f2b50 con 0x5584b31f0ff0 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.467+0000 7f51713cf640 1 -- 172.21.15.192:0/2731053630 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b31f0ff0 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.467+0000 7f5174f39800 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5584b32f7bb0 0x5584b32f9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.467+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b32fa6e0 con 0x5584b32f7bb0 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.467+0000 7f516bfff640 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5584b32f7bb0 0x5584b32f9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.467+0000 7f516bfff640 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5584b32f7bb0 0x5584b32f9fa0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.468+0000 7f516bfff640 1 -- 172.21.15.192:0/2731053630 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f515c051070 con 0x5584b32f7bb0 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.468+0000 7f5174f39800 1 Processor -- start 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.468+0000 7f5174f39800 1 -- start start 2024-09-10T05:11:48.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.468+0000 7f5174f39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3308340 0x5584b3308760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.468+0000 7f5174f39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5584b30e7a00 con 0x5584b3308340 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.468+0000 7f5170bce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3308340 0x5584b3308760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.468+0000 7f5170bce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3308340 0x5584b3308760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59938/0 (socket says 172.21.15.192:59938) 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.468+0000 7f5170bce640 1 -- 172.21.15.192:0/1634769988 learned_addr learned my addr 172.21.15.192:0/1634769988 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.469+0000 7f5170bce640 1 -- 172.21.15.192:0/1634769988 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b3308da0 con 0x5584b3308340 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.469+0000 7f5170bce640 1 --2- 172.21.15.192:0/1634769988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3308340 0x5584b3308760 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5164001250 tx=0x7f516401ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.469+0000 7f50567fc640 1 -- 172.21.15.192:0/1634769988 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5164018430 con 0x5584b3308340 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.469+0000 7f50567fc640 1 -- 172.21.15.192:0/1634769988 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5164045040 con 0x5584b3308340 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.469+0000 7f5174f39800 1 -- 172.21.15.192:0/1634769988 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584b33095d0 con 0x5584b3308340 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.469+0000 7f50567fc640 1 -- 172.21.15.192:0/1634769988 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f516400c8c0 con 0x5584b3308340 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.469+0000 7f5174f39800 1 -- 172.21.15.192:0/1634769988 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b3309b70 con 0x5584b3308340 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.470+0000 7f50567fc640 1 -- 172.21.15.192:0/1634769988 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5164053040 con 0x5584b3308340 2024-09-10T05:11:48.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.470+0000 7f50567fc640 1 --2- 172.21.15.192:0/1634769988 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f504803c780 0x7f504803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.470+0000 7f50567fc640 1 -- 172.21.15.192:0/1634769988 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5164025030 con 0x5584b3308340 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.470+0000 7f516bfff640 1 --2- 172.21.15.192:0/1634769988 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f504803c780 0x7f504803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.470+0000 7f5174f39800 1 Processor -- start 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.470+0000 7f5174f39800 1 -- start start 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.470+0000 7f516bfff640 1 --2- 172.21.15.192:0/1634769988 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f504803c780 0x7f504803ec40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5584b32f1e50 tx=0x7f515c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.470+0000 7f5174f39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 0x5584b3315020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.470+0000 7f5174f39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5584b32e3090 con 0x5584b3314c20 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.471+0000 7f5170bce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 0x5584b3315020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.471+0000 7f5170bce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 0x5584b3315020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59950/0 (socket says 172.21.15.192:59950) 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.471+0000 7f5170bce640 1 -- 172.21.15.192:0/2118063046 learned_addr learned my addr 172.21.15.192:0/2118063046 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.471+0000 7f5170bce640 1 -- 172.21.15.192:0/2118063046 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b3315610 con 0x5584b3314c20 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.471+0000 7f5170bce640 1 --2- 172.21.15.192:0/2118063046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 0x5584b3315020 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5164029fd0 tx=0x7f516400d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72263c8490070922 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.471+0000 7f5047fff640 1 -- 172.21.15.192:0/2118063046 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51640363f0 con 0x5584b3314c20 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.471+0000 7f5047fff640 1 -- 172.21.15.192:0/2118063046 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51640365b0 con 0x5584b3314c20 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.471+0000 7f5047fff640 1 -- 172.21.15.192:0/2118063046 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5164024cb0 con 0x5584b3314c20 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5174f39800 1 -- 172.21.15.192:0/2118063046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 msgr2=0x5584b3315020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5174f39800 1 --2- 172.21.15.192:0/2118063046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 0x5584b3315020 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5164029fd0 tx=0x7f516400d6b0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5174f39800 1 -- 172.21.15.192:0/2118063046 shutdown_connections 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5174f39800 1 --2- 172.21.15.192:0/2118063046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 0x5584b3315020 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5174f39800 1 -- 172.21.15.192:0/2118063046 >> 172.21.15.192:0/2118063046 conn(0x5584b3311020 msgr2=0x5584b330f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5174f39800 1 -- 172.21.15.192:0/2118063046 shutdown_connections 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5174f39800 1 -- 172.21.15.192:0/2118063046 wait complete. 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5174f39800 1 Processor -- start 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5174f39800 1 -- start start 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5174f39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 0x5584b331c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5174f39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5584b3315a80 con 0x5584b3314c20 2024-09-10T05:11:48.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5170bce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 0x5584b331c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5170bce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 0x5584b331c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59966/0 (socket says 172.21.15.192:59966) 2024-09-10T05:11:48.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.472+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 learned_addr learned my addr 172.21.15.192:0/4226556307 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.473+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b331c590 con 0x5584b3314c20 2024-09-10T05:11:48.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.473+0000 7f5170bce640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 0x5584b331c030 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5164037e70 tx=0x7f516403ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.473+0000 7f50467fc640 1 -- 172.21.15.192:0/4226556307 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51640363f0 con 0x5584b3314c20 2024-09-10T05:11:48.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.473+0000 7f50467fc640 1 -- 172.21.15.192:0/4226556307 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f516406f070 con 0x5584b3314c20 2024-09-10T05:11:48.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.473+0000 7f50467fc640 1 -- 172.21.15.192:0/4226556307 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51640163b0 con 0x5584b3314c20 2024-09-10T05:11:48.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.473+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584b331c590 con 0x5584b3314c20 2024-09-10T05:11:48.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.473+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b331c590 con 0x5584b3314c20 2024-09-10T05:11:48.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.474+0000 7f50467fc640 1 -- 172.21.15.192:0/4226556307 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f516405d070 con 0x5584b3314c20 2024-09-10T05:11:48.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.474+0000 7f50467fc640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f503c03c780 0x7f503c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.474+0000 7f50467fc640 1 -- 172.21.15.192:0/4226556307 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5164027120 con 0x5584b3314c20 2024-09-10T05:11:48.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.474+0000 7f516bfff640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f503c03c780 0x7f503c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.475+0000 7f516bfff640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f503c03c780 0x7f503c03ec40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f515c000c00 tx=0x7f515c053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.475+0000 7f5174f39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.475+0000 7f5174f39800 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5584b3327560 0x5584b3329a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.475+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b332a170 con 0x5584b3327560 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.475+0000 7f51713cf640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5584b3327560 0x5584b3329a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.475+0000 7f51713cf640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5584b3327560 0x5584b3329a20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.475+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.475+0000 7f5174f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.475+0000 7f5174f39800 20 realm 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.475+0000 7f5174f39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.475+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b332a580 con 0x5584b3327560 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.475+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f5174f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f5174f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f5174f39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b332ae50 con 0x5584b3327560 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f5174f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f5174f39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b3327560 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f5174f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f5174f39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f5174f39800 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5584b332bf50 0x5584b332e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b332e900 con 0x5584b332bf50 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.476+0000 7f5170bce640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5584b332bf50 0x5584b332e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.477+0000 7f5170bce640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5584b332bf50 0x5584b332e340 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.477+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.477+0000 7f5174f39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.477+0000 7f5174f39800 20 searching for the correct realm 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.477+0000 7f5174f39800 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5584b33308b0 0x5584b3332d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.477+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b3333440 con 0x5584b33308b0 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.477+0000 7f516bfff640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5584b33308b0 0x5584b3332d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.477+0000 7f516bfff640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5584b33308b0 0x5584b3332d70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.477+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.477+0000 7f516bfff640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f515c05f040 0x7f515c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.477+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b3333440 con 0x7f515c05f040 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.478+0000 7f51713cf640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f515c05f040 0x7f515c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.478+0000 7f51713cf640 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f515c05f040 0x7f515c06b410 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.478+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.478+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b332bf50 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.478+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.478+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b3327560 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.479+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.479+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b3327560 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.479+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.479+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b332bf50 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.479+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.479+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b332bf50 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.479+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.479+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x7f515c05f040 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.479+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.480+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b33308b0 2024-09-10T05:11:48.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.480+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.480+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b3327560 2024-09-10T05:11:48.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.480+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.480+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b332bf50 2024-09-10T05:11:48.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.480+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.480+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b3327560 2024-09-10T05:11:48.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.480+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.480+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x7f515c05f040 2024-09-10T05:11:48.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.481+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.481+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b33308b0 2024-09-10T05:11:48.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.481+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.481+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b33308b0 2024-09-10T05:11:48.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.481+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.481+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b332bf50 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.481+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.481+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b33308b0 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.482+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.482+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b33308b0 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.482+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.482+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b3327560 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.482+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.482+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b3327560 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.482+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.482+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b332bf50 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.482+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.482+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b33308b0 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.483+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.483+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x7f515c05f040 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.483+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.483+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b3327560 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.483+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.483+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b332bf50 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.484+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.484+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b33308b0 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.484+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.484+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b332bf50 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.484+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.484+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x7f515c05f040 2024-09-10T05:11:48.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.484+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.484+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b33308b0 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.484+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.484+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b332bf50 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x5584b3327560 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584b332b1f0 con 0x7f515c05f040 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5174f39800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5174f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5174f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5174f39800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:48.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5174f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5174f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5174f39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b332f1c0 con 0x5584b3327560 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5174f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5174f39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.485+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b332f1c0 con 0x5584b3327560 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b332f1c0 con 0x7f515c05f040 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:48.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 20 zone default found 2024-09-10T05:11:48.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 4 Realm: () 2024-09-10T05:11:48.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:48.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:48.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:48.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 20 zonegroup default 2024-09-10T05:11:48.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b332f1a0 con 0x5584b332bf50 2024-09-10T05:11:48.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.486+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b33352b0 con 0x5584b33308b0 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.487+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.487+0000 7f5174f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.487+0000 7f5174f39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.487+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b3335650 con 0x5584b33308b0 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.487+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.487+0000 7f5174f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.487+0000 7f5174f39800 20 started sync module instance, tier type = 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.487+0000 7f5174f39800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.487+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3334750 con 0x7f515c05f040 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.488+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.488+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94028430527616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3334750 con 0x7f515c05f040 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.488+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3336010 con 0x5584b3327560 2024-09-10T05:11:48.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.489+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94028430527616] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.490+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.490+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94028430525568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3336010 con 0x5584b3327560 2024-09-10T05:11:48.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.490+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3336a10 con 0x5584b33308b0 2024-09-10T05:11:48.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.491+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94028430525568] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.491+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.491+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94028430531424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3335f80 con 0x5584b33308b0 2024-09-10T05:11:48.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.491+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b33378d0 con 0x7f515c05f040 2024-09-10T05:11:48.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.492+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.492+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94028430531424] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.492+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94028430537760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3337cf0 con 0x7f515c05f040 2024-09-10T05:11:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.492+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b33386b0 con 0x5584b3327560 2024-09-10T05:11:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.493+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94028430537760] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.493+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.493+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94028430539296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b33386b0 con 0x5584b3327560 2024-09-10T05:11:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.493+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3339070 con 0x5584b332bf50 2024-09-10T05:11:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.494+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.494+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94028430539296] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.494+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94028430541312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3338620 con 0x5584b332bf50 2024-09-10T05:11:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.494+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3339e00 con 0x5584b332bf50 2024-09-10T05:11:48.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.495+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94028430541312] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.495+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.495+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94028430546528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b333a6a0 con 0x5584b332bf50 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.495+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b333b060 con 0x5584b332bf50 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.496+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94028430546528] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.496+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.496+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94028430549968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b333b060 con 0x5584b332bf50 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.496+0000 7f5174f39800 20 add_watcher() i=0 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.496+0000 7f5174f39800 20 add_watcher() i=1 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.496+0000 7f5174f39800 20 add_watcher() i=2 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.496+0000 7f5174f39800 20 add_watcher() i=3 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.496+0000 7f5174f39800 20 add_watcher() i=4 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.496+0000 7f5174f39800 20 add_watcher() i=5 2024-09-10T05:11:48.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.496+0000 7f5174f39800 20 add_watcher() i=6 2024-09-10T05:11:48.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.497+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94028430549968] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.497+0000 7f5174f39800 20 add_watcher() i=7 2024-09-10T05:11:48.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.497+0000 7f5174f39800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:48.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.497+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b333e370 con 0x5584b3327560 2024-09-10T05:11:48.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.497+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.497+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94028430552352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b333b5f0 con 0x5584b3327560 2024-09-10T05:11:48.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.498+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94028430552352] v35'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.498+0000 7f5026fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.498+0000 7f5174f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:48.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.498+0000 7f5174f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:48.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.498+0000 7f5174f39800 5 note: GC not initialized 2024-09-10T05:11:48.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.498+0000 7f5025fe3640 20 reqs_thread_entry: start 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.499+0000 7f5174f39800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.499+0000 7f5174f39800 20 Filter name: none 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.499+0000 7f4f977fe640 20 reqs_thread_entry: start 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.499+0000 7f5174f39800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.499+0000 7f5174f39800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.499+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b3371470 con 0x5584b3327560 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.499+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.499+0000 7f5174f39800 20 rados_obj.operate() r=0 bl.length=673 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.499+0000 7f5174f39800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.499+0000 7f5174f39800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.499+0000 7f5174f39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.499+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3377eb0 con 0x5584b3327560 2024-09-10T05:11:48.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.500+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v35'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.500+0000 7f5174f39800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.500+0000 7f5174f39800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.500+0000 7f5174f39800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.500+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94028430801136 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b33735d0 con 0x5584b3327560 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.501+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 94028430539296 notify 150323855368 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f516c018bf0 con 0x5584b3327560 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.501+0000 7f5047fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855368 cookie 94028430539296 notifier 4413 bl.length()=758 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.501+0000 7f5047fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.501+0000 7f5047fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.501+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(64 notify.4 [notify cookie 94028430801136 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.501+0000 7f5047fff640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f5034003ea0 con 0x5584b3327560 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.501+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.501+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== watch-notify(notify_complete (2) cookie 94028430801136 notify 150323855368 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f516c018dc0 con 0x5584b3327560 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.501+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b33778f0 con 0x5584b3327560 2024-09-10T05:11:48.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.502+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(66 foo:foo1 [delete] v35'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.502+0000 7f5174f39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-10T05:11:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.502+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94028430801136 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584b3373120 con 0x7f515c05f040 2024-09-10T05:11:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.502+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== watch-notify(notify (1) cookie 94028430527616 notify 150323855364 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f516c018dc0 con 0x7f515c05f040 2024-09-10T05:11:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.502+0000 7f50477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855364 cookie 94028430527616 notifier 4413 bl.length()=159 2024-09-10T05:11:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.502+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(67 notify.0 [notify cookie 94028430801136 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.502+0000 7f50477fe640 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4fa40032c0 con 0x7f515c05f040 2024-09-10T05:11:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.502+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.503+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== watch-notify(notify_complete (2) cookie 94028430801136 notify 150323855364 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f516c0051e0 con 0x7f515c05f040 2024-09-10T05:11:48.515 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T05:11:48.248949Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:48.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.503+0000 7f5026fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.503+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94028430552352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b336f330 con 0x5584b3327560 2024-09-10T05:11:48.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.504+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94028430552352] v35'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.504+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94028430527616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3373d90 con 0x7f515c05f040 2024-09-10T05:11:48.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.505+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94028430527616] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.505+0000 7f5174f39800 20 remove_watcher() i=0 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.505+0000 7f5174f39800 2 removed watcher, disabling cache 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.505+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94028430525568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3373d90 con 0x5584b3327560 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.507+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94028430525568] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.507+0000 7f5174f39800 20 remove_watcher() i=1 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.507+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94028430531424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3373d90 con 0x5584b33308b0 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.508+0000 7f516bfff640 1 -- 172.21.15.192:0/4226556307 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94028430531424] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f515c07c040 con 0x5584b33308b0 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.508+0000 7f5174f39800 20 remove_watcher() i=2 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.508+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94028430537760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3373d90 con 0x7f515c05f040 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.509+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94028430537760] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x7f515c05f040 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.509+0000 7f5174f39800 20 remove_watcher() i=3 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.509+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94028430539296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3373d90 con 0x5584b3327560 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.510+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94028430539296] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516c00a4d0 con 0x5584b3327560 2024-09-10T05:11:48.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.510+0000 7f5174f39800 20 remove_watcher() i=4 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.510+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94028430541312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3373d90 con 0x5584b332bf50 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.511+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94028430541312] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.511+0000 7f5174f39800 20 remove_watcher() i=5 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.511+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94028430546528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3373d90 con 0x5584b332bf50 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.511+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94028430546528] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.511+0000 7f5174f39800 20 remove_watcher() i=6 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.511+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94028430549968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584b3373d90 con 0x5584b332bf50 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.512+0000 7f5170bce640 1 -- 172.21.15.192:0/4226556307 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94028430549968] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f516405c030 con 0x5584b332bf50 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.512+0000 7f5174f39800 20 remove_watcher() i=7 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5584b332bf50 msgr2=0x5584b332e340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5584b332bf50 0x5584b332e340 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5584b3327560 msgr2=0x5584b3329a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5584b3327560 0x5584b3329a20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f515c05f040 msgr2=0x7f515c06b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f515c05f040 0x7f515c06b410 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5584b33308b0 msgr2=0x5584b3332d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5584b33308b0 0x5584b3332d70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f503c03c780 msgr2=0x7f503c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f503c03c780 0x7f503c03ec40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f515c000c00 tx=0x7f515c053000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 msgr2=0x5584b331c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f51713cf640 1 -- 172.21.15.192:0/4226556307 reap_dead start 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 0x5584b331c030 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5164037e70 tx=0x7f516403ddf0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 shutdown_connections 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 --2- 172.21.15.192:0/4226556307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3314c20 0x5584b331c030 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 >> 172.21.15.192:0/4226556307 conn(0x5584b3311020 msgr2=0x5584b330f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 shutdown_connections 2024-09-10T05:11:48.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/4226556307 wait complete. 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/1634769988 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f504803c780 msgr2=0x7f504803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 --2- 172.21.15.192:0/1634769988 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f504803c780 0x7f504803ec40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5584b32f1e50 tx=0x7f515c005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/1634769988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3308340 msgr2=0x5584b3308760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 --2- 172.21.15.192:0/1634769988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3308340 0x5584b3308760 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5164001250 tx=0x7f516401ae90 comp rx=0 tx=0).stop 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/1634769988 shutdown_connections 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 --2- 172.21.15.192:0/1634769988 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f504803c780 0x7f504803ec40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 --2- 172.21.15.192:0/1634769988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b3308340 0x5584b3308760 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/1634769988 >> 172.21.15.192:0/1634769988 conn(0x5584b32fc6f0 msgr2=0x5584b32fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/1634769988 shutdown_connections 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.513+0000 7f5174f39800 1 -- 172.21.15.192:0/1634769988 wait complete. 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5584b32f3cb0 msgr2=0x5584b32f60a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5584b32f3cb0 0x5584b32f60a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5584b31f0ff0 msgr2=0x5584b32f1840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5584b31f0ff0 0x5584b32f1840 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5584b32f7bb0 msgr2=0x5584b32f9fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5584b32f7bb0 0x5584b32f9fa0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f505803c780 msgr2=0x7f505803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f505803c780 0x7f505803ec40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f515c057000 tx=0x7f515c052000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 msgr2=0x5584b32ea1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 --2- 172.21.15.192:0/2731053630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5584b31ef4d0 0x5584b32ea1f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f516400c010 tx=0x7f5164000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f51713cf640 1 -- 172.21.15.192:0/2731053630 reap_dead start 2024-09-10T05:11:48.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 shutdown_connections 2024-09-10T05:11:48.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 >> 172.21.15.192:0/2731053630 conn(0x5584b31eb200 msgr2=0x5584b32e3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 shutdown_connections 2024-09-10T05:11:48.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.514+0000 7f5174f39800 1 -- 172.21.15.192:0/2731053630 wait complete. 2024-09-10T05:11:48.526 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T05:11:48.248949Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:48.526 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-10T05:11:48.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-10T05:11:48.527 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-10T05:11:48.571 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:48.571 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:48.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.570+0000 7f28f992c800 1 Processor -- start 2024-09-10T05:11:48.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.571+0000 7f28f992c800 1 -- start start 2024-09-10T05:11:48.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.571+0000 7f28f992c800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b860503200 0x55b8605056c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.571+0000 7f28f992c800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b8603a8e40 con 0x55b8604ff600 2024-09-10T05:11:48.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.571+0000 7f28f992c800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55b860373680 con 0x55b860503200 2024-09-10T05:11:48.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.571+0000 7f28f4d60640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b860503200 0x55b8605056c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.571+0000 7f28f5561640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55b8604ff600 0x55b8605019f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36336/0 (socket says 172.21.15.192:36336) 2024-09-10T05:11:48.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.571+0000 7f28f5561640 1 -- 172.21.15.192:0/4022634055 learned_addr learned my addr 172.21.15.192:0/4022634055 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:48.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.571+0000 7f28f4d60640 1 -- 172.21.15.192:0/4022634055 >> v1:172.21.15.139:6789/0 conn(0x55b8604ff600 legacy=0x55b8605019f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.571+0000 7f28effff640 1 -- 172.21.15.192:0/4022634055 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2792973920 0 0) 0x55b8603a8e40 con 0x55b8604ff600 2024-09-10T05:11:48.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.571+0000 7f28f4d60640 1 -- 172.21.15.192:0/4022634055 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86038f6b0 con 0x55b860503200 2024-09-10T05:11:48.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.573+0000 7f28f4d60640 1 --2- 172.21.15.192:0/4022634055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860503200 0x55b8605056c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f28e000a470 tx=0x7f28e0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca600a0da50493b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.573+0000 7f28effff640 1 -- 172.21.15.192:0/4022634055 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28e0053570 con 0x55b860503200 2024-09-10T05:11:48.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.573+0000 7f28effff640 1 -- 172.21.15.192:0/4022634055 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e0058070 con 0x55b860503200 2024-09-10T05:11:48.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.573+0000 7f28effff640 1 -- 172.21.15.192:0/4022634055 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28e0053880 con 0x55b860503200 2024-09-10T05:11:48.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.574+0000 7f28f992c800 1 -- 172.21.15.192:0/4022634055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860503200 msgr2=0x55b8605056c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.574+0000 7f28f992c800 1 --2- 172.21.15.192:0/4022634055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860503200 0x55b8605056c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f28e000a470 tx=0x7f28e0045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:48.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.574+0000 7f28f992c800 1 -- 172.21.15.192:0/4022634055 shutdown_connections 2024-09-10T05:11:48.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.574+0000 7f28f992c800 1 --2- 172.21.15.192:0/4022634055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860503200 0x55b8605056c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.574+0000 7f28f992c800 1 -- 172.21.15.192:0/4022634055 >> 172.21.15.192:0/4022634055 conn(0x55b8604f91c0 msgr2=0x55b8604fb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.574+0000 7f28f992c800 1 -- 172.21.15.192:0/4022634055 shutdown_connections 2024-09-10T05:11:48.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.574+0000 7f28f992c800 1 -- 172.21.15.192:0/4022634055 wait complete. 2024-09-10T05:11:48.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.588+0000 7f28f992c800 1 Processor -- start 2024-09-10T05:11:48.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.588+0000 7f28f992c800 1 -- start start 2024-09-10T05:11:48.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.588+0000 7f28f992c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 0x55b8604fed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.588+0000 7f28f992c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b860397dd0 con 0x55b8604ff600 2024-09-10T05:11:48.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.588+0000 7f28f5561640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 0x55b8604fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.588+0000 7f28f5561640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 0x55b8604fed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:59988/0 (socket says 172.21.15.192:59988) 2024-09-10T05:11:48.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.588+0000 7f28f5561640 1 -- 172.21.15.192:0/4153602853 learned_addr learned my addr 172.21.15.192:0/4153602853 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.589+0000 7f28f5561640 1 -- 172.21.15.192:0/4153602853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8603b0e10 con 0x55b8604ff600 2024-09-10T05:11:48.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.589+0000 7f28f5561640 1 --2- 172.21.15.192:0/4153602853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 0x55b8604fed30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f28f0006fa0 tx=0x7f28f0001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99151488099befe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.589+0000 7f27e3606640 1 -- 172.21.15.192:0/4153602853 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f0003450 con 0x55b8604ff600 2024-09-10T05:11:48.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.589+0000 7f27e3606640 1 -- 172.21.15.192:0/4153602853 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f0003610 con 0x55b8604ff600 2024-09-10T05:11:48.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.589+0000 7f27e3606640 1 -- 172.21.15.192:0/4153602853 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f0003970 con 0x55b8604ff600 2024-09-10T05:11:48.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f992c800 1 -- 172.21.15.192:0/4153602853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 msgr2=0x55b8604fed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f992c800 1 --2- 172.21.15.192:0/4153602853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 0x55b8604fed30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f28f0006fa0 tx=0x7f28f0001b00 comp rx=0 tx=0).stop 2024-09-10T05:11:48.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f992c800 1 -- 172.21.15.192:0/4153602853 shutdown_connections 2024-09-10T05:11:48.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f992c800 1 --2- 172.21.15.192:0/4153602853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 0x55b8604fed30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f992c800 1 -- 172.21.15.192:0/4153602853 >> 172.21.15.192:0/4153602853 conn(0x55b8604f91c0 msgr2=0x55b8605e9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f992c800 1 -- 172.21.15.192:0/4153602853 shutdown_connections 2024-09-10T05:11:48.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f992c800 1 -- 172.21.15.192:0/4153602853 wait complete. 2024-09-10T05:11:48.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f992c800 1 Processor -- start 2024-09-10T05:11:48.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f992c800 1 -- start start 2024-09-10T05:11:48.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f992c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 0x55b8605f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f992c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b860506040 con 0x55b8604ff600 2024-09-10T05:11:48.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f5561640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 0x55b8605f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f5561640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 0x55b8605f7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60000/0 (socket says 172.21.15.192:60000) 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.590+0000 7f28f5561640 1 -- 172.21.15.192:0/4126581128 learned_addr learned my addr 172.21.15.192:0/4126581128 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.591+0000 7f28f5561640 1 -- 172.21.15.192:0/4126581128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8605f8540 con 0x55b8604ff600 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.591+0000 7f28f5561640 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 0x55b8605f7fe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f28f0001330 tx=0x7f28f0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.591+0000 7f27e1e03640 1 -- 172.21.15.192:0/4126581128 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f0014a10 con 0x55b8604ff600 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.591+0000 7f27e1e03640 1 -- 172.21.15.192:0/4126581128 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f0014bb0 con 0x55b8604ff600 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.591+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8605f87d0 con 0x55b8604ff600 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.591+0000 7f27e1e03640 1 -- 172.21.15.192:0/4126581128 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f001e3f0 con 0x55b8604ff600 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.591+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8605f91d0 con 0x55b8604ff600 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.592+0000 7f27e1e03640 1 -- 172.21.15.192:0/4126581128 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f28f0010070 con 0x55b8604ff600 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.592+0000 7f27e1e03640 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27dc03c780 0x7f27dc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.592+0000 7f27e1e03640 1 -- 172.21.15.192:0/4126581128 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f28f0018070 con 0x55b8604ff600 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.592+0000 7f28f4d60640 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27dc03c780 0x7f27dc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.592+0000 7f28f992c800 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b860503200 0x55b8605ff630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.592+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b8605ffb70 con 0x55b860503200 2024-09-10T05:11:48.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.592+0000 7f28f5d62640 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b860503200 0x55b8605ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.593+0000 7f28f4d60640 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27dc03c780 0x7f27dc03ec40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f28e0057000 tx=0x7f28e0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.593+0000 7f28f5d62640 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b860503200 0x55b8605ff630 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.593+0000 7f28f5d62640 1 -- 172.21.15.192:0/4126581128 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28e80083e0 con 0x55b860503200 2024-09-10T05:11:48.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.593+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b8605fff10 con 0x55b860503200 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.593+0000 7f28f5d62640 1 -- 172.21.15.192:0/4126581128 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28e80083e0 con 0x55b860503200 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.593+0000 7f28f992c800 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b8606019d0 0x55b860603e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.593+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b8606045e0 con 0x55b8606019d0 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.593+0000 7f28f5561640 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b8606019d0 0x55b860603e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.594+0000 7f28f5561640 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b8606019d0 0x55b860603e50 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.594+0000 7f28f5561640 1 -- 172.21.15.192:0/4126581128 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f28f001b070 con 0x55b8606019d0 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.594+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b860600760 con 0x55b860503200 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.594+0000 7f28f5d62640 1 -- 172.21.15.192:0/4126581128 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28e80083e0 con 0x55b860503200 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.594+0000 7f28f992c800 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b860605a40 0x55b860607e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.594+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b8606085a0 con 0x55b860605a40 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.595+0000 7f28f4d60640 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b860605a40 0x55b860607e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.595+0000 7f28f4d60640 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b860605a40 0x55b860607e30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.595+0000 7f28f4d60640 1 -- 172.21.15.192:0/4126581128 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f28e0051070 con 0x55b860605a40 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.595+0000 7f28f992c800 1 Processor -- start 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.595+0000 7f28f992c800 1 -- start start 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.596+0000 7f28f992c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8606161e0 0x55b860616600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.596+0000 7f28f992c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b8603f5a00 con 0x55b8606161e0 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.596+0000 7f28f5561640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8606161e0 0x55b860616600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.596+0000 7f28f5561640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8606161e0 0x55b860616600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60012/0 (socket says 172.21.15.192:60012) 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.596+0000 7f28f5561640 1 -- 172.21.15.192:0/1115763106 learned_addr learned my addr 172.21.15.192:0/1115763106 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.596+0000 7f28f5561640 1 -- 172.21.15.192:0/1115763106 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b860616c40 con 0x55b8606161e0 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.596+0000 7f28f5561640 1 --2- 172.21.15.192:0/1115763106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8606161e0 0x55b860616600 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f28f0014ff0 tx=0x7f28f0028ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.596+0000 7f27daffd640 1 -- 172.21.15.192:0/1115763106 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f0038070 con 0x55b8606161e0 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.596+0000 7f27daffd640 1 -- 172.21.15.192:0/1115763106 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f004af00 con 0x55b8606161e0 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.596+0000 7f27daffd640 1 -- 172.21.15.192:0/1115763106 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f004b0b0 con 0x55b8606161e0 2024-09-10T05:11:48.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.596+0000 7f28f992c800 1 -- 172.21.15.192:0/1115763106 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b860617470 con 0x55b8606161e0 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.596+0000 7f28f992c800 1 -- 172.21.15.192:0/1115763106 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b860617a10 con 0x55b8606161e0 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.597+0000 7f27daffd640 1 -- 172.21.15.192:0/1115763106 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f28f003b070 con 0x55b8606161e0 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.597+0000 7f27daffd640 1 --2- 172.21.15.192:0/1115763106 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27cc03c780 0x7f27cc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.597+0000 7f27daffd640 1 -- 172.21.15.192:0/1115763106 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f28f003ec80 con 0x55b8606161e0 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.597+0000 7f28f4d60640 1 --2- 172.21.15.192:0/1115763106 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27cc03c780 0x7f27cc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f28f992c800 1 Processor -- start 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f28f992c800 1 -- start start 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f28f4d60640 1 --2- 172.21.15.192:0/1115763106 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27cc03c780 0x7f27cc03ec40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55b860604980 tx=0x7f28e0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f28f992c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 0x55b860623000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f28f992c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b8604fd5d0 con 0x55b860622c20 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f28f5561640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 0x55b860623000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f28f5561640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 0x55b860623000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60028/0 (socket says 172.21.15.192:60028) 2024-09-10T05:11:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f28f5561640 1 -- 172.21.15.192:0/122995195 learned_addr learned my addr 172.21.15.192:0/122995195 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f28f5561640 1 -- 172.21.15.192:0/122995195 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8606235f0 con 0x55b860622c20 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f28f5561640 1 --2- 172.21.15.192:0/122995195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 0x55b860623000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28f00527f0 tx=0x7f28f0012480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee5f777dc1ec1b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f27d8ff9640 1 -- 172.21.15.192:0/122995195 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f0052440 con 0x55b860622c20 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f27d8ff9640 1 -- 172.21.15.192:0/122995195 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f0052600 con 0x55b860622c20 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.598+0000 7f27d8ff9640 1 -- 172.21.15.192:0/122995195 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f0026bb0 con 0x55b860622c20 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.599+0000 7f28f992c800 1 -- 172.21.15.192:0/122995195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 msgr2=0x55b860623000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.599+0000 7f28f992c800 1 --2- 172.21.15.192:0/122995195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 0x55b860623000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28f00527f0 tx=0x7f28f0012480 comp rx=0 tx=0).stop 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.599+0000 7f28f992c800 1 -- 172.21.15.192:0/122995195 shutdown_connections 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.599+0000 7f28f992c800 1 --2- 172.21.15.192:0/122995195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 0x55b860623000 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.599+0000 7f28f992c800 1 -- 172.21.15.192:0/122995195 >> 172.21.15.192:0/122995195 conn(0x55b86061f020 msgr2=0x55b86061d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.599+0000 7f28f992c800 1 -- 172.21.15.192:0/122995195 shutdown_connections 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.599+0000 7f28f992c800 1 -- 172.21.15.192:0/122995195 wait complete. 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.599+0000 7f28f992c800 1 Processor -- start 2024-09-10T05:11:48.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.599+0000 7f28f992c800 1 -- start start 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.599+0000 7f28f992c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 0x55b86062a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.599+0000 7f28f992c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b860623a80 con 0x55b860622c20 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.600+0000 7f28f5561640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 0x55b86062a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.600+0000 7f28f5561640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 0x55b86062a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60032/0 (socket says 172.21.15.192:60032) 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.600+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 learned_addr learned my addr 172.21.15.192:0/3857696095 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.600+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86062a580 con 0x55b860622c20 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.600+0000 7f28f5561640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 0x55b86062a020 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f28f0002020 tx=0x7f28f0045ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.600+0000 7f27caffd640 1 -- 172.21.15.192:0/3857696095 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f006c020 con 0x55b860622c20 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.600+0000 7f27caffd640 1 -- 172.21.15.192:0/3857696095 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f0038210 con 0x55b860622c20 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.600+0000 7f27caffd640 1 -- 172.21.15.192:0/3857696095 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28f0063040 con 0x55b860622c20 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.600+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b86062a580 con 0x55b860622c20 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.600+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b86062a580 con 0x55b860622c20 2024-09-10T05:11:48.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.601+0000 7f27caffd640 1 -- 172.21.15.192:0/3857696095 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f28f006f020 con 0x55b860622c20 2024-09-10T05:11:48.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.601+0000 7f27caffd640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27c003c730 0x7f27c003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.601+0000 7f27caffd640 1 -- 172.21.15.192:0/3857696095 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f28f005a070 con 0x55b860622c20 2024-09-10T05:11:48.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.601+0000 7f28f4d60640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27c003c730 0x7f27c003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.602+0000 7f28f4d60640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27c003c730 0x7f27c003ebf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f28e0000c00 tx=0x7f28e0053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.602+0000 7f28f992c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.602+0000 7f28f992c800 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b860635620 0x55b860637ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.602+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b860638230 con 0x55b860635620 2024-09-10T05:11:48.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.602+0000 7f28f5d62640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b860635620 0x55b860637ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.602+0000 7f28f5d62640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b860635620 0x55b860637ae0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28e80083e0 con 0x55b860635620 2024-09-10T05:11:48.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 20 realm 2024-09-10T05:11:48.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b860638640 con 0x55b860635620 2024-09-10T05:11:48.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28e80083e0 con 0x55b860635620 2024-09-10T05:11:48.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:48.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860635620 2024-09-10T05:11:48.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28e80083e0 con 0x55b860635620 2024-09-10T05:11:48.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b8606392b0 con 0x55b860635620 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28e80083e0 con 0x55b860635620 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b860639c70 0x55b86063c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.603+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b86063c670 con 0x55b860639c70 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.604+0000 7f28f5561640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b860639c70 0x55b86063c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.604+0000 7f28f5561640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b860639c70 0x55b86063c060 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.604+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.604+0000 7f28f992c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.604+0000 7f28f992c800 20 searching for the correct realm 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.604+0000 7f28f992c800 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b86063e620 0x55b860640ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.604+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860641160 con 0x55b86063e620 2024-09-10T05:11:48.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.604+0000 7f28f4d60640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b86063e620 0x55b860640ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.605+0000 7f28f4d60640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b86063e620 0x55b860640ae0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.605+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.605+0000 7f28f4d60640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f28e005f040 0x7f28e006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.605+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860641160 con 0x7f28e005f040 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.605+0000 7f28f5d62640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f28e005f040 0x7f28e006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.605+0000 7f28f5d62640 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f28e005f040 0x7f28e006b410 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.605+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f28e80083e0 con 0x7f28e005f040 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.605+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860639c70 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.606+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.606+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860635620 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.606+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e80083e0 con 0x55b860635620 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.606+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860635620 2024-09-10T05:11:48.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.606+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.606+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860639c70 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.606+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.606+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860639c70 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.607+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.607+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x7f28e005f040 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.607+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e8026040 con 0x7f28e005f040 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.607+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b86063e620 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.607+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.607+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860635620 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.607+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.607+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860639c70 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.608+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.608+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860635620 2024-09-10T05:11:48.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.608+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.608+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x7f28e005f040 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.608+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f28e8026040 con 0x7f28e005f040 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.608+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b86063e620 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.608+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.608+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b86063e620 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.608+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.608+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860639c70 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.609+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.609+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b86063e620 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.609+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.609+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b86063e620 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.609+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.609+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860635620 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.609+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.609+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860635620 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.610+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.610+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860639c70 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.610+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.610+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b86063e620 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.610+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.610+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x7f28e005f040 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.610+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e8026040 con 0x7f28e005f040 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.610+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860635620 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.611+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.611+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860639c70 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.611+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.611+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b86063e620 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.611+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.611+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860639c70 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.611+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.611+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x7f28e005f040 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.612+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e8026040 con 0x7f28e005f040 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.612+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b86063e620 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.612+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.612+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860639c70 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.612+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.612+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x55b860635620 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.612+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b860638f10 con 0x7f28e005f040 2024-09-10T05:11:48.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28e8026040 con 0x7f28e005f040 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b86063cf30 con 0x55b860635620 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b86063cf30 con 0x55b860635620 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b86063cf30 con 0x7f28e005f040 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.613+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f28e8026040 con 0x7f28e005f040 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 20 zone default found 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 4 Realm: () 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 20 zonegroup default 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b86063cf30 con 0x55b860639c70 2024-09-10T05:11:48.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b860642fd0 con 0x55b86063e620 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b860643370 con 0x55b86063e620 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 20 started sync module instance, tier type = 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.614+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860642470 con 0x7f28e005f040 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.615+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x7f28e005f040 2024-09-10T05:11:48.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.615+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94250379520448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860642470 con 0x7f28e005f040 2024-09-10T05:11:48.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.615+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860643d30 con 0x55b860635620 2024-09-10T05:11:48.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.616+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94250379520448] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x7f28e005f040 2024-09-10T05:11:48.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.617+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.617+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94250379518368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860643d30 con 0x55b860635620 2024-09-10T05:11:48.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.617+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860644730 con 0x55b86063e620 2024-09-10T05:11:48.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.618+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94250379518368] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.618+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.618+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94250379524224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860643ca0 con 0x55b86063e620 2024-09-10T05:11:48.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.618+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b8606455f0 con 0x7f28e005f040 2024-09-10T05:11:48.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.619+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94250379524224] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.619+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x7f28e005f040 2024-09-10T05:11:48.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.619+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94250379530560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860645a10 con 0x7f28e005f040 2024-09-10T05:11:48.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.619+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b8606463d0 con 0x55b860635620 2024-09-10T05:11:48.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.620+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94250379530560] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x7f28e005f040 2024-09-10T05:11:48.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.620+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.620+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94250379532096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b8606463d0 con 0x55b860635620 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.620+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860646d90 con 0x55b860639c70 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.621+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.621+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94250379536608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860646d00 con 0x55b860639c70 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.621+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860647d00 con 0x55b860639c70 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.621+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94250379532096] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.622+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94250379536608] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.622+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.622+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94250379534112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860647850 con 0x55b860639c70 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.622+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860648210 con 0x55b860639c70 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.623+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94250379534112] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.623+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.623+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94250379538672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860648210 con 0x55b860639c70 2024-09-10T05:11:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.623+0000 7f28f992c800 20 add_watcher() i=0 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.623+0000 7f28f992c800 20 add_watcher() i=1 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.623+0000 7f28f992c800 20 add_watcher() i=2 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.623+0000 7f28f992c800 20 add_watcher() i=3 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.623+0000 7f28f992c800 20 add_watcher() i=4 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.623+0000 7f28f992c800 20 add_watcher() i=5 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.623+0000 7f28f992c800 20 add_watcher() i=6 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.624+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94250379538672] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.624+0000 7f28f992c800 20 add_watcher() i=7 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.624+0000 7f28f992c800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.624+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b86064b610 con 0x55b860635620 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.625+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.625+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94250379542320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860648b30 con 0x55b860635620 2024-09-10T05:11:48.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.626+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94250379542320] v35'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.626+0000 7f27ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.626+0000 7f28f992c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.626+0000 7f28f992c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.626+0000 7f28f992c800 5 note: GC not initialized 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.626+0000 7f27aa7e4640 20 reqs_thread_entry: start 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.626+0000 7f28f992c800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.626+0000 7f28f992c800 20 Filter name: none 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.626+0000 7f271bfff640 20 reqs_thread_entry: start 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.626+0000 7f28f992c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.626+0000 7f28f992c800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.626+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b86067e5c0 con 0x55b860635620 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.627+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.627+0000 7f28f992c800 20 rados_obj.operate() r=0 bl.length=582 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.627+0000 7f28f992c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.627+0000 7f28f992c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.627+0000 7f28f992c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.627+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b860684a80 con 0x55b860635620 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.628+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v35'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.628+0000 7f28f992c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.628+0000 7f28f992c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.628+0000 7f28f992c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.628+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94250379789440 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b8606803f0 con 0x55b860635620 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.628+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 94250379532096 notify 150323855369 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f28e8010040 con 0x55b860635620 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.628+0000 7f27d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855369 cookie 94250379532096 notifier 4420 bl.length()=732 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.628+0000 7f27d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.628+0000 7f27d8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:48.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.628+0000 7f27d8ff9640 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f27b8003ea0 con 0x55b860635620 2024-09-10T05:11:48.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.628+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(64 notify.4 [notify cookie 94250379789440 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.629+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.629+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== watch-notify(notify_complete (2) cookie 94250379789440 notify 150323855369 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f28e800a9a0 con 0x55b860635620 2024-09-10T05:11:48.640 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-10T05:11:48.248949Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.629+0000 7f27ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.629+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94250379542320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b86067c480 con 0x55b860635620 2024-09-10T05:11:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.630+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94250379542320] v35'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.630+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94250379520448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b86067c480 con 0x7f28e005f040 2024-09-10T05:11:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.631+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94250379520448] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x7f28e005f040 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.631+0000 7f28f992c800 20 remove_watcher() i=0 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.631+0000 7f28f992c800 2 removed watcher, disabling cache 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.631+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94250379518368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b86067c480 con 0x55b860635620 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.632+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94250379518368] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.632+0000 7f28f992c800 20 remove_watcher() i=1 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.632+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94250379524224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b86067c480 con 0x55b86063e620 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.633+0000 7f28f4d60640 1 -- 172.21.15.192:0/3857696095 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94250379524224] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e007c040 con 0x55b86063e620 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.633+0000 7f28f992c800 20 remove_watcher() i=2 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.633+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94250379530560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b86067c480 con 0x7f28e005f040 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.634+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94250379530560] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x7f28e005f040 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.634+0000 7f28f992c800 20 remove_watcher() i=3 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.634+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94250379532096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b86067c480 con 0x55b860635620 2024-09-10T05:11:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.636+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94250379532096] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28e8026040 con 0x55b860635620 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.636+0000 7f28f992c800 20 remove_watcher() i=4 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.636+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94250379536608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b86067c480 con 0x55b860639c70 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.637+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94250379536608] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.637+0000 7f28f992c800 20 remove_watcher() i=5 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.637+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94250379534112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b86067c480 con 0x55b860639c70 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.637+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94250379534112] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.637+0000 7f28f992c800 20 remove_watcher() i=6 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.638+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94250379538672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b86067c480 con 0x55b860639c70 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.638+0000 7f28f5561640 1 -- 172.21.15.192:0/3857696095 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94250379538672] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28f0066040 con 0x55b860639c70 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.638+0000 7f28f992c800 20 remove_watcher() i=7 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b860639c70 msgr2=0x55b86063c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b860639c70 0x55b86063c060 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b860635620 msgr2=0x55b860637ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b860635620 0x55b860637ae0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f28e005f040 msgr2=0x7f28e006b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f28e005f040 0x7f28e006b410 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b86063e620 msgr2=0x55b860640ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b86063e620 0x55b860640ae0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27c003c730 msgr2=0x7f27c003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27c003c730 0x7f27c003ebf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f28e0000c00 tx=0x7f28e0053000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 msgr2=0x55b86062a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f5d62640 1 -- 172.21.15.192:0/3857696095 reap_dead start 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 0x55b86062a020 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f28f0002020 tx=0x7f28f0045ee0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 shutdown_connections 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 --2- 172.21.15.192:0/3857696095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b860622c20 0x55b86062a020 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 >> 172.21.15.192:0/3857696095 conn(0x55b86061f020 msgr2=0x55b86061d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 shutdown_connections 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/3857696095 wait complete. 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/1115763106 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27cc03c780 msgr2=0x7f27cc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 --2- 172.21.15.192:0/1115763106 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27cc03c780 0x7f27cc03ec40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55b860604980 tx=0x7f28e0005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/1115763106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8606161e0 msgr2=0x55b860616600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 --2- 172.21.15.192:0/1115763106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8606161e0 0x55b860616600 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f28f0014ff0 tx=0x7f28f0028ea0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/1115763106 shutdown_connections 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 --2- 172.21.15.192:0/1115763106 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27cc03c780 0x7f27cc03ec40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 --2- 172.21.15.192:0/1115763106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8606161e0 0x55b860616600 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/1115763106 >> 172.21.15.192:0/1115763106 conn(0x55b86060a590 msgr2=0x55b86060a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/1115763106 shutdown_connections 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.639+0000 7f28f992c800 1 -- 172.21.15.192:0/1115763106 wait complete. 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b8606019d0 msgr2=0x55b860603e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b8606019d0 0x55b860603e50 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b860503200 msgr2=0x55b8605ff630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b860503200 0x55b8605ff630 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b860605a40 msgr2=0x55b860607e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b860605a40 0x55b860607e30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27dc03c780 msgr2=0x7f27dc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f27dc03c780 0x7f27dc03ec40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f28e0057000 tx=0x7f28e0052000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 msgr2=0x55b8605f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 --2- 172.21.15.192:0/4126581128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8604ff600 0x55b8605f7fe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f28f0001330 tx=0x7f28f0001250 comp rx=0 tx=0).stop 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f5d62640 1 -- 172.21.15.192:0/4126581128 reap_dead start 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 shutdown_connections 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 >> 172.21.15.192:0/4126581128 conn(0x55b8604f91c0 msgr2=0x55b8605e99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 shutdown_connections 2024-09-10T05:11:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.640+0000 7f28f992c800 1 -- 172.21.15.192:0/4126581128 wait complete. 2024-09-10T05:11:48.651 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-10T05:11:48.248949Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:48.652 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-10T05:11:48.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-10T05:11:48.652 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-10T05:11:48.699 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:48.700 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:48.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.699+0000 7fa806212800 1 Processor -- start 2024-09-10T05:11:48.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.699+0000 7fa806212800 1 -- start start 2024-09-10T05:11:48.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.699+0000 7fa806212800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x557b30f16000 0x557b30f1eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.699+0000 7fa806212800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b30dbfe40 con 0x557b30f144e0 2024-09-10T05:11:48.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.699+0000 7fa806212800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x557b30d8a680 con 0x557b30f16000 2024-09-10T05:11:48.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.700+0000 7fa8010ca640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x557b30f16000 0x557b30f1eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.700+0000 7fa8018cb640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x557b30f144e0 0x557b30f148e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36352/0 (socket says 172.21.15.192:36352) 2024-09-10T05:11:48.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.700+0000 7fa8018cb640 1 -- 172.21.15.192:0/3998714556 learned_addr learned my addr 172.21.15.192:0/3998714556 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:48.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.700+0000 7fa8010ca640 1 -- 172.21.15.192:0/3998714556 >> v1:172.21.15.139:6789/0 conn(0x557b30f144e0 legacy=0x557b30f148e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.700+0000 7fa8010ca640 1 -- 172.21.15.192:0/3998714556 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b30da66b0 con 0x557b30f16000 2024-09-10T05:11:48.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.700+0000 7fa8008c9640 1 -- 172.21.15.192:0/3998714556 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703423417 0 0) 0x557b30dbfe40 con 0x557b30f144e0 2024-09-10T05:11:48.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.702+0000 7fa8010ca640 1 --2- 172.21.15.192:0/3998714556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f16000 0x557b30f1eb20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800a470 tx=0x7fa7f8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cec2a81f605915e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.702+0000 7fa8008c9640 1 -- 172.21.15.192:0/3998714556 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f8053570 con 0x557b30f16000 2024-09-10T05:11:48.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.702+0000 7fa8008c9640 1 -- 172.21.15.192:0/3998714556 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f8058070 con 0x557b30f16000 2024-09-10T05:11:48.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.702+0000 7fa8008c9640 1 -- 172.21.15.192:0/3998714556 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f8053880 con 0x557b30f16000 2024-09-10T05:11:48.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.702+0000 7fa806212800 1 -- 172.21.15.192:0/3998714556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f16000 msgr2=0x557b30f1eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.702+0000 7fa806212800 1 --2- 172.21.15.192:0/3998714556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f16000 0x557b30f1eb20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800a470 tx=0x7fa7f8045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:48.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.702+0000 7fa806212800 1 -- 172.21.15.192:0/3998714556 shutdown_connections 2024-09-10T05:11:48.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.702+0000 7fa806212800 1 --2- 172.21.15.192:0/3998714556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f16000 0x557b30f1eb20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.702+0000 7fa806212800 1 -- 172.21.15.192:0/3998714556 >> 172.21.15.192:0/3998714556 conn(0x557b30f10210 msgr2=0x557b30f12650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.702+0000 7fa806212800 1 -- 172.21.15.192:0/3998714556 shutdown_connections 2024-09-10T05:11:48.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.702+0000 7fa806212800 1 -- 172.21.15.192:0/3998714556 wait complete. 2024-09-10T05:11:48.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.716+0000 7fa806212800 1 Processor -- start 2024-09-10T05:11:48.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.716+0000 7fa806212800 1 -- start start 2024-09-10T05:11:48.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.716+0000 7fa806212800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 0x557b310076b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.716+0000 7fa806212800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b30daedd0 con 0x557b30f144e0 2024-09-10T05:11:48.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.716+0000 7fa8018cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 0x557b310076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.716+0000 7fa8018cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 0x557b310076b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60058/0 (socket says 172.21.15.192:60058) 2024-09-10T05:11:48.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.717+0000 7fa8018cb640 1 -- 172.21.15.192:0/4161417300 learned_addr learned my addr 172.21.15.192:0/4161417300 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.717+0000 7fa8018cb640 1 -- 172.21.15.192:0/4161417300 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b30dc7e10 con 0x557b30f144e0 2024-09-10T05:11:48.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.717+0000 7fa8018cb640 1 --2- 172.21.15.192:0/4161417300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 0x557b310076b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4001ea0 tx=0x7fa7f400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49798d14708277e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.717+0000 7fa6efe07640 1 -- 172.21.15.192:0/4161417300 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f4008070 con 0x557b30f144e0 2024-09-10T05:11:48.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.717+0000 7fa6efe07640 1 -- 172.21.15.192:0/4161417300 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f400d500 con 0x557b30f144e0 2024-09-10T05:11:48.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.717+0000 7fa6efe07640 1 -- 172.21.15.192:0/4161417300 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f400d880 con 0x557b30f144e0 2024-09-10T05:11:48.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.718+0000 7fa806212800 1 -- 172.21.15.192:0/4161417300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 msgr2=0x557b310076b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.718+0000 7fa806212800 1 --2- 172.21.15.192:0/4161417300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 0x557b310076b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4001ea0 tx=0x7fa7f400b6a0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.718+0000 7fa806212800 1 -- 172.21.15.192:0/4161417300 shutdown_connections 2024-09-10T05:11:48.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.718+0000 7fa806212800 1 --2- 172.21.15.192:0/4161417300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 0x557b310076b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.718+0000 7fa806212800 1 -- 172.21.15.192:0/4161417300 >> 172.21.15.192:0/4161417300 conn(0x557b30f10210 msgr2=0x557b31003030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.718+0000 7fa806212800 1 -- 172.21.15.192:0/4161417300 shutdown_connections 2024-09-10T05:11:48.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.718+0000 7fa806212800 1 -- 172.21.15.192:0/4161417300 wait complete. 2024-09-10T05:11:48.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.718+0000 7fa806212800 1 Processor -- start 2024-09-10T05:11:48.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.718+0000 7fa806212800 1 -- start start 2024-09-10T05:11:48.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.718+0000 7fa806212800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 0x557b3100efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.718+0000 7fa806212800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b30f1f360 con 0x557b30f144e0 2024-09-10T05:11:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.719+0000 7fa8018cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 0x557b3100efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.719+0000 7fa8018cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 0x557b3100efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60062/0 (socket says 172.21.15.192:60062) 2024-09-10T05:11:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.719+0000 7fa8018cb640 1 -- 172.21.15.192:0/999112458 learned_addr learned my addr 172.21.15.192:0/999112458 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.719+0000 7fa8018cb640 1 -- 172.21.15.192:0/999112458 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3100f530 con 0x557b30f144e0 2024-09-10T05:11:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.719+0000 7fa8018cb640 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 0x557b3100efd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40012f0 tx=0x7fa7f4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.719+0000 7fa6ee604640 1 -- 172.21.15.192:0/999112458 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f400f9d0 con 0x557b30f144e0 2024-09-10T05:11:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.719+0000 7fa6ee604640 1 -- 172.21.15.192:0/999112458 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f400fb70 con 0x557b30f144e0 2024-09-10T05:11:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.719+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b3100f7c0 con 0x557b30f144e0 2024-09-10T05:11:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.719+0000 7fa6ee604640 1 -- 172.21.15.192:0/999112458 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f400fe50 con 0x557b30f144e0 2024-09-10T05:11:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.720+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b310101c0 con 0x557b30f144e0 2024-09-10T05:11:48.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.720+0000 7fa6ee604640 1 -- 172.21.15.192:0/999112458 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa7f4017040 con 0x557b30f144e0 2024-09-10T05:11:48.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.721+0000 7fa6ee604640 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6e803c920 0x7fa6e803ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.721+0000 7fa6ee604640 1 -- 172.21.15.192:0/999112458 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa7f4015020 con 0x557b30f144e0 2024-09-10T05:11:48.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.721+0000 7fa8010ca640 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6e803c920 0x7fa6e803ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.721+0000 7fa806212800 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557b30f16000 0x557b31016620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.721+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b31016b60 con 0x557b30f16000 2024-09-10T05:11:48.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.721+0000 7fa8020cc640 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557b30f16000 0x557b31016620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.721+0000 7fa8010ca640 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6e803c920 0x7fa6e803ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8057000 tx=0x7fa7f8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.721+0000 7fa8020cc640 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557b30f16000 0x557b31016620 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.721+0000 7fa8020cc640 1 -- 172.21.15.192:0/999112458 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b30f16000 2024-09-10T05:11:48.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.721+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b31016f00 con 0x557b30f16000 2024-09-10T05:11:48.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.722+0000 7fa8020cc640 1 -- 172.21.15.192:0/999112458 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b30f16000 2024-09-10T05:11:48.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.722+0000 7fa806212800 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557b31018a00 0x557b3101ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.722+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b3101b610 con 0x557b31018a00 2024-09-10T05:11:48.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.722+0000 7fa8018cb640 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557b31018a00 0x557b3101ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.722+0000 7fa8018cb640 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557b31018a00 0x557b3101ae80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.723+0000 7fa8018cb640 1 -- 172.21.15.192:0/999112458 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa7f402d070 con 0x557b31018a00 2024-09-10T05:11:48.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.723+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b31017750 con 0x557b30f16000 2024-09-10T05:11:48.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.723+0000 7fa8020cc640 1 -- 172.21.15.192:0/999112458 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b30f16000 2024-09-10T05:11:48.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.723+0000 7fa806212800 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x557b3101ca70 0x557b3101ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.723+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b3101f5d0 con 0x557b3101ca70 2024-09-10T05:11:48.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.723+0000 7fa8010ca640 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x557b3101ca70 0x557b3101ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.723+0000 7fa8010ca640 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x557b3101ca70 0x557b3101ee60 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.723+0000 7fa8010ca640 1 -- 172.21.15.192:0/999112458 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa7f8051070 con 0x557b3101ca70 2024-09-10T05:11:48.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.724+0000 7fa806212800 1 Processor -- start 2024-09-10T05:11:48.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.724+0000 7fa806212800 1 -- start start 2024-09-10T05:11:48.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.724+0000 7fa806212800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b3102d200 0x557b3102d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.724+0000 7fa806212800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b30e0ca00 con 0x557b3102d200 2024-09-10T05:11:48.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.724+0000 7fa8018cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b3102d200 0x557b3102d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.724+0000 7fa8018cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b3102d200 0x557b3102d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60074/0 (socket says 172.21.15.192:60074) 2024-09-10T05:11:48.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.724+0000 7fa8018cb640 1 -- 172.21.15.192:0/959762739 learned_addr learned my addr 172.21.15.192:0/959762739 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.724+0000 7fa8018cb640 1 -- 172.21.15.192:0/959762739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3102dc60 con 0x557b3102d200 2024-09-10T05:11:48.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.725+0000 7fa8018cb640 1 --2- 172.21.15.192:0/959762739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b3102d200 0x557b3102d620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400e660 tx=0x7fa7f4018860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.725+0000 7fa6e77fe640 1 -- 172.21.15.192:0/959762739 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f40511b0 con 0x557b3102d200 2024-09-10T05:11:48.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.725+0000 7fa6e77fe640 1 -- 172.21.15.192:0/959762739 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f4044910 con 0x557b3102d200 2024-09-10T05:11:48.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.725+0000 7fa806212800 1 -- 172.21.15.192:0/959762739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b3102e490 con 0x557b3102d200 2024-09-10T05:11:48.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.725+0000 7fa6e77fe640 1 -- 172.21.15.192:0/959762739 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f4044bf0 con 0x557b3102d200 2024-09-10T05:11:48.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.725+0000 7fa806212800 1 -- 172.21.15.192:0/959762739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b3102ea30 con 0x557b3102d200 2024-09-10T05:11:48.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.726+0000 7fa6e77fe640 1 -- 172.21.15.192:0/959762739 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa7f403f8e0 con 0x557b3102d200 2024-09-10T05:11:48.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.726+0000 7fa6e77fe640 1 --2- 172.21.15.192:0/959762739 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6dc03c780 0x7fa6dc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.726+0000 7fa6e77fe640 1 -- 172.21.15.192:0/959762739 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa7f403d020 con 0x557b3102d200 2024-09-10T05:11:48.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.726+0000 7fa8010ca640 1 --2- 172.21.15.192:0/959762739 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6dc03c780 0x7fa6dc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.726+0000 7fa806212800 1 Processor -- start 2024-09-10T05:11:48.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.726+0000 7fa806212800 1 -- start start 2024-09-10T05:11:48.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.726+0000 7fa8010ca640 1 --2- 172.21.15.192:0/959762739 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6dc03c780 0x7fa6dc03ec40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8000c00 tx=0x7fa7f8005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.726+0000 7fa806212800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 0x557b31039e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.726+0000 7fa806212800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b31007f00 con 0x557b31039a80 2024-09-10T05:11:48.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.727+0000 7fa8018cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 0x557b31039e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.727+0000 7fa8018cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 0x557b31039e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60082/0 (socket says 172.21.15.192:60082) 2024-09-10T05:11:48.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.727+0000 7fa8018cb640 1 -- 172.21.15.192:0/2837307027 learned_addr learned my addr 172.21.15.192:0/2837307027 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.727+0000 7fa8018cb640 1 -- 172.21.15.192:0/2837307027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3103a470 con 0x557b31039a80 2024-09-10T05:11:48.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.727+0000 7fa8018cb640 1 --2- 172.21.15.192:0/2837307027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 0x557b31039e80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa7f403b490 tx=0x7fa7f404ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5f3bac2310f695 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.727+0000 7fa6e57fa640 1 -- 172.21.15.192:0/2837307027 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f4026430 con 0x557b31039a80 2024-09-10T05:11:48.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.727+0000 7fa6e57fa640 1 -- 172.21.15.192:0/2837307027 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f402f3e0 con 0x557b31039a80 2024-09-10T05:11:48.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.727+0000 7fa6e57fa640 1 -- 172.21.15.192:0/2837307027 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f40265d0 con 0x557b31039a80 2024-09-10T05:11:48.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.727+0000 7fa806212800 1 -- 172.21.15.192:0/2837307027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 msgr2=0x557b31039e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.727+0000 7fa806212800 1 --2- 172.21.15.192:0/2837307027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 0x557b31039e80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa7f403b490 tx=0x7fa7f404ba70 comp rx=0 tx=0).stop 2024-09-10T05:11:48.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa806212800 1 -- 172.21.15.192:0/2837307027 shutdown_connections 2024-09-10T05:11:48.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa806212800 1 --2- 172.21.15.192:0/2837307027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 0x557b31039e80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa806212800 1 -- 172.21.15.192:0/2837307027 >> 172.21.15.192:0/2837307027 conn(0x557b31035e80 msgr2=0x557b310340c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa806212800 1 -- 172.21.15.192:0/2837307027 shutdown_connections 2024-09-10T05:11:48.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa806212800 1 -- 172.21.15.192:0/2837307027 wait complete. 2024-09-10T05:11:48.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa806212800 1 Processor -- start 2024-09-10T05:11:48.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa806212800 1 -- start start 2024-09-10T05:11:48.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa806212800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 0x557b31040f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa806212800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b3103a8e0 con 0x557b31039a80 2024-09-10T05:11:48.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa8018cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 0x557b31040f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa8018cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 0x557b31040f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60088/0 (socket says 172.21.15.192:60088) 2024-09-10T05:11:48.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 learned_addr learned my addr 172.21.15.192:0/2127959375 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.728+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b31041480 con 0x557b31039a80 2024-09-10T05:11:48.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.729+0000 7fa8018cb640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 0x557b31040f20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa7f403e780 tx=0x7fa7f4044830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.729+0000 7fa6d37fe640 1 -- 172.21.15.192:0/2127959375 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f406b070 con 0x557b31039a80 2024-09-10T05:11:48.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.729+0000 7fa6d37fe640 1 -- 172.21.15.192:0/2127959375 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f404daa0 con 0x557b31039a80 2024-09-10T05:11:48.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.729+0000 7fa6d37fe640 1 -- 172.21.15.192:0/2127959375 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f404ddc0 con 0x557b31039a80 2024-09-10T05:11:48.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.729+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b31041480 con 0x557b31039a80 2024-09-10T05:11:48.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.729+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b31041480 con 0x557b31039a80 2024-09-10T05:11:48.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.729+0000 7fa6d37fe640 1 -- 172.21.15.192:0/2127959375 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa7f406e070 con 0x557b31039a80 2024-09-10T05:11:48.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.730+0000 7fa6d37fe640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6cc03c730 0x7fa6cc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.730+0000 7fa6d37fe640 1 -- 172.21.15.192:0/2127959375 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa7f405c030 con 0x557b31039a80 2024-09-10T05:11:48.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.730+0000 7fa8010ca640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6cc03c730 0x7fa6cc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.730+0000 7fa8010ca640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6cc03c730 0x7fa6cc03ebf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x557b3101f9d0 tx=0x7fa7f8053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa806212800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa806212800 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557b3104c490 0x557b3104e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b3104f0a0 con 0x557b3104c490 2024-09-10T05:11:48.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa8020cc640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557b3104c490 0x557b3104e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa8020cc640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557b3104c490 0x557b3104e950 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa806212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa806212800 20 realm 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa806212800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b3104f4b0 con 0x557b3104c490 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa806212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa806212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa806212800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.731+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b3104fd80 con 0x557b3104c490 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.732+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.732+0000 7fa806212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.732+0000 7fa806212800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.732+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b3104c490 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.732+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.732+0000 7fa806212800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.732+0000 7fa806212800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.732+0000 7fa806212800 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557b31050e80 0x557b31053270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.732+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b31053830 con 0x557b31050e80 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.732+0000 7fa8018cb640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557b31050e80 0x557b31053270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.733+0000 7fa8018cb640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557b31050e80 0x557b31053270 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.733+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.733+0000 7fa806212800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.733+0000 7fa806212800 20 searching for the correct realm 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.733+0000 7fa806212800 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x557b310557e0 0x557b31057ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.733+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31058370 con 0x557b310557e0 2024-09-10T05:11:48.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.733+0000 7fa8010ca640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x557b310557e0 0x557b31057ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.733+0000 7fa8010ca640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x557b310557e0 0x557b31057ca0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.733+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.733+0000 7fa8010ca640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa7f805f040 0x7fa7f806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.733+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31058370 con 0x7fa7f805f040 2024-09-10T05:11:48.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.734+0000 7fa8020cc640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa7f805f040 0x7fa7f806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.734+0000 7fa8020cc640 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa7f805f040 0x7fa7f806b410 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.734+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.734+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b31050e80 2024-09-10T05:11:48.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.735+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.735+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b3104c490 2024-09-10T05:11:48.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.735+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.735+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b3104c490 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.735+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.735+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b31050e80 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.735+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.735+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b31050e80 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.736+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.736+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x7fa7f805f040 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.736+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.736+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b310557e0 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.736+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.736+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b3104c490 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.736+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.736+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b31050e80 2024-09-10T05:11:48.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.737+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.737+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b3104c490 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.737+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.737+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x7fa7f805f040 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.737+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.737+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b310557e0 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.737+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.737+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b310557e0 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.738+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.738+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b31050e80 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.738+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.738+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b310557e0 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.738+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.738+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b310557e0 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.738+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.738+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b3104c490 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.738+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.738+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b3104c490 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.739+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.739+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b31050e80 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.739+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.739+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b310557e0 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.739+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.739+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x7fa7f805f040 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.739+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.739+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b3104c490 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.740+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.740+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b31050e80 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.740+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.740+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b310557e0 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.740+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.740+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b31050e80 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.740+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.740+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x7fa7f805f040 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.741+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.741+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b310557e0 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.741+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.741+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b31050e80 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.741+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.741+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x557b3104c490 2024-09-10T05:11:48.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.741+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.741+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557b31050120 con 0x7fa7f805f040 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b310540f0 con 0x557b3104c490 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b310540f0 con 0x557b3104c490 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b310540f0 con 0x7fa7f805f040 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 zone default found 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 4 Realm: () 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 zonegroup default 2024-09-10T05:11:48.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.742+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b31054990 con 0x557b31050e80 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa806212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa806212800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b3105a1e0 con 0x557b310557e0 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa806212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa806212800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b3105a580 con 0x557b310557e0 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa806212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa806212800 20 started sync module instance, tier type = 2024-09-10T05:11:48.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa806212800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:48.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.743+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b31059680 con 0x7fa7f805f040 2024-09-10T05:11:48.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.744+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.744+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93987591789520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b31059680 con 0x7fa7f805f040 2024-09-10T05:11:48.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.744+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105af40 con 0x557b3104c490 2024-09-10T05:11:48.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.745+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93987591789520] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.746+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.746+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93987591787440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105af40 con 0x557b3104c490 2024-09-10T05:11:48.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.746+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105b960 con 0x557b310557e0 2024-09-10T05:11:48.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.747+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.747+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93987591795792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105c200 con 0x557b310557e0 2024-09-10T05:11:48.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.747+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105ccc0 con 0x7fa7f805f040 2024-09-10T05:11:48.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.747+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93987591787440] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.748+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93987591795792] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.748+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.748+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93987591798096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105aa90 con 0x7fa7f805f040 2024-09-10T05:11:48.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.748+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105d5a0 con 0x557b3104c490 2024-09-10T05:11:48.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.749+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93987591798096] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.749+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.749+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93987591800720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105d4e0 con 0x557b3104c490 2024-09-10T05:11:48.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.749+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105dfb0 con 0x557b31050e80 2024-09-10T05:11:48.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.750+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93987591800720] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.750+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.750+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93987591802928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105d450 con 0x557b31050e80 2024-09-10T05:11:48.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.750+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105ecd0 con 0x557b31050e80 2024-09-10T05:11:48.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.751+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93987591802928] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.751+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.751+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93987591808304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105f570 con 0x557b31050e80 2024-09-10T05:11:48.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.751+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105ff30 con 0x557b31050e80 2024-09-10T05:11:48.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.752+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.752+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93987591814064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b31060620 con 0x557b31050e80 2024-09-10T05:11:48.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.752+0000 7fa806212800 20 add_watcher() i=0 2024-09-10T05:11:48.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.752+0000 7fa806212800 20 add_watcher() i=1 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.752+0000 7fa806212800 20 add_watcher() i=2 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.752+0000 7fa806212800 20 add_watcher() i=3 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.752+0000 7fa806212800 20 add_watcher() i=4 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.752+0000 7fa806212800 20 add_watcher() i=5 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.752+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93987591808304] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.752+0000 7fa806212800 20 add_watcher() i=6 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.753+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93987591814064] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.753+0000 7fa806212800 20 add_watcher() i=7 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.753+0000 7fa806212800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.753+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b3105f0c0 con 0x557b3104c490 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.753+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.753+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93987591815344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3105f0c0 con 0x557b3104c490 2024-09-10T05:11:48.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.754+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93987591815344] v35'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.754+0000 7fa6b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.754+0000 7fa806212800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.754+0000 7fa806212800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.754+0000 7fa806212800 5 note: GC not initialized 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.755+0000 7fa6b27fc640 20 reqs_thread_entry: start 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.755+0000 7fa806212800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.755+0000 7fa806212800 20 Filter name: none 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.755+0000 7fa623fff640 20 reqs_thread_entry: start 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.755+0000 7fa806212800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.755+0000 7fa806212800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.755+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b310966e0 con 0x557b3104c490 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.755+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.755+0000 7fa806212800 20 rados_obj.operate() r=0 bl.length=556 2024-09-10T05:11:48.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.755+0000 7fa806212800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:48.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.755+0000 7fa806212800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:48.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.755+0000 7fa806212800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:48.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.756+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3109ccb0 con 0x557b3104c490 2024-09-10T05:11:48.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v35'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa806212800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:48.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa806212800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:48.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa806212800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:48.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93987592062704 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b31098390 con 0x557b3104c490 2024-09-10T05:11:48.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 93987591800720 notify 150323855370 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fa7fc026410 con 0x557b3104c490 2024-09-10T05:11:48.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa6e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855370 cookie 93987591800720 notifier 4427 bl.length()=567 2024-09-10T05:11:48.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(64 notify.4 [notify cookie 93987592062704 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa6e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa6e57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa6e57fa640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa6c4003ea0 con 0x557b3104c490 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== watch-notify(notify_complete (2) cookie 93987592062704 notify 150323855370 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa7fc0265e0 con 0x557b3104c490 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.757+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b3109c6f0 con 0x7fa7f805f040 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.758+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(66 foo:foo2 [delete] v35'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.758+0000 7fa806212800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.758+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93987592062704 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557b31097ee0 con 0x7fa7f805f040 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.759+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== watch-notify(notify (1) cookie 93987591789520 notify 150323855365 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fa7fc0265e0 con 0x7fa7f805f040 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.759+0000 7fa6e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855365 cookie 93987591789520 notifier 4427 bl.length()=159 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.759+0000 7fa6e57fa640 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa6c4003ea0 con 0x7fa7f805f040 2024-09-10T05:11:48.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.759+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.0 [notify cookie 93987592062704 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.759+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== watch-notify(notify_complete (2) cookie 93987592062704 notify 150323855365 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa7fc026880 con 0x7fa7f805f040 2024-09-10T05:11:48.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.759+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.772 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:48.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.760+0000 7fa6b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.760+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93987591815344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b31094540 con 0x557b3104c490 2024-09-10T05:11:48.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.761+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93987591815344] v35'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.761+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93987591789520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b31094540 con 0x7fa7f805f040 2024-09-10T05:11:48.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.762+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93987591789520] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.762+0000 7fa806212800 20 remove_watcher() i=0 2024-09-10T05:11:48.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.762+0000 7fa806212800 2 removed watcher, disabling cache 2024-09-10T05:11:48.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.762+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93987591787440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b31094540 con 0x557b3104c490 2024-09-10T05:11:48.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.763+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93987591787440] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.763+0000 7fa806212800 20 remove_watcher() i=1 2024-09-10T05:11:48.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.763+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93987591795792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b31094540 con 0x557b310557e0 2024-09-10T05:11:48.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.764+0000 7fa8010ca640 1 -- 172.21.15.192:0/2127959375 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93987591795792] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f807c040 con 0x557b310557e0 2024-09-10T05:11:48.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.764+0000 7fa806212800 20 remove_watcher() i=2 2024-09-10T05:11:48.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.764+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93987591798096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b31094540 con 0x7fa7f805f040 2024-09-10T05:11:48.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.765+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93987591798096] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x7fa7f805f040 2024-09-10T05:11:48.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.765+0000 7fa806212800 20 remove_watcher() i=3 2024-09-10T05:11:48.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.765+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93987591800720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b31094540 con 0x557b3104c490 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.766+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93987591800720] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7fc00a4d0 con 0x557b3104c490 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.766+0000 7fa806212800 20 remove_watcher() i=4 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.766+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93987591802928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b31094540 con 0x557b31050e80 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.767+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93987591802928] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.767+0000 7fa806212800 20 remove_watcher() i=5 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.767+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93987591808304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b31094540 con 0x557b31050e80 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.768+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93987591808304] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.768+0000 7fa806212800 20 remove_watcher() i=6 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.768+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93987591814064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557b31094540 con 0x557b31050e80 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa8018cb640 1 -- 172.21.15.192:0/2127959375 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93987591814064] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f4077070 con 0x557b31050e80 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 20 remove_watcher() i=7 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557b31050e80 msgr2=0x557b31053270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557b31050e80 0x557b31053270 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557b3104c490 msgr2=0x557b3104e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557b3104c490 0x557b3104e950 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa7f805f040 msgr2=0x7fa7f806b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa7f805f040 0x7fa7f806b410 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x557b310557e0 msgr2=0x557b31057ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x557b310557e0 0x557b31057ca0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6cc03c730 msgr2=0x7fa6cc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6cc03c730 0x7fa6cc03ebf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x557b3101f9d0 tx=0x7fa7f8053000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 msgr2=0x557b31040f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 --2- 172.21.15.192:0/2127959375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b31039a80 0x557b31040f20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa7f403e780 tx=0x7fa7f4044830 comp rx=0 tx=0).stop 2024-09-10T05:11:48.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 reap_dead start 2024-09-10T05:11:48.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa8020cc640 1 -- 172.21.15.192:0/2127959375 reap_dead start 2024-09-10T05:11:48.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 shutdown_connections 2024-09-10T05:11:48.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 >> 172.21.15.192:0/2127959375 conn(0x557b31035e80 msgr2=0x557b31034090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 shutdown_connections 2024-09-10T05:11:48.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/2127959375 wait complete. 2024-09-10T05:11:48.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/959762739 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6dc03c780 msgr2=0x7fa6dc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 --2- 172.21.15.192:0/959762739 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6dc03c780 0x7fa6dc03ec40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8000c00 tx=0x7fa7f8005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:48.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/959762739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b3102d200 msgr2=0x557b3102d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 --2- 172.21.15.192:0/959762739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b3102d200 0x557b3102d620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400e660 tx=0x7fa7f4018860 comp rx=0 tx=0).stop 2024-09-10T05:11:48.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/959762739 shutdown_connections 2024-09-10T05:11:48.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 --2- 172.21.15.192:0/959762739 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6dc03c780 0x7fa6dc03ec40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 --2- 172.21.15.192:0/959762739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b3102d200 0x557b3102d620 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/959762739 >> 172.21.15.192:0/959762739 conn(0x557b31021560 msgr2=0x557b31021940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/959762739 shutdown_connections 2024-09-10T05:11:48.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.769+0000 7fa806212800 1 -- 172.21.15.192:0/959762739 wait complete. 2024-09-10T05:11:48.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557b31018a00 msgr2=0x557b3101ae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557b31018a00 0x557b3101ae80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557b30f16000 msgr2=0x557b31016620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557b30f16000 0x557b31016620 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x557b3101ca70 msgr2=0x557b3101ee60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x557b3101ca70 0x557b3101ee60 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6e803c920 msgr2=0x7fa6e803ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa6e803c920 0x7fa6e803ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8057000 tx=0x7fa7f8052000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 msgr2=0x557b3100efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 --2- 172.21.15.192:0/999112458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b30f144e0 0x557b3100efd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40012f0 tx=0x7fa7f4000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa8020cc640 1 -- 172.21.15.192:0/999112458 reap_dead start 2024-09-10T05:11:48.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 shutdown_connections 2024-09-10T05:11:48.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 >> 172.21.15.192:0/999112458 conn(0x557b30f10210 msgr2=0x557b31008990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 shutdown_connections 2024-09-10T05:11:48.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.770+0000 7fa806212800 1 -- 172.21.15.192:0/999112458 wait complete. 2024-09-10T05:11:48.784 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:48.784 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-10T05:11:48.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-10T05:11:48.785 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-10T05:11:48.830 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:48.830 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:48.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.829+0000 7f7f7ab33800 1 Processor -- start 2024-09-10T05:11:48.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.830+0000 7f7f7ab33800 1 -- start start 2024-09-10T05:11:48.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.830+0000 7f7f7ab33800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5612f1b2dfc0 0x5612f1b36ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.830+0000 7f7f7ab33800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612f19d7e40 con 0x5612f1b2c4a0 2024-09-10T05:11:48.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.830+0000 7f7f7ab33800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5612f19a2680 con 0x5612f1b2dfc0 2024-09-10T05:11:48.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.830+0000 7f7f76019640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5612f1b2dfc0 0x5612f1b36ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.830+0000 7f7f7681a640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5612f1b2c4a0 0x5612f1b2c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36356/0 (socket says 172.21.15.192:36356) 2024-09-10T05:11:48.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.830+0000 7f7f7681a640 1 -- 172.21.15.192:0/3273843678 learned_addr learned my addr 172.21.15.192:0/3273843678 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:48.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.830+0000 7f7f75818640 1 -- 172.21.15.192:0/3273843678 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991935567 0 0) 0x5612f19d7e40 con 0x5612f1b2c4a0 2024-09-10T05:11:48.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.830+0000 7f7f75818640 1 -- 172.21.15.192:0/3273843678 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f60001e10 con 0x5612f1b2c4a0 2024-09-10T05:11:48.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.830+0000 7f7f76019640 1 -- 172.21.15.192:0/3273843678 >> v1:172.21.15.139:6789/0 conn(0x5612f1b2c4a0 legacy=0x5612f1b2c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.830+0000 7f7f76019640 1 -- 172.21.15.192:0/3273843678 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612f19be6b0 con 0x5612f1b2dfc0 2024-09-10T05:11:48.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.832+0000 7f7f76019640 1 --2- 172.21.15.192:0/3273843678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2dfc0 0x5612f1b36ae0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00a470 tx=0x7f7f6c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601c539bc6fa6847 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.832+0000 7f7f75818640 1 -- 172.21.15.192:0/3273843678 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c059070 con 0x5612f1b2dfc0 2024-09-10T05:11:48.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.832+0000 7f7f75818640 1 -- 172.21.15.192:0/3273843678 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6c054570 con 0x5612f1b2dfc0 2024-09-10T05:11:48.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.832+0000 7f7f75818640 1 -- 172.21.15.192:0/3273843678 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c054870 con 0x5612f1b2dfc0 2024-09-10T05:11:48.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.833+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3273843678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2dfc0 msgr2=0x5612f1b36ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.833+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/3273843678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2dfc0 0x5612f1b36ae0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00a470 tx=0x7f7f6c045920 comp rx=0 tx=0).stop 2024-09-10T05:11:48.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.833+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3273843678 shutdown_connections 2024-09-10T05:11:48.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.833+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/3273843678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2dfc0 0x5612f1b36ae0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.833+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3273843678 >> 172.21.15.192:0/3273843678 conn(0x5612f1b281f0 msgr2=0x5612f1b2a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.833+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3273843678 shutdown_connections 2024-09-10T05:11:48.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.833+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3273843678 wait complete. 2024-09-10T05:11:48.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.846+0000 7f7f7ab33800 1 Processor -- start 2024-09-10T05:11:48.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.846+0000 7f7f7ab33800 1 -- start start 2024-09-10T05:11:48.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.847+0000 7f7f7ab33800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 0x5612f1c1f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.847+0000 7f7f7ab33800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5612f19c6dd0 con 0x5612f1b2c4a0 2024-09-10T05:11:48.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.847+0000 7f7f7681a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 0x5612f1c1f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.847+0000 7f7f7681a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 0x5612f1c1f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60112/0 (socket says 172.21.15.192:60112) 2024-09-10T05:11:48.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.847+0000 7f7f7681a640 1 -- 172.21.15.192:0/964335207 learned_addr learned my addr 172.21.15.192:0/964335207 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.847+0000 7f7f7681a640 1 -- 172.21.15.192:0/964335207 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612f19dfe10 con 0x5612f1b2c4a0 2024-09-10T05:11:48.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.847+0000 7f7f7681a640 1 --2- 172.21.15.192:0/964335207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 0x5612f1c1f670 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7f68001e30 tx=0x7f7f6800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee8e0bb5a54c04f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.848+0000 7f7e64e09640 1 -- 172.21.15.192:0/964335207 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f68012020 con 0x5612f1b2c4a0 2024-09-10T05:11:48.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.848+0000 7f7e64e09640 1 -- 172.21.15.192:0/964335207 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6800e470 con 0x5612f1b2c4a0 2024-09-10T05:11:48.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.848+0000 7f7e64e09640 1 -- 172.21.15.192:0/964335207 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f6800e790 con 0x5612f1b2c4a0 2024-09-10T05:11:48.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.848+0000 7f7f7ab33800 1 -- 172.21.15.192:0/964335207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 msgr2=0x5612f1c1f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.848+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/964335207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 0x5612f1c1f670 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7f68001e30 tx=0x7f7f6800b780 comp rx=0 tx=0).stop 2024-09-10T05:11:48.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.848+0000 7f7f7ab33800 1 -- 172.21.15.192:0/964335207 shutdown_connections 2024-09-10T05:11:48.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.848+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/964335207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 0x5612f1c1f670 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.848+0000 7f7f7ab33800 1 -- 172.21.15.192:0/964335207 >> 172.21.15.192:0/964335207 conn(0x5612f1b281f0 msgr2=0x5612f1c1aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.848+0000 7f7f7ab33800 1 -- 172.21.15.192:0/964335207 shutdown_connections 2024-09-10T05:11:48.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.848+0000 7f7f7ab33800 1 -- 172.21.15.192:0/964335207 wait complete. 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.849+0000 7f7f7ab33800 1 Processor -- start 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.849+0000 7f7f7ab33800 1 -- start start 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.849+0000 7f7f7ab33800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 0x5612f1c26fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.849+0000 7f7f7ab33800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5612f1b372f0 con 0x5612f1b2c4a0 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.849+0000 7f7f7681a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 0x5612f1c26fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.849+0000 7f7f7681a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 0x5612f1c26fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60120/0 (socket says 172.21.15.192:60120) 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.849+0000 7f7f7681a640 1 -- 172.21.15.192:0/3221250827 learned_addr learned my addr 172.21.15.192:0/3221250827 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.850+0000 7f7f7681a640 1 -- 172.21.15.192:0/3221250827 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612f1c27520 con 0x5612f1b2c4a0 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.850+0000 7f7f7681a640 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 0x5612f1c26fc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5612f1c20600 tx=0x7f7f680040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.850+0000 7f7e63606640 1 -- 172.21.15.192:0/3221250827 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f68012030 con 0x5612f1b2c4a0 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.850+0000 7f7e63606640 1 -- 172.21.15.192:0/3221250827 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6801a7a0 con 0x5612f1b2c4a0 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.850+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612f1c277b0 con 0x5612f1b2c4a0 2024-09-10T05:11:48.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.850+0000 7f7e63606640 1 -- 172.21.15.192:0/3221250827 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f6801aaa0 con 0x5612f1b2c4a0 2024-09-10T05:11:48.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.850+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612f1c281b0 con 0x5612f1b2c4a0 2024-09-10T05:11:48.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.851+0000 7f7e63606640 1 -- 172.21.15.192:0/3221250827 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7f68015020 con 0x5612f1b2c4a0 2024-09-10T05:11:48.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.851+0000 7f7e63606640 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e5c03c780 0x7f7e5c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.851+0000 7f7e63606640 1 -- 172.21.15.192:0/3221250827 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f7f68020070 con 0x5612f1b2c4a0 2024-09-10T05:11:48.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.851+0000 7f7f76019640 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e5c03c780 0x7f7e5c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.851+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5612f1b2dfc0 0x5612f1c2e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.851+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c2eb50 con 0x5612f1b2dfc0 2024-09-10T05:11:48.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.851+0000 7f7f7701b640 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5612f1b2dfc0 0x5612f1c2e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.852+0000 7f7f76019640 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e5c03c780 0x7f7e5c03ec40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5612f1aa0cc0 tx=0x7f7f6c050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.852+0000 7f7f7701b640 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5612f1b2dfc0 0x5612f1c2e610 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.852+0000 7f7f7701b640 1 -- 172.21.15.192:0/3221250827 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1b2dfc0 2024-09-10T05:11:48.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.852+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c2eef0 con 0x5612f1b2dfc0 2024-09-10T05:11:48.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.852+0000 7f7f7701b640 1 -- 172.21.15.192:0/3221250827 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1b2dfc0 2024-09-10T05:11:48.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.852+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5612f1c309f0 0x5612f1c32e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.852+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c335f0 con 0x5612f1c309f0 2024-09-10T05:11:48.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.853+0000 7f7f7681a640 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5612f1c309f0 0x5612f1c32e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.853+0000 7f7f7681a640 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5612f1c309f0 0x5612f1c32e60 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.853+0000 7f7f7681a640 1 -- 172.21.15.192:0/3221250827 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7f68018950 con 0x5612f1c309f0 2024-09-10T05:11:48.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.853+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c2f740 con 0x5612f1b2dfc0 2024-09-10T05:11:48.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.853+0000 7f7f7701b640 1 -- 172.21.15.192:0/3221250827 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1b2dfc0 2024-09-10T05:11:48.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.853+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5612f1c34a50 0x5612f1c36e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.853+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c375b0 con 0x5612f1c34a50 2024-09-10T05:11:48.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.854+0000 7f7f76019640 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5612f1c34a50 0x5612f1c36e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.854+0000 7f7f76019640 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5612f1c34a50 0x5612f1c36e40 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.854+0000 7f7f76019640 1 -- 172.21.15.192:0/3221250827 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7f6c061430 con 0x5612f1c34a50 2024-09-10T05:11:48.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.854+0000 7f7f7ab33800 1 Processor -- start 2024-09-10T05:11:48.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7f7ab33800 1 -- start start 2024-09-10T05:11:48.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7f7ab33800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c451e0 0x5612f1c45600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7f7ab33800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5612f1a24a00 con 0x5612f1c451e0 2024-09-10T05:11:48.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7f7681a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c451e0 0x5612f1c45600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7f7681a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c451e0 0x5612f1c45600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60136/0 (socket says 172.21.15.192:60136) 2024-09-10T05:11:48.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7f7681a640 1 -- 172.21.15.192:0/1588142055 learned_addr learned my addr 172.21.15.192:0/1588142055 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7f7681a640 1 -- 172.21.15.192:0/1588142055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612f1c45c40 con 0x5612f1c451e0 2024-09-10T05:11:48.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7f7681a640 1 --2- 172.21.15.192:0/1588142055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c451e0 0x5612f1c45600 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7f68001770 tx=0x7f7f6804d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7e60e01640 1 -- 172.21.15.192:0/1588142055 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f680165c0 con 0x5612f1c451e0 2024-09-10T05:11:48.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7e60e01640 1 -- 172.21.15.192:0/1588142055 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f68016760 con 0x5612f1c451e0 2024-09-10T05:11:48.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7f7ab33800 1 -- 172.21.15.192:0/1588142055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612f1c46470 con 0x5612f1c451e0 2024-09-10T05:11:48.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7e60e01640 1 -- 172.21.15.192:0/1588142055 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f6802c7d0 con 0x5612f1c451e0 2024-09-10T05:11:48.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.855+0000 7f7f7ab33800 1 -- 172.21.15.192:0/1588142055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612f1c46470 con 0x5612f1c451e0 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.856+0000 7f7e60e01640 1 -- 172.21.15.192:0/1588142055 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7f6802c970 con 0x5612f1c451e0 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.856+0000 7f7e60e01640 1 --2- 172.21.15.192:0/1588142055 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e5003c780 0x7f7e5003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.856+0000 7f7e60e01640 1 -- 172.21.15.192:0/1588142055 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f7f68037c70 con 0x5612f1c451e0 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.856+0000 7f7f76019640 1 --2- 172.21.15.192:0/1588142055 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e5003c780 0x7f7e5003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.857+0000 7f7f7ab33800 1 Processor -- start 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.857+0000 7f7f7ab33800 1 -- start start 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.857+0000 7f7f76019640 1 --2- 172.21.15.192:0/1588142055 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e5003c780 0x7f7e5003ec40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00a470 tx=0x7f7f6c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.857+0000 7f7f7ab33800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 0x5612f1c51c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.857+0000 7f7f7ab33800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5612f1c1fec0 con 0x5612f1c518a0 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.857+0000 7f7f7681a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 0x5612f1c51c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.857+0000 7f7f7681a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 0x5612f1c51c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60150/0 (socket says 172.21.15.192:60150) 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.857+0000 7f7f7681a640 1 -- 172.21.15.192:0/819760157 learned_addr learned my addr 172.21.15.192:0/819760157 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.857+0000 7f7f7681a640 1 -- 172.21.15.192:0/819760157 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612f1c52270 con 0x5612f1c518a0 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.857+0000 7f7f7681a640 1 --2- 172.21.15.192:0/819760157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 0x5612f1c51c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7f68047fd0 tx=0x7f7f68024f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff736132e21b09e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.858+0000 7f7e5a7fc640 1 -- 172.21.15.192:0/819760157 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f68063070 con 0x5612f1c518a0 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.858+0000 7f7e5a7fc640 1 -- 172.21.15.192:0/819760157 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6802d3f0 con 0x5612f1c518a0 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.858+0000 7f7e5a7fc640 1 -- 172.21.15.192:0/819760157 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f6805a040 con 0x5612f1c518a0 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.858+0000 7f7f7ab33800 1 -- 172.21.15.192:0/819760157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 msgr2=0x5612f1c51c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.858+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/819760157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 0x5612f1c51c80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7f68047fd0 tx=0x7f7f68024f40 comp rx=0 tx=0).stop 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.858+0000 7f7f7ab33800 1 -- 172.21.15.192:0/819760157 shutdown_connections 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.858+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/819760157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 0x5612f1c51c80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.858+0000 7f7f7ab33800 1 -- 172.21.15.192:0/819760157 >> 172.21.15.192:0/819760157 conn(0x5612f1c4dca0 msgr2=0x5612f1c4bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.858+0000 7f7f7ab33800 1 -- 172.21.15.192:0/819760157 shutdown_connections 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.858+0000 7f7f7ab33800 1 -- 172.21.15.192:0/819760157 wait complete. 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.858+0000 7f7f7ab33800 1 Processor -- start 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.858+0000 7f7f7ab33800 1 -- start start 2024-09-10T05:11:48.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.859+0000 7f7f7ab33800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 0x5612f1c58d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.859+0000 7f7f7ab33800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5612f1c52700 con 0x5612f1c518a0 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.859+0000 7f7f7681a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 0x5612f1c58d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.859+0000 7f7f7681a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 0x5612f1c58d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60152/0 (socket says 172.21.15.192:60152) 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.859+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 learned_addr learned my addr 172.21.15.192:0/257529760 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.859+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612f1c592e0 con 0x5612f1c518a0 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.859+0000 7f7f7681a640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 0x5612f1c58d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7f68047ab0 tx=0x7f7f68012f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.859+0000 7f7e58ff9640 1 -- 172.21.15.192:0/257529760 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f6806c020 con 0x5612f1c518a0 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.859+0000 7f7e58ff9640 1 -- 172.21.15.192:0/257529760 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6800d5f0 con 0x5612f1c518a0 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.859+0000 7f7e58ff9640 1 -- 172.21.15.192:0/257529760 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f68063040 con 0x5612f1c518a0 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.859+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612f1c592e0 con 0x5612f1c518a0 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.860+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612f1c592e0 con 0x5612f1c518a0 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.860+0000 7f7e58ff9640 1 -- 172.21.15.192:0/257529760 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7f6806f020 con 0x5612f1c518a0 2024-09-10T05:11:48.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7e58ff9640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e4003c6e0 0x7f7e4003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7e58ff9640 1 -- 172.21.15.192:0/257529760 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f7f68072c40 con 0x5612f1c518a0 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7f76019640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e4003c6e0 0x7f7e4003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5612f1c641e0 0x5612f1c666a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c66df0 con 0x5612f1c641e0 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7f7701b640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5612f1c641e0 0x5612f1c666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7f76019640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e4003c6e0 0x7f7e4003eba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c054fd0 tx=0x7f7f6c051000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7f7701b640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5612f1c641e0 0x5612f1c666a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7f7ab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7f7ab33800 20 realm 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.861+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67200 con 0x5612f1c641e0 2024-09-10T05:11:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7ab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7ab33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67ad0 con 0x5612f1c641e0 2024-09-10T05:11:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7ab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c641e0 2024-09-10T05:11:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7ab33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5612f1c68960 0x5612f1c6ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c6b490 con 0x5612f1c68960 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.862+0000 7f7f7681a640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5612f1c68960 0x5612f1c6ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.863+0000 7f7f7681a640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5612f1c68960 0x5612f1c6ad50 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.863+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.863+0000 7f7f7ab33800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.863+0000 7f7f7ab33800 20 searching for the correct realm 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.863+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5612f1c6d530 0x5612f1c6f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.863+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c700c0 con 0x5612f1c6d530 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.863+0000 7f7f76019640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5612f1c6d530 0x5612f1c6f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.863+0000 7f7f76019640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5612f1c6d530 0x5612f1c6f9f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.864+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.864+0000 7f7f76019640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7f6c087040 0x7f7f6c078940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.864+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c700c0 con 0x7f7f6c087040 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.864+0000 7f7f7701b640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7f6c087040 0x7f7f6c078940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.864+0000 7f7f7701b640 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7f6c087040 0x7f7f6c078940 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.864+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.864+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c68960 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.865+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.865+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c641e0 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.865+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.865+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c641e0 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.865+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.865+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c68960 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.865+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.865+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c68960 2024-09-10T05:11:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.866+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.866+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x7f7f6c087040 2024-09-10T05:11:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.866+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.866+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c6d530 2024-09-10T05:11:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.866+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.866+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c641e0 2024-09-10T05:11:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.866+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.866+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c68960 2024-09-10T05:11:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.867+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.867+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c641e0 2024-09-10T05:11:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.867+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.867+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x7f7f6c087040 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.867+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.867+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c6d530 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.867+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.867+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c6d530 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.867+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.867+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c68960 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.868+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.868+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c6d530 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.868+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.868+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c6d530 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.868+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.868+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c641e0 2024-09-10T05:11:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.868+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.868+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c641e0 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.868+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.869+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c68960 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.869+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.869+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c6d530 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.869+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.869+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x7f7f6c087040 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.869+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.869+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c641e0 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.870+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.870+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c68960 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.870+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.870+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c6d530 2024-09-10T05:11:48.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.870+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.870+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c68960 2024-09-10T05:11:48.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.870+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.870+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x7f7f6c087040 2024-09-10T05:11:48.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.871+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.871+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c6d530 2024-09-10T05:11:48.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.871+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.871+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c68960 2024-09-10T05:11:48.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.871+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.871+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x5612f1c641e0 2024-09-10T05:11:48.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.871+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.871+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c67e70 con 0x7f7f6c087040 2024-09-10T05:11:48.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:48.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:48.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:48.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:48.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:48.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:48.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c6be30 con 0x5612f1c641e0 2024-09-10T05:11:48.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c6be30 con 0x5612f1c641e0 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c6be00 con 0x7f7f6c087040 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 zone default found 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 4 Realm: () 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:48.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 zonegroup default 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.872+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c6c220 con 0x5612f1c68960 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f7ab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c6bc10 con 0x5612f1c6d530 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f7ab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c71f30 con 0x5612f1c6d530 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f7ab33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f7ab33800 20 started sync module instance, tier type = 2024-09-10T05:11:48.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f7ab33800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:48.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.873+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c713d0 con 0x7f7f6c087040 2024-09-10T05:11:48.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.874+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.874+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94639365757184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c713d0 con 0x7f7f6c087040 2024-09-10T05:11:48.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.874+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c729d0 con 0x5612f1c641e0 2024-09-10T05:11:48.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.875+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94639365757184] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.875+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.875+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94639365760192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c713d0 con 0x5612f1c641e0 2024-09-10T05:11:48.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.875+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c73460 con 0x5612f1c6d530 2024-09-10T05:11:48.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.876+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94639365760192] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.877+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.877+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94639365754656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c71340 con 0x5612f1c6d530 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.877+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c74320 con 0x7f7f6c087040 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.877+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94639365754656] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.878+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.878+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94639365766768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c74740 con 0x7f7f6c087040 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.878+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c75100 con 0x5612f1c641e0 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.879+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94639365766768] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.879+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.879+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94639365768304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c75100 con 0x5612f1c641e0 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.879+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c75ac0 con 0x5612f1c68960 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.880+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94639365768304] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.880+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.880+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94639365770320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c75070 con 0x5612f1c68960 2024-09-10T05:11:48.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.880+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c76820 con 0x5612f1c68960 2024-09-10T05:11:48.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.881+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94639365770320] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.881+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.881+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94639365775424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c770f0 con 0x5612f1c68960 2024-09-10T05:11:48.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.881+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c77ab0 con 0x5612f1c68960 2024-09-10T05:11:48.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.882+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.882+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94639365775424] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.882+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94639365780992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c77a20 con 0x5612f1c68960 2024-09-10T05:11:48.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.882+0000 7f7f7ab33800 20 add_watcher() i=0 2024-09-10T05:11:48.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.882+0000 7f7f7ab33800 20 add_watcher() i=1 2024-09-10T05:11:48.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.882+0000 7f7f7ab33800 20 add_watcher() i=2 2024-09-10T05:11:48.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.882+0000 7f7f7ab33800 20 add_watcher() i=3 2024-09-10T05:11:48.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.882+0000 7f7f7ab33800 20 add_watcher() i=4 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.882+0000 7f7f7ab33800 20 add_watcher() i=5 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.882+0000 7f7f7ab33800 20 add_watcher() i=6 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.883+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94639365780992] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.883+0000 7f7f7ab33800 20 add_watcher() i=7 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.883+0000 7f7f7ab33800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.883+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c7ae50 con 0x5612f1c641e0 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.883+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.883+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94639365778496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c78370 con 0x5612f1c641e0 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.884+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94639365778496] v35'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.884+0000 7f7e2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.884+0000 7f7f7ab33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.884+0000 7f7f7ab33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.884+0000 7f7f7ab33800 5 note: GC not initialized 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.884+0000 7f7da7fff640 20 reqs_thread_entry: start 2024-09-10T05:11:48.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.884+0000 7f7f7ab33800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.885+0000 7f7f7ab33800 20 Filter name: none 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.885+0000 7f7da5ffb640 20 reqs_thread_entry: start 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.885+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.885+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1cad950 con 0x5612f1c641e0 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.885+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.885+0000 7f7f7ab33800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.885+0000 7f7f7ab33800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.885+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1cae210 con 0x5612f1c641e0 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.885+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.886+0000 7f7f7ab33800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.886+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612f1caf220 con 0x7f7f6c087040 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.886+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.887+0000 7f7e2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:48.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.887+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94639365778496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1cab870 con 0x5612f1c641e0 2024-09-10T05:11:48.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.888+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94639365778496] v35'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.888+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94639365757184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1cab870 con 0x7f7f6c087040 2024-09-10T05:11:48.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.889+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94639365757184] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.889+0000 7f7f7ab33800 20 remove_watcher() i=0 2024-09-10T05:11:48.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.889+0000 7f7f7ab33800 2 removed watcher, disabling cache 2024-09-10T05:11:48.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.889+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94639365760192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1cab870 con 0x5612f1c641e0 2024-09-10T05:11:48.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.890+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94639365760192] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.890+0000 7f7f7ab33800 20 remove_watcher() i=1 2024-09-10T05:11:48.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.890+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94639365754656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1cab870 con 0x5612f1c6d530 2024-09-10T05:11:48.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.891+0000 7f7f76019640 1 -- 172.21.15.192:0/257529760 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94639365754656] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f6c075070 con 0x5612f1c6d530 2024-09-10T05:11:48.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.891+0000 7f7f7ab33800 20 remove_watcher() i=2 2024-09-10T05:11:48.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.891+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94639365766768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c70f20 con 0x7f7f6c087040 2024-09-10T05:11:48.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.892+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94639365766768] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x7f7f6c087040 2024-09-10T05:11:48.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.892+0000 7f7f7ab33800 20 remove_watcher() i=3 2024-09-10T05:11:48.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.892+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94639365768304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c73e70 con 0x5612f1c641e0 2024-09-10T05:11:48.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.893+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94639365768304] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f7000a4d0 con 0x5612f1c641e0 2024-09-10T05:11:48.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.893+0000 7f7f7ab33800 20 remove_watcher() i=4 2024-09-10T05:11:48.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.893+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94639365770320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c70f20 con 0x5612f1c68960 2024-09-10T05:11:48.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.893+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94639365770320] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.894+0000 7f7f7ab33800 20 remove_watcher() i=5 2024-09-10T05:11:48.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.894+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94639365775424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c73e70 con 0x5612f1c68960 2024-09-10T05:11:48.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.894+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94639365775424] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.894+0000 7f7f7ab33800 20 remove_watcher() i=6 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.894+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94639365780992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612f1c74c50 con 0x5612f1c68960 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.895+0000 7f7f7681a640 1 -- 172.21.15.192:0/257529760 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94639365780992] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f68066040 con 0x5612f1c68960 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.895+0000 7f7f7ab33800 20 remove_watcher() i=7 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.895+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5612f1c68960 msgr2=0x5612f1c6ad50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.895+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5612f1c68960 0x5612f1c6ad50 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5612f1c641e0 msgr2=0x5612f1c666a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5612f1c641e0 0x5612f1c666a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7f6c087040 msgr2=0x7f7f6c078940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7f6c087040 0x7f7f6c078940 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5612f1c6d530 msgr2=0x5612f1c6f9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5612f1c6d530 0x5612f1c6f9f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e4003c6e0 msgr2=0x7f7e4003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e4003c6e0 0x7f7e4003eba0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c054fd0 tx=0x7f7f6c051000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 msgr2=0x5612f1c58d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/257529760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c518a0 0x5612f1c58d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7f68047ab0 tx=0x7f7f68012f00 comp rx=0 tx=0).stop 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 reap_dead start 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7701b640 1 -- 172.21.15.192:0/257529760 reap_dead start 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 shutdown_connections 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 >> 172.21.15.192:0/257529760 conn(0x5612f1c4dca0 msgr2=0x5612f1c4beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 shutdown_connections 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/257529760 wait complete. 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/1588142055 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e5003c780 msgr2=0x7f7e5003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/1588142055 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e5003c780 0x7f7e5003ec40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00a470 tx=0x7f7f6c005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/1588142055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c451e0 msgr2=0x5612f1c45600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/1588142055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c451e0 0x5612f1c45600 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7f68001770 tx=0x7f7f6804d320 comp rx=0 tx=0).stop 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/1588142055 shutdown_connections 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/1588142055 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e5003c780 0x7f7e5003ec40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/1588142055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1c451e0 0x5612f1c45600 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/1588142055 >> 172.21.15.192:0/1588142055 conn(0x5612f1c39540 msgr2=0x5612f1c39920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/1588142055 shutdown_connections 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/1588142055 wait complete. 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5612f1c309f0 msgr2=0x5612f1c32e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5612f1c309f0 0x5612f1c32e60 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5612f1b2dfc0 msgr2=0x5612f1c2e610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.896+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5612f1b2dfc0 0x5612f1c2e610 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.897+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5612f1c34a50 msgr2=0x5612f1c36e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.897+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5612f1c34a50 0x5612f1c36e40 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.897+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e5c03c780 msgr2=0x7f7e5c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.897+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7e5c03c780 0x7f7e5c03ec40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5612f1aa0cc0 tx=0x7f7f6c050000 comp rx=0 tx=0).stop 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.897+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 msgr2=0x5612f1c26fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.897+0000 7f7f7ab33800 1 --2- 172.21.15.192:0/3221250827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612f1b2c4a0 0x5612f1c26fc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5612f1c20600 tx=0x7f7f680040e0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.897+0000 7f7f7701b640 1 -- 172.21.15.192:0/3221250827 reap_dead start 2024-09-10T05:11:48.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.897+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 shutdown_connections 2024-09-10T05:11:48.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.897+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 >> 172.21.15.192:0/3221250827 conn(0x5612f1b281f0 msgr2=0x5612f1c20950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.897+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 shutdown_connections 2024-09-10T05:11:48.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.897+0000 7f7f7ab33800 1 -- 172.21.15.192:0/3221250827 wait complete. 2024-09-10T05:11:48.910 INFO:teuthology.orchestra.run.smithi192.stdout:[] 2024-09-10T05:11:48.910 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T05:11:48.910 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-10T05:11:48.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-10T05:11:48.910 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-10T05:11:48.955 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:48.955 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:48.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.954+0000 7fa41ef46800 1 Processor -- start 2024-09-10T05:11:48.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.955+0000 7fa41ef46800 1 -- start start 2024-09-10T05:11:48.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.955+0000 7fa41ef46800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5572efb1d200 0x5572efb1f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.955+0000 7fa41ef46800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5572ef9c2e40 con 0x5572efb19690 2024-09-10T05:11:48.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.955+0000 7fa41ef46800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5572ef98d680 con 0x5572efb1d200 2024-09-10T05:11:48.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.955+0000 7fa41c236640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5572efb1d200 0x5572efb1f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.955+0000 7fa41ca37640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5572efb19690 0x5572efb1ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36362/0 (socket says 172.21.15.192:36362) 2024-09-10T05:11:48.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.955+0000 7fa41ca37640 1 -- 172.21.15.192:0/1500050583 learned_addr learned my addr 172.21.15.192:0/1500050583 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:48.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.955+0000 7fa41c236640 1 -- 172.21.15.192:0/1500050583 >> v1:172.21.15.139:6789/0 conn(0x5572efb19690 legacy=0x5572efb1ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.955+0000 7fa41c236640 1 -- 172.21.15.192:0/1500050583 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572ef9a96b0 con 0x5572efb1d200 2024-09-10T05:11:48.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.957+0000 7fa41c236640 1 --2- 172.21.15.192:0/1500050583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb1d200 0x5572efb1f6c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa41000a470 tx=0x7fa410045880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f55a61f42ea690 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.957+0000 7fa41ba35640 1 -- 172.21.15.192:0/1500050583 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa410059070 con 0x5572efb1d200 2024-09-10T05:11:48.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.957+0000 7fa41ba35640 1 -- 172.21.15.192:0/1500050583 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa410054570 con 0x5572efb1d200 2024-09-10T05:11:48.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.957+0000 7fa41ba35640 1 -- 172.21.15.192:0/1500050583 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa410054870 con 0x5572efb1d200 2024-09-10T05:11:48.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.958+0000 7fa41ef46800 1 -- 172.21.15.192:0/1500050583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb1d200 msgr2=0x5572efb1f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.958+0000 7fa41ef46800 1 --2- 172.21.15.192:0/1500050583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb1d200 0x5572efb1f6c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa41000a470 tx=0x7fa410045880 comp rx=0 tx=0).stop 2024-09-10T05:11:48.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.958+0000 7fa41ef46800 1 -- 172.21.15.192:0/1500050583 shutdown_connections 2024-09-10T05:11:48.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.958+0000 7fa41ef46800 1 --2- 172.21.15.192:0/1500050583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb1d200 0x5572efb1f6c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.958+0000 7fa41ef46800 1 -- 172.21.15.192:0/1500050583 >> 172.21.15.192:0/1500050583 conn(0x5572efb131f0 msgr2=0x5572efb15630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.958+0000 7fa41ef46800 1 -- 172.21.15.192:0/1500050583 shutdown_connections 2024-09-10T05:11:48.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.958+0000 7fa41ef46800 1 -- 172.21.15.192:0/1500050583 wait complete. 2024-09-10T05:11:48.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.972+0000 7fa41ef46800 1 Processor -- start 2024-09-10T05:11:48.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.972+0000 7fa41ef46800 1 -- start start 2024-09-10T05:11:48.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.972+0000 7fa41ef46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 0x5572efb18e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.972+0000 7fa41ef46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5572ef9b1dd0 con 0x5572efb19690 2024-09-10T05:11:48.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.972+0000 7fa41ca37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 0x5572efb18e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.972+0000 7fa41ca37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 0x5572efb18e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60156/0 (socket says 172.21.15.192:60156) 2024-09-10T05:11:48.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.972+0000 7fa41ca37640 1 -- 172.21.15.192:0/1738917303 learned_addr learned my addr 172.21.15.192:0/1738917303 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.973+0000 7fa41ca37640 1 -- 172.21.15.192:0/1738917303 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572ef9cae10 con 0x5572efb19690 2024-09-10T05:11:48.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.973+0000 7fa41ca37640 1 --2- 172.21.15.192:0/1738917303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 0x5572efb18e20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00b510 tx=0x7fa40c00b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a97772251c2570 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.973+0000 7fa30ae0d640 1 -- 172.21.15.192:0/1738917303 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa40c008070 con 0x5572efb19690 2024-09-10T05:11:48.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.973+0000 7fa30ae0d640 1 -- 172.21.15.192:0/1738917303 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c00d5c0 con 0x5572efb19690 2024-09-10T05:11:48.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.973+0000 7fa30ae0d640 1 -- 172.21.15.192:0/1738917303 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa40c00d8e0 con 0x5572efb19690 2024-09-10T05:11:48.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ef46800 1 -- 172.21.15.192:0/1738917303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 msgr2=0x5572efb18e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ef46800 1 --2- 172.21.15.192:0/1738917303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 0x5572efb18e20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00b510 tx=0x7fa40c00b9d0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ef46800 1 -- 172.21.15.192:0/1738917303 shutdown_connections 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ef46800 1 --2- 172.21.15.192:0/1738917303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 0x5572efb18e20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ef46800 1 -- 172.21.15.192:0/1738917303 >> 172.21.15.192:0/1738917303 conn(0x5572efb131f0 msgr2=0x5572efc04000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ef46800 1 -- 172.21.15.192:0/1738917303 shutdown_connections 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ef46800 1 -- 172.21.15.192:0/1738917303 wait complete. 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ef46800 1 Processor -- start 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ef46800 1 -- start start 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ef46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 0x5572efc121a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ef46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5572efb20040 con 0x5572efb19690 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ca37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 0x5572efc121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ca37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 0x5572efc121a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60170/0 (socket says 172.21.15.192:60170) 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.974+0000 7fa41ca37640 1 -- 172.21.15.192:0/961600225 learned_addr learned my addr 172.21.15.192:0/961600225 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.975+0000 7fa41ca37640 1 -- 172.21.15.192:0/961600225 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572efc12700 con 0x5572efb19690 2024-09-10T05:11:48.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.975+0000 7fa41ca37640 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 0x5572efc121a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5572efb18950 tx=0x7fa40c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.975+0000 7fa30960a640 1 -- 172.21.15.192:0/961600225 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa40c00fac0 con 0x5572efb19690 2024-09-10T05:11:48.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.975+0000 7fa30960a640 1 -- 172.21.15.192:0/961600225 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c020030 con 0x5572efb19690 2024-09-10T05:11:48.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.975+0000 7fa30960a640 1 -- 172.21.15.192:0/961600225 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa40c00fdd0 con 0x5572efb19690 2024-09-10T05:11:48.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.975+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572efc12990 con 0x5572efb19690 2024-09-10T05:11:48.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.975+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572efc135a0 con 0x5572efb19690 2024-09-10T05:11:48.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.976+0000 7fa30960a640 1 -- 172.21.15.192:0/961600225 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa40c01b430 con 0x5572efb19690 2024-09-10T05:11:48.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.976+0000 7fa30960a640 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa30403c730 0x7fa30403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.976+0000 7fa30960a640 1 -- 172.21.15.192:0/961600225 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa40c054240 con 0x5572efb19690 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.976+0000 7fa41c236640 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa30403c730 0x7fa30403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.976+0000 7fa41ef46800 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5572efb1d200 0x5572efc197f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.976+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc19d30 con 0x5572efb1d200 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.976+0000 7fa41d238640 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5572efb1d200 0x5572efc197f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.977+0000 7fa41c236640 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa30403c730 0x7fa30403ebf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa410056000 tx=0x7fa410050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.977+0000 7fa41d238640 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5572efb1d200 0x5572efc197f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.977+0000 7fa41d238640 1 -- 172.21.15.192:0/961600225 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efb1d200 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.977+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc1a0d0 con 0x5572efb1d200 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.977+0000 7fa41d238640 1 -- 172.21.15.192:0/961600225 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efb1d200 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.977+0000 7fa41ef46800 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5572efc1bbd0 0x5572efc1e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.977+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc1e800 con 0x5572efc1bbd0 2024-09-10T05:11:48.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.977+0000 7fa41ca37640 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5572efc1bbd0 0x5572efc1e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.978+0000 7fa41ca37640 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5572efc1bbd0 0x5572efc1e070 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.978+0000 7fa41ca37640 1 -- 172.21.15.192:0/961600225 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa40c02c070 con 0x5572efc1bbd0 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.978+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc1a920 con 0x5572efb1d200 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.978+0000 7fa41d238640 1 -- 172.21.15.192:0/961600225 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efb1d200 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.978+0000 7fa41ef46800 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5572efc1fc60 0x5572efc22050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.978+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc22790 con 0x5572efc1fc60 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.978+0000 7fa41c236640 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5572efc1fc60 0x5572efc22050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.979+0000 7fa41c236640 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5572efc1fc60 0x5572efc22050 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.979+0000 7fa41c236640 1 -- 172.21.15.192:0/961600225 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa41005c040 con 0x5572efc1fc60 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.979+0000 7fa41ef46800 1 Processor -- start 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.979+0000 7fa41ef46800 1 -- start start 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.980+0000 7fa41ef46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc303f0 0x5572efc30810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.980+0000 7fa41ef46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5572efa0fa00 con 0x5572efc303f0 2024-09-10T05:11:48.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.980+0000 7fa41ca37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc303f0 0x5572efc30810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.980+0000 7fa41ca37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc303f0 0x5572efc30810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60184/0 (socket says 172.21.15.192:60184) 2024-09-10T05:11:48.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.980+0000 7fa41ca37640 1 -- 172.21.15.192:0/3800763950 learned_addr learned my addr 172.21.15.192:0/3800763950 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.980+0000 7fa41ca37640 1 -- 172.21.15.192:0/3800763950 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572efc30e50 con 0x5572efc303f0 2024-09-10T05:11:48.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.980+0000 7fa41ca37640 1 --2- 172.21.15.192:0/3800763950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc303f0 0x5572efc30810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa40c018520 tx=0x7fa40c00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.980+0000 7fa302ffd640 1 -- 172.21.15.192:0/3800763950 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa40c044610 con 0x5572efc303f0 2024-09-10T05:11:48.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.980+0000 7fa302ffd640 1 -- 172.21.15.192:0/3800763950 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c0529a0 con 0x5572efc303f0 2024-09-10T05:11:48.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.980+0000 7fa41ef46800 1 -- 172.21.15.192:0/3800763950 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572efc31680 con 0x5572efc303f0 2024-09-10T05:11:48.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.980+0000 7fa302ffd640 1 -- 172.21.15.192:0/3800763950 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa40c052cc0 con 0x5572efc303f0 2024-09-10T05:11:48.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.980+0000 7fa41ef46800 1 -- 172.21.15.192:0/3800763950 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572efc31c20 con 0x5572efc303f0 2024-09-10T05:11:48.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.981+0000 7fa302ffd640 1 -- 172.21.15.192:0/3800763950 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa40c019960 con 0x5572efc303f0 2024-09-10T05:11:48.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.981+0000 7fa302ffd640 1 --2- 172.21.15.192:0/3800763950 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2f403c780 0x7fa2f403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.981+0000 7fa302ffd640 1 -- 172.21.15.192:0/3800763950 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa40c038930 con 0x5572efc303f0 2024-09-10T05:11:48.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.981+0000 7fa41c236640 1 --2- 172.21.15.192:0/3800763950 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2f403c780 0x7fa2f403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.982+0000 7fa41ef46800 1 Processor -- start 2024-09-10T05:11:48.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.982+0000 7fa41ef46800 1 -- start start 2024-09-10T05:11:48.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.982+0000 7fa41c236640 1 --2- 172.21.15.192:0/3800763950 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2f403c780 0x7fa2f403ec40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5572efc1eba0 tx=0x7fa410005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.982+0000 7fa41ef46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 0x5572efc3d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.982+0000 7fa41ef46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5572efb176c0 con 0x5572efc3cd10 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.982+0000 7fa41ca37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 0x5572efc3d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.982+0000 7fa41ca37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 0x5572efc3d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60196/0 (socket says 172.21.15.192:60196) 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.982+0000 7fa41ca37640 1 -- 172.21.15.192:0/3110721652 learned_addr learned my addr 172.21.15.192:0/3110721652 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.982+0000 7fa41ca37640 1 -- 172.21.15.192:0/3110721652 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572efc3d700 con 0x5572efc3cd10 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.982+0000 7fa41ca37640 1 --2- 172.21.15.192:0/3110721652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 0x5572efc3d110 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa40c046fd0 tx=0x7fa40c040f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122f57ea7bacbd97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.983+0000 7fa300ff9640 1 -- 172.21.15.192:0/3110721652 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa40c02fcd0 con 0x5572efc3cd10 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.983+0000 7fa300ff9640 1 -- 172.21.15.192:0/3110721652 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c02e3e0 con 0x5572efc3cd10 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.983+0000 7fa300ff9640 1 -- 172.21.15.192:0/3110721652 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa40c0383f0 con 0x5572efc3cd10 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.983+0000 7fa41ef46800 1 -- 172.21.15.192:0/3110721652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 msgr2=0x5572efc3d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.983+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3110721652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 0x5572efc3d110 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa40c046fd0 tx=0x7fa40c040f70 comp rx=0 tx=0).stop 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.983+0000 7fa41ef46800 1 -- 172.21.15.192:0/3110721652 shutdown_connections 2024-09-10T05:11:48.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.983+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3110721652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 0x5572efc3d110 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.983+0000 7fa41ef46800 1 -- 172.21.15.192:0/3110721652 >> 172.21.15.192:0/3110721652 conn(0x5572efc39110 msgr2=0x5572efc37350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.983+0000 7fa41ef46800 1 -- 172.21.15.192:0/3110721652 shutdown_connections 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.983+0000 7fa41ef46800 1 -- 172.21.15.192:0/3110721652 wait complete. 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.983+0000 7fa41ef46800 1 Processor -- start 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.983+0000 7fa41ef46800 1 -- start start 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.984+0000 7fa41ef46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 0x5572efc44190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.984+0000 7fa41ef46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5572efc3db70 con 0x5572efc3cd10 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.984+0000 7fa41ca37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 0x5572efc44190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.984+0000 7fa41ca37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 0x5572efc44190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60210/0 (socket says 172.21.15.192:60210) 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.984+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 learned_addr learned my addr 172.21.15.192:0/3976517077 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.984+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572efc446f0 con 0x5572efc3cd10 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.984+0000 7fa41ca37640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 0x5572efc44190 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00ed50 tx=0x7fa40c059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.984+0000 7fa2fa7fc640 1 -- 172.21.15.192:0/3976517077 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa40c02fcd0 con 0x5572efc3cd10 2024-09-10T05:11:48.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.984+0000 7fa2fa7fc640 1 -- 172.21.15.192:0/3976517077 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c052e60 con 0x5572efc3cd10 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.984+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572efc446f0 con 0x5572efc3cd10 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.984+0000 7fa2fa7fc640 1 -- 172.21.15.192:0/3976517077 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa40c019c50 con 0x5572efc3cd10 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.984+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572efc446f0 con 0x5572efc3cd10 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.985+0000 7fa2fa7fc640 1 -- 172.21.15.192:0/3976517077 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa40c03e300 con 0x5572efc3cd10 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.985+0000 7fa2fa7fc640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2e403c780 0x7fa2e403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.985+0000 7fa2fa7fc640 1 -- 172.21.15.192:0/3976517077 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa40c05a030 con 0x5572efc3cd10 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.985+0000 7fa41c236640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2e403c780 0x7fa2e403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.986+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.986+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5572efc4f5d0 0x5572efc51a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.986+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc521e0 con 0x5572efc4f5d0 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.986+0000 7fa41d238640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5572efc4f5d0 0x5572efc51a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.986+0000 7fa41c236640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2e403c780 0x7fa2e403ec40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa410054fd0 tx=0x7fa410051000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.986+0000 7fa41d238640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5572efc4f5d0 0x5572efc51a90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.986+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.986+0000 7fa41ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.986+0000 7fa41ef46800 20 realm 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.986+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.986+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc525f0 con 0x5572efc4f5d0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.986+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41ef46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc52ec0 con 0x5572efc4f5d0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x5572efc4f5d0 2024-09-10T05:11:48.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41ef46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5572efc53d90 0x5572efc56180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc568e0 con 0x5572efc53d90 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.987+0000 7fa41ca37640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5572efc53d90 0x5572efc56180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.988+0000 7fa41ca37640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5572efc53d90 0x5572efc56180 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.988+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.988+0000 7fa41ef46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.988+0000 7fa41ef46800 20 searching for the correct realm 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.988+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5572efc58990 0x5572efc5ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.988+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5b520 con 0x5572efc58990 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.988+0000 7fa41c236640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5572efc58990 0x5572efc5ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.988+0000 7fa41c236640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5572efc58990 0x5572efc5ae50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:48.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.989+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.989+0000 7fa41c236640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa410077040 0x7fa410084920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.989+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5b520 con 0x7fa410077040 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.989+0000 7fa41d238640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa410077040 0x7fa410084920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.989+0000 7fa41d238640 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa410077040 0x7fa410084920 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.989+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.989+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x5572efc53d90 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.989+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.990+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x5572efc4f5d0 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.990+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.990+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x5572efc4f5d0 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.990+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.990+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x5572efc53d90 2024-09-10T05:11:49.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.990+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.990+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x5572efc53d90 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.991+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.991+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x7fa410077040 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.991+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.991+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x5572efc58990 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.991+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.991+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x5572efc4f5d0 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.991+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.991+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x5572efc53d90 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.992+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.992+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x5572efc4f5d0 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.992+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.992+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x7fa410077040 2024-09-10T05:11:49.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.992+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.992+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5572efc53260 con 0x5572efc58990 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.992+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.992+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc58990 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.992+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.992+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc53d90 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.993+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.993+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc58990 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.993+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.993+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc58990 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.993+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.993+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc4f5d0 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.993+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.993+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc4f5d0 2024-09-10T05:11:49.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.994+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.994+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc53d90 2024-09-10T05:11:49.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.994+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.994+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc58990 2024-09-10T05:11:49.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.994+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.994+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x7fa410077040 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.994+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.994+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc4f5d0 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.995+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.995+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc53d90 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.995+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.995+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc58990 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.995+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.995+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc53d90 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.995+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.995+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x7fa410077040 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.996+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.996+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc58990 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.996+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.996+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc53d90 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.996+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.996+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x5572efc4f5d0 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.996+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.996+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fa410091040 con 0x7fa410077040 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:49.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc57290 con 0x5572efc4f5d0 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc57290 con 0x5572efc4f5d0 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc57260 con 0x7fa410077040 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:49.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 zone default found 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 4 Realm: () 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 zonegroup default 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.997+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc57680 con 0x5572efc53d90 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc57c20 con 0x5572efc58990 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5d390 con 0x5572efc58990 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41ef46800 20 started sync module instance, tier type = 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41ef46800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.998+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5c830 con 0x7fa410077040 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.999+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.999+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93952137350448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5c830 con 0x7fa410077040 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:48.999+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5dd50 con 0x5572efc4f5d0 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.000+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93952137350448] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.001+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.001+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93952137353856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5c830 con 0x5572efc4f5d0 2024-09-10T05:11:49.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.001+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5e7a0 con 0x5572efc58990 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.002+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.002+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93952137355952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5f070 con 0x5572efc58990 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.002+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5faf0 con 0x7fa410077040 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.002+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93952137353856] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.003+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93952137355952] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.003+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.003+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93952137358272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5c380 con 0x7fa410077040 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.003+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc60390 con 0x5572efc4f5d0 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.004+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93952137358272] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.004+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.004+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93952137360864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc60340 con 0x5572efc4f5d0 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.004+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc60dd0 con 0x5572efc53d90 2024-09-10T05:11:49.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.005+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93952137360864] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.005+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.005+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93952137363088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc602b0 con 0x5572efc53d90 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.005+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc61b20 con 0x5572efc53d90 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.006+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93952137363088] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.006+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.006+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93952137368512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc62370 con 0x5572efc53d90 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.006+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc62d30 con 0x5572efc53d90 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.007+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.007+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93952137368512] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.007+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93952137374304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc61fa0 con 0x5572efc53d90 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.007+0000 7fa41ef46800 20 add_watcher() i=0 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.007+0000 7fa41ef46800 20 add_watcher() i=1 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.007+0000 7fa41ef46800 20 add_watcher() i=2 2024-09-10T05:11:49.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.007+0000 7fa41ef46800 20 add_watcher() i=3 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.007+0000 7fa41ef46800 20 add_watcher() i=4 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.007+0000 7fa41ef46800 20 add_watcher() i=5 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.007+0000 7fa41ef46800 20 add_watcher() i=6 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.008+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93952137374304] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.008+0000 7fa41ef46800 20 add_watcher() i=7 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.008+0000 7fa41ef46800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.008+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc664d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.008+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.008+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93952137375360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc63a20 con 0x5572efc4f5d0 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.009+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93952137375360] v35'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.009+0000 7fa2d37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa41ef46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:49.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa41ef46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa41ef46800 5 note: GC not initialized 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa2d27dc640 20 reqs_thread_entry: start 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa41ef46800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa41ef46800 20 Filter name: none 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa243fff640 20 reqs_thread_entry: start 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc990e0 con 0x5572efc4f5d0 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa41ef46800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa41ef46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.010+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc999a0 con 0x5572efc4f5d0 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.011+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.011+0000 7fa41ef46800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:49.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.011+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5572efc9a9b0 con 0x7fa410077040 2024-09-10T05:11:49.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.011+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.012+0000 7fa2d37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:49.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.012+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93952137375360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc97000 con 0x5572efc4f5d0 2024-09-10T05:11:49.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.013+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93952137375360] v35'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.013+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93952137350448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc97000 con 0x7fa410077040 2024-09-10T05:11:49.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.014+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93952137350448] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.014+0000 7fa41ef46800 20 remove_watcher() i=0 2024-09-10T05:11:49.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.014+0000 7fa41ef46800 2 removed watcher, disabling cache 2024-09-10T05:11:49.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.014+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93952137353856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc97000 con 0x5572efc4f5d0 2024-09-10T05:11:49.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.015+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93952137353856] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.015+0000 7fa41ef46800 20 remove_watcher() i=1 2024-09-10T05:11:49.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.015+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93952137355952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc97000 con 0x5572efc58990 2024-09-10T05:11:49.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.016+0000 7fa41c236640 1 -- 172.21.15.192:0/3976517077 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93952137355952] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa410082070 con 0x5572efc58990 2024-09-10T05:11:49.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.016+0000 7fa41ef46800 20 remove_watcher() i=2 2024-09-10T05:11:49.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.016+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93952137358272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5da80 con 0x7fa410077040 2024-09-10T05:11:49.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.017+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93952137358272] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x7fa410077040 2024-09-10T05:11:49.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.017+0000 7fa41ef46800 20 remove_watcher() i=3 2024-09-10T05:11:49.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.017+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93952137360864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5da80 con 0x5572efc4f5d0 2024-09-10T05:11:49.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.018+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93952137360864] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa41400a4d0 con 0x5572efc4f5d0 2024-09-10T05:11:49.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.018+0000 7fa41ef46800 20 remove_watcher() i=4 2024-09-10T05:11:49.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.018+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93952137363088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5da80 con 0x5572efc53d90 2024-09-10T05:11:49.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.019+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93952137363088] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.019+0000 7fa41ef46800 20 remove_watcher() i=5 2024-09-10T05:11:49.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.019+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93952137368512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc5fe90 con 0x5572efc53d90 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.020+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93952137368512] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.020+0000 7fa41ef46800 20 remove_watcher() i=6 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.020+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93952137374304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5572efc613c0 con 0x5572efc53d90 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ca37640 1 -- 172.21.15.192:0/3976517077 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93952137374304] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40c03e070 con 0x5572efc53d90 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 20 remove_watcher() i=7 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5572efc53d90 msgr2=0x5572efc56180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5572efc53d90 0x5572efc56180 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5572efc4f5d0 msgr2=0x5572efc51a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5572efc4f5d0 0x5572efc51a90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa410077040 msgr2=0x7fa410084920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa410077040 0x7fa410084920 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5572efc58990 msgr2=0x5572efc5ae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5572efc58990 0x5572efc5ae50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2e403c780 msgr2=0x7fa2e403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2e403c780 0x7fa2e403ec40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa410054fd0 tx=0x7fa410051000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 msgr2=0x5572efc44190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3976517077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc3cd10 0x5572efc44190 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00ed50 tx=0x7fa40c059000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41d238640 1 -- 172.21.15.192:0/3976517077 reap_dead start 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 shutdown_connections 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 >> 172.21.15.192:0/3976517077 conn(0x5572efc39110 msgr2=0x5572efc37320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 shutdown_connections 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3976517077 wait complete. 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3800763950 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2f403c780 msgr2=0x7fa2f403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3800763950 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2f403c780 0x7fa2f403ec40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5572efc1eba0 tx=0x7fa410005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3800763950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc303f0 msgr2=0x5572efc30810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3800763950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc303f0 0x5572efc30810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa40c018520 tx=0x7fa40c00e940 comp rx=0 tx=0).stop 2024-09-10T05:11:49.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3800763950 shutdown_connections 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3800763950 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2f403c780 0x7fa2f403ec40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 --2- 172.21.15.192:0/3800763950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efc303f0 0x5572efc30810 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3800763950 >> 172.21.15.192:0/3800763950 conn(0x5572efc247a0 msgr2=0x5572efc24b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.021+0000 7fa41ef46800 1 -- 172.21.15.192:0/3800763950 shutdown_connections 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 -- 172.21.15.192:0/3800763950 wait complete. 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5572efc1bbd0 msgr2=0x5572efc1e070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5572efc1bbd0 0x5572efc1e070 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5572efb1d200 msgr2=0x5572efc197f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5572efb1d200 0x5572efc197f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5572efc1fc60 msgr2=0x5572efc22050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5572efc1fc60 0x5572efc22050 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa30403c730 msgr2=0x7fa30403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa30403c730 0x7fa30403ebf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa410056000 tx=0x7fa410050000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 msgr2=0x5572efc121a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 --2- 172.21.15.192:0/961600225 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572efb19690 0x5572efc121a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5572efb18950 tx=0x7fa40c000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41d238640 1 -- 172.21.15.192:0/961600225 reap_dead start 2024-09-10T05:11:49.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 shutdown_connections 2024-09-10T05:11:49.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 >> 172.21.15.192:0/961600225 conn(0x5572efb131f0 msgr2=0x5572efc03b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 shutdown_connections 2024-09-10T05:11:49.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.022+0000 7fa41ef46800 1 -- 172.21.15.192:0/961600225 wait complete. 2024-09-10T05:11:49.033 INFO:teuthology.orchestra.run.smithi192.stdout:[] 2024-09-10T05:11:49.033 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T05:11:49.051 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:11:49.051 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-10T05:11:49.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-10T05:11:49.051 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-10T05:11:49.096 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:49.096 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:49.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.096+0000 7f62ecc20800 1 Processor -- start 2024-09-10T05:11:49.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.096+0000 7f62ecc20800 1 -- start start 2024-09-10T05:11:49.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.096+0000 7f62ecc20800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x560e63a2c4a0 0x560e63a2c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.096+0000 7f62ecc20800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e638d7e40 con 0x560e63a2cde0 2024-09-10T05:11:49.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.096+0000 7f62ecc20800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x560e638a2680 con 0x560e63a2c4a0 2024-09-10T05:11:49.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.096+0000 7f62ea70a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x560e63a2c4a0 0x560e63a2c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.096+0000 7f62e9f09640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x560e63a2cde0 0x560e63a2d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36364/0 (socket says 172.21.15.192:36364) 2024-09-10T05:11:49.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.096+0000 7f62e9f09640 1 -- 172.21.15.192:0/3487293791 learned_addr learned my addr 172.21.15.192:0/3487293791 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:49.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.096+0000 7f62ea70a640 1 -- 172.21.15.192:0/3487293791 >> v1:172.21.15.139:6789/0 conn(0x560e63a2cde0 legacy=0x560e63a2d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.096+0000 7f62e9708640 1 -- 172.21.15.192:0/3487293791 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615568960 0 0) 0x560e638d7e40 con 0x560e63a2cde0 2024-09-10T05:11:49.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.096+0000 7f62ea70a640 1 -- 172.21.15.192:0/3487293791 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e638be6b0 con 0x560e63a2c4a0 2024-09-10T05:11:49.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.098+0000 7f62ea70a640 1 --2- 172.21.15.192:0/3487293791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63a2c8a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f62e4005fd0 tx=0x7f62e4045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36eebf0a8cc6542e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.098+0000 7f62e9708640 1 -- 172.21.15.192:0/3487293791 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e4058530 con 0x560e63a2c4a0 2024-09-10T05:11:49.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.098+0000 7f62e9708640 1 -- 172.21.15.192:0/3487293791 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e40586d0 con 0x560e63a2c4a0 2024-09-10T05:11:49.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.098+0000 7f62e9708640 1 -- 172.21.15.192:0/3487293791 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e40589d0 con 0x560e63a2c4a0 2024-09-10T05:11:49.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.099+0000 7f62ecc20800 1 -- 172.21.15.192:0/3487293791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 msgr2=0x560e63a2c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.099+0000 7f62ecc20800 1 --2- 172.21.15.192:0/3487293791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63a2c8a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f62e4005fd0 tx=0x7f62e4045c30 comp rx=0 tx=0).stop 2024-09-10T05:11:49.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.099+0000 7f62ecc20800 1 -- 172.21.15.192:0/3487293791 shutdown_connections 2024-09-10T05:11:49.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.099+0000 7f62ecc20800 1 --2- 172.21.15.192:0/3487293791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63a2c8a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.099+0000 7f62ecc20800 1 -- 172.21.15.192:0/3487293791 >> 172.21.15.192:0/3487293791 conn(0x560e63a281b0 msgr2=0x560e63a2a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.099+0000 7f62ecc20800 1 -- 172.21.15.192:0/3487293791 shutdown_connections 2024-09-10T05:11:49.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.099+0000 7f62ecc20800 1 -- 172.21.15.192:0/3487293791 wait complete. 2024-09-10T05:11:49.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.113+0000 7f62ecc20800 1 Processor -- start 2024-09-10T05:11:49.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.113+0000 7f62ecc20800 1 -- start start 2024-09-10T05:11:49.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.113+0000 7f62ecc20800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63b1f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.113+0000 7f62ecc20800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560e638c6dd0 con 0x560e63a2c4a0 2024-09-10T05:11:49.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.114+0000 7f62ea70a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63b1f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.114+0000 7f62ea70a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63b1f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60224/0 (socket says 172.21.15.192:60224) 2024-09-10T05:11:49.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.114+0000 7f62ea70a640 1 -- 172.21.15.192:0/4206532545 learned_addr learned my addr 172.21.15.192:0/4206532545 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.114+0000 7f62ea70a640 1 -- 172.21.15.192:0/4206532545 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e638dfe10 con 0x560e63a2c4a0 2024-09-10T05:11:49.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.114+0000 7f62ea70a640 1 --2- 172.21.15.192:0/4206532545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63b1f6e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f62e4025a60 tx=0x7f62e4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18136db8e6c7125 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.114+0000 7f61d8608640 1 -- 172.21.15.192:0/4206532545 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e4068070 con 0x560e63a2c4a0 2024-09-10T05:11:49.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.114+0000 7f61d8608640 1 -- 172.21.15.192:0/4206532545 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4058880 con 0x560e63a2c4a0 2024-09-10T05:11:49.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.114+0000 7f61d8608640 1 -- 172.21.15.192:0/4206532545 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e4058ba0 con 0x560e63a2c4a0 2024-09-10T05:11:49.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.115+0000 7f62ecc20800 1 -- 172.21.15.192:0/4206532545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 msgr2=0x560e63b1f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.115+0000 7f62ecc20800 1 --2- 172.21.15.192:0/4206532545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63b1f6e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f62e4025a60 tx=0x7f62e4051000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.115+0000 7f62ecc20800 1 -- 172.21.15.192:0/4206532545 shutdown_connections 2024-09-10T05:11:49.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.115+0000 7f62ecc20800 1 --2- 172.21.15.192:0/4206532545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63b1f6e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.115+0000 7f62ecc20800 1 -- 172.21.15.192:0/4206532545 >> 172.21.15.192:0/4206532545 conn(0x560e63a281b0 msgr2=0x560e63b1b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.115+0000 7f62ecc20800 1 -- 172.21.15.192:0/4206532545 shutdown_connections 2024-09-10T05:11:49.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.115+0000 7f62ecc20800 1 -- 172.21.15.192:0/4206532545 wait complete. 2024-09-10T05:11:49.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.116+0000 7f62ecc20800 1 Processor -- start 2024-09-10T05:11:49.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.116+0000 7f62ecc20800 1 -- start start 2024-09-10T05:11:49.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.116+0000 7f62ecc20800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63b26f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.116+0000 7f62ecc20800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560e63a2dd00 con 0x560e63a2c4a0 2024-09-10T05:11:49.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.116+0000 7f62ea70a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63b26f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.116+0000 7f62ea70a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63b26f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60232/0 (socket says 172.21.15.192:60232) 2024-09-10T05:11:49.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.116+0000 7f62ea70a640 1 -- 172.21.15.192:0/1930443818 learned_addr learned my addr 172.21.15.192:0/1930443818 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.116+0000 7f62ea70a640 1 -- 172.21.15.192:0/1930443818 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e63b274b0 con 0x560e63a2c4a0 2024-09-10T05:11:49.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.117+0000 7f62ea70a640 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63b26f50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f62e4025a60 tx=0x7f62e4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.117+0000 7f61d6e05640 1 -- 172.21.15.192:0/1930443818 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e4068040 con 0x560e63a2c4a0 2024-09-10T05:11:49.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.117+0000 7f61d6e05640 1 -- 172.21.15.192:0/1930443818 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4071070 con 0x560e63a2c4a0 2024-09-10T05:11:49.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.117+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e63b27740 con 0x560e63a2c4a0 2024-09-10T05:11:49.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.117+0000 7f61d6e05640 1 -- 172.21.15.192:0/1930443818 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e40637b0 con 0x560e63a2c4a0 2024-09-10T05:11:49.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.117+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e63b280c0 con 0x560e63a2c4a0 2024-09-10T05:11:49.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.118+0000 7f61d6e05640 1 -- 172.21.15.192:0/1930443818 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f62e4063950 con 0x560e63a2c4a0 2024-09-10T05:11:49.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.118+0000 7f61d6e05640 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61d003c7d0 0x7f61d003ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.118+0000 7f61d6e05640 1 -- 172.21.15.192:0/1930443818 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f62e4097450 con 0x560e63a2c4a0 2024-09-10T05:11:49.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.118+0000 7f62e9f09640 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61d003c7d0 0x7f61d003ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.118+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560e63a2cde0 0x560e63b2e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.118+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b28d10 con 0x560e63a2cde0 2024-09-10T05:11:49.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.118+0000 7f62eaf0b640 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560e63a2cde0 0x560e63b2e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.118+0000 7f62e9f09640 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61d003c7d0 0x7f61d003ec90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f62d4000c00 tx=0x7f62d40013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.118+0000 7f62eaf0b640 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560e63a2cde0 0x560e63b2e5a0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.119+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1930443818 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62dc0083e0 con 0x560e63a2cde0 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.119+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b285a0 con 0x560e63a2cde0 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.119+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1930443818 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f62dc0083e0 con 0x560e63a2cde0 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.119+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560e63b30a50 0x560e63b32e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.119+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b33510 con 0x560e63b30a50 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.119+0000 7f62ea70a640 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560e63b30a50 0x560e63b32e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.119+0000 7f62ea70a640 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560e63b30a50 0x560e63b32e40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.120+0000 7f62ea70a640 1 -- 172.21.15.192:0/1930443818 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f62e40769d0 con 0x560e63b30a50 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.120+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b2f8f0 con 0x560e63a2cde0 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.120+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1930443818 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62dc0083e0 con 0x560e63a2cde0 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.120+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560e63b34950 0x560e63b36d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.120+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b374d0 con 0x560e63b34950 2024-09-10T05:11:49.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.120+0000 7f62e9f09640 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560e63b34950 0x560e63b36d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.120+0000 7f62e9f09640 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560e63b34950 0x560e63b36d40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.121+0000 7f62e9f09640 1 -- 172.21.15.192:0/1930443818 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f62d400f670 con 0x560e63b34950 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.121+0000 7f62ecc20800 1 Processor -- start 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.121+0000 7f62ecc20800 1 -- start start 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.121+0000 7f62ecc20800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b450f0 0x560e63b45510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.121+0000 7f62ecc20800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560e63924a00 con 0x560e63b450f0 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.121+0000 7f62ea70a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b450f0 0x560e63b45510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.121+0000 7f62ea70a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b450f0 0x560e63b45510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60238/0 (socket says 172.21.15.192:60238) 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.121+0000 7f62ea70a640 1 -- 172.21.15.192:0/2785197566 learned_addr learned my addr 172.21.15.192:0/2785197566 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.122+0000 7f62ea70a640 1 -- 172.21.15.192:0/2785197566 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e63b45b50 con 0x560e63b450f0 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.122+0000 7f62ea70a640 1 --2- 172.21.15.192:0/2785197566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b450f0 0x560e63b45510 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f62e4095860 tx=0x7f62e406e390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.122+0000 7f61cffff640 1 -- 172.21.15.192:0/2785197566 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e4094150 con 0x560e63b450f0 2024-09-10T05:11:49.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.122+0000 7f61cffff640 1 -- 172.21.15.192:0/2785197566 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4086070 con 0x560e63b450f0 2024-09-10T05:11:49.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.122+0000 7f62ecc20800 1 -- 172.21.15.192:0/2785197566 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e63b46380 con 0x560e63b450f0 2024-09-10T05:11:49.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.122+0000 7f61cffff640 1 -- 172.21.15.192:0/2785197566 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e406b760 con 0x560e63b450f0 2024-09-10T05:11:49.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.122+0000 7f62ecc20800 1 -- 172.21.15.192:0/2785197566 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e63b46920 con 0x560e63b450f0 2024-09-10T05:11:49.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.123+0000 7f61cffff640 1 -- 172.21.15.192:0/2785197566 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f62e4088030 con 0x560e63b450f0 2024-09-10T05:11:49.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.123+0000 7f61cffff640 1 --2- 172.21.15.192:0/2785197566 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61c403c780 0x7f61c403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.123+0000 7f61cffff640 1 -- 172.21.15.192:0/2785197566 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f62e408bc50 con 0x560e63b450f0 2024-09-10T05:11:49.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.123+0000 7f62e9f09640 1 --2- 172.21.15.192:0/2785197566 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61c403c780 0x7f61c403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.123+0000 7f62ecc20800 1 Processor -- start 2024-09-10T05:11:49.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.123+0000 7f62ecc20800 1 -- start start 2024-09-10T05:11:49.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.123+0000 7f62e9f09640 1 --2- 172.21.15.192:0/2785197566 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61c403c780 0x7f61c403ec40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x560e63b378d0 tx=0x7f62d4006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.123+0000 7f62ecc20800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 0x560e63b51db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.123+0000 7f62ecc20800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560e63b1fe70 con 0x560e63b519d0 2024-09-10T05:11:49.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.124+0000 7f62ea70a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 0x560e63b51db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.124+0000 7f62ea70a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 0x560e63b51db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60240/0 (socket says 172.21.15.192:60240) 2024-09-10T05:11:49.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.124+0000 7f62ea70a640 1 -- 172.21.15.192:0/1933105704 learned_addr learned my addr 172.21.15.192:0/1933105704 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.124+0000 7f62ea70a640 1 -- 172.21.15.192:0/1933105704 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e63b523a0 con 0x560e63b519d0 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.124+0000 7f62ea70a640 1 --2- 172.21.15.192:0/1933105704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 0x560e63b51db0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f62e408e7e0 tx=0x7f62e404fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41add318ef7aedd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.124+0000 7f61cdffb640 1 -- 172.21.15.192:0/1933105704 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e40a5020 con 0x560e63b519d0 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.124+0000 7f61cdffb640 1 -- 172.21.15.192:0/1933105704 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4075cc0 con 0x560e63b519d0 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.124+0000 7f61cdffb640 1 -- 172.21.15.192:0/1933105704 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e4065070 con 0x560e63b519d0 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.124+0000 7f62ecc20800 1 -- 172.21.15.192:0/1933105704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 msgr2=0x560e63b51db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.124+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1933105704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 0x560e63b51db0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f62e408e7e0 tx=0x7f62e404fea0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.125+0000 7f62ecc20800 1 -- 172.21.15.192:0/1933105704 shutdown_connections 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.125+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1933105704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 0x560e63b51db0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.125+0000 7f62ecc20800 1 -- 172.21.15.192:0/1933105704 >> 172.21.15.192:0/1933105704 conn(0x560e63b4ddd0 msgr2=0x560e63b4c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.125+0000 7f62ecc20800 1 -- 172.21.15.192:0/1933105704 shutdown_connections 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.125+0000 7f62ecc20800 1 -- 172.21.15.192:0/1933105704 wait complete. 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.125+0000 7f62ecc20800 1 Processor -- start 2024-09-10T05:11:49.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.125+0000 7f62ecc20800 1 -- start start 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.125+0000 7f62ecc20800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 0x560e63b58d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.125+0000 7f62ecc20800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560e63b52830 con 0x560e63b519d0 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.125+0000 7f62ea70a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 0x560e63b58d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.125+0000 7f62ea70a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 0x560e63b58d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60242/0 (socket says 172.21.15.192:60242) 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.125+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 learned_addr learned my addr 172.21.15.192:0/1138058790 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.126+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e63b592d0 con 0x560e63b519d0 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.126+0000 7f62ea70a640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 0x560e63b58d70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f62e408e7e0 tx=0x7f62e4077f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.126+0000 7f61bbfff640 1 -- 172.21.15.192:0/1138058790 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e40b9070 con 0x560e63b519d0 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.126+0000 7f61bbfff640 1 -- 172.21.15.192:0/1138058790 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e40757f0 con 0x560e63b519d0 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.126+0000 7f61bbfff640 1 -- 172.21.15.192:0/1138058790 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62e4065070 con 0x560e63b519d0 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.126+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e63b592d0 con 0x560e63b519d0 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.126+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e63b592d0 con 0x560e63b519d0 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.127+0000 7f61bbfff640 1 -- 172.21.15.192:0/1138058790 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f62e40bc070 con 0x560e63b519d0 2024-09-10T05:11:49.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.127+0000 7f61bbfff640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61b403c780 0x7f61b403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.127+0000 7f61bbfff640 1 -- 172.21.15.192:0/1138058790 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f62e40b1050 con 0x560e63b519d0 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.127+0000 7f62e9f09640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61b403c780 0x7f61b403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.127+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.127+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560e63b642f0 0x560e63b667b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.127+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b66f00 con 0x560e63b642f0 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.127+0000 7f62eaf0b640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560e63b642f0 0x560e63b667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62e9f09640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61b403c780 0x7f61b403ec40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f62d400ffd0 tx=0x7f62d4023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62eaf0b640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560e63b642f0 0x560e63b667b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62dc0083e0 con 0x560e63b642f0 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62ecc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62ecc20800 20 realm 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b67310 con 0x560e63b642f0 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62dc0083e0 con 0x560e63b642f0 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62ecc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62ecc20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b67be0 con 0x560e63b642f0 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62dc0083e0 con 0x560e63b642f0 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62ecc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.128+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b67f80 con 0x560e63b642f0 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f62dc0083e0 con 0x560e63b642f0 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62ecc20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560e63b686d0 0x560e63b6aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b6b250 con 0x560e63b686d0 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62ea70a640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560e63b686d0 0x560e63b6aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62ea70a640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560e63b686d0 0x560e63b6aac0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62ecc20800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62ecc20800 20 searching for the correct realm 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560e63b6d340 0x560e63b6f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560e63b6fed0 con 0x560e63b6d340 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.129+0000 7f62e9f09640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560e63b6d340 0x560e63b6f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.130+0000 7f62e9f09640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560e63b6d340 0x560e63b6f800 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.130+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.130+0000 7f62e9f09640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f62d402e910 0x7f62d403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.130+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560e63b6fed0 con 0x7f62d402e910 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.130+0000 7f62eaf0b640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f62d402e910 0x7f62d403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.130+0000 7f62eaf0b640 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f62d402e910 0x7f62d403a3c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.131+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f62dc0083e0 con 0x7f62d402e910 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.131+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560e63b67be0 con 0x560e63b686d0 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.131+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.131+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560e63b67be0 con 0x560e63b642f0 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.131+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc0083e0 con 0x560e63b642f0 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.131+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560e63b67be0 con 0x560e63b642f0 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.132+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.132+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560e63b67be0 con 0x560e63b686d0 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.132+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.132+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560e63b67be0 con 0x560e63b686d0 2024-09-10T05:11:49.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.132+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.132+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x7f62d402e910 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.132+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.132+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b6d340 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.133+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.133+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b642f0 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.133+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.133+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b686d0 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.133+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.133+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b642f0 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.133+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.133+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x7f62d402e910 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.133+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.133+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b6d340 2024-09-10T05:11:49.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.134+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.134+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b6d340 2024-09-10T05:11:49.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.134+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.134+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b686d0 2024-09-10T05:11:49.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.134+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.134+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b6d340 2024-09-10T05:11:49.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.134+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.134+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b6d340 2024-09-10T05:11:49.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.135+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.135+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b642f0 2024-09-10T05:11:49.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.135+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.135+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b642f0 2024-09-10T05:11:49.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.135+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.135+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b686d0 2024-09-10T05:11:49.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.135+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.135+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b6d340 2024-09-10T05:11:49.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.136+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.136+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x7f62d402e910 2024-09-10T05:11:49.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.136+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.136+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b642f0 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.136+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.136+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b686d0 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.136+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.136+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b6d340 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.137+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.137+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b686d0 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.137+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.137+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x7f62d402e910 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.137+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.137+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b6d340 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.137+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.137+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b686d0 2024-09-10T05:11:49.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x560e63b642f0 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f62e40cb040 con 0x7f62d402e910 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ecc20800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ecc20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ecc20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ecc20800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ecc20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ecc20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b6bc00 con 0x560e63b642f0 2024-09-10T05:11:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ecc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.138+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b6bc00 con 0x560e63b642f0 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b6bbd0 con 0x7f62d402e910 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 20 zone default found 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 4 Realm: () 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 20 zonegroup default 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b6bff0 con 0x560e63b686d0 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.139+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b6bb30 con 0x560e63b6d340 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.140+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.140+0000 7f62ecc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.140+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.140+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b71d40 con 0x560e63b6d340 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.140+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.140+0000 7f62ecc20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.140+0000 7f62ecc20800 20 started sync module instance, tier type = 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.140+0000 7f62ecc20800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.140+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b711e0 con 0x7f62d402e910 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.141+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.141+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94619802474240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b711e0 con 0x7f62d402e910 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.141+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b727d0 con 0x560e63b642f0 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.142+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.142+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94619802477216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b727d0 con 0x560e63b642f0 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.142+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b737d0 con 0x560e63b6d340 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.143+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94619802477216] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.144+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94619802474240] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.144+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.144+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94619802471728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b72bc0 con 0x560e63b6d340 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.144+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b741e0 con 0x7f62d402e910 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.145+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.145+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94619802471728] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.145+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94619802484288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b748b0 con 0x7f62d402e910 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.145+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b732e0 con 0x560e63b642f0 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.146+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94619802484288] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.146+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.146+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94619802485504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b732e0 con 0x560e63b642f0 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.146+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b75820 con 0x560e63b686d0 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.147+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94619802485504] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.147+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.147+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94619802488480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b75c10 con 0x560e63b686d0 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.147+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b765d0 con 0x560e63b686d0 2024-09-10T05:11:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.148+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94619802488480] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.148+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.148+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94619802489536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b76e70 con 0x560e63b686d0 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.148+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b77740 con 0x560e63b686d0 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.149+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94619802489536] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.149+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.149+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94619802495424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b77940 con 0x560e63b686d0 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.149+0000 7f62ecc20800 20 add_watcher() i=0 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.149+0000 7f62ecc20800 20 add_watcher() i=1 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.149+0000 7f62ecc20800 20 add_watcher() i=2 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.149+0000 7f62ecc20800 20 add_watcher() i=3 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.149+0000 7f62ecc20800 20 add_watcher() i=4 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.149+0000 7f62ecc20800 20 add_watcher() i=5 2024-09-10T05:11:49.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.149+0000 7f62ecc20800 20 add_watcher() i=6 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.150+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94619802495424] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.150+0000 7f62ecc20800 20 add_watcher() i=7 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.150+0000 7f62ecc20800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.150+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63b7ad80 con 0x560e63b642f0 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.150+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.150+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94619802499232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b78170 con 0x560e63b642f0 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.151+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94619802499232] v35'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.151+0000 7f61a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.151+0000 7f62ecc20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.151+0000 7f62ecc20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.151+0000 7f62ecc20800 5 note: GC not initialized 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.152+0000 7f611b7fe640 20 reqs_thread_entry: start 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.152+0000 7f62ecc20800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:49.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.152+0000 7f62ecc20800 20 Filter name: none 2024-09-10T05:11:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.152+0000 7f61197fa640 20 reqs_thread_entry: start 2024-09-10T05:11:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.152+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.152+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63bad6d0 con 0x560e63b642f0 2024-09-10T05:11:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.152+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.152+0000 7f62ecc20800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.152+0000 7f62ecc20800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.152+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63badf90 con 0x560e63b642f0 2024-09-10T05:11:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.152+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.153+0000 7f62ecc20800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.153+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560e63baefa0 con 0x7f62d402e910 2024-09-10T05:11:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.153+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.154+0000 7f61a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.154+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94619802499232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63bab5d0 con 0x560e63b642f0 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.155+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94619802499232] v35'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.155+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94619802474240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63bab5d0 con 0x7f62d402e910 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.156+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94619802474240] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.156+0000 7f62ecc20800 20 remove_watcher() i=0 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.156+0000 7f62ecc20800 2 removed watcher, disabling cache 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.156+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94619802477216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63bab5d0 con 0x560e63b642f0 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.157+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94619802477216] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.157+0000 7f62ecc20800 20 remove_watcher() i=1 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.157+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94619802471728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63bab5d0 con 0x560e63b6d340 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.158+0000 7f62e9f09640 1 -- 172.21.15.192:0/1138058790 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94619802471728] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4037040 con 0x560e63b6d340 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.158+0000 7f62ecc20800 20 remove_watcher() i=2 2024-09-10T05:11:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.158+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94619802484288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b70d30 con 0x7f62d402e910 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.159+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94619802484288] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x7f62d402e910 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.159+0000 7f62ecc20800 20 remove_watcher() i=3 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.159+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94619802485504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b70d30 con 0x560e63b642f0 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.160+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94619802485504] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc026040 con 0x560e63b642f0 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.160+0000 7f62ecc20800 20 remove_watcher() i=4 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.160+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94619802488480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b70d30 con 0x560e63b686d0 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.161+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94619802488480] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.161+0000 7f62ecc20800 20 remove_watcher() i=5 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.161+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94619802489536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b74ea0 con 0x560e63b686d0 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.162+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94619802489536] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.162+0000 7f62ecc20800 20 remove_watcher() i=6 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.162+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94619802495424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560e63b70d30 con 0x560e63b686d0 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ea70a640 1 -- 172.21.15.192:0/1138058790 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94619802495424] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62e40bb030 con 0x560e63b686d0 2024-09-10T05:11:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 20 remove_watcher() i=7 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560e63b686d0 msgr2=0x560e63b6aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560e63b686d0 0x560e63b6aac0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560e63b642f0 msgr2=0x560e63b667b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560e63b642f0 0x560e63b667b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f62d402e910 msgr2=0x7f62d403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f62d402e910 0x7f62d403a3c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560e63b6d340 msgr2=0x560e63b6f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560e63b6d340 0x560e63b6f800 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61b403c780 msgr2=0x7f61b403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61b403c780 0x7f61b403ec40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f62d400ffd0 tx=0x7f62d4023040 comp rx=0 tx=0).stop 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 msgr2=0x560e63b58d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1138058790 reap_dead start 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 0x560e63b58d70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f62e408e7e0 tx=0x7f62e4077f90 comp rx=0 tx=0).stop 2024-09-10T05:11:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 shutdown_connections 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1138058790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b519d0 0x560e63b58d70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 >> 172.21.15.192:0/1138058790 conn(0x560e63b4ddd0 msgr2=0x560e63b4bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 shutdown_connections 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/1138058790 wait complete. 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/2785197566 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61c403c780 msgr2=0x7f61c403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 --2- 172.21.15.192:0/2785197566 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61c403c780 0x7f61c403ec40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x560e63b378d0 tx=0x7f62d4006000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/2785197566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b450f0 msgr2=0x560e63b45510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 --2- 172.21.15.192:0/2785197566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b450f0 0x560e63b45510 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f62e4095860 tx=0x7f62e406e390 comp rx=0 tx=0).stop 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/2785197566 shutdown_connections 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 --2- 172.21.15.192:0/2785197566 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61c403c780 0x7f61c403ec40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 --2- 172.21.15.192:0/2785197566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63b450f0 0x560e63b45510 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.163+0000 7f62ecc20800 1 -- 172.21.15.192:0/2785197566 >> 172.21.15.192:0/2785197566 conn(0x560e63b394a0 msgr2=0x560e63b39880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 -- 172.21.15.192:0/2785197566 shutdown_connections 2024-09-10T05:11:49.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 -- 172.21.15.192:0/2785197566 wait complete. 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560e63b30a50 msgr2=0x560e63b32e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560e63b30a50 0x560e63b32e40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560e63a2cde0 msgr2=0x560e63b2e5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560e63a2cde0 0x560e63b2e5a0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560e63b34950 msgr2=0x560e63b36d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560e63b34950 0x560e63b36d40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61d003c7d0 msgr2=0x7f61d003ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f61d003c7d0 0x7f61d003ec90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f62d4000c00 tx=0x7f62d40013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 msgr2=0x560e63b26f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 --2- 172.21.15.192:0/1930443818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e63a2c4a0 0x560e63b26f50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f62e4025a60 tx=0x7f62e4003330 comp rx=0 tx=0).stop 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62eaf0b640 1 -- 172.21.15.192:0/1930443818 reap_dead start 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 shutdown_connections 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 >> 172.21.15.192:0/1930443818 conn(0x560e63a281b0 msgr2=0x560e63b208a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 shutdown_connections 2024-09-10T05:11:49.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.164+0000 7f62ecc20800 1 -- 172.21.15.192:0/1930443818 wait complete. 2024-09-10T05:11:49.174 INFO:teuthology.orchestra.run.smithi192.stdout:["myfoo"] 2024-09-10T05:11:49.175 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-10T05:11:49.178 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:11:49.178 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-10T05:11:49.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-10T05:11:49.178 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-10T05:11:49.220 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:49.220 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:49.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.220+0000 7f146492e800 1 Processor -- start 2024-09-10T05:11:49.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.220+0000 7f146492e800 1 -- start start 2024-09-10T05:11:49.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.220+0000 7f146492e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55e6123f51e0 0x55e6123f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.220+0000 7f146492e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e61229ae40 con 0x55e6123f15e0 2024-09-10T05:11:49.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.220+0000 7f146492e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55e612265680 con 0x55e6123f51e0 2024-09-10T05:11:49.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.220+0000 7f145fd63640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55e6123f51e0 0x55e6123f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.220+0000 7f1460564640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55e6123f15e0 0x55e6123f39d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36370/0 (socket says 172.21.15.192:36370) 2024-09-10T05:11:49.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.220+0000 7f1460564640 1 -- 172.21.15.192:0/2075032554 learned_addr learned my addr 172.21.15.192:0/2075032554 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:49.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.221+0000 7f145fd63640 1 -- 172.21.15.192:0/2075032554 >> v1:172.21.15.139:6789/0 conn(0x55e6123f15e0 legacy=0x55e6123f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.221+0000 7f145f562640 1 -- 172.21.15.192:0/2075032554 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041987929 0 0) 0x55e61229ae40 con 0x55e6123f15e0 2024-09-10T05:11:49.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.221+0000 7f145fd63640 1 -- 172.21.15.192:0/2075032554 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6122816b0 con 0x55e6123f51e0 2024-09-10T05:11:49.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.222+0000 7f145fd63640 1 --2- 172.21.15.192:0/2075032554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f51e0 0x55e6123f76a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f145400a470 tx=0x7f1454045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19e77424ed8f8a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.223+0000 7f145f562640 1 -- 172.21.15.192:0/2075032554 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1454053570 con 0x55e6123f51e0 2024-09-10T05:11:49.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.223+0000 7f145f562640 1 -- 172.21.15.192:0/2075032554 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1454058070 con 0x55e6123f51e0 2024-09-10T05:11:49.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.223+0000 7f145f562640 1 -- 172.21.15.192:0/2075032554 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1454053880 con 0x55e6123f51e0 2024-09-10T05:11:49.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.223+0000 7f146492e800 1 -- 172.21.15.192:0/2075032554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f51e0 msgr2=0x55e6123f76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.223+0000 7f146492e800 1 --2- 172.21.15.192:0/2075032554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f51e0 0x55e6123f76a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f145400a470 tx=0x7f1454045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:49.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.223+0000 7f146492e800 1 -- 172.21.15.192:0/2075032554 shutdown_connections 2024-09-10T05:11:49.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.223+0000 7f146492e800 1 --2- 172.21.15.192:0/2075032554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f51e0 0x55e6123f76a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.223+0000 7f146492e800 1 -- 172.21.15.192:0/2075032554 >> 172.21.15.192:0/2075032554 conn(0x55e6123eb1a0 msgr2=0x55e6123ed600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.223+0000 7f146492e800 1 -- 172.21.15.192:0/2075032554 shutdown_connections 2024-09-10T05:11:49.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.223+0000 7f146492e800 1 -- 172.21.15.192:0/2075032554 wait complete. 2024-09-10T05:11:49.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.237+0000 7f146492e800 1 Processor -- start 2024-09-10T05:11:49.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.237+0000 7f146492e800 1 -- start start 2024-09-10T05:11:49.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.237+0000 7f146492e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f15e0 0x55e6124e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.237+0000 7f146492e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e612289dd0 con 0x55e6123f15e0 2024-09-10T05:11:49.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.237+0000 7f1460564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f15e0 0x55e6124e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.237+0000 7f1460564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f15e0 0x55e6124e04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60260/0 (socket says 172.21.15.192:60260) 2024-09-10T05:11:49.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.237+0000 7f1460564640 1 -- 172.21.15.192:0/2188590865 learned_addr learned my addr 172.21.15.192:0/2188590865 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.238+0000 7f1460564640 1 -- 172.21.15.192:0/2188590865 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6122a2e10 con 0x55e6123f15e0 2024-09-10T05:11:49.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.238+0000 7f1460564640 1 --2- 172.21.15.192:0/2188590865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f15e0 0x55e6124e04c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1450001ea0 tx=0x7f145000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4d864a90214eb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.238+0000 7f134e60c640 1 -- 172.21.15.192:0/2188590865 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1450008070 con 0x55e6123f15e0 2024-09-10T05:11:49.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.238+0000 7f134e60c640 1 -- 172.21.15.192:0/2188590865 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145000d500 con 0x55e6123f15e0 2024-09-10T05:11:49.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.238+0000 7f134e60c640 1 -- 172.21.15.192:0/2188590865 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f145000d880 con 0x55e6123f15e0 2024-09-10T05:11:49.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.239+0000 7f146492e800 1 -- 172.21.15.192:0/2188590865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f15e0 msgr2=0x55e6124e04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.239+0000 7f146492e800 1 --2- 172.21.15.192:0/2188590865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f15e0 0x55e6124e04c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1450001ea0 tx=0x7f145000b6a0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.239+0000 7f146492e800 1 -- 172.21.15.192:0/2188590865 shutdown_connections 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.239+0000 7f146492e800 1 --2- 172.21.15.192:0/2188590865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f15e0 0x55e6124e04c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.239+0000 7f146492e800 1 -- 172.21.15.192:0/2188590865 >> 172.21.15.192:0/2188590865 conn(0x55e6123eb1a0 msgr2=0x55e6124dbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.239+0000 7f146492e800 1 -- 172.21.15.192:0/2188590865 shutdown_connections 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.239+0000 7f146492e800 1 -- 172.21.15.192:0/2188590865 wait complete. 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.239+0000 7f146492e800 1 Processor -- start 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.239+0000 7f146492e800 1 -- start start 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.239+0000 7f146492e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f51e0 0x55e6124e8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.239+0000 7f146492e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e6123f8020 con 0x55e6123f51e0 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.240+0000 7f1460564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f51e0 0x55e6124e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.240+0000 7f1460564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f51e0 0x55e6124e8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60272/0 (socket says 172.21.15.192:60272) 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.240+0000 7f1460564640 1 -- 172.21.15.192:0/1945674563 learned_addr learned my addr 172.21.15.192:0/1945674563 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.240+0000 7f1460564640 1 -- 172.21.15.192:0/1945674563 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6124e85a0 con 0x55e6123f51e0 2024-09-10T05:11:49.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.240+0000 7f1460564640 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f51e0 0x55e6124e8040 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f14500012f0 tx=0x7f1450000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.240+0000 7f134ce09640 1 -- 172.21.15.192:0/1945674563 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f145000de50 con 0x55e6123f51e0 2024-09-10T05:11:49.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.240+0000 7f134ce09640 1 -- 172.21.15.192:0/1945674563 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145000f930 con 0x55e6123f51e0 2024-09-10T05:11:49.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.240+0000 7f134ce09640 1 -- 172.21.15.192:0/1945674563 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f145000fc30 con 0x55e6123f51e0 2024-09-10T05:11:49.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.240+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6124e8830 con 0x55e6123f51e0 2024-09-10T05:11:49.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.240+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6124e9230 con 0x55e6123f51e0 2024-09-10T05:11:49.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.241+0000 7f134ce09640 1 -- 172.21.15.192:0/1945674563 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1450017040 con 0x55e6123f51e0 2024-09-10T05:11:49.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.241+0000 7f134ce09640 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f134803c920 0x7f134803ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.241+0000 7f134ce09640 1 -- 172.21.15.192:0/1945674563 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1450015020 con 0x55e6123f51e0 2024-09-10T05:11:49.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.241+0000 7f145fd63640 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f134803c920 0x7f134803ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.242+0000 7f146492e800 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e6124e9d30 0x55e6124ef690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.242+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6124efc10 con 0x55e6124e9d30 2024-09-10T05:11:49.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.242+0000 7f1460d65640 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e6124e9d30 0x55e6124ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.242+0000 7f145fd63640 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f134803c920 0x7f134803ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1454057000 tx=0x7f1454052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.242+0000 7f1460d65640 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e6124e9d30 0x55e6124ef690 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.242+0000 7f1460d65640 1 -- 172.21.15.192:0/1945674563 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e6124e9d30 2024-09-10T05:11:49.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.242+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6124e96e0 con 0x55e6124e9d30 2024-09-10T05:11:49.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.242+0000 7f1460d65640 1 -- 172.21.15.192:0/1945674563 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f145800a4d0 con 0x55e6124e9d30 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.242+0000 7f146492e800 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e6124f1f60 0x55e6124f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.242+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6124f4a20 con 0x55e6124f1f60 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.243+0000 7f1460564640 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e6124f1f60 0x55e6124f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.243+0000 7f1460564640 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e6124f1f60 0x55e6124f4350 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.243+0000 7f1460564640 1 -- 172.21.15.192:0/1945674563 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f145002d070 con 0x55e6124f1f60 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.243+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6124f0e00 con 0x55e6124e9d30 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.243+0000 7f1460d65640 1 -- 172.21.15.192:0/1945674563 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f145800a4d0 con 0x55e6124e9d30 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.244+0000 7f146492e800 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e6124f5e60 0x55e6124f8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.244+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6124f8990 con 0x55e6124f5e60 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.244+0000 7f145fd63640 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e6124f5e60 0x55e6124f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.244+0000 7f145fd63640 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e6124f5e60 0x55e6124f8250 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.244+0000 7f145fd63640 1 -- 172.21.15.192:0/1945674563 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1454051070 con 0x55e6124f5e60 2024-09-10T05:11:49.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.245+0000 7f146492e800 1 Processor -- start 2024-09-10T05:11:49.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.245+0000 7f146492e800 1 -- start start 2024-09-10T05:11:49.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.245+0000 7f146492e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6125065f0 0x55e612506a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.245+0000 7f146492e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e6122e7a00 con 0x55e6125065f0 2024-09-10T05:11:49.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.245+0000 7f1460564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6125065f0 0x55e612506a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.245+0000 7f1460564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6125065f0 0x55e612506a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60276/0 (socket says 172.21.15.192:60276) 2024-09-10T05:11:49.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.245+0000 7f1460564640 1 -- 172.21.15.192:0/3794829369 learned_addr learned my addr 172.21.15.192:0/3794829369 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.246+0000 7f1460564640 1 -- 172.21.15.192:0/3794829369 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e612507050 con 0x55e6125065f0 2024-09-10T05:11:49.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.246+0000 7f1460564640 1 --2- 172.21.15.192:0/3794829369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6125065f0 0x55e612506a10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f145000bd10 tx=0x7f145004be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.246+0000 7f1345ffb640 1 -- 172.21.15.192:0/3794829369 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1450010070 con 0x55e6125065f0 2024-09-10T05:11:49.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.246+0000 7f1345ffb640 1 -- 172.21.15.192:0/3794829369 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1450019470 con 0x55e6125065f0 2024-09-10T05:11:49.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.246+0000 7f146492e800 1 -- 172.21.15.192:0/3794829369 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e612507880 con 0x55e6125065f0 2024-09-10T05:11:49.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.246+0000 7f1345ffb640 1 -- 172.21.15.192:0/3794829369 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1450010210 con 0x55e6125065f0 2024-09-10T05:11:49.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.246+0000 7f146492e800 1 -- 172.21.15.192:0/3794829369 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e612507e20 con 0x55e6125065f0 2024-09-10T05:11:49.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.247+0000 7f1345ffb640 1 -- 172.21.15.192:0/3794829369 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f145004b320 con 0x55e6125065f0 2024-09-10T05:11:49.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.247+0000 7f1345ffb640 1 --2- 172.21.15.192:0/3794829369 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f133803c6e0 0x7f133803eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.247+0000 7f1345ffb640 1 -- 172.21.15.192:0/3794829369 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f145003cc50 con 0x55e6125065f0 2024-09-10T05:11:49.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.247+0000 7f145fd63640 1 --2- 172.21.15.192:0/3794829369 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f133803c6e0 0x7f133803eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.247+0000 7f146492e800 1 Processor -- start 2024-09-10T05:11:49.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.247+0000 7f146492e800 1 -- start start 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.247+0000 7f145fd63640 1 --2- 172.21.15.192:0/3794829369 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f133803c6e0 0x7f133803eba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55e6124f00e0 tx=0x7f1454005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.247+0000 7f146492e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 0x55e6123ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.247+0000 7f146492e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e6124e0d10 con 0x55e6123ef5e0 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.248+0000 7f1460564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 0x55e6123ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.248+0000 7f1460564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 0x55e6123ef9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60286/0 (socket says 172.21.15.192:60286) 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.248+0000 7f1460564640 1 -- 172.21.15.192:0/2103435476 learned_addr learned my addr 172.21.15.192:0/2103435476 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.248+0000 7f1460564640 1 -- 172.21.15.192:0/2103435476 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6123effd0 con 0x55e6123ef5e0 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.248+0000 7f1460564640 1 --2- 172.21.15.192:0/2103435476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 0x55e6123ef9e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f145000e4d0 tx=0x7f145004b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e85bb62a19edc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.248+0000 7f133f7fe640 1 -- 172.21.15.192:0/2103435476 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f145001cd60 con 0x55e6123ef5e0 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.248+0000 7f133f7fe640 1 -- 172.21.15.192:0/2103435476 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1450018c70 con 0x55e6123ef5e0 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.248+0000 7f133f7fe640 1 -- 172.21.15.192:0/2103435476 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f145001c440 con 0x55e6123ef5e0 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f146492e800 1 -- 172.21.15.192:0/2103435476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 msgr2=0x55e6123ef9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f146492e800 1 --2- 172.21.15.192:0/2103435476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 0x55e6123ef9e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f145000e4d0 tx=0x7f145004b790 comp rx=0 tx=0).stop 2024-09-10T05:11:49.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f146492e800 1 -- 172.21.15.192:0/2103435476 shutdown_connections 2024-09-10T05:11:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f146492e800 1 --2- 172.21.15.192:0/2103435476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 0x55e6123ef9e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f146492e800 1 -- 172.21.15.192:0/2103435476 >> 172.21.15.192:0/2103435476 conn(0x55e61250f430 msgr2=0x55e61250d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f146492e800 1 -- 172.21.15.192:0/2103435476 shutdown_connections 2024-09-10T05:11:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f146492e800 1 -- 172.21.15.192:0/2103435476 wait complete. 2024-09-10T05:11:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f146492e800 1 Processor -- start 2024-09-10T05:11:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f146492e800 1 -- start start 2024-09-10T05:11:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f146492e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 0x55e61251c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f146492e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e6123f04c0 con 0x55e6123ef5e0 2024-09-10T05:11:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f1460564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 0x55e61251c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f1460564640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 0x55e61251c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60292/0 (socket says 172.21.15.192:60292) 2024-09-10T05:11:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.249+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 learned_addr learned my addr 172.21.15.192:0/7279672 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.250+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e61251cb60 con 0x55e6123ef5e0 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.250+0000 7f1460564640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 0x55e61251c600 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1450026b20 tx=0x7f145003afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.250+0000 7f133dffb640 1 -- 172.21.15.192:0/7279672 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1450052860 con 0x55e6123ef5e0 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.250+0000 7f133dffb640 1 -- 172.21.15.192:0/7279672 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1450052a00 con 0x55e6123ef5e0 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.250+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e61251cb60 con 0x55e6123ef5e0 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.250+0000 7f133dffb640 1 -- 172.21.15.192:0/7279672 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f145003e1a0 con 0x55e6123ef5e0 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.250+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e61251cb60 con 0x55e6123ef5e0 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.251+0000 7f133dffb640 1 -- 172.21.15.192:0/7279672 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f145001c7d0 con 0x55e6123ef5e0 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.251+0000 7f133dffb640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f133003c780 0x7f133003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.251+0000 7f133dffb640 1 -- 172.21.15.192:0/7279672 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1450066030 con 0x55e6123ef5e0 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.251+0000 7f146492e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.251+0000 7f145fd63640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f133003c780 0x7f133003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.251+0000 7f146492e800 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e612527a90 0x55e612529ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.251+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e61252a630 con 0x55e612527a90 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.251+0000 7f1460d65640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e612527a90 0x55e612529ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f145fd63640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f133003c780 0x7f133003ec40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1454000c00 tx=0x7f1454053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f1460d65640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e612527a90 0x55e612529ee0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f146492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f146492e800 20 realm 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f146492e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e61252aa40 con 0x55e612527a90 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f146492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f146492e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f146492e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b310 con 0x55e612527a90 2024-09-10T05:11:49.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f146492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f146492e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.252+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612527a90 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.253+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.253+0000 7f146492e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.253+0000 7f146492e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.253+0000 7f146492e800 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e61252c1a0 0x55e61252e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.253+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e61252ecd0 con 0x55e61252c1a0 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.253+0000 7f1460564640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e61252c1a0 0x55e61252e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.253+0000 7f1460564640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e61252c1a0 0x55e61252e590 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.253+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.254+0000 7f146492e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:49.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.254+0000 7f146492e800 20 searching for the correct realm 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.254+0000 7f146492e800 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e612530d70 0x55e612533230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.254+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e612533900 con 0x55e612530d70 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.254+0000 7f145fd63640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e612530d70 0x55e612533230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.254+0000 7f145fd63640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e612530d70 0x55e612533230 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.254+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.254+0000 7f145fd63640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f145405f040 0x7f145406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.254+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e612533900 con 0x7f145405f040 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.254+0000 7f1460d65640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f145405f040 0x7f145406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.255+0000 7f1460d65640 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f145405f040 0x7f145406b410 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.255+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.255+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e61252c1a0 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.255+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.255+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612527a90 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.256+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.256+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612527a90 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.256+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.256+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e61252c1a0 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.256+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.256+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e61252c1a0 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.256+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.256+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x7f145405f040 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.256+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.256+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612530d70 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.257+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.257+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612527a90 2024-09-10T05:11:49.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.257+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.257+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e61252c1a0 2024-09-10T05:11:49.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.257+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.257+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612527a90 2024-09-10T05:11:49.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.257+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.257+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x7f145405f040 2024-09-10T05:11:49.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.258+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.258+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612530d70 2024-09-10T05:11:49.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.258+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.258+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612530d70 2024-09-10T05:11:49.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.258+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.258+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e61252c1a0 2024-09-10T05:11:49.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.258+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.258+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612530d70 2024-09-10T05:11:49.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.259+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.259+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612530d70 2024-09-10T05:11:49.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.259+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.259+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612527a90 2024-09-10T05:11:49.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.259+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.259+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612527a90 2024-09-10T05:11:49.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.259+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.259+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e61252c1a0 2024-09-10T05:11:49.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.260+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.260+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612530d70 2024-09-10T05:11:49.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.260+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.260+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x7f145405f040 2024-09-10T05:11:49.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.260+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.260+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612527a90 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.260+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.260+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e61252c1a0 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.261+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.261+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612530d70 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.261+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.261+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e61252c1a0 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.261+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.261+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x7f145405f040 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.261+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.261+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612530d70 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.261+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.261+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e61252c1a0 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612527a90 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x7f145405f040 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f146492e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f146492e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f146492e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f146492e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f146492e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f146492e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f146492e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.262+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e61252f670 con 0x55e612527a90 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e61252f670 con 0x55e612527a90 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e61252f670 con 0x7f145405f040 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 20 zone default found 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 4 Realm: () 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:49.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 20 zonegroup default 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e61252fa60 con 0x55e61252c1a0 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.263+0000 7f146492e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.264+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e61252f3f0 con 0x55e612530d70 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.264+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.264+0000 7f146492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.264+0000 7f146492e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.264+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e612535770 con 0x55e612530d70 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.264+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.264+0000 7f146492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.264+0000 7f146492e800 20 started sync module instance, tier type = 2024-09-10T05:11:49.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.264+0000 7f146492e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:49.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.264+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e612534c10 con 0x7f145405f040 2024-09-10T05:11:49.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.265+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.265+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94446638289168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e612534c10 con 0x7f145405f040 2024-09-10T05:11:49.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.265+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6125361b0 con 0x55e612527a90 2024-09-10T05:11:49.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.266+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94446638289168] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.266+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.266+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94446638292096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e612534c10 con 0x55e612527a90 2024-09-10T05:11:49.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.266+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e612536c40 con 0x55e612530d70 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.267+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.267+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94446638294800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6125374e0 con 0x55e612530d70 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.267+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e612537fa0 con 0x7f145405f040 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.267+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94446638292096] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.268+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94446638294800] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.268+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.268+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94446638297136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e612534760 con 0x7f145405f040 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.268+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e612538840 con 0x55e612527a90 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.269+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.269+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94446638301936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e612538c70 con 0x55e612527a90 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.269+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e612539780 con 0x55e61252c1a0 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.269+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94446638297136] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.270+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94446638301936] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.270+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.270+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94446638302992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e612537a70 con 0x55e61252c1a0 2024-09-10T05:11:49.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.270+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e61253a020 con 0x55e61252c1a0 2024-09-10T05:11:49.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.271+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.271+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94446638310336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e61252c1a0 2024-09-10T05:11:49.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.271+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e61253b6b0 con 0x55e61252c1a0 2024-09-10T05:11:49.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.271+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94446638302992] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.272+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94446638310336] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.272+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.272+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94446638313888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e61253b670 con 0x55e61252c1a0 2024-09-10T05:11:49.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.272+0000 7f146492e800 20 add_watcher() i=0 2024-09-10T05:11:49.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.272+0000 7f146492e800 20 add_watcher() i=1 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.272+0000 7f146492e800 20 add_watcher() i=2 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.272+0000 7f146492e800 20 add_watcher() i=3 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.272+0000 7f146492e800 20 add_watcher() i=4 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.272+0000 7f146492e800 20 add_watcher() i=5 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.272+0000 7f146492e800 20 add_watcher() i=6 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.273+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94446638313888] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.273+0000 7f146492e800 20 add_watcher() i=7 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.273+0000 7f146492e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.273+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e61253eb50 con 0x55e612527a90 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.274+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.274+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94446638315120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e61253bf40 con 0x55e612527a90 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.274+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94446638315120] v35'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.275+0000 7f13167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.275+0000 7f146492e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.275+0000 7f146492e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.275+0000 7f146492e800 5 note: GC not initialized 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.275+0000 7f13157e2640 20 reqs_thread_entry: start 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.275+0000 7f146492e800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.275+0000 7f146492e800 20 Filter name: none 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.275+0000 7f1286ffd640 20 reqs_thread_entry: start 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.275+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e612571260 con 0x55e612530d70 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.275+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(62 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.275+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6125374e0 con 0x55e612530d70 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.276+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(63 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.276+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6125374e0 con 0x55e612527a90 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.276+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(64 [pgnls start_epoch 35 out=49b] v35'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.276+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612527a90 2024-09-10T05:11:49.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.276+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 [pgnls start_epoch 35 out=49b] v35'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.276+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x7f145405f040 2024-09-10T05:11:49.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.276+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(66 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.276+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612530d70 2024-09-10T05:11:49.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.277+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(67 [pgnls start_epoch 35 out=127b] v35'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.277+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612527a90 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.277+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.277+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612530d70 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.277+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(69 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.277+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x7f145405f040 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.277+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(70 [pgnls start_epoch 35 out=49b] v35'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.277+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612530d70 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.277+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(71 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.277+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612527a90 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.278+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(72 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.278+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e61252c1a0 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.278+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.278+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e61252c1a0 2024-09-10T05:11:49.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.278+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(74 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.278+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e612530d70 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.278+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(75 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.278+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e61252c1a0 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.279+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(76 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.279+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e61252c1a0 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.279+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(77 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.279+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e61252c1a0 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.279+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(78 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.279+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e612530d70 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.279+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(79 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.279+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x7f145405f040 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.280+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(80 [pgnls start_epoch 35 out=70b] v35'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.280+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e612527a90 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.280+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(81 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.280+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e612527a90 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.280+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(82 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.280+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e612530d70 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.280+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(83 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.280+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x7f145405f040 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.281+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(84 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.281+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e61252c1a0 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.281+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(85 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.281+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e612527a90 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.281+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(86 [pgnls start_epoch 35 out=49b] v35'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.281+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e61252c1a0 2024-09-10T05:11:49.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.281+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(87 [pgnls start_epoch 35 out=49b] v35'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.281+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e612530d70 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.281+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(88 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.282+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x7f145405f040 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.282+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(89 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.282+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e61252c1a0 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.282+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(90 [pgnls start_epoch 35 out=49b] v35'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.282+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e612527a90 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.282+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(91 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.282+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x55e612530d70 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.282+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(92 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.282+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e61253ac90 con 0x7f145405f040 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.283+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(93 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.283+0000 7f146492e800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.283+0000 7f146492e800 20 RGWRados::pool_iterate: got myfoo 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.283+0000 7f13167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.283+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94446638315120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6125374e0 con 0x55e612527a90 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.284+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94446638315120] v35'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.284+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94446638289168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x7f145405f040 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.287+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94446638289168] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.287+0000 7f146492e800 20 remove_watcher() i=0 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.287+0000 7f146492e800 2 removed watcher, disabling cache 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.287+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94446638292096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6125374e0 con 0x55e612527a90 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.288+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94446638292096] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.288+0000 7f146492e800 20 remove_watcher() i=1 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.288+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94446638294800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e61252b6b0 con 0x55e612530d70 2024-09-10T05:11:49.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.289+0000 7f145fd63640 1 -- 172.21.15.192:0/7279672 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94446638294800] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145407c040 con 0x55e612530d70 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.289+0000 7f146492e800 20 remove_watcher() i=2 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.289+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94446638297136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6125374e0 con 0x7f145405f040 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.290+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94446638297136] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x7f145405f040 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.290+0000 7f146492e800 20 remove_watcher() i=3 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.290+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94446638301936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6125374e0 con 0x55e612527a90 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.291+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94446638301936] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145800a4d0 con 0x55e612527a90 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.291+0000 7f146492e800 20 remove_watcher() i=4 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.291+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94446638302992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6125374e0 con 0x55e61252c1a0 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.292+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94446638302992] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.292+0000 7f146492e800 20 remove_watcher() i=5 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.292+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94446638310336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e612535c80 con 0x55e61252c1a0 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.293+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94446638310336] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.293+0000 7f146492e800 20 remove_watcher() i=6 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.293+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94446638313888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e612536710 con 0x55e61252c1a0 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f1460564640 1 -- 172.21.15.192:0/7279672 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94446638313888] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f145002d070 con 0x55e61252c1a0 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 20 remove_watcher() i=7 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e61252c1a0 msgr2=0x55e61252e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e61252c1a0 0x55e61252e590 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e612527a90 msgr2=0x55e612529ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e612527a90 0x55e612529ee0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f145405f040 msgr2=0x7f145406b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f145405f040 0x7f145406b410 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e612530d70 msgr2=0x55e612533230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e612530d70 0x55e612533230 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f133003c780 msgr2=0x7f133003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f133003c780 0x7f133003ec40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1454000c00 tx=0x7f1454053000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 msgr2=0x55e61251c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f1460d65640 1 -- 172.21.15.192:0/7279672 reap_dead start 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 0x55e61251c600 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1450026b20 tx=0x7f145003afd0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 shutdown_connections 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 --2- 172.21.15.192:0/7279672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123ef5e0 0x55e61251c600 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 >> 172.21.15.192:0/7279672 conn(0x55e61250f430 msgr2=0x55e61250d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 shutdown_connections 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/7279672 wait complete. 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/3794829369 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f133803c6e0 msgr2=0x7f133803eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 --2- 172.21.15.192:0/3794829369 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f133803c6e0 0x7f133803eba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55e6124f00e0 tx=0x7f1454005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/3794829369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6125065f0 msgr2=0x55e612506a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 --2- 172.21.15.192:0/3794829369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6125065f0 0x55e612506a10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f145000bd10 tx=0x7f145004be50 comp rx=0 tx=0).stop 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/3794829369 shutdown_connections 2024-09-10T05:11:49.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 --2- 172.21.15.192:0/3794829369 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f133803c6e0 0x7f133803eba0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 --2- 172.21.15.192:0/3794829369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6125065f0 0x55e612506a10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/3794829369 >> 172.21.15.192:0/3794829369 conn(0x55e6124fa9a0 msgr2=0x55e6124fad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/3794829369 shutdown_connections 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.294+0000 7f146492e800 1 -- 172.21.15.192:0/3794829369 wait complete. 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e6124f1f60 msgr2=0x55e6124f4350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e6124f1f60 0x55e6124f4350 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e6124e9d30 msgr2=0x55e6124ef690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e6124e9d30 0x55e6124ef690 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e6124f5e60 msgr2=0x55e6124f8250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e6124f5e60 0x55e6124f8250 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f134803c920 msgr2=0x7f134803ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f134803c920 0x7f134803ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1454057000 tx=0x7f1454052000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f51e0 msgr2=0x55e6124e8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 --2- 172.21.15.192:0/1945674563 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6123f51e0 0x55e6124e8040 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f14500012f0 tx=0x7f1450000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f1460d65640 1 -- 172.21.15.192:0/1945674563 reap_dead start 2024-09-10T05:11:49.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 shutdown_connections 2024-09-10T05:11:49.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 >> 172.21.15.192:0/1945674563 conn(0x55e6123eb1a0 msgr2=0x55e6124e1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 shutdown_connections 2024-09-10T05:11:49.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.295+0000 7f146492e800 1 -- 172.21.15.192:0/1945674563 wait complete. 2024-09-10T05:11:49.312 INFO:teuthology.orchestra.run.smithi192.stdout:["myfoo"] 2024-09-10T05:11:49.312 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-10T05:11:49.325 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:11:49.338 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:11:49.347 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:11:49.393 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-10T05:11:49.421 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:11:49.450 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:11:49.480 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:11:49.480 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T05:11:49.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T05:11:49.480 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T05:11:49.527 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:49.527 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:49.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.525+0000 7f1c6a412800 1 Processor -- start 2024-09-10T05:11:49.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.525+0000 7f1c6a412800 1 -- start start 2024-09-10T05:11:49.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.525+0000 7f1c6a412800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55fe6a24fdf0 0x55fe6a250af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.525+0000 7f1c6a412800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fe6a0fae40 con 0x55fe6a251030 2024-09-10T05:11:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.525+0000 7f1c6a412800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55fe6a0c5680 con 0x55fe6a24fdf0 2024-09-10T05:11:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.525+0000 7f1c65be0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55fe6a24fdf0 0x55fe6a250af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.525+0000 7f1c5d3df640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55fe6a251030 0x55fe6a255d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36372/0 (socket says 172.21.15.192:36372) 2024-09-10T05:11:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.525+0000 7f1c5d3df640 1 -- 172.21.15.192:0/149203451 learned_addr learned my addr 172.21.15.192:0/149203451 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.525+0000 7f1c65be0640 1 -- 172.21.15.192:0/149203451 >> v1:172.21.15.139:6789/0 conn(0x55fe6a251030 legacy=0x55fe6a255d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.526+0000 7f1c653df640 1 -- 172.21.15.192:0/149203451 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2103163160 0 0) 0x55fe6a0fae40 con 0x55fe6a251030 2024-09-10T05:11:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.526+0000 7f1c65be0640 1 -- 172.21.15.192:0/149203451 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe6a0e16b0 con 0x55fe6a24fdf0 2024-09-10T05:11:49.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.527+0000 7f1c65be0640 1 --2- 172.21.15.192:0/149203451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a250af0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800a470 tx=0x7f1c58045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dd653fdcd1cc3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.528+0000 7f1c653df640 1 -- 172.21.15.192:0/149203451 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c58053570 con 0x55fe6a24fdf0 2024-09-10T05:11:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.528+0000 7f1c653df640 1 -- 172.21.15.192:0/149203451 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c58058070 con 0x55fe6a24fdf0 2024-09-10T05:11:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.528+0000 7f1c653df640 1 -- 172.21.15.192:0/149203451 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c58053880 con 0x55fe6a24fdf0 2024-09-10T05:11:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.528+0000 7f1c6a412800 1 -- 172.21.15.192:0/149203451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 msgr2=0x55fe6a250af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.528+0000 7f1c6a412800 1 --2- 172.21.15.192:0/149203451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a250af0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800a470 tx=0x7f1c58045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.528+0000 7f1c6a412800 1 -- 172.21.15.192:0/149203451 shutdown_connections 2024-09-10T05:11:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.528+0000 7f1c6a412800 1 --2- 172.21.15.192:0/149203451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a250af0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.528+0000 7f1c6a412800 1 -- 172.21.15.192:0/149203451 >> 172.21.15.192:0/149203451 conn(0x55fe6a24b1c0 msgr2=0x55fe6a24d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.528+0000 7f1c6a412800 1 -- 172.21.15.192:0/149203451 shutdown_connections 2024-09-10T05:11:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.528+0000 7f1c6a412800 1 -- 172.21.15.192:0/149203451 wait complete. 2024-09-10T05:11:49.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.542+0000 7f1c6a412800 1 Processor -- start 2024-09-10T05:11:49.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.542+0000 7f1c6a412800 1 -- start start 2024-09-10T05:11:49.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.542+0000 7f1c6a412800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a3404a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.542+0000 7f1c6a412800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fe6a0e9dd0 con 0x55fe6a24fdf0 2024-09-10T05:11:49.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.542+0000 7f1c65be0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a3404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.542+0000 7f1c65be0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a3404a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60306/0 (socket says 172.21.15.192:60306) 2024-09-10T05:11:49.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.542+0000 7f1c65be0640 1 -- 172.21.15.192:0/1857611922 learned_addr learned my addr 172.21.15.192:0/1857611922 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.543+0000 7f1c65be0640 1 -- 172.21.15.192:0/1857611922 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe6a102e10 con 0x55fe6a24fdf0 2024-09-10T05:11:49.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.543+0000 7f1c65be0640 1 --2- 172.21.15.192:0/1857611922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a3404a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800a470 tx=0x7f1c58051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49d307a65421d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.543+0000 7f1b53e07640 1 -- 172.21.15.192:0/1857611922 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c58053570 con 0x55fe6a24fdf0 2024-09-10T05:11:49.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.543+0000 7f1b53e07640 1 -- 172.21.15.192:0/1857611922 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c58063030 con 0x55fe6a24fdf0 2024-09-10T05:11:49.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.543+0000 7f1b53e07640 1 -- 172.21.15.192:0/1857611922 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c58053840 con 0x55fe6a24fdf0 2024-09-10T05:11:49.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.544+0000 7f1c6a412800 1 -- 172.21.15.192:0/1857611922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 msgr2=0x55fe6a3404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.544+0000 7f1c6a412800 1 --2- 172.21.15.192:0/1857611922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a3404a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800a470 tx=0x7f1c58051000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.544+0000 7f1c6a412800 1 -- 172.21.15.192:0/1857611922 shutdown_connections 2024-09-10T05:11:49.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.544+0000 7f1c6a412800 1 --2- 172.21.15.192:0/1857611922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a3404a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.544+0000 7f1c6a412800 1 -- 172.21.15.192:0/1857611922 >> 172.21.15.192:0/1857611922 conn(0x55fe6a24b1c0 msgr2=0x55fe6a33e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.544+0000 7f1c6a412800 1 -- 172.21.15.192:0/1857611922 shutdown_connections 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.544+0000 7f1c6a412800 1 -- 172.21.15.192:0/1857611922 wait complete. 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.544+0000 7f1c6a412800 1 Processor -- start 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.544+0000 7f1c6a412800 1 -- start start 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.544+0000 7f1c6a412800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a347da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.544+0000 7f1c6a412800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fe6a251720 con 0x55fe6a24fdf0 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.544+0000 7f1c65be0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a347da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.545+0000 7f1c65be0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a347da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60320/0 (socket says 172.21.15.192:60320) 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.545+0000 7f1c65be0640 1 -- 172.21.15.192:0/2700826679 learned_addr learned my addr 172.21.15.192:0/2700826679 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.545+0000 7f1c65be0640 1 -- 172.21.15.192:0/2700826679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe6a348300 con 0x55fe6a24fdf0 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.545+0000 7f1c65be0640 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a347da0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800a470 tx=0x7f1c58002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.545+0000 7f1b52604640 1 -- 172.21.15.192:0/2700826679 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c58078070 con 0x55fe6a24fdf0 2024-09-10T05:11:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.545+0000 7f1b52604640 1 -- 172.21.15.192:0/2700826679 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c58068420 con 0x55fe6a24fdf0 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.545+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe6a348590 con 0x55fe6a24fdf0 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.545+0000 7f1b52604640 1 -- 172.21.15.192:0/2700826679 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c58068700 con 0x55fe6a24fdf0 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.545+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe6a3491a0 con 0x55fe6a24fdf0 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.546+0000 7f1b52604640 1 -- 172.21.15.192:0/2700826679 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1c5807b070 con 0x55fe6a24fdf0 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.546+0000 7f1b52604640 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b4c03c780 0x7f1b4c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.546+0000 7f1b52604640 1 -- 172.21.15.192:0/2700826679 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1c58097810 con 0x55fe6a24fdf0 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.546+0000 7f1c5d3df640 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b4c03c780 0x7f1b4c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.546+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fe6a251030 0x55fe6a34f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.546+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a34f930 con 0x55fe6a251030 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.547+0000 7f1c663e1640 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fe6a251030 0x55fe6a34f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.547+0000 7f1c5d3df640 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b4c03c780 0x7f1b4c03ec40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1c50000c00 tx=0x7f1c500013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.547+0000 7f1c663e1640 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fe6a251030 0x55fe6a34f3f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.547+0000 7f1c663e1640 1 -- 172.21.15.192:0/2700826679 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a251030 2024-09-10T05:11:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.547+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a34fcd0 con 0x55fe6a251030 2024-09-10T05:11:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.547+0000 7f1c663e1640 1 -- 172.21.15.192:0/2700826679 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a251030 2024-09-10T05:11:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.547+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fe6a351750 0x55fe6a353bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.547+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a354380 con 0x55fe6a351750 2024-09-10T05:11:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.548+0000 7f1c65be0640 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fe6a351750 0x55fe6a353bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.548+0000 7f1c65be0640 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fe6a351750 0x55fe6a353bf0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.548+0000 7f1c65be0640 1 -- 172.21.15.192:0/2700826679 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1c5807a030 con 0x55fe6a351750 2024-09-10T05:11:49.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.548+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a350520 con 0x55fe6a251030 2024-09-10T05:11:49.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.548+0000 7f1c663e1640 1 -- 172.21.15.192:0/2700826679 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a251030 2024-09-10T05:11:49.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.548+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55fe6a3557e0 0x55fe6a357bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.548+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a358270 con 0x55fe6a3557e0 2024-09-10T05:11:49.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.549+0000 7f1c5d3df640 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55fe6a3557e0 0x55fe6a357bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.549+0000 7f1c5d3df640 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55fe6a3557e0 0x55fe6a357bd0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.549+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2700826679 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1c5000f670 con 0x55fe6a3557e0 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.549+0000 7f1c6a412800 1 Processor -- start 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.550+0000 7f1c6a412800 1 -- start start 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.550+0000 7f1c6a412800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a33c010 0x55fe6a33a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.550+0000 7f1c6a412800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fe6a147a00 con 0x55fe6a33c010 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.550+0000 7f1c65be0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a33c010 0x55fe6a33a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.550+0000 7f1c65be0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a33c010 0x55fe6a33a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60334/0 (socket says 172.21.15.192:60334) 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.550+0000 7f1c65be0640 1 -- 172.21.15.192:0/1909223401 learned_addr learned my addr 172.21.15.192:0/1909223401 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.550+0000 7f1c65be0640 1 -- 172.21.15.192:0/1909223401 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe6a33c530 con 0x55fe6a33c010 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.551+0000 7f1c65be0640 1 --2- 172.21.15.192:0/1909223401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a33c010 0x55fe6a33a880 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1c58052560 tx=0x7f1c5807ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.551+0000 7f1b4b7fe640 1 -- 172.21.15.192:0/1909223401 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c58068d60 con 0x55fe6a33c010 2024-09-10T05:11:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.551+0000 7f1b4b7fe640 1 -- 172.21.15.192:0/1909223401 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c58097b30 con 0x55fe6a33c010 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.551+0000 7f1c6a412800 1 -- 172.21.15.192:0/1909223401 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe6a33adc0 con 0x55fe6a33c010 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.551+0000 7f1b4b7fe640 1 -- 172.21.15.192:0/1909223401 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c58097e10 con 0x55fe6a33c010 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.551+0000 7f1c6a412800 1 -- 172.21.15.192:0/1909223401 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe6a33b360 con 0x55fe6a33c010 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.551+0000 7f1b4b7fe640 1 -- 172.21.15.192:0/1909223401 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1c5807c3b0 con 0x55fe6a33c010 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.552+0000 7f1b4b7fe640 1 --2- 172.21.15.192:0/1909223401 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b4003c8d0 0x7f1b4003ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.552+0000 7f1b4b7fe640 1 -- 172.21.15.192:0/1909223401 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1c5808e070 con 0x55fe6a33c010 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.552+0000 7f1c5d3df640 1 --2- 172.21.15.192:0/1909223401 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b4003c8d0 0x7f1b4003ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.552+0000 7f1c6a412800 1 Processor -- start 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.552+0000 7f1c6a412800 1 -- start start 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.552+0000 7f1c5d3df640 1 --2- 172.21.15.192:0/1909223401 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b4003c8d0 0x7f1b4003ed90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55fe6a349e60 tx=0x7f1c50006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.552+0000 7f1c6a412800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 0x55fe6a374cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.552+0000 7f1c6a412800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fe6a340c90 con 0x55fe6a374910 2024-09-10T05:11:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.552+0000 7f1c65be0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 0x55fe6a374cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.552+0000 7f1c65be0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 0x55fe6a374cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60350/0 (socket says 172.21.15.192:60350) 2024-09-10T05:11:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.552+0000 7f1c65be0640 1 -- 172.21.15.192:0/1167568562 learned_addr learned my addr 172.21.15.192:0/1167568562 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.553+0000 7f1c65be0640 1 -- 172.21.15.192:0/1167568562 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe6a3752e0 con 0x55fe6a374910 2024-09-10T05:11:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.553+0000 7f1c65be0640 1 --2- 172.21.15.192:0/1167568562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 0x55fe6a374cf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1c5805f730 tx=0x7f1c5807dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6659e69197343d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.553+0000 7f1b497fa640 1 -- 172.21.15.192:0/1167568562 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c580af070 con 0x55fe6a374910 2024-09-10T05:11:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.553+0000 7f1b497fa640 1 -- 172.21.15.192:0/1167568562 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c58091410 con 0x55fe6a374910 2024-09-10T05:11:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.553+0000 7f1b497fa640 1 -- 172.21.15.192:0/1167568562 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c5805e940 con 0x55fe6a374910 2024-09-10T05:11:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.553+0000 7f1c6a412800 1 -- 172.21.15.192:0/1167568562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 msgr2=0x55fe6a374cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.553+0000 7f1c6a412800 1 --2- 172.21.15.192:0/1167568562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 0x55fe6a374cf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1c5805f730 tx=0x7f1c5807dcd0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.553+0000 7f1c6a412800 1 -- 172.21.15.192:0/1167568562 shutdown_connections 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.553+0000 7f1c6a412800 1 --2- 172.21.15.192:0/1167568562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 0x55fe6a374cf0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.553+0000 7f1c6a412800 1 -- 172.21.15.192:0/1167568562 >> 172.21.15.192:0/1167568562 conn(0x55fe6a370d10 msgr2=0x55fe6a36ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.553+0000 7f1c6a412800 1 -- 172.21.15.192:0/1167568562 shutdown_connections 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.553+0000 7f1c6a412800 1 -- 172.21.15.192:0/1167568562 wait complete. 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.554+0000 7f1c6a412800 1 Processor -- start 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.554+0000 7f1c6a412800 1 -- start start 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.554+0000 7f1c6a412800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 0x55fe6a37bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.554+0000 7f1c6a412800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fe6a375770 con 0x55fe6a374910 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.554+0000 7f1c65be0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 0x55fe6a37bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.554+0000 7f1c65be0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 0x55fe6a37bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60360/0 (socket says 172.21.15.192:60360) 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.554+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 learned_addr learned my addr 172.21.15.192:0/2069295883 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.554+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe6a37c2a0 con 0x55fe6a374910 2024-09-10T05:11:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.555+0000 7f1c65be0640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 0x55fe6a37bd40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1c5807d750 tx=0x7f1c58052ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.555+0000 7f1b377fe640 1 -- 172.21.15.192:0/2069295883 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c580ba020 con 0x55fe6a374910 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.555+0000 7f1b377fe640 1 -- 172.21.15.192:0/2069295883 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c58074ac0 con 0x55fe6a374910 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.555+0000 7f1b377fe640 1 -- 172.21.15.192:0/2069295883 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c580af040 con 0x55fe6a374910 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.555+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe6a37c2a0 con 0x55fe6a374910 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.555+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe6a37c2a0 con 0x55fe6a374910 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.556+0000 7f1b377fe640 1 -- 172.21.15.192:0/2069295883 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1c580bd020 con 0x55fe6a374910 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.556+0000 7f1b377fe640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b3003c780 0x7f1b3003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.556+0000 7f1b377fe640 1 -- 172.21.15.192:0/2069295883 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1c580a7070 con 0x55fe6a374910 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.556+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.556+0000 7f1c5d3df640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b3003c780 0x7f1b3003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.556+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fe6a387300 0x55fe6a389790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.556+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a389ee0 con 0x55fe6a387300 2024-09-10T05:11:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.556+0000 7f1c663e1640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fe6a387300 0x55fe6a389790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c5d3df640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b3003c780 0x7f1b3003ec40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000ffd0 tx=0x7f1c50023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c663e1640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fe6a387300 0x55fe6a389790 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c6a412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c6a412800 20 realm 2024-09-10T05:11:49.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38a2f0 con 0x55fe6a387300 2024-09-10T05:11:49.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c6a412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c6a412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:49.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38abc0 con 0x55fe6a387300 2024-09-10T05:11:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c6a412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.557+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a387300 2024-09-10T05:11:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.558+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.558+0000 7f1c6a412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.558+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.558+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fe6a38ba50 0x55fe6a38de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.558+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38e580 con 0x55fe6a38ba50 2024-09-10T05:11:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.558+0000 7f1c65be0640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fe6a38ba50 0x55fe6a38de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.558+0000 7f1c65be0640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fe6a38ba50 0x55fe6a38de40 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.558+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.558+0000 7f1c6a412800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:49.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.558+0000 7f1c6a412800 20 searching for the correct realm 2024-09-10T05:11:49.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.559+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55fe6a390620 0x55fe6a392ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.559+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3931b0 con 0x55fe6a390620 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.559+0000 7f1c5d3df640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55fe6a390620 0x55fe6a392ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.559+0000 7f1c5d3df640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55fe6a390620 0x55fe6a392ae0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.559+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.559+0000 7f1c5d3df640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1c5002e910 0x7f1c5003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.559+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3931b0 con 0x7f1c5002e910 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.559+0000 7f1c663e1640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1c5002e910 0x7f1c5003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.560+0000 7f1c663e1640 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1c5002e910 0x7f1c5003a3c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.560+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.560+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a38ba50 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.560+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.560+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a387300 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.560+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.561+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a387300 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.561+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.561+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a38ba50 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.561+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.561+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a38ba50 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.561+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.561+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x7f1c5002e910 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.561+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.561+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a390620 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.562+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.562+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a387300 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.562+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.562+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a38ba50 2024-09-10T05:11:49.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.562+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.562+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a387300 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.562+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.562+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x7f1c5002e910 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.563+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.563+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a390620 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.563+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.563+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a390620 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.563+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.563+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a38ba50 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.563+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.563+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a390620 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.564+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.564+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a390620 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.564+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.564+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a387300 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.564+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.564+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a387300 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.564+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.564+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a38ba50 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.565+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.565+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a390620 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.565+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.565+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x7f1c5002e910 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.565+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.565+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a387300 2024-09-10T05:11:49.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.565+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.565+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a38ba50 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.566+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.566+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a390620 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.566+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.566+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a38ba50 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.566+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.566+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x7f1c5002e910 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.566+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a390620 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a38ba50 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x55fe6a387300 2024-09-10T05:11:49.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38af60 con 0x7f1c5002e910 2024-09-10T05:11:49.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c6a412800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:49.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c6a412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:49.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c6a412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:49.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c6a412800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c6a412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c6a412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.567+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38ef20 con 0x55fe6a387300 2024-09-10T05:11:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38ef20 con 0x55fe6a387300 2024-09-10T05:11:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38ef20 con 0x7f1c5002e910 2024-09-10T05:11:49.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:49.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 20 zone default found 2024-09-10T05:11:49.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 4 Realm: () 2024-09-10T05:11:49.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:49.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:49.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:49.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 20 zonegroup default 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.568+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38f310 con 0x55fe6a38ba50 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c6a412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a38f8d0 con 0x55fe6a390620 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c6a412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a395020 con 0x55fe6a390620 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c6a412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c6a412800 20 started sync module instance, tier type = 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c6a412800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.569+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3944c0 con 0x7f1c5002e910 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.570+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.570+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94551192193552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3944c0 con 0x7f1c5002e910 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.570+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a395af0 con 0x55fe6a387300 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.571+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94551192193552] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.571+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.571+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94551192196576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3944c0 con 0x55fe6a387300 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.571+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a396570 con 0x55fe6a390620 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.572+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94551192196576] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.572+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.572+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94551192190992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a394430 con 0x55fe6a390620 2024-09-10T05:11:49.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.573+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a397460 con 0x7f1c5002e910 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.573+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94551192190992] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.574+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.574+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94551192203184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a397880 con 0x7f1c5002e910 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.574+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a398240 con 0x55fe6a387300 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.575+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.575+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94551192203184] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.575+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94551192206736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a398660 con 0x55fe6a387300 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.575+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a398bf0 con 0x55fe6a38ba50 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.576+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94551192206736] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.576+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.576+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94551192204240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a398660 con 0x55fe6a38ba50 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.576+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a398660 con 0x55fe6a38ba50 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.577+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.577+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94551192211792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a399b00 con 0x55fe6a38ba50 2024-09-10T05:11:49.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.577+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a39a530 con 0x55fe6a38ba50 2024-09-10T05:11:49.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.577+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94551192204240] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.578+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.578+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94551192211792] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.578+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94551192215616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a39a530 con 0x55fe6a38ba50 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.578+0000 7f1c6a412800 20 add_watcher() i=0 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.578+0000 7f1c6a412800 20 add_watcher() i=1 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.578+0000 7f1c6a412800 20 add_watcher() i=2 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.578+0000 7f1c6a412800 20 add_watcher() i=3 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.578+0000 7f1c6a412800 20 add_watcher() i=4 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.578+0000 7f1c6a412800 20 add_watcher() i=5 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.578+0000 7f1c6a412800 20 add_watcher() i=6 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.579+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94551192215616] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.579+0000 7f1c6a412800 20 add_watcher() i=7 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.579+0000 7f1c6a412800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.579+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a399680 con 0x55fe6a387300 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.579+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.579+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94551192207792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a399680 con 0x55fe6a387300 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.580+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94551192207792] v35'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.580+0000 7f1b17fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.580+0000 7f1c6a412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.580+0000 7f1c6a412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.581+0000 7f1c6a412800 5 note: GC not initialized 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.581+0000 7f1b16ffd640 20 reqs_thread_entry: start 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.581+0000 7f1c6a412800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.581+0000 7f1c6a412800 20 Filter name: none 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.581+0000 7f1b14ff9640 20 reqs_thread_entry: start 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.581+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.581+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3d06a0 con 0x7f1c5002e910 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.581+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.581+0000 7f1c6a412800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:49.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.581+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.582+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:63 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3d0f30 con 0x55fe6a390620 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.582+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(63 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.582+0000 7f1c6a412800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.582+0000 7f1c6a412800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.582+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.582+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3d0ac0 con 0x7f1c5002e910 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.582+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.582+0000 7f1c6a412800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.582+0000 7f1c6a412800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.582+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:65 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3d29f0 con 0x55fe6a390620 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(65 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:11:49.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 4.5 4:a13f7d51:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3d2490 con 0x55fe6a390620 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:67 4.23 4:c5bf8a98:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3d7400 con 0x55fe6a38ba50 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:68 4.26 4:6764b625:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3d9fe0 con 0x55fe6a38ba50 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 4.19 4:9b146b93:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3dc8d0 con 0x55fe6a390620 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 4.2a 4:54fd2db9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3df1a0 con 0x55fe6a387300 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 4.23 4:c6e2b706:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3e1a50 con 0x55fe6a38ba50 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 4.e 4:71344637:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3e3f20 con 0x7f1c5002e910 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 4.29 4:950bf6db:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3e6b70 con 0x55fe6a390620 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:74 4.d 4:b0727371:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3e99e0 con 0x55fe6a390620 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 4.26 4:64e4daa4:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3ec3f0 con 0x55fe6a38ba50 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:76 4.3f 4:fc8f57a3:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3eece0 con 0x7f1c5002e910 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(67 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(70 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(68 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.5 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(72 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(66 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(75 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(69 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.583+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(76 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.584+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(73 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.584+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(74 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.584+0000 7f1b17fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.584+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94551192207792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3cdfe0 con 0x55fe6a387300 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.585+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94551192207792] v35'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.585+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94551192193552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3cdfe0 con 0x7f1c5002e910 2024-09-10T05:11:49.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.586+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94551192193552] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.586+0000 7f1c6a412800 20 remove_watcher() i=0 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.586+0000 7f1c6a412800 2 removed watcher, disabling cache 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.586+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94551192196576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3cdfe0 con 0x55fe6a387300 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.587+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94551192196576] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.587+0000 7f1c6a412800 20 remove_watcher() i=1 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.587+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94551192190992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3cdfe0 con 0x55fe6a390620 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.588+0000 7f1c5d3df640 1 -- 172.21.15.192:0/2069295883 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94551192190992] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c50037040 con 0x55fe6a390620 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.588+0000 7f1c6a412800 20 remove_watcher() i=2 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.588+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94551192203184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3cdfe0 con 0x7f1c5002e910 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.589+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94551192203184] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x7f1c5002e910 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.589+0000 7f1c6a412800 20 remove_watcher() i=3 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.589+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94551192206736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3cdfe0 con 0x55fe6a387300 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.590+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94551192206736] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6000a4d0 con 0x55fe6a387300 2024-09-10T05:11:49.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.590+0000 7f1c6a412800 20 remove_watcher() i=4 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.590+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94551192204240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3cdfe0 con 0x55fe6a38ba50 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.591+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94551192204240] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.591+0000 7f1c6a412800 20 remove_watcher() i=5 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.591+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94551192211792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3cdfe0 con 0x55fe6a38ba50 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.592+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94551192211792] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.592+0000 7f1c6a412800 20 remove_watcher() i=6 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.592+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94551192215616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fe6a3cdfe0 con 0x55fe6a38ba50 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c65be0640 1 -- 172.21.15.192:0/2069295883 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94551192215616] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c580b2040 con 0x55fe6a38ba50 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 20 remove_watcher() i=7 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fe6a38ba50 msgr2=0x55fe6a38de40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fe6a38ba50 0x55fe6a38de40 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fe6a387300 msgr2=0x55fe6a389790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fe6a387300 0x55fe6a389790 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1c5002e910 msgr2=0x7f1c5003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1c5002e910 0x7f1c5003a3c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55fe6a390620 msgr2=0x55fe6a392ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55fe6a390620 0x55fe6a392ae0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b3003c780 msgr2=0x7f1b3003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b3003c780 0x7f1b3003ec40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000ffd0 tx=0x7f1c50023040 comp rx=0 tx=0).stop 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 msgr2=0x55fe6a37bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2069295883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a374910 0x55fe6a37bd40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1c5807d750 tx=0x7f1c58052ee0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 reap_dead start 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c663e1640 1 -- 172.21.15.192:0/2069295883 reap_dead start 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 shutdown_connections 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 >> 172.21.15.192:0/2069295883 conn(0x55fe6a370d10 msgr2=0x55fe6a36ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 shutdown_connections 2024-09-10T05:11:49.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.593+0000 7f1c6a412800 1 -- 172.21.15.192:0/2069295883 wait complete. 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/1909223401 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b4003c8d0 msgr2=0x7f1b4003ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 --2- 172.21.15.192:0/1909223401 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b4003c8d0 0x7f1b4003ed90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55fe6a349e60 tx=0x7f1c50006000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/1909223401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a33c010 msgr2=0x55fe6a33a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 --2- 172.21.15.192:0/1909223401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a33c010 0x55fe6a33a880 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1c58052560 tx=0x7f1c5807ce00 comp rx=0 tx=0).stop 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/1909223401 shutdown_connections 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 --2- 172.21.15.192:0/1909223401 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b4003c8d0 0x7f1b4003ed90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 --2- 172.21.15.192:0/1909223401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a33c010 0x55fe6a33a880 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/1909223401 >> 172.21.15.192:0/1909223401 conn(0x55fe6a35a280 msgr2=0x55fe6a35a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/1909223401 shutdown_connections 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/1909223401 wait complete. 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fe6a351750 msgr2=0x55fe6a353bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fe6a351750 0x55fe6a353bf0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fe6a251030 msgr2=0x55fe6a34f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fe6a251030 0x55fe6a34f3f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55fe6a3557e0 msgr2=0x55fe6a357bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55fe6a3557e0 0x55fe6a357bd0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b4c03c780 msgr2=0x7f1b4c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1b4c03c780 0x7f1b4c03ec40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1c50000c00 tx=0x7f1c500013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 msgr2=0x55fe6a347da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 --2- 172.21.15.192:0/2700826679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe6a24fdf0 0x55fe6a347da0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800a470 tx=0x7f1c58002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c663e1640 1 -- 172.21.15.192:0/2700826679 reap_dead start 2024-09-10T05:11:49.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 shutdown_connections 2024-09-10T05:11:49.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 >> 172.21.15.192:0/2700826679 conn(0x55fe6a24b1c0 msgr2=0x55fe6a339d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 shutdown_connections 2024-09-10T05:11:49.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.594+0000 7f1c6a412800 1 -- 172.21.15.192:0/2700826679 wait complete. 2024-09-10T05:11:49.610 INFO:teuthology.orchestra.run.smithi192.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"236edb0a-22f9-4c79-a204-203688ed4bab","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1","marker":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T05:11:49.045054Z","creation_time":"2024-09-10T05:11:49.040226Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-10T05:11:49.611 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '236edb0a-22f9-4c79-a204-203688ed4bab', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1', 'marker': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:11:49.045054Z', 'creation_time': '2024-09-10T05:11:49.040226Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T05:11:49.611 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-10T05:11:49.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-10T05:11:49.611 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-10T05:11:49.655 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:49.656 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:49.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.655+0000 7f3f516bb800 1 Processor -- start 2024-09-10T05:11:49.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.655+0000 7f3f516bb800 1 -- start start 2024-09-10T05:11:49.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.655+0000 7f3f516bb800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55804770b200 0x55804770d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.655+0000 7f3f516bb800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580475b0e40 con 0x558047707600 2024-09-10T05:11:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.655+0000 7f3f516bb800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55804757b680 con 0x55804770b200 2024-09-10T05:11:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.656+0000 7f3f469a4640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55804770b200 0x55804770d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.656+0000 7f3f4f1a5640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x558047707600 0x5580477099f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36374/0 (socket says 172.21.15.192:36374) 2024-09-10T05:11:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.656+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/798252060 learned_addr learned my addr 172.21.15.192:0/798252060 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.656+0000 7f3f4e9a4640 1 -- 172.21.15.192:0/798252060 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1758888115 0 0) 0x5580475b0e40 con 0x558047707600 2024-09-10T05:11:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.656+0000 7f3f4e9a4640 1 -- 172.21.15.192:0/798252060 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f3c001e10 con 0x558047707600 2024-09-10T05:11:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.656+0000 7f3f469a4640 1 -- 172.21.15.192:0/798252060 >> v1:172.21.15.139:6789/0 conn(0x558047707600 legacy=0x5580477099f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.656+0000 7f3f469a4640 1 -- 172.21.15.192:0/798252060 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580475976b0 con 0x55804770b200 2024-09-10T05:11:49.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.658+0000 7f3f469a4640 1 --2- 172.21.15.192:0/798252060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804770b200 0x55804770d6c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800a470 tx=0x7f3f38045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec54e7d6c3318c0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.658+0000 7f3f4e9a4640 1 -- 172.21.15.192:0/798252060 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38059070 con 0x55804770b200 2024-09-10T05:11:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.658+0000 7f3f4e9a4640 1 -- 172.21.15.192:0/798252060 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f38054570 con 0x55804770b200 2024-09-10T05:11:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.658+0000 7f3f4e9a4640 1 -- 172.21.15.192:0/798252060 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38054850 con 0x55804770b200 2024-09-10T05:11:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.658+0000 7f3f516bb800 1 -- 172.21.15.192:0/798252060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804770b200 msgr2=0x55804770d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.659+0000 7f3f516bb800 1 --2- 172.21.15.192:0/798252060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804770b200 0x55804770d6c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800a470 tx=0x7f3f38045920 comp rx=0 tx=0).stop 2024-09-10T05:11:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.659+0000 7f3f516bb800 1 -- 172.21.15.192:0/798252060 shutdown_connections 2024-09-10T05:11:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.659+0000 7f3f516bb800 1 --2- 172.21.15.192:0/798252060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804770b200 0x55804770d6c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.659+0000 7f3f516bb800 1 -- 172.21.15.192:0/798252060 >> 172.21.15.192:0/798252060 conn(0x5580477011c0 msgr2=0x558047703620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.659+0000 7f3f516bb800 1 -- 172.21.15.192:0/798252060 shutdown_connections 2024-09-10T05:11:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.659+0000 7f3f516bb800 1 -- 172.21.15.192:0/798252060 wait complete. 2024-09-10T05:11:49.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.672+0000 7f3f516bb800 1 Processor -- start 2024-09-10T05:11:49.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.672+0000 7f3f516bb800 1 -- start start 2024-09-10T05:11:49.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.672+0000 7f3f516bb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 0x558047706d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.672+0000 7f3f516bb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55804759fdd0 con 0x558047707600 2024-09-10T05:11:49.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.673+0000 7f3f4f1a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 0x558047706d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.673+0000 7f3f4f1a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 0x558047706d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60390/0 (socket says 172.21.15.192:60390) 2024-09-10T05:11:49.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.673+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/1026364799 learned_addr learned my addr 172.21.15.192:0/1026364799 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.673+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/1026364799 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580475b8e10 con 0x558047707600 2024-09-10T05:11:49.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.673+0000 7f3f4f1a5640 1 --2- 172.21.15.192:0/1026364799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 0x558047706d70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3f40001e30 tx=0x7f3f4000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eced2bb859f1d1ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.673+0000 7f3e3d60a640 1 -- 172.21.15.192:0/1026364799 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40012020 con 0x558047707600 2024-09-10T05:11:49.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.673+0000 7f3e3d60a640 1 -- 172.21.15.192:0/1026364799 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f4000e470 con 0x558047707600 2024-09-10T05:11:49.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.673+0000 7f3e3d60a640 1 -- 172.21.15.192:0/1026364799 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4000e790 con 0x558047707600 2024-09-10T05:11:49.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.674+0000 7f3f516bb800 1 -- 172.21.15.192:0/1026364799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 msgr2=0x558047706d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.674+0000 7f3f516bb800 1 --2- 172.21.15.192:0/1026364799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 0x558047706d70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3f40001e30 tx=0x7f3f4000b780 comp rx=0 tx=0).stop 2024-09-10T05:11:49.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.674+0000 7f3f516bb800 1 -- 172.21.15.192:0/1026364799 shutdown_connections 2024-09-10T05:11:49.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.674+0000 7f3f516bb800 1 --2- 172.21.15.192:0/1026364799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 0x558047706d70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.674+0000 7f3f516bb800 1 -- 172.21.15.192:0/1026364799 >> 172.21.15.192:0/1026364799 conn(0x5580477011c0 msgr2=0x5580477f1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.674+0000 7f3f516bb800 1 -- 172.21.15.192:0/1026364799 shutdown_connections 2024-09-10T05:11:49.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.674+0000 7f3f516bb800 1 -- 172.21.15.192:0/1026364799 wait complete. 2024-09-10T05:11:49.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.674+0000 7f3f516bb800 1 Processor -- start 2024-09-10T05:11:49.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.674+0000 7f3f516bb800 1 -- start start 2024-09-10T05:11:49.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.674+0000 7f3f516bb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 0x558047800020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.674+0000 7f3f516bb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55804770e040 con 0x558047707600 2024-09-10T05:11:49.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.675+0000 7f3f4f1a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 0x558047800020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.675+0000 7f3f4f1a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 0x558047800020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60402/0 (socket says 172.21.15.192:60402) 2024-09-10T05:11:49.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.675+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/224205002 learned_addr learned my addr 172.21.15.192:0/224205002 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.675+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/224205002 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558047800580 con 0x558047707600 2024-09-10T05:11:49.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.675+0000 7f3f4f1a5640 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 0x558047800020 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5580477068a0 tx=0x7f3f400040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.675+0000 7f3e3be07640 1 -- 172.21.15.192:0/224205002 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40012030 con 0x558047707600 2024-09-10T05:11:49.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.675+0000 7f3e3be07640 1 -- 172.21.15.192:0/224205002 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f4001a7a0 con 0x558047707600 2024-09-10T05:11:49.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.675+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558047800810 con 0x558047707600 2024-09-10T05:11:49.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.675+0000 7f3e3be07640 1 -- 172.21.15.192:0/224205002 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4001aaa0 con 0x558047707600 2024-09-10T05:11:49.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.675+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558047801210 con 0x558047707600 2024-09-10T05:11:49.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.676+0000 7f3e3be07640 1 -- 172.21.15.192:0/224205002 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3f40015020 con 0x558047707600 2024-09-10T05:11:49.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.676+0000 7f3e3be07640 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e3403c780 0x7f3e3403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.676+0000 7f3e3be07640 1 -- 172.21.15.192:0/224205002 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3f40020070 con 0x558047707600 2024-09-10T05:11:49.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.676+0000 7f3f469a4640 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e3403c780 0x7f3e3403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.677+0000 7f3f516bb800 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55804770b200 0x558047807670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.677+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047801df0 con 0x55804770b200 2024-09-10T05:11:49.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.677+0000 7f3f4f9a6640 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55804770b200 0x558047807670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.677+0000 7f3f469a4640 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e3403c780 0x7f3e3403ec40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x558047679540 tx=0x7f3f38050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.677+0000 7f3f4f9a6640 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55804770b200 0x558047807670 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.677+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/224205002 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804770b200 2024-09-10T05:11:49.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.677+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580478016f0 con 0x55804770b200 2024-09-10T05:11:49.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.677+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/224205002 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804770b200 2024-09-10T05:11:49.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.678+0000 7f3f516bb800 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x558047809b60 0x55804780bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.678+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55804780c620 con 0x558047809b60 2024-09-10T05:11:49.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.678+0000 7f3f4f1a5640 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x558047809b60 0x55804780bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.678+0000 7f3f4f1a5640 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x558047809b60 0x55804780bf50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.678+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/224205002 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f40018950 con 0x558047809b60 2024-09-10T05:11:49.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.678+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047808a00 con 0x55804770b200 2024-09-10T05:11:49.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.679+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/224205002 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804770b200 2024-09-10T05:11:49.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.679+0000 7f3f516bb800 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55804780da60 0x55804780fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.679+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047810550 con 0x55804780da60 2024-09-10T05:11:49.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.679+0000 7f3f469a4640 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55804780da60 0x55804780fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.679+0000 7f3f469a4640 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55804780da60 0x55804780fe50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.679+0000 7f3f469a4640 1 -- 172.21.15.192:0/224205002 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3f38061430 con 0x55804780da60 2024-09-10T05:11:49.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.680+0000 7f3f516bb800 1 Processor -- start 2024-09-10T05:11:49.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.680+0000 7f3f516bb800 1 -- start start 2024-09-10T05:11:49.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.680+0000 7f3f516bb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804781e1b0 0x55804781e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.680+0000 7f3f516bb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5580475fda00 con 0x55804781e1b0 2024-09-10T05:11:49.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.680+0000 7f3f4f1a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804781e1b0 0x55804781e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.680+0000 7f3f4f1a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804781e1b0 0x55804781e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60416/0 (socket says 172.21.15.192:60416) 2024-09-10T05:11:49.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.680+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/4189910006 learned_addr learned my addr 172.21.15.192:0/4189910006 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.680+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/4189910006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55804781ec10 con 0x55804781e1b0 2024-09-10T05:11:49.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.680+0000 7f3f4f1a5640 1 --2- 172.21.15.192:0/4189910006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804781e1b0 0x55804781e5d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000c010 tx=0x7f3f40018720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.680+0000 7f3e39602640 1 -- 172.21.15.192:0/4189910006 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4004b160 con 0x55804781e1b0 2024-09-10T05:11:49.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.680+0000 7f3e39602640 1 -- 172.21.15.192:0/4189910006 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f4004b300 con 0x55804781e1b0 2024-09-10T05:11:49.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.681+0000 7f3f516bb800 1 -- 172.21.15.192:0/4189910006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55804781f440 con 0x55804781e1b0 2024-09-10T05:11:49.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.681+0000 7f3e39602640 1 -- 172.21.15.192:0/4189910006 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4004b4b0 con 0x55804781e1b0 2024-09-10T05:11:49.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.681+0000 7f3f516bb800 1 -- 172.21.15.192:0/4189910006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55804781f440 con 0x55804781e1b0 2024-09-10T05:11:49.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.681+0000 7f3e39602640 1 -- 172.21.15.192:0/4189910006 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3f4002c800 con 0x55804781e1b0 2024-09-10T05:11:49.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.681+0000 7f3e39602640 1 --2- 172.21.15.192:0/4189910006 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e2803c780 0x7f3e2803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.681+0000 7f3e39602640 1 -- 172.21.15.192:0/4189910006 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3f40037c70 con 0x55804781e1b0 2024-09-10T05:11:49.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.682+0000 7f3f469a4640 1 --2- 172.21.15.192:0/4189910006 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e2803c780 0x7f3e2803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.682+0000 7f3f516bb800 1 Processor -- start 2024-09-10T05:11:49.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.682+0000 7f3f516bb800 1 -- start start 2024-09-10T05:11:49.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.682+0000 7f3f469a4640 1 --2- 172.21.15.192:0/4189910006 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e2803c780 0x7f3e2803ec40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x558047807ce0 tx=0x7f3f38005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.682+0000 7f3f516bb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 0x55804782ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.682+0000 7f3f516bb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558047705610 con 0x55804782a880 2024-09-10T05:11:49.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.682+0000 7f3f4f1a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 0x55804782ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.682+0000 7f3f4f1a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 0x55804782ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60420/0 (socket says 172.21.15.192:60420) 2024-09-10T05:11:49.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.682+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/4213660235 learned_addr learned my addr 172.21.15.192:0/4213660235 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.683+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/4213660235 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55804782b270 con 0x55804782a880 2024-09-10T05:11:49.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.683+0000 7f3f4f1a5640 1 --2- 172.21.15.192:0/4213660235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 0x55804782ac80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3f4003a030 tx=0x7f3f4002d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422510349602d71f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.683+0000 7f3e32ffd640 1 -- 172.21.15.192:0/4213660235 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40063070 con 0x55804782a880 2024-09-10T05:11:49.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.683+0000 7f3e32ffd640 1 -- 172.21.15.192:0/4213660235 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f40024d30 con 0x55804782a880 2024-09-10T05:11:49.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.683+0000 7f3e32ffd640 1 -- 172.21.15.192:0/4213660235 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4005a040 con 0x55804782a880 2024-09-10T05:11:49.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.683+0000 7f3f516bb800 1 -- 172.21.15.192:0/4213660235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 msgr2=0x55804782ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.683+0000 7f3f516bb800 1 --2- 172.21.15.192:0/4213660235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 0x55804782ac80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3f4003a030 tx=0x7f3f4002d8d0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.683+0000 7f3f516bb800 1 -- 172.21.15.192:0/4213660235 shutdown_connections 2024-09-10T05:11:49.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.683+0000 7f3f516bb800 1 --2- 172.21.15.192:0/4213660235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 0x55804782ac80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.683+0000 7f3f516bb800 1 -- 172.21.15.192:0/4213660235 >> 172.21.15.192:0/4213660235 conn(0x558047826c80 msgr2=0x558047824ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.683+0000 7f3f516bb800 1 -- 172.21.15.192:0/4213660235 shutdown_connections 2024-09-10T05:11:49.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.683+0000 7f3f516bb800 1 -- 172.21.15.192:0/4213660235 wait complete. 2024-09-10T05:11:49.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.684+0000 7f3f516bb800 1 Processor -- start 2024-09-10T05:11:49.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.684+0000 7f3f516bb800 1 -- start start 2024-09-10T05:11:49.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.684+0000 7f3f516bb800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 0x558047831d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.684+0000 7f3f516bb800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55804782b6e0 con 0x55804782a880 2024-09-10T05:11:49.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.684+0000 7f3f4f1a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 0x558047831d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.684+0000 7f3f4f1a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 0x558047831d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60436/0 (socket says 172.21.15.192:60436) 2024-09-10T05:11:49.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.684+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 learned_addr learned my addr 172.21.15.192:0/425925828 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.684+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558047832270 con 0x55804782a880 2024-09-10T05:11:49.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.684+0000 7f3f4f1a5640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 0x558047831d10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3f40000c00 tx=0x7f3f4000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.684+0000 7f3e317fa640 1 -- 172.21.15.192:0/425925828 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4006c020 con 0x55804782a880 2024-09-10T05:11:49.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.685+0000 7f3e317fa640 1 -- 172.21.15.192:0/425925828 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f400535d0 con 0x55804782a880 2024-09-10T05:11:49.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.685+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558047832270 con 0x55804782a880 2024-09-10T05:11:49.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.685+0000 7f3e317fa640 1 -- 172.21.15.192:0/425925828 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40063040 con 0x55804782a880 2024-09-10T05:11:49.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.685+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558047832270 con 0x55804782a880 2024-09-10T05:11:49.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.685+0000 7f3e317fa640 1 -- 172.21.15.192:0/425925828 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3f4006f020 con 0x55804782a880 2024-09-10T05:11:49.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.686+0000 7f3e317fa640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e1803c730 0x7f3e1803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.686+0000 7f3e317fa640 1 -- 172.21.15.192:0/425925828 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3f40072c40 con 0x55804782a880 2024-09-10T05:11:49.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.686+0000 7f3f469a4640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e1803c730 0x7f3e1803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.686+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.686+0000 7f3f516bb800 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55804783d2a0 0x55804783f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.686+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55804783fe80 con 0x55804783d2a0 2024-09-10T05:11:49.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.686+0000 7f3f4f9a6640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55804783d2a0 0x55804783f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.686+0000 7f3f469a4640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e1803c730 0x7f3e1803ebf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x558047810950 tx=0x7f3f38063040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.686+0000 7f3f4f9a6640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55804783d2a0 0x55804783f730 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 20 realm 2024-09-10T05:11:49.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047840290 con 0x55804783d2a0 2024-09-10T05:11:49.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:49.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047840b60 con 0x55804783d2a0 2024-09-10T05:11:49.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047840f00 con 0x55804783d2a0 2024-09-10T05:11:49.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:49.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5580478419f0 0x558047843de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047844520 con 0x5580478419f0 2024-09-10T05:11:49.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.687+0000 7f3f4f1a5640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5580478419f0 0x558047843de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.688+0000 7f3f4f1a5640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5580478419f0 0x558047843de0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.688+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.688+0000 7f3f516bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:49.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.688+0000 7f3f516bb800 20 searching for the correct realm 2024-09-10T05:11:49.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.688+0000 7f3f516bb800 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5580478465c0 0x558047848a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.688+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x5580478465c0 2024-09-10T05:11:49.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.688+0000 7f3f469a4640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5580478465c0 0x558047848a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.689+0000 7f3f469a4640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5580478465c0 0x558047848a80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.689+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.689+0000 7f3f469a4640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3f38077040 0x7f3f38084920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.689+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x7f3f38077040 2024-09-10T05:11:49.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.689+0000 7f3f4f9a6640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3f38077040 0x7f3f38084920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.689+0000 7f3f4f9a6640 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3f38077040 0x7f3f38084920 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.690+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.690+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x5580478419f0 2024-09-10T05:11:49.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.690+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.690+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x55804783d2a0 2024-09-10T05:11:49.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.690+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.690+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x55804783d2a0 2024-09-10T05:11:49.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.690+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.690+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x5580478419f0 2024-09-10T05:11:49.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.691+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.691+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x5580478419f0 2024-09-10T05:11:49.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.691+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.691+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x7f3f38077040 2024-09-10T05:11:49.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.691+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.691+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x5580478465c0 2024-09-10T05:11:49.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.691+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.691+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x55804783d2a0 2024-09-10T05:11:49.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.692+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.692+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x5580478419f0 2024-09-10T05:11:49.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.692+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.692+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x55804783d2a0 2024-09-10T05:11:49.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.692+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.692+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x7f3f38077040 2024-09-10T05:11:49.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.692+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.692+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558047849150 con 0x5580478465c0 2024-09-10T05:11:49.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.692+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.693+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x5580478465c0 2024-09-10T05:11:49.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.693+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.693+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x5580478419f0 2024-09-10T05:11:49.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.693+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.693+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x5580478465c0 2024-09-10T05:11:49.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.693+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.693+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x5580478465c0 2024-09-10T05:11:49.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.693+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.693+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x55804783d2a0 2024-09-10T05:11:49.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.694+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.694+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x55804783d2a0 2024-09-10T05:11:49.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.694+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.694+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x5580478419f0 2024-09-10T05:11:49.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.694+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.694+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x5580478465c0 2024-09-10T05:11:49.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.694+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.694+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x7f3f38077040 2024-09-10T05:11:49.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.694+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.694+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x55804783d2a0 2024-09-10T05:11:49.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.695+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.695+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x5580478419f0 2024-09-10T05:11:49.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.695+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.695+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x5580478465c0 2024-09-10T05:11:49.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.695+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.695+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x5580478419f0 2024-09-10T05:11:49.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.695+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.695+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x7f3f38077040 2024-09-10T05:11:49.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.696+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.696+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x5580478465c0 2024-09-10T05:11:49.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.696+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.696+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x5580478419f0 2024-09-10T05:11:49.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.696+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.696+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x55804783d2a0 2024-09-10T05:11:49.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.696+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.696+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f3f38091040 con 0x7f3f38077040 2024-09-10T05:11:49.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:49.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:49.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:49.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:49.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:49.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:49.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047844fc0 con 0x55804783d2a0 2024-09-10T05:11:49.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580478453b0 con 0x55804783d2a0 2024-09-10T05:11:49.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:49.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580478453b0 con 0x7f3f38077040 2024-09-10T05:11:49.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:49.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.697+0000 7f3f516bb800 20 zone default found 2024-09-10T05:11:49.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 4 Realm: () 2024-09-10T05:11:49.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 20 zonegroup default 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580478457d0 con 0x5580478419f0 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55804784afc0 con 0x5580478465c0 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55804784b360 con 0x5580478465c0 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 20 started sync module instance, tier type = 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.698+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784a460 con 0x7f3f38077040 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.699+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.699+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94009444051328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784a460 con 0x7f3f38077040 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.699+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784be00 con 0x55804783d2a0 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.700+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94009444051328] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.701+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.701+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94009444055280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784a460 con 0x55804783d2a0 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.701+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784c880 con 0x5580478465c0 2024-09-10T05:11:49.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.701+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94009444055280] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.702+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.702+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94009444048816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784a3d0 con 0x5580478465c0 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.702+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784d640 con 0x7f3f38077040 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.703+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94009444048816] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.703+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.703+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94009444060320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784da60 con 0x7f3f38077040 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.703+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784e4a0 con 0x55804783d2a0 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.704+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.704+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94009444065136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784e460 con 0x55804783d2a0 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.704+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784f480 con 0x5580478419f0 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.704+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94009444060320] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.705+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.705+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94009444069264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784f870 con 0x5580478419f0 2024-09-10T05:11:49.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.705+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94009444065136] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.705+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55804784e890 con 0x5580478419f0 2024-09-10T05:11:49.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.706+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94009444069264] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.706+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.706+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94009444072832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558047850650 con 0x5580478419f0 2024-09-10T05:11:49.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.706+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558047850ea0 con 0x5580478419f0 2024-09-10T05:11:49.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.707+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.707+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94009444072832] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.707+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94009444075568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558047850cd0 con 0x5580478419f0 2024-09-10T05:11:49.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.707+0000 7f3f516bb800 20 add_watcher() i=0 2024-09-10T05:11:49.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.707+0000 7f3f516bb800 20 add_watcher() i=1 2024-09-10T05:11:49.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.707+0000 7f3f516bb800 20 add_watcher() i=2 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.707+0000 7f3f516bb800 20 add_watcher() i=3 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.707+0000 7f3f516bb800 20 add_watcher() i=4 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.707+0000 7f3f516bb800 20 add_watcher() i=5 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.707+0000 7f3f516bb800 20 add_watcher() i=6 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.708+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94009444075568] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.708+0000 7f3f516bb800 20 add_watcher() i=7 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.708+0000 7f3f516bb800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.708+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047854240 con 0x55804783d2a0 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.708+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.708+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94009444073888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558047851760 con 0x55804783d2a0 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.709+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94009444073888] v35'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.709+0000 7f3e05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:49.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.709+0000 7f3f516bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.709+0000 7f3f516bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.710+0000 7f3f516bb800 5 note: GC not initialized 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.710+0000 7f3e04fe1640 20 reqs_thread_entry: start 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.710+0000 7f3f516bb800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.710+0000 7f3f516bb800 20 Filter name: none 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.710+0000 7f3d7e7fc640 20 reqs_thread_entry: start 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.710+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.710+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047886e50 con 0x55804783d2a0 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.710+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.710+0000 7f3f516bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.710+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.710+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580478876e0 con 0x55804783d2a0 2024-09-10T05:11:49.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.711+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.711+0000 7f3f516bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.711+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580478886f0 con 0x7f3f38077040 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.711+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.711+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.711+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047886050 con 0x7f3f38077040 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.711+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.711+0000 7f3f516bb800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.711+0000 7f3f516bb800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.711+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047888590 con 0x5580478465c0 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(66 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:11:49.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 4.5 4:a13f7d51:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047888050 con 0x5580478465c0 2024-09-10T05:11:49.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:68 4.23 4:c5bf8a98:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55804788d200 con 0x5580478419f0 2024-09-10T05:11:49.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 4.26 4:6764b625:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55804788fc80 con 0x5580478419f0 2024-09-10T05:11:49.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:70 4.19 4:9b146b93:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047892530 con 0x5580478465c0 2024-09-10T05:11:49.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 4.2a 4:54fd2db9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558047894da0 con 0x55804783d2a0 2024-09-10T05:11:49.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 4.23 4:c6e2b706:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580478979f0 con 0x5580478419f0 2024-09-10T05:11:49.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:73 4.e 4:71344637:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55804789a3e0 con 0x7f3f38077040 2024-09-10T05:11:49.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:74 4.29 4:950bf6db:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55804789a3e0 con 0x5580478465c0 2024-09-10T05:11:49.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:75 4.d 4:b0727371:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55804789f240 con 0x5580478465c0 2024-09-10T05:11:49.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 4.26 4:64e4daa4:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580478a1ce0 con 0x5580478419f0 2024-09-10T05:11:49.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:77 4.3f 4:fc8f57a3:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580478a4710 con 0x7f3f38077040 2024-09-10T05:11:49.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(68 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(71 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(69 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(72 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.5 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(73 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.712+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(70 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.713+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(76 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.713+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(74 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.713+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(77 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.713+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(75 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.713+0000 7f3e05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.713+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94009444073888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580478a1ce0 con 0x55804783d2a0 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.714+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94009444073888] v35'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.714+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94009444051328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558047884db0 con 0x7f3f38077040 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.715+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94009444051328] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.715+0000 7f3f516bb800 20 remove_watcher() i=0 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.715+0000 7f3f516bb800 2 removed watcher, disabling cache 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.715+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94009444055280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558047884db0 con 0x55804783d2a0 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.716+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94009444055280] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.717+0000 7f3f516bb800 20 remove_watcher() i=1 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.717+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94009444048816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558047884db0 con 0x5580478465c0 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.717+0000 7f3f469a4640 1 -- 172.21.15.192:0/425925828 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94009444048816] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f38082070 con 0x5580478465c0 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.717+0000 7f3f516bb800 20 remove_watcher() i=2 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.717+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94009444060320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558047884db0 con 0x7f3f38077040 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.718+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94009444060320] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x7f3f38077040 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.718+0000 7f3f516bb800 20 remove_watcher() i=3 2024-09-10T05:11:49.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.718+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94009444065136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558047884db0 con 0x55804783d2a0 2024-09-10T05:11:49.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.719+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94009444065136] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f4800a4d0 con 0x55804783d2a0 2024-09-10T05:11:49.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.719+0000 7f3f516bb800 20 remove_watcher() i=4 2024-09-10T05:11:49.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.719+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94009444069264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558047884db0 con 0x5580478419f0 2024-09-10T05:11:49.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.720+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94009444069264] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.720+0000 7f3f516bb800 20 remove_watcher() i=5 2024-09-10T05:11:49.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.720+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94009444072832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558047884db0 con 0x5580478419f0 2024-09-10T05:11:49.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.721+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94009444072832] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.721+0000 7f3f516bb800 20 remove_watcher() i=6 2024-09-10T05:11:49.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.721+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94009444075568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558047884db0 con 0x5580478419f0 2024-09-10T05:11:49.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f4f1a5640 1 -- 172.21.15.192:0/425925828 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94009444075568] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f40066040 con 0x5580478419f0 2024-09-10T05:11:49.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 20 remove_watcher() i=7 2024-09-10T05:11:49.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5580478419f0 msgr2=0x558047843de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5580478419f0 0x558047843de0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55804783d2a0 msgr2=0x55804783f730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55804783d2a0 0x55804783f730 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3f38077040 msgr2=0x7f3f38084920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3f38077040 0x7f3f38084920 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5580478465c0 msgr2=0x558047848a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5580478465c0 0x558047848a80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e1803c730 msgr2=0x7f3e1803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e1803c730 0x7f3e1803ebf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x558047810950 tx=0x7f3f38063040 comp rx=0 tx=0).stop 2024-09-10T05:11:49.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 msgr2=0x558047831d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 --2- 172.21.15.192:0/425925828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804782a880 0x558047831d10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3f40000c00 tx=0x7f3f4000ff90 comp rx=0 tx=0).stop 2024-09-10T05:11:49.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/425925828 reap_dead start 2024-09-10T05:11:49.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 shutdown_connections 2024-09-10T05:11:49.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 >> 172.21.15.192:0/425925828 conn(0x558047826c80 msgr2=0x558047824e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 shutdown_connections 2024-09-10T05:11:49.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.722+0000 7f3f516bb800 1 -- 172.21.15.192:0/425925828 wait complete. 2024-09-10T05:11:49.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/4189910006 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e2803c780 msgr2=0x7f3e2803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 --2- 172.21.15.192:0/4189910006 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e2803c780 0x7f3e2803ec40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x558047807ce0 tx=0x7f3f38005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:49.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/4189910006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804781e1b0 msgr2=0x55804781e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 --2- 172.21.15.192:0/4189910006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804781e1b0 0x55804781e5d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000c010 tx=0x7f3f40018720 comp rx=0 tx=0).stop 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/4189910006 shutdown_connections 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 --2- 172.21.15.192:0/4189910006 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e2803c780 0x7f3e2803ec40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 --2- 172.21.15.192:0/4189910006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55804781e1b0 0x55804781e5d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/4189910006 >> 172.21.15.192:0/4189910006 conn(0x558047812560 msgr2=0x558047812940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/4189910006 shutdown_connections 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/4189910006 wait complete. 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x558047809b60 msgr2=0x55804780bf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x558047809b60 0x55804780bf50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55804770b200 msgr2=0x558047807670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55804770b200 0x558047807670 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55804780da60 msgr2=0x55804780fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55804780da60 0x55804780fe50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e3403c780 msgr2=0x7f3e3403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3e3403c780 0x7f3e3403ec40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x558047679540 tx=0x7f3f38050000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 msgr2=0x558047800020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 --2- 172.21.15.192:0/224205002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558047707600 0x558047800020 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5580477068a0 tx=0x7f3f400040e0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f4f9a6640 1 -- 172.21.15.192:0/224205002 reap_dead start 2024-09-10T05:11:49.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 shutdown_connections 2024-09-10T05:11:49.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 >> 172.21.15.192:0/224205002 conn(0x5580477011c0 msgr2=0x5580477f1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 shutdown_connections 2024-09-10T05:11:49.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.723+0000 7f3f516bb800 1 -- 172.21.15.192:0/224205002 wait complete. 2024-09-10T05:11:49.769 INFO:teuthology.orchestra.run.smithi192.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"236edb0a-22f9-4c79-a204-203688ed4bab","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1","marker":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T05:11:49.045054Z","creation_time":"2024-09-10T05:11:49.040226Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-10T05:11:49.770 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '236edb0a-22f9-4c79-a204-203688ed4bab', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1', 'marker': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:11:49.045054Z', 'creation_time': '2024-09-10T05:11:49.040226Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-10T05:11:49.776 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T05:11:49.777 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T05:11:49.777 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T05:11:49.777 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T05:11:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:49.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.821+0000 7f331fd26800 1 Processor -- start 2024-09-10T05:11:49.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.821+0000 7f331fd26800 1 -- start start 2024-09-10T05:11:49.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.821+0000 7f331fd26800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55eec4698680 0x55eec469aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.821+0000 7f331fd26800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eec4541e40 con 0x55eec469b010 2024-09-10T05:11:49.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.821+0000 7f331fd26800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55eec450c680 con 0x55eec4698680 2024-09-10T05:11:49.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.821+0000 7f331b95d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55eec4698680 0x55eec469aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.821+0000 7f331b15c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55eec469b010 0x55eec469d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36386/0 (socket says 172.21.15.192:36386) 2024-09-10T05:11:49.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.821+0000 7f331b15c640 1 -- 172.21.15.192:0/1165381011 learned_addr learned my addr 172.21.15.192:0/1165381011 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:49.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.821+0000 7f331b95d640 1 -- 172.21.15.192:0/1165381011 >> v1:172.21.15.139:6789/0 conn(0x55eec469b010 legacy=0x55eec469d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.822+0000 7f331b95d640 1 -- 172.21.15.192:0/1165381011 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec45286b0 con 0x55eec4698680 2024-09-10T05:11:49.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.822+0000 7f331a95b640 1 -- 172.21.15.192:0/1165381011 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766283722 0 0) 0x55eec4541e40 con 0x55eec469b010 2024-09-10T05:11:49.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.823+0000 7f331b95d640 1 --2- 172.21.15.192:0/1165381011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec469aa70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f330c00a470 tx=0x7f330c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839f5f3c19cf8de6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.823+0000 7f331a95b640 1 -- 172.21.15.192:0/1165381011 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c053570 con 0x55eec4698680 2024-09-10T05:11:49.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.823+0000 7f331a95b640 1 -- 172.21.15.192:0/1165381011 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c058070 con 0x55eec4698680 2024-09-10T05:11:49.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.823+0000 7f331a95b640 1 -- 172.21.15.192:0/1165381011 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c053880 con 0x55eec4698680 2024-09-10T05:11:49.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.824+0000 7f331fd26800 1 -- 172.21.15.192:0/1165381011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 msgr2=0x55eec469aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.824+0000 7f331fd26800 1 --2- 172.21.15.192:0/1165381011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec469aa70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f330c00a470 tx=0x7f330c045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:49.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.824+0000 7f331fd26800 1 -- 172.21.15.192:0/1165381011 shutdown_connections 2024-09-10T05:11:49.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.824+0000 7f331fd26800 1 --2- 172.21.15.192:0/1165381011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec469aa70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.824+0000 7f331fd26800 1 -- 172.21.15.192:0/1165381011 >> 172.21.15.192:0/1165381011 conn(0x55eec46921c0 msgr2=0x55eec4694620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.824+0000 7f331fd26800 1 -- 172.21.15.192:0/1165381011 shutdown_connections 2024-09-10T05:11:49.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.824+0000 7f331fd26800 1 -- 172.21.15.192:0/1165381011 wait complete. 2024-09-10T05:11:49.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.838+0000 7f331fd26800 1 Processor -- start 2024-09-10T05:11:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.838+0000 7f331fd26800 1 -- start start 2024-09-10T05:11:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.838+0000 7f331fd26800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec4787430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.838+0000 7f331fd26800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55eec4530dd0 con 0x55eec4698680 2024-09-10T05:11:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.838+0000 7f331b95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec4787430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.838+0000 7f331b95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec4787430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60454/0 (socket says 172.21.15.192:60454) 2024-09-10T05:11:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.838+0000 7f331b95d640 1 -- 172.21.15.192:0/2115207012 learned_addr learned my addr 172.21.15.192:0/2115207012 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.838+0000 7f331b95d640 1 -- 172.21.15.192:0/2115207012 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec4549e10 con 0x55eec4698680 2024-09-10T05:11:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.839+0000 7f331b95d640 1 --2- 172.21.15.192:0/2115207012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec4787430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f330c025c20 tx=0x7f330c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ed65ded1c2f4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.839+0000 7f3209e0b640 1 -- 172.21.15.192:0/2115207012 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c053a20 con 0x55eec4698680 2024-09-10T05:11:49.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.839+0000 7f3209e0b640 1 -- 172.21.15.192:0/2115207012 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c063070 con 0x55eec4698680 2024-09-10T05:11:49.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.839+0000 7f3209e0b640 1 -- 172.21.15.192:0/2115207012 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c053d30 con 0x55eec4698680 2024-09-10T05:11:49.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.839+0000 7f331fd26800 1 -- 172.21.15.192:0/2115207012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 msgr2=0x55eec4787430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.839+0000 7f331fd26800 1 --2- 172.21.15.192:0/2115207012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec4787430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f330c025c20 tx=0x7f330c051000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.840+0000 7f331fd26800 1 -- 172.21.15.192:0/2115207012 shutdown_connections 2024-09-10T05:11:49.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.840+0000 7f331fd26800 1 --2- 172.21.15.192:0/2115207012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec4787430 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.840+0000 7f331fd26800 1 -- 172.21.15.192:0/2115207012 >> 172.21.15.192:0/2115207012 conn(0x55eec46921c0 msgr2=0x55eec4782db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.840+0000 7f331fd26800 1 -- 172.21.15.192:0/2115207012 shutdown_connections 2024-09-10T05:11:49.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.840+0000 7f331fd26800 1 -- 172.21.15.192:0/2115207012 wait complete. 2024-09-10T05:11:49.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.840+0000 7f331fd26800 1 Processor -- start 2024-09-10T05:11:49.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.840+0000 7f331fd26800 1 -- start start 2024-09-10T05:11:49.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.840+0000 7f331fd26800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec4697da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.840+0000 7f331fd26800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55eec469f030 con 0x55eec4698680 2024-09-10T05:11:49.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.840+0000 7f331b95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec4697da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.840+0000 7f331b95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec4697da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60462/0 (socket says 172.21.15.192:60462) 2024-09-10T05:11:49.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.840+0000 7f331b95d640 1 -- 172.21.15.192:0/3268934537 learned_addr learned my addr 172.21.15.192:0/3268934537 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.841+0000 7f331b95d640 1 -- 172.21.15.192:0/3268934537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec4698300 con 0x55eec4698680 2024-09-10T05:11:49.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.841+0000 7f331b95d640 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec4697da0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f330c025c20 tx=0x7f330c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.841+0000 7f3203fff640 1 -- 172.21.15.192:0/3268934537 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c078070 con 0x55eec4698680 2024-09-10T05:11:49.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.841+0000 7f3203fff640 1 -- 172.21.15.192:0/3268934537 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c073470 con 0x55eec4698680 2024-09-10T05:11:49.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.841+0000 7f3203fff640 1 -- 172.21.15.192:0/3268934537 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c073750 con 0x55eec4698680 2024-09-10T05:11:49.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.841+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eec46966b0 con 0x55eec4698680 2024-09-10T05:11:49.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.841+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eec4696cd0 con 0x55eec4698680 2024-09-10T05:11:49.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.842+0000 7f3203fff640 1 -- 172.21.15.192:0/3268934537 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f330c07b070 con 0x55eec4698680 2024-09-10T05:11:49.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.842+0000 7f3203fff640 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f320403c780 0x7f320403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.842+0000 7f3203fff640 1 -- 172.21.15.192:0/3268934537 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f330c097b80 con 0x55eec4698680 2024-09-10T05:11:49.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.842+0000 7f331b15c640 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f320403c780 0x7f320403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.842+0000 7f331fd26800 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55eec469b010 0x55eec47982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.842+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4798800 con 0x55eec469b010 2024-09-10T05:11:49.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.842+0000 7f331c15e640 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55eec469b010 0x55eec47982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.843+0000 7f331b15c640 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f320403c780 0x7f320403ec40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3310000c00 tx=0x7f33100013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.843+0000 7f331c15e640 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55eec469b010 0x55eec47982c0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.843+0000 7f331c15e640 1 -- 172.21.15.192:0/3268934537 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec469b010 2024-09-10T05:11:49.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.843+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4697180 con 0x55eec469b010 2024-09-10T05:11:49.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.843+0000 7f331c15e640 1 -- 172.21.15.192:0/3268934537 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec469b010 2024-09-10T05:11:49.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.843+0000 7f331fd26800 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55eec479aa70 0x55eec479ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.843+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec479d530 con 0x55eec479aa70 2024-09-10T05:11:49.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.844+0000 7f331b95d640 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55eec479aa70 0x55eec479ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.844+0000 7f331b95d640 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55eec479aa70 0x55eec479ce60 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.844+0000 7f331b95d640 1 -- 172.21.15.192:0/3268934537 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f330c07a030 con 0x55eec479aa70 2024-09-10T05:11:49.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.844+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4799940 con 0x55eec469b010 2024-09-10T05:11:49.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.844+0000 7f331c15e640 1 -- 172.21.15.192:0/3268934537 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec469b010 2024-09-10T05:11:49.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.844+0000 7f331fd26800 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55eec479e970 0x55eec47a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.844+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47a1460 con 0x55eec479e970 2024-09-10T05:11:49.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.845+0000 7f331b15c640 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55eec479e970 0x55eec47a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.845+0000 7f331b15c640 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55eec479e970 0x55eec47a0d60 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.845+0000 7f331b15c640 1 -- 172.21.15.192:0/3268934537 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f331000f670 con 0x55eec479e970 2024-09-10T05:11:49.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.845+0000 7f331fd26800 1 Processor -- start 2024-09-10T05:11:49.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.845+0000 7f331fd26800 1 -- start start 2024-09-10T05:11:49.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.846+0000 7f331fd26800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47af060 0x55eec47af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.846+0000 7f331fd26800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55eec458ea00 con 0x55eec47af060 2024-09-10T05:11:49.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.846+0000 7f331b95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47af060 0x55eec47af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.846+0000 7f331b95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47af060 0x55eec47af480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60476/0 (socket says 172.21.15.192:60476) 2024-09-10T05:11:49.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.846+0000 7f331b95d640 1 -- 172.21.15.192:0/3715741423 learned_addr learned my addr 172.21.15.192:0/3715741423 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.846+0000 7f331b95d640 1 -- 172.21.15.192:0/3715741423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec47afac0 con 0x55eec47af060 2024-09-10T05:11:49.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.846+0000 7f331b95d640 1 --2- 172.21.15.192:0/3715741423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47af060 0x55eec47af480 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f330c095f00 tx=0x7f330c05de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.846+0000 7f32017fa640 1 -- 172.21.15.192:0/3715741423 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c07c6a0 con 0x55eec47af060 2024-09-10T05:11:49.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.846+0000 7f32017fa640 1 -- 172.21.15.192:0/3715741423 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c07c840 con 0x55eec47af060 2024-09-10T05:11:49.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.846+0000 7f331fd26800 1 -- 172.21.15.192:0/3715741423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eec47b02f0 con 0x55eec47af060 2024-09-10T05:11:49.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.846+0000 7f32017fa640 1 -- 172.21.15.192:0/3715741423 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c0685e0 con 0x55eec47af060 2024-09-10T05:11:49.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.846+0000 7f331fd26800 1 -- 172.21.15.192:0/3715741423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eec47b0890 con 0x55eec47af060 2024-09-10T05:11:49.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.847+0000 7f32017fa640 1 -- 172.21.15.192:0/3715741423 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f330c068780 con 0x55eec47af060 2024-09-10T05:11:49.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.848+0000 7f32017fa640 1 --2- 172.21.15.192:0/3715741423 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f31f403c780 0x7f31f403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.848+0000 7f32017fa640 1 -- 172.21.15.192:0/3715741423 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f330c08f070 con 0x55eec47af060 2024-09-10T05:11:49.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.848+0000 7f331b15c640 1 --2- 172.21.15.192:0/3715741423 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f31f403c780 0x7f31f403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.848+0000 7f331fd26800 1 Processor -- start 2024-09-10T05:11:49.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.848+0000 7f331fd26800 1 -- start start 2024-09-10T05:11:49.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.848+0000 7f331b15c640 1 --2- 172.21.15.192:0/3715741423 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f31f403c780 0x7f31f403ec40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55eec4798c40 tx=0x7f3310006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.848+0000 7f331fd26800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 0x55eec47bbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.848+0000 7f331fd26800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55eec4787c20 con 0x55eec47bb8e0 2024-09-10T05:11:49.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.848+0000 7f331b95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 0x55eec47bbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.848+0000 7f331b95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 0x55eec47bbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60490/0 (socket says 172.21.15.192:60490) 2024-09-10T05:11:49.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.848+0000 7f331b95d640 1 -- 172.21.15.192:0/208144765 learned_addr learned my addr 172.21.15.192:0/208144765 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.849+0000 7f331b95d640 1 -- 172.21.15.192:0/208144765 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec47bc2b0 con 0x55eec47bb8e0 2024-09-10T05:11:49.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.849+0000 7f331b95d640 1 --2- 172.21.15.192:0/208144765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 0x55eec47bbcc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f330c04d0b0 tx=0x7f330c04d1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43060d9878b642ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.849+0000 7f31faffd640 1 -- 172.21.15.192:0/208144765 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c05c870 con 0x55eec47bb8e0 2024-09-10T05:11:49.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.849+0000 7f31faffd640 1 -- 172.21.15.192:0/208144765 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c0923c0 con 0x55eec47bb8e0 2024-09-10T05:11:49.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.849+0000 7f31faffd640 1 -- 172.21.15.192:0/208144765 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c073ad0 con 0x55eec47bb8e0 2024-09-10T05:11:49.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.849+0000 7f331fd26800 1 -- 172.21.15.192:0/208144765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 msgr2=0x55eec47bbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.849+0000 7f331fd26800 1 --2- 172.21.15.192:0/208144765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 0x55eec47bbcc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f330c04d0b0 tx=0x7f330c04d1a0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.849+0000 7f331fd26800 1 -- 172.21.15.192:0/208144765 shutdown_connections 2024-09-10T05:11:49.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.849+0000 7f331fd26800 1 --2- 172.21.15.192:0/208144765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 0x55eec47bbcc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.849+0000 7f331fd26800 1 -- 172.21.15.192:0/208144765 >> 172.21.15.192:0/208144765 conn(0x55eec47b7ce0 msgr2=0x55eec47b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.850+0000 7f331fd26800 1 -- 172.21.15.192:0/208144765 shutdown_connections 2024-09-10T05:11:49.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.850+0000 7f331fd26800 1 -- 172.21.15.192:0/208144765 wait complete. 2024-09-10T05:11:49.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.850+0000 7f331fd26800 1 Processor -- start 2024-09-10T05:11:49.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.850+0000 7f331fd26800 1 -- start start 2024-09-10T05:11:49.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.850+0000 7f331fd26800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 0x55eec47c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.850+0000 7f331fd26800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55eec47bc740 con 0x55eec47bb8e0 2024-09-10T05:11:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.850+0000 7f331b95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 0x55eec47c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.850+0000 7f331b95d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 0x55eec47c2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60498/0 (socket says 172.21.15.192:60498) 2024-09-10T05:11:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.850+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 learned_addr learned my addr 172.21.15.192:0/1524335080 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.850+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec47c3200 con 0x55eec47bb8e0 2024-09-10T05:11:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.851+0000 7f331b95d640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 0x55eec47c2ca0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f330c053730 tx=0x7f330c05af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.851+0000 7f31f97fa640 1 -- 172.21.15.192:0/1524335080 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c052bf0 con 0x55eec47bb8e0 2024-09-10T05:11:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.851+0000 7f31f97fa640 1 -- 172.21.15.192:0/1524335080 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c0bb070 con 0x55eec47bb8e0 2024-09-10T05:11:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.851+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eec47c3200 con 0x55eec47bb8e0 2024-09-10T05:11:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.851+0000 7f31f97fa640 1 -- 172.21.15.192:0/1524335080 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c07d660 con 0x55eec47bb8e0 2024-09-10T05:11:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.851+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eec47c3200 con 0x55eec47bb8e0 2024-09-10T05:11:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.852+0000 7f31f97fa640 1 -- 172.21.15.192:0/1524335080 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f330c07d800 con 0x55eec47bb8e0 2024-09-10T05:11:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.852+0000 7f31f97fa640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f31e403c730 0x7f31e403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.852+0000 7f31f97fa640 1 -- 172.21.15.192:0/1524335080 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f330c0ba180 con 0x55eec47bb8e0 2024-09-10T05:11:49.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.852+0000 7f331b15c640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f31e403c730 0x7f31e403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.852+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.852+0000 7f331fd26800 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55eec47ce250 0x55eec47d0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.852+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d0e60 con 0x55eec47ce250 2024-09-10T05:11:49.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.852+0000 7f331c15e640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55eec47ce250 0x55eec47d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.852+0000 7f331b15c640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f31e403c730 0x7f31e403ebf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f331000ffd0 tx=0x7f3310023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331c15e640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55eec47ce250 0x55eec47d0710 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331fd26800 20 realm 2024-09-10T05:11:49.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d1270 con 0x55eec47ce250 2024-09-10T05:11:49.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331fd26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:49.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d1b40 con 0x55eec47ce250 2024-09-10T05:11:49.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.853+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d1ee0 con 0x55eec47ce250 2024-09-10T05:11:49.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331fd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:49.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331fd26800 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55eec47d29d0 0x55eec47d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d29d0 2024-09-10T05:11:49.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331b95d640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55eec47d29d0 0x55eec47d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331b95d640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55eec47d29d0 0x55eec47d4dc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331fd26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:49.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331fd26800 20 searching for the correct realm 2024-09-10T05:11:49.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331fd26800 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55eec47d75a0 0x55eec47d9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47da130 con 0x55eec47d75a0 2024-09-10T05:11:49.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.854+0000 7f331b15c640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55eec47d75a0 0x55eec47d9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.855+0000 7f331b15c640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55eec47d75a0 0x55eec47d9a60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.855+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.855+0000 7f331b15c640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f331002e910 0x7f331003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.855+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47da130 con 0x7f331002e910 2024-09-10T05:11:49.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.855+0000 7f331c15e640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f331002e910 0x7f331003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.855+0000 7f331c15e640 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f331002e910 0x7f331003a3c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.856+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.856+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d1ee0 con 0x55eec47d29d0 2024-09-10T05:11:49.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.856+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.856+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47ce250 2024-09-10T05:11:49.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.856+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.856+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47ce250 2024-09-10T05:11:49.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.856+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.856+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d29d0 2024-09-10T05:11:49.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.857+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.857+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d29d0 2024-09-10T05:11:49.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.857+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.857+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x7f331002e910 2024-09-10T05:11:49.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.857+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.857+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d75a0 2024-09-10T05:11:49.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.857+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.857+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47ce250 2024-09-10T05:11:49.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.857+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.857+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d29d0 2024-09-10T05:11:49.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.858+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.858+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47ce250 2024-09-10T05:11:49.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.858+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.858+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x7f331002e910 2024-09-10T05:11:49.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.858+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.858+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d75a0 2024-09-10T05:11:49.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.858+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.858+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d75a0 2024-09-10T05:11:49.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.859+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.859+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d29d0 2024-09-10T05:11:49.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.859+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.859+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d75a0 2024-09-10T05:11:49.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.859+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.859+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d75a0 2024-09-10T05:11:49.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.859+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.859+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47ce250 2024-09-10T05:11:49.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.860+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.860+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47ce250 2024-09-10T05:11:49.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.860+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.860+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d29d0 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.860+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.860+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d75a0 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.860+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.860+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x7f331002e910 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.860+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.860+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47ce250 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.861+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.861+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d29d0 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.861+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.861+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d75a0 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.861+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.861+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d29d0 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.861+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.861+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x7f331002e910 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.862+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.862+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d75a0 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.862+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.862+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47d29d0 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.862+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.862+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x55eec47ce250 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.862+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.862+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5500 con 0x7f331002e910 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:49.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d1ee0 con 0x55eec47ce250 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d1ee0 con 0x55eec47ce250 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:49.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d1ee0 con 0x7f331002e910 2024-09-10T05:11:49.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:49.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 zone default found 2024-09-10T05:11:49.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 4 Realm: () 2024-09-10T05:11:49.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:49.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:49.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:49.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.863+0000 7f331fd26800 20 zonegroup default 2024-09-10T05:11:49.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47d5e70 con 0x55eec47d29d0 2024-09-10T05:11:49.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47db6c0 con 0x55eec47d75a0 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47dbb90 con 0x55eec47d75a0 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331fd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331fd26800 20 started sync module instance, tier type = 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331fd26800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.864+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47daa60 con 0x7f331002e910 2024-09-10T05:11:49.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.865+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.866+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94483987148720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47daa60 con 0x7f331002e910 2024-09-10T05:11:49.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.866+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47dc720 con 0x55eec47ce250 2024-09-10T05:11:49.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.867+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.867+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94483987153424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47dc6e0 con 0x55eec47ce250 2024-09-10T05:11:49.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.867+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94483987148720] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.867+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47da5f0 con 0x55eec47d75a0 2024-09-10T05:11:49.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.868+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94483987153424] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.868+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.868+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94483987155728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47dd6c0 con 0x55eec47d75a0 2024-09-10T05:11:49.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.868+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47de080 con 0x7f331002e910 2024-09-10T05:11:49.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.869+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94483987155728] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.869+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.869+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94483987160016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47de4a0 con 0x7f331002e910 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.869+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47dee60 con 0x55eec47ce250 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.870+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94483987160016] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.870+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.870+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94483987161552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47dee60 con 0x55eec47ce250 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.870+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47df820 con 0x55eec47d29d0 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.871+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.871+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94483987166064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47dfc40 con 0x55eec47d29d0 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.871+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47e0720 con 0x55eec47d29d0 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.871+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94483987161552] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.872+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94483987166064] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.872+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.872+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94483987169840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47df7d0 con 0x55eec47d29d0 2024-09-10T05:11:49.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.872+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47e0db0 con 0x55eec47d29d0 2024-09-10T05:11:49.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.873+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94483987169840] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.873+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.873+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94483987163568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47e0db0 con 0x55eec47d29d0 2024-09-10T05:11:49.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.873+0000 7f331fd26800 20 add_watcher() i=0 2024-09-10T05:11:49.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.873+0000 7f331fd26800 20 add_watcher() i=1 2024-09-10T05:11:49.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.873+0000 7f331fd26800 20 add_watcher() i=2 2024-09-10T05:11:49.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.873+0000 7f331fd26800 20 add_watcher() i=3 2024-09-10T05:11:49.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.873+0000 7f331fd26800 20 add_watcher() i=4 2024-09-10T05:11:49.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.873+0000 7f331fd26800 20 add_watcher() i=5 2024-09-10T05:11:49.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.873+0000 7f331fd26800 20 add_watcher() i=6 2024-09-10T05:11:49.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.874+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94483987163568] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.874+0000 7f331fd26800 20 add_watcher() i=7 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.874+0000 7f331fd26800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.874+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec47e4000 con 0x55eec47ce250 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.875+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.875+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94483987171952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec47e1340 con 0x55eec47ce250 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.875+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94483987171952] v35'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.876+0000 7f31d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.876+0000 7f331fd26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.876+0000 7f331fd26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.876+0000 7f331fd26800 5 note: GC not initialized 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.876+0000 7f31d0fe1640 20 reqs_thread_entry: start 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.876+0000 7f331fd26800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:49.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.876+0000 7f331fd26800 20 Filter name: none 2024-09-10T05:11:49.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.876+0000 7f314a7fc640 20 reqs_thread_entry: start 2024-09-10T05:11:49.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.876+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.876+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4817230 con 0x7f331002e910 2024-09-10T05:11:49.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331fd26800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:49.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:63 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4817ac0 con 0x55eec47d75a0 2024-09-10T05:11:49.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(63 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331fd26800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:49.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331fd26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:11:49.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4817650 con 0x7f331002e910 2024-09-10T05:11:49.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331fd26800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:49.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331fd26800 20 rados->read ofs=0 len=0 2024-09-10T05:11:49.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.877+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:65 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4819580 con 0x55eec47d75a0 2024-09-10T05:11:49.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(65 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:49.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:11:49.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 4.5 4:a13f7d51:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4818fc0 con 0x55eec47d75a0 2024-09-10T05:11:49.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:67 4.23 4:c5bf8a98:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec481df50 con 0x55eec47d29d0 2024-09-10T05:11:49.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:68 4.26 4:6764b625:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4820970 con 0x55eec47d29d0 2024-09-10T05:11:49.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 4.19 4:9b146b93:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4823410 con 0x55eec47d75a0 2024-09-10T05:11:49.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 4.2a 4:54fd2db9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4825ed0 con 0x55eec47ce250 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 4.23 4:c6e2b706:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4823410 con 0x55eec47d29d0 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 4.e 4:71344637:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec482b160 con 0x7f331002e910 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 4.29 4:950bf6db:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec482db40 con 0x55eec47d75a0 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:74 4.d 4:b0727371:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4830570 con 0x55eec47d75a0 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 4.26 4:64e4daa4:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec48333f0 con 0x55eec47d29d0 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:76 4.3f 4:fc8f57a3:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eec4836260 con 0x7f331002e910 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(70 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(67 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(68 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(72 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.5 [call out=128b] v0'0 uv4 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(66 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(69 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(75 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(76 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(73 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.878+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(74 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.879+0000 7f31d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:49.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.879+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94483987171952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec4823410 con 0x55eec47ce250 2024-09-10T05:11:49.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.880+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94483987171952] v35'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.880+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94483987148720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec4814bb0 con 0x7f331002e910 2024-09-10T05:11:49.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.881+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94483987148720] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.882+0000 7f331fd26800 20 remove_watcher() i=0 2024-09-10T05:11:49.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.882+0000 7f331fd26800 2 removed watcher, disabling cache 2024-09-10T05:11:49.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.882+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94483987153424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec4814bb0 con 0x55eec47ce250 2024-09-10T05:11:49.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.882+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94483987153424] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.883+0000 7f331fd26800 20 remove_watcher() i=1 2024-09-10T05:11:49.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.883+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94483987155728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec4814bb0 con 0x55eec47d75a0 2024-09-10T05:11:49.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.883+0000 7f331b15c640 1 -- 172.21.15.192:0/1524335080 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94483987155728] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3310037040 con 0x55eec47d75a0 2024-09-10T05:11:49.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.883+0000 7f331fd26800 20 remove_watcher() i=2 2024-09-10T05:11:49.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.884+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94483987160016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec4814bb0 con 0x7f331002e910 2024-09-10T05:11:49.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.885+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94483987160016] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x7f331002e910 2024-09-10T05:11:49.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.885+0000 7f331fd26800 20 remove_watcher() i=3 2024-09-10T05:11:49.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.885+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94483987161552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec4814bb0 con 0x55eec47ce250 2024-09-10T05:11:49.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.885+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94483987161552] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f331400a4d0 con 0x55eec47ce250 2024-09-10T05:11:49.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.885+0000 7f331fd26800 20 remove_watcher() i=4 2024-09-10T05:11:49.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.885+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94483987166064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec4814bb0 con 0x55eec47d29d0 2024-09-10T05:11:49.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.886+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94483987166064] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.886+0000 7f331fd26800 20 remove_watcher() i=5 2024-09-10T05:11:49.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.886+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94483987169840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec4814bb0 con 0x55eec47d29d0 2024-09-10T05:11:49.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.887+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94483987169840] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.887+0000 7f331fd26800 20 remove_watcher() i=6 2024-09-10T05:11:49.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.887+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94483987163568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eec4814bb0 con 0x55eec47d29d0 2024-09-10T05:11:49.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.888+0000 7f331b95d640 1 -- 172.21.15.192:0/1524335080 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94483987163568] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330c07a030 con 0x55eec47d29d0 2024-09-10T05:11:49.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.888+0000 7f331fd26800 20 remove_watcher() i=7 2024-09-10T05:11:49.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.888+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55eec47d29d0 msgr2=0x55eec47d4dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.888+0000 7f331fd26800 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55eec47d29d0 0x55eec47d4dc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.888+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55eec47ce250 msgr2=0x55eec47d0710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.888+0000 7f331fd26800 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55eec47ce250 0x55eec47d0710 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.888+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f331002e910 msgr2=0x7f331003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.888+0000 7f331fd26800 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f331002e910 0x7f331003a3c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.888+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55eec47d75a0 msgr2=0x55eec47d9a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.888+0000 7f331fd26800 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55eec47d75a0 0x55eec47d9a60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f31e403c730 msgr2=0x7f31e403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f31e403c730 0x7f31e403ebf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f331000ffd0 tx=0x7f3310023040 comp rx=0 tx=0).stop 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 msgr2=0x55eec47c2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331c15e640 1 -- 172.21.15.192:0/1524335080 reap_dead start 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 0x55eec47c2ca0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f330c053730 tx=0x7f330c05af90 comp rx=0 tx=0).stop 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 shutdown_connections 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 --2- 172.21.15.192:0/1524335080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47bb8e0 0x55eec47c2ca0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 >> 172.21.15.192:0/1524335080 conn(0x55eec47b7ce0 msgr2=0x55eec47b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 shutdown_connections 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/1524335080 wait complete. 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/3715741423 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f31f403c780 msgr2=0x7f31f403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 --2- 172.21.15.192:0/3715741423 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f31f403c780 0x7f31f403ec40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55eec4798c40 tx=0x7f3310006000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/3715741423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47af060 msgr2=0x55eec47af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 --2- 172.21.15.192:0/3715741423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47af060 0x55eec47af480 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f330c095f00 tx=0x7f330c05de70 comp rx=0 tx=0).stop 2024-09-10T05:11:49.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/3715741423 shutdown_connections 2024-09-10T05:11:49.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 --2- 172.21.15.192:0/3715741423 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f31f403c780 0x7f31f403ec40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 --2- 172.21.15.192:0/3715741423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec47af060 0x55eec47af480 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/3715741423 >> 172.21.15.192:0/3715741423 conn(0x55eec47a3410 msgr2=0x55eec47a37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/3715741423 shutdown_connections 2024-09-10T05:11:49.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/3715741423 wait complete. 2024-09-10T05:11:49.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55eec479aa70 msgr2=0x55eec479ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55eec479aa70 0x55eec479ce60 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55eec469b010 msgr2=0x55eec47982c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55eec469b010 0x55eec47982c0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55eec479e970 msgr2=0x55eec47a0d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.889+0000 7f331fd26800 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55eec479e970 0x55eec47a0d60 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.890+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f320403c780 msgr2=0x7f320403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.890+0000 7f331fd26800 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f320403c780 0x7f320403ec40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3310000c00 tx=0x7f33100013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.890+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 msgr2=0x55eec4697da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.890+0000 7f331fd26800 1 --2- 172.21.15.192:0/3268934537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eec4698680 0x55eec4697da0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f330c025c20 tx=0x7f330c002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.890+0000 7f331c15e640 1 -- 172.21.15.192:0/3268934537 reap_dead start 2024-09-10T05:11:49.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.890+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 shutdown_connections 2024-09-10T05:11:49.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.890+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 >> 172.21.15.192:0/3268934537 conn(0x55eec46921c0 msgr2=0x55eec4788680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.890+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 shutdown_connections 2024-09-10T05:11:49.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.890+0000 7f331fd26800 1 -- 172.21.15.192:0/3268934537 wait complete. 2024-09-10T05:11:49.917 INFO:teuthology.orchestra.run.smithi192.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"236edb0a-22f9-4c79-a204-203688ed4bab","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1","marker":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T05:11:49.045054Z","creation_time":"2024-09-10T05:11:49.040226Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-10T05:11:49.918 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '236edb0a-22f9-4c79-a204-203688ed4bab', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1', 'marker': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:11:49.045054Z', 'creation_time': '2024-09-10T05:11:49.040226Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T05:11:49.918 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-10T05:11:49.918 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-10T05:11:49.918 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-10T05:11:49.965 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.965+0000 7fa0dbf1f800 1 Processor -- start 2024-09-10T05:11:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.965+0000 7fa0dbf1f800 1 -- start start 2024-09-10T05:11:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.965+0000 7fa0dbf1f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5571edf0c490 0x5571edf0c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.965+0000 7fa0dbf1f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5571eddb7e40 con 0x5571edf0cdd0 2024-09-10T05:11:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.965+0000 7fa0dbf1f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5571edd82680 con 0x5571edf0c490 2024-09-10T05:11:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.966+0000 7fa0d7ca2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5571edf0c490 0x5571edf0c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.966+0000 7fa0d74a1640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5571edf0cdd0 0x5571edf0d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36402/0 (socket says 172.21.15.192:36402) 2024-09-10T05:11:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.966+0000 7fa0d7ca2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5571edf0c490 0x5571edf0c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60504/0 (socket says 172.21.15.192:60504) 2024-09-10T05:11:49.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.966+0000 7fa0d74a1640 1 -- 172.21.15.192:0/4070361304 learned_addr learned my addr 172.21.15.192:0/4070361304 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:49.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.966+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/4070361304 >> v1:172.21.15.139:6789/0 conn(0x5571edf0cdd0 legacy=0x5571edf0d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.966+0000 7fa0d6ca0640 1 -- 172.21.15.192:0/4070361304 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884204661 0 0) 0x5571eddb7e40 con 0x5571edf0cdd0 2024-09-10T05:11:49.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.966+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/4070361304 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571edd9e6b0 con 0x5571edf0c490 2024-09-10T05:11:49.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.968+0000 7fa0d7ca2640 1 --2- 172.21.15.192:0/4070361304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571edf0c890 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800a470 tx=0x7fa0c8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983ba31685b40fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.968+0000 7fa0d6ca0640 1 -- 172.21.15.192:0/4070361304 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c8053570 con 0x5571edf0c490 2024-09-10T05:11:49.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.968+0000 7fa0d6ca0640 1 -- 172.21.15.192:0/4070361304 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c8058070 con 0x5571edf0c490 2024-09-10T05:11:49.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.968+0000 7fa0d6ca0640 1 -- 172.21.15.192:0/4070361304 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c8053880 con 0x5571edf0c490 2024-09-10T05:11:49.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.968+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/4070361304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 msgr2=0x5571edf0c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.968+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/4070361304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571edf0c890 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800a470 tx=0x7fa0c8045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:49.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.968+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/4070361304 shutdown_connections 2024-09-10T05:11:49.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.969+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/4070361304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571edf0c890 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.969+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/4070361304 >> 172.21.15.192:0/4070361304 conn(0x5571edf08200 msgr2=0x5571edf0a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.969+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/4070361304 shutdown_connections 2024-09-10T05:11:49.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.969+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/4070361304 wait complete. 2024-09-10T05:11:49.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.982+0000 7fa0dbf1f800 1 Processor -- start 2024-09-10T05:11:49.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.982+0000 7fa0dbf1f800 1 -- start start 2024-09-10T05:11:49.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.982+0000 7fa0dbf1f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571edfff630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.982+0000 7fa0dbf1f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5571edda6dd0 con 0x5571edf0c490 2024-09-10T05:11:49.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.983+0000 7fa0d7ca2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571edfff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.983+0000 7fa0d7ca2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571edfff630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60508/0 (socket says 172.21.15.192:60508) 2024-09-10T05:11:49.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.983+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/3203727194 learned_addr learned my addr 172.21.15.192:0/3203727194 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.983+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/3203727194 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571eddbfe10 con 0x5571edf0c490 2024-09-10T05:11:49.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.983+0000 7fa0d7ca2640 1 --2- 172.21.15.192:0/3203727194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571edfff630 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800a470 tx=0x7fa0c8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836cc2f8a537d7af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.983+0000 7f9fc5e0b640 1 -- 172.21.15.192:0/3203727194 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c8053570 con 0x5571edf0c490 2024-09-10T05:11:49.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.983+0000 7f9fc5e0b640 1 -- 172.21.15.192:0/3203727194 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c8063030 con 0x5571edf0c490 2024-09-10T05:11:49.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.983+0000 7f9fc5e0b640 1 -- 172.21.15.192:0/3203727194 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c8053840 con 0x5571edf0c490 2024-09-10T05:11:49.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.984+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3203727194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 msgr2=0x5571edfff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:49.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.984+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/3203727194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571edfff630 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800a470 tx=0x7fa0c8051000 comp rx=0 tx=0).stop 2024-09-10T05:11:49.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.984+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3203727194 shutdown_connections 2024-09-10T05:11:49.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.984+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/3203727194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571edfff630 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:49.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.984+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3203727194 >> 172.21.15.192:0/3203727194 conn(0x5571edf08200 msgr2=0x5571edffafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:49.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.984+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3203727194 shutdown_connections 2024-09-10T05:11:49.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.984+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3203727194 wait complete. 2024-09-10T05:11:49.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.984+0000 7fa0dbf1f800 1 Processor -- start 2024-09-10T05:11:49.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.985+0000 7fa0dbf1f800 1 -- start start 2024-09-10T05:11:49.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.985+0000 7fa0dbf1f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571ee006f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:49.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.985+0000 7fa0dbf1f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5571edf0dd50 con 0x5571edf0c490 2024-09-10T05:11:49.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.985+0000 7fa0d7ca2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571ee006f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:49.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.985+0000 7fa0d7ca2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571ee006f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60512/0 (socket says 172.21.15.192:60512) 2024-09-10T05:11:49.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.985+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/3345080663 learned_addr learned my addr 172.21.15.192:0/3345080663 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:49.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.985+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/3345080663 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ee007470 con 0x5571edf0c490 2024-09-10T05:11:49.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.985+0000 7fa0d7ca2640 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571ee006f10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800a470 tx=0x7fa0c8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:49.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.985+0000 7f9fbffff640 1 -- 172.21.15.192:0/3345080663 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c8078070 con 0x5571edf0c490 2024-09-10T05:11:49.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.985+0000 7f9fbffff640 1 -- 172.21.15.192:0/3345080663 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c8068420 con 0x5571edf0c490 2024-09-10T05:11:49.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.985+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571ee007700 con 0x5571edf0c490 2024-09-10T05:11:49.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.985+0000 7f9fbffff640 1 -- 172.21.15.192:0/3345080663 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c8068700 con 0x5571edf0c490 2024-09-10T05:11:49.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.986+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ee008310 con 0x5571edf0c490 2024-09-10T05:11:49.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.986+0000 7f9fbffff640 1 -- 172.21.15.192:0/3345080663 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa0c807b070 con 0x5571edf0c490 2024-09-10T05:11:50.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.986+0000 7f9fbffff640 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fc003c780 0x7f9fc003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.987+0000 7f9fbffff640 1 -- 172.21.15.192:0/3345080663 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa0c8097810 con 0x5571edf0c490 2024-09-10T05:11:50.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.987+0000 7fa0d74a1640 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fc003c780 0x7f9fc003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.987+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5571edf0cdd0 0x5571ee00e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.987+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee00eaa0 con 0x5571edf0cdd0 2024-09-10T05:11:50.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.987+0000 7fa0d84a3640 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5571edf0cdd0 0x5571ee00e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.987+0000 7fa0d74a1640 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fc003c780 0x7f9fc003ec40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc000c00 tx=0x7fa0cc0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.987+0000 7fa0d84a3640 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5571edf0cdd0 0x5571ee00e560 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.987+0000 7fa0d84a3640 1 -- 172.21.15.192:0/3345080663 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571edf0cdd0 2024-09-10T05:11:50.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.987+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee00ee40 con 0x5571edf0cdd0 2024-09-10T05:11:50.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.988+0000 7fa0d84a3640 1 -- 172.21.15.192:0/3345080663 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571edf0cdd0 2024-09-10T05:11:50.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.988+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5571ee0108c0 0x5571ee012d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.988+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0134f0 con 0x5571ee0108c0 2024-09-10T05:11:50.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.988+0000 7fa0d7ca2640 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5571ee0108c0 0x5571ee012d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.988+0000 7fa0d7ca2640 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5571ee0108c0 0x5571ee012d60 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.988+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/3345080663 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa0c807a030 con 0x5571ee0108c0 2024-09-10T05:11:50.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.989+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee00f690 con 0x5571edf0cdd0 2024-09-10T05:11:50.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.989+0000 7fa0d84a3640 1 -- 172.21.15.192:0/3345080663 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571edf0cdd0 2024-09-10T05:11:50.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.989+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5571ee014950 0x5571ee016d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.989+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0173e0 con 0x5571ee014950 2024-09-10T05:11:50.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.989+0000 7fa0d74a1640 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5571ee014950 0x5571ee016d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.989+0000 7fa0d74a1640 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5571ee014950 0x5571ee016d40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.989+0000 7fa0d74a1640 1 -- 172.21.15.192:0/3345080663 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa0cc00f670 con 0x5571ee014950 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.990+0000 7fa0dbf1f800 1 Processor -- start 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.990+0000 7fa0dbf1f800 1 -- start start 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.990+0000 7fa0dbf1f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee025040 0x5571ee025460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.990+0000 7fa0dbf1f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5571ede04a00 con 0x5571ee025040 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.990+0000 7fa0d7ca2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee025040 0x5571ee025460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.990+0000 7fa0d7ca2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee025040 0x5571ee025460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60518/0 (socket says 172.21.15.192:60518) 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.990+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/240666510 learned_addr learned my addr 172.21.15.192:0/240666510 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.990+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/240666510 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ee025aa0 con 0x5571ee025040 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.991+0000 7fa0d7ca2640 1 --2- 172.21.15.192:0/240666510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee025040 0x5571ee025460 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8052560 tx=0x7fa0c807ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.991+0000 7f9fbd7fa640 1 -- 172.21.15.192:0/240666510 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c8068d60 con 0x5571ee025040 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.991+0000 7f9fbd7fa640 1 -- 172.21.15.192:0/240666510 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c8097b30 con 0x5571ee025040 2024-09-10T05:11:50.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.991+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/240666510 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571ee0262d0 con 0x5571ee025040 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.991+0000 7f9fbd7fa640 1 -- 172.21.15.192:0/240666510 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c8097e10 con 0x5571ee025040 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.991+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/240666510 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ee026870 con 0x5571ee025040 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.991+0000 7f9fbd7fa640 1 -- 172.21.15.192:0/240666510 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa0c807c3b0 con 0x5571ee025040 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.992+0000 7f9fbd7fa640 1 --2- 172.21.15.192:0/240666510 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fb003c8d0 0x7f9fb003ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.992+0000 7f9fbd7fa640 1 -- 172.21.15.192:0/240666510 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa0c808e070 con 0x5571ee025040 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.992+0000 7fa0d74a1640 1 --2- 172.21.15.192:0/240666510 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fb003c8d0 0x7f9fb003ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.992+0000 7fa0dbf1f800 1 Processor -- start 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.992+0000 7fa0d74a1640 1 --2- 172.21.15.192:0/240666510 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fb003c8d0 0x7f9fb003ed90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5571ee008fd0 tx=0x7fa0cc006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.992+0000 7fa0dbf1f800 1 -- start start 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.992+0000 7fa0dbf1f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 0x5571ee031c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.992+0000 7fa0dbf1f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5571edfffe20 con 0x5571ee0318b0 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.992+0000 7fa0d7ca2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 0x5571ee031c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.992+0000 7fa0d7ca2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 0x5571ee031c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60522/0 (socket says 172.21.15.192:60522) 2024-09-10T05:11:50.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.992+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2784152978 learned_addr learned my addr 172.21.15.192:0/2784152978 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.993+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2784152978 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ee032280 con 0x5571ee0318b0 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.993+0000 7fa0d7ca2640 1 --2- 172.21.15.192:0/2784152978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 0x5571ee031c90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa0c805f730 tx=0x7fa0c807dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f237185035630a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.993+0000 7f9fb6ffd640 1 -- 172.21.15.192:0/2784152978 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c80af070 con 0x5571ee0318b0 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.993+0000 7f9fb6ffd640 1 -- 172.21.15.192:0/2784152978 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c8091410 con 0x5571ee0318b0 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.993+0000 7f9fb6ffd640 1 -- 172.21.15.192:0/2784152978 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c805e940 con 0x5571ee0318b0 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.993+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2784152978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 msgr2=0x5571ee031c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.993+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/2784152978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 0x5571ee031c90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa0c805f730 tx=0x7fa0c807dcd0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.993+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2784152978 shutdown_connections 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.993+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/2784152978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 0x5571ee031c90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.993+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2784152978 >> 172.21.15.192:0/2784152978 conn(0x5571ee02dcb0 msgr2=0x5571ee02bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.993+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2784152978 shutdown_connections 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.993+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2784152978 wait complete. 2024-09-10T05:11:50.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.994+0000 7fa0dbf1f800 1 Processor -- start 2024-09-10T05:11:50.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.994+0000 7fa0dbf1f800 1 -- start start 2024-09-10T05:11:50.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.994+0000 7fa0dbf1f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 0x5571ee038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.994+0000 7fa0dbf1f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5571ee032710 con 0x5571ee0318b0 2024-09-10T05:11:50.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.994+0000 7fa0d7ca2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 0x5571ee038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.994+0000 7fa0d7ca2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 0x5571ee038cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60534/0 (socket says 172.21.15.192:60534) 2024-09-10T05:11:50.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.994+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 learned_addr learned my addr 172.21.15.192:0/2357181460 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.994+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ee039220 con 0x5571ee0318b0 2024-09-10T05:11:50.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.994+0000 7fa0d7ca2640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 0x5571ee038cc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa0c807d750 tx=0x7fa0c8052ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.995+0000 7f9fb57fa640 1 -- 172.21.15.192:0/2357181460 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c80ba020 con 0x5571ee0318b0 2024-09-10T05:11:50.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.995+0000 7f9fb57fa640 1 -- 172.21.15.192:0/2357181460 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c8074ac0 con 0x5571ee0318b0 2024-09-10T05:11:50.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.995+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571ee039220 con 0x5571ee0318b0 2024-09-10T05:11:50.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.995+0000 7f9fb57fa640 1 -- 172.21.15.192:0/2357181460 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c80af040 con 0x5571ee0318b0 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.995+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ee039220 con 0x5571ee0318b0 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.996+0000 7f9fb57fa640 1 -- 172.21.15.192:0/2357181460 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa0c80bd020 con 0x5571ee0318b0 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.996+0000 7f9fb57fa640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fa003c780 0x7f9fa003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.996+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.996+0000 7f9fb57fa640 1 -- 172.21.15.192:0/2357181460 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa0c80a7070 con 0x5571ee0318b0 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.996+0000 7fa0d74a1640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fa003c780 0x7f9fa003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.996+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5571ee044270 0x5571ee046700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.996+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee046e50 con 0x5571ee044270 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.996+0000 7fa0d84a3640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5571ee044270 0x5571ee046700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0d74a1640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fa003c780 0x7f9fa003ec40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00ffd0 tx=0x7fa0cc023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0d84a3640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5571ee044270 0x5571ee046700 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0dbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0dbf1f800 20 realm 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047260 con 0x5571ee044270 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0dbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0dbf1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047b30 con 0x5571ee044270 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0dbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.997+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee044270 2024-09-10T05:11:50.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.998+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.998+0000 7fa0dbf1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.998+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.998+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5571ee0489c0 0x5571ee04adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.998+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee04b4f0 con 0x5571ee0489c0 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.998+0000 7fa0d7ca2640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5571ee0489c0 0x5571ee04adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.998+0000 7fa0d7ca2640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5571ee0489c0 0x5571ee04adb0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.999+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.999+0000 7fa0dbf1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.999+0000 7fa0dbf1f800 20 searching for the correct realm 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.999+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5571ee04d590 0x5571ee04fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.999+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee050120 con 0x5571ee04d590 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.999+0000 7fa0d74a1640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5571ee04d590 0x5571ee04fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.999+0000 7fa0d74a1640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5571ee04d590 0x5571ee04fa50 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.999+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.999+0000 7fa0d74a1640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa0cc02e910 0x7fa0cc03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.999+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee050120 con 0x7fa0cc02e910 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:49.999+0000 7fa0d84a3640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa0cc02e910 0x7fa0cc03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.000+0000 7fa0d84a3640 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa0cc02e910 0x7fa0cc03a3c0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.000+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.000+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee0489c0 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.000+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.000+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee044270 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.000+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.000+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee044270 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.001+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.001+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee0489c0 2024-09-10T05:11:50.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.001+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.001+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee0489c0 2024-09-10T05:11:50.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.001+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.001+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x7fa0cc02e910 2024-09-10T05:11:50.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.001+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.001+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee04d590 2024-09-10T05:11:50.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.002+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.002+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee044270 2024-09-10T05:11:50.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.002+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.002+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee0489c0 2024-09-10T05:11:50.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.002+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.002+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee044270 2024-09-10T05:11:50.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.002+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.002+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x7fa0cc02e910 2024-09-10T05:11:50.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.003+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.003+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee04d590 2024-09-10T05:11:50.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.003+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.003+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee04d590 2024-09-10T05:11:50.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.003+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.003+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee0489c0 2024-09-10T05:11:50.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.003+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.003+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee04d590 2024-09-10T05:11:50.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.003+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.003+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee04d590 2024-09-10T05:11:50.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.004+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.004+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee044270 2024-09-10T05:11:50.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.004+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.004+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee044270 2024-09-10T05:11:50.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.004+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.004+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee0489c0 2024-09-10T05:11:50.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.004+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.004+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee04d590 2024-09-10T05:11:50.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.005+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.005+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x7fa0cc02e910 2024-09-10T05:11:50.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.005+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.005+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee044270 2024-09-10T05:11:50.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.005+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.005+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee0489c0 2024-09-10T05:11:50.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.005+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.005+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee04d590 2024-09-10T05:11:50.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.006+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.006+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee0489c0 2024-09-10T05:11:50.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.006+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.006+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x7fa0cc02e910 2024-09-10T05:11:50.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.006+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.006+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee04d590 2024-09-10T05:11:50.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.006+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.006+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee0489c0 2024-09-10T05:11:50.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x5571ee044270 2024-09-10T05:11:50.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5571ee047ed0 con 0x7fa0cc02e910 2024-09-10T05:11:50.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0dbf1f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:50.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0dbf1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:50.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0dbf1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:50.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0dbf1f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:50.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0dbf1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:50.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0dbf1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:50.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee04be90 con 0x5571ee044270 2024-09-10T05:11:50.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0dbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.007+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee04be90 con 0x5571ee044270 2024-09-10T05:11:50.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee04be90 con 0x7fa0cc02e910 2024-09-10T05:11:50.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:50.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 20 zone default found 2024-09-10T05:11:50.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 4 Realm: () 2024-09-10T05:11:50.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:50.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:50.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:50.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 20 zonegroup default 2024-09-10T05:11:50.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee04c280 con 0x5571ee0489c0 2024-09-10T05:11:50.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.008+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee04c840 con 0x5571ee04d590 2024-09-10T05:11:50.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.009+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.009+0000 7fa0dbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.009+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.009+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee051f90 con 0x5571ee04d590 2024-09-10T05:11:50.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.009+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.009+0000 7fa0dbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.009+0000 7fa0dbf1f800 20 started sync module instance, tier type = 2024-09-10T05:11:50.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.009+0000 7fa0dbf1f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:50.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.009+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee051430 con 0x7fa0cc02e910 2024-09-10T05:11:50.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.010+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.010+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93947812977024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee051430 con 0x7fa0cc02e910 2024-09-10T05:11:50.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.010+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee052a40 con 0x5571ee044270 2024-09-10T05:11:50.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.011+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93947812977024] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.011+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.011+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93947812980048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee051430 con 0x5571ee044270 2024-09-10T05:11:50.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.011+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee053510 con 0x5571ee04d590 2024-09-10T05:11:50.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.012+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93947812980048] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.012+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.012+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93947812974464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0513a0 con 0x5571ee04d590 2024-09-10T05:11:50.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.012+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0543d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.013+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93947812974464] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.014+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.014+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93947812986656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0547f0 con 0x7fa0cc02e910 2024-09-10T05:11:50.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.014+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0551b0 con 0x5571ee044270 2024-09-10T05:11:50.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.015+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93947812986656] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.015+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.015+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93947812990688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0547f0 con 0x5571ee044270 2024-09-10T05:11:50.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.015+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee055bc0 con 0x5571ee0489c0 2024-09-10T05:11:50.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.016+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.016+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93947812992784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee055b30 con 0x5571ee0489c0 2024-09-10T05:11:50.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.016+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee056b90 con 0x5571ee0489c0 2024-09-10T05:11:50.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.016+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93947812990688] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.017+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.017+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93947812996736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee056b50 con 0x5571ee0489c0 2024-09-10T05:11:50.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.017+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0575a0 con 0x5571ee0489c0 2024-09-10T05:11:50.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.017+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93947812992784] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.018+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93947812996736] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.018+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.018+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93947812987712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee055f60 con 0x5571ee0489c0 2024-09-10T05:11:50.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.018+0000 7fa0dbf1f800 20 add_watcher() i=0 2024-09-10T05:11:50.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.018+0000 7fa0dbf1f800 20 add_watcher() i=1 2024-09-10T05:11:50.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.018+0000 7fa0dbf1f800 20 add_watcher() i=2 2024-09-10T05:11:50.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.018+0000 7fa0dbf1f800 20 add_watcher() i=3 2024-09-10T05:11:50.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.018+0000 7fa0dbf1f800 20 add_watcher() i=4 2024-09-10T05:11:50.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.018+0000 7fa0dbf1f800 20 add_watcher() i=5 2024-09-10T05:11:50.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.018+0000 7fa0dbf1f800 20 add_watcher() i=6 2024-09-10T05:11:50.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.019+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93947812987712] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.019+0000 7fa0dbf1f800 20 add_watcher() i=7 2024-09-10T05:11:50.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.019+0000 7fa0dbf1f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:50.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.019+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee05a590 con 0x5571ee044270 2024-09-10T05:11:50.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.019+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.019+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93947812999312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee057a40 con 0x5571ee044270 2024-09-10T05:11:50.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.020+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93947812999312] v35'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.020+0000 7f9f8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.020+0000 7fa0dbf1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:50.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.020+0000 7fa0dbf1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:50.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.020+0000 7fa0dbf1f800 5 note: GC not initialized 2024-09-10T05:11:50.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.020+0000 7f9f8cfe1640 20 reqs_thread_entry: start 2024-09-10T05:11:50.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.021+0000 7fa0dbf1f800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:50.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.021+0000 7fa0dbf1f800 20 Filter name: none 2024-09-10T05:11:50.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.021+0000 7f9f067fc640 20 reqs_thread_entry: start 2024-09-10T05:11:50.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.021+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.021+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee08d230 con 0x5571ee044270 2024-09-10T05:11:50.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.021+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.021+0000 7fa0dbf1f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:50.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.021+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee08e650 con 0x7fa0cc02e910 2024-09-10T05:11:50.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee08e620 con 0x5571ee04d590 2024-09-10T05:11:50.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:50.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:11:50.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:65 4.5 4:a13f7d51:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee08e040 con 0x5571ee04d590 2024-09-10T05:11:50.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:66 4.23 4:c5bf8a98:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee093240 con 0x5571ee0489c0 2024-09-10T05:11:50.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:67 4.26 4:6764b625:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee095eb0 con 0x5571ee0489c0 2024-09-10T05:11:50.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 4.19 4:9b146b93:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee098720 con 0x5571ee04d590 2024-09-10T05:11:50.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 4.2a 4:54fd2db9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee09b010 con 0x5571ee044270 2024-09-10T05:11:50.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 4.23 4:c6e2b706:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee09dd30 con 0x5571ee0489c0 2024-09-10T05:11:50.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 4.e 4:71344637:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0a0670 con 0x7fa0cc02e910 2024-09-10T05:11:50.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:72 4.29 4:950bf6db:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0a2f00 con 0x5571ee04d590 2024-09-10T05:11:50.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 4.d 4:b0727371:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0a5b80 con 0x5571ee04d590 2024-09-10T05:11:50.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 4.26 4:64e4daa4:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0a8550 con 0x5571ee0489c0 2024-09-10T05:11:50.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(65 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.022+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:75 4.3f 4:fc8f57a3:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0ab1d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.023+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(68 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.023+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(66 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.023+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(67 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.023+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(69 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.023+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(71 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.023+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(70 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.5 [call out=128b] v0'0 uv4 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.023+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(73 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.023+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(72 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.023+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(74 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.023+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(75 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.023+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0a84d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.024+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(76 foo.buckets [call] v35'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.024+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0a84d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.025+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(77 foo.buckets [call] v35'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.025+0000 7fa0dbf1f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.025+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0a84d0 con 0x5571ee044270 2024-09-10T05:11:50.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.025+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.025+0000 7fa0dbf1f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:50.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.025+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0a84d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.025+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.026+0000 7f9f8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.026+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93947812999312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee0a84d0 con 0x5571ee044270 2024-09-10T05:11:50.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.027+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 93947812999312] v35'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.027+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93947812977024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee057090 con 0x7fa0cc02e910 2024-09-10T05:11:50.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.028+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 93947812977024] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.028+0000 7fa0dbf1f800 20 remove_watcher() i=0 2024-09-10T05:11:50.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.028+0000 7fa0dbf1f800 2 removed watcher, disabling cache 2024-09-10T05:11:50.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.028+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93947812980048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee057090 con 0x5571ee044270 2024-09-10T05:11:50.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.029+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 93947812980048] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.029+0000 7fa0dbf1f800 20 remove_watcher() i=1 2024-09-10T05:11:50.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.029+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93947812974464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee057090 con 0x5571ee04d590 2024-09-10T05:11:50.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.030+0000 7fa0d74a1640 1 -- 172.21.15.192:0/2357181460 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 93947812974464] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc037040 con 0x5571ee04d590 2024-09-10T05:11:50.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.030+0000 7fa0dbf1f800 20 remove_watcher() i=2 2024-09-10T05:11:50.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.030+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93947812986656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee050f80 con 0x7fa0cc02e910 2024-09-10T05:11:50.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.031+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 93947812986656] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x7fa0cc02e910 2024-09-10T05:11:50.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.031+0000 7fa0dbf1f800 20 remove_watcher() i=3 2024-09-10T05:11:50.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.031+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93947812990688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee057090 con 0x5571ee044270 2024-09-10T05:11:50.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.032+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 93947812990688] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0d000a4d0 con 0x5571ee044270 2024-09-10T05:11:50.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.032+0000 7fa0dbf1f800 20 remove_watcher() i=4 2024-09-10T05:11:50.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.032+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93947812992784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee053f20 con 0x5571ee0489c0 2024-09-10T05:11:50.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.033+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 93947812992784] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.033+0000 7fa0dbf1f800 20 remove_watcher() i=5 2024-09-10T05:11:50.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.033+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93947812996736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee050f80 con 0x5571ee0489c0 2024-09-10T05:11:50.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.034+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 93947812996736] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.034+0000 7fa0dbf1f800 20 remove_watcher() i=6 2024-09-10T05:11:50.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.034+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93947812987712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5571ee057090 con 0x5571ee0489c0 2024-09-10T05:11:50.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0d7ca2640 1 -- 172.21.15.192:0/2357181460 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 93947812987712] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c80b2040 con 0x5571ee0489c0 2024-09-10T05:11:50.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 20 remove_watcher() i=7 2024-09-10T05:11:50.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5571ee0489c0 msgr2=0x5571ee04adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5571ee0489c0 0x5571ee04adb0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5571ee044270 msgr2=0x5571ee046700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5571ee044270 0x5571ee046700 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa0cc02e910 msgr2=0x7fa0cc03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa0cc02e910 0x7fa0cc03a3c0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5571ee04d590 msgr2=0x5571ee04fa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5571ee04d590 0x5571ee04fa50 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fa003c780 msgr2=0x7f9fa003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fa003c780 0x7f9fa003ec40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00ffd0 tx=0x7fa0cc023040 comp rx=0 tx=0).stop 2024-09-10T05:11:50.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 msgr2=0x5571ee038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0d84a3640 1 -- 172.21.15.192:0/2357181460 reap_dead start 2024-09-10T05:11:50.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 0x5571ee038cc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa0c807d750 tx=0x7fa0c8052ee0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 shutdown_connections 2024-09-10T05:11:50.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/2357181460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee0318b0 0x5571ee038cc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.035+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 >> 172.21.15.192:0/2357181460 conn(0x5571ee02dcb0 msgr2=0x5571ee02bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 shutdown_connections 2024-09-10T05:11:50.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/2357181460 wait complete. 2024-09-10T05:11:50.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/240666510 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fb003c8d0 msgr2=0x7f9fb003ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/240666510 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fb003c8d0 0x7f9fb003ed90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5571ee008fd0 tx=0x7fa0cc006000 comp rx=0 tx=0).stop 2024-09-10T05:11:50.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/240666510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee025040 msgr2=0x5571ee025460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/240666510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee025040 0x5571ee025460 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8052560 tx=0x7fa0c807ce00 comp rx=0 tx=0).stop 2024-09-10T05:11:50.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/240666510 shutdown_connections 2024-09-10T05:11:50.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/240666510 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fb003c8d0 0x7f9fb003ed90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/240666510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571ee025040 0x5571ee025460 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/240666510 >> 172.21.15.192:0/240666510 conn(0x5571ee0193f0 msgr2=0x5571ee0197d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/240666510 shutdown_connections 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/240666510 wait complete. 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5571ee0108c0 msgr2=0x5571ee012d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5571ee0108c0 0x5571ee012d60 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5571edf0cdd0 msgr2=0x5571ee00e560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5571edf0cdd0 0x5571ee00e560 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5571ee014950 msgr2=0x5571ee016d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5571ee014950 0x5571ee016d40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fc003c780 msgr2=0x7f9fc003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9fc003c780 0x7f9fc003ec40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc000c00 tx=0x7fa0cc0013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 msgr2=0x5571ee006f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 --2- 172.21.15.192:0/3345080663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571edf0c490 0x5571ee006f10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800a470 tx=0x7fa0c8002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0d84a3640 1 -- 172.21.15.192:0/3345080663 reap_dead start 2024-09-10T05:11:50.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 shutdown_connections 2024-09-10T05:11:50.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 >> 172.21.15.192:0/3345080663 conn(0x5571edf08200 msgr2=0x5571edff97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.036+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 shutdown_connections 2024-09-10T05:11:50.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.037+0000 7fa0dbf1f800 1 -- 172.21.15.192:0/3345080663 wait complete. 2024-09-10T05:11:50.086 INFO:teuthology.orchestra.run.smithi192.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-10T05:11:50.025007Z","last_stats_update":"2024-09-10T05:11:50.024043Z"} 2024-09-10T05:11:50.086 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-10T05:11:50.025007Z', 'last_stats_update': '2024-09-10T05:11:50.024043Z'} 2024-09-10T05:11:50.091 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:11:50.091 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-10T05:11:50.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-10T05:11:50.092 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-10T05:11:50.140 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:50.140 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:50.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.139+0000 7f703dc0e800 1 Processor -- start 2024-09-10T05:11:50.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.140+0000 7f703dc0e800 1 -- start start 2024-09-10T05:11:50.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.140+0000 7f703dc0e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c643b98230 0x55c643b9a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.140+0000 7f703dc0e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c643a3de40 con 0x55c643b946c0 2024-09-10T05:11:50.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.140+0000 7f703dc0e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55c643a08680 con 0x55c643b98230 2024-09-10T05:11:50.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.140+0000 7f7038b6a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c643b98230 0x55c643b9a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.140+0000 7f703936b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55c643b946c0 0x55c643b96ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36406/0 (socket says 172.21.15.192:36406) 2024-09-10T05:11:50.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.140+0000 7f703936b640 1 -- 172.21.15.192:0/1773074836 learned_addr learned my addr 172.21.15.192:0/1773074836 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:50.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.140+0000 7f7038b6a640 1 -- 172.21.15.192:0/1773074836 >> v1:172.21.15.139:6789/0 conn(0x55c643b946c0 legacy=0x55c643b96ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.140+0000 7f7033fff640 1 -- 172.21.15.192:0/1773074836 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608022132 0 0) 0x55c643a3de40 con 0x55c643b946c0 2024-09-10T05:11:50.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.140+0000 7f7038b6a640 1 -- 172.21.15.192:0/1773074836 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c643a246b0 con 0x55c643b98230 2024-09-10T05:11:50.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.142+0000 7f7038b6a640 1 --2- 172.21.15.192:0/1773074836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b98230 0x55c643b9a6d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f702400a470 tx=0x7f7024045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb37d1058e55f41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.142+0000 7f7033fff640 1 -- 172.21.15.192:0/1773074836 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7024053570 con 0x55c643b98230 2024-09-10T05:11:50.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.142+0000 7f7033fff640 1 -- 172.21.15.192:0/1773074836 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7024058070 con 0x55c643b98230 2024-09-10T05:11:50.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.142+0000 7f7033fff640 1 -- 172.21.15.192:0/1773074836 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7024053880 con 0x55c643b98230 2024-09-10T05:11:50.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.143+0000 7f703dc0e800 1 -- 172.21.15.192:0/1773074836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b98230 msgr2=0x55c643b9a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.143+0000 7f703dc0e800 1 --2- 172.21.15.192:0/1773074836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b98230 0x55c643b9a6d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f702400a470 tx=0x7f7024045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:50.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.143+0000 7f703dc0e800 1 -- 172.21.15.192:0/1773074836 shutdown_connections 2024-09-10T05:11:50.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.143+0000 7f703dc0e800 1 --2- 172.21.15.192:0/1773074836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b98230 0x55c643b9a6d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.143+0000 7f703dc0e800 1 -- 172.21.15.192:0/1773074836 >> 172.21.15.192:0/1773074836 conn(0x55c643b8e200 msgr2=0x55c643b90640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.143+0000 7f703dc0e800 1 -- 172.21.15.192:0/1773074836 shutdown_connections 2024-09-10T05:11:50.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.143+0000 7f703dc0e800 1 -- 172.21.15.192:0/1773074836 wait complete. 2024-09-10T05:11:50.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.156+0000 7f703dc0e800 1 Processor -- start 2024-09-10T05:11:50.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.157+0000 7f703dc0e800 1 -- start start 2024-09-10T05:11:50.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.157+0000 7f703dc0e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 0x55c643c83490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.157+0000 7f703dc0e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c643a2cdd0 con 0x55c643b946c0 2024-09-10T05:11:50.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.157+0000 7f703936b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 0x55c643c83490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.157+0000 7f703936b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 0x55c643c83490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60566/0 (socket says 172.21.15.192:60566) 2024-09-10T05:11:50.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.157+0000 7f703936b640 1 -- 172.21.15.192:0/2524651534 learned_addr learned my addr 172.21.15.192:0/2524651534 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.157+0000 7f703936b640 1 -- 172.21.15.192:0/2524651534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c643a45e10 con 0x55c643b946c0 2024-09-10T05:11:50.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.158+0000 7f703936b640 1 --2- 172.21.15.192:0/2524651534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 0x55c643c83490 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f702c006fa0 tx=0x7f702c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208c23f41ee8e537 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.158+0000 7f6f27606640 1 -- 172.21.15.192:0/2524651534 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c003450 con 0x55c643b946c0 2024-09-10T05:11:50.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.158+0000 7f6f27606640 1 -- 172.21.15.192:0/2524651534 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702c003610 con 0x55c643b946c0 2024-09-10T05:11:50.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.158+0000 7f6f27606640 1 -- 172.21.15.192:0/2524651534 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c003970 con 0x55c643b946c0 2024-09-10T05:11:50.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.158+0000 7f703dc0e800 1 -- 172.21.15.192:0/2524651534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 msgr2=0x55c643c83490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.158+0000 7f703dc0e800 1 --2- 172.21.15.192:0/2524651534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 0x55c643c83490 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f702c006fa0 tx=0x7f702c001b00 comp rx=0 tx=0).stop 2024-09-10T05:11:50.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703dc0e800 1 -- 172.21.15.192:0/2524651534 shutdown_connections 2024-09-10T05:11:50.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703dc0e800 1 --2- 172.21.15.192:0/2524651534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 0x55c643c83490 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703dc0e800 1 -- 172.21.15.192:0/2524651534 >> 172.21.15.192:0/2524651534 conn(0x55c643b8e200 msgr2=0x55c643c7ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703dc0e800 1 -- 172.21.15.192:0/2524651534 shutdown_connections 2024-09-10T05:11:50.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703dc0e800 1 -- 172.21.15.192:0/2524651534 wait complete. 2024-09-10T05:11:50.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703dc0e800 1 Processor -- start 2024-09-10T05:11:50.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703dc0e800 1 -- start start 2024-09-10T05:11:50.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703dc0e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 0x55c643c8ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703dc0e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c643b9b050 con 0x55c643b946c0 2024-09-10T05:11:50.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703936b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 0x55c643c8ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703936b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 0x55c643c8ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60580/0 (socket says 172.21.15.192:60580) 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703936b640 1 -- 172.21.15.192:0/429025090 learned_addr learned my addr 172.21.15.192:0/429025090 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.159+0000 7f703936b640 1 -- 172.21.15.192:0/429025090 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c643c8b340 con 0x55c643b946c0 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.160+0000 7f703936b640 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 0x55c643c8ade0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f702c001330 tx=0x7f702c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.160+0000 7f6f25e03640 1 -- 172.21.15.192:0/429025090 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c014a10 con 0x55c643b946c0 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.160+0000 7f6f25e03640 1 -- 172.21.15.192:0/429025090 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702c014bb0 con 0x55c643b946c0 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.160+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c643c8b5d0 con 0x55c643b946c0 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.160+0000 7f6f25e03640 1 -- 172.21.15.192:0/429025090 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c01e3f0 con 0x55c643b946c0 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.160+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c643c8bfd0 con 0x55c643b946c0 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.161+0000 7f6f25e03640 1 -- 172.21.15.192:0/429025090 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f702c010070 con 0x55c643b946c0 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.161+0000 7f6f25e03640 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f2003c780 0x7f6f2003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.161+0000 7f6f25e03640 1 -- 172.21.15.192:0/429025090 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f702c018070 con 0x55c643b946c0 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.161+0000 7f7038b6a640 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f2003c780 0x7f6f2003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.161+0000 7f703dc0e800 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c643b98230 0x55c643c92430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.161+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643c92970 con 0x55c643b98230 2024-09-10T05:11:50.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.161+0000 7f7039b6c640 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c643b98230 0x55c643c92430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.161+0000 7f7038b6a640 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f2003c780 0x7f6f2003ec40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7024057000 tx=0x7f7024052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.162+0000 7f7039b6c640 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c643b98230 0x55c643c92430 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.162+0000 7f7039b6c640 1 -- 172.21.15.192:0/429025090 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70340083e0 con 0x55c643b98230 2024-09-10T05:11:50.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.162+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643c92d10 con 0x55c643b98230 2024-09-10T05:11:50.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.162+0000 7f7039b6c640 1 -- 172.21.15.192:0/429025090 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70340083e0 con 0x55c643b98230 2024-09-10T05:11:50.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.162+0000 7f703dc0e800 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c643c947d0 0x55c643c96c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.162+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643c973e0 con 0x55c643c947d0 2024-09-10T05:11:50.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.162+0000 7f703936b640 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c643c947d0 0x55c643c96c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.163+0000 7f703936b640 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c643c947d0 0x55c643c96c50 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.163+0000 7f703936b640 1 -- 172.21.15.192:0/429025090 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f702c01b070 con 0x55c643c947d0 2024-09-10T05:11:50.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.163+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643c93560 con 0x55c643b98230 2024-09-10T05:11:50.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.163+0000 7f7039b6c640 1 -- 172.21.15.192:0/429025090 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70340083e0 con 0x55c643b98230 2024-09-10T05:11:50.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.163+0000 7f703dc0e800 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c643c98840 0x55c643c9ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.163+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643c9b3a0 con 0x55c643c98840 2024-09-10T05:11:50.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.163+0000 7f7038b6a640 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c643c98840 0x55c643c9ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.164+0000 7f7038b6a640 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c643c98840 0x55c643c9ac30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.164+0000 7f7038b6a640 1 -- 172.21.15.192:0/429025090 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7024051070 con 0x55c643c98840 2024-09-10T05:11:50.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.164+0000 7f703dc0e800 1 Processor -- start 2024-09-10T05:11:50.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.164+0000 7f703dc0e800 1 -- start start 2024-09-10T05:11:50.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.164+0000 7f703dc0e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643ca9010 0x55c643ca9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.164+0000 7f703dc0e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c643a8aa00 con 0x55c643ca9010 2024-09-10T05:11:50.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.165+0000 7f703936b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643ca9010 0x55c643ca9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.165+0000 7f703936b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643ca9010 0x55c643ca9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60590/0 (socket says 172.21.15.192:60590) 2024-09-10T05:11:50.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.165+0000 7f703936b640 1 -- 172.21.15.192:0/3395550715 learned_addr learned my addr 172.21.15.192:0/3395550715 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.165+0000 7f703936b640 1 -- 172.21.15.192:0/3395550715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c643ca9a70 con 0x55c643ca9010 2024-09-10T05:11:50.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.165+0000 7f703936b640 1 --2- 172.21.15.192:0/3395550715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643ca9010 0x55c643ca9430 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f702c010d60 tx=0x7f702c010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.165+0000 7f6f1effd640 1 -- 172.21.15.192:0/3395550715 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c037070 con 0x55c643ca9010 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.165+0000 7f6f1effd640 1 -- 172.21.15.192:0/3395550715 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702c04b110 con 0x55c643ca9010 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.165+0000 7f703dc0e800 1 -- 172.21.15.192:0/3395550715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c643caa2a0 con 0x55c643ca9010 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.165+0000 7f6f1effd640 1 -- 172.21.15.192:0/3395550715 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c04b3f0 con 0x55c643ca9010 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.165+0000 7f703dc0e800 1 -- 172.21.15.192:0/3395550715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c643caa840 con 0x55c643ca9010 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.166+0000 7f6f1effd640 1 -- 172.21.15.192:0/3395550715 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f702c03a070 con 0x55c643ca9010 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.166+0000 7f6f1effd640 1 --2- 172.21.15.192:0/3395550715 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f1003c780 0x7f6f1003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.166+0000 7f6f1effd640 1 -- 172.21.15.192:0/3395550715 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f702c02a000 con 0x55c643ca9010 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.166+0000 7f7038b6a640 1 --2- 172.21.15.192:0/3395550715 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f1003c780 0x7f6f1003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.166+0000 7f703dc0e800 1 Processor -- start 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.166+0000 7f703dc0e800 1 -- start start 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.167+0000 7f7038b6a640 1 --2- 172.21.15.192:0/3395550715 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f1003c780 0x7f6f1003ec40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55c643c8cf10 tx=0x7f7024005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.167+0000 7f703dc0e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 0x55c643b92ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.167+0000 7f703dc0e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c643c83ce0 con 0x55c643b926c0 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.167+0000 7f703936b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 0x55c643b92ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.167+0000 7f703936b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 0x55c643b92ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60598/0 (socket says 172.21.15.192:60598) 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.167+0000 7f703936b640 1 -- 172.21.15.192:0/1129447129 learned_addr learned my addr 172.21.15.192:0/1129447129 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.167+0000 7f703936b640 1 -- 172.21.15.192:0/1129447129 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c643b930b0 con 0x55c643b926c0 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.167+0000 7f703936b640 1 --2- 172.21.15.192:0/1129447129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 0x55c643b92ac0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f702c04b5f0 tx=0x7f702c053550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef6649008af64af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.167+0000 7f6f1cff9640 1 -- 172.21.15.192:0/1129447129 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c062070 con 0x55c643b926c0 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.167+0000 7f6f1cff9640 1 -- 172.21.15.192:0/1129447129 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702c0113e0 con 0x55c643b926c0 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.167+0000 7f6f1cff9640 1 -- 172.21.15.192:0/1129447129 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c011770 con 0x55c643b926c0 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703dc0e800 1 -- 172.21.15.192:0/1129447129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 msgr2=0x55c643b92ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703dc0e800 1 --2- 172.21.15.192:0/1129447129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 0x55c643b92ac0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f702c04b5f0 tx=0x7f702c053550 comp rx=0 tx=0).stop 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703dc0e800 1 -- 172.21.15.192:0/1129447129 shutdown_connections 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703dc0e800 1 --2- 172.21.15.192:0/1129447129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 0x55c643b92ac0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703dc0e800 1 -- 172.21.15.192:0/1129447129 >> 172.21.15.192:0/1129447129 conn(0x55c643cb1ef0 msgr2=0x55c643cb0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703dc0e800 1 -- 172.21.15.192:0/1129447129 shutdown_connections 2024-09-10T05:11:50.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703dc0e800 1 -- 172.21.15.192:0/1129447129 wait complete. 2024-09-10T05:11:50.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703dc0e800 1 Processor -- start 2024-09-10T05:11:50.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703dc0e800 1 -- start start 2024-09-10T05:11:50.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703dc0e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 0x55c643cbf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703dc0e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c643b935a0 con 0x55c643b926c0 2024-09-10T05:11:50.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703936b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 0x55c643cbf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703936b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 0x55c643cbf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60610/0 (socket says 172.21.15.192:60610) 2024-09-10T05:11:50.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.168+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 learned_addr learned my addr 172.21.15.192:0/545991363 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.169+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c643cbf670 con 0x55c643b926c0 2024-09-10T05:11:50.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.169+0000 7f703936b640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 0x55c643cbf110 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f702c0128e0 tx=0x7f702c04df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.169+0000 7f6f0effd640 1 -- 172.21.15.192:0/545991363 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c062040 con 0x55c643b926c0 2024-09-10T05:11:50.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.169+0000 7f6f0effd640 1 -- 172.21.15.192:0/545991363 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702c011a70 con 0x55c643b926c0 2024-09-10T05:11:50.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.169+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c643cbf670 con 0x55c643b926c0 2024-09-10T05:11:50.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.169+0000 7f6f0effd640 1 -- 172.21.15.192:0/545991363 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c01d8a0 con 0x55c643b926c0 2024-09-10T05:11:50.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.169+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c643cbf670 con 0x55c643b926c0 2024-09-10T05:11:50.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.170+0000 7f6f0effd640 1 -- 172.21.15.192:0/545991363 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f702c05c040 con 0x55c643b926c0 2024-09-10T05:11:50.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.170+0000 7f6f0effd640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f0403c780 0x7f6f0403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.170+0000 7f6f0effd640 1 -- 172.21.15.192:0/545991363 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f702c059040 con 0x55c643b926c0 2024-09-10T05:11:50.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.170+0000 7f7038b6a640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f0403c780 0x7f6f0403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.170+0000 7f7038b6a640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f0403c780 0x7f6f0403ec40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7024000c00 tx=0x7f7024053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f703dc0e800 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c643cca4e0 0x55c643ccc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccd0f0 con 0x55c643cca4e0 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f7039b6c640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c643cca4e0 0x55c643ccc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f7039b6c640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c643cca4e0 0x55c643ccc9a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70340083e0 con 0x55c643cca4e0 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f703dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f703dc0e800 20 realm 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccd500 con 0x55c643cca4e0 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70340083e0 con 0x55c643cca4e0 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f703dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f703dc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.171+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cca4e0 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.172+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70340083e0 con 0x55c643cca4e0 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.172+0000 7f703dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.172+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.172+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643cce170 con 0x55c643cca4e0 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.172+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70340083e0 con 0x55c643cca4e0 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.172+0000 7f703dc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.172+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.172+0000 7f703dc0e800 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c643cceb30 0x55c643cd0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.172+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd14f0 con 0x55c643cceb30 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.172+0000 7f703936b640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c643cceb30 0x55c643cd0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.172+0000 7f703936b640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c643cceb30 0x55c643cd0f20 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.173+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.173+0000 7f703dc0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.173+0000 7f703dc0e800 20 searching for the correct realm 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.173+0000 7f703dc0e800 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c643cd34c0 0x55c643cd5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.173+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd6000 con 0x55c643cd34c0 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.173+0000 7f7038b6a640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c643cd34c0 0x55c643cd5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.173+0000 7f7038b6a640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c643cd34c0 0x55c643cd5980 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.173+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.173+0000 7f7038b6a640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f702405f040 0x7f702406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.173+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd6000 con 0x7f702405f040 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.174+0000 7f7039b6c640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f702405f040 0x7f702406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.174+0000 7f7039b6c640 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f702405f040 0x7f702406b410 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.174+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f70340083e0 con 0x7f702405f040 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.174+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cceb30 2024-09-10T05:11:50.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.174+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.174+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cca4e0 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.175+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70340083e0 con 0x55c643cca4e0 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.175+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cca4e0 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.175+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.175+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cceb30 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.175+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.175+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cceb30 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.175+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.175+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x7f702405f040 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.175+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.175+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cd34c0 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.176+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.176+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cca4e0 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.176+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.176+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cceb30 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.176+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.176+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cca4e0 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.176+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.176+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x7f702405f040 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.177+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.177+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cd34c0 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.177+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.177+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cd34c0 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.177+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.177+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cceb30 2024-09-10T05:11:50.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.177+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.177+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cd34c0 2024-09-10T05:11:50.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.178+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.178+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cd34c0 2024-09-10T05:11:50.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.178+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.178+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cca4e0 2024-09-10T05:11:50.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.178+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.178+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cca4e0 2024-09-10T05:11:50.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.178+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.178+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cceb30 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.178+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.179+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cd34c0 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.179+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.179+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x7f702405f040 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.179+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.179+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cca4e0 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.179+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.179+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cceb30 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.179+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.180+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cd34c0 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.180+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.180+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cceb30 2024-09-10T05:11:50.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.180+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.180+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x7f702405f040 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.180+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.180+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cd34c0 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.180+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.180+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cceb30 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x55c643cca4e0 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c643ccddd0 con 0x7f702405f040 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703dc0e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703dc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:50.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703dc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:50.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703dc0e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:50.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703dc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:50.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703dc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:50.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd1db0 con 0x55c643cca4e0 2024-09-10T05:11:50.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.181+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd1db0 con 0x55c643cca4e0 2024-09-10T05:11:50.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd1db0 con 0x7f702405f040 2024-09-10T05:11:50.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:50.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 20 zone default found 2024-09-10T05:11:50.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 4 Realm: () 2024-09-10T05:11:50.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:50.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:50.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:50.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 20 zonegroup default 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd1da0 con 0x55c643cceb30 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.182+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd7e70 con 0x55c643cd34c0 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.183+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.183+0000 7f703dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.183+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.183+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd8210 con 0x55c643cd34c0 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.183+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.183+0000 7f703dc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.183+0000 7f703dc0e800 20 started sync module instance, tier type = 2024-09-10T05:11:50.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.183+0000 7f703dc0e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:50.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.183+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd7310 con 0x7f702405f040 2024-09-10T05:11:50.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.184+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.184+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94310029424704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd7310 con 0x7f702405f040 2024-09-10T05:11:50.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.184+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd8bd0 con 0x55c643cca4e0 2024-09-10T05:11:50.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.185+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94310029424704] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.185+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.185+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94310029428992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd7310 con 0x55c643cca4e0 2024-09-10T05:11:50.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.185+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd9640 con 0x55c643cd34c0 2024-09-10T05:11:50.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.186+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.186+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94310029431088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd9f10 con 0x55c643cd34c0 2024-09-10T05:11:50.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.186+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cdaa00 con 0x7f702405f040 2024-09-10T05:11:50.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.186+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94310029428992] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.187+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94310029431088] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.188+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.188+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94310029433440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cd6e60 con 0x7f702405f040 2024-09-10T05:11:50.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.188+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cdb2e0 con 0x55c643cca4e0 2024-09-10T05:11:50.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.189+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.189+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94310029433440] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.189+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94310029438368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cdb710 con 0x55c643cca4e0 2024-09-10T05:11:50.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.189+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cda510 con 0x55c643cceb30 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.190+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94310029438368] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.190+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.190+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94310029439424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cdc180 con 0x55c643cceb30 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.190+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cdca10 con 0x55c643cceb30 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.191+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94310029439424] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.191+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.191+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94310029442256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cdc620 con 0x55c643cceb30 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.191+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cdd7f0 con 0x55c643cceb30 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.192+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.192+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94310029447904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cddc60 con 0x55c643cceb30 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.192+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94310029442256] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.192+0000 7f703dc0e800 20 add_watcher() i=0 2024-09-10T05:11:50.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.192+0000 7f703dc0e800 20 add_watcher() i=1 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.192+0000 7f703dc0e800 20 add_watcher() i=2 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.192+0000 7f703dc0e800 20 add_watcher() i=3 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.192+0000 7f703dc0e800 20 add_watcher() i=4 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.192+0000 7f703dc0e800 20 add_watcher() i=5 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.192+0000 7f703dc0e800 20 add_watcher() i=6 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.195+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94310029447904] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.195+0000 7f703dc0e800 20 add_watcher() i=7 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.195+0000 7f703dc0e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.195+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643cddc60 con 0x55c643cca4e0 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.195+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.195+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94310029449136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643cddbd0 con 0x55c643cca4e0 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.196+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94310029449136] v35'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.196+0000 7f6eeffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.196+0000 7f703dc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.196+0000 7f703dc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.196+0000 7f703dc0e800 5 note: GC not initialized 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f6eeefe5640 20 reqs_thread_entry: start 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f703dc0e800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f703dc0e800 20 Filter name: none 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f6eecfe1640 20 reqs_thread_entry: start 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f703dc0e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643d13ca0 con 0x55c643cca4e0 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f703dc0e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f703dc0e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f703dc0e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:50.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f703dc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f703dc0e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.197+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643d13700 con 0x7f702405f040 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 : miss 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643d17410 con 0x55c643cd34c0 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:50.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.198+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643d1ab50 con 0x7f702405f040 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.200+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(65 foo.buckets [call] v35'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.200+0000 7f703dc0e800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.200+0000 7f703dc0e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.200+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643d19b60 con 0x7f702405f040 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.200+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.200+0000 7f703dc0e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.200+0000 7f703dc0e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.200+0000 7f703dc0e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:50.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.200+0000 7f703dc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.200+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643d1e680 con 0x7f702405f040 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.201+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v35'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.201+0000 7f703dc0e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.201+0000 7f703dc0e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.201+0000 7f703dc0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.201+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94310029697184 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c643d1b980 con 0x55c643cceb30 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.202+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== watch-notify(notify (1) cookie 94310029442256 notify 150323855367 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55c643caa840 con 0x55c643cceb30 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.202+0000 7f6f1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855367 cookie 94310029442256 notifier 4490 bl.length()=338 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.202+0000 7f6f1cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.202+0000 7f6f1cff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.202+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(68 notify.6 [notify cookie 94310029697184 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.202+0000 7f6f1cff9640 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6efc003ea0 con 0x55c643cceb30 2024-09-10T05:11:50.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.202+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.202+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== watch-notify(notify_complete (2) cookie 94310029697184 notify 150323855367 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f702c081040 con 0x55c643cceb30 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.203+0000 7f6eeffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.203+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94310029449136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643d11b00 con 0x55c643cca4e0 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.204+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94310029449136] v35'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.204+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94310029424704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643d11b00 con 0x7f702405f040 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.205+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94310029424704] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.205+0000 7f703dc0e800 20 remove_watcher() i=0 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.205+0000 7f703dc0e800 2 removed watcher, disabling cache 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.205+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94310029428992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643d11b00 con 0x55c643cca4e0 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.206+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94310029428992] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.206+0000 7f703dc0e800 20 remove_watcher() i=1 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.206+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94310029431088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643d11b00 con 0x55c643cd34c0 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.207+0000 7f7038b6a640 1 -- 172.21.15.192:0/545991363 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94310029431088] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702407c040 con 0x55c643cd34c0 2024-09-10T05:11:50.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.207+0000 7f703dc0e800 20 remove_watcher() i=2 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.207+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94310029433440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643d11b00 con 0x7f702405f040 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.208+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94310029433440] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7034026040 con 0x7f702405f040 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.208+0000 7f703dc0e800 20 remove_watcher() i=3 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.208+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94310029438368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643d11b00 con 0x55c643cca4e0 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.209+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94310029438368] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7034026040 con 0x55c643cca4e0 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.209+0000 7f703dc0e800 20 remove_watcher() i=4 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.209+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94310029439424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643d11b00 con 0x55c643cceb30 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.210+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94310029439424] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.210+0000 7f703dc0e800 20 remove_watcher() i=5 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.210+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94310029442256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643d11b00 con 0x55c643cceb30 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.211+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94310029442256] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.211+0000 7f703dc0e800 20 remove_watcher() i=6 2024-09-10T05:11:50.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.211+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94310029447904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c643d11b00 con 0x55c643cceb30 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703936b640 1 -- 172.21.15.192:0/545991363 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94310029447904] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f702c064070 con 0x55c643cceb30 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 20 remove_watcher() i=7 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c643cceb30 msgr2=0x55c643cd0f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c643cceb30 0x55c643cd0f20 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c643cca4e0 msgr2=0x55c643ccc9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c643cca4e0 0x55c643ccc9a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f702405f040 msgr2=0x7f702406b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f702405f040 0x7f702406b410 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c643cd34c0 msgr2=0x55c643cd5980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c643cd34c0 0x55c643cd5980 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f0403c780 msgr2=0x7f6f0403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f0403c780 0x7f6f0403ec40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7024000c00 tx=0x7f7024053000 comp rx=0 tx=0).stop 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 msgr2=0x55c643cbf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f7039b6c640 1 -- 172.21.15.192:0/545991363 reap_dead start 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.212+0000 7f703dc0e800 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 0x55c643cbf110 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f702c0128e0 tx=0x7f702c04df50 comp rx=0 tx=0).stop 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 shutdown_connections 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 --2- 172.21.15.192:0/545991363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b926c0 0x55c643cbf110 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 >> 172.21.15.192:0/545991363 conn(0x55c643cb1ef0 msgr2=0x55c643cb0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 shutdown_connections 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/545991363 wait complete. 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/3395550715 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f1003c780 msgr2=0x7f6f1003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 --2- 172.21.15.192:0/3395550715 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f1003c780 0x7f6f1003ec40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55c643c8cf10 tx=0x7f7024005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/3395550715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643ca9010 msgr2=0x55c643ca9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 --2- 172.21.15.192:0/3395550715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643ca9010 0x55c643ca9430 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f702c010d60 tx=0x7f702c010ab0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/3395550715 shutdown_connections 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 --2- 172.21.15.192:0/3395550715 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f1003c780 0x7f6f1003ec40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 --2- 172.21.15.192:0/3395550715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643ca9010 0x55c643ca9430 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/3395550715 >> 172.21.15.192:0/3395550715 conn(0x55c643c9d3c0 msgr2=0x55c643c9d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/3395550715 shutdown_connections 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/3395550715 wait complete. 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c643c947d0 msgr2=0x55c643c96c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c643c947d0 0x55c643c96c50 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c643b98230 msgr2=0x55c643c92430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c643b98230 0x55c643c92430 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c643c98840 msgr2=0x55c643c9ac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c643c98840 0x55c643c9ac30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f2003c780 msgr2=0x7f6f2003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6f2003c780 0x7f6f2003ec40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7024057000 tx=0x7f7024052000 comp rx=0 tx=0).stop 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 msgr2=0x55c643c8ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 --2- 172.21.15.192:0/429025090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c643b946c0 0x55c643c8ade0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f702c001330 tx=0x7f702c001250 comp rx=0 tx=0).stop 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f7039b6c640 1 -- 172.21.15.192:0/429025090 reap_dead start 2024-09-10T05:11:50.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 shutdown_connections 2024-09-10T05:11:50.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.213+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 >> 172.21.15.192:0/429025090 conn(0x55c643b8e200 msgr2=0x55c643c84770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.214+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 shutdown_connections 2024-09-10T05:11:50.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.214+0000 7f703dc0e800 1 -- 172.21.15.192:0/429025090 wait complete. 2024-09-10T05:11:50.229 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T05:11:50.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T05:11:50.229 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-10T05:11:50.281 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:50.281 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:50.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.281+0000 7fa3ea325800 1 Processor -- start 2024-09-10T05:11:50.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.281+0000 7fa3ea325800 1 -- start start 2024-09-10T05:11:50.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.281+0000 7fa3ea325800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562deedd7ff0 0x562deede0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.281+0000 7fa3ea325800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562deec81e40 con 0x562deedd64d0 2024-09-10T05:11:50.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.281+0000 7fa3ea325800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x562deec4c680 con 0x562deedd7ff0 2024-09-10T05:11:50.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.281+0000 7fa3dffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562deedd7ff0 0x562deede0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.281+0000 7fa3e5f33640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x562deedd64d0 0x562deedd68d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36420/0 (socket says 172.21.15.192:36420) 2024-09-10T05:11:50.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.281+0000 7fa3e5f33640 1 -- 172.21.15.192:0/4015515145 learned_addr learned my addr 172.21.15.192:0/4015515145 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:50.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.282+0000 7fa3dffff640 1 -- 172.21.15.192:0/4015515145 >> v1:172.21.15.139:6789/0 conn(0x562deedd64d0 legacy=0x562deedd68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.282+0000 7fa3e5732640 1 -- 172.21.15.192:0/4015515145 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610941587 0 0) 0x562deec81e40 con 0x562deedd64d0 2024-09-10T05:11:50.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.282+0000 7fa3dffff640 1 -- 172.21.15.192:0/4015515145 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562deec686b0 con 0x562deedd7ff0 2024-09-10T05:11:50.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.283+0000 7fa3dffff640 1 --2- 172.21.15.192:0/4015515145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd7ff0 0x562deede0b10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000a470 tx=0x7fa3d0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c617bd6e68cfa920 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.283+0000 7fa3e5732640 1 -- 172.21.15.192:0/4015515145 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d0053570 con 0x562deedd7ff0 2024-09-10T05:11:50.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.284+0000 7fa3e5732640 1 -- 172.21.15.192:0/4015515145 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d0058070 con 0x562deedd7ff0 2024-09-10T05:11:50.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.284+0000 7fa3e5732640 1 -- 172.21.15.192:0/4015515145 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d0053880 con 0x562deedd7ff0 2024-09-10T05:11:50.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.284+0000 7fa3ea325800 1 -- 172.21.15.192:0/4015515145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd7ff0 msgr2=0x562deede0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.284+0000 7fa3ea325800 1 --2- 172.21.15.192:0/4015515145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd7ff0 0x562deede0b10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000a470 tx=0x7fa3d0045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:50.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.284+0000 7fa3ea325800 1 -- 172.21.15.192:0/4015515145 shutdown_connections 2024-09-10T05:11:50.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.284+0000 7fa3ea325800 1 --2- 172.21.15.192:0/4015515145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd7ff0 0x562deede0b10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.284+0000 7fa3ea325800 1 -- 172.21.15.192:0/4015515145 >> 172.21.15.192:0/4015515145 conn(0x562deedd2200 msgr2=0x562deedd4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.284+0000 7fa3ea325800 1 -- 172.21.15.192:0/4015515145 shutdown_connections 2024-09-10T05:11:50.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.284+0000 7fa3ea325800 1 -- 172.21.15.192:0/4015515145 wait complete. 2024-09-10T05:11:50.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.298+0000 7fa3ea325800 1 Processor -- start 2024-09-10T05:11:50.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.298+0000 7fa3ea325800 1 -- start start 2024-09-10T05:11:50.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.298+0000 7fa3ea325800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 0x562deeec9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.298+0000 7fa3ea325800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562deec70dd0 con 0x562deedd64d0 2024-09-10T05:11:50.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.299+0000 7fa3e5f33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 0x562deeec9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.299+0000 7fa3e5f33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 0x562deeec9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60642/0 (socket says 172.21.15.192:60642) 2024-09-10T05:11:50.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.299+0000 7fa3e5f33640 1 -- 172.21.15.192:0/4273652246 learned_addr learned my addr 172.21.15.192:0/4273652246 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.299+0000 7fa3e5f33640 1 -- 172.21.15.192:0/4273652246 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562deec89e10 con 0x562deedd64d0 2024-09-10T05:11:50.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.299+0000 7fa3e5f33640 1 --2- 172.21.15.192:0/4273652246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 0x562deeec9790 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8001ea0 tx=0x7fa3d800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438bb32d03131de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.299+0000 7fa2d3e07640 1 -- 172.21.15.192:0/4273652246 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d8008070 con 0x562deedd64d0 2024-09-10T05:11:50.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.299+0000 7fa2d3e07640 1 -- 172.21.15.192:0/4273652246 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d800d500 con 0x562deedd64d0 2024-09-10T05:11:50.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.299+0000 7fa2d3e07640 1 -- 172.21.15.192:0/4273652246 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d800d880 con 0x562deedd64d0 2024-09-10T05:11:50.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.300+0000 7fa3ea325800 1 -- 172.21.15.192:0/4273652246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 msgr2=0x562deeec9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.300+0000 7fa3ea325800 1 --2- 172.21.15.192:0/4273652246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 0x562deeec9790 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8001ea0 tx=0x7fa3d800b6a0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.300+0000 7fa3ea325800 1 -- 172.21.15.192:0/4273652246 shutdown_connections 2024-09-10T05:11:50.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.300+0000 7fa3ea325800 1 --2- 172.21.15.192:0/4273652246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 0x562deeec9790 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.300+0000 7fa3ea325800 1 -- 172.21.15.192:0/4273652246 >> 172.21.15.192:0/4273652246 conn(0x562deedd2200 msgr2=0x562deeec5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.300+0000 7fa3ea325800 1 -- 172.21.15.192:0/4273652246 shutdown_connections 2024-09-10T05:11:50.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.300+0000 7fa3ea325800 1 -- 172.21.15.192:0/4273652246 wait complete. 2024-09-10T05:11:50.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.300+0000 7fa3ea325800 1 Processor -- start 2024-09-10T05:11:50.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.301+0000 7fa3ea325800 1 -- start start 2024-09-10T05:11:50.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.301+0000 7fa3ea325800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 0x562deeed1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.301+0000 7fa3ea325800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562deede1320 con 0x562deedd64d0 2024-09-10T05:11:50.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.301+0000 7fa3e5f33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 0x562deeed1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.301+0000 7fa3e5f33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 0x562deeed1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60648/0 (socket says 172.21.15.192:60648) 2024-09-10T05:11:50.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.301+0000 7fa3e5f33640 1 -- 172.21.15.192:0/4196779127 learned_addr learned my addr 172.21.15.192:0/4196779127 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.301+0000 7fa3e5f33640 1 -- 172.21.15.192:0/4196779127 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562deeed1660 con 0x562deedd64d0 2024-09-10T05:11:50.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.301+0000 7fa3e5f33640 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 0x562deeed1100 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80012f0 tx=0x7fa3d8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.301+0000 7fa2d2604640 1 -- 172.21.15.192:0/4196779127 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d800f9d0 con 0x562deedd64d0 2024-09-10T05:11:50.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.301+0000 7fa2d2604640 1 -- 172.21.15.192:0/4196779127 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d800fb70 con 0x562deedd64d0 2024-09-10T05:11:50.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.301+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562deeed18f0 con 0x562deedd64d0 2024-09-10T05:11:50.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.302+0000 7fa2d2604640 1 -- 172.21.15.192:0/4196779127 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d800fe50 con 0x562deedd64d0 2024-09-10T05:11:50.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.302+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562deeed22f0 con 0x562deedd64d0 2024-09-10T05:11:50.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.302+0000 7fa2d2604640 1 -- 172.21.15.192:0/4196779127 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa3d8017040 con 0x562deedd64d0 2024-09-10T05:11:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.303+0000 7fa2d2604640 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2cc03c920 0x7fa2cc03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.303+0000 7fa2d2604640 1 -- 172.21.15.192:0/4196779127 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa3d8015020 con 0x562deedd64d0 2024-09-10T05:11:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.303+0000 7fa3dffff640 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2cc03c920 0x7fa2cc03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.303+0000 7fa3ea325800 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562deedd7ff0 0x562deeed8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.303+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deeed8c90 con 0x562deedd7ff0 2024-09-10T05:11:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.303+0000 7fa3e6734640 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562deedd7ff0 0x562deeed8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.303+0000 7fa3dffff640 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2cc03c920 0x7fa2cc03ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0057000 tx=0x7fa3d0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.303+0000 7fa3e6734640 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562deedd7ff0 0x562deeed8750 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.303+0000 7fa3e6734640 1 -- 172.21.15.192:0/4196779127 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deedd7ff0 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.303+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deeed9030 con 0x562deedd7ff0 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.304+0000 7fa3e6734640 1 -- 172.21.15.192:0/4196779127 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deedd7ff0 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.304+0000 7fa3ea325800 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562deeedab30 0x562deeedcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.304+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deeedd740 con 0x562deeedab30 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.304+0000 7fa3e5f33640 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562deeedab30 0x562deeedcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.304+0000 7fa3e5f33640 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562deeedab30 0x562deeedcfb0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.305+0000 7fa3e5f33640 1 -- 172.21.15.192:0/4196779127 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa3d802d070 con 0x562deeedab30 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.305+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deeed9880 con 0x562deedd7ff0 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.305+0000 7fa3e6734640 1 -- 172.21.15.192:0/4196779127 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deedd7ff0 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.305+0000 7fa3ea325800 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562deeedeba0 0x562deeee0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.305+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deeee1700 con 0x562deeedeba0 2024-09-10T05:11:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.305+0000 7fa3dffff640 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562deeedeba0 0x562deeee0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.305+0000 7fa3dffff640 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562deeedeba0 0x562deeee0f90 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.306+0000 7fa3dffff640 1 -- 172.21.15.192:0/4196779127 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa3d0051070 con 0x562deeedeba0 2024-09-10T05:11:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.306+0000 7fa3ea325800 1 Processor -- start 2024-09-10T05:11:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.306+0000 7fa3ea325800 1 -- start start 2024-09-10T05:11:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.306+0000 7fa3ea325800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeeef2b0 0x562deeeef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.306+0000 7fa3ea325800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562deeccea00 con 0x562deeeef2b0 2024-09-10T05:11:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.306+0000 7fa3e5f33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeeef2b0 0x562deeeef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.306+0000 7fa3e5f33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeeef2b0 0x562deeeef6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60662/0 (socket says 172.21.15.192:60662) 2024-09-10T05:11:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.306+0000 7fa3e5f33640 1 -- 172.21.15.192:0/2467432985 learned_addr learned my addr 172.21.15.192:0/2467432985 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.307+0000 7fa3e5f33640 1 -- 172.21.15.192:0/2467432985 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562deeeefd10 con 0x562deeeef2b0 2024-09-10T05:11:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.307+0000 7fa3e5f33640 1 --2- 172.21.15.192:0/2467432985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeeef2b0 0x562deeeef6d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800e660 tx=0x7fa3d8052e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.307+0000 7fa2cb7fe640 1 -- 172.21.15.192:0/2467432985 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d804b350 con 0x562deeeef2b0 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.307+0000 7fa2cb7fe640 1 -- 172.21.15.192:0/2467432985 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d801a3c0 con 0x562deeeef2b0 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.307+0000 7fa3ea325800 1 -- 172.21.15.192:0/2467432985 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562deeef0540 con 0x562deeeef2b0 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.307+0000 7fa2cb7fe640 1 -- 172.21.15.192:0/2467432985 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d8044910 con 0x562deeeef2b0 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.307+0000 7fa3ea325800 1 -- 172.21.15.192:0/2467432985 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562deeef0ae0 con 0x562deeeef2b0 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.308+0000 7fa2cb7fe640 1 -- 172.21.15.192:0/2467432985 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa3d8044ab0 con 0x562deeeef2b0 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.308+0000 7fa2cb7fe640 1 --2- 172.21.15.192:0/2467432985 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2c003c780 0x7fa2c003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.308+0000 7fa2cb7fe640 1 -- 172.21.15.192:0/2467432985 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa3d803d3d0 con 0x562deeeef2b0 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.308+0000 7fa3dffff640 1 --2- 172.21.15.192:0/2467432985 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2c003c780 0x7fa2c003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.308+0000 7fa3ea325800 1 Processor -- start 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.308+0000 7fa3ea325800 1 -- start start 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.308+0000 7fa3dffff640 1 --2- 172.21.15.192:0/2467432985 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2c003c780 0x7fa2c003ec40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0000c00 tx=0x7fa3d0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.308+0000 7fa3ea325800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 0x562deeefbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.308+0000 7fa3ea325800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562deeec9fe0 con 0x562deeefbae0 2024-09-10T05:11:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.309+0000 7fa3e5f33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 0x562deeefbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.309+0000 7fa3e5f33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 0x562deeefbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60666/0 (socket says 172.21.15.192:60666) 2024-09-10T05:11:50.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.309+0000 7fa3e5f33640 1 -- 172.21.15.192:0/2271334974 learned_addr learned my addr 172.21.15.192:0/2271334974 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.309+0000 7fa3e5f33640 1 -- 172.21.15.192:0/2271334974 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562deeefc4d0 con 0x562deeefbae0 2024-09-10T05:11:50.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.309+0000 7fa3e5f33640 1 --2- 172.21.15.192:0/2271334974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 0x562deeefbee0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa3d803b7f0 tx=0x7fa3d8044810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c733fd23307e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.309+0000 7fa2c97fa640 1 -- 172.21.15.192:0/2271334974 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d8019470 con 0x562deeefbae0 2024-09-10T05:11:50.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.309+0000 7fa2c97fa640 1 -- 172.21.15.192:0/2271334974 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d8044da0 con 0x562deeefbae0 2024-09-10T05:11:50.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.309+0000 7fa2c97fa640 1 -- 172.21.15.192:0/2271334974 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d802fd30 con 0x562deeefbae0 2024-09-10T05:11:50.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.309+0000 7fa3ea325800 1 -- 172.21.15.192:0/2271334974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 msgr2=0x562deeefbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.309+0000 7fa3ea325800 1 --2- 172.21.15.192:0/2271334974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 0x562deeefbee0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa3d803b7f0 tx=0x7fa3d8044810 comp rx=0 tx=0).stop 2024-09-10T05:11:50.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3ea325800 1 -- 172.21.15.192:0/2271334974 shutdown_connections 2024-09-10T05:11:50.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3ea325800 1 --2- 172.21.15.192:0/2271334974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 0x562deeefbee0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3ea325800 1 -- 172.21.15.192:0/2271334974 >> 172.21.15.192:0/2271334974 conn(0x562deeef7ee0 msgr2=0x562deeef6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3ea325800 1 -- 172.21.15.192:0/2271334974 shutdown_connections 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3ea325800 1 -- 172.21.15.192:0/2271334974 wait complete. 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3ea325800 1 Processor -- start 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3ea325800 1 -- start start 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3ea325800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 0x562deef02e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3ea325800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562deeefc940 con 0x562deeefbae0 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3e5f33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 0x562deef02e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3e5f33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 0x562deef02e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60674/0 (socket says 172.21.15.192:60674) 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 learned_addr learned my addr 172.21.15.192:0/614318193 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.310+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562deef033e0 con 0x562deeefbae0 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.311+0000 7fa3e5f33640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 0x562deef02e80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa3d803e690 tx=0x7fa3d803b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.311+0000 7fa2b77fe640 1 -- 172.21.15.192:0/614318193 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d806a070 con 0x562deeefbae0 2024-09-10T05:11:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.311+0000 7fa2b77fe640 1 -- 172.21.15.192:0/614318193 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d803f8e0 con 0x562deeefbae0 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.311+0000 7fa2b77fe640 1 -- 172.21.15.192:0/614318193 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3d80198d0 con 0x562deeefbae0 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.311+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562deef033e0 con 0x562deeefbae0 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.311+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562deef033e0 con 0x562deeefbae0 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.312+0000 7fa2b77fe640 1 -- 172.21.15.192:0/614318193 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa3d806d070 con 0x562deeefbae0 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.312+0000 7fa2b77fe640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2b003c6e0 0x7fa2b003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.312+0000 7fa2b77fe640 1 -- 172.21.15.192:0/614318193 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa3d8061040 con 0x562deeefbae0 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.312+0000 7fa3dffff640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2b003c6e0 0x7fa2b003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.312+0000 7fa3dffff640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2b003c6e0 0x7fa2b003eba0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x562deeee1b00 tx=0x7fa3d0053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.312+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3ea325800 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562deef0e4b0 0x562deef10970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef110c0 con 0x562deef0e4b0 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3e6734640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562deef0e4b0 0x562deef10970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3e6734640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562deef0e4b0 0x562deef10970 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3ea325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3ea325800 20 realm 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef114d0 con 0x562deef0e4b0 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3ea325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3ea325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.313+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef11da0 con 0x562deef0e4b0 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.314+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.314+0000 7fa3ea325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.314+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.314+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef0e4b0 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.314+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.314+0000 7fa3ea325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.314+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.314+0000 7fa3ea325800 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562deef12ea0 0x562deef15290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.314+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef15850 con 0x562deef12ea0 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.314+0000 7fa3e5f33640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562deef12ea0 0x562deef15290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.314+0000 7fa3e5f33640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562deef12ea0 0x562deef15290 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.315+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.315+0000 7fa3ea325800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.315+0000 7fa3ea325800 20 searching for the correct realm 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.315+0000 7fa3ea325800 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562deef17800 0x562deef19cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.315+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef1a390 con 0x562deef17800 2024-09-10T05:11:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.315+0000 7fa3dffff640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562deef17800 0x562deef19cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.315+0000 7fa3dffff640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562deef17800 0x562deef19cc0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.315+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.315+0000 7fa3dffff640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa3d005f040 0x7fa3d006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.315+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef1a390 con 0x7fa3d005f040 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.315+0000 7fa3e6734640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa3d005f040 0x7fa3d006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.316+0000 7fa3e6734640 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa3d005f040 0x7fa3d006b410 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.316+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.316+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef12ea0 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.316+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.316+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef0e4b0 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.317+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.317+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef0e4b0 2024-09-10T05:11:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.317+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.317+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef12ea0 2024-09-10T05:11:50.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.317+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.317+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef12ea0 2024-09-10T05:11:50.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.317+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.317+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x7fa3d005f040 2024-09-10T05:11:50.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.318+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.318+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef17800 2024-09-10T05:11:50.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.318+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.318+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef0e4b0 2024-09-10T05:11:50.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.318+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.318+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef12ea0 2024-09-10T05:11:50.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.318+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.318+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef0e4b0 2024-09-10T05:11:50.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.318+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.319+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x7fa3d005f040 2024-09-10T05:11:50.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.319+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.319+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef17800 2024-09-10T05:11:50.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.319+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.319+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef17800 2024-09-10T05:11:50.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.319+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.319+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef12ea0 2024-09-10T05:11:50.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.319+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.319+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef17800 2024-09-10T05:11:50.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.320+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.320+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef17800 2024-09-10T05:11:50.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.320+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.320+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef0e4b0 2024-09-10T05:11:50.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.320+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.320+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef0e4b0 2024-09-10T05:11:50.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.320+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.320+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef12ea0 2024-09-10T05:11:50.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.321+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.321+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef17800 2024-09-10T05:11:50.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.321+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.321+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x7fa3d005f040 2024-09-10T05:11:50.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.321+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.321+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef0e4b0 2024-09-10T05:11:50.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.321+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.321+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef12ea0 2024-09-10T05:11:50.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.322+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.322+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef17800 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.322+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.322+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef12ea0 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.322+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.322+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x7fa3d005f040 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.322+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.322+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef17800 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef12ea0 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x562deef0e4b0 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562deef12140 con 0x7fa3d005f040 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3ea325800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3ea325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3ea325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3ea325800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3ea325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3ea325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.323+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef16110 con 0x562deef0e4b0 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef16110 con 0x562deef0e4b0 2024-09-10T05:11:50.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef16110 con 0x7fa3d005f040 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 20 zone default found 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 4 Realm: () 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 20 zonegroup default 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef169b0 con 0x562deef12ea0 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.324+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.325+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef1c200 con 0x562deef17800 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.325+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.325+0000 7fa3ea325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.325+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.325+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef1c5a0 con 0x562deef17800 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.325+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.325+0000 7fa3ea325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.325+0000 7fa3ea325800 20 started sync module instance, tier type = 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.325+0000 7fa3ea325800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.325+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef1b6a0 con 0x7fa3d005f040 2024-09-10T05:11:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.326+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.326+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94755282336672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef1b6a0 con 0x7fa3d005f040 2024-09-10T05:11:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.326+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef1cf60 con 0x562deef0e4b0 2024-09-10T05:11:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.327+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94755282336672] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.327+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.328+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94755282334704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef1cf60 con 0x562deef0e4b0 2024-09-10T05:11:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.328+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef1d960 con 0x562deef17800 2024-09-10T05:11:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.328+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.328+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94755282343024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef1e230 con 0x562deef17800 2024-09-10T05:11:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.328+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef1ecd0 con 0x7fa3d005f040 2024-09-10T05:11:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.329+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94755282334704] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.329+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94755282343024] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.330+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.330+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94755282345344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef1cab0 con 0x7fa3d005f040 2024-09-10T05:11:50.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.330+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef1f570 con 0x562deef0e4b0 2024-09-10T05:11:50.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.331+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.331+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94755282350192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef1f490 con 0x562deef0e4b0 2024-09-10T05:11:50.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.331+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef204b0 con 0x562deef12ea0 2024-09-10T05:11:50.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.331+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94755282345344] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.332+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94755282350192] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.332+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.332+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94755282352480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef1e7a0 con 0x562deef12ea0 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.332+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef20d50 con 0x562deef12ea0 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.332+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94755282352480] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.333+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.333+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94755282354048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef215f0 con 0x562deef12ea0 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.333+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef21e80 con 0x562deef12ea0 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.333+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94755282354048] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94755282360720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef22270 con 0x562deef12ea0 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3ea325800 20 add_watcher() i=0 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3ea325800 20 add_watcher() i=1 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3ea325800 20 add_watcher() i=2 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3ea325800 20 add_watcher() i=3 2024-09-10T05:11:50.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3ea325800 20 add_watcher() i=4 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3ea325800 20 add_watcher() i=5 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3ea325800 20 add_watcher() i=6 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94755282360720] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3ea325800 20 add_watcher() i=7 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3ea325800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.334+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef25750 con 0x562deef0e4b0 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.335+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.335+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94755282362992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef22bb0 con 0x562deef0e4b0 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.336+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94755282362992] v35'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.336+0000 7fa2977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.336+0000 7fa3ea325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.336+0000 7fa3ea325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.336+0000 7fa3ea325800 5 note: GC not initialized 2024-09-10T05:11:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa2967fc640 20 reqs_thread_entry: start 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa3ea325800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa3ea325800 20 Filter name: none 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa207fff640 20 reqs_thread_entry: start 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa3ea325800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef58740 con 0x562deef12ea0 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa3ea325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa3ea325800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa3ea325800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa3ea325800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa3ea325800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.337+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef56de0 con 0x562deef12ea0 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.338+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.338+0000 7fa3ea325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.338+0000 7fa3ea325800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.338+0000 7fa3ea325800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.338+0000 7fa3ea325800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.338+0000 7fa3ea325800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.338+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef576b0 con 0x562deef12ea0 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v35'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa3ea325800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa3ea325800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa3ea325800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94755282579968 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef5bbd0 con 0x562deef12ea0 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== watch-notify(notify (1) cookie 94755282352480 notify 150323855368 ret 0) ==== 598+0+0 (crc 0 0 0) 0x562deef58090 con 0x562deef12ea0 2024-09-10T05:11:50.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa2c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855368 cookie 94755282352480 notifier 4497 bl.length()=556 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa2c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa2c97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa2c97fa640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa2a8003ea0 con 0x562deef12ea0 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(65 notify.5 [notify cookie 94755282579968 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== watch-notify(notify_complete (2) cookie 94755282579968 notify 150323855368 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562deeeefd10 con 0x562deef12ea0 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.339+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef57660 con 0x562deef12ea0 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.340+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v35'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.340+0000 7fa3ea325800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.340+0000 7fa3ea325800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.340+0000 7fa3ea325800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.340+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94755282579888 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562deef5bd30 con 0x562deef17800 2024-09-10T05:11:50.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.341+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== watch-notify(notify (1) cookie 94755282343024 notify 150323855362 ret 0) ==== 219+0+0 (crc 0 0 0) 0x562deec686b0 con 0x562deef17800 2024-09-10T05:11:50.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.341+0000 7fa2c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855362 cookie 94755282343024 notifier 4497 bl.length()=177 2024-09-10T05:11:50.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.341+0000 7fa2c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:11:50.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.341+0000 7fa2c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:11:50.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.341+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(68 notify.2 [notify cookie 94755282579888 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.341+0000 7fa2c8ff9640 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa210003400 con 0x562deef17800 2024-09-10T05:11:50.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.341+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.341+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== watch-notify(notify_complete (2) cookie 94755282579888 notify 150323855362 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa3d0075cd0 con 0x562deef17800 2024-09-10T05:11:50.359 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T05:11:50.338764Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:50.338754Z","tags":[],"group_ids":[]} 2024-09-10T05:11:50.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.342+0000 7fa2977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.342+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94755282362992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef56550 con 0x562deef0e4b0 2024-09-10T05:11:50.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.343+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94755282362992] v35'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.343+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94755282336672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef56550 con 0x7fa3d005f040 2024-09-10T05:11:50.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.344+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94755282336672] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.344+0000 7fa3ea325800 20 remove_watcher() i=0 2024-09-10T05:11:50.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.344+0000 7fa3ea325800 2 removed watcher, disabling cache 2024-09-10T05:11:50.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.344+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94755282334704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef56550 con 0x562deef0e4b0 2024-09-10T05:11:50.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.345+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94755282334704] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.345+0000 7fa3ea325800 20 remove_watcher() i=1 2024-09-10T05:11:50.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.345+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94755282343024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef56550 con 0x562deef17800 2024-09-10T05:11:50.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.346+0000 7fa3dffff640 1 -- 172.21.15.192:0/614318193 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94755282343024] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d007c040 con 0x562deef17800 2024-09-10T05:11:50.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.346+0000 7fa3ea325800 20 remove_watcher() i=2 2024-09-10T05:11:50.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.346+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94755282345344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef56550 con 0x7fa3d005f040 2024-09-10T05:11:50.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.347+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94755282345344] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x7fa3d005f040 2024-09-10T05:11:50.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.347+0000 7fa3ea325800 20 remove_watcher() i=3 2024-09-10T05:11:50.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.347+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94755282350192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef56550 con 0x562deef0e4b0 2024-09-10T05:11:50.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.348+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94755282350192] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3e000a4d0 con 0x562deef0e4b0 2024-09-10T05:11:50.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.348+0000 7fa3ea325800 20 remove_watcher() i=4 2024-09-10T05:11:50.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.348+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94755282352480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef56550 con 0x562deef12ea0 2024-09-10T05:11:50.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.349+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94755282352480] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.349+0000 7fa3ea325800 20 remove_watcher() i=5 2024-09-10T05:11:50.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.349+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94755282354048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef56550 con 0x562deef12ea0 2024-09-10T05:11:50.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.350+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94755282354048] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.350+0000 7fa3ea325800 20 remove_watcher() i=6 2024-09-10T05:11:50.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.350+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94755282360720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562deef56550 con 0x562deef12ea0 2024-09-10T05:11:50.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3e5f33640 1 -- 172.21.15.192:0/614318193 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94755282360720] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3d8076070 con 0x562deef12ea0 2024-09-10T05:11:50.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 20 remove_watcher() i=7 2024-09-10T05:11:50.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562deef12ea0 msgr2=0x562deef15290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562deef12ea0 0x562deef15290 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562deef0e4b0 msgr2=0x562deef10970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562deef0e4b0 0x562deef10970 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa3d005f040 msgr2=0x7fa3d006b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa3d005f040 0x7fa3d006b410 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562deef17800 msgr2=0x562deef19cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562deef17800 0x562deef19cc0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2b003c6e0 msgr2=0x7fa2b003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2b003c6e0 0x7fa2b003eba0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x562deeee1b00 tx=0x7fa3d0053000 comp rx=0 tx=0).stop 2024-09-10T05:11:50.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 msgr2=0x562deef02e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3e6734640 1 -- 172.21.15.192:0/614318193 reap_dead start 2024-09-10T05:11:50.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.351+0000 7fa3ea325800 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 0x562deef02e80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa3d803e690 tx=0x7fa3d803b750 comp rx=0 tx=0).stop 2024-09-10T05:11:50.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 shutdown_connections 2024-09-10T05:11:50.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 --2- 172.21.15.192:0/614318193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeefbae0 0x562deef02e80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 >> 172.21.15.192:0/614318193 conn(0x562deeef7ee0 msgr2=0x562deeef60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 shutdown_connections 2024-09-10T05:11:50.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/614318193 wait complete. 2024-09-10T05:11:50.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/2467432985 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2c003c780 msgr2=0x7fa2c003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 --2- 172.21.15.192:0/2467432985 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2c003c780 0x7fa2c003ec40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0000c00 tx=0x7fa3d0005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:50.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/2467432985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeeef2b0 msgr2=0x562deeeef6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 --2- 172.21.15.192:0/2467432985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeeef2b0 0x562deeeef6d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800e660 tx=0x7fa3d8052e20 comp rx=0 tx=0).stop 2024-09-10T05:11:50.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/2467432985 shutdown_connections 2024-09-10T05:11:50.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 --2- 172.21.15.192:0/2467432985 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2c003c780 0x7fa2c003ec40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 --2- 172.21.15.192:0/2467432985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deeeef2b0 0x562deeeef6d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/2467432985 >> 172.21.15.192:0/2467432985 conn(0x562deeee3610 msgr2=0x562deeee39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/2467432985 shutdown_connections 2024-09-10T05:11:50.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/2467432985 wait complete. 2024-09-10T05:11:50.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562deeedab30 msgr2=0x562deeedcfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562deeedab30 0x562deeedcfb0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562deedd7ff0 msgr2=0x562deeed8750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562deedd7ff0 0x562deeed8750 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562deeedeba0 msgr2=0x562deeee0f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562deeedeba0 0x562deeee0f90 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2cc03c920 msgr2=0x7fa2cc03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa2cc03c920 0x7fa2cc03ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0057000 tx=0x7fa3d0052000 comp rx=0 tx=0).stop 2024-09-10T05:11:50.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.352+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 msgr2=0x562deeed1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.353+0000 7fa3ea325800 1 --2- 172.21.15.192:0/4196779127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562deedd64d0 0x562deeed1100 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80012f0 tx=0x7fa3d8000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.353+0000 7fa3e6734640 1 -- 172.21.15.192:0/4196779127 reap_dead start 2024-09-10T05:11:50.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.353+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 shutdown_connections 2024-09-10T05:11:50.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.353+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 >> 172.21.15.192:0/4196779127 conn(0x562deedd2200 msgr2=0x562deeecaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.353+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 shutdown_connections 2024-09-10T05:11:50.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.353+0000 7fa3ea325800 1 -- 172.21.15.192:0/4196779127 wait complete. 2024-09-10T05:11:50.375 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T05:11:50.338764Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:50.338754Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:50.382 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T05:11:50.387 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:11:50.387 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-10T05:11:50.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-10T05:11:50.388 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-10T05:11:50.432 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:50.432 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:50.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.431+0000 7f94f6e0f800 1 Processor -- start 2024-09-10T05:11:50.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.431+0000 7f94f6e0f800 1 -- start start 2024-09-10T05:11:50.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.431+0000 7f94f6e0f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a74ded7200 0x55a74dedcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.432+0000 7f94f6e0f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a74dd80e40 con 0x55a74ded5df0 2024-09-10T05:11:50.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.432+0000 7f94f6e0f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55a74dd4b680 con 0x55a74ded7200 2024-09-10T05:11:50.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.432+0000 7f94effff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a74ded7200 0x55a74dedcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.432+0000 7f94effff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a74ded7200 0x55a74dedcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60680/0 (socket says 172.21.15.192:60680) 2024-09-10T05:11:50.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.432+0000 7f94effff640 1 -- 172.21.15.192:0/2637470720 learned_addr learned my addr 172.21.15.192:0/2637470720 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.432+0000 7f94f48f9640 1 --1- 172.21.15.192:0/2637470720 >> v1:172.21.15.139:6789/0 conn(0x55a74ded5df0 0x55a74ded6af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36434/0 (socket says 172.21.15.192:36434) 2024-09-10T05:11:50.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.432+0000 7f94effff640 1 -- 172.21.15.192:0/2637470720 >> v1:172.21.15.139:6789/0 conn(0x55a74ded5df0 legacy=0x55a74ded6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.432+0000 7f94ef7fe640 1 -- 172.21.15.192:0/2637470720 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664664016 0 0) 0x55a74dd80e40 con 0x55a74ded5df0 2024-09-10T05:11:50.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.432+0000 7f94effff640 1 -- 172.21.15.192:0/2637470720 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a74dd676b0 con 0x55a74ded7200 2024-09-10T05:11:50.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.434+0000 7f94effff640 1 --2- 172.21.15.192:0/2637470720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded7200 0x55a74dedcda0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f94e000a520 tx=0x7f94e0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5847b93b38865eda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.434+0000 7f94ef7fe640 1 -- 172.21.15.192:0/2637470720 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e0055070 con 0x55a74ded7200 2024-09-10T05:11:50.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.434+0000 7f94ef7fe640 1 -- 172.21.15.192:0/2637470720 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e00515b0 con 0x55a74ded7200 2024-09-10T05:11:50.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.434+0000 7f94ef7fe640 1 -- 172.21.15.192:0/2637470720 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e00518d0 con 0x55a74ded7200 2024-09-10T05:11:50.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.435+0000 7f94f6e0f800 1 -- 172.21.15.192:0/2637470720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded7200 msgr2=0x55a74dedcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.435+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/2637470720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded7200 0x55a74dedcda0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f94e000a520 tx=0x7f94e0045ba0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.435+0000 7f94f6e0f800 1 -- 172.21.15.192:0/2637470720 shutdown_connections 2024-09-10T05:11:50.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.435+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/2637470720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded7200 0x55a74dedcda0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.435+0000 7f94f6e0f800 1 -- 172.21.15.192:0/2637470720 >> 172.21.15.192:0/2637470720 conn(0x55a74ded11c0 msgr2=0x55a74ded3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.435+0000 7f94f6e0f800 1 -- 172.21.15.192:0/2637470720 shutdown_connections 2024-09-10T05:11:50.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.435+0000 7f94f6e0f800 1 -- 172.21.15.192:0/2637470720 wait complete. 2024-09-10T05:11:50.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.448+0000 7f94f6e0f800 1 Processor -- start 2024-09-10T05:11:50.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.449+0000 7f94f6e0f800 1 -- start start 2024-09-10T05:11:50.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.449+0000 7f94f6e0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 0x55a74dfc53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.449+0000 7f94f6e0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a74dd6fdd0 con 0x55a74ded5df0 2024-09-10T05:11:50.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.449+0000 7f94f48f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 0x55a74dfc53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.449+0000 7f94f48f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 0x55a74dfc53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60696/0 (socket says 172.21.15.192:60696) 2024-09-10T05:11:50.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.449+0000 7f94f48f9640 1 -- 172.21.15.192:0/1308919298 learned_addr learned my addr 172.21.15.192:0/1308919298 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.449+0000 7f94f48f9640 1 -- 172.21.15.192:0/1308919298 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a74dd88e10 con 0x55a74ded5df0 2024-09-10T05:11:50.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.449+0000 7f94f48f9640 1 --2- 172.21.15.192:0/1308919298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 0x55a74dfc53e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f94e8001ea0 tx=0x7f94e800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a39d8a6ae9671d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.449+0000 7f93e2e05640 1 -- 172.21.15.192:0/1308919298 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8008070 con 0x55a74ded5df0 2024-09-10T05:11:50.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.450+0000 7f93e2e05640 1 -- 172.21.15.192:0/1308919298 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e800d500 con 0x55a74ded5df0 2024-09-10T05:11:50.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.450+0000 7f93e2e05640 1 -- 172.21.15.192:0/1308919298 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e800d880 con 0x55a74ded5df0 2024-09-10T05:11:50.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.450+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1308919298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 msgr2=0x55a74dfc53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.450+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/1308919298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 0x55a74dfc53e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f94e8001ea0 tx=0x7f94e800b6a0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.450+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1308919298 shutdown_connections 2024-09-10T05:11:50.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.450+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/1308919298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 0x55a74dfc53e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.450+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1308919298 >> 172.21.15.192:0/1308919298 conn(0x55a74ded11c0 msgr2=0x55a74dfc0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.450+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1308919298 shutdown_connections 2024-09-10T05:11:50.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.450+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1308919298 wait complete. 2024-09-10T05:11:50.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f94f6e0f800 1 Processor -- start 2024-09-10T05:11:50.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f94f6e0f800 1 -- start start 2024-09-10T05:11:50.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f94f6e0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 0x55a74dfd0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f94f6e0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a74ded78f0 con 0x55a74ded5df0 2024-09-10T05:11:50.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f94f48f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 0x55a74dfd0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f94f48f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 0x55a74dfd0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60710/0 (socket says 172.21.15.192:60710) 2024-09-10T05:11:50.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f94f48f9640 1 -- 172.21.15.192:0/3491316102 learned_addr learned my addr 172.21.15.192:0/3491316102 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f94f48f9640 1 -- 172.21.15.192:0/3491316102 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a74dfd0580 con 0x55a74ded5df0 2024-09-10T05:11:50.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f94f48f9640 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 0x55a74dfd0020 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f94e80012f0 tx=0x7f94e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f93e1602640 1 -- 172.21.15.192:0/3491316102 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e800f9d0 con 0x55a74ded5df0 2024-09-10T05:11:50.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f93e1602640 1 -- 172.21.15.192:0/3491316102 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e800fb70 con 0x55a74ded5df0 2024-09-10T05:11:50.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a74dfd0810 con 0x55a74ded5df0 2024-09-10T05:11:50.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.451+0000 7f93e1602640 1 -- 172.21.15.192:0/3491316102 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e800fe50 con 0x55a74ded5df0 2024-09-10T05:11:50.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.452+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a74dfd1210 con 0x55a74ded5df0 2024-09-10T05:11:50.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.452+0000 7f93e1602640 1 -- 172.21.15.192:0/3491316102 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f94e8017040 con 0x55a74ded5df0 2024-09-10T05:11:50.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.453+0000 7f93e1602640 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93dc03c920 0x7f93dc03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.453+0000 7f93e1602640 1 -- 172.21.15.192:0/3491316102 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f94e8015020 con 0x55a74ded5df0 2024-09-10T05:11:50.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.453+0000 7f94effff640 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93dc03c920 0x7f93dc03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.453+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a74ded7200 0x55a74dfd7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.453+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74dfd7bb0 con 0x55a74ded7200 2024-09-10T05:11:50.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.453+0000 7f94f50fa640 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a74ded7200 0x55a74dfd7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.453+0000 7f94effff640 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93dc03c920 0x7f93dc03ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f94e0057000 tx=0x7f94e0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.453+0000 7f94f50fa640 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a74ded7200 0x55a74dfd7670 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.453+0000 7f94f50fa640 1 -- 172.21.15.192:0/3491316102 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74ded7200 2024-09-10T05:11:50.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.453+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74dfd7f50 con 0x55a74ded7200 2024-09-10T05:11:50.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.454+0000 7f94f50fa640 1 -- 172.21.15.192:0/3491316102 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74ded7200 2024-09-10T05:11:50.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.454+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a74dfd9a50 0x55a74dfdbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.454+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74dfdc660 con 0x55a74dfd9a50 2024-09-10T05:11:50.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.454+0000 7f94f48f9640 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a74dfd9a50 0x55a74dfdbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.454+0000 7f94f48f9640 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a74dfd9a50 0x55a74dfdbed0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.455+0000 7f94f48f9640 1 -- 172.21.15.192:0/3491316102 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f94e802d070 con 0x55a74dfd9a50 2024-09-10T05:11:50.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.455+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74dfd87a0 con 0x55a74ded7200 2024-09-10T05:11:50.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.455+0000 7f94f50fa640 1 -- 172.21.15.192:0/3491316102 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74ded7200 2024-09-10T05:11:50.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.455+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a74dfddac0 0x55a74dfdfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.455+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74dfe0620 con 0x55a74dfddac0 2024-09-10T05:11:50.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.455+0000 7f94effff640 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a74dfddac0 0x55a74dfdfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.455+0000 7f94effff640 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a74dfddac0 0x55a74dfdfeb0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.456+0000 7f94effff640 1 -- 172.21.15.192:0/3491316102 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f94e0057030 con 0x55a74dfddac0 2024-09-10T05:11:50.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.456+0000 7f94f6e0f800 1 Processor -- start 2024-09-10T05:11:50.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.456+0000 7f94f6e0f800 1 -- start start 2024-09-10T05:11:50.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.456+0000 7f94f6e0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dfee250 0x55a74dfee670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.456+0000 7f94f6e0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a74ddcda00 con 0x55a74dfee250 2024-09-10T05:11:50.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.456+0000 7f94f48f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dfee250 0x55a74dfee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.456+0000 7f94f48f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dfee250 0x55a74dfee670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60720/0 (socket says 172.21.15.192:60720) 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.456+0000 7f94f48f9640 1 -- 172.21.15.192:0/1723007013 learned_addr learned my addr 172.21.15.192:0/1723007013 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.456+0000 7f94f48f9640 1 -- 172.21.15.192:0/1723007013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a74dfeecb0 con 0x55a74dfee250 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.457+0000 7f94f48f9640 1 --2- 172.21.15.192:0/1723007013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dfee250 0x55a74dfee670 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f94e800e660 tx=0x7f94e8018e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.457+0000 7f93da7fc640 1 -- 172.21.15.192:0/1723007013 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8048020 con 0x55a74dfee250 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.457+0000 7f93da7fc640 1 -- 172.21.15.192:0/1723007013 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e804b310 con 0x55a74dfee250 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.457+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1723007013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a74dfef4e0 con 0x55a74dfee250 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.457+0000 7f93da7fc640 1 -- 172.21.15.192:0/1723007013 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e801a4f0 con 0x55a74dfee250 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.457+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1723007013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a74dfefa80 con 0x55a74dfee250 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.457+0000 7f93da7fc640 1 -- 172.21.15.192:0/1723007013 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f94e804b020 con 0x55a74dfee250 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.458+0000 7f93da7fc640 1 --2- 172.21.15.192:0/1723007013 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93cc03c730 0x7f93cc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.458+0000 7f93da7fc640 1 -- 172.21.15.192:0/1723007013 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f94e803c4e0 con 0x55a74dfee250 2024-09-10T05:11:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.458+0000 7f94effff640 1 --2- 172.21.15.192:0/1723007013 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93cc03c730 0x7f93cc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.458+0000 7f94f6e0f800 1 Processor -- start 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.458+0000 7f94f6e0f800 1 -- start start 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.458+0000 7f94effff640 1 --2- 172.21.15.192:0/1723007013 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93cc03c730 0x7f93cc03ebf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f94e0051bd0 tx=0x7f94e0005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.458+0000 7f94f6e0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 0x55a74dffae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.458+0000 7f94f6e0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a74dfc5c30 con 0x55a74dffaa70 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.458+0000 7f94f48f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 0x55a74dffae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.458+0000 7f94f48f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 0x55a74dffae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60734/0 (socket says 172.21.15.192:60734) 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.458+0000 7f94f48f9640 1 -- 172.21.15.192:0/1339369003 learned_addr learned my addr 172.21.15.192:0/1339369003 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.459+0000 7f94f48f9640 1 -- 172.21.15.192:0/1339369003 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a74dffb460 con 0x55a74dffaa70 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.459+0000 7f94f48f9640 1 --2- 172.21.15.192:0/1339369003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 0x55a74dffae70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f94e8026fd0 tx=0x7f94e8026d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bd79b4d60f90d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.459+0000 7f93cbfff640 1 -- 172.21.15.192:0/1339369003 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8035070 con 0x55a74dffaa70 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.459+0000 7f93cbfff640 1 -- 172.21.15.192:0/1339369003 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e8044910 con 0x55a74dffaa70 2024-09-10T05:11:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.459+0000 7f93cbfff640 1 -- 172.21.15.192:0/1339369003 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e80195a0 con 0x55a74dffaa70 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.459+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1339369003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 msgr2=0x55a74dffae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.459+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/1339369003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 0x55a74dffae70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f94e8026fd0 tx=0x7f94e8026d80 comp rx=0 tx=0).stop 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.459+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1339369003 shutdown_connections 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.459+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/1339369003 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 0x55a74dffae70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.459+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1339369003 >> 172.21.15.192:0/1339369003 conn(0x55a74dff6e70 msgr2=0x55a74dff50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.459+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1339369003 shutdown_connections 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.459+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1339369003 wait complete. 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.460+0000 7f94f6e0f800 1 Processor -- start 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.460+0000 7f94f6e0f800 1 -- start start 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.460+0000 7f94f6e0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 0x55a74e001e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.460+0000 7f94f6e0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a74dffb8d0 con 0x55a74dffaa70 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.460+0000 7f94f48f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 0x55a74e001e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.460+0000 7f94f48f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 0x55a74e001e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60742/0 (socket says 172.21.15.192:60742) 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.460+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 learned_addr learned my addr 172.21.15.192:0/3304214512 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.460+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a74e0023d0 con 0x55a74dffaa70 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.460+0000 7f94f48f9640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 0x55a74e001e70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94e804b4e0 tx=0x7f94e803a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.461+0000 7f93ca7fc640 1 -- 172.21.15.192:0/3304214512 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8065020 con 0x55a74dffaa70 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.461+0000 7f93ca7fc640 1 -- 172.21.15.192:0/3304214512 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e804b890 con 0x55a74dffaa70 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.461+0000 7f93ca7fc640 1 -- 172.21.15.192:0/3304214512 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e8035040 con 0x55a74dffaa70 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.461+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a74e0023d0 con 0x55a74dffaa70 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.461+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a74e0023d0 con 0x55a74dffaa70 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.462+0000 7f93ca7fc640 1 -- 172.21.15.192:0/3304214512 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f94e8026430 con 0x55a74dffaa70 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.462+0000 7f93ca7fc640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93c003c780 0x7f93c003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.462+0000 7f94f6e0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.462+0000 7f93ca7fc640 1 -- 172.21.15.192:0/3304214512 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f94e80579b0 con 0x55a74dffaa70 2024-09-10T05:11:50.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.462+0000 7f94effff640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93c003c780 0x7f93c003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.462+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a74e00d430 0x55a74e00f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.462+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e010010 con 0x55a74e00d430 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.462+0000 7f94f50fa640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a74e00d430 0x55a74e00f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.462+0000 7f94effff640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93c003c780 0x7f93c003ec40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f94e0000c00 tx=0x7f94e0053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.462+0000 7f94f50fa640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a74e00d430 0x55a74e00f8c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 20 realm 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e010420 con 0x55a74e00d430 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e010cf0 con 0x55a74e00d430 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e00d430 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a74e011b80 0x55a74e013f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.463+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e0146b0 con 0x55a74e011b80 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.464+0000 7f94f48f9640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a74e011b80 0x55a74e013f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.464+0000 7f94f48f9640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a74e011b80 0x55a74e013f70 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.464+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.464+0000 7f94f6e0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.464+0000 7f94f6e0f800 20 searching for the correct realm 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.464+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a74e016750 0x55a74e018c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.464+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e0192e0 con 0x55a74e016750 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.465+0000 7f94effff640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a74e016750 0x55a74e018c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.465+0000 7f94effff640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a74e016750 0x55a74e018c10 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.465+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.465+0000 7f94effff640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f94e0069040 0x7f94e006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.465+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e0192e0 con 0x7f94e0069040 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.465+0000 7f94f50fa640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f94e0069040 0x7f94e006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.465+0000 7f94f50fa640 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f94e0069040 0x7f94e006a940 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.466+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.466+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e011b80 2024-09-10T05:11:50.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.466+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.466+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e00d430 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.466+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.466+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e00d430 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.466+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.466+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e011b80 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.467+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.467+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e011b80 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.467+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.467+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x7f94e0069040 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.467+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.467+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e016750 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.467+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.467+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e00d430 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.468+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.468+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e011b80 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.468+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.468+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e00d430 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.468+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.468+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x7f94e0069040 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.468+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.468+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e016750 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.468+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.469+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e016750 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.469+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.469+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e011b80 2024-09-10T05:11:50.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.469+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.469+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e016750 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.469+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.469+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e016750 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.469+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.469+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e00d430 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.470+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.470+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e00d430 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.470+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.470+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e011b80 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.470+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.470+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e016750 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.470+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.470+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x7f94e0069040 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.471+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.471+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e00d430 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.471+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.471+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e011b80 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.471+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.471+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e016750 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.471+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.471+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e011b80 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.472+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.472+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x7f94e0069040 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.472+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.472+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e016750 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.472+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.472+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e011b80 2024-09-10T05:11:50.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x55a74e00d430 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a74e011090 con 0x7f94e0069040 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f6e0f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f6e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f6e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f6e0f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f6e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f6e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f6e0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.473+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e015050 con 0x55a74e00d430 2024-09-10T05:11:50.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e015050 con 0x55a74e00d430 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e015050 con 0x7f94e0069040 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 20 zone default found 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 4 Realm: () 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:50.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 20 zonegroup default 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.474+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e015440 con 0x55a74e011b80 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94f6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94f6e0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e0159e0 con 0x55a74e016750 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94f6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94f6e0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01b150 con 0x55a74e016750 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94f6e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94f6e0f800 20 started sync module instance, tier type = 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94f6e0f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.475+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01a5f0 con 0x7f94e0069040 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.476+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.476+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94177056631568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01a5f0 con 0x7f94e0069040 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.476+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01bbb0 con 0x55a74e00d430 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.477+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94177056631568] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.477+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.477+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94177056634512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01a5f0 con 0x55a74e00d430 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.477+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01c620 con 0x55a74e016750 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.478+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94177056634512] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.478+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.479+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94177056629056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01a560 con 0x55a74e016750 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.479+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01d410 con 0x7f94e0069040 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.479+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.480+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94177056640752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01dcb0 con 0x7f94e0069040 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.480+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01e750 con 0x55a74e00d430 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.480+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94177056629056] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.481+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94177056640752] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.481+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.481+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94177056645664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01d7b0 con 0x55a74e00d430 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.481+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01eff0 con 0x55a74e011b80 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.482+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94177056645664] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.482+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.482+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94177056642912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01ca40 con 0x55a74e011b80 2024-09-10T05:11:50.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.482+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01f9b0 con 0x55a74e011b80 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.483+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94177056642912] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.483+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.483+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94177056648000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e020200 con 0x55a74e011b80 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.483+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e020ad0 con 0x55a74e011b80 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.484+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.484+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94177056654752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e0212e0 con 0x55a74e011b80 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.484+0000 7f94f6e0f800 20 add_watcher() i=0 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.484+0000 7f94f6e0f800 20 add_watcher() i=1 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.484+0000 7f94f6e0f800 20 add_watcher() i=2 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.484+0000 7f94f6e0f800 20 add_watcher() i=3 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.484+0000 7f94f6e0f800 20 add_watcher() i=4 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.484+0000 7f94f6e0f800 20 add_watcher() i=5 2024-09-10T05:11:50.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.484+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94177056648000] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.484+0000 7f94f6e0f800 20 add_watcher() i=6 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.484+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94177056654752] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.485+0000 7f94f6e0f800 20 add_watcher() i=7 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.485+0000 7f94f6e0f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.485+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01fd50 con 0x55a74e00d430 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.485+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.485+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94177056656752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01fd50 con 0x55a74e00d430 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.486+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94177056656752] v35'114 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.486+0000 7f93ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.486+0000 7f94f6e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.486+0000 7f94f6e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.486+0000 7f94f6e0f800 5 note: GC not initialized 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.486+0000 7f93aa7e4640 20 reqs_thread_entry: start 2024-09-10T05:11:50.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.486+0000 7f94f6e0f800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:50.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.487+0000 7f94f6e0f800 20 Filter name: none 2024-09-10T05:11:50.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.487+0000 7f93a3fff640 20 reqs_thread_entry: start 2024-09-10T05:11:50.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.487+0000 7f94f6e0f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.487+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a74e056f00 con 0x7f94e0069040 2024-09-10T05:11:50.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.487+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.487+0000 7f94f6e0f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:50.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.488+0000 7f93ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.488+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94177056656752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e021cd0 con 0x55a74e00d430 2024-09-10T05:11:50.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.489+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94177056656752] v35'115 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.489+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94177056631568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e054e50 con 0x7f94e0069040 2024-09-10T05:11:50.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.490+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94177056631568] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.490+0000 7f94f6e0f800 20 remove_watcher() i=0 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.490+0000 7f94f6e0f800 2 removed watcher, disabling cache 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.490+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94177056634512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e054e50 con 0x55a74e00d430 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.491+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94177056634512] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.491+0000 7f94f6e0f800 20 remove_watcher() i=1 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.491+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94177056629056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e054e50 con 0x55a74e016750 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.492+0000 7f94effff640 1 -- 172.21.15.192:0/3304214512 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94177056629056] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e0057030 con 0x55a74e016750 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.492+0000 7f94f6e0f800 20 remove_watcher() i=2 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.492+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94177056640752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01a140 con 0x7f94e0069040 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.493+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94177056640752] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x7f94e0069040 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.493+0000 7f94f6e0f800 20 remove_watcher() i=3 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.493+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94177056645664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01a140 con 0x55a74e00d430 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.494+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94177056645664] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f000a4d0 con 0x55a74e00d430 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.494+0000 7f94f6e0f800 20 remove_watcher() i=4 2024-09-10T05:11:50.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.494+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94177056642912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01a140 con 0x55a74e011b80 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.495+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94177056642912] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.495+0000 7f94f6e0f800 20 remove_watcher() i=5 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.495+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94177056648000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01d760 con 0x55a74e011b80 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.496+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94177056648000] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.496+0000 7f94f6e0f800 20 remove_watcher() i=6 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.496+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94177056654752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a74e01a140 con 0x55a74e011b80 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f48f9640 1 -- 172.21.15.192:0/3304214512 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94177056654752] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e8067020 con 0x55a74e011b80 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 20 remove_watcher() i=7 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a74e011b80 msgr2=0x55a74e013f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a74e011b80 0x55a74e013f70 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a74e00d430 msgr2=0x55a74e00f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a74e00d430 0x55a74e00f8c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f94e0069040 msgr2=0x7f94e006a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f94e0069040 0x7f94e006a940 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a74e016750 msgr2=0x55a74e018c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a74e016750 0x55a74e018c10 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93c003c780 msgr2=0x7f93c003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93c003c780 0x7f93c003ec40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f94e0000c00 tx=0x7f94e0053000 comp rx=0 tx=0).stop 2024-09-10T05:11:50.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 msgr2=0x55a74e001e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f50fa640 1 -- 172.21.15.192:0/3304214512 reap_dead start 2024-09-10T05:11:50.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 0x55a74e001e70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94e804b4e0 tx=0x7f94e803a8a0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 shutdown_connections 2024-09-10T05:11:50.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3304214512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dffaa70 0x55a74e001e70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 >> 172.21.15.192:0/3304214512 conn(0x55a74dff6e70 msgr2=0x55a74dff5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 shutdown_connections 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.497+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3304214512 wait complete. 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1723007013 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93cc03c730 msgr2=0x7f93cc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/1723007013 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93cc03c730 0x7f93cc03ebf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f94e0051bd0 tx=0x7f94e0005ac0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1723007013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dfee250 msgr2=0x55a74dfee670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/1723007013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dfee250 0x55a74dfee670 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f94e800e660 tx=0x7f94e8018e20 comp rx=0 tx=0).stop 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1723007013 shutdown_connections 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/1723007013 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93cc03c730 0x7f93cc03ebf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/1723007013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74dfee250 0x55a74dfee670 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1723007013 >> 172.21.15.192:0/1723007013 conn(0x55a74dfe25b0 msgr2=0x55a74dfe2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1723007013 shutdown_connections 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/1723007013 wait complete. 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a74dfd9a50 msgr2=0x55a74dfdbed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a74dfd9a50 0x55a74dfdbed0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a74ded7200 msgr2=0x55a74dfd7670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a74ded7200 0x55a74dfd7670 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a74dfddac0 msgr2=0x55a74dfdfeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a74dfddac0 0x55a74dfdfeb0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93dc03c920 msgr2=0x7f93dc03ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93dc03c920 0x7f93dc03ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f94e0057000 tx=0x7f94e0052000 comp rx=0 tx=0).stop 2024-09-10T05:11:50.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 msgr2=0x55a74dfd0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 --2- 172.21.15.192:0/3491316102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a74ded5df0 0x55a74dfd0020 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f94e80012f0 tx=0x7f94e8000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f50fa640 1 -- 172.21.15.192:0/3491316102 reap_dead start 2024-09-10T05:11:50.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 shutdown_connections 2024-09-10T05:11:50.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 >> 172.21.15.192:0/3491316102 conn(0x55a74ded11c0 msgr2=0x55a74dfc66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 shutdown_connections 2024-09-10T05:11:50.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.498+0000 7f94f6e0f800 1 -- 172.21.15.192:0/3491316102 wait complete. 2024-09-10T05:11:50.530 INFO:teuthology.orchestra.run.smithi192.stdout:{"key":"bucket:myfoo","ver":{"tag":"_IJaHHa-9WNHtvD2fPSqAKuC","ver":2},"mtime":"2024-09-10T05:11:50.201248Z","data":{"bucket":{"name":"myfoo","marker":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1","bucket_id":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-10T05:11:49.040226Z","linked":false,"has_bucket_info":false}} 2024-09-10T05:11:50.531 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_IJaHHa-9WNHtvD2fPSqAKuC', 'ver': 2}, 'mtime': '2024-09-10T05:11:50.201248Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1', 'bucket_id': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-10T05:11:49.040226Z', 'linked': False, 'has_bucket_info': False}} 2024-09-10T05:11:50.531 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1'] 2024-09-10T05:11:50.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1'] 2024-09-10T05:11:50.531 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 2024-09-10T05:11:50.621 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:50.621 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:50.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.620+0000 7f7adc296800 1 Processor -- start 2024-09-10T05:11:50.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.620+0000 7f7adc296800 1 -- start start 2024-09-10T05:11:50.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.620+0000 7f7adc296800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56486f4406b0 0x56486f442aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.620+0000 7f7adc296800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56486f2e9e40 con 0x56486f443040 2024-09-10T05:11:50.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.620+0000 7f7adc296800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x56486f2b4680 con 0x56486f4406b0 2024-09-10T05:11:50.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.621+0000 7f7ad9d80640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56486f4406b0 0x56486f442aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.621+0000 7f7ad157f640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x56486f443040 0x56486f445500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36438/0 (socket says 172.21.15.192:36438) 2024-09-10T05:11:50.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.621+0000 7f7ad9d80640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56486f4406b0 0x56486f442aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60756/0 (socket says 172.21.15.192:60756) 2024-09-10T05:11:50.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.621+0000 7f7ad157f640 1 -- 172.21.15.192:0/1054276840 learned_addr learned my addr 172.21.15.192:0/1054276840 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:50.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.621+0000 7f7ad9d80640 1 -- 172.21.15.192:0/1054276840 >> v1:172.21.15.139:6789/0 conn(0x56486f443040 legacy=0x56486f445500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.621+0000 7f7ad957f640 1 -- 172.21.15.192:0/1054276840 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580097011 0 0) 0x56486f2e9e40 con 0x56486f443040 2024-09-10T05:11:50.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.621+0000 7f7ad9d80640 1 -- 172.21.15.192:0/1054276840 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56486f2d06b0 con 0x56486f4406b0 2024-09-10T05:11:50.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.623+0000 7f7ad9d80640 1 --2- 172.21.15.192:0/1054276840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f442aa0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00a470 tx=0x7f7acc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66a1596c3b9ef13 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.623+0000 7f7ad957f640 1 -- 172.21.15.192:0/1054276840 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7acc053570 con 0x56486f4406b0 2024-09-10T05:11:50.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.623+0000 7f7ad957f640 1 -- 172.21.15.192:0/1054276840 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc058070 con 0x56486f4406b0 2024-09-10T05:11:50.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.623+0000 7f7ad957f640 1 -- 172.21.15.192:0/1054276840 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7acc053880 con 0x56486f4406b0 2024-09-10T05:11:50.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.624+0000 7f7adc296800 1 -- 172.21.15.192:0/1054276840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 msgr2=0x56486f442aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.624+0000 7f7adc296800 1 --2- 172.21.15.192:0/1054276840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f442aa0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00a470 tx=0x7f7acc045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:50.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.624+0000 7f7adc296800 1 -- 172.21.15.192:0/1054276840 shutdown_connections 2024-09-10T05:11:50.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.624+0000 7f7adc296800 1 --2- 172.21.15.192:0/1054276840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f442aa0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.624+0000 7f7adc296800 1 -- 172.21.15.192:0/1054276840 >> 172.21.15.192:0/1054276840 conn(0x56486f43a210 msgr2=0x56486f43c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.624+0000 7f7adc296800 1 -- 172.21.15.192:0/1054276840 shutdown_connections 2024-09-10T05:11:50.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.624+0000 7f7adc296800 1 -- 172.21.15.192:0/1054276840 wait complete. 2024-09-10T05:11:50.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.637+0000 7f7adc296800 1 Processor -- start 2024-09-10T05:11:50.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.638+0000 7f7adc296800 1 -- start start 2024-09-10T05:11:50.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.638+0000 7f7adc296800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f52f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.638+0000 7f7adc296800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56486f2d8dd0 con 0x56486f4406b0 2024-09-10T05:11:50.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.638+0000 7f7ad9d80640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f52f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.638+0000 7f7ad9d80640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f52f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60760/0 (socket says 172.21.15.192:60760) 2024-09-10T05:11:50.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.638+0000 7f7ad9d80640 1 -- 172.21.15.192:0/1750002204 learned_addr learned my addr 172.21.15.192:0/1750002204 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.638+0000 7f7ad9d80640 1 -- 172.21.15.192:0/1750002204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56486f2f1e10 con 0x56486f4406b0 2024-09-10T05:11:50.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.638+0000 7f7ad9d80640 1 --2- 172.21.15.192:0/1750002204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f52f550 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7acc025c20 tx=0x7f7acc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861eddd110706688 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.638+0000 7f79c7e07640 1 -- 172.21.15.192:0/1750002204 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7acc053a20 con 0x56486f4406b0 2024-09-10T05:11:50.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.639+0000 7f79c7e07640 1 -- 172.21.15.192:0/1750002204 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc063070 con 0x56486f4406b0 2024-09-10T05:11:50.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.639+0000 7f79c7e07640 1 -- 172.21.15.192:0/1750002204 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7acc053d30 con 0x56486f4406b0 2024-09-10T05:11:50.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.639+0000 7f7adc296800 1 -- 172.21.15.192:0/1750002204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 msgr2=0x56486f52f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.639+0000 7f7adc296800 1 --2- 172.21.15.192:0/1750002204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f52f550 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7acc025c20 tx=0x7f7acc051000 comp rx=0 tx=0).stop 2024-09-10T05:11:50.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.639+0000 7f7adc296800 1 -- 172.21.15.192:0/1750002204 shutdown_connections 2024-09-10T05:11:50.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.639+0000 7f7adc296800 1 --2- 172.21.15.192:0/1750002204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f52f550 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.639+0000 7f7adc296800 1 -- 172.21.15.192:0/1750002204 >> 172.21.15.192:0/1750002204 conn(0x56486f43a210 msgr2=0x56486f52aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.639+0000 7f7adc296800 1 -- 172.21.15.192:0/1750002204 shutdown_connections 2024-09-10T05:11:50.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.639+0000 7f7adc296800 1 -- 172.21.15.192:0/1750002204 wait complete. 2024-09-10T05:11:50.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.640+0000 7f7adc296800 1 Processor -- start 2024-09-10T05:11:50.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.640+0000 7f7adc296800 1 -- start start 2024-09-10T05:11:50.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.640+0000 7f7adc296800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f536e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.640+0000 7f7adc296800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56486f447060 con 0x56486f4406b0 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.640+0000 7f7ad9d80640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f536e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.640+0000 7f7ad9d80640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f536e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60766/0 (socket says 172.21.15.192:60766) 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.640+0000 7f7ad9d80640 1 -- 172.21.15.192:0/3997236803 learned_addr learned my addr 172.21.15.192:0/3997236803 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.640+0000 7f7ad9d80640 1 -- 172.21.15.192:0/3997236803 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56486f5373e0 con 0x56486f4406b0 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.641+0000 7f7ad9d80640 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f536e80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7acc025c20 tx=0x7f7acc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.641+0000 7f79c6604640 1 -- 172.21.15.192:0/3997236803 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7acc078070 con 0x56486f4406b0 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.641+0000 7f79c6604640 1 -- 172.21.15.192:0/3997236803 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc073470 con 0x56486f4406b0 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.641+0000 7f79c6604640 1 -- 172.21.15.192:0/3997236803 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7acc073750 con 0x56486f4406b0 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.641+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56486f537670 con 0x56486f4406b0 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.641+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56486f538230 con 0x56486f4406b0 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.642+0000 7f79c6604640 1 -- 172.21.15.192:0/3997236803 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7acc07b070 con 0x56486f4406b0 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.642+0000 7f79c6604640 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79c003c780 0x7f79c003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.642+0000 7f79c6604640 1 -- 172.21.15.192:0/3997236803 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f7acc097b40 con 0x56486f4406b0 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.642+0000 7f7ad157f640 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79c003c780 0x7f79c003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.642+0000 7f7adc296800 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56486f443040 0x56486f53e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.642+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f538bf0 con 0x56486f443040 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.642+0000 7f7ada581640 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56486f443040 0x56486f53e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.642+0000 7f7ad157f640 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79c003c780 0x7f79c003ec40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4000c00 tx=0x7f7ac40013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.642+0000 7f7ada581640 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56486f443040 0x56486f53e480 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.643+0000 7f7ada581640 1 -- 172.21.15.192:0/3997236803 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f443040 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.643+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f5385a0 con 0x56486f443040 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.643+0000 7f7ada581640 1 -- 172.21.15.192:0/3997236803 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f443040 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.643+0000 7f7adc296800 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56486f5408f0 0x56486f542ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.643+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f5433b0 con 0x56486f5408f0 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.643+0000 7f7ad9d80640 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56486f5408f0 0x56486f542ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.644+0000 7f7ad9d80640 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56486f5408f0 0x56486f542ce0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.644+0000 7f7ad9d80640 1 -- 172.21.15.192:0/3997236803 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7acc07a030 con 0x56486f5408f0 2024-09-10T05:11:50.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.644+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f53f790 con 0x56486f443040 2024-09-10T05:11:50.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.644+0000 7f7ada581640 1 -- 172.21.15.192:0/3997236803 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f443040 2024-09-10T05:11:50.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.644+0000 7f7adc296800 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56486f5447f0 0x56486f546be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.644+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f547320 con 0x56486f5447f0 2024-09-10T05:11:50.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.644+0000 7f7ad157f640 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56486f5447f0 0x56486f546be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.645+0000 7f7ad157f640 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56486f5447f0 0x56486f546be0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.645+0000 7f7ad157f640 1 -- 172.21.15.192:0/3997236803 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7ac400f670 con 0x56486f5447f0 2024-09-10T05:11:50.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.645+0000 7f7adc296800 1 Processor -- start 2024-09-10T05:11:50.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.645+0000 7f7adc296800 1 -- start start 2024-09-10T05:11:50.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.645+0000 7f7adc296800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f554f80 0x56486f5553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.645+0000 7f7adc296800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56486f336a00 con 0x56486f554f80 2024-09-10T05:11:50.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.646+0000 7f7ad9d80640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f554f80 0x56486f5553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.646+0000 7f7ad9d80640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f554f80 0x56486f5553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60774/0 (socket says 172.21.15.192:60774) 2024-09-10T05:11:50.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.646+0000 7f7ad9d80640 1 -- 172.21.15.192:0/807060833 learned_addr learned my addr 172.21.15.192:0/807060833 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.646+0000 7f7ad9d80640 1 -- 172.21.15.192:0/807060833 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56486f5559e0 con 0x56486f554f80 2024-09-10T05:11:50.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.646+0000 7f7ad9d80640 1 --2- 172.21.15.192:0/807060833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f554f80 0x56486f5553a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7acc095f30 tx=0x7f7acc05d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.646+0000 7f79bf7fe640 1 -- 172.21.15.192:0/807060833 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7acc07c780 con 0x56486f554f80 2024-09-10T05:11:50.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.646+0000 7f79bf7fe640 1 -- 172.21.15.192:0/807060833 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc068470 con 0x56486f554f80 2024-09-10T05:11:50.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.646+0000 7f7adc296800 1 -- 172.21.15.192:0/807060833 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56486f556210 con 0x56486f554f80 2024-09-10T05:11:50.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.646+0000 7f79bf7fe640 1 -- 172.21.15.192:0/807060833 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7acc07c920 con 0x56486f554f80 2024-09-10T05:11:50.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.646+0000 7f7adc296800 1 -- 172.21.15.192:0/807060833 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56486f5567b0 con 0x56486f554f80 2024-09-10T05:11:50.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.647+0000 7f79bf7fe640 1 -- 172.21.15.192:0/807060833 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7acc068770 con 0x56486f554f80 2024-09-10T05:11:50.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.647+0000 7f79bf7fe640 1 --2- 172.21.15.192:0/807060833 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79b403c780 0x7f79b403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.647+0000 7f79bf7fe640 1 -- 172.21.15.192:0/807060833 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f7acc08f070 con 0x56486f554f80 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.647+0000 7f7ad157f640 1 --2- 172.21.15.192:0/807060833 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79b403c780 0x7f79b403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.647+0000 7f7adc296800 1 Processor -- start 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.648+0000 7f7adc296800 1 -- start start 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.648+0000 7f7ad157f640 1 --2- 172.21.15.192:0/807060833 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79b403c780 0x7f79b403ec40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x56486f53ea90 tx=0x7f7ac4006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.648+0000 7f7adc296800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 0x56486f43ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.648+0000 7f7adc296800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56486f52fd40 con 0x56486f43e6b0 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.648+0000 7f7ad9d80640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 0x56486f43ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.648+0000 7f7ad9d80640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 0x56486f43ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60778/0 (socket says 172.21.15.192:60778) 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.648+0000 7f7ad9d80640 1 -- 172.21.15.192:0/416404993 learned_addr learned my addr 172.21.15.192:0/416404993 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.648+0000 7f7ad9d80640 1 -- 172.21.15.192:0/416404993 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56486f43f080 con 0x56486f43e6b0 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.648+0000 7f7ad9d80640 1 --2- 172.21.15.192:0/416404993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 0x56486f43ea90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7acc06cfd0 tx=0x7f7acc07d5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d58d0a76e9795c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.648+0000 7f79bd7fa640 1 -- 172.21.15.192:0/416404993 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7acc055d00 con 0x56486f43e6b0 2024-09-10T05:11:50.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.648+0000 7f79bd7fa640 1 -- 172.21.15.192:0/416404993 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc05cbf0 con 0x56486f43e6b0 2024-09-10T05:11:50.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.648+0000 7f79bd7fa640 1 -- 172.21.15.192:0/416404993 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7acc0523a0 con 0x56486f43e6b0 2024-09-10T05:11:50.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7adc296800 1 -- 172.21.15.192:0/416404993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 msgr2=0x56486f43ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7adc296800 1 --2- 172.21.15.192:0/416404993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 0x56486f43ea90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7acc06cfd0 tx=0x7f7acc07d5b0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7adc296800 1 -- 172.21.15.192:0/416404993 shutdown_connections 2024-09-10T05:11:50.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7adc296800 1 --2- 172.21.15.192:0/416404993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 0x56486f43ea90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7adc296800 1 -- 172.21.15.192:0/416404993 >> 172.21.15.192:0/416404993 conn(0x56486f55dc00 msgr2=0x56486f55be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7adc296800 1 -- 172.21.15.192:0/416404993 shutdown_connections 2024-09-10T05:11:50.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7adc296800 1 -- 172.21.15.192:0/416404993 wait complete. 2024-09-10T05:11:50.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7adc296800 1 Processor -- start 2024-09-10T05:11:50.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7adc296800 1 -- start start 2024-09-10T05:11:50.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7adc296800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 0x56486f56ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7adc296800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56486f43f590 con 0x56486f43e6b0 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7ad9d80640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 0x56486f56ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7ad9d80640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 0x56486f56ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60790/0 (socket says 172.21.15.192:60790) 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.649+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 learned_addr learned my addr 172.21.15.192:0/260616350 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.650+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56486f56b360 con 0x56486f43e6b0 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.650+0000 7f7ad9d80640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 0x56486f56ae00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7acc06cfd0 tx=0x7f7acc070e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.650+0000 7f79ab7fe640 1 -- 172.21.15.192:0/260616350 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7acc0bc070 con 0x56486f43e6b0 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.650+0000 7f79ab7fe640 1 -- 172.21.15.192:0/260616350 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc073ad0 con 0x56486f43e6b0 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.650+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56486f56b360 con 0x56486f43e6b0 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.650+0000 7f79ab7fe640 1 -- 172.21.15.192:0/260616350 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7acc07d660 con 0x56486f43e6b0 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.650+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56486f56b360 con 0x56486f43e6b0 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.651+0000 7f79ab7fe640 1 -- 172.21.15.192:0/260616350 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7acc0bf070 con 0x56486f43e6b0 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.651+0000 7f79ab7fe640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79a403c780 0x7f79a403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.651+0000 7f79ab7fe640 1 -- 172.21.15.192:0/260616350 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f7acc0a8070 con 0x56486f43e6b0 2024-09-10T05:11:50.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.651+0000 7f7ad157f640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79a403c780 0x7f79a403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.651+0000 7f7ad157f640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79a403c780 0x7f79a403ec40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400ffd0 tx=0x7f7ac4023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.652+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.652+0000 7f7adc296800 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56486f576350 0x56486f578810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.652+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f578f60 con 0x56486f576350 2024-09-10T05:11:50.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.652+0000 7f7ada581640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56486f576350 0x56486f578810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.652+0000 7f7ada581640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56486f576350 0x56486f578810 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.652+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.652+0000 7f7adc296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.652+0000 7f7adc296800 20 realm 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.652+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.652+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f579370 con 0x56486f576350 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7adc296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7adc296800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f579c40 con 0x56486f576350 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7adc296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f576350 2024-09-10T05:11:50.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7adc296800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7adc296800 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56486f57ad40 0x56486f57d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f57d6f0 con 0x56486f57ad40 2024-09-10T05:11:50.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.653+0000 7f7ad9d80640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56486f57ad40 0x56486f57d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.654+0000 7f7ad9d80640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56486f57ad40 0x56486f57d130 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.654+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.654+0000 7f7adc296800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:50.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.654+0000 7f7adc296800 20 searching for the correct realm 2024-09-10T05:11:50.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.654+0000 7f7adc296800 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56486f57f6a0 0x56486f581b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.654+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f582230 con 0x56486f57f6a0 2024-09-10T05:11:50.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.654+0000 7f7ad157f640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56486f57f6a0 0x56486f581b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.654+0000 7f7ad157f640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56486f57f6a0 0x56486f581b60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.655+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.655+0000 7f7ad157f640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7ac402e910 0x7f7ac403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.655+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f582230 con 0x7f7ac402e910 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.655+0000 7f7ada581640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7ac402e910 0x7f7ac403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.655+0000 7f7ada581640 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7ac402e910 0x7f7ac403a3c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.655+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.655+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57ad40 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.655+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.655+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f576350 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.656+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.656+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f576350 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.656+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.656+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57ad40 2024-09-10T05:11:50.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.656+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.656+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57ad40 2024-09-10T05:11:50.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.656+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.656+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x7f7ac402e910 2024-09-10T05:11:50.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.657+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.657+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57f6a0 2024-09-10T05:11:50.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.657+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.657+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f576350 2024-09-10T05:11:50.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.657+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.657+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57ad40 2024-09-10T05:11:50.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.657+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.657+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f576350 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.658+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.658+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x7f7ac402e910 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.658+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.658+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57f6a0 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.658+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.658+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57f6a0 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.658+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.658+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57ad40 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.659+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.659+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57f6a0 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.659+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.659+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57f6a0 2024-09-10T05:11:50.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.659+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.659+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f576350 2024-09-10T05:11:50.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.659+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.659+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f576350 2024-09-10T05:11:50.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.659+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.659+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57ad40 2024-09-10T05:11:50.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.660+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.660+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57f6a0 2024-09-10T05:11:50.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.660+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.660+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x7f7ac402e910 2024-09-10T05:11:50.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.660+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.660+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f576350 2024-09-10T05:11:50.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.660+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.660+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57ad40 2024-09-10T05:11:50.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.661+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.661+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57f6a0 2024-09-10T05:11:50.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.661+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.661+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57ad40 2024-09-10T05:11:50.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.661+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.661+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x7f7ac402e910 2024-09-10T05:11:50.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.661+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.661+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57f6a0 2024-09-10T05:11:50.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f57ad40 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x56486f576350 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56486f579fe0 con 0x7f7ac402e910 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7adc296800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7adc296800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7adc296800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7adc296800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7adc296800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7adc296800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:50.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.662+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f57dfb0 con 0x56486f576350 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f57dfb0 con 0x56486f576350 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f57dfb0 con 0x7f7ac402e910 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 20 zone default found 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 4 Realm: () 2024-09-10T05:11:50.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:50.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:50.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:50.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 20 zonegroup default 2024-09-10T05:11:50.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f57dfa0 con 0x56486f57ad40 2024-09-10T05:11:50.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.663+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.664+0000 7f7adc296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.664+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.664+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f5840a0 con 0x56486f57f6a0 2024-09-10T05:11:50.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.664+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.664+0000 7f7adc296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.664+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.664+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f584440 con 0x56486f57f6a0 2024-09-10T05:11:50.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.664+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.664+0000 7f7adc296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.664+0000 7f7adc296800 20 started sync module instance, tier type = 2024-09-10T05:11:50.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.664+0000 7f7adc296800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:50.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.664+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f583540 con 0x7f7ac402e910 2024-09-10T05:11:50.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.665+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.665+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94869105687104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f583540 con 0x7f7ac402e910 2024-09-10T05:11:50.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.665+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f584e00 con 0x56486f576350 2024-09-10T05:11:50.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.666+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94869105687104] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.666+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.666+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94869105691440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f583540 con 0x56486f576350 2024-09-10T05:11:50.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.666+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5858a0 con 0x56486f57f6a0 2024-09-10T05:11:50.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.667+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94869105691440] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.667+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.667+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94869105684624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5834b0 con 0x56486f57f6a0 2024-09-10T05:11:50.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.667+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f586760 con 0x7f7ac402e910 2024-09-10T05:11:50.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.668+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94869105684624] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.668+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.668+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94869105697456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f586b80 con 0x7f7ac402e910 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.668+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f587540 con 0x56486f576350 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.669+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.669+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94869105701008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5874b0 con 0x56486f576350 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.669+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f588430 con 0x56486f57ad40 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.670+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94869105697456] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.670+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.670+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94869105701008] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.670+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94869105704832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5866d0 con 0x56486f57ad40 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.670+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f588cd0 con 0x56486f57ad40 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.671+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.671+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94869105706960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f589100 con 0x56486f57ad40 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.671+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f589c10 con 0x56486f57ad40 2024-09-10T05:11:50.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.671+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94869105704832] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.672+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.672+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94869105706960] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.672+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94869105710784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f589bd0 con 0x56486f57ad40 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.672+0000 7f7adc296800 20 add_watcher() i=0 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.672+0000 7f7adc296800 20 add_watcher() i=1 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.672+0000 7f7adc296800 20 add_watcher() i=2 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.672+0000 7f7adc296800 20 add_watcher() i=3 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.672+0000 7f7adc296800 20 add_watcher() i=4 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.672+0000 7f7adc296800 20 add_watcher() i=5 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.672+0000 7f7adc296800 20 add_watcher() i=6 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.675+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94869105710784] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.675+0000 7f7adc296800 20 add_watcher() i=7 2024-09-10T05:11:50.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.675+0000 7f7adc296800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.675+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f588cb0 con 0x56486f576350 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.675+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.675+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94869105703136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f588cb0 con 0x56486f576350 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.676+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94869105703136] v35'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.676+0000 7f798b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.676+0000 7f7adc296800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.676+0000 7f7adc296800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.677+0000 7f7adc296800 5 note: GC not initialized 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.677+0000 7f798a7fc640 20 reqs_thread_entry: start 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.677+0000 7f7adc296800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.677+0000 7f7adc296800 20 Filter name: none 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.677+0000 7f78fbfff640 20 reqs_thread_entry: start 2024-09-10T05:11:50.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.677+0000 7f7adc296800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.677+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.677+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f5bfbf0 con 0x56486f57ad40 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.678+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.678+0000 7f7adc296800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.678+0000 7f7adc296800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.678+0000 7f7adc296800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.678+0000 7f7adc296800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.678+0000 7f7adc296800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.678+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.678+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f5c1b80 con 0x7f7ac402e910 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.678+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.678+0000 7f7adc296800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:50.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.678+0000 7f7adc296800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.678+0000 7f7adc296800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.679+0000 7f7adc296800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 : miss 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.679+0000 7f7adc296800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.679+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f5c3610 con 0x56486f57f6a0 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.679+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.679+0000 7f7adc296800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.679+0000 7f7adc296800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.679+0000 7f7adc296800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.679+0000 7f7adc296800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.679+0000 7f7adc296800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.679+0000 7f7adc296800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.679+0000 7f7adc296800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.679+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5c8090 con 0x7f7ac402e910 2024-09-10T05:11:50.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.680+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(65 foo.buckets [call] v35'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.680+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5cde20 con 0x56486f57f6a0 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(66 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v35'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f7adc296800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f7adc296800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f7adc296800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f7adc296800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1, ofs0, ns] 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94869105949872 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f5c8970 con 0x7f7ac402e910 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== watch-notify(notify (1) cookie 94869105697456 notify 150323855373 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f7ad4026410 con 0x7f7ac402e910 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f79bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855373 cookie 94869105697456 notifier 4511 bl.length()=760 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(67 notify.3 [notify cookie 94869105949872 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f79bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f79bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:50.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f79bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.681+0000 7f79bd7fa640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f799c003ea0 con 0x7f7ac402e910 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.682+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.682+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== watch-notify(notify_complete (2) cookie 94869105949872 notify 150323855373 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7ad4005040 con 0x7f7ac402e910 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.682+0000 7f7adc296800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): orig_sources= new_sources= 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.682+0000 7f7adc296800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): potential sources added=[] removed=[] 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.682+0000 7f7adc296800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): orig_dests= new_dests= 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.682+0000 7f7adc296800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): potential dests added=[] removed=[] 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.682+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5ccda0 con 0x56486f57ad40 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.683+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(69 fud.buckets [call] v35'3 uv3 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.683+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5c8950 con 0x7f7ac402e910 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.684+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v35'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.684+0000 7f7adc296800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T05:11:50.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.684+0000 7f7adc296800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:50.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.684+0000 7f7adc296800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:11:50.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.684+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94869105968288 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56486f5c88c0 con 0x56486f57ad40 2024-09-10T05:11:50.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.684+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== watch-notify(notify (1) cookie 94869105706960 notify 150323855369 ret 0) ==== 356+0+0 (crc 0 0 0) 0x56486f5559e0 con 0x56486f57ad40 2024-09-10T05:11:50.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.684+0000 7f79bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855369 cookie 94869105706960 notifier 4511 bl.length()=314 2024-09-10T05:11:50.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.684+0000 7f79bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T05:11:50.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.684+0000 7f79bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:50.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.684+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(71 notify.6 [notify cookie 94869105968288 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.684+0000 7f79bd7fa640 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f799c003ea0 con 0x56486f57ad40 2024-09-10T05:11:50.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.685+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.685+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== watch-notify(notify_complete (2) cookie 94869105968288 notify 150323855369 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56486f538230 con 0x56486f57ad40 2024-09-10T05:11:50.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.685+0000 7f798b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.685+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94869105703136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5bda50 con 0x56486f576350 2024-09-10T05:11:50.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.686+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94869105703136] v35'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.686+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94869105687104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5bda50 con 0x7f7ac402e910 2024-09-10T05:11:50.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.687+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94869105687104] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.687+0000 7f7adc296800 20 remove_watcher() i=0 2024-09-10T05:11:50.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.687+0000 7f7adc296800 2 removed watcher, disabling cache 2024-09-10T05:11:50.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.687+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94869105691440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5bda50 con 0x56486f576350 2024-09-10T05:11:50.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.688+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94869105691440] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.688+0000 7f7adc296800 20 remove_watcher() i=1 2024-09-10T05:11:50.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.689+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94869105684624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5bda50 con 0x56486f57f6a0 2024-09-10T05:11:50.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.689+0000 7f7ad157f640 1 -- 172.21.15.192:0/260616350 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94869105684624] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ac4037040 con 0x56486f57f6a0 2024-09-10T05:11:50.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.689+0000 7f7adc296800 20 remove_watcher() i=2 2024-09-10T05:11:50.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.689+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94869105697456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5bda50 con 0x7f7ac402e910 2024-09-10T05:11:50.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.690+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94869105697456] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x7f7ac402e910 2024-09-10T05:11:50.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.690+0000 7f7adc296800 20 remove_watcher() i=3 2024-09-10T05:11:50.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.690+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94869105701008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5bda50 con 0x56486f576350 2024-09-10T05:11:50.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.691+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94869105701008] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ad400a4d0 con 0x56486f576350 2024-09-10T05:11:50.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.691+0000 7f7adc296800 20 remove_watcher() i=4 2024-09-10T05:11:50.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.691+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94869105704832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5bda50 con 0x56486f57ad40 2024-09-10T05:11:50.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.692+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94869105704832] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.692+0000 7f7adc296800 20 remove_watcher() i=5 2024-09-10T05:11:50.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.692+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94869105706960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5bda50 con 0x56486f57ad40 2024-09-10T05:11:50.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.694+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94869105706960] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.694+0000 7f7adc296800 20 remove_watcher() i=6 2024-09-10T05:11:50.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.694+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94869105710784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56486f5bda50 con 0x56486f57ad40 2024-09-10T05:11:50.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7ad9d80640 1 -- 172.21.15.192:0/260616350 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94869105710784] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7acc0be030 con 0x56486f57ad40 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 20 remove_watcher() i=7 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56486f57ad40 msgr2=0x56486f57d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56486f57ad40 0x56486f57d130 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56486f576350 msgr2=0x56486f578810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56486f576350 0x56486f578810 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7ac402e910 msgr2=0x7f7ac403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f7ac402e910 0x7f7ac403a3c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56486f57f6a0 msgr2=0x56486f581b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56486f57f6a0 0x56486f581b60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79a403c780 msgr2=0x7f79a403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79a403c780 0x7f79a403ec40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400ffd0 tx=0x7f7ac4023040 comp rx=0 tx=0).stop 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 msgr2=0x56486f56ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7ada581640 1 -- 172.21.15.192:0/260616350 reap_dead start 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 0x56486f56ae00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7acc06cfd0 tx=0x7f7acc070e80 comp rx=0 tx=0).stop 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 shutdown_connections 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 --2- 172.21.15.192:0/260616350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f43e6b0 0x56486f56ae00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 >> 172.21.15.192:0/260616350 conn(0x56486f55dc00 msgr2=0x56486f55be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 shutdown_connections 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.695+0000 7f7adc296800 1 -- 172.21.15.192:0/260616350 wait complete. 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/807060833 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79b403c780 msgr2=0x7f79b403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 --2- 172.21.15.192:0/807060833 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79b403c780 0x7f79b403ec40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x56486f53ea90 tx=0x7f7ac4006000 comp rx=0 tx=0).stop 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/807060833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f554f80 msgr2=0x56486f5553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 --2- 172.21.15.192:0/807060833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f554f80 0x56486f5553a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7acc095f30 tx=0x7f7acc05d820 comp rx=0 tx=0).stop 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/807060833 shutdown_connections 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 --2- 172.21.15.192:0/807060833 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79b403c780 0x7f79b403ec40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 --2- 172.21.15.192:0/807060833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f554f80 0x56486f5553a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/807060833 >> 172.21.15.192:0/807060833 conn(0x56486f549330 msgr2=0x56486f549710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/807060833 shutdown_connections 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/807060833 wait complete. 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56486f5408f0 msgr2=0x56486f542ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56486f5408f0 0x56486f542ce0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56486f443040 msgr2=0x56486f53e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56486f443040 0x56486f53e480 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56486f5447f0 msgr2=0x56486f546be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56486f5447f0 0x56486f546be0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79c003c780 msgr2=0x7f79c003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f79c003c780 0x7f79c003ec40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4000c00 tx=0x7f7ac40013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 msgr2=0x56486f536e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 --2- 172.21.15.192:0/3997236803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56486f4406b0 0x56486f536e80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7acc025c20 tx=0x7f7acc002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7ada581640 1 -- 172.21.15.192:0/3997236803 reap_dead start 2024-09-10T05:11:50.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 shutdown_connections 2024-09-10T05:11:50.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 >> 172.21.15.192:0/3997236803 conn(0x56486f43a210 msgr2=0x56486f5307a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 shutdown_connections 2024-09-10T05:11:50.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.696+0000 7f7adc296800 1 -- 172.21.15.192:0/3997236803 wait complete. 2024-09-10T05:11:50.711 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T05:11:50.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T05:11:50.711 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T05:11:50.755 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:50.755 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:50.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.755+0000 7f3ee2820800 1 Processor -- start 2024-09-10T05:11:50.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.755+0000 7f3ee2820800 1 -- start start 2024-09-10T05:11:50.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.755+0000 7f3ee2820800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b916c99fc0 0x55b916ca2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.755+0000 7f3ee2820800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b916b43e40 con 0x55b916c984a0 2024-09-10T05:11:50.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.755+0000 7f3ee2820800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55b916b0e680 con 0x55b916c99fc0 2024-09-10T05:11:50.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.756+0000 7f3edfb10640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b916c99fc0 0x55b916ca2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.756+0000 7f3ee0311640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55b916c984a0 0x55b916c988a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36452/0 (socket says 172.21.15.192:36452) 2024-09-10T05:11:50.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.756+0000 7f3edfb10640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b916c99fc0 0x55b916ca2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60800/0 (socket says 172.21.15.192:60800) 2024-09-10T05:11:50.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.756+0000 7f3ee0311640 1 -- 172.21.15.192:0/2807357957 learned_addr learned my addr 172.21.15.192:0/2807357957 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:50.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.756+0000 7f3edfb10640 1 -- 172.21.15.192:0/2807357957 >> v1:172.21.15.139:6789/0 conn(0x55b916c984a0 legacy=0x55b916c988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.756+0000 7f3edf30f640 1 -- 172.21.15.192:0/2807357957 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962830067 0 0) 0x55b916b43e40 con 0x55b916c984a0 2024-09-10T05:11:50.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.756+0000 7f3edfb10640 1 -- 172.21.15.192:0/2807357957 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b916b2a6b0 con 0x55b916c99fc0 2024-09-10T05:11:50.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.758+0000 7f3edfb10640 1 --2- 172.21.15.192:0/2807357957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c99fc0 0x55b916ca2ae0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800a470 tx=0x7f3ec8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbc6e1450cf6f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.758+0000 7f3edf30f640 1 -- 172.21.15.192:0/2807357957 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec8053570 con 0x55b916c99fc0 2024-09-10T05:11:50.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.758+0000 7f3edf30f640 1 -- 172.21.15.192:0/2807357957 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec8058070 con 0x55b916c99fc0 2024-09-10T05:11:50.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.758+0000 7f3edf30f640 1 -- 172.21.15.192:0/2807357957 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec8053880 con 0x55b916c99fc0 2024-09-10T05:11:50.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.758+0000 7f3ee2820800 1 -- 172.21.15.192:0/2807357957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c99fc0 msgr2=0x55b916ca2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.758+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2807357957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c99fc0 0x55b916ca2ae0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800a470 tx=0x7f3ec8045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:50.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.758+0000 7f3ee2820800 1 -- 172.21.15.192:0/2807357957 shutdown_connections 2024-09-10T05:11:50.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.758+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2807357957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c99fc0 0x55b916ca2ae0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.758+0000 7f3ee2820800 1 -- 172.21.15.192:0/2807357957 >> 172.21.15.192:0/2807357957 conn(0x55b916c941f0 msgr2=0x55b916c96630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.758+0000 7f3ee2820800 1 -- 172.21.15.192:0/2807357957 shutdown_connections 2024-09-10T05:11:50.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.758+0000 7f3ee2820800 1 -- 172.21.15.192:0/2807357957 wait complete. 2024-09-10T05:11:50.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.772+0000 7f3ee2820800 1 Processor -- start 2024-09-10T05:11:50.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.772+0000 7f3ee2820800 1 -- start start 2024-09-10T05:11:50.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.772+0000 7f3ee2820800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c984a0 0x55b916d8b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.772+0000 7f3ee2820800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b916b32dd0 con 0x55b916c984a0 2024-09-10T05:11:50.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.773+0000 7f3ee0311640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c984a0 0x55b916d8b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.773+0000 7f3ee0311640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c984a0 0x55b916d8b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60804/0 (socket says 172.21.15.192:60804) 2024-09-10T05:11:50.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.773+0000 7f3ee0311640 1 -- 172.21.15.192:0/963341176 learned_addr learned my addr 172.21.15.192:0/963341176 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.773+0000 7f3ee0311640 1 -- 172.21.15.192:0/963341176 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b916b4be10 con 0x55b916c984a0 2024-09-10T05:11:50.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.773+0000 7f3ee0311640 1 --2- 172.21.15.192:0/963341176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c984a0 0x55b916d8b620 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0006fa0 tx=0x7f3ed0001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda0e0fa23a50e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.773+0000 7f3dce60c640 1 -- 172.21.15.192:0/963341176 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed0003450 con 0x55b916c984a0 2024-09-10T05:11:50.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.773+0000 7f3dce60c640 1 -- 172.21.15.192:0/963341176 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed0003610 con 0x55b916c984a0 2024-09-10T05:11:50.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.773+0000 7f3dce60c640 1 -- 172.21.15.192:0/963341176 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed0003970 con 0x55b916c984a0 2024-09-10T05:11:50.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.774+0000 7f3ee2820800 1 -- 172.21.15.192:0/963341176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c984a0 msgr2=0x55b916d8b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.774+0000 7f3ee2820800 1 --2- 172.21.15.192:0/963341176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c984a0 0x55b916d8b620 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0006fa0 tx=0x7f3ed0001b00 comp rx=0 tx=0).stop 2024-09-10T05:11:50.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.774+0000 7f3ee2820800 1 -- 172.21.15.192:0/963341176 shutdown_connections 2024-09-10T05:11:50.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.774+0000 7f3ee2820800 1 --2- 172.21.15.192:0/963341176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c984a0 0x55b916d8b620 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.774+0000 7f3ee2820800 1 -- 172.21.15.192:0/963341176 >> 172.21.15.192:0/963341176 conn(0x55b916c941f0 msgr2=0x55b916d86fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.774+0000 7f3ee2820800 1 -- 172.21.15.192:0/963341176 shutdown_connections 2024-09-10T05:11:50.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.774+0000 7f3ee2820800 1 -- 172.21.15.192:0/963341176 wait complete. 2024-09-10T05:11:50.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.774+0000 7f3ee2820800 1 Processor -- start 2024-09-10T05:11:50.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.775+0000 7f3ee2820800 1 -- start start 2024-09-10T05:11:50.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.775+0000 7f3ee2820800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c99fc0 0x55b916d931f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.775+0000 7f3ee2820800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b916ca32f0 con 0x55b916c99fc0 2024-09-10T05:11:50.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.775+0000 7f3ee0311640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c99fc0 0x55b916d931f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.775+0000 7f3ee0311640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c99fc0 0x55b916d931f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60812/0 (socket says 172.21.15.192:60812) 2024-09-10T05:11:50.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.775+0000 7f3ee0311640 1 -- 172.21.15.192:0/1878563533 learned_addr learned my addr 172.21.15.192:0/1878563533 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.775+0000 7f3ee0311640 1 -- 172.21.15.192:0/1878563533 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b916d93750 con 0x55b916c99fc0 2024-09-10T05:11:50.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.775+0000 7f3ee0311640 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c99fc0 0x55b916d931f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0001330 tx=0x7f3ed0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.775+0000 7f3dcce09640 1 -- 172.21.15.192:0/1878563533 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed00062f0 con 0x55b916c99fc0 2024-09-10T05:11:50.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.775+0000 7f3dcce09640 1 -- 172.21.15.192:0/1878563533 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed0014970 con 0x55b916c99fc0 2024-09-10T05:11:50.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.775+0000 7f3dcce09640 1 -- 172.21.15.192:0/1878563533 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed0014c50 con 0x55b916c99fc0 2024-09-10T05:11:50.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.775+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b916d939e0 con 0x55b916c99fc0 2024-09-10T05:11:50.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.776+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b916d943e0 con 0x55b916c99fc0 2024-09-10T05:11:50.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.776+0000 7f3dcce09640 1 -- 172.21.15.192:0/1878563533 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3ed0010070 con 0x55b916c99fc0 2024-09-10T05:11:50.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.776+0000 7f3dcce09640 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3dc803c780 0x7f3dc803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.777+0000 7f3dcce09640 1 -- 172.21.15.192:0/1878563533 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3ed0018070 con 0x55b916c99fc0 2024-09-10T05:11:50.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.777+0000 7f3edfb10640 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3dc803c780 0x7f3dc803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.777+0000 7f3ee2820800 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b916d94ee0 0x55b916d9a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.777+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916d9add0 con 0x55b916d94ee0 2024-09-10T05:11:50.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.777+0000 7f3ee0b12640 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b916d94ee0 0x55b916d9a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.777+0000 7f3edfb10640 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3dc803c780 0x7f3dc803ec40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8057000 tx=0x7f3ec8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.777+0000 7f3ee0b12640 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b916d94ee0 0x55b916d9a840 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.777+0000 7f3ee0b12640 1 -- 172.21.15.192:0/1878563533 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ed80083e0 con 0x55b916d94ee0 2024-09-10T05:11:50.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.777+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916d94890 con 0x55b916d94ee0 2024-09-10T05:11:50.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.778+0000 7f3ee0b12640 1 -- 172.21.15.192:0/1878563533 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ed80083e0 con 0x55b916d94ee0 2024-09-10T05:11:50.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.778+0000 7f3ee2820800 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b916d9d120 0x55b916d9f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.778+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916d9fbe0 con 0x55b916d9d120 2024-09-10T05:11:50.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.778+0000 7f3ee0311640 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b916d9d120 0x55b916d9f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.778+0000 7f3ee0311640 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b916d9d120 0x55b916d9f510 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.778+0000 7f3ee0311640 1 -- 172.21.15.192:0/1878563533 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3ed001b070 con 0x55b916d9d120 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.779+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916d9bfc0 con 0x55b916d94ee0 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.779+0000 7f3ee0b12640 1 -- 172.21.15.192:0/1878563533 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ed80083e0 con 0x55b916d94ee0 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.779+0000 7f3ee2820800 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b916da1020 0x55b916da3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.779+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916da3ba0 con 0x55b916da1020 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.779+0000 7f3edfb10640 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b916da1020 0x55b916da3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.779+0000 7f3edfb10640 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b916da1020 0x55b916da3410 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.780+0000 7f3edfb10640 1 -- 172.21.15.192:0/1878563533 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916da1020 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.780+0000 7f3ee2820800 1 Processor -- start 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.780+0000 7f3ee2820800 1 -- start start 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.780+0000 7f3ee2820800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916db17c0 0x55b916db1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.780+0000 7f3ee2820800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b916b90a00 con 0x55b916db17c0 2024-09-10T05:11:50.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.780+0000 7f3ee0311640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916db17c0 0x55b916db1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.780+0000 7f3ee0311640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916db17c0 0x55b916db1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60818/0 (socket says 172.21.15.192:60818) 2024-09-10T05:11:50.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.780+0000 7f3ee0311640 1 -- 172.21.15.192:0/177538927 learned_addr learned my addr 172.21.15.192:0/177538927 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.781+0000 7f3ee0311640 1 -- 172.21.15.192:0/177538927 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b916db2220 con 0x55b916db17c0 2024-09-10T05:11:50.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.781+0000 7f3ee0311640 1 --2- 172.21.15.192:0/177538927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916db17c0 0x55b916db1be0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0019fd0 tx=0x7f3ed0010730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.781+0000 7f3dc5ffb640 1 -- 172.21.15.192:0/177538927 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed0012e10 con 0x55b916db17c0 2024-09-10T05:11:50.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.781+0000 7f3dc5ffb640 1 -- 172.21.15.192:0/177538927 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed0047070 con 0x55b916db17c0 2024-09-10T05:11:50.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.781+0000 7f3ee2820800 1 -- 172.21.15.192:0/177538927 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b916db2a50 con 0x55b916db17c0 2024-09-10T05:11:50.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.781+0000 7f3dc5ffb640 1 -- 172.21.15.192:0/177538927 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed0029680 con 0x55b916db17c0 2024-09-10T05:11:50.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.781+0000 7f3ee2820800 1 -- 172.21.15.192:0/177538927 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b916db2ff0 con 0x55b916db17c0 2024-09-10T05:11:50.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.782+0000 7f3dc5ffb640 1 -- 172.21.15.192:0/177538927 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3ed004acf0 con 0x55b916db17c0 2024-09-10T05:11:50.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.782+0000 7f3dc5ffb640 1 --2- 172.21.15.192:0/177538927 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3db803c780 0x7f3db803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.782+0000 7f3dc5ffb640 1 -- 172.21.15.192:0/177538927 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3ed003bc70 con 0x55b916db17c0 2024-09-10T05:11:50.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.782+0000 7f3edfb10640 1 --2- 172.21.15.192:0/177538927 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3db803c780 0x7f3db803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.782+0000 7f3ee2820800 1 Processor -- start 2024-09-10T05:11:50.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.782+0000 7f3ee2820800 1 -- start start 2024-09-10T05:11:50.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.782+0000 7f3edfb10640 1 --2- 172.21.15.192:0/177538927 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3db803c780 0x7f3db803ec40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8045f20 tx=0x7f3ec8005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.782+0000 7f3ee2820800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 0x55b916dbe6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.782+0000 7f3ee2820800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b916d8be70 con 0x55b916dbe2c0 2024-09-10T05:11:50.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.783+0000 7f3ee0311640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 0x55b916dbe6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.783+0000 7f3ee0311640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 0x55b916dbe6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60828/0 (socket says 172.21.15.192:60828) 2024-09-10T05:11:50.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.783+0000 7f3ee0311640 1 -- 172.21.15.192:0/2872361568 learned_addr learned my addr 172.21.15.192:0/2872361568 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.783+0000 7f3ee0311640 1 -- 172.21.15.192:0/2872361568 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b916dbecb0 con 0x55b916dbe2c0 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.783+0000 7f3ee0311640 1 --2- 172.21.15.192:0/2872361568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 0x55b916dbe6c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ed002d000 tx=0x7f3ed004fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d465c7337a79ca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.783+0000 7f3dbf7fe640 1 -- 172.21.15.192:0/2872361568 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed00537c0 con 0x55b916dbe2c0 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.783+0000 7f3dbf7fe640 1 -- 172.21.15.192:0/2872361568 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed0029820 con 0x55b916dbe2c0 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.783+0000 7f3dbf7fe640 1 -- 172.21.15.192:0/2872361568 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed004b110 con 0x55b916dbe2c0 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.783+0000 7f3ee2820800 1 -- 172.21.15.192:0/2872361568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 msgr2=0x55b916dbe6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.783+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2872361568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 0x55b916dbe6c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ed002d000 tx=0x7f3ed004fa60 comp rx=0 tx=0).stop 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee2820800 1 -- 172.21.15.192:0/2872361568 shutdown_connections 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2872361568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 0x55b916dbe6c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee2820800 1 -- 172.21.15.192:0/2872361568 >> 172.21.15.192:0/2872361568 conn(0x55b916dba6c0 msgr2=0x55b916db8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee2820800 1 -- 172.21.15.192:0/2872361568 shutdown_connections 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee2820800 1 -- 172.21.15.192:0/2872361568 wait complete. 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee2820800 1 Processor -- start 2024-09-10T05:11:50.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee2820800 1 -- start start 2024-09-10T05:11:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee2820800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 0x55b916dc5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee2820800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b916dbf120 con 0x55b916dbe2c0 2024-09-10T05:11:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee0311640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 0x55b916dc5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee0311640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 0x55b916dc5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60840/0 (socket says 172.21.15.192:60840) 2024-09-10T05:11:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 learned_addr learned my addr 172.21.15.192:0/2205142638 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.784+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b916dc5be0 con 0x55b916dbe2c0 2024-09-10T05:11:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.785+0000 7f3ee0311640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 0x55b916dc5680 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0029ab0 tx=0x7f3ed004c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.785+0000 7f3dbdffb640 1 -- 172.21.15.192:0/2205142638 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed004f4a0 con 0x55b916dbe2c0 2024-09-10T05:11:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.785+0000 7f3dbdffb640 1 -- 172.21.15.192:0/2205142638 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed004f640 con 0x55b916dbe2c0 2024-09-10T05:11:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.785+0000 7f3dbdffb640 1 -- 172.21.15.192:0/2205142638 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed004c020 con 0x55b916dbe2c0 2024-09-10T05:11:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.785+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b916dc5be0 con 0x55b916dbe2c0 2024-09-10T05:11:50.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.785+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b916dc5be0 con 0x55b916dbe2c0 2024-09-10T05:11:50.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.785+0000 7f3dbdffb640 1 -- 172.21.15.192:0/2205142638 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3ed004c1c0 con 0x55b916dbe2c0 2024-09-10T05:11:50.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.786+0000 7f3dbdffb640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3db003c780 0x7f3db003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.786+0000 7f3dbdffb640 1 -- 172.21.15.192:0/2205142638 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3ed0068070 con 0x55b916dbe2c0 2024-09-10T05:11:50.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.786+0000 7f3edfb10640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3db003c780 0x7f3db003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.786+0000 7f3edfb10640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3db003c780 0x7f3db003ec40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80539f0 tx=0x7f3ec806b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.786+0000 7f3ee2820800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.786+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b916dd0c50 0x55b916dd3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.786+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd3860 con 0x55b916dd0c50 2024-09-10T05:11:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee0b12640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b916dd0c50 0x55b916dd3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee0b12640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b916dd0c50 0x55b916dd3110 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ed80083e0 con 0x55b916dd0c50 2024-09-10T05:11:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee2820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee2820800 20 realm 2024-09-10T05:11:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee2820800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd3c70 con 0x55b916dd0c50 2024-09-10T05:11:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ed80083e0 con 0x55b916dd0c50 2024-09-10T05:11:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee2820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee2820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee2820800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd0c50 2024-09-10T05:11:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ed80083e0 con 0x55b916dd0c50 2024-09-10T05:11:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee2820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee2820800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.787+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd48e0 con 0x55b916dd0c50 2024-09-10T05:11:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.788+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ed80083e0 con 0x55b916dd0c50 2024-09-10T05:11:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.788+0000 7f3ee2820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.788+0000 7f3ee2820800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.788+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b916dd52a0 0x55b916dd7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.788+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd7ce0 con 0x55b916dd52a0 2024-09-10T05:11:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.788+0000 7f3ee0311640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b916dd52a0 0x55b916dd7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.788+0000 7f3ee0311640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b916dd52a0 0x55b916dd7690 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.789+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.789+0000 7f3ee2820800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.789+0000 7f3ee2820800 20 searching for the correct realm 2024-09-10T05:11:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.789+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b916dd9c70 0x55b916ddc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.789+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916ddc7b0 con 0x55b916dd9c70 2024-09-10T05:11:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.789+0000 7f3edfb10640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b916dd9c70 0x55b916ddc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.789+0000 7f3edfb10640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b916dd9c70 0x55b916ddc130 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.789+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.789+0000 7f3edfb10640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3ec808a040 0x7f3ec808a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.789+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916ddc7b0 con 0x7f3ec808a040 2024-09-10T05:11:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.790+0000 7f3ee0b12640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3ec808a040 0x7f3ec808a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.790+0000 7f3ee0b12640 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3ec808a040 0x7f3ec808a420 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.790+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3ed80083e0 con 0x7f3ec808a040 2024-09-10T05:11:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.790+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd52a0 2024-09-10T05:11:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.790+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.790+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd0c50 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.791+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed80083e0 con 0x55b916dd0c50 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.791+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd0c50 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.791+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.791+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd52a0 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.791+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.791+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd52a0 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.792+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.792+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x7f3ec808a040 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.792+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.792+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd9c70 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.792+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.792+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd0c50 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.792+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.792+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd52a0 2024-09-10T05:11:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.793+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.793+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd0c50 2024-09-10T05:11:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.793+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.793+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x7f3ec808a040 2024-09-10T05:11:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.793+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.793+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd9c70 2024-09-10T05:11:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.793+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.793+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd9c70 2024-09-10T05:11:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.794+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.794+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd52a0 2024-09-10T05:11:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.794+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.794+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd9c70 2024-09-10T05:11:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.794+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.794+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd9c70 2024-09-10T05:11:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.794+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.794+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd0c50 2024-09-10T05:11:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.795+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.795+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd0c50 2024-09-10T05:11:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.795+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.795+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd52a0 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.795+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.795+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd9c70 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.795+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.795+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x7f3ec808a040 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.796+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.796+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd0c50 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.796+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.796+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd52a0 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.796+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.796+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd9c70 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.796+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.796+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd52a0 2024-09-10T05:11:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.797+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.797+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x7f3ec808a040 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.797+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.797+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd9c70 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.797+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.797+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd52a0 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x55b916dd0c50 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd4540 con 0x7f3ec808a040 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee2820800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee2820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee2820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee2820800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee2820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee2820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee2820800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd8080 con 0x55b916dd0c50 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee2820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee2820800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.798+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd8080 con 0x55b916dd0c50 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd8080 con 0x7f3ec808a040 2024-09-10T05:11:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 20 zone default found 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 4 Realm: () 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 20 zonegroup default 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916dd8500 con 0x55b916dd52a0 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.799+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916dde620 con 0x55b916dd9c70 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.800+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.800+0000 7f3ee2820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.800+0000 7f3ee2820800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.800+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916dde9c0 con 0x55b916dd9c70 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.800+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.800+0000 7f3ee2820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.800+0000 7f3ee2820800 20 started sync module instance, tier type = 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.800+0000 7f3ee2820800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.800+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916dddac0 con 0x7f3ec808a040 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.801+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.801+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94253440950288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916dddac0 con 0x7f3ec808a040 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.801+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916ddf380 con 0x55b916dd0c50 2024-09-10T05:11:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.802+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94253440950288] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.802+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.802+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94253440948208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916ddf380 con 0x55b916dd0c50 2024-09-10T05:11:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.802+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916ddfd40 con 0x55b916dd9c70 2024-09-10T05:11:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.803+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.803+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94253440956560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de0610 con 0x55b916dd9c70 2024-09-10T05:11:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.803+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de1090 con 0x7f3ec808a040 2024-09-10T05:11:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.803+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94253440948208] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.804+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94253440956560] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.804+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.804+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94253440958816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916ddeed0 con 0x7f3ec808a040 2024-09-10T05:11:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.804+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de1960 con 0x55b916dd0c50 2024-09-10T05:11:50.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.805+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.805+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94253440963680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de1d80 con 0x55b916dd0c50 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.805+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de2870 con 0x55b916dd52a0 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.805+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94253440958816] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.806+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94253440963680] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.806+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.806+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94253440964736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de0b80 con 0x55b916dd52a0 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.806+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de3110 con 0x55b916dd52a0 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.807+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94253440964736] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.807+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.807+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94253440967488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de3110 con 0x55b916dd52a0 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.807+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de3b30 con 0x55b916dd52a0 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.808+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.808+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94253440967488] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.808+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94253440972320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de3af0 con 0x55b916dd52a0 2024-09-10T05:11:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.808+0000 7f3ee2820800 20 add_watcher() i=0 2024-09-10T05:11:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.808+0000 7f3ee2820800 20 add_watcher() i=1 2024-09-10T05:11:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.808+0000 7f3ee2820800 20 add_watcher() i=2 2024-09-10T05:11:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.808+0000 7f3ee2820800 20 add_watcher() i=3 2024-09-10T05:11:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.808+0000 7f3ee2820800 20 add_watcher() i=4 2024-09-10T05:11:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.808+0000 7f3ee2820800 20 add_watcher() i=5 2024-09-10T05:11:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.808+0000 7f3ee2820800 20 add_watcher() i=6 2024-09-10T05:11:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.809+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94253440972320] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.809+0000 7f3ee2820800 20 add_watcher() i=7 2024-09-10T05:11:50.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.809+0000 7f3ee2820800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:50.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.809+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916de6f80 con 0x55b916dd0c50 2024-09-10T05:11:50.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.810+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.810+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94253440969744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de4440 con 0x55b916dd0c50 2024-09-10T05:11:50.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.811+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94253440969744] v35'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.811+0000 7f3d96fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.811+0000 7f3ee2820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:50.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.811+0000 7f3ee2820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:50.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.811+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916def840 con 0x55b916dd0c50 2024-09-10T05:11:50.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.812+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'44 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.812+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916defe90 con 0x55b916dd52a0 2024-09-10T05:11:50.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.813+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.813+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916defe70 con 0x55b916dd9c70 2024-09-10T05:11:50.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.814+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.814+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df0950 con 0x55b916dd0c50 2024-09-10T05:11:50.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.815+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'119 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.815+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916ded670 con 0x7f3ec808a040 2024-09-10T05:11:50.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.816+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'38 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.816+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916ded640 con 0x55b916dd9c70 2024-09-10T05:11:50.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.817+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'33 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.817+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df1680 con 0x55b916dd0c50 2024-09-10T05:11:50.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.818+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.818+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df1680 con 0x55b916dd52a0 2024-09-10T05:11:50.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.819+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'27 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.819+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df1710 con 0x7f3ec808a040 2024-09-10T05:11:50.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.820+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.820+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df17a0 con 0x55b916dd9c70 2024-09-10T05:11:50.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.821+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.821+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df1d30 con 0x7f3ec808a040 2024-09-10T05:11:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.822+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'39 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.822+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df1d10 con 0x55b916dd52a0 2024-09-10T05:11:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.823+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.823+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df1ce0 con 0x7f3ec808a040 2024-09-10T05:11:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.824+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.824+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df1ce0 con 0x55b916dd52a0 2024-09-10T05:11:50.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.825+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'39 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.825+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df1ce0 con 0x55b916dd0c50 2024-09-10T05:11:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.826+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'120 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.826+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df20c0 con 0x55b916dd9c70 2024-09-10T05:11:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.827+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.827+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df20c0 con 0x7f3ec808a040 2024-09-10T05:11:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.828+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.828+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df20c0 con 0x55b916dd9c70 2024-09-10T05:11:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.829+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.829+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df20c0 con 0x55b916dd0c50 2024-09-10T05:11:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.830+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.830+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df20c0 con 0x55b916dd0c50 2024-09-10T05:11:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.831+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'121 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.831+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df20c0 con 0x55b916dd9c70 2024-09-10T05:11:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.832+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.832+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df20c0 con 0x7f3ec808a040 2024-09-10T05:11:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.833+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.833+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df20c0 con 0x55b916dd9c70 2024-09-10T05:11:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.834+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.834+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df2100 con 0x55b916dd9c70 2024-09-10T05:11:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.834+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.834+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df2140 con 0x55b916dd9c70 2024-09-10T05:11:50.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.835+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'17 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.835+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df2140 con 0x55b916dd9c70 2024-09-10T05:11:50.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.836+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.836+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df2180 con 0x55b916dd52a0 2024-09-10T05:11:50.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.838+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.838+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df2180 con 0x55b916dd9c70 2024-09-10T05:11:50.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.839+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.839+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df2180 con 0x55b916dd52a0 2024-09-10T05:11:50.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.840+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.840+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df2180 con 0x55b916dd9c70 2024-09-10T05:11:50.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.841+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.841+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df2180 con 0x55b916dd52a0 2024-09-10T05:11:50.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.842+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'40 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.842+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916df21c0 con 0x7f3ec808a040 2024-09-10T05:11:50.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.842+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.843+0000 7f3d95fe3640 20 reqs_thread_entry: start 2024-09-10T05:11:50.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.843+0000 7f3ee2820800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:50.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.843+0000 7f3ee2820800 20 Filter name: none 2024-09-10T05:11:50.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.843+0000 7f3d8effd640 20 reqs_thread_entry: start 2024-09-10T05:11:50.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.843+0000 7f3ee2820800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:11:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.843+0000 7f3ee2820800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.843+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916e1d0e0 con 0x55b916dd52a0 2024-09-10T05:11:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.844+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.844+0000 7f3ee2820800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:11:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.844+0000 7f3ee2820800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T05:11:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.844+0000 7f3ee2820800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:11:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.844+0000 7f3ee2820800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.844+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b916e1f610 con 0x55b916dd52a0 2024-09-10T05:11:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.844+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv3 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T05:11:50.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.845+0000 7f3d96fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.845+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94253440969744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de5c10 con 0x55b916dd0c50 2024-09-10T05:11:50.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.846+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94253440969744] v35'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.846+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94253440950288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de2c10 con 0x7f3ec808a040 2024-09-10T05:11:50.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.847+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94253440950288] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.847+0000 7f3ee2820800 20 remove_watcher() i=0 2024-09-10T05:11:50.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.847+0000 7f3ee2820800 2 removed watcher, disabling cache 2024-09-10T05:11:50.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.847+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94253440948208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de2c10 con 0x55b916dd0c50 2024-09-10T05:11:50.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.848+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94253440948208] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.848+0000 7f3ee2820800 20 remove_watcher() i=1 2024-09-10T05:11:50.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.848+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94253440956560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de2c10 con 0x55b916dd9c70 2024-09-10T05:11:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.849+0000 7f3edfb10640 1 -- 172.21.15.192:0/2205142638 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94253440956560] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ec8051070 con 0x55b916dd9c70 2024-09-10T05:11:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.849+0000 7f3ee2820800 20 remove_watcher() i=2 2024-09-10T05:11:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.849+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94253440958816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de2c10 con 0x7f3ec808a040 2024-09-10T05:11:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.850+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94253440958816] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x7f3ec808a040 2024-09-10T05:11:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.850+0000 7f3ee2820800 20 remove_watcher() i=3 2024-09-10T05:11:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.850+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94253440963680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de2c10 con 0x55b916dd0c50 2024-09-10T05:11:50.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.851+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94253440963680] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8026040 con 0x55b916dd0c50 2024-09-10T05:11:50.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.851+0000 7f3ee2820800 20 remove_watcher() i=4 2024-09-10T05:11:50.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.851+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94253440964736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de1460 con 0x55b916dd52a0 2024-09-10T05:11:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.852+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94253440964736] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.852+0000 7f3ee2820800 20 remove_watcher() i=5 2024-09-10T05:11:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.852+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94253440967488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de2c10 con 0x55b916dd52a0 2024-09-10T05:11:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.853+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94253440967488] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.853+0000 7f3ee2820800 20 remove_watcher() i=6 2024-09-10T05:11:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.853+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94253440972320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b916de2340 con 0x55b916dd52a0 2024-09-10T05:11:50.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee0311640 1 -- 172.21.15.192:0/2205142638 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94253440972320] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed0072020 con 0x55b916dd52a0 2024-09-10T05:11:50.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 20 remove_watcher() i=7 2024-09-10T05:11:50.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b916dd52a0 msgr2=0x55b916dd7690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b916dd52a0 0x55b916dd7690 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b916dd0c50 msgr2=0x55b916dd3110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b916dd0c50 0x55b916dd3110 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3ec808a040 msgr2=0x7f3ec808a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3ec808a040 0x7f3ec808a420 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b916dd9c70 msgr2=0x55b916ddc130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b916dd9c70 0x55b916ddc130 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3db003c780 msgr2=0x7f3db003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3db003c780 0x7f3db003ec40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80539f0 tx=0x7f3ec806b040 comp rx=0 tx=0).stop 2024-09-10T05:11:50.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 msgr2=0x55b916dc5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 --2- 172.21.15.192:0/2205142638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916dbe2c0 0x55b916dc5680 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0029ab0 tx=0x7f3ed004c630 comp rx=0 tx=0).stop 2024-09-10T05:11:50.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 reap_dead start 2024-09-10T05:11:50.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee0b12640 1 -- 172.21.15.192:0/2205142638 reap_dead start 2024-09-10T05:11:50.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 shutdown_connections 2024-09-10T05:11:50.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.854+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 >> 172.21.15.192:0/2205142638 conn(0x55b916dba6c0 msgr2=0x55b916db88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 shutdown_connections 2024-09-10T05:11:50.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/2205142638 wait complete. 2024-09-10T05:11:50.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/177538927 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3db803c780 msgr2=0x7f3db803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 --2- 172.21.15.192:0/177538927 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3db803c780 0x7f3db803ec40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8045f20 tx=0x7f3ec8005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:50.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/177538927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916db17c0 msgr2=0x55b916db1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 --2- 172.21.15.192:0/177538927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916db17c0 0x55b916db1be0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0019fd0 tx=0x7f3ed0010730 comp rx=0 tx=0).stop 2024-09-10T05:11:50.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/177538927 shutdown_connections 2024-09-10T05:11:50.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 --2- 172.21.15.192:0/177538927 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3db803c780 0x7f3db803ec40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 --2- 172.21.15.192:0/177538927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916db17c0 0x55b916db1be0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/177538927 >> 172.21.15.192:0/177538927 conn(0x55b916da5b70 msgr2=0x55b916da5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/177538927 shutdown_connections 2024-09-10T05:11:50.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/177538927 wait complete. 2024-09-10T05:11:50.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b916d9d120 msgr2=0x55b916d9f510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b916d9d120 0x55b916d9f510 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b916d94ee0 msgr2=0x55b916d9a840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b916d94ee0 0x55b916d9a840 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b916da1020 msgr2=0x55b916da3410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b916da1020 0x55b916da3410 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3dc803c780 msgr2=0x7f3dc803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3dc803c780 0x7f3dc803ec40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8057000 tx=0x7f3ec8052000 comp rx=0 tx=0).stop 2024-09-10T05:11:50.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c99fc0 msgr2=0x55b916d931f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 --2- 172.21.15.192:0/1878563533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b916c99fc0 0x55b916d931f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0001330 tx=0x7f3ed0001250 comp rx=0 tx=0).stop 2024-09-10T05:11:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee0b12640 1 -- 172.21.15.192:0/1878563533 reap_dead start 2024-09-10T05:11:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 shutdown_connections 2024-09-10T05:11:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 >> 172.21.15.192:0/1878563533 conn(0x55b916c941f0 msgr2=0x55b916d8c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.855+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 shutdown_connections 2024-09-10T05:11:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.856+0000 7f3ee2820800 1 -- 172.21.15.192:0/1878563533 wait complete. 2024-09-10T05:11:50.867 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T05:11:50.868 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-10T05:11:50.868 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-10T05:11:50.868 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-10T05:11:50.915 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:50.915 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:50.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.915+0000 7f8ef111f800 1 Processor -- start 2024-09-10T05:11:50.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.915+0000 7f8ef111f800 1 -- start start 2024-09-10T05:11:50.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.915+0000 7f8ef111f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c2cbb3fff0 0x55c2cbb48b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.915+0000 7f8ef111f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2cb9e9e40 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.915+0000 7f8ef111f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55c2cb9b4680 con 0x55c2cbb3fff0 2024-09-10T05:11:50.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.915+0000 7f8eec6a1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c2cbb3fff0 0x55c2cbb48b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.916+0000 7f8eec6a1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c2cbb3fff0 0x55c2cbb48b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60852/0 (socket says 172.21.15.192:60852) 2024-09-10T05:11:50.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.916+0000 7f8eecea2640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55c2cbb3e4d0 0x55c2cbb3e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36456/0 (socket says 172.21.15.192:36456) 2024-09-10T05:11:50.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.916+0000 7f8eec6a1640 1 -- 172.21.15.192:0/3522558555 learned_addr learned my addr 172.21.15.192:0/3522558555 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.916+0000 7f8eec6a1640 1 -- 172.21.15.192:0/3522558555 >> v1:172.21.15.139:6789/0 conn(0x55c2cbb3e4d0 legacy=0x55c2cbb3e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.916+0000 7f8eebea0640 1 -- 172.21.15.192:0/3522558555 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2236312350 0 0) 0x55c2cb9e9e40 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.916+0000 7f8eec6a1640 1 -- 172.21.15.192:0/3522558555 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2cb9d06b0 con 0x55c2cbb3fff0 2024-09-10T05:11:50.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.918+0000 7f8eec6a1640 1 --2- 172.21.15.192:0/3522558555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3fff0 0x55c2cbb48b10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400a520 tx=0x7f8ed4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b372bee597f29b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.918+0000 7f8eebea0640 1 -- 172.21.15.192:0/3522558555 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed4055070 con 0x55c2cbb3fff0 2024-09-10T05:11:50.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.918+0000 7f8eebea0640 1 -- 172.21.15.192:0/3522558555 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed40515b0 con 0x55c2cbb3fff0 2024-09-10T05:11:50.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.918+0000 7f8eebea0640 1 -- 172.21.15.192:0/3522558555 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed40518d0 con 0x55c2cbb3fff0 2024-09-10T05:11:50.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.918+0000 7f8ef111f800 1 -- 172.21.15.192:0/3522558555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3fff0 msgr2=0x55c2cbb48b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.918+0000 7f8ef111f800 1 --2- 172.21.15.192:0/3522558555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3fff0 0x55c2cbb48b10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400a520 tx=0x7f8ed4045ba0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.918+0000 7f8ef111f800 1 -- 172.21.15.192:0/3522558555 shutdown_connections 2024-09-10T05:11:50.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.918+0000 7f8ef111f800 1 --2- 172.21.15.192:0/3522558555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3fff0 0x55c2cbb48b10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.918+0000 7f8ef111f800 1 -- 172.21.15.192:0/3522558555 >> 172.21.15.192:0/3522558555 conn(0x55c2cbb3a1c0 msgr2=0x55c2cbb3c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.918+0000 7f8ef111f800 1 -- 172.21.15.192:0/3522558555 shutdown_connections 2024-09-10T05:11:50.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.918+0000 7f8ef111f800 1 -- 172.21.15.192:0/3522558555 wait complete. 2024-09-10T05:11:50.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.932+0000 7f8ef111f800 1 Processor -- start 2024-09-10T05:11:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.932+0000 7f8ef111f800 1 -- start start 2024-09-10T05:11:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.932+0000 7f8ef111f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 0x55c2cbc31600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.932+0000 7f8ef111f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c2cb9d8dd0 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.932+0000 7f8eecea2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 0x55c2cbc31600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.932+0000 7f8eecea2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 0x55c2cbc31600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60854/0 (socket says 172.21.15.192:60854) 2024-09-10T05:11:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.932+0000 7f8eecea2640 1 -- 172.21.15.192:0/1363286428 learned_addr learned my addr 172.21.15.192:0/1363286428 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.933+0000 7f8eecea2640 1 -- 172.21.15.192:0/1363286428 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2cb9f1e10 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.933+0000 7f8eecea2640 1 --2- 172.21.15.192:0/1363286428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 0x55c2cbc31600 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8edc006fa0 tx=0x7f8edc001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb5e30b3dc2e601 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.933+0000 7f8ddae0d640 1 -- 172.21.15.192:0/1363286428 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8edc003450 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.933+0000 7f8ddae0d640 1 -- 172.21.15.192:0/1363286428 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8edc003610 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.933+0000 7f8ddae0d640 1 -- 172.21.15.192:0/1363286428 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8edc003970 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8ef111f800 1 -- 172.21.15.192:0/1363286428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 msgr2=0x55c2cbc31600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8ef111f800 1 --2- 172.21.15.192:0/1363286428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 0x55c2cbc31600 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8edc006fa0 tx=0x7f8edc001b00 comp rx=0 tx=0).stop 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8ef111f800 1 -- 172.21.15.192:0/1363286428 shutdown_connections 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8ef111f800 1 --2- 172.21.15.192:0/1363286428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 0x55c2cbc31600 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8ef111f800 1 -- 172.21.15.192:0/1363286428 >> 172.21.15.192:0/1363286428 conn(0x55c2cbb3a1c0 msgr2=0x55c2cbc2cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8ef111f800 1 -- 172.21.15.192:0/1363286428 shutdown_connections 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8ef111f800 1 -- 172.21.15.192:0/1363286428 wait complete. 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8ef111f800 1 Processor -- start 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8ef111f800 1 -- start start 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8ef111f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 0x55c2cbc38f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8ef111f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c2cbb49350 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8eecea2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 0x55c2cbc38f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8eecea2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 0x55c2cbc38f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60858/0 (socket says 172.21.15.192:60858) 2024-09-10T05:11:50.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.934+0000 7f8eecea2640 1 -- 172.21.15.192:0/2266788359 learned_addr learned my addr 172.21.15.192:0/2266788359 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.935+0000 7f8eecea2640 1 -- 172.21.15.192:0/2266788359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2cbc394e0 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.935+0000 7f8eecea2640 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 0x55c2cbc38f80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8edc001330 tx=0x7f8edc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.935+0000 7f8dd960a640 1 -- 172.21.15.192:0/2266788359 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8edc014a10 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.935+0000 7f8dd960a640 1 -- 172.21.15.192:0/2266788359 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8edc014bb0 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.935+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2cbc39770 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.935+0000 7f8dd960a640 1 -- 172.21.15.192:0/2266788359 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8edc01e3f0 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.935+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2cbc3a170 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.936+0000 7f8dd960a640 1 -- 172.21.15.192:0/2266788359 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8edc010070 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.936+0000 7f8dd960a640 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8dd403c780 0x7f8dd403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.936+0000 7f8dd960a640 1 -- 172.21.15.192:0/2266788359 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f8edc018070 con 0x55c2cbb3e4d0 2024-09-10T05:11:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.936+0000 7f8eec6a1640 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8dd403c780 0x7f8dd403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.936+0000 7f8ef111f800 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c2cbb3fff0 0x55c2cbc405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.936+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc40b10 con 0x55c2cbb3fff0 2024-09-10T05:11:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.936+0000 7f8eed6a3640 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c2cbb3fff0 0x55c2cbc405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.937+0000 7f8eec6a1640 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8dd403c780 0x7f8dd403ec40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4057000 tx=0x7f8ed4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.937+0000 7f8eed6a3640 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c2cbb3fff0 0x55c2cbc405d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.937+0000 7f8eed6a3640 1 -- 172.21.15.192:0/2266788359 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ee40083e0 con 0x55c2cbb3fff0 2024-09-10T05:11:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.937+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc40eb0 con 0x55c2cbb3fff0 2024-09-10T05:11:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.937+0000 7f8eed6a3640 1 -- 172.21.15.192:0/2266788359 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ee40083e0 con 0x55c2cbb3fff0 2024-09-10T05:11:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.937+0000 7f8ef111f800 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c2cbc42970 0x55c2cbc44de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.937+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc45570 con 0x55c2cbc42970 2024-09-10T05:11:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.937+0000 7f8eecea2640 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c2cbc42970 0x55c2cbc44de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.938+0000 7f8eecea2640 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c2cbc42970 0x55c2cbc44de0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.938+0000 7f8eecea2640 1 -- 172.21.15.192:0/2266788359 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8edc01b070 con 0x55c2cbc42970 2024-09-10T05:11:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.938+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc41700 con 0x55c2cbb3fff0 2024-09-10T05:11:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.938+0000 7f8eed6a3640 1 -- 172.21.15.192:0/2266788359 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ee40083e0 con 0x55c2cbb3fff0 2024-09-10T05:11:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.938+0000 7f8ef111f800 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c2cbc469d0 0x55c2cbc48dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.938+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc49530 con 0x55c2cbc469d0 2024-09-10T05:11:50.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.938+0000 7f8eec6a1640 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c2cbc469d0 0x55c2cbc48dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.939+0000 7f8eec6a1640 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c2cbc469d0 0x55c2cbc48dc0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.939+0000 7f8eec6a1640 1 -- 172.21.15.192:0/2266788359 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc469d0 2024-09-10T05:11:50.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.939+0000 7f8ef111f800 1 Processor -- start 2024-09-10T05:11:50.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.939+0000 7f8ef111f800 1 -- start start 2024-09-10T05:11:50.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.940+0000 7f8ef111f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc571a0 0x55c2cbc575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.940+0000 7f8ef111f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c2cba36a00 con 0x55c2cbc571a0 2024-09-10T05:11:50.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.940+0000 7f8eecea2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc571a0 0x55c2cbc575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.940+0000 7f8eecea2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc571a0 0x55c2cbc575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60868/0 (socket says 172.21.15.192:60868) 2024-09-10T05:11:50.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.940+0000 7f8eecea2640 1 -- 172.21.15.192:0/3804634808 learned_addr learned my addr 172.21.15.192:0/3804634808 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.940+0000 7f8eecea2640 1 -- 172.21.15.192:0/3804634808 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2cbc57c00 con 0x55c2cbc571a0 2024-09-10T05:11:50.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.940+0000 7f8eecea2640 1 --2- 172.21.15.192:0/3804634808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc571a0 0x55c2cbc575c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8edc010d60 tx=0x7f8edc010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.941+0000 7f8dd27fc640 1 -- 172.21.15.192:0/3804634808 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8edc037070 con 0x55c2cbc571a0 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.941+0000 7f8dd27fc640 1 -- 172.21.15.192:0/3804634808 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8edc04b110 con 0x55c2cbc571a0 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.941+0000 7f8ef111f800 1 -- 172.21.15.192:0/3804634808 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2cbc58430 con 0x55c2cbc571a0 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.941+0000 7f8dd27fc640 1 -- 172.21.15.192:0/3804634808 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8edc04b3f0 con 0x55c2cbc571a0 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.941+0000 7f8ef111f800 1 -- 172.21.15.192:0/3804634808 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2cbc589d0 con 0x55c2cbc571a0 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.942+0000 7f8dd27fc640 1 -- 172.21.15.192:0/3804634808 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8edc03a070 con 0x55c2cbc571a0 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.942+0000 7f8dd27fc640 1 --2- 172.21.15.192:0/3804634808 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8dc403c780 0x7f8dc403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.942+0000 7f8dd27fc640 1 -- 172.21.15.192:0/3804634808 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f8edc02a000 con 0x55c2cbc571a0 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.942+0000 7f8eec6a1640 1 --2- 172.21.15.192:0/3804634808 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8dc403c780 0x7f8dc403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.942+0000 7f8ef111f800 1 Processor -- start 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.942+0000 7f8eec6a1640 1 --2- 172.21.15.192:0/3804634808 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8dc403c780 0x7f8dc403ec40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55c2cbc3b0a0 tx=0x7f8ed4005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.942+0000 7f8ef111f800 1 -- start start 2024-09-10T05:11:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.942+0000 7f8ef111f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 0x55c2cbc64080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.942+0000 7f8ef111f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c2cbc31e50 con 0x55c2cbc63c80 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.943+0000 7f8eecea2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 0x55c2cbc64080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.943+0000 7f8eecea2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 0x55c2cbc64080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60884/0 (socket says 172.21.15.192:60884) 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.943+0000 7f8eecea2640 1 -- 172.21.15.192:0/2209396247 learned_addr learned my addr 172.21.15.192:0/2209396247 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.943+0000 7f8eecea2640 1 -- 172.21.15.192:0/2209396247 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2cbc64670 con 0x55c2cbc63c80 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.943+0000 7f8eecea2640 1 --2- 172.21.15.192:0/2209396247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 0x55c2cbc64080 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8edc04b5f0 tx=0x7f8edc053550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae3c32e32ba55e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.943+0000 7f8dc3fff640 1 -- 172.21.15.192:0/2209396247 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8edc062070 con 0x55c2cbc63c80 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.943+0000 7f8dc3fff640 1 -- 172.21.15.192:0/2209396247 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8edc0113e0 con 0x55c2cbc63c80 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.943+0000 7f8dc3fff640 1 -- 172.21.15.192:0/2209396247 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8edc011770 con 0x55c2cbc63c80 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.943+0000 7f8ef111f800 1 -- 172.21.15.192:0/2209396247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 msgr2=0x55c2cbc64080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8ef111f800 1 --2- 172.21.15.192:0/2209396247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 0x55c2cbc64080 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8edc04b5f0 tx=0x7f8edc053550 comp rx=0 tx=0).stop 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8ef111f800 1 -- 172.21.15.192:0/2209396247 shutdown_connections 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8ef111f800 1 --2- 172.21.15.192:0/2209396247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 0x55c2cbc64080 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8ef111f800 1 -- 172.21.15.192:0/2209396247 >> 172.21.15.192:0/2209396247 conn(0x55c2cbc60080 msgr2=0x55c2cbc5e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8ef111f800 1 -- 172.21.15.192:0/2209396247 shutdown_connections 2024-09-10T05:11:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8ef111f800 1 -- 172.21.15.192:0/2209396247 wait complete. 2024-09-10T05:11:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8ef111f800 1 Processor -- start 2024-09-10T05:11:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8ef111f800 1 -- start start 2024-09-10T05:11:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8ef111f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 0x55c2cbc6b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8ef111f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c2cbc64ae0 con 0x55c2cbc63c80 2024-09-10T05:11:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8eecea2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 0x55c2cbc6b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8eecea2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 0x55c2cbc6b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60886/0 (socket says 172.21.15.192:60886) 2024-09-10T05:11:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 learned_addr learned my addr 172.21.15.192:0/1431085780 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:50.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.944+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2cbc6b620 con 0x55c2cbc63c80 2024-09-10T05:11:50.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.945+0000 7f8eecea2640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 0x55c2cbc6b0c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8edc0128e0 tx=0x7f8edc04df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.945+0000 7f8dc27fc640 1 -- 172.21.15.192:0/1431085780 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8edc062040 con 0x55c2cbc63c80 2024-09-10T05:11:50.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.945+0000 7f8dc27fc640 1 -- 172.21.15.192:0/1431085780 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8edc053a00 con 0x55c2cbc63c80 2024-09-10T05:11:50.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.945+0000 7f8dc27fc640 1 -- 172.21.15.192:0/1431085780 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8edc01d8a0 con 0x55c2cbc63c80 2024-09-10T05:11:50.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.945+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2cbc6b620 con 0x55c2cbc63c80 2024-09-10T05:11:50.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.945+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2cbc6b620 con 0x55c2cbc63c80 2024-09-10T05:11:50.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.946+0000 7f8dc27fc640 1 -- 172.21.15.192:0/1431085780 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8edc05c040 con 0x55c2cbc63c80 2024-09-10T05:11:50.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.946+0000 7f8dc27fc640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8db803c730 0x7f8db803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.946+0000 7f8dc27fc640 1 -- 172.21.15.192:0/1431085780 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f8edc059040 con 0x55c2cbc63c80 2024-09-10T05:11:50.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.946+0000 7f8eec6a1640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8db803c730 0x7f8db803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.946+0000 7f8eec6a1640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8db803c730 0x7f8db803ebf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4077040 tx=0x7f8ed4053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8ef111f800 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c2cbc76500 0x55c2cbc789c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79110 con 0x55c2cbc76500 2024-09-10T05:11:50.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8eed6a3640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c2cbc76500 0x55c2cbc789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8eed6a3640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c2cbc76500 0x55c2cbc789c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ee40083e0 con 0x55c2cbc76500 2024-09-10T05:11:50.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8ef111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8ef111f800 20 realm 2024-09-10T05:11:50.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79520 con 0x55c2cbc76500 2024-09-10T05:11:50.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ee40083e0 con 0x55c2cbc76500 2024-09-10T05:11:50.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8ef111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8ef111f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:50.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.947+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc76500 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.948+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ee40083e0 con 0x55c2cbc76500 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.948+0000 7f8ef111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.948+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.948+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc7a190 con 0x55c2cbc76500 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.948+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ee40083e0 con 0x55c2cbc76500 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.948+0000 7f8ef111f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.948+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.948+0000 7f8ef111f800 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c2cbc7ab50 0x55c2cbc7cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.948+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc7d510 con 0x55c2cbc7ab50 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.948+0000 7f8eecea2640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c2cbc7ab50 0x55c2cbc7cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.949+0000 7f8eecea2640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c2cbc7ab50 0x55c2cbc7cf40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.949+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.949+0000 7f8ef111f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:50.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.949+0000 7f8ef111f800 20 searching for the correct realm 2024-09-10T05:11:50.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.949+0000 7f8ef111f800 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c2cbc7f4e0 0x55c2cbc819a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.949+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc82020 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.949+0000 7f8eec6a1640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c2cbc7f4e0 0x55c2cbc819a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.949+0000 7f8eec6a1640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c2cbc7f4e0 0x55c2cbc819a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.950+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.950+0000 7f8eec6a1640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f8ed4069040 0x7f8ed406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:50.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.950+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc82020 con 0x7f8ed4069040 2024-09-10T05:11:50.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.950+0000 7f8eed6a3640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f8ed4069040 0x7f8ed406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:50.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.950+0000 7f8eed6a3640 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f8ed4069040 0x7f8ed406a940 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:50.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.950+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8ee40083e0 con 0x7f8ed4069040 2024-09-10T05:11:50.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.950+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.951+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.951+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc76500 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.951+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ee40083e0 con 0x55c2cbc76500 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.951+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc76500 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.951+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.951+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.951+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.951+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.952+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.952+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x7f8ed4069040 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.952+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.952+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.952+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.952+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc76500 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.952+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.952+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.953+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.953+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc76500 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.953+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.953+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x7f8ed4069040 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.953+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.953+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.953+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.953+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.953+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.953+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.954+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.954+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.954+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.954+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.954+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.954+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc76500 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.954+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.954+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc76500 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.955+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.955+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.955+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.955+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.955+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.955+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x7f8ed4069040 2024-09-10T05:11:50.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.955+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.955+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc76500 2024-09-10T05:11:50.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.955+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.956+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.956+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.956+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.956+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.956+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.956+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.956+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x7f8ed4069040 2024-09-10T05:11:50.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.957+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.957+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.957+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.957+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.957+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.957+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x55c2cbc76500 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.957+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.957+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc79df0 con 0x7f8ed4069040 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:50.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc7ddd0 con 0x55c2cbc76500 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc7ddd0 con 0x55c2cbc76500 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.958+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc7ddd0 con 0x7f8ed4069040 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 20 zone default found 2024-09-10T05:11:50.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 4 Realm: () 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 20 zonegroup default 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc7e220 con 0x55c2cbc7ab50 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc83e90 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc84230 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 20 started sync module instance, tier type = 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.959+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc83330 con 0x7f8ed4069040 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.960+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.960+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94295130912544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc83330 con 0x7f8ed4069040 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.960+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc84ac0 con 0x55c2cbc76500 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.961+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94295130912544] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.962+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.962+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94295130916304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc83330 con 0x55c2cbc76500 2024-09-10T05:11:50.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.962+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc85540 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.963+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94295130916304] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.963+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.963+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94295130910336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc832a0 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.963+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc86320 con 0x7f8ed4069040 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.964+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.964+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94295130910336] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.964+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94295130921312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc86710 con 0x7f8ed4069040 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.964+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc87110 con 0x55c2cbc76500 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.965+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94295130921312] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.965+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.965+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94295130922368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc870d0 con 0x55c2cbc76500 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.965+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc87b20 con 0x55c2cbc7ab50 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.966+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.966+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94295130922368] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.966+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94295130928752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc883c0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.966+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc86c60 con 0x55c2cbc7ab50 2024-09-10T05:11:50.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.967+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.967+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94295130926176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc88db0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.967+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc89850 con 0x55c2cbc7ab50 2024-09-10T05:11:50.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.967+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94295130928752] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.968+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.968+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94295130936096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc89810 con 0x55c2cbc7ab50 2024-09-10T05:11:50.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.968+0000 7f8ef111f800 20 add_watcher() i=0 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.968+0000 7f8ef111f800 20 add_watcher() i=1 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.968+0000 7f8ef111f800 20 add_watcher() i=2 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.968+0000 7f8ef111f800 20 add_watcher() i=3 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.968+0000 7f8ef111f800 20 add_watcher() i=4 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.968+0000 7f8ef111f800 20 add_watcher() i=5 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.968+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94295130926176] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.968+0000 7f8ef111f800 20 add_watcher() i=6 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.969+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94295130936096] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.969+0000 7f8ef111f800 20 add_watcher() i=7 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.969+0000 7f8ef111f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.969+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc88900 con 0x55c2cbc76500 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.969+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.969+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94295130930880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbc88900 con 0x55c2cbc76500 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.970+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94295130930880] v35'123 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.970+0000 7f8da37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.970+0000 7f8ef111f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.970+0000 7f8ef111f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.970+0000 7f8ef111f800 5 note: GC not initialized 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8da27e4640 20 reqs_thread_entry: start 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8ef111f800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8ef111f800 20 Filter name: none 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8d9bfff640 20 reqs_thread_entry: start 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8ef111f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcbf8d0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8ef111f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8ef111f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8ef111f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8ef111f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8ef111f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.971+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcc1860 con 0x7f8ed4069040 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 : miss 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcc3230 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.972+0000 7f8ef111f800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.973+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcc4b30 con 0x55c2cbc7ab50 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.973+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(65 fud.buckets [call] v35'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.974+0000 7f8ef111f800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.974+0000 7f8ef111f800 20 rados->read ofs=0 len=0 2024-09-10T05:11:50.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.974+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcc4f60 con 0x7f8ed4069040 2024-09-10T05:11:50.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.974+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.974+0000 7f8ef111f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:50.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.974+0000 7f8ef111f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-10T05:11:50.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.974+0000 7f8ef111f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:50.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.974+0000 7f8ef111f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:50.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.974+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbccab60 con 0x7f8ed4069040 2024-09-10T05:11:50.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.975+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v35'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.975+0000 7f8ef111f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T05:11:50.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.975+0000 7f8ef111f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:50.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.975+0000 7f8ef111f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:11:50.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.975+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94295131186800 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcc7f50 con 0x55c2cbc7ab50 2024-09-10T05:11:50.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.976+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== watch-notify(notify (1) cookie 94295130926176 notify 150323855370 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55c2cbc589d0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.976+0000 7f8dc3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855370 cookie 94295130926176 notifier 4525 bl.length()=338 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.976+0000 7f8dc3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.976+0000 7f8dc3fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.976+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(68 notify.6 [notify cookie 94295131186800 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.976+0000 7f8dc3fff640 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f8db0003ea0 con 0x55c2cbc7ab50 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.976+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.976+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== watch-notify(notify_complete (2) cookie 94295131186800 notify 150323855370 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c2cbc58430 con 0x55c2cbc7ab50 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.977+0000 7f8da37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.977+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94295130930880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcbd730 con 0x55c2cbc76500 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.978+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94295130930880] v35'124 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.978+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94295130912544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcbd730 con 0x7f8ed4069040 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.978+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94295130912544] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.979+0000 7f8ef111f800 20 remove_watcher() i=0 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.979+0000 7f8ef111f800 2 removed watcher, disabling cache 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.979+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94295130916304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcbd730 con 0x55c2cbc76500 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.979+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94295130916304] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.980+0000 7f8ef111f800 20 remove_watcher() i=1 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.980+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94295130910336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcbd730 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.980+0000 7f8eec6a1640 1 -- 172.21.15.192:0/1431085780 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94295130910336] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ed4057030 con 0x55c2cbc7f4e0 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.980+0000 7f8ef111f800 20 remove_watcher() i=2 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.980+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94295130921312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcbd730 con 0x7f8ed4069040 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.981+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94295130921312] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x7f8ed4069040 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.981+0000 7f8ef111f800 20 remove_watcher() i=3 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.981+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94295130922368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcbd730 con 0x55c2cbc76500 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.982+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94295130922368] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ee4026040 con 0x55c2cbc76500 2024-09-10T05:11:50.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.982+0000 7f8ef111f800 20 remove_watcher() i=4 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.982+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94295130928752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcbd730 con 0x55c2cbc7ab50 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.983+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94295130928752] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.983+0000 7f8ef111f800 20 remove_watcher() i=5 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.983+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94295130926176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcbd730 con 0x55c2cbc7ab50 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.984+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94295130926176] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.984+0000 7f8ef111f800 20 remove_watcher() i=6 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.984+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94295130936096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c2cbcbd730 con 0x55c2cbc7ab50 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.985+0000 7f8eecea2640 1 -- 172.21.15.192:0/1431085780 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94295130936096] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8edc064070 con 0x55c2cbc7ab50 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.985+0000 7f8ef111f800 20 remove_watcher() i=7 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.985+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c2cbc7ab50 msgr2=0x55c2cbc7cf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.985+0000 7f8ef111f800 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c2cbc7ab50 0x55c2cbc7cf40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.985+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c2cbc76500 msgr2=0x55c2cbc789c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.985+0000 7f8ef111f800 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c2cbc76500 0x55c2cbc789c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:50.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.985+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f8ed4069040 msgr2=0x7f8ed406a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.985+0000 7f8ef111f800 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f8ed4069040 0x7f8ed406a940 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.985+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c2cbc7f4e0 msgr2=0x55c2cbc819a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.985+0000 7f8ef111f800 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c2cbc7f4e0 0x55c2cbc819a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8db803c730 msgr2=0x7f8db803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8db803c730 0x7f8db803ebf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4077040 tx=0x7f8ed4053000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 msgr2=0x55c2cbc6b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 --2- 172.21.15.192:0/1431085780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc63c80 0x55c2cbc6b0c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8edc0128e0 tx=0x7f8edc04df50 comp rx=0 tx=0).stop 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 reap_dead start 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8eed6a3640 1 -- 172.21.15.192:0/1431085780 reap_dead start 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 shutdown_connections 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 >> 172.21.15.192:0/1431085780 conn(0x55c2cbc60080 msgr2=0x55c2cbc5e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 shutdown_connections 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/1431085780 wait complete. 2024-09-10T05:11:51.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/3804634808 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8dc403c780 msgr2=0x7f8dc403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 --2- 172.21.15.192:0/3804634808 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8dc403c780 0x7f8dc403ec40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55c2cbc3b0a0 tx=0x7f8ed4005ac0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/3804634808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc571a0 msgr2=0x55c2cbc575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 --2- 172.21.15.192:0/3804634808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc571a0 0x55c2cbc575c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8edc010d60 tx=0x7f8edc010ab0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/3804634808 shutdown_connections 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 --2- 172.21.15.192:0/3804634808 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8dc403c780 0x7f8dc403ec40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 --2- 172.21.15.192:0/3804634808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbc571a0 0x55c2cbc575c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/3804634808 >> 172.21.15.192:0/3804634808 conn(0x55c2cbc4b550 msgr2=0x55c2cbc4b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/3804634808 shutdown_connections 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/3804634808 wait complete. 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c2cbc42970 msgr2=0x55c2cbc44de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c2cbc42970 0x55c2cbc44de0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c2cbb3fff0 msgr2=0x55c2cbc405d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c2cbb3fff0 0x55c2cbc405d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c2cbc469d0 msgr2=0x55c2cbc48dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c2cbc469d0 0x55c2cbc48dc0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8dd403c780 msgr2=0x7f8dd403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f8dd403c780 0x7f8dd403ec40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4057000 tx=0x7f8ed4052000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.986+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 msgr2=0x55c2cbc38f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.987+0000 7f8ef111f800 1 --2- 172.21.15.192:0/2266788359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c2cbb3e4d0 0x55c2cbc38f80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8edc001330 tx=0x7f8edc001250 comp rx=0 tx=0).stop 2024-09-10T05:11:51.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.987+0000 7f8eed6a3640 1 -- 172.21.15.192:0/2266788359 reap_dead start 2024-09-10T05:11:51.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.987+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 shutdown_connections 2024-09-10T05:11:51.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.987+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 >> 172.21.15.192:0/2266788359 conn(0x55c2cbb3a1c0 msgr2=0x55c2cbc328e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.987+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 shutdown_connections 2024-09-10T05:11:51.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:50.987+0000 7f8ef111f800 1 -- 172.21.15.192:0/2266788359 wait complete. 2024-09-10T05:11:51.003 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1'] 2024-09-10T05:11:51.004 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1'] 2024-09-10T05:11:51.004 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 2024-09-10T05:11:51.052 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:51.053 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:51.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.052+0000 7fef99e13800 1 Processor -- start 2024-09-10T05:11:51.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.052+0000 7fef99e13800 1 -- start start 2024-09-10T05:11:51.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.052+0000 7fef99e13800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55bbe5e834c0 0x55bbe5e838c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.052+0000 7fef99e13800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bbe5d2ee40 con 0x55bbe5e83e00 2024-09-10T05:11:51.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.052+0000 7fef99e13800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55bbe5cf9680 con 0x55bbe5e834c0 2024-09-10T05:11:51.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.053+0000 7fef95548640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55bbe5e834c0 0x55bbe5e838c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.053+0000 7fef95548640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55bbe5e834c0 0x55bbe5e838c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60898/0 (socket says 172.21.15.192:60898) 2024-09-10T05:11:51.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.053+0000 7fef95548640 1 -- 172.21.15.192:0/3139328744 learned_addr learned my addr 172.21.15.192:0/3139328744 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.053+0000 7fef8cd47640 1 --1- 172.21.15.192:0/3139328744 >> v1:172.21.15.139:6789/0 conn(0x55bbe5e83e00 0x55bbe5e842b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36466/0 (socket says 172.21.15.192:36466) 2024-09-10T05:11:51.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.053+0000 7fef95548640 1 -- 172.21.15.192:0/3139328744 >> v1:172.21.15.139:6789/0 conn(0x55bbe5e83e00 legacy=0x55bbe5e842b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.053+0000 7fef94d47640 1 -- 172.21.15.192:0/3139328744 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3752674462 0 0) 0x55bbe5d2ee40 con 0x55bbe5e83e00 2024-09-10T05:11:51.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.053+0000 7fef95548640 1 -- 172.21.15.192:0/3139328744 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe5d156b0 con 0x55bbe5e834c0 2024-09-10T05:11:51.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.055+0000 7fef95548640 1 --2- 172.21.15.192:0/3139328744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5e838c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fef8800a520 tx=0x7fef88045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47617d360542236d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.055+0000 7fef94d47640 1 -- 172.21.15.192:0/3139328744 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef88055070 con 0x55bbe5e834c0 2024-09-10T05:11:51.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.055+0000 7fef94d47640 1 -- 172.21.15.192:0/3139328744 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef880515b0 con 0x55bbe5e834c0 2024-09-10T05:11:51.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.055+0000 7fef94d47640 1 -- 172.21.15.192:0/3139328744 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef880518d0 con 0x55bbe5e834c0 2024-09-10T05:11:51.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.055+0000 7fef99e13800 1 -- 172.21.15.192:0/3139328744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 msgr2=0x55bbe5e838c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.055+0000 7fef99e13800 1 --2- 172.21.15.192:0/3139328744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5e838c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fef8800a520 tx=0x7fef88045ba0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.055+0000 7fef99e13800 1 -- 172.21.15.192:0/3139328744 shutdown_connections 2024-09-10T05:11:51.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.055+0000 7fef99e13800 1 --2- 172.21.15.192:0/3139328744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5e838c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.055+0000 7fef99e13800 1 -- 172.21.15.192:0/3139328744 >> 172.21.15.192:0/3139328744 conn(0x55bbe5e7f210 msgr2=0x55bbe5e81650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.055+0000 7fef99e13800 1 -- 172.21.15.192:0/3139328744 shutdown_connections 2024-09-10T05:11:51.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.055+0000 7fef99e13800 1 -- 172.21.15.192:0/3139328744 wait complete. 2024-09-10T05:11:51.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.069+0000 7fef99e13800 1 Processor -- start 2024-09-10T05:11:51.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.069+0000 7fef99e13800 1 -- start start 2024-09-10T05:11:51.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.069+0000 7fef99e13800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5f76710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.069+0000 7fef99e13800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bbe5d1ddd0 con 0x55bbe5e834c0 2024-09-10T05:11:51.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.070+0000 7fef95548640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5f76710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.070+0000 7fef95548640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5f76710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60902/0 (socket says 172.21.15.192:60902) 2024-09-10T05:11:51.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.070+0000 7fef95548640 1 -- 172.21.15.192:0/3810903954 learned_addr learned my addr 172.21.15.192:0/3810903954 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.070+0000 7fef95548640 1 -- 172.21.15.192:0/3810903954 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe5d36e10 con 0x55bbe5e834c0 2024-09-10T05:11:51.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.070+0000 7fef95548640 1 --2- 172.21.15.192:0/3810903954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5f76710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fef88045be0 tx=0x7fef88051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ae6fac539297bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.070+0000 7fee83606640 1 -- 172.21.15.192:0/3810903954 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef88051ac0 con 0x55bbe5e834c0 2024-09-10T05:11:51.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.070+0000 7fee83606640 1 -- 172.21.15.192:0/3810903954 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef88051c60 con 0x55bbe5e834c0 2024-09-10T05:11:51.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.070+0000 7fee83606640 1 -- 172.21.15.192:0/3810903954 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef88066460 con 0x55bbe5e834c0 2024-09-10T05:11:51.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.071+0000 7fef99e13800 1 -- 172.21.15.192:0/3810903954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 msgr2=0x55bbe5f76710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.071+0000 7fef99e13800 1 --2- 172.21.15.192:0/3810903954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5f76710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fef88045be0 tx=0x7fef88051000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.071+0000 7fef99e13800 1 -- 172.21.15.192:0/3810903954 shutdown_connections 2024-09-10T05:11:51.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.071+0000 7fef99e13800 1 --2- 172.21.15.192:0/3810903954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5f76710 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.071+0000 7fef99e13800 1 -- 172.21.15.192:0/3810903954 >> 172.21.15.192:0/3810903954 conn(0x55bbe5e7f210 msgr2=0x55bbe5f72090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.071+0000 7fef99e13800 1 -- 172.21.15.192:0/3810903954 shutdown_connections 2024-09-10T05:11:51.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.071+0000 7fef99e13800 1 -- 172.21.15.192:0/3810903954 wait complete. 2024-09-10T05:11:51.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.071+0000 7fef99e13800 1 Processor -- start 2024-09-10T05:11:51.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.071+0000 7fef99e13800 1 -- start start 2024-09-10T05:11:51.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.072+0000 7fef99e13800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5f7e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.072+0000 7fef99e13800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bbe5e84d80 con 0x55bbe5e834c0 2024-09-10T05:11:51.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.072+0000 7fef95548640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5f7e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.072+0000 7fef95548640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5f7e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60910/0 (socket says 172.21.15.192:60910) 2024-09-10T05:11:51.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.072+0000 7fef95548640 1 -- 172.21.15.192:0/2134759379 learned_addr learned my addr 172.21.15.192:0/2134759379 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.072+0000 7fef95548640 1 -- 172.21.15.192:0/2134759379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe5f7e590 con 0x55bbe5e834c0 2024-09-10T05:11:51.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.072+0000 7fef95548640 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5f7e030 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fef88045be0 tx=0x7fef88003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.072+0000 7fee81e03640 1 -- 172.21.15.192:0/2134759379 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8805a600 con 0x55bbe5e834c0 2024-09-10T05:11:51.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.072+0000 7fee81e03640 1 -- 172.21.15.192:0/2134759379 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef8805a7a0 con 0x55bbe5e834c0 2024-09-10T05:11:51.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.072+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bbe5f7e820 con 0x55bbe5e834c0 2024-09-10T05:11:51.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.072+0000 7fee81e03640 1 -- 172.21.15.192:0/2134759379 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8805aa80 con 0x55bbe5e834c0 2024-09-10T05:11:51.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.072+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe5f7f220 con 0x55bbe5e834c0 2024-09-10T05:11:51.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.073+0000 7fee81e03640 1 -- 172.21.15.192:0/2134759379 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fef88058070 con 0x55bbe5e834c0 2024-09-10T05:11:51.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.073+0000 7fee81e03640 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee7c03c780 0x7fee7c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.073+0000 7fee81e03640 1 -- 172.21.15.192:0/2134759379 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fef88062070 con 0x55bbe5e834c0 2024-09-10T05:11:51.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.073+0000 7fef8cd47640 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee7c03c780 0x7fee7c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.074+0000 7fef99e13800 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55bbe5e83e00 0x55bbe5f85680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.074+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5f85bc0 con 0x55bbe5e83e00 2024-09-10T05:11:51.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.074+0000 7fef95d49640 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55bbe5e83e00 0x55bbe5f85680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.074+0000 7fef8cd47640 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee7c03c780 0x7fee7c03ec40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef80000c00 tx=0x7fef800013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.074+0000 7fef95d49640 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55bbe5e83e00 0x55bbe5f85680 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.074+0000 7fef95d49640 1 -- 172.21.15.192:0/2134759379 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5e83e00 2024-09-10T05:11:51.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.074+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5f85f60 con 0x55bbe5e83e00 2024-09-10T05:11:51.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.075+0000 7fef95d49640 1 -- 172.21.15.192:0/2134759379 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5e83e00 2024-09-10T05:11:51.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.075+0000 7fef99e13800 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55bbe5f87a20 0x55bbe5f89ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.075+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5f8a650 con 0x55bbe5f87a20 2024-09-10T05:11:51.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.075+0000 7fef95548640 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55bbe5f87a20 0x55bbe5f89ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.075+0000 7fef95548640 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55bbe5f87a20 0x55bbe5f89ec0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.075+0000 7fef95548640 1 -- 172.21.15.192:0/2134759379 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5f87a20 2024-09-10T05:11:51.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.075+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5f867b0 con 0x55bbe5e83e00 2024-09-10T05:11:51.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.076+0000 7fef95d49640 1 -- 172.21.15.192:0/2134759379 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5e83e00 2024-09-10T05:11:51.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.076+0000 7fef99e13800 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55bbe5f8bab0 0x55bbe5f8dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.076+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5f8e5e0 con 0x55bbe5f8bab0 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.076+0000 7fef8cd47640 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55bbe5f8bab0 0x55bbe5f8dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.076+0000 7fef8cd47640 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55bbe5f8bab0 0x55bbe5f8dea0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.076+0000 7fef8cd47640 1 -- 172.21.15.192:0/2134759379 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fef8000f670 con 0x55bbe5f8bab0 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.077+0000 7fef99e13800 1 Processor -- start 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.077+0000 7fef99e13800 1 -- start start 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.077+0000 7fef99e13800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5f9c1a0 0x55bbe5f9c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.077+0000 7fef99e13800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bbe5d7ba00 con 0x55bbe5f9c1a0 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.077+0000 7fef95548640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5f9c1a0 0x55bbe5f9c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.077+0000 7fef95548640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5f9c1a0 0x55bbe5f9c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60924/0 (socket says 172.21.15.192:60924) 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.077+0000 7fef95548640 1 -- 172.21.15.192:0/142819498 learned_addr learned my addr 172.21.15.192:0/142819498 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.077+0000 7fef95548640 1 -- 172.21.15.192:0/142819498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe5f9cc00 con 0x55bbe5f9c1a0 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.078+0000 7fef95548640 1 --2- 172.21.15.192:0/142819498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5f9c1a0 0x55bbe5f9c5c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fef88065b40 tx=0x7fef88065f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.078+0000 7fee7affd640 1 -- 172.21.15.192:0/142819498 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef88094070 con 0x55bbe5f9c1a0 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.078+0000 7fee7affd640 1 -- 172.21.15.192:0/142819498 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef88095e40 con 0x55bbe5f9c1a0 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.078+0000 7fef99e13800 1 -- 172.21.15.192:0/142819498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bbe5f9d430 con 0x55bbe5f9c1a0 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.078+0000 7fee7affd640 1 -- 172.21.15.192:0/142819498 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8807a650 con 0x55bbe5f9c1a0 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.078+0000 7fef99e13800 1 -- 172.21.15.192:0/142819498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe5f9d430 con 0x55bbe5f9c1a0 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.078+0000 7fee7affd640 1 -- 172.21.15.192:0/142819498 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fef8804f070 con 0x55bbe5f9c1a0 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.079+0000 7fee7affd640 1 --2- 172.21.15.192:0/142819498 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee6c03c730 0x7fee6c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.079+0000 7fee7affd640 1 -- 172.21.15.192:0/142819498 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fef8808c070 con 0x55bbe5f9c1a0 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.079+0000 7fef8cd47640 1 --2- 172.21.15.192:0/142819498 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee6c03c730 0x7fee6c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.079+0000 7fef99e13800 1 Processor -- start 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.079+0000 7fef8cd47640 1 --2- 172.21.15.192:0/142819498 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee6c03c730 0x7fee6c03ebf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55bbe5f80130 tx=0x7fef80006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.079+0000 7fef99e13800 1 -- start start 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.079+0000 7fef99e13800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 0x55bbe5fa8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.079+0000 7fef99e13800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bbe5f76ea0 con 0x55bbe5fa8810 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.079+0000 7fef95548640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 0x55bbe5fa8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.079+0000 7fef95548640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 0x55bbe5fa8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60926/0 (socket says 172.21.15.192:60926) 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.079+0000 7fef95548640 1 -- 172.21.15.192:0/2627550172 learned_addr learned my addr 172.21.15.192:0/2627550172 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.080+0000 7fef95548640 1 -- 172.21.15.192:0/2627550172 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe5fa91e0 con 0x55bbe5fa8810 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.080+0000 7fef95548640 1 --2- 172.21.15.192:0/2627550172 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 0x55bbe5fa8bf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fef880658c0 tx=0x7fef880713e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32877f3d7147f768 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.080+0000 7fee78ff9640 1 -- 172.21.15.192:0/2627550172 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef88085cc0 con 0x55bbe5fa8810 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.080+0000 7fee78ff9640 1 -- 172.21.15.192:0/2627550172 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef88085670 con 0x55bbe5fa8810 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.080+0000 7fee78ff9640 1 -- 172.21.15.192:0/2627550172 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef8808eb70 con 0x55bbe5fa8810 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.080+0000 7fef99e13800 1 -- 172.21.15.192:0/2627550172 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 msgr2=0x55bbe5fa8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.080+0000 7fef99e13800 1 --2- 172.21.15.192:0/2627550172 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 0x55bbe5fa8bf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fef880658c0 tx=0x7fef880713e0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.080+0000 7fef99e13800 1 -- 172.21.15.192:0/2627550172 shutdown_connections 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.080+0000 7fef99e13800 1 --2- 172.21.15.192:0/2627550172 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 0x55bbe5fa8bf0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.080+0000 7fef99e13800 1 -- 172.21.15.192:0/2627550172 >> 172.21.15.192:0/2627550172 conn(0x55bbe5fa4c10 msgr2=0x55bbe5fa2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.080+0000 7fef99e13800 1 -- 172.21.15.192:0/2627550172 shutdown_connections 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.080+0000 7fef99e13800 1 -- 172.21.15.192:0/2627550172 wait complete. 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.081+0000 7fef99e13800 1 Processor -- start 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.081+0000 7fef99e13800 1 -- start start 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.081+0000 7fef99e13800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 0x55bbe5fafc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.081+0000 7fef99e13800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bbe5fa9670 con 0x55bbe5fa8810 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.081+0000 7fef95548640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 0x55bbe5fafc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.081+0000 7fef95548640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 0x55bbe5fafc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60930/0 (socket says 172.21.15.192:60930) 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.081+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 learned_addr learned my addr 172.21.15.192:0/2165603511 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.081+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe5fb01b0 con 0x55bbe5fa8810 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.081+0000 7fef95548640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 0x55bbe5fafc50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fef88095650 tx=0x7fef88099f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.082+0000 7fee6affd640 1 -- 172.21.15.192:0/2165603511 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef880b9020 con 0x55bbe5fa8810 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.082+0000 7fee6affd640 1 -- 172.21.15.192:0/2165603511 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef880715a0 con 0x55bbe5fa8810 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.082+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bbe5fb01b0 con 0x55bbe5fa8810 2024-09-10T05:11:51.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.082+0000 7fee6affd640 1 -- 172.21.15.192:0/2165603511 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef88071880 con 0x55bbe5fa8810 2024-09-10T05:11:51.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.082+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe5fb01b0 con 0x55bbe5fa8810 2024-09-10T05:11:51.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.082+0000 7fee6affd640 1 -- 172.21.15.192:0/2165603511 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fef880bc020 con 0x55bbe5fa8810 2024-09-10T05:11:51.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.083+0000 7fee6affd640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee6003c780 0x7fee6003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.083+0000 7fee6affd640 1 -- 172.21.15.192:0/2165603511 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fef880af050 con 0x55bbe5fa8810 2024-09-10T05:11:51.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.083+0000 7fef8cd47640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee6003c780 0x7fee6003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.083+0000 7fef8cd47640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee6003c780 0x7fee6003ec40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef8000ffd0 tx=0x7fef80023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.083+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.083+0000 7fef99e13800 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55bbe5fbb1e0 0x55bbe5fbd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.083+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbddf0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.083+0000 7fef95d49640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55bbe5fbb1e0 0x55bbe5fbd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef95d49640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55bbe5fbb1e0 0x55bbe5fbd6a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef99e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef99e13800 20 realm 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbe200 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef99e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef99e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbead0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef99e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.084+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef99e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef99e13800 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55bbe5fbfbd0 0x55bbe5fc1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc2580 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef95548640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55bbe5fbfbd0 0x55bbe5fc1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef95548640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55bbe5fbfbd0 0x55bbe5fc1fc0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef99e13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef99e13800 20 searching for the correct realm 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef99e13800 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55bbe5fc4530 0x55bbe5fc69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc70c0 con 0x55bbe5fc4530 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.085+0000 7fef8cd47640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55bbe5fc4530 0x55bbe5fc69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.086+0000 7fef8cd47640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55bbe5fc4530 0x55bbe5fc69f0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.086+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.086+0000 7fef8cd47640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fef8002e910 0x7fef8003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.086+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc70c0 con 0x7fef8002e910 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.086+0000 7fef95d49640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fef8002e910 0x7fef8003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.086+0000 7fef95d49640 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fef8002e910 0x7fef8003a3c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.087+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.087+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.087+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.087+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.087+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.087+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.087+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.087+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.088+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.088+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.088+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.088+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x7fef8002e910 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.088+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.088+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fc4530 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.088+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.088+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.088+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.088+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.089+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.089+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.089+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.089+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x7fef8002e910 2024-09-10T05:11:51.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.089+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.089+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fc4530 2024-09-10T05:11:51.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.089+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.089+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fc4530 2024-09-10T05:11:51.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.089+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.089+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.090+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.090+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fc4530 2024-09-10T05:11:51.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.090+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.090+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fc4530 2024-09-10T05:11:51.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.090+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.090+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.090+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.090+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.091+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.091+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.091+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.091+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fc4530 2024-09-10T05:11:51.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.091+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.091+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x7fef8002e910 2024-09-10T05:11:51.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.091+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.091+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.092+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.092+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.092+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.092+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fc4530 2024-09-10T05:11:51.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.092+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.092+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.093+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.093+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x7fef8002e910 2024-09-10T05:11:51.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.093+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.093+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fc4530 2024-09-10T05:11:51.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.093+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.093+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.093+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.093+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fbee70 con 0x7fef8002e910 2024-09-10T05:11:51.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:51.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:51.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:51.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:51.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:51.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:51.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc2e40 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc2e40 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.094+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc2e40 con 0x7fef8002e910 2024-09-10T05:11:51.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:51.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 20 zone default found 2024-09-10T05:11:51.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 4 Realm: () 2024-09-10T05:11:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 20 zonegroup default 2024-09-10T05:11:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc36e0 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc8f30 con 0x55bbe5fc4530 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc92d0 con 0x55bbe5fc4530 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.095+0000 7fef99e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.096+0000 7fef99e13800 20 started sync module instance, tier type = 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.096+0000 7fef99e13800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.096+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc83d0 con 0x7fef8002e910 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.097+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.097+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94265505777872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc83d0 con 0x7fef8002e910 2024-09-10T05:11:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.097+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc9c90 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.097+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94265505777872] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.098+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.098+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94265505775872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc9c90 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.098+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fca6b0 con 0x55bbe5fc4530 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.099+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94265505775872] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.099+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.099+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94265505781728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fc9c00 con 0x55bbe5fc4530 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.099+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fcb570 con 0x7fef8002e910 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.100+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.100+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94265505788608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fcbd30 con 0x7fef8002e910 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.100+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fcc850 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.100+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94265505781728] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.101+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.101+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94265505792800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fcc810 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.101+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fcd260 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.101+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94265505788608] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.102+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94265505792800] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.102+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.102+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94265505786528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fcb780 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.102+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fcdb00 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.103+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.103+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94265505798224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fce2c0 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.103+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fcede0 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.103+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94265505786528] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.104+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94265505798224] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.104+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.104+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94265505802416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fcdd10 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.104+0000 7fef99e13800 20 add_watcher() i=0 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.104+0000 7fef99e13800 20 add_watcher() i=1 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.104+0000 7fef99e13800 20 add_watcher() i=2 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.104+0000 7fef99e13800 20 add_watcher() i=3 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.104+0000 7fef99e13800 20 add_watcher() i=4 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.104+0000 7fef99e13800 20 add_watcher() i=5 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.104+0000 7fef99e13800 20 add_watcher() i=6 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.105+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94265505802416] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.105+0000 7fef99e13800 20 add_watcher() i=7 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.105+0000 7fef99e13800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.105+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fd1dd0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.105+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.105+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94265505795504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe5fcf280 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.106+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94265505795504] v35'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.106+0000 7fee4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:51.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.106+0000 7fef99e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:51.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.106+0000 7fef99e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:51.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.106+0000 7fef99e13800 5 note: GC not initialized 2024-09-10T05:11:51.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.106+0000 7fee4a7e4640 20 reqs_thread_entry: start 2024-09-10T05:11:51.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef99e13800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef99e13800 20 Filter name: none 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fedbbfff640 20 reqs_thread_entry: start 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef99e13800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe6004da0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fef9000a4d0 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef99e13800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef99e13800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef99e13800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef99e13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef99e13800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.107+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe6006d30 con 0x7fef8002e910 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 : miss 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe60085b0 con 0x55bbe5fc4530 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:51.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.108+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d110 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.109+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(65 fud.buckets [call] v35'5 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.109+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe6012e30 con 0x55bbe5fc4530 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.110+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(66 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v35'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.110+0000 7fef99e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.110+0000 7fef99e13800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.110+0000 7fef99e13800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.110+0000 7fef99e13800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1, ofs0, ns] 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.110+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94265506040944 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d9f0 con 0x7fef8002e910 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== watch-notify(notify (1) cookie 94265505788608 notify 150323855374 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7fef90045430 con 0x7fef8002e910 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fee78ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855374 cookie 94265505788608 notifier 4532 bl.length()=760 2024-09-10T05:11:51.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fee78ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fee78ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fee78ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.3 [notify cookie 94265506040944 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fee78ff9640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fee58003ea0 con 0x7fef8002e910 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== watch-notify(notify_complete (2) cookie 94265506040944 notify 150323855374 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fef900050f0 con 0x7fef8002e910 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fef99e13800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): orig_sources= new_sources= 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fef99e13800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): potential sources added=[] removed=[] 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fef99e13800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): orig_dests= new_dests= 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fef99e13800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): potential dests added=[] removed=[] 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.111+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe6008c50 con 0x7fef8002e910 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.112+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(69 foo.buckets [call] v35'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fef9000a4d0 con 0x7fef8002e910 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.112+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d520 con 0x7fef8002e910 2024-09-10T05:11:51.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.113+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v35'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fef9004d040 con 0x7fef8002e910 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.113+0000 7fef99e13800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.113+0000 7fef99e13800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.113+0000 7fef99e13800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.114+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94265506040912 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d520 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.114+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== watch-notify(notify (1) cookie 94265505798224 notify 150323855371 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55bbe5f7f220 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.114+0000 7fee78ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855371 cookie 94265505798224 notifier 4532 bl.length()=314 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.114+0000 7fee78ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.114+0000 7fee78ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.114+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 notify.6 [notify cookie 94265506040912 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.114+0000 7fee78ff9640 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fee58003ea0 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.114+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.114+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== watch-notify(notify_complete (2) cookie 94265506040912 notify 150323855371 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bbe5f7e820 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.115+0000 7fee4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.115+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94265505795504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d520 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.116+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94265505795504] v35'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef9004d040 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.116+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94265505777872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d520 con 0x7fef8002e910 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.117+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94265505777872] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9004d040 con 0x7fef8002e910 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.117+0000 7fef99e13800 20 remove_watcher() i=0 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.117+0000 7fef99e13800 2 removed watcher, disabling cache 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.117+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94265505775872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d520 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.118+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94265505775872] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9004d040 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.118+0000 7fef99e13800 20 remove_watcher() i=1 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.118+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94265505781728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d520 con 0x55bbe5fc4530 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.119+0000 7fef8cd47640 1 -- 172.21.15.192:0/2165603511 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94265505781728] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef80037040 con 0x55bbe5fc4530 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.119+0000 7fef99e13800 20 remove_watcher() i=2 2024-09-10T05:11:51.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.119+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94265505788608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d520 con 0x7fef8002e910 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.120+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94265505788608] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9004d040 con 0x7fef8002e910 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.120+0000 7fef99e13800 20 remove_watcher() i=3 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.120+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94265505792800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d520 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.121+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94265505792800] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef9004d040 con 0x55bbe5fbb1e0 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.121+0000 7fef99e13800 20 remove_watcher() i=4 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.121+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94265505786528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d520 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.122+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94265505786528] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.122+0000 7fef99e13800 20 remove_watcher() i=5 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.122+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94265505798224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d520 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.123+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94265505798224] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.123+0000 7fef99e13800 20 remove_watcher() i=6 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.123+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94265505802416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55bbe600d520 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef95548640 1 -- 172.21.15.192:0/2165603511 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94265505802416] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef88057030 con 0x55bbe5fbfbd0 2024-09-10T05:11:51.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 20 remove_watcher() i=7 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55bbe5fbfbd0 msgr2=0x55bbe5fc1fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55bbe5fbfbd0 0x55bbe5fc1fc0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55bbe5fbb1e0 msgr2=0x55bbe5fbd6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55bbe5fbb1e0 0x55bbe5fbd6a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fef8002e910 msgr2=0x7fef8003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fef8002e910 0x7fef8003a3c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55bbe5fc4530 msgr2=0x55bbe5fc69f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55bbe5fc4530 0x55bbe5fc69f0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee6003c780 msgr2=0x7fee6003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee6003c780 0x7fee6003ec40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef8000ffd0 tx=0x7fef80023040 comp rx=0 tx=0).stop 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 msgr2=0x55bbe5fafc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 --2- 172.21.15.192:0/2165603511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5fa8810 0x55bbe5fafc50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fef88095650 tx=0x7fef88099f00 comp rx=0 tx=0).stop 2024-09-10T05:11:51.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 reap_dead start 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef95d49640 1 -- 172.21.15.192:0/2165603511 reap_dead start 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 shutdown_connections 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 >> 172.21.15.192:0/2165603511 conn(0x55bbe5fa4c10 msgr2=0x55bbe5fa2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 shutdown_connections 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.124+0000 7fef99e13800 1 -- 172.21.15.192:0/2165603511 wait complete. 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/142819498 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee6c03c730 msgr2=0x7fee6c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 --2- 172.21.15.192:0/142819498 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee6c03c730 0x7fee6c03ebf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55bbe5f80130 tx=0x7fef80006000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/142819498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5f9c1a0 msgr2=0x55bbe5f9c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 --2- 172.21.15.192:0/142819498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5f9c1a0 0x55bbe5f9c5c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fef88065b40 tx=0x7fef88065f80 comp rx=0 tx=0).stop 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/142819498 shutdown_connections 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 --2- 172.21.15.192:0/142819498 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee6c03c730 0x7fee6c03ebf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 --2- 172.21.15.192:0/142819498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5f9c1a0 0x55bbe5f9c5c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/142819498 >> 172.21.15.192:0/142819498 conn(0x55bbe5f90550 msgr2=0x55bbe5f90930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/142819498 shutdown_connections 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/142819498 wait complete. 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55bbe5f87a20 msgr2=0x55bbe5f89ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55bbe5f87a20 0x55bbe5f89ec0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55bbe5e83e00 msgr2=0x55bbe5f85680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55bbe5e83e00 0x55bbe5f85680 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55bbe5f8bab0 msgr2=0x55bbe5f8dea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55bbe5f8bab0 0x55bbe5f8dea0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee7c03c780 msgr2=0x7fee7c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fee7c03c780 0x7fee7c03ec40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef80000c00 tx=0x7fef800013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 msgr2=0x55bbe5f7e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 --2- 172.21.15.192:0/2134759379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbe5e834c0 0x55bbe5f7e030 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fef88045be0 tx=0x7fef88003020 comp rx=0 tx=0).stop 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef95d49640 1 -- 172.21.15.192:0/2134759379 reap_dead start 2024-09-10T05:11:51.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 shutdown_connections 2024-09-10T05:11:51.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 >> 172.21.15.192:0/2134759379 conn(0x55bbe5e7f210 msgr2=0x55bbe5f778d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 shutdown_connections 2024-09-10T05:11:51.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.125+0000 7fef99e13800 1 -- 172.21.15.192:0/2134759379 wait complete. 2024-09-10T05:11:51.159 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-10T05:11:51.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-10T05:11:51.159 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-10T05:11:51.203 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:51.204 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:51.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.203+0000 7f1b81542800 1 Processor -- start 2024-09-10T05:11:51.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.203+0000 7f1b81542800 1 -- start start 2024-09-10T05:11:51.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.204+0000 7f1b81542800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5555b2f70600 0x5555b2f729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.204+0000 7f1b81542800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555b2e19e40 con 0x5555b2f73020 2024-09-10T05:11:51.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.204+0000 7f1b81542800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5555b2de4680 con 0x5555b2f70600 2024-09-10T05:11:51.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.204+0000 7f1b7d286640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5555b2f70600 0x5555b2f729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.204+0000 7f1b7d286640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5555b2f70600 0x5555b2f729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60938/0 (socket says 172.21.15.192:60938) 2024-09-10T05:11:51.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.204+0000 7f1b7d286640 1 -- 172.21.15.192:0/263684070 learned_addr learned my addr 172.21.15.192:0/263684070 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.204+0000 7f1b7d286640 1 -- 172.21.15.192:0/263684070 >> v1:172.21.15.139:6789/0 conn(0x5555b2f73020 legacy=0x5555b2f754e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.204+0000 7f1b77fff640 1 -- 172.21.15.192:0/263684070 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711232337 0 0) 0x5555b2e19e40 con 0x5555b2f73020 2024-09-10T05:11:51.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.204+0000 7f1b7d286640 1 -- 172.21.15.192:0/263684070 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555b2e006b0 con 0x5555b2f70600 2024-09-10T05:11:51.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.206+0000 7f1b7d286640 1 --2- 172.21.15.192:0/263684070 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b2f729f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1b70005fd0 tx=0x7f1b70045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1c1a3d97906f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.206+0000 7f1b77fff640 1 -- 172.21.15.192:0/263684070 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7004e600 con 0x5555b2f70600 2024-09-10T05:11:51.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.206+0000 7f1b77fff640 1 -- 172.21.15.192:0/263684070 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7004e7a0 con 0x5555b2f70600 2024-09-10T05:11:51.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.206+0000 7f1b77fff640 1 -- 172.21.15.192:0/263684070 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7004eaa0 con 0x5555b2f70600 2024-09-10T05:11:51.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.207+0000 7f1b81542800 1 -- 172.21.15.192:0/263684070 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 msgr2=0x5555b2f729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.207+0000 7f1b81542800 1 --2- 172.21.15.192:0/263684070 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b2f729f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1b70005fd0 tx=0x7f1b70045cf0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.207+0000 7f1b81542800 1 -- 172.21.15.192:0/263684070 shutdown_connections 2024-09-10T05:11:51.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.207+0000 7f1b81542800 1 --2- 172.21.15.192:0/263684070 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b2f729f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.207+0000 7f1b81542800 1 -- 172.21.15.192:0/263684070 >> 172.21.15.192:0/263684070 conn(0x5555b2f6a1c0 msgr2=0x5555b2f6c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.207+0000 7f1b81542800 1 -- 172.21.15.192:0/263684070 shutdown_connections 2024-09-10T05:11:51.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.207+0000 7f1b81542800 1 -- 172.21.15.192:0/263684070 wait complete. 2024-09-10T05:11:51.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.220+0000 7f1b81542800 1 Processor -- start 2024-09-10T05:11:51.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.221+0000 7f1b81542800 1 -- start start 2024-09-10T05:11:51.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.221+0000 7f1b81542800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b305f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.221+0000 7f1b81542800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5555b2e08dd0 con 0x5555b2f70600 2024-09-10T05:11:51.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.221+0000 7f1b7d286640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b305f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.221+0000 7f1b7d286640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b305f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60954/0 (socket says 172.21.15.192:60954) 2024-09-10T05:11:51.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.221+0000 7f1b7d286640 1 -- 172.21.15.192:0/3966785640 learned_addr learned my addr 172.21.15.192:0/3966785640 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.221+0000 7f1b7d286640 1 -- 172.21.15.192:0/3966785640 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555b2e21e10 con 0x5555b2f70600 2024-09-10T05:11:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.222+0000 7f1b7d286640 1 --2- 172.21.15.192:0/3966785640 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b305f4d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1b70005fd0 tx=0x7f1b70050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c592b29f2deaf86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.222+0000 7f1a6b606640 1 -- 172.21.15.192:0/3966785640 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7004ea80 con 0x5555b2f70600 2024-09-10T05:11:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.222+0000 7f1a6b606640 1 -- 172.21.15.192:0/3966785640 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7005c040 con 0x5555b2f70600 2024-09-10T05:11:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.222+0000 7f1a6b606640 1 -- 172.21.15.192:0/3966785640 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7004ed50 con 0x5555b2f70600 2024-09-10T05:11:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.222+0000 7f1b81542800 1 -- 172.21.15.192:0/3966785640 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 msgr2=0x5555b305f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.222+0000 7f1b81542800 1 --2- 172.21.15.192:0/3966785640 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b305f4d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1b70005fd0 tx=0x7f1b70050000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.223+0000 7f1b81542800 1 -- 172.21.15.192:0/3966785640 shutdown_connections 2024-09-10T05:11:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.223+0000 7f1b81542800 1 --2- 172.21.15.192:0/3966785640 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b305f4d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.223+0000 7f1b81542800 1 -- 172.21.15.192:0/3966785640 >> 172.21.15.192:0/3966785640 conn(0x5555b2f6a1c0 msgr2=0x5555b305ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.223+0000 7f1b81542800 1 -- 172.21.15.192:0/3966785640 shutdown_connections 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.223+0000 7f1b81542800 1 -- 172.21.15.192:0/3966785640 wait complete. 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.223+0000 7f1b81542800 1 Processor -- start 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.223+0000 7f1b81542800 1 -- start start 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.223+0000 7f1b81542800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b2f6fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.223+0000 7f1b81542800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5555b2f77040 con 0x5555b2f70600 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.223+0000 7f1b7d286640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b2f6fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.223+0000 7f1b7d286640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b2f6fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60966/0 (socket says 172.21.15.192:60966) 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.223+0000 7f1b7d286640 1 -- 172.21.15.192:0/3368134396 learned_addr learned my addr 172.21.15.192:0/3368134396 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.224+0000 7f1b7d286640 1 -- 172.21.15.192:0/3368134396 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555b2f70280 con 0x5555b2f70600 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.224+0000 7f1b7d286640 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b2f6fd20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000a190 tx=0x7f1b70003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.224+0000 7f1a69e03640 1 -- 172.21.15.192:0/3368134396 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b70071070 con 0x5555b2f70600 2024-09-10T05:11:51.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.224+0000 7f1a69e03640 1 -- 172.21.15.192:0/3368134396 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7006d440 con 0x5555b2f70600 2024-09-10T05:11:51.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.224+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555b2f6e630 con 0x5555b2f70600 2024-09-10T05:11:51.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.224+0000 7f1a69e03640 1 -- 172.21.15.192:0/3368134396 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7006d740 con 0x5555b2f70600 2024-09-10T05:11:51.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.224+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555b2f6ebf0 con 0x5555b2f70600 2024-09-10T05:11:51.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.225+0000 7f1a69e03640 1 -- 172.21.15.192:0/3368134396 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1b70074070 con 0x5555b2f70600 2024-09-10T05:11:51.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.225+0000 7f1a69e03640 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a6403c780 0x7f1a6403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.225+0000 7f1a69e03640 1 -- 172.21.15.192:0/3368134396 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1b70066020 con 0x5555b2f70600 2024-09-10T05:11:51.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.225+0000 7f1b7ca85640 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a6403c780 0x7f1a6403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.225+0000 7f1b81542800 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5555b2f73020 0x5555b30701f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.225+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b3070730 con 0x5555b2f73020 2024-09-10T05:11:51.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.225+0000 7f1b7da87640 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5555b2f73020 0x5555b30701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.225+0000 7f1b7ca85640 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a6403c780 0x7f1a6403ec40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1b68000f60 tx=0x7f1b680013f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.225+0000 7f1b7da87640 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5555b2f73020 0x5555b30701f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.226+0000 7f1b7da87640 1 -- 172.21.15.192:0/3368134396 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b780083e0 con 0x5555b2f73020 2024-09-10T05:11:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.226+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b2f6f0d0 con 0x5555b2f73020 2024-09-10T05:11:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.226+0000 7f1b7da87640 1 -- 172.21.15.192:0/3368134396 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b780083e0 con 0x5555b2f73020 2024-09-10T05:11:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.226+0000 7f1b81542800 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5555b3072a00 0x5555b3074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.226+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30754c0 con 0x5555b3072a00 2024-09-10T05:11:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.226+0000 7f1b7d286640 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5555b3072a00 0x5555b3074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.227+0000 7f1b7d286640 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5555b3072a00 0x5555b3074df0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.227+0000 7f1b7d286640 1 -- 172.21.15.192:0/3368134396 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1b7007d070 con 0x5555b3072a00 2024-09-10T05:11:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.227+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30718a0 con 0x5555b2f73020 2024-09-10T05:11:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.227+0000 7f1b7da87640 1 -- 172.21.15.192:0/3368134396 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b780083e0 con 0x5555b2f73020 2024-09-10T05:11:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.227+0000 7f1b81542800 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5555b3076900 0x5555b3078cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.227+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b3079480 con 0x5555b3076900 2024-09-10T05:11:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.227+0000 7f1b7ca85640 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5555b3076900 0x5555b3078cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.228+0000 7f1b7ca85640 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5555b3076900 0x5555b3078cf0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.228+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3368134396 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1b68010540 con 0x5555b3076900 2024-09-10T05:11:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.228+0000 7f1b81542800 1 Processor -- start 2024-09-10T05:11:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.228+0000 7f1b81542800 1 -- start start 2024-09-10T05:11:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.228+0000 7f1b81542800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b30870a0 0x5555b30874c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.228+0000 7f1b81542800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5555b2e66a00 con 0x5555b30870a0 2024-09-10T05:11:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.229+0000 7f1b7d286640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b30870a0 0x5555b30874c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.229+0000 7f1b7d286640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b30870a0 0x5555b30874c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60968/0 (socket says 172.21.15.192:60968) 2024-09-10T05:11:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.229+0000 7f1b7d286640 1 -- 172.21.15.192:0/1418315285 learned_addr learned my addr 172.21.15.192:0/1418315285 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.229+0000 7f1b7d286640 1 -- 172.21.15.192:0/1418315285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555b3087b00 con 0x5555b30870a0 2024-09-10T05:11:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.229+0000 7f1b7d286640 1 --2- 172.21.15.192:0/1418315285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b30870a0 0x5555b30874c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1b7004efd0 tx=0x7f1b7006db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.229+0000 7f1a62ffd640 1 -- 172.21.15.192:0/1418315285 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7007b040 con 0x5555b30870a0 2024-09-10T05:11:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.229+0000 7f1a62ffd640 1 -- 172.21.15.192:0/1418315285 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7006bc30 con 0x5555b30870a0 2024-09-10T05:11:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.229+0000 7f1b81542800 1 -- 172.21.15.192:0/1418315285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555b3088330 con 0x5555b30870a0 2024-09-10T05:11:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.229+0000 7f1a62ffd640 1 -- 172.21.15.192:0/1418315285 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b70056900 con 0x5555b30870a0 2024-09-10T05:11:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.229+0000 7f1b81542800 1 -- 172.21.15.192:0/1418315285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555b30888d0 con 0x5555b30870a0 2024-09-10T05:11:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.230+0000 7f1a62ffd640 1 -- 172.21.15.192:0/1418315285 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1b70089030 con 0x5555b30870a0 2024-09-10T05:11:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.230+0000 7f1a62ffd640 1 --2- 172.21.15.192:0/1418315285 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a5403c780 0x7f1a5403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.230+0000 7f1a62ffd640 1 -- 172.21.15.192:0/1418315285 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1b70087070 con 0x5555b30870a0 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.230+0000 7f1b7ca85640 1 --2- 172.21.15.192:0/1418315285 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a5403c780 0x7f1a5403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.230+0000 7f1b81542800 1 Processor -- start 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.230+0000 7f1b81542800 1 -- start start 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.230+0000 7f1b7ca85640 1 --2- 172.21.15.192:0/1418315285 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a5403c780 0x7f1a5403ec40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800c010 tx=0x7f1b68006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.231+0000 7f1b81542800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 0x5555b3093d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.231+0000 7f1b81542800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5555b305fc60 con 0x5555b3093960 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.231+0000 7f1b7d286640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 0x5555b3093d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.231+0000 7f1b7d286640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 0x5555b3093d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60970/0 (socket says 172.21.15.192:60970) 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.231+0000 7f1b7d286640 1 -- 172.21.15.192:0/779393646 learned_addr learned my addr 172.21.15.192:0/779393646 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.231+0000 7f1b7d286640 1 -- 172.21.15.192:0/779393646 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555b3094350 con 0x5555b3093960 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.231+0000 7f1b7d286640 1 --2- 172.21.15.192:0/779393646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 0x5555b3093d60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1b70074040 tx=0x7f1b70056e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1685b1146c43062e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.231+0000 7f1a60ff9640 1 -- 172.21.15.192:0/779393646 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b70080640 con 0x5555b3093960 2024-09-10T05:11:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.231+0000 7f1a60ff9640 1 -- 172.21.15.192:0/779393646 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7008edd0 con 0x5555b3093960 2024-09-10T05:11:51.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.231+0000 7f1a60ff9640 1 -- 172.21.15.192:0/779393646 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b70078e40 con 0x5555b3093960 2024-09-10T05:11:51.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b81542800 1 -- 172.21.15.192:0/779393646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 msgr2=0x5555b3093d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b81542800 1 --2- 172.21.15.192:0/779393646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 0x5555b3093d60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1b70074040 tx=0x7f1b70056e70 comp rx=0 tx=0).stop 2024-09-10T05:11:51.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b81542800 1 -- 172.21.15.192:0/779393646 shutdown_connections 2024-09-10T05:11:51.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b81542800 1 --2- 172.21.15.192:0/779393646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 0x5555b3093d60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b81542800 1 -- 172.21.15.192:0/779393646 >> 172.21.15.192:0/779393646 conn(0x5555b308fd60 msgr2=0x5555b308dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b81542800 1 -- 172.21.15.192:0/779393646 shutdown_connections 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b81542800 1 -- 172.21.15.192:0/779393646 wait complete. 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b81542800 1 Processor -- start 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b81542800 1 -- start start 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b81542800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 0x5555b309ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b81542800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5555b30947c0 con 0x5555b3093960 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b7d286640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 0x5555b309ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b7d286640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 0x5555b309ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60976/0 (socket says 172.21.15.192:60976) 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.232+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 learned_addr learned my addr 172.21.15.192:0/3106417669 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.233+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555b309b2c0 con 0x5555b3093960 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.233+0000 7f1b7d286640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 0x5555b309ad60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1b70063950 tx=0x7f1b7007deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.233+0000 7f1a52ffd640 1 -- 172.21.15.192:0/3106417669 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b700ba070 con 0x5555b3093960 2024-09-10T05:11:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.233+0000 7f1a52ffd640 1 -- 172.21.15.192:0/3106417669 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b70063a20 con 0x5555b3093960 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.233+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555b309b2c0 con 0x5555b3093960 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.233+0000 7f1a52ffd640 1 -- 172.21.15.192:0/3106417669 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b70063d40 con 0x5555b3093960 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.233+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555b309b2c0 con 0x5555b3093960 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.234+0000 7f1a52ffd640 1 -- 172.21.15.192:0/3106417669 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1b700bd070 con 0x5555b3093960 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.234+0000 7f1a52ffd640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a4803c780 0x7f1a4803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.234+0000 7f1a52ffd640 1 -- 172.21.15.192:0/3106417669 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1b700b2070 con 0x5555b3093960 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.234+0000 7f1b7ca85640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a4803c780 0x7f1a4803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.235+0000 7f1b7ca85640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a4803c780 0x7f1a4803ec40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5555b3079880 tx=0x7f1b68022040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.235+0000 7f1b81542800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.235+0000 7f1b81542800 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5555b30a6310 0x5555b30a87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.235+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a8f20 con 0x5555b30a6310 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.235+0000 7f1b7da87640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5555b30a6310 0x5555b30a87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.235+0000 7f1b7da87640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5555b30a6310 0x5555b30a87d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.235+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b780083e0 con 0x5555b30a6310 2024-09-10T05:11:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.235+0000 7f1b81542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.235+0000 7f1b81542800 20 realm 2024-09-10T05:11:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.235+0000 7f1b81542800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.235+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9330 con 0x5555b30a6310 2024-09-10T05:11:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.235+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b780083e0 con 0x5555b30a6310 2024-09-10T05:11:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b81542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b81542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b81542800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30a6310 2024-09-10T05:11:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b780083e0 con 0x5555b30a6310 2024-09-10T05:11:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b81542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b81542800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9fa0 con 0x5555b30a6310 2024-09-10T05:11:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b780083e0 con 0x5555b30a6310 2024-09-10T05:11:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b81542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b81542800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b81542800 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5555b30aa960 0x5555b30acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30ad3a0 con 0x5555b30aa960 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.236+0000 7f1b7d286640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5555b30aa960 0x5555b30acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.237+0000 7f1b7d286640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5555b30aa960 0x5555b30acd50 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.237+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.237+0000 7f1b81542800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.237+0000 7f1b81542800 20 searching for the correct realm 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.237+0000 7f1b81542800 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5555b30af330 0x5555b30b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.237+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b1e70 con 0x5555b30af330 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.237+0000 7f1b7ca85640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5555b30af330 0x5555b30b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.237+0000 7f1b7ca85640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5555b30af330 0x5555b30b17f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.238+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.238+0000 7f1b7ca85640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1b6802d910 0x7f1b680393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.238+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b1e70 con 0x7f1b6802d910 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.238+0000 7f1b7da87640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1b6802d910 0x7f1b680393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.238+0000 7f1b7da87640 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1b6802d910 0x7f1b680393c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.238+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1b780083e0 con 0x7f1b6802d910 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.238+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30aa960 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.238+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.238+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30a6310 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.239+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b780083e0 con 0x5555b30a6310 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.239+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30a6310 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.239+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.239+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30aa960 2024-09-10T05:11:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.239+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.239+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30aa960 2024-09-10T05:11:51.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.239+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.239+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x7f1b6802d910 2024-09-10T05:11:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.240+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.240+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30af330 2024-09-10T05:11:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.240+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.240+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30a6310 2024-09-10T05:11:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.240+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.240+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30aa960 2024-09-10T05:11:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.240+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.240+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30a6310 2024-09-10T05:11:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.241+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.241+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x7f1b6802d910 2024-09-10T05:11:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.241+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.241+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30af330 2024-09-10T05:11:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.241+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.241+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30af330 2024-09-10T05:11:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.241+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.241+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30aa960 2024-09-10T05:11:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.242+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.242+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30af330 2024-09-10T05:11:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.242+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.242+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30af330 2024-09-10T05:11:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.242+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.242+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30a6310 2024-09-10T05:11:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.242+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.242+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30a6310 2024-09-10T05:11:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.242+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.242+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30aa960 2024-09-10T05:11:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.243+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.243+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30af330 2024-09-10T05:11:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.243+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.243+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x7f1b6802d910 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.243+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.243+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30a6310 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.243+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.243+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30aa960 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.244+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.244+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30af330 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.244+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.244+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30aa960 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.244+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.244+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x7f1b6802d910 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.245+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.245+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30af330 2024-09-10T05:11:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.245+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.245+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30aa960 2024-09-10T05:11:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.245+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.245+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x5555b30a6310 2024-09-10T05:11:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.245+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.245+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5555b30a9c00 con 0x7f1b6802d910 2024-09-10T05:11:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30ad740 con 0x5555b30a6310 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30ad740 con 0x5555b30a6310 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30ad740 con 0x7f1b6802d910 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 zone default found 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 4 Realm: () 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 zonegroup default 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.246+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30ae050 con 0x5555b30aa960 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.247+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.247+0000 7f1b81542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.247+0000 7f1b81542800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.247+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b3ce0 con 0x5555b30af330 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.247+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.247+0000 7f1b81542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.247+0000 7f1b81542800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.247+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b4080 con 0x5555b30af330 2024-09-10T05:11:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.248+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.248+0000 7f1b81542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.248+0000 7f1b81542800 20 started sync module instance, tier type = 2024-09-10T05:11:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.248+0000 7f1b81542800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.248+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b3180 con 0x7f1b6802d910 2024-09-10T05:11:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.249+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.249+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93826564437408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b3180 con 0x7f1b6802d910 2024-09-10T05:11:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.249+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b4a40 con 0x5555b30a6310 2024-09-10T05:11:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.250+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93826564437408] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.250+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.250+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93826564435632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b4a40 con 0x5555b30a6310 2024-09-10T05:11:51.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.250+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b5400 con 0x5555b30af330 2024-09-10T05:11:51.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.251+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93826564435632] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.251+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.251+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93826564441488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b49b0 con 0x5555b30af330 2024-09-10T05:11:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.251+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b62c0 con 0x7f1b6802d910 2024-09-10T05:11:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.252+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93826564441488] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.252+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.252+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93826564447760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b66e0 con 0x7f1b6802d910 2024-09-10T05:11:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.252+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b70a0 con 0x5555b30a6310 2024-09-10T05:11:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.253+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.253+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93826564451312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b74c0 con 0x5555b30a6310 2024-09-10T05:11:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.253+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b7f70 con 0x5555b30aa960 2024-09-10T05:11:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.253+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93826564447760] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.254+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93826564451312] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.254+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.254+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93826564448816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b74c0 con 0x5555b30aa960 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.254+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b8810 con 0x5555b30aa960 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.255+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.255+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93826564457824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b9030 con 0x5555b30aa960 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.255+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b9b50 con 0x5555b30aa960 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.255+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93826564448816] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.256+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.256+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93826564457824] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.256+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93826564462112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b7010 con 0x5555b30aa960 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.256+0000 7f1b81542800 20 add_watcher() i=0 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.256+0000 7f1b81542800 20 add_watcher() i=1 2024-09-10T05:11:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.256+0000 7f1b81542800 20 add_watcher() i=2 2024-09-10T05:11:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.256+0000 7f1b81542800 20 add_watcher() i=3 2024-09-10T05:11:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.256+0000 7f1b81542800 20 add_watcher() i=4 2024-09-10T05:11:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.256+0000 7f1b81542800 20 add_watcher() i=5 2024-09-10T05:11:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.256+0000 7f1b81542800 20 add_watcher() i=6 2024-09-10T05:11:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.257+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93826564462112] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.257+0000 7f1b81542800 20 add_watcher() i=7 2024-09-10T05:11:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.257+0000 7f1b81542800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.257+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30bcb40 con 0x5555b30a6310 2024-09-10T05:11:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.257+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.257+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93826564459200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b9fc0 con 0x5555b30a6310 2024-09-10T05:11:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.258+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93826564459200] v35'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.258+0000 7f1a33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.259+0000 7f1b81542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.259+0000 7f1b81542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.259+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c53c0 con 0x5555b30a6310 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.260+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'45 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.260+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c53c0 con 0x5555b30aa960 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.261+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.261+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c53c0 con 0x5555b30af330 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.262+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.262+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c4b80 con 0x5555b30a6310 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.263+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'128 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.263+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c69e0 con 0x7f1b6802d910 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.264+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'41 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.264+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c6e90 con 0x5555b30af330 2024-09-10T05:11:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.265+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'35 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.265+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7060 con 0x5555b30a6310 2024-09-10T05:11:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.266+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.266+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7060 con 0x5555b30aa960 2024-09-10T05:11:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.267+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'29 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.267+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7190 con 0x7f1b6802d910 2024-09-10T05:11:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.268+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.268+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7220 con 0x5555b30af330 2024-09-10T05:11:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.269+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.269+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c77b0 con 0x7f1b6802d910 2024-09-10T05:11:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.270+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'42 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.270+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7790 con 0x5555b30aa960 2024-09-10T05:11:51.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.271+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.271+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7820 con 0x7f1b6802d910 2024-09-10T05:11:51.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.272+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.272+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7820 con 0x5555b30aa960 2024-09-10T05:11:51.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.273+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'41 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.273+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7820 con 0x5555b30a6310 2024-09-10T05:11:51.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.274+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'129 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.274+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7950 con 0x5555b30af330 2024-09-10T05:11:51.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.275+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.275+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7d70 con 0x7f1b6802d910 2024-09-10T05:11:51.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.276+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.276+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7cb0 con 0x5555b30af330 2024-09-10T05:11:51.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.277+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.277+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7e00 con 0x5555b30a6310 2024-09-10T05:11:51.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.278+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.278+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7e00 con 0x5555b30a6310 2024-09-10T05:11:51.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.279+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'130 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.279+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7e00 con 0x5555b30af330 2024-09-10T05:11:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.280+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.280+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7e90 con 0x7f1b6802d910 2024-09-10T05:11:51.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.281+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.281+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7e90 con 0x5555b30af330 2024-09-10T05:11:51.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.282+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.282+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7e90 con 0x5555b30af330 2024-09-10T05:11:51.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.283+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.283+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7eb0 con 0x5555b30af330 2024-09-10T05:11:51.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.284+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'18 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.284+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7ed0 con 0x5555b30af330 2024-09-10T05:11:51.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.285+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.285+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7f40 con 0x5555b30aa960 2024-09-10T05:11:51.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.286+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.286+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7f40 con 0x5555b30af330 2024-09-10T05:11:51.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.287+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.287+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7f40 con 0x5555b30aa960 2024-09-10T05:11:51.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.288+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.288+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7f40 con 0x5555b30af330 2024-09-10T05:11:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.289+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.290+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7f40 con 0x5555b30aa960 2024-09-10T05:11:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.291+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'42 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.291+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c7f80 con 0x7f1b6802d910 2024-09-10T05:11:51.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.292+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.292+0000 7f1a32fe5640 20 reqs_thread_entry: start 2024-09-10T05:11:51.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.292+0000 7f1b81542800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:51.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.292+0000 7f1b81542800 20 Filter name: none 2024-09-10T05:11:51.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.292+0000 7f1a30fe1640 20 reqs_thread_entry: start 2024-09-10T05:11:51.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.292+0000 7f1b81542800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:11:51.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.292+0000 7f1b81542800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.292+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30f2ea0 con 0x5555b30aa960 2024-09-10T05:11:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.293+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.293+0000 7f1b81542800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:11:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.293+0000 7f1b81542800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T05:11:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.293+0000 7f1b81542800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:11:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.293+0000 7f1b81542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.293+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30f53a0 con 0x5555b30aa960 2024-09-10T05:11:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.293+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv4 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.293+0000 7f1b81542800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T05:11:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.294+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30f2e20 con 0x5555b30aa960 2024-09-10T05:11:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.294+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v35'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.295+0000 7f1b81542800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:11:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.295+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93826564705968 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30f5c60 con 0x5555b30af330 2024-09-10T05:11:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.295+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== watch-notify(notify (1) cookie 93826564441488 notify 150323855363 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5555b30c7950 con 0x5555b30af330 2024-09-10T05:11:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.295+0000 7f1a60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855363 cookie 93826564441488 notifier 4539 bl.length()=170 2024-09-10T05:11:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.295+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(97 notify.2 [notify cookie 93826564705968 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.295+0000 7f1a60ff9640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1a40003d60 con 0x5555b30af330 2024-09-10T05:11:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.295+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.295+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 29 ==== watch-notify(notify_complete (2) cookie 93826564705968 notify 150323855363 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5555b30c75c0 con 0x5555b30af330 2024-09-10T05:11:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.295+0000 7f1b81542800 10 removing email index: 2024-09-10T05:11:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.295+0000 7f1b81542800 10 removing user buckets index 2024-09-10T05:11:51.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.295+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30f4eb0 con 0x5555b30aa960 2024-09-10T05:11:51.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.296+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(99 fud.buckets [delete] v35'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.296+0000 7f1b81542800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-10T05:11:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.296+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93826564705968 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30f5c40 con 0x5555b30aa960 2024-09-10T05:11:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.297+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== watch-notify(notify (1) cookie 93826564457824 notify 150323855372 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5555b30c7270 con 0x5555b30aa960 2024-09-10T05:11:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.297+0000 7f1a53fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855372 cookie 93826564457824 notifier 4539 bl.length()=160 2024-09-10T05:11:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.297+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 30 ==== osd_op_reply(100 notify.6 [notify cookie 93826564705968 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.297+0000 7f1a53fff640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f19a40032c0 con 0x5555b30aa960 2024-09-10T05:11:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.297+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.297+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 32 ==== watch-notify(notify_complete (2) cookie 93826564705968 notify 150323855372 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5555b3087b00 con 0x5555b30aa960 2024-09-10T05:11:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.297+0000 7f1b81542800 10 removing user index: fud 2024-09-10T05:11:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.297+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30f7c60 con 0x5555b30aa960 2024-09-10T05:11:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.298+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 33 ==== osd_op_reply(102 fud [call,call,delete] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.298+0000 7f1b81542800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-10T05:11:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.298+0000 7f1b81542800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T05:11:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.298+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 93826564697632 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5555b30f4700 con 0x5555b30aa960 2024-09-10T05:11:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.298+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 34 ==== watch-notify(notify (1) cookie 93826564448816 notify 150323855373 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5555b3087b00 con 0x5555b30aa960 2024-09-10T05:11:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.298+0000 7f1a60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855373 cookie 93826564448816 notifier 4539 bl.length()=152 2024-09-10T05:11:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.298+0000 7f1a60ff9640 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1a40003d60 con 0x5555b30aa960 2024-09-10T05:11:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.298+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 35 ==== osd_op_reply(103 notify.5 [notify cookie 93826564697632 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.299+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.299+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 37 ==== watch-notify(notify_complete (2) cookie 93826564697632 notify 150323855373 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5555b2f6ebf0 con 0x5555b30aa960 2024-09-10T05:11:51.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.299+0000 7f1a33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:51.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.299+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93826564459200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30c3470 con 0x5555b30a6310 2024-09-10T05:11:51.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.300+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93826564459200] v35'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.300+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93826564437408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b8ac0 con 0x7f1b6802d910 2024-09-10T05:11:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.301+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93826564437408] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.301+0000 7f1b81542800 20 remove_watcher() i=0 2024-09-10T05:11:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.301+0000 7f1b81542800 2 removed watcher, disabling cache 2024-09-10T05:11:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.301+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93826564435632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b8ac0 con 0x5555b30a6310 2024-09-10T05:11:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.303+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93826564435632] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.303+0000 7f1b81542800 20 remove_watcher() i=1 2024-09-10T05:11:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.303+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93826564441488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b8ac0 con 0x5555b30af330 2024-09-10T05:11:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.304+0000 7f1b7ca85640 1 -- 172.21.15.192:0/3106417669 <== osd.3 v2:172.21.15.192:6816/1620624472 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93826564441488] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b68036040 con 0x5555b30af330 2024-09-10T05:11:51.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.304+0000 7f1b81542800 20 remove_watcher() i=2 2024-09-10T05:11:51.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.304+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93826564447760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b8ac0 con 0x7f1b6802d910 2024-09-10T05:11:51.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.305+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93826564447760] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x7f1b6802d910 2024-09-10T05:11:51.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.305+0000 7f1b81542800 20 remove_watcher() i=3 2024-09-10T05:11:51.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.305+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93826564451312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b5e10 con 0x5555b30a6310 2024-09-10T05:11:51.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.306+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93826564451312] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b78026040 con 0x5555b30a6310 2024-09-10T05:11:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.306+0000 7f1b81542800 20 remove_watcher() i=4 2024-09-10T05:11:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.306+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93826564448816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b8ac0 con 0x5555b30aa960 2024-09-10T05:11:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.307+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93826564448816] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.307+0000 7f1b81542800 20 remove_watcher() i=5 2024-09-10T05:11:51.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.307+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93826564457824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b6bf0 con 0x5555b30aa960 2024-09-10T05:11:51.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.308+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93826564457824] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.308+0000 7f1b81542800 20 remove_watcher() i=6 2024-09-10T05:11:51.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.308+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93826564462112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5555b30b8ac0 con 0x5555b30aa960 2024-09-10T05:11:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b7d286640 1 -- 172.21.15.192:0/3106417669 <== osd.0 v2:172.21.15.139:6800/2915567440 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93826564462112] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b700bc030 con 0x5555b30aa960 2024-09-10T05:11:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 20 remove_watcher() i=7 2024-09-10T05:11:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5555b30aa960 msgr2=0x5555b30acd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5555b30aa960 0x5555b30acd50 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5555b30a6310 msgr2=0x5555b30a87d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5555b30a6310 0x5555b30a87d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1b6802d910 msgr2=0x7f1b680393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1b6802d910 0x7f1b680393c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5555b30af330 msgr2=0x5555b30b17f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5555b30af330 0x5555b30b17f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a4803c780 msgr2=0x7f1a4803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a4803c780 0x7f1a4803ec40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5555b3079880 tx=0x7f1b68022040 comp rx=0 tx=0).stop 2024-09-10T05:11:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 msgr2=0x5555b309ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 --2- 172.21.15.192:0/3106417669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b3093960 0x5555b309ad60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1b70063950 tx=0x7f1b7007deb0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 reap_dead start 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b7da87640 1 -- 172.21.15.192:0/3106417669 reap_dead start 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 shutdown_connections 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 >> 172.21.15.192:0/3106417669 conn(0x5555b308fd60 msgr2=0x5555b308df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 shutdown_connections 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/3106417669 wait complete. 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/1418315285 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a5403c780 msgr2=0x7f1a5403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 --2- 172.21.15.192:0/1418315285 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a5403c780 0x7f1a5403ec40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800c010 tx=0x7f1b68006000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/1418315285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b30870a0 msgr2=0x5555b30874c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 --2- 172.21.15.192:0/1418315285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b30870a0 0x5555b30874c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1b7004efd0 tx=0x7f1b7006db50 comp rx=0 tx=0).stop 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/1418315285 shutdown_connections 2024-09-10T05:11:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 --2- 172.21.15.192:0/1418315285 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a5403c780 0x7f1a5403ec40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 --2- 172.21.15.192:0/1418315285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b30870a0 0x5555b30874c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/1418315285 >> 172.21.15.192:0/1418315285 conn(0x5555b307b450 msgr2=0x5555b307b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/1418315285 shutdown_connections 2024-09-10T05:11:51.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.309+0000 7f1b81542800 1 -- 172.21.15.192:0/1418315285 wait complete. 2024-09-10T05:11:51.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5555b3072a00 msgr2=0x5555b3074df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5555b3072a00 0x5555b3074df0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5555b2f73020 msgr2=0x5555b30701f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5555b2f73020 0x5555b30701f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5555b3076900 msgr2=0x5555b3078cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5555b3076900 0x5555b3078cf0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a6403c780 msgr2=0x7f1a6403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1a6403c780 0x7f1a6403ec40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1b68000f60 tx=0x7f1b680013f0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 msgr2=0x5555b2f6fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 --2- 172.21.15.192:0/3368134396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5555b2f70600 0x5555b2f6fd20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000a190 tx=0x7f1b70003330 comp rx=0 tx=0).stop 2024-09-10T05:11:51.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b7da87640 1 -- 172.21.15.192:0/3368134396 reap_dead start 2024-09-10T05:11:51.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 shutdown_connections 2024-09-10T05:11:51.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 >> 172.21.15.192:0/3368134396 conn(0x5555b2f6a1c0 msgr2=0x5555b3059640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 shutdown_connections 2024-09-10T05:11:51.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.310+0000 7f1b81542800 1 -- 172.21.15.192:0/3368134396 wait complete. 2024-09-10T05:11:51.319 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T05:11:51.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-10T05:11:51.319 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-10T05:11:51.374 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:51.374 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:51.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.373+0000 7f49a912e800 1 Processor -- start 2024-09-10T05:11:51.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.374+0000 7f49a912e800 1 -- start start 2024-09-10T05:11:51.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.374+0000 7f49a912e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a17ad55790 0x55a17ad57b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.374+0000 7f49a912e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a17abfee40 con 0x55a17ad580c0 2024-09-10T05:11:51.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.374+0000 7f49a912e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55a17abc9680 con 0x55a17ad55790 2024-09-10T05:11:51.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.374+0000 7f49a4edd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a17ad55790 0x55a17ad57b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.374+0000 7f49a4edd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a17ad55790 0x55a17ad57b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60992/0 (socket says 172.21.15.192:60992) 2024-09-10T05:11:51.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.374+0000 7f49a4edd640 1 -- 172.21.15.192:0/2907692657 learned_addr learned my addr 172.21.15.192:0/2907692657 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.374+0000 7f49a4edd640 1 -- 172.21.15.192:0/2907692657 >> v1:172.21.15.139:6789/0 conn(0x55a17ad580c0 legacy=0x55a17ad5a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.374+0000 7f49a4edd640 1 -- 172.21.15.192:0/2907692657 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17abe56b0 con 0x55a17ad55790 2024-09-10T05:11:51.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.374+0000 7f499f7fe640 1 -- 172.21.15.192:0/2907692657 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204412207 0 0) 0x55a17abfee40 con 0x55a17ad580c0 2024-09-10T05:11:51.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.376+0000 7f49a4edd640 1 --2- 172.21.15.192:0/2907692657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ad57b80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f499800a520 tx=0x7f4998045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3238bb900c619e70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.376+0000 7f499f7fe640 1 -- 172.21.15.192:0/2907692657 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4998055070 con 0x55a17ad55790 2024-09-10T05:11:51.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.376+0000 7f499f7fe640 1 -- 172.21.15.192:0/2907692657 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49980515b0 con 0x55a17ad55790 2024-09-10T05:11:51.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.376+0000 7f499f7fe640 1 -- 172.21.15.192:0/2907692657 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49980518d0 con 0x55a17ad55790 2024-09-10T05:11:51.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.377+0000 7f49a912e800 1 -- 172.21.15.192:0/2907692657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 msgr2=0x55a17ad57b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.377+0000 7f49a912e800 1 --2- 172.21.15.192:0/2907692657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ad57b80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f499800a520 tx=0x7f4998045ba0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.377+0000 7f49a912e800 1 -- 172.21.15.192:0/2907692657 shutdown_connections 2024-09-10T05:11:51.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.377+0000 7f49a912e800 1 --2- 172.21.15.192:0/2907692657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ad57b80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.377+0000 7f49a912e800 1 -- 172.21.15.192:0/2907692657 >> 172.21.15.192:0/2907692657 conn(0x55a17ad4f250 msgr2=0x55a17ad51690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.377+0000 7f49a912e800 1 -- 172.21.15.192:0/2907692657 shutdown_connections 2024-09-10T05:11:51.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.377+0000 7f49a912e800 1 -- 172.21.15.192:0/2907692657 wait complete. 2024-09-10T05:11:51.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.390+0000 7f49a912e800 1 Processor -- start 2024-09-10T05:11:51.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.390+0000 7f49a912e800 1 -- start start 2024-09-10T05:11:51.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.391+0000 7f49a912e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ae44590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.391+0000 7f49a912e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a17abeddd0 con 0x55a17ad55790 2024-09-10T05:11:51.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.391+0000 7f49a4edd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ae44590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.391+0000 7f49a4edd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ae44590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60998/0 (socket says 172.21.15.192:60998) 2024-09-10T05:11:51.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.391+0000 7f49a4edd640 1 -- 172.21.15.192:0/3441422879 learned_addr learned my addr 172.21.15.192:0/3441422879 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.391+0000 7f49a4edd640 1 -- 172.21.15.192:0/3441422879 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17ac06e10 con 0x55a17ad55790 2024-09-10T05:11:51.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.391+0000 7f49a4edd640 1 --2- 172.21.15.192:0/3441422879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ae44590 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4998025da0 tx=0x7f4998051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58711cccf2709b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.391+0000 7f4892e05640 1 -- 172.21.15.192:0/3441422879 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4998051950 con 0x55a17ad55790 2024-09-10T05:11:51.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.392+0000 7f4892e05640 1 -- 172.21.15.192:0/3441422879 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4998051af0 con 0x55a17ad55790 2024-09-10T05:11:51.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.392+0000 7f4892e05640 1 -- 172.21.15.192:0/3441422879 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4998051dd0 con 0x55a17ad55790 2024-09-10T05:11:51.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.392+0000 7f49a912e800 1 -- 172.21.15.192:0/3441422879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 msgr2=0x55a17ae44590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.392+0000 7f49a912e800 1 --2- 172.21.15.192:0/3441422879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ae44590 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4998025da0 tx=0x7f4998051000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.392+0000 7f49a912e800 1 -- 172.21.15.192:0/3441422879 shutdown_connections 2024-09-10T05:11:51.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.392+0000 7f49a912e800 1 --2- 172.21.15.192:0/3441422879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ae44590 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.392+0000 7f49a912e800 1 -- 172.21.15.192:0/3441422879 >> 172.21.15.192:0/3441422879 conn(0x55a17ad4f250 msgr2=0x55a17ae3ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.392+0000 7f49a912e800 1 -- 172.21.15.192:0/3441422879 shutdown_connections 2024-09-10T05:11:51.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.392+0000 7f49a912e800 1 -- 172.21.15.192:0/3441422879 wait complete. 2024-09-10T05:11:51.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f49a912e800 1 Processor -- start 2024-09-10T05:11:51.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f49a912e800 1 -- start start 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f49a912e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ae4bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f49a912e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a17ad5c0b0 con 0x55a17ad55790 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f49a4edd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ae4bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f49a4edd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ae4bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32774/0 (socket says 172.21.15.192:32774) 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f49a4edd640 1 -- 172.21.15.192:0/4261671224 learned_addr learned my addr 172.21.15.192:0/4261671224 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f49a4edd640 1 -- 172.21.15.192:0/4261671224 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17ae4c280 con 0x55a17ad55790 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f49a4edd640 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ae4bd20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4998025da0 tx=0x7f4998002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f4891602640 1 -- 172.21.15.192:0/4261671224 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f499805a600 con 0x55a17ad55790 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f4891602640 1 -- 172.21.15.192:0/4261671224 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4998073070 con 0x55a17ad55790 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a17ae4c510 con 0x55a17ad55790 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.393+0000 7f4891602640 1 -- 172.21.15.192:0/4261671224 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f499805a910 con 0x55a17ad55790 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.394+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a17ae4d120 con 0x55a17ad55790 2024-09-10T05:11:51.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.394+0000 7f4891602640 1 -- 172.21.15.192:0/4261671224 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4998058070 con 0x55a17ad55790 2024-09-10T05:11:51.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.395+0000 7f4891602640 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f488c03c780 0x7f488c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.395+0000 7f4891602640 1 -- 172.21.15.192:0/4261671224 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f499806b040 con 0x55a17ad55790 2024-09-10T05:11:51.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.395+0000 7f499ffff640 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f488c03c780 0x7f488c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.395+0000 7f49a912e800 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a17ad580c0 0x55a17ae53370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.395+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae538b0 con 0x55a17ad580c0 2024-09-10T05:11:51.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.395+0000 7f49a56de640 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a17ad580c0 0x55a17ae53370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.395+0000 7f499ffff640 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f488c03c780 0x7f488c03ec40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4990000f60 tx=0x7f49900013f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.395+0000 7f49a56de640 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a17ad580c0 0x55a17ae53370 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.395+0000 7f49a56de640 1 -- 172.21.15.192:0/4261671224 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ad580c0 2024-09-10T05:11:51.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.396+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae53c50 con 0x55a17ad580c0 2024-09-10T05:11:51.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.396+0000 7f49a56de640 1 -- 172.21.15.192:0/4261671224 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ad580c0 2024-09-10T05:11:51.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.396+0000 7f49a912e800 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a17ae55790 0x55a17ae57c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.396+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae583a0 con 0x55a17ae55790 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.396+0000 7f49a4edd640 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a17ae55790 0x55a17ae57c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.396+0000 7f49a4edd640 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a17ae55790 0x55a17ae57c10 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.397+0000 7f49a4edd640 1 -- 172.21.15.192:0/4261671224 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4998057030 con 0x55a17ae55790 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.397+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae544a0 con 0x55a17ad580c0 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.397+0000 7f49a56de640 1 -- 172.21.15.192:0/4261671224 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ad580c0 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.397+0000 7f49a912e800 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a17ae59800 0x55a17ae5bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.397+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae5c330 con 0x55a17ae59800 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.398+0000 7f499ffff640 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a17ae59800 0x55a17ae5bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.398+0000 7f499ffff640 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a17ae59800 0x55a17ae5bbf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.398+0000 7f499ffff640 1 -- 172.21.15.192:0/4261671224 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4990010540 con 0x55a17ae59800 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.398+0000 7f49a912e800 1 Processor -- start 2024-09-10T05:11:51.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.398+0000 7f49a912e800 1 -- start start 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.399+0000 7f49a912e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae69f70 0x55a17ae6a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.399+0000 7f49a912e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a17ac4ba00 con 0x55a17ae69f70 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.399+0000 7f49a4edd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae69f70 0x55a17ae6a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.399+0000 7f49a4edd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae69f70 0x55a17ae6a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32778/0 (socket says 172.21.15.192:32778) 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.399+0000 7f49a4edd640 1 -- 172.21.15.192:0/4269547705 learned_addr learned my addr 172.21.15.192:0/4269547705 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.399+0000 7f49a4edd640 1 -- 172.21.15.192:0/4269547705 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17ae6a9d0 con 0x55a17ae69f70 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.399+0000 7f49a4edd640 1 --2- 172.21.15.192:0/4269547705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae69f70 0x55a17ae6a390 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f49980507d0 tx=0x7f4998097420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.399+0000 7f488a7fc640 1 -- 172.21.15.192:0/4269547705 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49980860b0 con 0x55a17ae69f70 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.399+0000 7f488a7fc640 1 -- 172.21.15.192:0/4269547705 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4998086250 con 0x55a17ae69f70 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.399+0000 7f49a912e800 1 -- 172.21.15.192:0/4269547705 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a17ae6b200 con 0x55a17ae69f70 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.399+0000 7f488a7fc640 1 -- 172.21.15.192:0/4269547705 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4998050e40 con 0x55a17ae69f70 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.399+0000 7f49a912e800 1 -- 172.21.15.192:0/4269547705 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a17ae6b7a0 con 0x55a17ae69f70 2024-09-10T05:11:51.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.400+0000 7f488a7fc640 1 -- 172.21.15.192:0/4269547705 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f499804f070 con 0x55a17ae69f70 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.400+0000 7f488a7fc640 1 --2- 172.21.15.192:0/4269547705 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f487c03c6e0 0x7f487c03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.400+0000 7f488a7fc640 1 -- 172.21.15.192:0/4269547705 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f499808e070 con 0x55a17ae69f70 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.400+0000 7f499ffff640 1 --2- 172.21.15.192:0/4269547705 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f487c03c6e0 0x7f487c03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.401+0000 7f49a912e800 1 Processor -- start 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.401+0000 7f49a912e800 1 -- start start 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.401+0000 7f499ffff640 1 --2- 172.21.15.192:0/4269547705 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f487c03c6e0 0x7f487c03eba0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f499000c010 tx=0x7f4990006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.401+0000 7f49a912e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 0x55a17ae76b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.401+0000 7f49a912e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a17ae44d20 con 0x55a17ae76760 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.401+0000 7f49a4edd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 0x55a17ae76b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.401+0000 7f49a4edd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 0x55a17ae76b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32786/0 (socket says 172.21.15.192:32786) 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.401+0000 7f49a4edd640 1 -- 172.21.15.192:0/3004566688 learned_addr learned my addr 172.21.15.192:0/3004566688 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.401+0000 7f49a4edd640 1 -- 172.21.15.192:0/3004566688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17ae77150 con 0x55a17ae76760 2024-09-10T05:11:51.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.401+0000 7f49a4edd640 1 --2- 172.21.15.192:0/3004566688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 0x55a17ae76b60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4998050550 tx=0x7f499806ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422b76d55e60a30a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.402+0000 7f487bfff640 1 -- 172.21.15.192:0/3004566688 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4998084450 con 0x55a17ae76760 2024-09-10T05:11:51.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.402+0000 7f487bfff640 1 -- 172.21.15.192:0/3004566688 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499806e970 con 0x55a17ae76760 2024-09-10T05:11:51.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.402+0000 7f487bfff640 1 -- 172.21.15.192:0/3004566688 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4998055070 con 0x55a17ae76760 2024-09-10T05:11:51.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.402+0000 7f49a912e800 1 -- 172.21.15.192:0/3004566688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 msgr2=0x55a17ae76b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.402+0000 7f49a912e800 1 --2- 172.21.15.192:0/3004566688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 0x55a17ae76b60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4998050550 tx=0x7f499806ece0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.402+0000 7f49a912e800 1 -- 172.21.15.192:0/3004566688 shutdown_connections 2024-09-10T05:11:51.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.402+0000 7f49a912e800 1 --2- 172.21.15.192:0/3004566688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 0x55a17ae76b60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.402+0000 7f49a912e800 1 -- 172.21.15.192:0/3004566688 >> 172.21.15.192:0/3004566688 conn(0x55a17ae72b60 msgr2=0x55a17ae70da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.402+0000 7f49a912e800 1 -- 172.21.15.192:0/3004566688 shutdown_connections 2024-09-10T05:11:51.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.402+0000 7f49a912e800 1 -- 172.21.15.192:0/3004566688 wait complete. 2024-09-10T05:11:51.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.402+0000 7f49a912e800 1 Processor -- start 2024-09-10T05:11:51.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.402+0000 7f49a912e800 1 -- start start 2024-09-10T05:11:51.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.403+0000 7f49a912e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 0x55a17ae7db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.403+0000 7f49a912e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a17ae775c0 con 0x55a17ae76760 2024-09-10T05:11:51.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.403+0000 7f49a4edd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 0x55a17ae7db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.403+0000 7f49a4edd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 0x55a17ae7db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32792/0 (socket says 172.21.15.192:32792) 2024-09-10T05:11:51.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.403+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 learned_addr learned my addr 172.21.15.192:0/1641170060 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.403+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17ae7e0c0 con 0x55a17ae76760 2024-09-10T05:11:51.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.403+0000 7f49a4edd640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 0x55a17ae7db60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f499806feb0 tx=0x7f4998074fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.403+0000 7f487a7fc640 1 -- 172.21.15.192:0/1641170060 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49980bb070 con 0x55a17ae76760 2024-09-10T05:11:51.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.403+0000 7f487a7fc640 1 -- 172.21.15.192:0/1641170060 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4998083aa0 con 0x55a17ae76760 2024-09-10T05:11:51.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.403+0000 7f487a7fc640 1 -- 172.21.15.192:0/1641170060 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4998083d80 con 0x55a17ae76760 2024-09-10T05:11:51.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.403+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a17ae7e0c0 con 0x55a17ae76760 2024-09-10T05:11:51.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.403+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a17ae7e0c0 con 0x55a17ae76760 2024-09-10T05:11:51.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.404+0000 7f487a7fc640 1 -- 172.21.15.192:0/1641170060 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f49980be070 con 0x55a17ae76760 2024-09-10T05:11:51.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.404+0000 7f487a7fc640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f487003c730 0x7f487003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.404+0000 7f487a7fc640 1 -- 172.21.15.192:0/1641170060 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f4998062070 con 0x55a17ae76760 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.404+0000 7f499ffff640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f487003c730 0x7f487003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.405+0000 7f499ffff640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f487003c730 0x7f487003ebf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55a17ae58740 tx=0x7f4990022040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.405+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.405+0000 7f49a912e800 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a17ae88ff0 0x55a17ae8b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.405+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8bc00 con 0x55a17ae88ff0 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.405+0000 7f49a56de640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a17ae88ff0 0x55a17ae8b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.405+0000 7f49a56de640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a17ae88ff0 0x55a17ae8b4b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 20 realm 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8c010 con 0x55a17ae88ff0 2024-09-10T05:11:51.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:51.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8c8e0 con 0x55a17ae88ff0 2024-09-10T05:11:51.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae88ff0 2024-09-10T05:11:51.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a17ae8d9e0 0x55a17ae8fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.406+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae90390 con 0x55a17ae8d9e0 2024-09-10T05:11:51.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.407+0000 7f49a4edd640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a17ae8d9e0 0x55a17ae8fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.407+0000 7f49a4edd640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a17ae8d9e0 0x55a17ae8fdd0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.407+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.407+0000 7f49a912e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:51.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.407+0000 7f49a912e800 20 searching for the correct realm 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.407+0000 7f49a912e800 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a17ae92340 0x55a17ae94800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.407+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae94ed0 con 0x55a17ae92340 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.407+0000 7f499ffff640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a17ae92340 0x55a17ae94800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.407+0000 7f499ffff640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a17ae92340 0x55a17ae94800 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.408+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.408+0000 7f499ffff640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f499002d910 0x7f49900393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.408+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae94ed0 con 0x7f499002d910 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.408+0000 7f49a56de640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f499002d910 0x7f49900393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.408+0000 7f49a56de640 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f499002d910 0x7f49900393c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.408+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.408+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae8d9e0 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.409+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.409+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae88ff0 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.409+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.409+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae88ff0 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.409+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.409+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae8d9e0 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.409+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.409+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae8d9e0 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.410+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.410+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x7f499002d910 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.410+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.410+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae92340 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.410+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.410+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae88ff0 2024-09-10T05:11:51.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.410+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.410+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae8d9e0 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.411+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.411+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae88ff0 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.411+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.411+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x7f499002d910 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.411+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.411+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae92340 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.411+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.411+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae92340 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.411+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.411+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae8d9e0 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.412+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.412+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae92340 2024-09-10T05:11:51.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.412+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.412+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae92340 2024-09-10T05:11:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.412+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.412+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae88ff0 2024-09-10T05:11:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.412+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.412+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae88ff0 2024-09-10T05:11:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.413+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.413+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae8d9e0 2024-09-10T05:11:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.413+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.413+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae92340 2024-09-10T05:11:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.413+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.413+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x7f499002d910 2024-09-10T05:11:51.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.413+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.413+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae88ff0 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.414+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.414+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae8d9e0 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.414+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.414+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae92340 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.414+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.414+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae8d9e0 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.414+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.414+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x7f499002d910 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.415+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.415+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae92340 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.415+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.415+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae8d9e0 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.415+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.415+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x55a17ae88ff0 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.415+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.415+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae8cc80 con 0x7f499002d910 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae90c50 con 0x55a17ae88ff0 2024-09-10T05:11:51.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae90c50 con 0x55a17ae88ff0 2024-09-10T05:11:51.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae90c50 con 0x7f499002d910 2024-09-10T05:11:51.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:51.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 zone default found 2024-09-10T05:11:51.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 4 Realm: () 2024-09-10T05:11:51.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:51.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:51.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:51.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 zonegroup default 2024-09-10T05:11:51.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.416+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae90c40 con 0x55a17ae8d9e0 2024-09-10T05:11:51.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f49a912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae96d40 con 0x55a17ae92340 2024-09-10T05:11:51.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f49a912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae970e0 con 0x55a17ae92340 2024-09-10T05:11:51.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f49a912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f49a912e800 20 started sync module instance, tier type = 2024-09-10T05:11:51.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f49a912e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:51.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.417+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae961e0 con 0x7f499002d910 2024-09-10T05:11:51.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.418+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.418+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94152040212272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae961e0 con 0x7f499002d910 2024-09-10T05:11:51.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.418+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae97aa0 con 0x55a17ae88ff0 2024-09-10T05:11:51.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.419+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94152040212272] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.420+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.420+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94152040216528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae961e0 con 0x55a17ae88ff0 2024-09-10T05:11:51.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.420+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae98520 con 0x55a17ae92340 2024-09-10T05:11:51.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.421+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94152040216528] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.421+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.421+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94152040209712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae96150 con 0x55a17ae92340 2024-09-10T05:11:51.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.421+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae99410 con 0x7f499002d910 2024-09-10T05:11:51.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.422+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94152040209712] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.422+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.422+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94152040222560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae99830 con 0x7f499002d910 2024-09-10T05:11:51.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.422+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae9a1f0 con 0x55a17ae88ff0 2024-09-10T05:11:51.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.423+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.423+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94152040226112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae9a610 con 0x55a17ae88ff0 2024-09-10T05:11:51.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.423+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae9b110 con 0x55a17ae8d9e0 2024-09-10T05:11:51.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.423+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94152040222560] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.424+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.424+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94152040229888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae9b500 con 0x55a17ae8d9e0 2024-09-10T05:11:51.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.424+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae9bec0 con 0x55a17ae8d9e0 2024-09-10T05:11:51.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.424+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94152040226112] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.425+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94152040229888] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.425+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.425+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94152040233488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae9c260 con 0x55a17ae8d9e0 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.425+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae9caf0 con 0x55a17ae8d9e0 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.426+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94152040233488] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.426+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.426+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94152040227168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae9cd90 con 0x55a17ae8d9e0 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.426+0000 7f49a912e800 20 add_watcher() i=0 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.426+0000 7f49a912e800 20 add_watcher() i=1 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.426+0000 7f49a912e800 20 add_watcher() i=2 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.426+0000 7f49a912e800 20 add_watcher() i=3 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.426+0000 7f49a912e800 20 add_watcher() i=4 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.426+0000 7f49a912e800 20 add_watcher() i=5 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.426+0000 7f49a912e800 20 add_watcher() i=6 2024-09-10T05:11:51.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.427+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94152040227168] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.427+0000 7f49a912e800 20 add_watcher() i=7 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.427+0000 7f49a912e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.427+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17aea02a0 con 0x55a17ae88ff0 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.427+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.428+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94152040236608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17ae9d7c0 con 0x55a17ae88ff0 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.429+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94152040236608] v35'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.429+0000 7f485afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.429+0000 7f49a912e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.429+0000 7f49a912e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.429+0000 7f49a912e800 5 note: GC not initialized 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.429+0000 7f4859fe3640 20 reqs_thread_entry: start 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.429+0000 7f49a912e800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:51.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.429+0000 7f49a912e800 20 Filter name: none 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.429+0000 7f47cb7fe640 20 reqs_thread_entry: start 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.429+0000 7f49a912e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.429+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.429+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed3510 con 0x55a17ae8d9e0 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a912e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a912e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a912e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a912e800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed1b00 con 0x55a17ae8d9e0 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a912e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a912e800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a912e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a912e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.430+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed2380 con 0x55a17ae8d9e0 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.431+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v35'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.431+0000 7f49a912e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.431+0000 7f49a912e800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.431+0000 7f49a912e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.431+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94152040455888 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed69a0 con 0x7f499002d910 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.431+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== watch-notify(notify (1) cookie 94152040222560 notify 150323855375 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f49a0018ba0 con 0x7f499002d910 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.431+0000 7f487bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855375 cookie 94152040222560 notifier 4546 bl.length()=610 2024-09-10T05:11:51.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.431+0000 7f487bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-10T05:11:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.431+0000 7f487bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T05:11:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.431+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(65 notify.3 [notify cookie 94152040455888 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.431+0000 7f487bfff640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4868003ea0 con 0x7f499002d910 2024-09-10T05:11:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.431+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.432+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== watch-notify(notify_complete (2) cookie 94152040455888 notify 150323855375 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f49a0005040 con 0x7f499002d910 2024-09-10T05:11:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.432+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed1ea0 con 0x55a17ae8d9e0 2024-09-10T05:11:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v35'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f49a912e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:11:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f49a912e800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:11:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f49a912e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:11:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94152040455840 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed69a0 con 0x55a17ae92340 2024-09-10T05:11:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== watch-notify(notify (1) cookie 94152040209712 notify 150323855364 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7f499002dd60 con 0x55a17ae92340 2024-09-10T05:11:51.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f487bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855364 cookie 94152040209712 notifier 4546 bl.length()=192 2024-09-10T05:11:51.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f487bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:11:51.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f487bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:11:51.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f487bfff640 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4868003ea0 con 0x55a17ae92340 2024-09-10T05:11:51.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(68 notify.2 [notify cookie 94152040455840 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.433+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== watch-notify(notify_complete (2) cookie 94152040455840 notify 150323855364 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f499001eb20 con 0x55a17ae92340 2024-09-10T05:11:51.447 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T05:11:51.431072Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:51.431063Z","tags":[],"group_ids":[]} 2024-09-10T05:11:51.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.434+0000 7f485afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:51.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.434+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94152040236608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed11d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.435+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94152040236608] v35'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.435+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94152040212272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed11d0 con 0x7f499002d910 2024-09-10T05:11:51.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.436+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94152040212272] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.436+0000 7f49a912e800 20 remove_watcher() i=0 2024-09-10T05:11:51.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.436+0000 7f49a912e800 2 removed watcher, disabling cache 2024-09-10T05:11:51.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.436+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94152040216528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed11d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.437+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94152040216528] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.437+0000 7f49a912e800 20 remove_watcher() i=1 2024-09-10T05:11:51.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.437+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94152040209712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed11d0 con 0x55a17ae92340 2024-09-10T05:11:51.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.438+0000 7f499ffff640 1 -- 172.21.15.192:0/1641170060 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94152040209712] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4990036040 con 0x55a17ae92340 2024-09-10T05:11:51.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.438+0000 7f49a912e800 20 remove_watcher() i=2 2024-09-10T05:11:51.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.438+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94152040222560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed11d0 con 0x7f499002d910 2024-09-10T05:11:51.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.439+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94152040222560] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x7f499002d910 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.439+0000 7f49a912e800 20 remove_watcher() i=3 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.439+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94152040226112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed11d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.440+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94152040226112] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49a000a4d0 con 0x55a17ae88ff0 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.440+0000 7f49a912e800 20 remove_watcher() i=4 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.440+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94152040229888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed11d0 con 0x55a17ae8d9e0 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.441+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94152040229888] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.441+0000 7f49a912e800 20 remove_watcher() i=5 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.441+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94152040233488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed11d0 con 0x55a17ae8d9e0 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.442+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94152040233488] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.442+0000 7f49a912e800 20 remove_watcher() i=6 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.442+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94152040227168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a17aed11d0 con 0x55a17ae8d9e0 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a4edd640 1 -- 172.21.15.192:0/1641170060 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94152040227168] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49980bd030 con 0x55a17ae8d9e0 2024-09-10T05:11:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 20 remove_watcher() i=7 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a17ae8d9e0 msgr2=0x55a17ae8fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a17ae8d9e0 0x55a17ae8fdd0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a17ae88ff0 msgr2=0x55a17ae8b4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a17ae88ff0 0x55a17ae8b4b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f499002d910 msgr2=0x7f49900393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f499002d910 0x7f49900393c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a17ae92340 msgr2=0x55a17ae94800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a17ae92340 0x55a17ae94800 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f487003c730 msgr2=0x7f487003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f487003c730 0x7f487003ebf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55a17ae58740 tx=0x7f4990022040 comp rx=0 tx=0).stop 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a56de640 1 -- 172.21.15.192:0/1641170060 reap_dead start 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 msgr2=0x55a17ae7db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 0x55a17ae7db60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f499806feb0 tx=0x7f4998074fc0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 shutdown_connections 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 --2- 172.21.15.192:0/1641170060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae76760 0x55a17ae7db60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 >> 172.21.15.192:0/1641170060 conn(0x55a17ae72b60 msgr2=0x55a17ae70d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 shutdown_connections 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 -- 172.21.15.192:0/1641170060 wait complete. 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 -- 172.21.15.192:0/4269547705 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f487c03c6e0 msgr2=0x7f487c03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 --2- 172.21.15.192:0/4269547705 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f487c03c6e0 0x7f487c03eba0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f499000c010 tx=0x7f4990006000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 -- 172.21.15.192:0/4269547705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae69f70 msgr2=0x55a17ae6a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.443+0000 7f49a912e800 1 --2- 172.21.15.192:0/4269547705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae69f70 0x55a17ae6a390 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f49980507d0 tx=0x7f4998097420 comp rx=0 tx=0).stop 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4269547705 shutdown_connections 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 --2- 172.21.15.192:0/4269547705 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f487c03c6e0 0x7f487c03eba0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 --2- 172.21.15.192:0/4269547705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ae69f70 0x55a17ae6a390 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4269547705 >> 172.21.15.192:0/4269547705 conn(0x55a17ae5e320 msgr2=0x55a17ae5e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4269547705 shutdown_connections 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4269547705 wait complete. 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a17ae55790 msgr2=0x55a17ae57c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a17ae55790 0x55a17ae57c10 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a17ad580c0 msgr2=0x55a17ae53370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a17ad580c0 0x55a17ae53370 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a17ae59800 msgr2=0x55a17ae5bbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a17ae59800 0x55a17ae5bbf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f488c03c780 msgr2=0x7f488c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f488c03c780 0x7f488c03ec40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4990000f60 tx=0x7f49900013f0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 msgr2=0x55a17ae4bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 --2- 172.21.15.192:0/4261671224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a17ad55790 0x55a17ae4bd20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4998025da0 tx=0x7f4998002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a56de640 1 -- 172.21.15.192:0/4261671224 reap_dead start 2024-09-10T05:11:51.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 shutdown_connections 2024-09-10T05:11:51.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 >> 172.21.15.192:0/4261671224 conn(0x55a17ad4f250 msgr2=0x55a17ae3e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 shutdown_connections 2024-09-10T05:11:51.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.444+0000 7f49a912e800 1 -- 172.21.15.192:0/4261671224 wait complete. 2024-09-10T05:11:51.459 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T05:11:51.431072Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:51.431063Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:51.459 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T05:11:51.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T05:11:51.459 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-10T05:11:51.507 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:51.507 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:51.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.507+0000 7f1e2ff30800 1 Processor -- start 2024-09-10T05:11:51.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.507+0000 7f1e2ff30800 1 -- start start 2024-09-10T05:11:51.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.507+0000 7f1e2ff30800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5566229c3000 0x5566229cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.507+0000 7f1e2ff30800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55662286ce40 con 0x5566229c14e0 2024-09-10T05:11:51.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.507+0000 7f1e2ff30800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x556622837680 con 0x5566229c3000 2024-09-10T05:11:51.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.508+0000 7f1e23fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5566229c3000 0x5566229cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.508+0000 7f1e23fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5566229c3000 0x5566229cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32802/0 (socket says 172.21.15.192:32802) 2024-09-10T05:11:51.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.508+0000 7f1e23fff640 1 -- 172.21.15.192:0/1199452142 learned_addr learned my addr 172.21.15.192:0/1199452142 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.508+0000 7f1e23fff640 1 -- 172.21.15.192:0/1199452142 >> v1:172.21.15.139:6789/0 conn(0x5566229c14e0 legacy=0x5566229c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.508+0000 7f1e23fff640 1 -- 172.21.15.192:0/1199452142 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566228536b0 con 0x5566229c3000 2024-09-10T05:11:51.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.508+0000 7f1e2b4af640 1 -- 172.21.15.192:0/1199452142 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924339262 0 0) 0x55662286ce40 con 0x5566229c14e0 2024-09-10T05:11:51.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.510+0000 7f1e23fff640 1 --2- 172.21.15.192:0/1199452142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c3000 0x5566229cbb20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400a520 tx=0x7f1e14045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b888efbf6f7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.510+0000 7f1e2b4af640 1 -- 172.21.15.192:0/1199452142 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e14055070 con 0x5566229c3000 2024-09-10T05:11:51.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.510+0000 7f1e2b4af640 1 -- 172.21.15.192:0/1199452142 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e140515b0 con 0x5566229c3000 2024-09-10T05:11:51.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.510+0000 7f1e2b4af640 1 -- 172.21.15.192:0/1199452142 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e140518d0 con 0x5566229c3000 2024-09-10T05:11:51.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.510+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1199452142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c3000 msgr2=0x5566229cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.510+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/1199452142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c3000 0x5566229cbb20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400a520 tx=0x7f1e14045ba0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.510+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1199452142 shutdown_connections 2024-09-10T05:11:51.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.510+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/1199452142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c3000 0x5566229cbb20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.510+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1199452142 >> 172.21.15.192:0/1199452142 conn(0x5566229bd210 msgr2=0x5566229bf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.510+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1199452142 shutdown_connections 2024-09-10T05:11:51.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.510+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1199452142 wait complete. 2024-09-10T05:11:51.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.524+0000 7f1e2ff30800 1 Processor -- start 2024-09-10T05:11:51.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.524+0000 7f1e2ff30800 1 -- start start 2024-09-10T05:11:51.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.524+0000 7f1e2ff30800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 0x556622ab46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.524+0000 7f1e2ff30800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55662285bdd0 con 0x5566229c14e0 2024-09-10T05:11:51.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.525+0000 7f1e2bcb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 0x556622ab46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.525+0000 7f1e2bcb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 0x556622ab46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32804/0 (socket says 172.21.15.192:32804) 2024-09-10T05:11:51.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.525+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/871375039 learned_addr learned my addr 172.21.15.192:0/871375039 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.525+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/871375039 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556622874e10 con 0x5566229c14e0 2024-09-10T05:11:51.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.525+0000 7f1e2bcb0640 1 --2- 172.21.15.192:0/871375039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 0x556622ab46b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c001de0 tx=0x7f1e1c00b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909c452ac4935f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.525+0000 7f1d19e0b640 1 -- 172.21.15.192:0/871375039 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e1c016070 con 0x5566229c14e0 2024-09-10T05:11:51.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.525+0000 7f1d19e0b640 1 -- 172.21.15.192:0/871375039 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00f4d0 con 0x5566229c14e0 2024-09-10T05:11:51.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.525+0000 7f1d19e0b640 1 -- 172.21.15.192:0/871375039 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e1c00f830 con 0x5566229c14e0 2024-09-10T05:11:51.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.526+0000 7f1e2ff30800 1 -- 172.21.15.192:0/871375039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 msgr2=0x556622ab46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.526+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/871375039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 0x556622ab46b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c001de0 tx=0x7f1e1c00b590 comp rx=0 tx=0).stop 2024-09-10T05:11:51.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.526+0000 7f1e2ff30800 1 -- 172.21.15.192:0/871375039 shutdown_connections 2024-09-10T05:11:51.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.526+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/871375039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 0x556622ab46b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.526+0000 7f1e2ff30800 1 -- 172.21.15.192:0/871375039 >> 172.21.15.192:0/871375039 conn(0x5566229bd210 msgr2=0x556622ab0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.526+0000 7f1e2ff30800 1 -- 172.21.15.192:0/871375039 shutdown_connections 2024-09-10T05:11:51.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.526+0000 7f1e2ff30800 1 -- 172.21.15.192:0/871375039 wait complete. 2024-09-10T05:11:51.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.526+0000 7f1e2ff30800 1 Processor -- start 2024-09-10T05:11:51.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.526+0000 7f1e2ff30800 1 -- start start 2024-09-10T05:11:51.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.527+0000 7f1e2ff30800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 0x556622abc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.527+0000 7f1e2ff30800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5566229cc360 con 0x5566229c14e0 2024-09-10T05:11:51.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.527+0000 7f1e2bcb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 0x556622abc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.527+0000 7f1e2bcb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 0x556622abc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32812/0 (socket says 172.21.15.192:32812) 2024-09-10T05:11:51.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.527+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/1160181105 learned_addr learned my addr 172.21.15.192:0/1160181105 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.527+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/1160181105 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556622abc5b0 con 0x5566229c14e0 2024-09-10T05:11:51.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.527+0000 7f1e2bcb0640 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 0x556622abc050 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x556622ab5640 tx=0x7f1e1c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.527+0000 7f1d13fff640 1 -- 172.21.15.192:0/1160181105 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e1c016070 con 0x5566229c14e0 2024-09-10T05:11:51.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.527+0000 7f1d13fff640 1 -- 172.21.15.192:0/1160181105 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e1c023070 con 0x5566229c14e0 2024-09-10T05:11:51.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.527+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556622abc840 con 0x5566229c14e0 2024-09-10T05:11:51.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.527+0000 7f1d13fff640 1 -- 172.21.15.192:0/1160181105 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e1c011d40 con 0x5566229c14e0 2024-09-10T05:11:51.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.527+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556622abd240 con 0x5566229c14e0 2024-09-10T05:11:51.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.528+0000 7f1d13fff640 1 -- 172.21.15.192:0/1160181105 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1e1c028460 con 0x5566229c14e0 2024-09-10T05:11:51.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.528+0000 7f1d13fff640 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1d1403c7d0 0x7f1d1403ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.528+0000 7f1d13fff640 1 -- 172.21.15.192:0/1160181105 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1e1c053c00 con 0x5566229c14e0 2024-09-10T05:11:51.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.529+0000 7f1e23fff640 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1d1403c7d0 0x7f1d1403ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.529+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5566229c3000 0x556622ac36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.529+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622ac3be0 con 0x5566229c3000 2024-09-10T05:11:51.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.529+0000 7f1e2c4b1640 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5566229c3000 0x556622ac36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.529+0000 7f1e23fff640 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1d1403c7d0 0x7f1d1403ec90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1e14057000 tx=0x7f1e14052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.529+0000 7f1e2c4b1640 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5566229c3000 0x556622ac36a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.529+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/1160181105 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x5566229c3000 2024-09-10T05:11:51.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.529+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622ac3f80 con 0x5566229c3000 2024-09-10T05:11:51.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.530+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/1160181105 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e2400a4d0 con 0x5566229c3000 2024-09-10T05:11:51.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.530+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556622ac5a00 0x556622ac7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.530+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622ac8630 con 0x556622ac5a00 2024-09-10T05:11:51.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.530+0000 7f1e2bcb0640 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556622ac5a00 0x556622ac7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.530+0000 7f1e2bcb0640 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556622ac5a00 0x556622ac7ea0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.530+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/1160181105 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1e1c028930 con 0x556622ac5a00 2024-09-10T05:11:51.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.530+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622ac47d0 con 0x5566229c3000 2024-09-10T05:11:51.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.531+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/1160181105 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e2400a4d0 con 0x5566229c3000 2024-09-10T05:11:51.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.531+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556622ac9a90 0x556622acbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.531+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622acc5c0 con 0x556622ac9a90 2024-09-10T05:11:51.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.531+0000 7f1e23fff640 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556622ac9a90 0x556622acbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.531+0000 7f1e23fff640 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556622ac9a90 0x556622acbe80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.531+0000 7f1e23fff640 1 -- 172.21.15.192:0/1160181105 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1e14057030 con 0x556622ac9a90 2024-09-10T05:11:51.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.532+0000 7f1e2ff30800 1 Processor -- start 2024-09-10T05:11:51.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.532+0000 7f1e2ff30800 1 -- start start 2024-09-10T05:11:51.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.532+0000 7f1e2ff30800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ada200 0x556622ada620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.532+0000 7f1e2ff30800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5566228b9a00 con 0x556622ada200 2024-09-10T05:11:51.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.532+0000 7f1e2bcb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ada200 0x556622ada620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.532+0000 7f1e2bcb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ada200 0x556622ada620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32824/0 (socket says 172.21.15.192:32824) 2024-09-10T05:11:51.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.532+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/2870017697 learned_addr learned my addr 172.21.15.192:0/2870017697 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.533+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/2870017697 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556622adac60 con 0x556622ada200 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.533+0000 7f1e2bcb0640 1 --2- 172.21.15.192:0/2870017697 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ada200 0x556622ada620 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c051f80 tx=0x7f1e1c00e390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.533+0000 7f1d117fa640 1 -- 172.21.15.192:0/2870017697 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e1c00e640 con 0x556622ada200 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.533+0000 7f1d117fa640 1 -- 172.21.15.192:0/2870017697 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e1c017040 con 0x556622ada200 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.533+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2870017697 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556622adb490 con 0x556622ada200 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.533+0000 7f1d117fa640 1 -- 172.21.15.192:0/2870017697 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e1c0266a0 con 0x556622ada200 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.533+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2870017697 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556622adb490 con 0x556622ada200 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.534+0000 7f1d117fa640 1 -- 172.21.15.192:0/2870017697 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1e1c0278c0 con 0x556622ada200 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.534+0000 7f1d117fa640 1 --2- 172.21.15.192:0/2870017697 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1d0403c780 0x7f1d0403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.534+0000 7f1d117fa640 1 -- 172.21.15.192:0/2870017697 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1e1c050030 con 0x556622ada200 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.534+0000 7f1e23fff640 1 --2- 172.21.15.192:0/2870017697 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1d0403c780 0x7f1d0403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.534+0000 7f1e2ff30800 1 Processor -- start 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.534+0000 7f1e2ff30800 1 -- start start 2024-09-10T05:11:51.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.534+0000 7f1e23fff640 1 --2- 172.21.15.192:0/2870017697 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1d0403c780 0x7f1d0403ec40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x556622abe110 tx=0x7f1e14005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.535+0000 7f1e2ff30800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 0x556622ae6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.535+0000 7f1e2ff30800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556622ab4f00 con 0x556622ae6940 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.535+0000 7f1e2bcb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 0x556622ae6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.535+0000 7f1e2bcb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 0x556622ae6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32838/0 (socket says 172.21.15.192:32838) 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.535+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/2867907954 learned_addr learned my addr 172.21.15.192:0/2867907954 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.535+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/2867907954 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556622ae7330 con 0x556622ae6940 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.535+0000 7f1e2bcb0640 1 --2- 172.21.15.192:0/2867907954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 0x556622ae6d40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c03e610 tx=0x7f1e1c051490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c1b8f55fa83335 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.535+0000 7f1d0affd640 1 -- 172.21.15.192:0/2867907954 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e1c00db30 con 0x556622ae6940 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.535+0000 7f1d0affd640 1 -- 172.21.15.192:0/2867907954 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e1c0313d0 con 0x556622ae6940 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.535+0000 7f1d0affd640 1 -- 172.21.15.192:0/2867907954 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e1c04ad40 con 0x556622ae6940 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2867907954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 msgr2=0x556622ae6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/2867907954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 0x556622ae6d40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c03e610 tx=0x7f1e1c051490 comp rx=0 tx=0).stop 2024-09-10T05:11:51.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2867907954 shutdown_connections 2024-09-10T05:11:51.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/2867907954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 0x556622ae6d40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2867907954 >> 172.21.15.192:0/2867907954 conn(0x556622ae2d40 msgr2=0x556622ae0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2867907954 shutdown_connections 2024-09-10T05:11:51.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2867907954 wait complete. 2024-09-10T05:11:51.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2ff30800 1 Processor -- start 2024-09-10T05:11:51.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2ff30800 1 -- start start 2024-09-10T05:11:51.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2ff30800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 0x556622aedda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2ff30800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556622ae77a0 con 0x556622ae6940 2024-09-10T05:11:51.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2bcb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 0x556622aedda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2bcb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 0x556622aedda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32850/0 (socket says 172.21.15.192:32850) 2024-09-10T05:11:51.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.536+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 learned_addr learned my addr 172.21.15.192:0/587956766 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.537+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556622aee300 con 0x556622ae6940 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.537+0000 7f1e2bcb0640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 0x556622aedda0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0514d0 tx=0x7f1e1c03e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.537+0000 7f1d097fa640 1 -- 172.21.15.192:0/587956766 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e1c06d070 con 0x556622ae6940 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.537+0000 7f1d097fa640 1 -- 172.21.15.192:0/587956766 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00d3d0 con 0x556622ae6940 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.537+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556622aee300 con 0x556622ae6940 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.537+0000 7f1d097fa640 1 -- 172.21.15.192:0/587956766 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e1c03d200 con 0x556622ae6940 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.537+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556622aee300 con 0x556622ae6940 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.538+0000 7f1d097fa640 1 -- 172.21.15.192:0/587956766 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1e1c070070 con 0x556622ae6940 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.538+0000 7f1d097fa640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1cf403c6e0 0x7f1cf403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.538+0000 7f1d097fa640 1 -- 172.21.15.192:0/587956766 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1e1c059070 con 0x556622ae6940 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.538+0000 7f1e23fff640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1cf403c6e0 0x7f1cf403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.538+0000 7f1e23fff640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1cf403c6e0 0x7f1cf403eba0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1e14000c00 tx=0x7f1e14053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.538+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.538+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556622af9390 0x556622afb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.538+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622afbfa0 con 0x556622af9390 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.539+0000 7f1e2c4b1640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556622af9390 0x556622afb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.539+0000 7f1e2c4b1640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556622af9390 0x556622afb850 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.539+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.539+0000 7f1e2ff30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.539+0000 7f1e2ff30800 20 realm 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.539+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.539+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622afc3b0 con 0x556622af9390 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.539+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.539+0000 7f1e2ff30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.539+0000 7f1e2ff30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.539+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.539+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622afcc80 con 0x556622af9390 2024-09-10T05:11:51.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.540+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.540+0000 7f1e2ff30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.540+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.540+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622af9390 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.540+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.540+0000 7f1e2ff30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.540+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.540+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556622afdd80 0x556622b00170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.540+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b00730 con 0x556622afdd80 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.540+0000 7f1e2bcb0640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556622afdd80 0x556622b00170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.540+0000 7f1e2bcb0640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556622afdd80 0x556622b00170 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.541+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.541+0000 7f1e2ff30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.541+0000 7f1e2ff30800 20 searching for the correct realm 2024-09-10T05:11:51.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.541+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556622b026e0 0x556622b04ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.541+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622b05270 con 0x556622b026e0 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.541+0000 7f1e23fff640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556622b026e0 0x556622b04ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.541+0000 7f1e23fff640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556622b026e0 0x556622b04ba0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.541+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.541+0000 7f1e23fff640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1e14069040 0x7f1e1406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.541+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622b05270 con 0x7f1e14069040 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.542+0000 7f1e2c4b1640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1e14069040 0x7f1e1406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.542+0000 7f1e2c4b1640 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1e14069040 0x7f1e1406a940 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.542+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.542+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622afdd80 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.542+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.542+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622af9390 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.543+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.543+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622af9390 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.543+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.543+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622afdd80 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.543+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.543+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622afdd80 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.543+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.543+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x7f1e14069040 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.544+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.544+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622b026e0 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.544+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.544+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622af9390 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.544+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.544+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622afdd80 2024-09-10T05:11:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.544+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.544+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622af9390 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.545+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.545+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x7f1e14069040 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.545+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.545+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622b026e0 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.545+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.545+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622b026e0 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.545+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.545+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622afdd80 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.546+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.546+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622b026e0 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.546+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.546+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622b026e0 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.546+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.546+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622af9390 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.546+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.546+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622af9390 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.547+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.547+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622afdd80 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.547+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.547+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622b026e0 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.547+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.547+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x7f1e14069040 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.547+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.547+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622af9390 2024-09-10T05:11:51.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.548+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.548+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622afdd80 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.548+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.548+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622b026e0 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.548+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.548+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622afdd80 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.548+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.548+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x7f1e14069040 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.549+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.549+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622b026e0 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.549+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.549+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622afdd80 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.549+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.549+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x556622af9390 2024-09-10T05:11:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.549+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.549+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556622afd020 con 0x7f1e14069040 2024-09-10T05:11:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b00ff0 con 0x556622af9390 2024-09-10T05:11:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b00ff0 con 0x556622af9390 2024-09-10T05:11:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b00ff0 con 0x7f1e14069040 2024-09-10T05:11:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 zone default found 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 4 Realm: () 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 zonegroup default 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.550+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b00fd0 con 0x556622afdd80 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e2ff30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b070e0 con 0x556622b026e0 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e2ff30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b07480 con 0x556622b026e0 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e2ff30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e2ff30800 20 started sync module instance, tier type = 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e2ff30800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.551+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b06580 con 0x7f1e14069040 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.552+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.552+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93897157012144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b06580 con 0x7f1e14069040 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.552+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b07e40 con 0x556622af9390 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.553+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93897157012144] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.554+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.554+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93897157010096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b07e40 con 0x556622af9390 2024-09-10T05:11:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.554+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b08840 con 0x556622b026e0 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.555+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.555+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93897157018448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b090e0 con 0x556622b026e0 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.555+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b09b80 con 0x7f1e14069040 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.555+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93897157010096] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.556+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.556+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93897157023312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b09f70 con 0x7f1e14069040 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.556+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b0a990 con 0x556622af9390 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.556+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93897157018448] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.557+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93897157023312] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.557+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.557+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93897157015952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b0a950 con 0x556622af9390 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.557+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b08ca0 con 0x556622afdd80 2024-09-10T05:11:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.558+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.558+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93897157029248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b0b650 con 0x556622afdd80 2024-09-10T05:11:51.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.558+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93897157015952] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.558+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b0a4c0 con 0x556622afdd80 2024-09-10T05:11:51.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.559+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93897157029248] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.559+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.559+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93897157032896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b0c490 con 0x556622afdd80 2024-09-10T05:11:51.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.559+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b0cd20 con 0x556622afdd80 2024-09-10T05:11:51.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.560+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93897157032896] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.560+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.560+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93897157033952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b0cf00 con 0x556622afdd80 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.561+0000 7f1e2ff30800 20 add_watcher() i=0 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.561+0000 7f1e2ff30800 20 add_watcher() i=1 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.561+0000 7f1e2ff30800 20 add_watcher() i=2 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.561+0000 7f1e2ff30800 20 add_watcher() i=3 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.561+0000 7f1e2ff30800 20 add_watcher() i=4 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.561+0000 7f1e2ff30800 20 add_watcher() i=5 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.561+0000 7f1e2ff30800 20 add_watcher() i=6 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.561+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93897157033952] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.562+0000 7f1e2ff30800 20 add_watcher() i=7 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.562+0000 7f1e2ff30800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:51.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.562+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b102d0 con 0x556622af9390 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.562+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.562+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93897157037552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b0d6f0 con 0x556622af9390 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.563+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93897157037552] v35'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.563+0000 7f1ce1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.563+0000 7f1e2ff30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.563+0000 7f1e2ff30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.563+0000 7f1e2ff30800 5 note: GC not initialized 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.563+0000 7f1ce0fe1640 20 reqs_thread_entry: start 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.563+0000 7f1e2ff30800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.564+0000 7f1e2ff30800 20 Filter name: none 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.564+0000 7f1c5a7fc640 20 reqs_thread_entry: start 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.564+0000 7f1e2ff30800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.564+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.564+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b433f0 con 0x556622afdd80 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 20 rados_obj.operate() r=0 bl.length=419 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b44ed0 con 0x7f1e14069040 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:51.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 : miss 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.565+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b46a40 con 0x556622b026e0 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.566+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.566+0000 7f1e2ff30800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.566+0000 7f1e2ff30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.566+0000 7f1e2ff30800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.566+0000 7f1e2ff30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.566+0000 7f1e2ff30800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.566+0000 7f1e2ff30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.566+0000 7f1e2ff30800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.566+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b4b4a0 con 0x7f1e14069040 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.567+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(65 foo.buckets [call] v35'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.567+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 8.b 8:d0b4acb6:root::.bucket.meta.testx%3amyfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b4edb0 con 0x556622b026e0 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [create,call,writefull 0~420,setxattr (203)] v35'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1e2ff30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x7 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1e2ff30800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1e2ff30800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1e2ff30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1, ofs0, ns] 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93897157299168 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b4e840 con 0x556622b026e0 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== watch-notify(notify (1) cookie 93897157018448 notify 150323855365 ret 0) ==== 897+0+0 (crc 0 0 0) 0x556622b4f150 con 0x556622b026e0 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1d0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855365 cookie 93897157018448 notifier 4553 bl.length()=855 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1d0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x7 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1d0affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1d0affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1d0affd640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1cf0003ea0 con 0x556622b026e0 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.568+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(67 notify.2 [notify cookie 93897157299168 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.569+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.569+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== watch-notify(notify_complete (2) cookie 93897157299168 notify 150323855365 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556622b4b260 con 0x556622b026e0 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.569+0000 7f1e2ff30800 20 handle_bi_update(): bucket=testx:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): orig_sources= new_sources= 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.569+0000 7f1e2ff30800 20 handle_bi_update(): bucket=testx:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): potential sources added=[] removed=[] 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.569+0000 7f1e2ff30800 20 handle_bi_update(): bucket=testx:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): orig_dests= new_dests= 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.569+0000 7f1e2ff30800 20 handle_bi_update(): bucket=testx:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): potential dests added=[] removed=[] 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.569+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b4e940 con 0x556622af9390 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.570+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v35'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.570+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b4e940 con 0x556622af9390 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.571+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v35'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.571+0000 7f1e2ff30800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.571+0000 7f1e2ff30800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.571+0000 7f1e2ff30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-10T05:11:51.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.571+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 93897157305488 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b4e8b0 con 0x556622af9390 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.571+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 93897157015952 notify 150323855371 ret 0) ==== 390+0+0 (crc 0 0 0) 0x556622b4ece0 con 0x556622af9390 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.571+0000 7f1d0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855371 cookie 93897157015952 notifier 4553 bl.length()=348 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.571+0000 7f1d0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.571+0000 7f1d0a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.571+0000 7f1d0a7fc640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1c60003400 con 0x556622af9390 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.571+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(71 notify.4 [notify cookie 93897157305488 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.572+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== watch-notify(notify_complete (2) cookie 93897157305488 notify 150323855371 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556622b4dbf0 con 0x556622af9390 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.572+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.572+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b4e940 con 0x7f1e14069040 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.573+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(73 myfoo [call,delete] v35'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.573+0000 7f1e2ff30800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.573+0000 7f1e2ff30800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:11:51.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.573+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93897157305488 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b4e8b0 con 0x556622afdd80 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.573+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== watch-notify(notify (1) cookie 93897157032896 notify 150323855374 ret 0) ==== 191+0+0 (crc 0 0 0) 0x556622adac60 con 0x556622afdd80 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.573+0000 7f1d0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855374 cookie 93897157032896 notifier 4553 bl.length()=149 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.573+0000 7f1d0affd640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1cf0003ea0 con 0x556622afdd80 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.573+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(74 notify.6 [notify cookie 93897157305488 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.574+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.574+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== watch-notify(notify_complete (2) cookie 93897157305488 notify 150323855374 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1e1c048040 con 0x556622afdd80 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.574+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:76 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b4e940 con 0x556622b026e0 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.575+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(76 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call,delete] v35'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.575+0000 7f1e2ff30800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 from cache 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.575+0000 7f1e2ff30800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1, ofs0, ns] 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.575+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 93897157275872 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556622b4e940 con 0x7f1e14069040 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.575+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== watch-notify(notify (1) cookie 93897157023312 notify 150323855376 ret 0) ==== 248+0+0 (crc 0 0 0) 0x556622b4dbf0 con 0x7f1e14069040 2024-09-10T05:11:51.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.575+0000 7f1d0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855376 cookie 93897157023312 notifier 4553 bl.length()=206 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.575+0000 7f1d0a7fc640 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1c60003400 con 0x7f1e14069040 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.575+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(77 notify.3 [notify cookie 93897157275872 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.575+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== watch-notify(notify_complete (2) cookie 93897157275872 notify 150323855376 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1e24018d60 con 0x7f1e14069040 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.575+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.576+0000 7f1ce1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.576+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93897157037552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b41140 con 0x556622af9390 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.577+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93897157037552] v35'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.577+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93897157012144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b41140 con 0x7f1e14069040 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.578+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93897157012144] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.578+0000 7f1e2ff30800 20 remove_watcher() i=0 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.578+0000 7f1e2ff30800 2 removed watcher, disabling cache 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.578+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93897157010096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b41140 con 0x556622af9390 2024-09-10T05:11:51.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.579+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93897157010096] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.579+0000 7f1e2ff30800 20 remove_watcher() i=1 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.579+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93897157018448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b41140 con 0x556622b026e0 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.580+0000 7f1e23fff640 1 -- 172.21.15.192:0/587956766 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93897157018448] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e14057030 con 0x556622b026e0 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.580+0000 7f1e2ff30800 20 remove_watcher() i=2 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.580+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93897157023312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b41140 con 0x7f1e14069040 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.581+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93897157023312] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x7f1e14069040 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.581+0000 7f1e2ff30800 20 remove_watcher() i=3 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.581+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93897157015952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b41140 con 0x556622af9390 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.582+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93897157015952] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e2400a4d0 con 0x556622af9390 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.582+0000 7f1e2ff30800 20 remove_watcher() i=4 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.582+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93897157029248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b41140 con 0x556622afdd80 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.583+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93897157029248] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.583+0000 7f1e2ff30800 20 remove_watcher() i=5 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.583+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93897157032896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b41140 con 0x556622afdd80 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.584+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93897157032896] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.584+0000 7f1e2ff30800 20 remove_watcher() i=6 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.584+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93897157033952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556622b41140 con 0x556622afdd80 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2bcb0640 1 -- 172.21.15.192:0/587956766 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93897157033952] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e1c06f030 con 0x556622afdd80 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 20 remove_watcher() i=7 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556622afdd80 msgr2=0x556622b00170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556622afdd80 0x556622b00170 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556622af9390 msgr2=0x556622afb850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556622af9390 0x556622afb850 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1e14069040 msgr2=0x7f1e1406a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1e14069040 0x7f1e1406a940 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556622b026e0 msgr2=0x556622b04ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556622b026e0 0x556622b04ba0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1cf403c6e0 msgr2=0x7f1cf403eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1cf403c6e0 0x7f1cf403eba0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1e14000c00 tx=0x7f1e14053000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 msgr2=0x556622aedda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/587956766 reap_dead start 2024-09-10T05:11:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.585+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 0x556622aedda0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0514d0 tx=0x7f1e1c03e570 comp rx=0 tx=0).stop 2024-09-10T05:11:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 shutdown_connections 2024-09-10T05:11:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/587956766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ae6940 0x556622aedda0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 >> 172.21.15.192:0/587956766 conn(0x556622ae2d40 msgr2=0x556622ae0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 shutdown_connections 2024-09-10T05:11:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/587956766 wait complete. 2024-09-10T05:11:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2870017697 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1d0403c780 msgr2=0x7f1d0403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/2870017697 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1d0403c780 0x7f1d0403ec40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x556622abe110 tx=0x7f1e14005ac0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2870017697 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ada200 msgr2=0x556622ada620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/2870017697 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ada200 0x556622ada620 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c051f80 tx=0x7f1e1c00e390 comp rx=0 tx=0).stop 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2870017697 shutdown_connections 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/2870017697 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1d0403c780 0x7f1d0403ec40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/2870017697 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556622ada200 0x556622ada620 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2870017697 >> 172.21.15.192:0/2870017697 conn(0x556622ace5b0 msgr2=0x556622ace990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2870017697 shutdown_connections 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/2870017697 wait complete. 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556622ac5a00 msgr2=0x556622ac7ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556622ac5a00 0x556622ac7ea0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5566229c3000 msgr2=0x556622ac36a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5566229c3000 0x556622ac36a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556622ac9a90 msgr2=0x556622acbe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556622ac9a90 0x556622acbe80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1d1403c7d0 msgr2=0x7f1d1403ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1d1403c7d0 0x7f1d1403ec90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1e14057000 tx=0x7f1e14052000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 msgr2=0x556622abc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.586+0000 7f1e2ff30800 1 --2- 172.21.15.192:0/1160181105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566229c14e0 0x556622abc050 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x556622ab5640 tx=0x7f1e1c000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.587+0000 7f1e2c4b1640 1 -- 172.21.15.192:0/1160181105 reap_dead start 2024-09-10T05:11:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.587+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 shutdown_connections 2024-09-10T05:11:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.587+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 >> 172.21.15.192:0/1160181105 conn(0x5566229bd210 msgr2=0x556622ab5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.587+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 shutdown_connections 2024-09-10T05:11:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.587+0000 7f1e2ff30800 1 -- 172.21.15.192:0/1160181105 wait complete. 2024-09-10T05:11:51.604 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-10T05:11:51.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-10T05:11:51.605 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-10T05:11:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.647+0000 7f94e1134800 1 Processor -- start 2024-09-10T05:11:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.648+0000 7f94e1134800 1 -- start start 2024-09-10T05:11:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.648+0000 7f94e1134800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5652c2a83600 0x5652c2a859f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.648+0000 7f94e1134800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5652c292ce40 con 0x5652c2a86020 2024-09-10T05:11:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.648+0000 7f94e1134800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5652c28f7680 con 0x5652c2a83600 2024-09-10T05:11:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.648+0000 7f94dceb7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5652c2a83600 0x5652c2a859f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.648+0000 7f94d7fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5652c2a86020 0x5652c2a884e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36500/0 (socket says 172.21.15.192:36500) 2024-09-10T05:11:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.648+0000 7f94d7fff640 1 -- 172.21.15.192:0/318765016 learned_addr learned my addr 172.21.15.192:0/318765016 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.648+0000 7f94dceb7640 1 -- 172.21.15.192:0/318765016 >> v1:172.21.15.139:6789/0 conn(0x5652c2a86020 legacy=0x5652c2a884e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.648+0000 7f94d77fe640 1 -- 172.21.15.192:0/318765016 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3535224812 0 0) 0x5652c292ce40 con 0x5652c2a86020 2024-09-10T05:11:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.648+0000 7f94dceb7640 1 -- 172.21.15.192:0/318765016 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c29136b0 con 0x5652c2a83600 2024-09-10T05:11:51.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.650+0000 7f94dceb7640 1 --2- 172.21.15.192:0/318765016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2a859f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f94d000a470 tx=0x7f94d0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640556d924fdd491 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.650+0000 7f94d77fe640 1 -- 172.21.15.192:0/318765016 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d0053570 con 0x5652c2a83600 2024-09-10T05:11:51.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.650+0000 7f94d77fe640 1 -- 172.21.15.192:0/318765016 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d0058070 con 0x5652c2a83600 2024-09-10T05:11:51.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.650+0000 7f94d77fe640 1 -- 172.21.15.192:0/318765016 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d0053880 con 0x5652c2a83600 2024-09-10T05:11:51.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.651+0000 7f94e1134800 1 -- 172.21.15.192:0/318765016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 msgr2=0x5652c2a859f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.651+0000 7f94e1134800 1 --2- 172.21.15.192:0/318765016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2a859f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f94d000a470 tx=0x7f94d0045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:51.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.651+0000 7f94e1134800 1 -- 172.21.15.192:0/318765016 shutdown_connections 2024-09-10T05:11:51.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.651+0000 7f94e1134800 1 --2- 172.21.15.192:0/318765016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2a859f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.651+0000 7f94e1134800 1 -- 172.21.15.192:0/318765016 >> 172.21.15.192:0/318765016 conn(0x5652c2a7d1c0 msgr2=0x5652c2a7f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.651+0000 7f94e1134800 1 -- 172.21.15.192:0/318765016 shutdown_connections 2024-09-10T05:11:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.651+0000 7f94e1134800 1 -- 172.21.15.192:0/318765016 wait complete. 2024-09-10T05:11:51.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.665+0000 7f94e1134800 1 Processor -- start 2024-09-10T05:11:51.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.665+0000 7f94e1134800 1 -- start start 2024-09-10T05:11:51.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.665+0000 7f94e1134800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2b72550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.665+0000 7f94e1134800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5652c291bdd0 con 0x5652c2a83600 2024-09-10T05:11:51.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.665+0000 7f94dceb7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2b72550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.665+0000 7f94dceb7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2b72550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32866/0 (socket says 172.21.15.192:32866) 2024-09-10T05:11:51.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.665+0000 7f94dceb7640 1 -- 172.21.15.192:0/1806373720 learned_addr learned my addr 172.21.15.192:0/1806373720 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.666+0000 7f94dceb7640 1 -- 172.21.15.192:0/1806373720 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c2934e10 con 0x5652c2a83600 2024-09-10T05:11:51.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.666+0000 7f94dceb7640 1 --2- 172.21.15.192:0/1806373720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2b72550 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f94d0025c20 tx=0x7f94d0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b591aef488a6779c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.666+0000 7f93cae05640 1 -- 172.21.15.192:0/1806373720 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d0053a20 con 0x5652c2a83600 2024-09-10T05:11:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.666+0000 7f93cae05640 1 -- 172.21.15.192:0/1806373720 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d0063070 con 0x5652c2a83600 2024-09-10T05:11:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.666+0000 7f93cae05640 1 -- 172.21.15.192:0/1806373720 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d0053d30 con 0x5652c2a83600 2024-09-10T05:11:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94e1134800 1 -- 172.21.15.192:0/1806373720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 msgr2=0x5652c2b72550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94e1134800 1 --2- 172.21.15.192:0/1806373720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2b72550 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f94d0025c20 tx=0x7f94d0051000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94e1134800 1 -- 172.21.15.192:0/1806373720 shutdown_connections 2024-09-10T05:11:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94e1134800 1 --2- 172.21.15.192:0/1806373720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2b72550 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94e1134800 1 -- 172.21.15.192:0/1806373720 >> 172.21.15.192:0/1806373720 conn(0x5652c2a7d1c0 msgr2=0x5652c2b6ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94e1134800 1 -- 172.21.15.192:0/1806373720 shutdown_connections 2024-09-10T05:11:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94e1134800 1 -- 172.21.15.192:0/1806373720 wait complete. 2024-09-10T05:11:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94e1134800 1 Processor -- start 2024-09-10T05:11:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94e1134800 1 -- start start 2024-09-10T05:11:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94e1134800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2b79e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94e1134800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5652c2a8a040 con 0x5652c2a83600 2024-09-10T05:11:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94dceb7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2b79e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94dceb7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2b79e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32872/0 (socket says 172.21.15.192:32872) 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.667+0000 7f94dceb7640 1 -- 172.21.15.192:0/3088993681 learned_addr learned my addr 172.21.15.192:0/3088993681 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.668+0000 7f94dceb7640 1 -- 172.21.15.192:0/3088993681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c2b7a380 con 0x5652c2a83600 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.668+0000 7f94dceb7640 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2b79e20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f94d0025c20 tx=0x7f94d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.668+0000 7f93c9602640 1 -- 172.21.15.192:0/3088993681 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d0078070 con 0x5652c2a83600 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.668+0000 7f93c9602640 1 -- 172.21.15.192:0/3088993681 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d0073470 con 0x5652c2a83600 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.668+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652c2b7a610 con 0x5652c2a83600 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.668+0000 7f93c9602640 1 -- 172.21.15.192:0/3088993681 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d0073750 con 0x5652c2a83600 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.668+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652c2b7b220 con 0x5652c2a83600 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.669+0000 7f93c9602640 1 -- 172.21.15.192:0/3088993681 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f94d007b070 con 0x5652c2a83600 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.669+0000 7f93c9602640 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93c403c780 0x7f93c403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.669+0000 7f93c9602640 1 -- 172.21.15.192:0/3088993681 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f94d0097b80 con 0x5652c2a83600 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.669+0000 7f94d7fff640 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93c403c780 0x7f93c403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.669+0000 7f94e1134800 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652c2a86020 0x5652c2b81470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.669+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2b7bbe0 con 0x5652c2a86020 2024-09-10T05:11:51.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.669+0000 7f94dd6b8640 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652c2a86020 0x5652c2b81470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.670+0000 7f94d7fff640 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93c403c780 0x7f93c403ec40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f94c8000c00 tx=0x7f94c80013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.670+0000 7f94dd6b8640 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652c2a86020 0x5652c2b81470 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.670+0000 7f94dd6b8640 1 -- 172.21.15.192:0/3088993681 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2a86020 2024-09-10T05:11:51.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.670+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2b7b590 con 0x5652c2a86020 2024-09-10T05:11:51.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.670+0000 7f94dd6b8640 1 -- 172.21.15.192:0/3088993681 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2a86020 2024-09-10T05:11:51.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.670+0000 7f94e1134800 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652c2b838e0 0x5652c2b85cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.670+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2b863a0 con 0x5652c2b838e0 2024-09-10T05:11:51.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.670+0000 7f94dceb7640 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652c2b838e0 0x5652c2b85cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.671+0000 7f94dceb7640 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652c2b838e0 0x5652c2b85cd0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.671+0000 7f94dceb7640 1 -- 172.21.15.192:0/3088993681 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2b838e0 2024-09-10T05:11:51.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.671+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2b82780 con 0x5652c2a86020 2024-09-10T05:11:51.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.671+0000 7f94dd6b8640 1 -- 172.21.15.192:0/3088993681 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2a86020 2024-09-10T05:11:51.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.671+0000 7f94e1134800 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5652c2b877e0 0x5652c2b89bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.671+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2b8a310 con 0x5652c2b877e0 2024-09-10T05:11:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.672+0000 7f94d7fff640 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5652c2b877e0 0x5652c2b89bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.672+0000 7f94d7fff640 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5652c2b877e0 0x5652c2b89bd0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.672+0000 7f94d7fff640 1 -- 172.21.15.192:0/3088993681 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f94c800f670 con 0x5652c2b877e0 2024-09-10T05:11:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.672+0000 7f94e1134800 1 Processor -- start 2024-09-10T05:11:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.672+0000 7f94e1134800 1 -- start start 2024-09-10T05:11:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.672+0000 7f94e1134800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2b97f70 0x5652c2b98390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.672+0000 7f94e1134800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5652c2979a00 con 0x5652c2b97f70 2024-09-10T05:11:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.673+0000 7f94dceb7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2b97f70 0x5652c2b98390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.673+0000 7f94dceb7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2b97f70 0x5652c2b98390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32888/0 (socket says 172.21.15.192:32888) 2024-09-10T05:11:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.673+0000 7f94dceb7640 1 -- 172.21.15.192:0/598650032 learned_addr learned my addr 172.21.15.192:0/598650032 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.673+0000 7f94dceb7640 1 -- 172.21.15.192:0/598650032 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c2b989d0 con 0x5652c2b97f70 2024-09-10T05:11:51.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.673+0000 7f94dceb7640 1 --2- 172.21.15.192:0/598650032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2b97f70 0x5652c2b98390 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f94d0095f00 tx=0x7f94d005de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.673+0000 7f93c27fc640 1 -- 172.21.15.192:0/598650032 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d007c6a0 con 0x5652c2b97f70 2024-09-10T05:11:51.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.673+0000 7f93c27fc640 1 -- 172.21.15.192:0/598650032 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d007c840 con 0x5652c2b97f70 2024-09-10T05:11:51.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.673+0000 7f94e1134800 1 -- 172.21.15.192:0/598650032 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652c2b99200 con 0x5652c2b97f70 2024-09-10T05:11:51.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.673+0000 7f93c27fc640 1 -- 172.21.15.192:0/598650032 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d00685e0 con 0x5652c2b97f70 2024-09-10T05:11:51.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.673+0000 7f94e1134800 1 -- 172.21.15.192:0/598650032 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652c2b997a0 con 0x5652c2b97f70 2024-09-10T05:11:51.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.674+0000 7f93c27fc640 1 -- 172.21.15.192:0/598650032 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f94d0068780 con 0x5652c2b97f70 2024-09-10T05:11:51.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.674+0000 7f93c27fc640 1 --2- 172.21.15.192:0/598650032 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93b403c730 0x7f93b403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.674+0000 7f93c27fc640 1 -- 172.21.15.192:0/598650032 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f94d008f070 con 0x5652c2b97f70 2024-09-10T05:11:51.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.674+0000 7f94d7fff640 1 --2- 172.21.15.192:0/598650032 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93b403c730 0x7f93b403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.674+0000 7f94e1134800 1 Processor -- start 2024-09-10T05:11:51.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.675+0000 7f94e1134800 1 -- start start 2024-09-10T05:11:51.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.675+0000 7f94d7fff640 1 --2- 172.21.15.192:0/598650032 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93b403c730 0x7f93b403ebf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5652c2b81a80 tx=0x7f94c8006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.675+0000 7f94e1134800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 0x5652c2ba4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.675+0000 7f94e1134800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5652c2b72d40 con 0x5652c2ba47f0 2024-09-10T05:11:51.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.675+0000 7f94dceb7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 0x5652c2ba4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.675+0000 7f94dceb7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 0x5652c2ba4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32890/0 (socket says 172.21.15.192:32890) 2024-09-10T05:11:51.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.675+0000 7f94dceb7640 1 -- 172.21.15.192:0/413561252 learned_addr learned my addr 172.21.15.192:0/413561252 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.675+0000 7f94dceb7640 1 -- 172.21.15.192:0/413561252 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c2ba51c0 con 0x5652c2ba47f0 2024-09-10T05:11:51.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.675+0000 7f94dceb7640 1 --2- 172.21.15.192:0/413561252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 0x5652c2ba4bd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f94d006afa0 tx=0x7f94d0061e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6468052940b72816 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.675+0000 7f93b3fff640 1 -- 172.21.15.192:0/413561252 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d007d440 con 0x5652c2ba47f0 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.675+0000 7f93b3fff640 1 -- 172.21.15.192:0/413561252 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d00923c0 con 0x5652c2ba47f0 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.675+0000 7f93b3fff640 1 -- 172.21.15.192:0/413561252 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d0074040 con 0x5652c2ba47f0 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.676+0000 7f94e1134800 1 -- 172.21.15.192:0/413561252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 msgr2=0x5652c2ba4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.676+0000 7f94e1134800 1 --2- 172.21.15.192:0/413561252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 0x5652c2ba4bd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f94d006afa0 tx=0x7f94d0061e30 comp rx=0 tx=0).stop 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.676+0000 7f94e1134800 1 -- 172.21.15.192:0/413561252 shutdown_connections 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.676+0000 7f94e1134800 1 --2- 172.21.15.192:0/413561252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 0x5652c2ba4bd0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.676+0000 7f94e1134800 1 -- 172.21.15.192:0/413561252 >> 172.21.15.192:0/413561252 conn(0x5652c2ba0bf0 msgr2=0x5652c2b9ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.676+0000 7f94e1134800 1 -- 172.21.15.192:0/413561252 shutdown_connections 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.676+0000 7f94e1134800 1 -- 172.21.15.192:0/413561252 wait complete. 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.676+0000 7f94e1134800 1 Processor -- start 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.676+0000 7f94e1134800 1 -- start start 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.676+0000 7f94e1134800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 0x5652c2babc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.676+0000 7f94e1134800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5652c2ba5650 con 0x5652c2ba47f0 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.677+0000 7f94dceb7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 0x5652c2babc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.677+0000 7f94dceb7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 0x5652c2babc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32892/0 (socket says 172.21.15.192:32892) 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.677+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 learned_addr learned my addr 172.21.15.192:0/1713746418 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.677+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c2bac170 con 0x5652c2ba47f0 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.677+0000 7f94dceb7640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 0x5652c2babc10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f94d0053730 tx=0x7f94d006af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.677+0000 7f93b27fc640 1 -- 172.21.15.192:0/1713746418 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d007d440 con 0x5652c2ba47f0 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.677+0000 7f93b27fc640 1 -- 172.21.15.192:0/1713746418 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d0052bf0 con 0x5652c2ba47f0 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.677+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652c2bac170 con 0x5652c2ba47f0 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.677+0000 7f93b27fc640 1 -- 172.21.15.192:0/1713746418 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d007d660 con 0x5652c2ba47f0 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.677+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652c2bac170 con 0x5652c2ba47f0 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.678+0000 7f93b27fc640 1 -- 172.21.15.192:0/1713746418 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f94d00bd030 con 0x5652c2ba47f0 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.678+0000 7f93b27fc640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93a803c780 0x7f93a803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.678+0000 7f93b27fc640 1 -- 172.21.15.192:0/1713746418 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f94d00bb070 con 0x5652c2ba47f0 2024-09-10T05:11:51.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.678+0000 7f94d7fff640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93a803c780 0x7f93a803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.679+0000 7f94e1134800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.679+0000 7f94e1134800 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652c2bb7110 0x5652c2bb95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.679+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bb9d20 con 0x5652c2bb7110 2024-09-10T05:11:51.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.679+0000 7f94dd6b8640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652c2bb7110 0x5652c2bb95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.679+0000 7f94d7fff640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93a803c780 0x7f93a803ec40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f94c800ffd0 tx=0x7f94c8023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.679+0000 7f94dd6b8640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652c2bb7110 0x5652c2bb95d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.679+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.679+0000 7f94e1134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.679+0000 7f94e1134800 20 realm 2024-09-10T05:11:51.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.679+0000 7f94e1134800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.679+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bba130 con 0x5652c2bb7110 2024-09-10T05:11:51.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94e1134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94e1134800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:51.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94e1134800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbaa00 con 0x5652c2bb7110 2024-09-10T05:11:51.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94e1134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94e1134800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bb7110 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94e1134800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94e1134800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94e1134800 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652c2bbb890 0x5652c2bbdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbe3c0 con 0x5652c2bbb890 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.680+0000 7f94dceb7640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652c2bbb890 0x5652c2bbdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.681+0000 7f94dceb7640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652c2bbb890 0x5652c2bbdc80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.681+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.681+0000 7f94e1134800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.681+0000 7f94e1134800 20 searching for the correct realm 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.681+0000 7f94e1134800 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5652c2bc0460 0x5652c2bc2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.681+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc2ff0 con 0x5652c2bc0460 2024-09-10T05:11:51.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.681+0000 7f94d7fff640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5652c2bc0460 0x5652c2bc2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.681+0000 7f94d7fff640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5652c2bc0460 0x5652c2bc2920 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.682+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.682+0000 7f94d7fff640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f94c802e910 0x7f94c803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.682+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc2ff0 con 0x7f94c802e910 2024-09-10T05:11:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.682+0000 7f94dd6b8640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f94c802e910 0x7f94c803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.682+0000 7f94dd6b8640 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f94c802e910 0x7f94c803a3c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.682+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.682+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bbb890 2024-09-10T05:11:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.682+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.682+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bb7110 2024-09-10T05:11:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.683+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.683+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bb7110 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.683+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.683+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bbb890 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.683+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.683+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bbb890 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.683+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.683+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x7f94c802e910 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.684+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.684+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bc0460 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.684+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.684+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bb7110 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.684+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.684+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bbb890 2024-09-10T05:11:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.685+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.685+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bb7110 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.685+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.685+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x7f94c802e910 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.685+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.685+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bc0460 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.685+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.685+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bc0460 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.685+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.685+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bbb890 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.686+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.686+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bc0460 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.686+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.686+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bc0460 2024-09-10T05:11:51.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.686+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.686+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bb7110 2024-09-10T05:11:51.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.687+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.687+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bb7110 2024-09-10T05:11:51.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.687+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.687+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bbb890 2024-09-10T05:11:51.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.687+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.687+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bc0460 2024-09-10T05:11:51.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.687+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.687+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x7f94c802e910 2024-09-10T05:11:51.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.688+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.688+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bb7110 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.688+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.688+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bbb890 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.688+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.688+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bc0460 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.688+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.688+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bbb890 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.689+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.689+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x7f94c802e910 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.689+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.689+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bc0460 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.689+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.689+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bbb890 2024-09-10T05:11:51.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.689+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.689+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x5652c2bb7110 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbada0 con 0x7f94c802e910 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbed60 con 0x5652c2bb7110 2024-09-10T05:11:51.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbed60 con 0x5652c2bb7110 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.690+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbed30 con 0x7f94c802e910 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 20 zone default found 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 4 Realm: () 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:51.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 20 zonegroup default 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbf150 con 0x5652c2bbb890 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bbeb00 con 0x5652c2bc0460 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.691+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc4e60 con 0x5652c2bc0460 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.692+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.692+0000 7f94e1134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.692+0000 7f94e1134800 20 started sync module instance, tier type = 2024-09-10T05:11:51.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.692+0000 7f94e1134800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:51.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.692+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc4300 con 0x7f94c802e910 2024-09-10T05:11:51.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.693+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.693+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94913454426112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc4300 con 0x7f94c802e910 2024-09-10T05:11:51.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.693+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc5910 con 0x5652c2bb7110 2024-09-10T05:11:51.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.694+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94913454426112] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.694+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.694+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94913454429152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc4300 con 0x5652c2bb7110 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.694+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc63a0 con 0x5652c2bc0460 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.695+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94913454429152] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.695+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.695+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94913454423632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc4270 con 0x5652c2bc0460 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.695+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc7260 con 0x7f94c802e910 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.696+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94913454423632] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.696+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.696+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94913454435760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc7680 con 0x7f94c802e910 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.696+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc8040 con 0x5652c2bb7110 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.697+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.698+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94913454439312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc7fb0 con 0x5652c2bb7110 2024-09-10T05:11:51.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.698+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94913454435760] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.698+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc8fb0 con 0x5652c2bbb890 2024-09-10T05:11:51.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.698+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.699+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94913454443136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc7fb0 con 0x5652c2bbb890 2024-09-10T05:11:51.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.699+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc99f0 con 0x5652c2bbb890 2024-09-10T05:11:51.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.699+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94913454439312] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.700+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94913454443136] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.700+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.700+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94913454436816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc9540 con 0x5652c2bbb890 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.700+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc9f00 con 0x5652c2bbb890 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.701+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.701+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94913454436816] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.701+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94913454447184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bca320 con 0x5652c2bbb890 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.701+0000 7f94e1134800 20 add_watcher() i=0 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.701+0000 7f94e1134800 20 add_watcher() i=1 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.701+0000 7f94e1134800 20 add_watcher() i=2 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.701+0000 7f94e1134800 20 add_watcher() i=3 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.701+0000 7f94e1134800 20 add_watcher() i=4 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.701+0000 7f94e1134800 20 add_watcher() i=5 2024-09-10T05:11:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.701+0000 7f94e1134800 20 add_watcher() i=6 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.701+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94913454447184] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.702+0000 7f94e1134800 20 add_watcher() i=7 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.702+0000 7f94e1134800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.702+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bca320 con 0x5652c2bb7110 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.702+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.702+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94913454448240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bca300 con 0x5652c2bb7110 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.703+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94913454448240] v35'136 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.703+0000 7f93937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.703+0000 7f94e1134800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.703+0000 7f94e1134800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.703+0000 7f94e1134800 5 note: GC not initialized 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.703+0000 7f93927e4640 20 reqs_thread_entry: start 2024-09-10T05:11:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.703+0000 7f94e1134800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.703+0000 7f94e1134800 20 Filter name: none 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.704+0000 7f938b7fe640 20 reqs_thread_entry: start 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.704+0000 7f94e1134800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.704+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652c2c02110 con 0x5652c2bb7110 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.704+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.704+0000 7f94e1134800 20 rados_obj.operate() r=0 bl.length=193 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.705+0000 7f93937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.705+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94913454448240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bcac20 con 0x5652c2bb7110 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.706+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94913454448240] v35'137 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.706+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94913454426112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc9e70 con 0x7f94c802e910 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.707+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94913454426112] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.707+0000 7f94e1134800 20 remove_watcher() i=0 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.707+0000 7f94e1134800 2 removed watcher, disabling cache 2024-09-10T05:11:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.707+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94913454429152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc4800 con 0x5652c2bb7110 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.708+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94913454429152] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.708+0000 7f94e1134800 20 remove_watcher() i=1 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.708+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94913454423632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc4800 con 0x5652c2bc0460 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.709+0000 7f94d7fff640 1 -- 172.21.15.192:0/1713746418 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94913454423632] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94c8037040 con 0x5652c2bc0460 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.709+0000 7f94e1134800 20 remove_watcher() i=2 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.709+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94913454435760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc3e50 con 0x7f94c802e910 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.710+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94913454435760] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x7f94c802e910 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.710+0000 7f94e1134800 20 remove_watcher() i=3 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.710+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94913454439312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc6db0 con 0x5652c2bb7110 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.711+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94913454439312] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d800a4d0 con 0x5652c2bb7110 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.711+0000 7f94e1134800 20 remove_watcher() i=4 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.711+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94913454443136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc3e50 con 0x5652c2bbb890 2024-09-10T05:11:51.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.712+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94913454443136] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.712+0000 7f94e1134800 20 remove_watcher() i=5 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.712+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94913454436816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc7b90 con 0x5652c2bbb890 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.713+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94913454436816] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.713+0000 7f94e1134800 20 remove_watcher() i=6 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.713+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94913454447184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652c2bc3e50 con 0x5652c2bbb890 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94dceb7640 1 -- 172.21.15.192:0/1713746418 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94913454447184] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d007a030 con 0x5652c2bbb890 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 20 remove_watcher() i=7 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652c2bbb890 msgr2=0x5652c2bbdc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652c2bbb890 0x5652c2bbdc80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652c2bb7110 msgr2=0x5652c2bb95d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652c2bb7110 0x5652c2bb95d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f94c802e910 msgr2=0x7f94c803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f94c802e910 0x7f94c803a3c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5652c2bc0460 msgr2=0x5652c2bc2920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5652c2bc0460 0x5652c2bc2920 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93a803c780 msgr2=0x7f93a803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93a803c780 0x7f93a803ec40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f94c800ffd0 tx=0x7f94c8023040 comp rx=0 tx=0).stop 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94dd6b8640 1 -- 172.21.15.192:0/1713746418 reap_dead start 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 msgr2=0x5652c2babc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 0x5652c2babc10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f94d0053730 tx=0x7f94d006af00 comp rx=0 tx=0).stop 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 shutdown_connections 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 --2- 172.21.15.192:0/1713746418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2ba47f0 0x5652c2babc10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 >> 172.21.15.192:0/1713746418 conn(0x5652c2ba0bf0 msgr2=0x5652c2b9ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 shutdown_connections 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.714+0000 7f94e1134800 1 -- 172.21.15.192:0/1713746418 wait complete. 2024-09-10T05:11:51.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 -- 172.21.15.192:0/598650032 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93b403c730 msgr2=0x7f93b403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 --2- 172.21.15.192:0/598650032 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93b403c730 0x7f93b403ebf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5652c2b81a80 tx=0x7f94c8006000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 -- 172.21.15.192:0/598650032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2b97f70 msgr2=0x5652c2b98390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 --2- 172.21.15.192:0/598650032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2b97f70 0x5652c2b98390 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f94d0095f00 tx=0x7f94d005de70 comp rx=0 tx=0).stop 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 -- 172.21.15.192:0/598650032 shutdown_connections 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 --2- 172.21.15.192:0/598650032 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93b403c730 0x7f93b403ebf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 --2- 172.21.15.192:0/598650032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2b97f70 0x5652c2b98390 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 -- 172.21.15.192:0/598650032 >> 172.21.15.192:0/598650032 conn(0x5652c2b8c320 msgr2=0x5652c2b8c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 -- 172.21.15.192:0/598650032 shutdown_connections 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 -- 172.21.15.192:0/598650032 wait complete. 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652c2b838e0 msgr2=0x5652c2b85cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652c2b838e0 0x5652c2b85cd0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652c2a86020 msgr2=0x5652c2b81470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652c2a86020 0x5652c2b81470 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5652c2b877e0 msgr2=0x5652c2b89bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5652c2b877e0 0x5652c2b89bd0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93c403c780 msgr2=0x7f93c403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f93c403c780 0x7f93c403ec40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f94c8000c00 tx=0x7f94c80013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 msgr2=0x5652c2b79e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.715+0000 7f94e1134800 1 --2- 172.21.15.192:0/3088993681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652c2a83600 0x5652c2b79e20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f94d0025c20 tx=0x7f94d0002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.716+0000 7f94dd6b8640 1 -- 172.21.15.192:0/3088993681 reap_dead start 2024-09-10T05:11:51.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.716+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 shutdown_connections 2024-09-10T05:11:51.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.716+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 >> 172.21.15.192:0/3088993681 conn(0x5652c2a7d1c0 msgr2=0x5652c2b737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.716+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 shutdown_connections 2024-09-10T05:11:51.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.716+0000 7f94e1134800 1 -- 172.21.15.192:0/3088993681 wait complete. 2024-09-10T05:11:51.727 INFO:teuthology.orchestra.run.smithi192.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"TxH+Wq1C5nIOXpEiQqD42mLm","ver":2},"mtime":"2024-09-10T05:11:51.571027Z","data":{"bucket":{"name":"myfoo","marker":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1","bucket_id":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-10T05:11:49.040226Z","linked":true,"has_bucket_info":false}} 2024-09-10T05:11:51.728 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'TxH+Wq1C5nIOXpEiQqD42mLm', 'ver': 2}, 'mtime': '2024-09-10T05:11:51.571027Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1', 'bucket_id': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-10T05:11:49.040226Z', 'linked': True, 'has_bucket_info': False}} 2024-09-10T05:11:51.728 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-10T05:11:51.728 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-10T05:11:51.728 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-10T05:11:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:51.815 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:51.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.814+0000 7fdbb2b46800 1 Processor -- start 2024-09-10T05:11:51.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.814+0000 7fdbb2b46800 1 -- start start 2024-09-10T05:11:51.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.814+0000 7fdbb2b46800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5652f7b1c2d0 0x5652f7b21e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.814+0000 7fdbb2b46800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5652f79c4e40 con 0x5652f7b1b000 2024-09-10T05:11:51.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.814+0000 7fdbb2b46800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5652f798f680 con 0x5652f7b1c2d0 2024-09-10T05:11:51.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.815+0000 7fdba7fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5652f7b1c2d0 0x5652f7b21e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.815+0000 7fdbb0637640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5652f7b1b000 0x5652f7b1bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36516/0 (socket says 172.21.15.192:36516) 2024-09-10T05:11:51.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.815+0000 7fdbb0637640 1 -- 172.21.15.192:0/2838961963 learned_addr learned my addr 172.21.15.192:0/2838961963 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:51.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.815+0000 7fdba7fff640 1 -- 172.21.15.192:0/2838961963 >> v1:172.21.15.139:6789/0 conn(0x5652f7b1b000 legacy=0x5652f7b1bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.815+0000 7fdbafe36640 1 -- 172.21.15.192:0/2838961963 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155802666 0 0) 0x5652f79c4e40 con 0x5652f7b1b000 2024-09-10T05:11:51.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.815+0000 7fdba7fff640 1 -- 172.21.15.192:0/2838961963 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652f79ab6b0 con 0x5652f7b1c2d0 2024-09-10T05:11:51.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.817+0000 7fdba7fff640 1 --2- 172.21.15.192:0/2838961963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1c2d0 0x5652f7b21e70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800a470 tx=0x7fdb98045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a52c31695d762e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.817+0000 7fdbafe36640 1 -- 172.21.15.192:0/2838961963 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb98053570 con 0x5652f7b1c2d0 2024-09-10T05:11:51.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.817+0000 7fdbafe36640 1 -- 172.21.15.192:0/2838961963 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb98058070 con 0x5652f7b1c2d0 2024-09-10T05:11:51.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.817+0000 7fdbafe36640 1 -- 172.21.15.192:0/2838961963 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb98053880 con 0x5652f7b1c2d0 2024-09-10T05:11:51.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.817+0000 7fdbb2b46800 1 -- 172.21.15.192:0/2838961963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1c2d0 msgr2=0x5652f7b21e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.817+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/2838961963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1c2d0 0x5652f7b21e70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800a470 tx=0x7fdb98045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:51.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.817+0000 7fdbb2b46800 1 -- 172.21.15.192:0/2838961963 shutdown_connections 2024-09-10T05:11:51.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.817+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/2838961963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1c2d0 0x5652f7b21e70 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.817+0000 7fdbb2b46800 1 -- 172.21.15.192:0/2838961963 >> 172.21.15.192:0/2838961963 conn(0x5652f7b163d0 msgr2=0x5652f7b18830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.817+0000 7fdbb2b46800 1 -- 172.21.15.192:0/2838961963 shutdown_connections 2024-09-10T05:11:51.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.817+0000 7fdbb2b46800 1 -- 172.21.15.192:0/2838961963 wait complete. 2024-09-10T05:11:51.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.831+0000 7fdbb2b46800 1 Processor -- start 2024-09-10T05:11:51.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.831+0000 7fdbb2b46800 1 -- start start 2024-09-10T05:11:51.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.831+0000 7fdbb2b46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 0x5652f7c0a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.831+0000 7fdbb2b46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5652f79b3dd0 con 0x5652f7b1b000 2024-09-10T05:11:51.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.832+0000 7fdbb0637640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 0x5652f7c0a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.832+0000 7fdbb0637640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 0x5652f7c0a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32898/0 (socket says 172.21.15.192:32898) 2024-09-10T05:11:51.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.832+0000 7fdbb0637640 1 -- 172.21.15.192:0/1566885058 learned_addr learned my addr 172.21.15.192:0/1566885058 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.832+0000 7fdbb0637640 1 -- 172.21.15.192:0/1566885058 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652f79cce10 con 0x5652f7b1b000 2024-09-10T05:11:51.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.832+0000 7fdbb0637640 1 --2- 172.21.15.192:0/1566885058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 0x5652f7c0a440 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdba0001ea0 tx=0x7fdba000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211f55ee9c0887b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.832+0000 7fda9e60c640 1 -- 172.21.15.192:0/1566885058 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba0008070 con 0x5652f7b1b000 2024-09-10T05:11:51.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.832+0000 7fda9e60c640 1 -- 172.21.15.192:0/1566885058 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba000d500 con 0x5652f7b1b000 2024-09-10T05:11:51.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.832+0000 7fda9e60c640 1 -- 172.21.15.192:0/1566885058 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba000d880 con 0x5652f7b1b000 2024-09-10T05:11:51.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.833+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1566885058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 msgr2=0x5652f7c0a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.833+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/1566885058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 0x5652f7c0a440 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdba0001ea0 tx=0x7fdba000b6a0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.833+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1566885058 shutdown_connections 2024-09-10T05:11:51.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.833+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/1566885058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 0x5652f7c0a440 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.833+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1566885058 >> 172.21.15.192:0/1566885058 conn(0x5652f7b163d0 msgr2=0x5652f7c05dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.833+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1566885058 shutdown_connections 2024-09-10T05:11:51.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.833+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1566885058 wait complete. 2024-09-10T05:11:51.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.833+0000 7fdbb2b46800 1 Processor -- start 2024-09-10T05:11:51.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.833+0000 7fdbb2b46800 1 -- start start 2024-09-10T05:11:51.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.834+0000 7fdbb2b46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 0x5652f7c11d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.834+0000 7fdbb2b46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5652f7b1c9c0 con 0x5652f7b1b000 2024-09-10T05:11:51.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.834+0000 7fdbb0637640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 0x5652f7c11d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.834+0000 7fdbb0637640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 0x5652f7c11d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32908/0 (socket says 172.21.15.192:32908) 2024-09-10T05:11:51.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.834+0000 7fdbb0637640 1 -- 172.21.15.192:0/1200532254 learned_addr learned my addr 172.21.15.192:0/1200532254 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.834+0000 7fdbb0637640 1 -- 172.21.15.192:0/1200532254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652f7c122c0 con 0x5652f7b1b000 2024-09-10T05:11:51.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.834+0000 7fdbb0637640 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 0x5652f7c11d60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdba00012f0 tx=0x7fdba0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.834+0000 7fda9ce09640 1 -- 172.21.15.192:0/1200532254 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba000f9d0 con 0x5652f7b1b000 2024-09-10T05:11:51.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.834+0000 7fda9ce09640 1 -- 172.21.15.192:0/1200532254 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba000fb70 con 0x5652f7b1b000 2024-09-10T05:11:51.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.834+0000 7fda9ce09640 1 -- 172.21.15.192:0/1200532254 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba000fe50 con 0x5652f7b1b000 2024-09-10T05:11:51.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.834+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652f7c12550 con 0x5652f7b1b000 2024-09-10T05:11:51.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.834+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652f7c12f50 con 0x5652f7b1b000 2024-09-10T05:11:51.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.835+0000 7fda9ce09640 1 -- 172.21.15.192:0/1200532254 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdba0017040 con 0x5652f7b1b000 2024-09-10T05:11:51.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.835+0000 7fda9ce09640 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda9803c920 0x7fda9803ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.835+0000 7fda9ce09640 1 -- 172.21.15.192:0/1200532254 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fdba0015020 con 0x5652f7b1b000 2024-09-10T05:11:51.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.836+0000 7fdba7fff640 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda9803c920 0x7fda9803ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.836+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652f7b1c2d0 0x5652f7c193b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.836+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c198f0 con 0x5652f7b1c2d0 2024-09-10T05:11:51.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.836+0000 7fdbb0e38640 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652f7b1c2d0 0x5652f7c193b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.836+0000 7fdba7fff640 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda9803c920 0x7fda9803ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb98057000 tx=0x7fdb98052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.836+0000 7fdbb0e38640 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652f7b1c2d0 0x5652f7c193b0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.836+0000 7fdbb0e38640 1 -- 172.21.15.192:0/1200532254 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7b1c2d0 2024-09-10T05:11:51.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.836+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c19c90 con 0x5652f7b1c2d0 2024-09-10T05:11:51.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.837+0000 7fdbb0e38640 1 -- 172.21.15.192:0/1200532254 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7b1c2d0 2024-09-10T05:11:51.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.837+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652f7c1b790 0x5652f7c1dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.837+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c1e3a0 con 0x5652f7c1b790 2024-09-10T05:11:51.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.837+0000 7fdbb0637640 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652f7c1b790 0x5652f7c1dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.837+0000 7fdbb0637640 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652f7c1b790 0x5652f7c1dc10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.837+0000 7fdbb0637640 1 -- 172.21.15.192:0/1200532254 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdba002d070 con 0x5652f7c1b790 2024-09-10T05:11:51.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.837+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c1a4e0 con 0x5652f7b1c2d0 2024-09-10T05:11:51.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.838+0000 7fdbb0e38640 1 -- 172.21.15.192:0/1200532254 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7b1c2d0 2024-09-10T05:11:51.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.838+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5652f7c1f800 0x5652f7c21bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.838+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c22360 con 0x5652f7c1f800 2024-09-10T05:11:51.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.838+0000 7fdba7fff640 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5652f7c1f800 0x5652f7c21bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.838+0000 7fdba7fff640 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5652f7c1f800 0x5652f7c21bf0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.838+0000 7fdba7fff640 1 -- 172.21.15.192:0/1200532254 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb98051070 con 0x5652f7c1f800 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.839+0000 7fdbb2b46800 1 Processor -- start 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.839+0000 7fdbb2b46800 1 -- start start 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.839+0000 7fdbb2b46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7a906f0 0x5652f7a8ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.839+0000 7fdbb2b46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5652f7a11a00 con 0x5652f7a906f0 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.839+0000 7fdbb0637640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7a906f0 0x5652f7a8ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.839+0000 7fdbb0637640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7a906f0 0x5652f7a8ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32920/0 (socket says 172.21.15.192:32920) 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.839+0000 7fdbb0637640 1 -- 172.21.15.192:0/119330374 learned_addr learned my addr 172.21.15.192:0/119330374 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.839+0000 7fdbb0637640 1 -- 172.21.15.192:0/119330374 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652f7a90c10 con 0x5652f7a906f0 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.840+0000 7fdbb0637640 1 --2- 172.21.15.192:0/119330374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7a906f0 0x5652f7a8ef60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdba000e660 tx=0x7fdba0018e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.840+0000 7fda95ffb640 1 -- 172.21.15.192:0/119330374 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba0048020 con 0x5652f7a906f0 2024-09-10T05:11:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.840+0000 7fda95ffb640 1 -- 172.21.15.192:0/119330374 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba004b310 con 0x5652f7a906f0 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.840+0000 7fdbb2b46800 1 -- 172.21.15.192:0/119330374 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652f7a8f4a0 con 0x5652f7a906f0 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.840+0000 7fda95ffb640 1 -- 172.21.15.192:0/119330374 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba001a4f0 con 0x5652f7a906f0 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.840+0000 7fdbb2b46800 1 -- 172.21.15.192:0/119330374 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652f7a8f9f0 con 0x5652f7a906f0 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.840+0000 7fda95ffb640 1 -- 172.21.15.192:0/119330374 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdba004b020 con 0x5652f7a906f0 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.841+0000 7fda95ffb640 1 --2- 172.21.15.192:0/119330374 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda8803c730 0x7fda8803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.841+0000 7fda95ffb640 1 -- 172.21.15.192:0/119330374 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fdba003c4e0 con 0x5652f7a906f0 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.841+0000 7fdba7fff640 1 --2- 172.21.15.192:0/119330374 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda8803c730 0x7fda8803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.841+0000 7fdbb2b46800 1 Processor -- start 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.841+0000 7fdbb2b46800 1 -- start start 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.841+0000 7fdba7fff640 1 --2- 172.21.15.192:0/119330374 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda8803c730 0x7fda8803ebf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdb98000c00 tx=0x7fdb98005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.841+0000 7fdbb2b46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 0x5652f7c3edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.841+0000 7fdbb2b46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5652f7c0ac90 con 0x5652f7c3e9b0 2024-09-10T05:11:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.841+0000 7fdbb0637640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 0x5652f7c3edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.842+0000 7fdbb0637640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 0x5652f7c3edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32936/0 (socket says 172.21.15.192:32936) 2024-09-10T05:11:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.842+0000 7fdbb0637640 1 -- 172.21.15.192:0/392373562 learned_addr learned my addr 172.21.15.192:0/392373562 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.842+0000 7fdbb0637640 1 -- 172.21.15.192:0/392373562 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652f7c3f3a0 con 0x5652f7c3e9b0 2024-09-10T05:11:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.842+0000 7fdbb0637640 1 --2- 172.21.15.192:0/392373562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 0x5652f7c3edb0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdba0026fd0 tx=0x7fdba0026d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1f8cc8062da39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.842+0000 7fda8f7fe640 1 -- 172.21.15.192:0/392373562 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba0035070 con 0x5652f7c3e9b0 2024-09-10T05:11:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.842+0000 7fda8f7fe640 1 -- 172.21.15.192:0/392373562 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba0044910 con 0x5652f7c3e9b0 2024-09-10T05:11:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.842+0000 7fda8f7fe640 1 -- 172.21.15.192:0/392373562 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba00195a0 con 0x5652f7c3e9b0 2024-09-10T05:11:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.842+0000 7fdbb2b46800 1 -- 172.21.15.192:0/392373562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 msgr2=0x5652f7c3edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.842+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/392373562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 0x5652f7c3edb0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdba0026fd0 tx=0x7fdba0026d80 comp rx=0 tx=0).stop 2024-09-10T05:11:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb2b46800 1 -- 172.21.15.192:0/392373562 shutdown_connections 2024-09-10T05:11:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/392373562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 0x5652f7c3edb0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb2b46800 1 -- 172.21.15.192:0/392373562 >> 172.21.15.192:0/392373562 conn(0x5652f7c3adb0 msgr2=0x5652f7c38ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb2b46800 1 -- 172.21.15.192:0/392373562 shutdown_connections 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb2b46800 1 -- 172.21.15.192:0/392373562 wait complete. 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb2b46800 1 Processor -- start 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb2b46800 1 -- start start 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb2b46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 0x5652f7c45dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb2b46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5652f7c3f810 con 0x5652f7c3e9b0 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb0637640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 0x5652f7c45dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb0637640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 0x5652f7c45dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32944/0 (socket says 172.21.15.192:32944) 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 learned_addr learned my addr 172.21.15.192:0/337902982 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.843+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652f7c46330 con 0x5652f7c3e9b0 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.844+0000 7fdbb0637640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 0x5652f7c45dd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdba004b4e0 tx=0x7fdba003a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.844+0000 7fda8dffb640 1 -- 172.21.15.192:0/337902982 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba0065020 con 0x5652f7c3e9b0 2024-09-10T05:11:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.844+0000 7fda8dffb640 1 -- 172.21.15.192:0/337902982 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba004b890 con 0x5652f7c3e9b0 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.844+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652f7c46330 con 0x5652f7c3e9b0 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.844+0000 7fda8dffb640 1 -- 172.21.15.192:0/337902982 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdba0035040 con 0x5652f7c3e9b0 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.844+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652f7c46330 con 0x5652f7c3e9b0 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.845+0000 7fda8dffb640 1 -- 172.21.15.192:0/337902982 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdba0026430 con 0x5652f7c3e9b0 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.845+0000 7fda8dffb640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda8003c780 0x7fda8003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.845+0000 7fda8dffb640 1 -- 172.21.15.192:0/337902982 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fdba00579f0 con 0x5652f7c3e9b0 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.845+0000 7fdba7fff640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda8003c780 0x7fda8003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.845+0000 7fdba7fff640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda8003c780 0x7fda8003ec40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5652f7c22760 tx=0x7fdb98053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.845+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652f7c513a0 0x5652f7c53860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c53fb0 con 0x5652f7c513a0 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb0e38640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652f7c513a0 0x5652f7c53860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb0e38640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652f7c513a0 0x5652f7c53860 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb2b46800 20 realm 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c543c0 con 0x5652f7c513a0 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb2b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.846+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c54c90 con 0x5652f7c513a0 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.847+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.847+0000 7fdbb2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.847+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.847+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c513a0 2024-09-10T05:11:51.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.847+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.847+0000 7fdbb2b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.847+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.847+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652f7c55d90 0x5652f7c58180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.847+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c58740 con 0x5652f7c55d90 2024-09-10T05:11:51.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.847+0000 7fdbb0637640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652f7c55d90 0x5652f7c58180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.848+0000 7fdbb0637640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652f7c55d90 0x5652f7c58180 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.848+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.848+0000 7fdbb2b46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:51.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.848+0000 7fdbb2b46800 20 searching for the correct realm 2024-09-10T05:11:51.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.848+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5652f7c5a6f0 0x5652f7c5cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.848+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c5d280 con 0x5652f7c5a6f0 2024-09-10T05:11:51.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.848+0000 7fdba7fff640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5652f7c5a6f0 0x5652f7c5cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.848+0000 7fdba7fff640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5652f7c5a6f0 0x5652f7c5cbb0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.849+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.849+0000 7fdba7fff640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fdb9805f040 0x7fdb9806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.849+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c5d280 con 0x7fdb9805f040 2024-09-10T05:11:51.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.849+0000 7fdbb0e38640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fdb9805f040 0x7fdb9806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.849+0000 7fdbb0e38640 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fdb9805f040 0x7fdb9806b410 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.849+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.849+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c55d90 2024-09-10T05:11:51.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.849+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.849+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c513a0 2024-09-10T05:11:51.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.850+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.850+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c513a0 2024-09-10T05:11:51.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.850+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.850+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c55d90 2024-09-10T05:11:51.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.850+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.850+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c55d90 2024-09-10T05:11:51.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.850+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.850+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x7fdb9805f040 2024-09-10T05:11:51.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.851+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.851+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c5a6f0 2024-09-10T05:11:51.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.851+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.851+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c513a0 2024-09-10T05:11:51.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.851+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.851+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c55d90 2024-09-10T05:11:51.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.851+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.852+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c513a0 2024-09-10T05:11:51.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.852+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.852+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x7fdb9805f040 2024-09-10T05:11:51.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.852+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.852+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c5a6f0 2024-09-10T05:11:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.852+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.852+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c5a6f0 2024-09-10T05:11:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.852+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.852+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c55d90 2024-09-10T05:11:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.853+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.853+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c5a6f0 2024-09-10T05:11:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.853+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.853+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c5a6f0 2024-09-10T05:11:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.853+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.853+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c513a0 2024-09-10T05:11:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.853+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.853+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c513a0 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.854+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.854+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c55d90 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.854+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.854+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c5a6f0 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.854+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.854+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x7fdb9805f040 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.854+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.854+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c513a0 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.855+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.855+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c55d90 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.855+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.855+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c5a6f0 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.855+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.855+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c55d90 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.855+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.855+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x7fdb9805f040 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.856+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.856+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c5a6f0 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.856+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.856+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c55d90 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.856+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.856+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x5652f7c513a0 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.856+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.856+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c55030 con 0x7fdb9805f040 2024-09-10T05:11:51.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c59000 con 0x5652f7c513a0 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c59000 con 0x5652f7c513a0 2024-09-10T05:11:51.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.857+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c59000 con 0x7fdb9805f040 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 20 zone default found 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 4 Realm: () 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 20 zonegroup default 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c598a0 con 0x5652f7c55d90 2024-09-10T05:11:51.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c5f0f0 con 0x5652f7c5a6f0 2024-09-10T05:11:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c5f490 con 0x5652f7c5a6f0 2024-09-10T05:11:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 20 started sync module instance, tier type = 2024-09-10T05:11:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.858+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c5e590 con 0x7fdb9805f040 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.859+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.859+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94914344250080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c5e590 con 0x7fdb9805f040 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.860+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c5fe50 con 0x5652f7c513a0 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.860+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94914344250080] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.861+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.861+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94914344248000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c5fe50 con 0x5652f7c513a0 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.861+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c60850 con 0x5652f7c5a6f0 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.861+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94914344248000] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.862+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.862+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94914344253856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c5fdc0 con 0x5652f7c5a6f0 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.862+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c61740 con 0x7fdb9805f040 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.863+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94914344253856] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.863+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.863+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94914344260240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c61b60 con 0x7fdb9805f040 2024-09-10T05:11:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.863+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c62430 con 0x5652f7c513a0 2024-09-10T05:11:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.864+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.864+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94914344262496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c61f80 con 0x5652f7c513a0 2024-09-10T05:11:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.864+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c63400 con 0x5652f7c55d90 2024-09-10T05:11:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.864+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94914344260240] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.865+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94914344262496] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.865+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.865+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94914344265760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c616b0 con 0x5652f7c55d90 2024-09-10T05:11:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.865+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c63ca0 con 0x5652f7c55d90 2024-09-10T05:11:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.866+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94914344265760] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.866+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.866+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94914344267504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c644f0 con 0x5652f7c55d90 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.866+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c64dc0 con 0x5652f7c55d90 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.867+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.867+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94914344275328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c65650 con 0x5652f7c55d90 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.867+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94914344267504] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.867+0000 7fdbb2b46800 20 add_watcher() i=0 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.867+0000 7fdbb2b46800 20 add_watcher() i=1 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.867+0000 7fdbb2b46800 20 add_watcher() i=2 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.867+0000 7fdbb2b46800 20 add_watcher() i=3 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.867+0000 7fdbb2b46800 20 add_watcher() i=4 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.867+0000 7fdbb2b46800 20 add_watcher() i=5 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.867+0000 7fdbb2b46800 20 add_watcher() i=6 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.868+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94914344275328] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.868+0000 7fdbb2b46800 20 add_watcher() i=7 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.868+0000 7fdbb2b46800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.868+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c68680 con 0x5652f7c513a0 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.868+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.868+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94914344276384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c65b10 con 0x5652f7c513a0 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.869+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94914344276384] v35'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.869+0000 7fda667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.869+0000 7fdbb2b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.869+0000 7fdbb2b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 5 note: GC not initialized 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fda657e2640 20 reqs_thread_entry: start 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 20 Filter name: none 2024-09-10T05:11:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fd9d6ffd640 20 reqs_thread_entry: start 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c9b5f0 con 0x5652f7c513a0 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.870+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c9d580 con 0x5652f7c513a0 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 20 rados_obj.operate() r=0 bl.length=193 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 : miss 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 8.b 8:d0b4acb6:root::.bucket.meta.testx%3amyfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c9ee20 con 0x5652f7c5a6f0 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 20 rados_obj.operate() r=0 bl.length=420 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-10T05:11:51.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.871+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7ca35a0 con 0x5652f7c513a0 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.872+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v35'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.872+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7ca6eb0 con 0x5652f7c5a6f0 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.873+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(66 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [create,call,writefull 0~387,setxattr (123)] v35'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.873+0000 7fdbb2b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x7 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.873+0000 7fdbb2b46800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.873+0000 7fdbb2b46800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.873+0000 7fdbb2b46800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1, ofs0, ns] 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.873+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94914344536976 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7ca6850 con 0x7fdb9805f040 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== watch-notify(notify (1) cookie 94914344260240 notify 150323855377 ret 0) ==== 778+0+0 (crc 0 0 0) 0x7fdba8018dc0 con 0x7fdb9805f040 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fda8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855377 cookie 94914344260240 notifier 4567 bl.length()=736 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(67 notify.3 [notify cookie 94914344536976 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fda8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x7 2024-09-10T05:11:51.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fda8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fda8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fda8f7fe640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fda74003ea0 con 0x7fdb9805f040 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== watch-notify(notify_complete (2) cookie 94914344536976 notify 150323855377 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdba8045500 con 0x7fdb9805f040 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fdbb2b46800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): orig_sources= new_sources= 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fdbb2b46800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): potential sources added=[] removed=[] 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fdbb2b46800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): orig_dests= new_dests= 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fdbb2b46800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): potential dests added=[] removed=[] 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.874+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7ca6c80 con 0x7fdb9805f040 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.875+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(69 foo.buckets [call] v35'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.875+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7ca69d0 con 0x7fdb9805f040 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.876+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v35'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.876+0000 7fdbb2b46800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T05:11:51.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.876+0000 7fdbb2b46800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:51.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.876+0000 7fdbb2b46800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:11:51.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.876+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94914344543520 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7ca6940 con 0x5652f7c55d90 2024-09-10T05:11:51.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.877+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== watch-notify(notify (1) cookie 94914344267504 notify 150323855375 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5652f7a90c10 con 0x5652f7c55d90 2024-09-10T05:11:51.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.877+0000 7fda8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855375 cookie 94914344267504 notifier 4567 bl.length()=314 2024-09-10T05:11:51.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.877+0000 7fda8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-10T05:11:51.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.877+0000 7fda8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:51.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.877+0000 7fda8f7fe640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fda74003ea0 con 0x5652f7c55d90 2024-09-10T05:11:51.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.877+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(71 notify.6 [notify cookie 94914344543520 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.877+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.877+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== watch-notify(notify_complete (2) cookie 94914344543520 notify 150323855375 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdba005a020 con 0x5652f7c55d90 2024-09-10T05:11:51.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.877+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7ca6990 con 0x5652f7c513a0 2024-09-10T05:11:51.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.878+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(73 testx/myfoo [call,delete] v35'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.878+0000 7fdbb2b46800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-10T05:11:51.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.878+0000 7fdbb2b46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-10T05:11:51.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.878+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94914344543456 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7ca6900 con 0x5652f7c513a0 2024-09-10T05:11:51.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.879+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== watch-notify(notify (1) cookie 94914344262496 notify 150323855372 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5652f7ca6d70 con 0x5652f7c513a0 2024-09-10T05:11:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.879+0000 7fda8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855372 cookie 94914344262496 notifier 4567 bl.length()=155 2024-09-10T05:11:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.879+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(74 notify.4 [notify cookie 94914344543456 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.879+0000 7fda8effd640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd9e40032c0 con 0x5652f7c513a0 2024-09-10T05:11:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.879+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== watch-notify(notify_complete (2) cookie 94914344543456 notify 150323855372 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5652f7ca5ba0 con 0x5652f7c513a0 2024-09-10T05:11:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.879+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.879+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:76 8.b 8:d0b4acb6:root::.bucket.meta.testx%3amyfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7ca6950 con 0x5652f7c5a6f0 2024-09-10T05:11:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.880+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call,delete] v35'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.880+0000 7fdbb2b46800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 from cache 2024-09-10T05:11:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.880+0000 7fdbb2b46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1, ofs0, ns] 2024-09-10T05:11:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.880+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 94914344514752 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5652f7ca6950 con 0x5652f7c5a6f0 2024-09-10T05:11:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.880+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== watch-notify(notify (1) cookie 94914344253856 notify 150323855366 ret 0) ==== 254+0+0 (crc 0 0 0) 0x5652f7ca7250 con 0x5652f7c5a6f0 2024-09-10T05:11:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.880+0000 7fda8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855366 cookie 94914344253856 notifier 4567 bl.length()=212 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.880+0000 7fda8f7fe640 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fda74003ea0 con 0x5652f7c5a6f0 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.880+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(77 notify.2 [notify cookie 94914344514752 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.881+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== watch-notify(notify_complete (2) cookie 94914344514752 notify 150323855366 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5652f7ca2fd0 con 0x5652f7c5a6f0 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.881+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.881+0000 7fda667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.881+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94914344276384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c99490 con 0x5652f7c513a0 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.882+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94914344276384] v35'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.882+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94914344250080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c99490 con 0x7fdb9805f040 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.883+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94914344250080] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.884+0000 7fdbb2b46800 20 remove_watcher() i=0 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.884+0000 7fdbb2b46800 2 removed watcher, disabling cache 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.884+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94914344248000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c99490 con 0x5652f7c513a0 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.885+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94914344248000] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.885+0000 7fdbb2b46800 20 remove_watcher() i=1 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.885+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94914344253856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c99490 con 0x5652f7c5a6f0 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.885+0000 7fdba7fff640 1 -- 172.21.15.192:0/337902982 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94914344253856] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb9807c040 con 0x5652f7c5a6f0 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.885+0000 7fdbb2b46800 20 remove_watcher() i=2 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.885+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94914344260240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c99490 con 0x7fdb9805f040 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.887+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94914344260240] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x7fdb9805f040 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.887+0000 7fdbb2b46800 20 remove_watcher() i=3 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.887+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94914344262496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c99490 con 0x5652f7c513a0 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.888+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94914344262496] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba800a4d0 con 0x5652f7c513a0 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.888+0000 7fdbb2b46800 20 remove_watcher() i=4 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.888+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94914344265760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c99490 con 0x5652f7c55d90 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.889+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94914344265760] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.889+0000 7fdbb2b46800 20 remove_watcher() i=5 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.889+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94914344267504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c99490 con 0x5652f7c55d90 2024-09-10T05:11:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.890+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94914344267504] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.890+0000 7fdbb2b46800 20 remove_watcher() i=6 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.890+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94914344275328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5652f7c99490 con 0x5652f7c55d90 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb0637640 1 -- 172.21.15.192:0/337902982 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94914344275328] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdba0067020 con 0x5652f7c55d90 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 20 remove_watcher() i=7 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652f7c55d90 msgr2=0x5652f7c58180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652f7c55d90 0x5652f7c58180 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652f7c513a0 msgr2=0x5652f7c53860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652f7c513a0 0x5652f7c53860 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fdb9805f040 msgr2=0x7fdb9806b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fdb9805f040 0x7fdb9806b410 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5652f7c5a6f0 msgr2=0x5652f7c5cbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5652f7c5a6f0 0x5652f7c5cbb0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda8003c780 msgr2=0x7fda8003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda8003c780 0x7fda8003ec40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5652f7c22760 tx=0x7fdb98053000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 msgr2=0x5652f7c45dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/337902982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7c3e9b0 0x5652f7c45dd0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdba004b4e0 tx=0x7fdba003a8a0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 reap_dead start 2024-09-10T05:11:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb0e38640 1 -- 172.21.15.192:0/337902982 reap_dead start 2024-09-10T05:11:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 shutdown_connections 2024-09-10T05:11:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 >> 172.21.15.192:0/337902982 conn(0x5652f7c3adb0 msgr2=0x5652f7c38fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 shutdown_connections 2024-09-10T05:11:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/337902982 wait complete. 2024-09-10T05:11:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/119330374 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda8803c730 msgr2=0x7fda8803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/119330374 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda8803c730 0x7fda8803ebf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdb98000c00 tx=0x7fdb98005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/119330374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7a906f0 msgr2=0x5652f7a8ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/119330374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7a906f0 0x5652f7a8ef60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdba000e660 tx=0x7fdba0018e20 comp rx=0 tx=0).stop 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/119330374 shutdown_connections 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/119330374 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda8803c730 0x7fda8803ebf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/119330374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7a906f0 0x5652f7a8ef60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.891+0000 7fdbb2b46800 1 -- 172.21.15.192:0/119330374 >> 172.21.15.192:0/119330374 conn(0x5652f7c242f0 msgr2=0x5652f7c246d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 -- 172.21.15.192:0/119330374 shutdown_connections 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 -- 172.21.15.192:0/119330374 wait complete. 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652f7c1b790 msgr2=0x5652f7c1dc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5652f7c1b790 0x5652f7c1dc10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652f7b1c2d0 msgr2=0x5652f7c193b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5652f7b1c2d0 0x5652f7c193b0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5652f7c1f800 msgr2=0x5652f7c21bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5652f7c1f800 0x5652f7c21bf0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda9803c920 msgr2=0x7fda9803ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fda9803c920 0x7fda9803ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb98057000 tx=0x7fdb98052000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 msgr2=0x5652f7c11d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 --2- 172.21.15.192:0/1200532254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5652f7b1b000 0x5652f7c11d60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdba00012f0 tx=0x7fdba0000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb0e38640 1 -- 172.21.15.192:0/1200532254 reap_dead start 2024-09-10T05:11:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 shutdown_connections 2024-09-10T05:11:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 >> 172.21.15.192:0/1200532254 conn(0x5652f7b163d0 msgr2=0x5652f7c0b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 shutdown_connections 2024-09-10T05:11:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.892+0000 7fdbb2b46800 1 -- 172.21.15.192:0/1200532254 wait complete. 2024-09-10T05:11:51.908 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T05:11:51.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-10T05:11:51.908 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-10T05:11:51.955 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:51.955 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:51.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.955+0000 7fec18746800 1 Processor -- start 2024-09-10T05:11:51.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.955+0000 7fec18746800 1 -- start start 2024-09-10T05:11:51.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.955+0000 7fec18746800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5636b90e46a0 0x5636b90e6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.955+0000 7fec18746800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5636b8f8de40 con 0x5636b90e7030 2024-09-10T05:11:51.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.955+0000 7fec18746800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5636b8f58680 con 0x5636b90e46a0 2024-09-10T05:11:51.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.955+0000 7fec16237640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5636b90e46a0 0x5636b90e6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.955+0000 7fec16237640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5636b90e46a0 0x5636b90e6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32952/0 (socket says 172.21.15.192:32952) 2024-09-10T05:11:51.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.955+0000 7fec0ffff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5636b90e7030 0x5636b90e94f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36518/0 (socket says 172.21.15.192:36518) 2024-09-10T05:11:51.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.955+0000 7fec16237640 1 -- 172.21.15.192:0/505550517 learned_addr learned my addr 172.21.15.192:0/505550517 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.955+0000 7fec16237640 1 -- 172.21.15.192:0/505550517 >> v1:172.21.15.139:6789/0 conn(0x5636b90e7030 legacy=0x5636b90e94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.955+0000 7fec16237640 1 -- 172.21.15.192:0/505550517 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b8f746b0 con 0x5636b90e46a0 2024-09-10T05:11:51.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.955+0000 7fec15a36640 1 -- 172.21.15.192:0/505550517 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697384292 0 0) 0x5636b8f8de40 con 0x5636b90e7030 2024-09-10T05:11:51.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.957+0000 7fec16237640 1 --2- 172.21.15.192:0/505550517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b90e6a90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fec0800a520 tx=0x7fec08045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b751f927f03446cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.957+0000 7fec15a36640 1 -- 172.21.15.192:0/505550517 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec08055070 con 0x5636b90e46a0 2024-09-10T05:11:51.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.957+0000 7fec15a36640 1 -- 172.21.15.192:0/505550517 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec080515b0 con 0x5636b90e46a0 2024-09-10T05:11:51.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.957+0000 7fec15a36640 1 -- 172.21.15.192:0/505550517 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec080518d0 con 0x5636b90e46a0 2024-09-10T05:11:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.958+0000 7fec18746800 1 -- 172.21.15.192:0/505550517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 msgr2=0x5636b90e6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.958+0000 7fec18746800 1 --2- 172.21.15.192:0/505550517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b90e6a90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fec0800a520 tx=0x7fec08045ba0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.958+0000 7fec18746800 1 -- 172.21.15.192:0/505550517 shutdown_connections 2024-09-10T05:11:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.958+0000 7fec18746800 1 --2- 172.21.15.192:0/505550517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b90e6a90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.958+0000 7fec18746800 1 -- 172.21.15.192:0/505550517 >> 172.21.15.192:0/505550517 conn(0x5636b90de200 msgr2=0x5636b90e0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.958+0000 7fec18746800 1 -- 172.21.15.192:0/505550517 shutdown_connections 2024-09-10T05:11:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.958+0000 7fec18746800 1 -- 172.21.15.192:0/505550517 wait complete. 2024-09-10T05:11:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.971+0000 7fec18746800 1 Processor -- start 2024-09-10T05:11:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.972+0000 7fec18746800 1 -- start start 2024-09-10T05:11:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.972+0000 7fec18746800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b90e3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.972+0000 7fec18746800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5636b8f7cdd0 con 0x5636b90e46a0 2024-09-10T05:11:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.972+0000 7fec16237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b90e3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.972+0000 7fec16237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b90e3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32960/0 (socket says 172.21.15.192:32960) 2024-09-10T05:11:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.972+0000 7fec16237640 1 -- 172.21.15.192:0/1537774772 learned_addr learned my addr 172.21.15.192:0/1537774772 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.972+0000 7fec16237640 1 -- 172.21.15.192:0/1537774772 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b8f95e10 con 0x5636b90e46a0 2024-09-10T05:11:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.972+0000 7fec16237640 1 --2- 172.21.15.192:0/1537774772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b90e3e30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fec08025da0 tx=0x7fec08051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de6e0066961ce5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.973+0000 7feb04608640 1 -- 172.21.15.192:0/1537774772 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec08051950 con 0x5636b90e46a0 2024-09-10T05:11:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.973+0000 7feb04608640 1 -- 172.21.15.192:0/1537774772 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec08051af0 con 0x5636b90e46a0 2024-09-10T05:11:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.973+0000 7feb04608640 1 -- 172.21.15.192:0/1537774772 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec08051dd0 con 0x5636b90e46a0 2024-09-10T05:11:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.973+0000 7fec18746800 1 -- 172.21.15.192:0/1537774772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 msgr2=0x5636b90e3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.973+0000 7fec18746800 1 --2- 172.21.15.192:0/1537774772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b90e3e30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fec08025da0 tx=0x7fec08051000 comp rx=0 tx=0).stop 2024-09-10T05:11:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.973+0000 7fec18746800 1 -- 172.21.15.192:0/1537774772 shutdown_connections 2024-09-10T05:11:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.973+0000 7fec18746800 1 --2- 172.21.15.192:0/1537774772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b90e3e30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.973+0000 7fec18746800 1 -- 172.21.15.192:0/1537774772 >> 172.21.15.192:0/1537774772 conn(0x5636b90de200 msgr2=0x5636b91cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.973+0000 7fec18746800 1 -- 172.21.15.192:0/1537774772 shutdown_connections 2024-09-10T05:11:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.973+0000 7fec18746800 1 -- 172.21.15.192:0/1537774772 wait complete. 2024-09-10T05:11:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.974+0000 7fec18746800 1 Processor -- start 2024-09-10T05:11:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.974+0000 7fec18746800 1 -- start start 2024-09-10T05:11:51.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.974+0000 7fec18746800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b91dce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.974+0000 7fec18746800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5636b90eb050 con 0x5636b90e46a0 2024-09-10T05:11:51.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.974+0000 7fec16237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b91dce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.974+0000 7fec16237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b91dce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32968/0 (socket says 172.21.15.192:32968) 2024-09-10T05:11:51.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.974+0000 7fec16237640 1 -- 172.21.15.192:0/1179490623 learned_addr learned my addr 172.21.15.192:0/1179490623 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.974+0000 7fec16237640 1 -- 172.21.15.192:0/1179490623 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b91dd370 con 0x5636b90e46a0 2024-09-10T05:11:51.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.974+0000 7fec16237640 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b91dce10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fec08025da0 tx=0x7fec08002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.974+0000 7feb02e05640 1 -- 172.21.15.192:0/1179490623 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec0805a600 con 0x5636b90e46a0 2024-09-10T05:11:51.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.974+0000 7feb02e05640 1 -- 172.21.15.192:0/1179490623 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec08073070 con 0x5636b90e46a0 2024-09-10T05:11:51.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.975+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636b91dd600 con 0x5636b90e46a0 2024-09-10T05:11:51.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.975+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636b91de210 con 0x5636b90e46a0 2024-09-10T05:11:51.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.975+0000 7feb02e05640 1 -- 172.21.15.192:0/1179490623 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec0805a910 con 0x5636b90e46a0 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.975+0000 7feb02e05640 1 -- 172.21.15.192:0/1179490623 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fec08058070 con 0x5636b90e46a0 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.976+0000 7feb02e05640 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feafc03c780 0x7feafc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.976+0000 7feb02e05640 1 -- 172.21.15.192:0/1179490623 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fec0806b040 con 0x5636b90e46a0 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.976+0000 7fec0ffff640 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feafc03c780 0x7feafc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.976+0000 7fec18746800 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5636b90e7030 0x5636b91e4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.976+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b91e49a0 con 0x5636b90e7030 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.976+0000 7fec16a38640 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5636b90e7030 0x5636b91e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.976+0000 7fec0ffff640 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feafc03c780 0x7feafc03ec40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fec00000c00 tx=0x7fec000013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.976+0000 7fec16a38640 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5636b90e7030 0x5636b91e4460 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.976+0000 7fec16a38640 1 -- 172.21.15.192:0/1179490623 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b90e7030 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.976+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b91e4d40 con 0x5636b90e7030 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.977+0000 7fec16a38640 1 -- 172.21.15.192:0/1179490623 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b90e7030 2024-09-10T05:11:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.977+0000 7fec18746800 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5636b91e6840 0x5636b91e8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.977+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b91e9470 con 0x5636b91e6840 2024-09-10T05:11:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.977+0000 7fec16237640 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5636b91e6840 0x5636b91e8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.977+0000 7fec16237640 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5636b91e6840 0x5636b91e8ce0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.978+0000 7fec16237640 1 -- 172.21.15.192:0/1179490623 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fec08057030 con 0x5636b91e6840 2024-09-10T05:11:51.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.978+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b91e5590 con 0x5636b90e7030 2024-09-10T05:11:51.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.978+0000 7fec16a38640 1 -- 172.21.15.192:0/1179490623 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b90e7030 2024-09-10T05:11:51.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.978+0000 7fec18746800 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5636b91ea8d0 0x5636b91eccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.978+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b91ed430 con 0x5636b91ea8d0 2024-09-10T05:11:51.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.978+0000 7fec0ffff640 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5636b91ea8d0 0x5636b91eccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.978+0000 7fec0ffff640 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5636b91ea8d0 0x5636b91eccc0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.979+0000 7fec0ffff640 1 -- 172.21.15.192:0/1179490623 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fec0000f670 con 0x5636b91ea8d0 2024-09-10T05:11:51.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.979+0000 7fec18746800 1 Processor -- start 2024-09-10T05:11:51.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.979+0000 7fec18746800 1 -- start start 2024-09-10T05:11:51.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.979+0000 7fec18746800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b91fb090 0x5636b91fb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.979+0000 7fec18746800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5636b8fdaa00 con 0x5636b91fb090 2024-09-10T05:11:51.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.979+0000 7fec16237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b91fb090 0x5636b91fb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.979+0000 7fec16237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b91fb090 0x5636b91fb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32976/0 (socket says 172.21.15.192:32976) 2024-09-10T05:11:51.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.979+0000 7fec16237640 1 -- 172.21.15.192:0/1810960718 learned_addr learned my addr 172.21.15.192:0/1810960718 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.980+0000 7fec16237640 1 -- 172.21.15.192:0/1810960718 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b91fbaf0 con 0x5636b91fb090 2024-09-10T05:11:51.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.980+0000 7fec16237640 1 --2- 172.21.15.192:0/1810960718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b91fb090 0x5636b91fb4b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fec08095ab0 tx=0x7fec0805ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.980+0000 7feafbfff640 1 -- 172.21.15.192:0/1810960718 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec08000ed0 con 0x5636b91fb090 2024-09-10T05:11:51.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.980+0000 7feafbfff640 1 -- 172.21.15.192:0/1810960718 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec08095e50 con 0x5636b91fb090 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.980+0000 7feafbfff640 1 -- 172.21.15.192:0/1810960718 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec08078460 con 0x5636b91fb090 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.980+0000 7fec18746800 1 -- 172.21.15.192:0/1810960718 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636b91fc320 con 0x5636b91fb090 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.980+0000 7fec18746800 1 -- 172.21.15.192:0/1810960718 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636b91fc800 con 0x5636b91fb090 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.981+0000 7feafbfff640 1 -- 172.21.15.192:0/1810960718 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fec0804f070 con 0x5636b91fb090 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.981+0000 7feafbfff640 1 --2- 172.21.15.192:0/1810960718 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feaf003c780 0x7feaf003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.981+0000 7feafbfff640 1 -- 172.21.15.192:0/1810960718 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fec0808e070 con 0x5636b91fb090 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.981+0000 7fec0ffff640 1 --2- 172.21.15.192:0/1810960718 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feaf003c780 0x7feaf003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.981+0000 7fec18746800 1 Processor -- start 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.981+0000 7fec18746800 1 -- start start 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.981+0000 7fec0ffff640 1 --2- 172.21.15.192:0/1810960718 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feaf003c780 0x7feaf003ec40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x5636b91e9810 tx=0x7fec00006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.981+0000 7fec18746800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 0x5636b9207cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.981+0000 7fec18746800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5636b90e26d0 con 0x5636b92078d0 2024-09-10T05:11:51.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.982+0000 7fec16237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 0x5636b9207cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.982+0000 7fec16237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 0x5636b9207cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32988/0 (socket says 172.21.15.192:32988) 2024-09-10T05:11:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.982+0000 7fec16237640 1 -- 172.21.15.192:0/2138707521 learned_addr learned my addr 172.21.15.192:0/2138707521 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.982+0000 7fec16237640 1 -- 172.21.15.192:0/2138707521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b92082a0 con 0x5636b92078d0 2024-09-10T05:11:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.982+0000 7fec16237640 1 --2- 172.21.15.192:0/2138707521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 0x5636b9207cb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fec08051040 tx=0x7fec08006bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731229870e81d44d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.982+0000 7feaf9ffb640 1 -- 172.21.15.192:0/2138707521 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec08006560 con 0x5636b92078d0 2024-09-10T05:11:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.982+0000 7feaf9ffb640 1 -- 172.21.15.192:0/2138707521 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec08078600 con 0x5636b92078d0 2024-09-10T05:11:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.982+0000 7feaf9ffb640 1 -- 172.21.15.192:0/2138707521 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec08006380 con 0x5636b92078d0 2024-09-10T05:11:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec18746800 1 -- 172.21.15.192:0/2138707521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 msgr2=0x5636b9207cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec18746800 1 --2- 172.21.15.192:0/2138707521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 0x5636b9207cb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fec08051040 tx=0x7fec08006bf0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec18746800 1 -- 172.21.15.192:0/2138707521 shutdown_connections 2024-09-10T05:11:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec18746800 1 --2- 172.21.15.192:0/2138707521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 0x5636b9207cb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec18746800 1 -- 172.21.15.192:0/2138707521 >> 172.21.15.192:0/2138707521 conn(0x5636b9203cd0 msgr2=0x5636b9201f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec18746800 1 -- 172.21.15.192:0/2138707521 shutdown_connections 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec18746800 1 -- 172.21.15.192:0/2138707521 wait complete. 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec18746800 1 Processor -- start 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec18746800 1 -- start start 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec18746800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 0x5636b920ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec18746800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5636b9208730 con 0x5636b92078d0 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec16237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 0x5636b920ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec16237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 0x5636b920ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:32992/0 (socket says 172.21.15.192:32992) 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.983+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 learned_addr learned my addr 172.21.15.192:0/3286217817 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.984+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b920f1f0 con 0x5636b92078d0 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.984+0000 7fec16237640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 0x5636b920ec90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fec08005570 tx=0x7fec0807ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.984+0000 7feae7fff640 1 -- 172.21.15.192:0/3286217817 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec080bb070 con 0x5636b92078d0 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.984+0000 7feae7fff640 1 -- 172.21.15.192:0/3286217817 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec08092d30 con 0x5636b92078d0 2024-09-10T05:11:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.984+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636b920f1f0 con 0x5636b92078d0 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.984+0000 7feae7fff640 1 -- 172.21.15.192:0/3286217817 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec080941f0 con 0x5636b92078d0 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.984+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636b920f1f0 con 0x5636b92078d0 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.985+0000 7feae7fff640 1 -- 172.21.15.192:0/3286217817 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fec080be070 con 0x5636b92078d0 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.985+0000 7feae7fff640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feae003c780 0x7feae003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.985+0000 7feae7fff640 1 -- 172.21.15.192:0/3286217817 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fec080b3070 con 0x5636b92078d0 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.985+0000 7fec0ffff640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feae003c780 0x7feae003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.985+0000 7fec0ffff640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feae003c780 0x7feae003ec40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fec0000ffd0 tx=0x7fec00023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.986+0000 7fec18746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.986+0000 7fec18746800 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5636b921a200 0x5636b921c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.986+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b921ce10 con 0x5636b921a200 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.986+0000 7fec16a38640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5636b921a200 0x5636b921c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.986+0000 7fec16a38640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5636b921a200 0x5636b921c6c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.986+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:51.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.986+0000 7fec18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.986+0000 7fec18746800 20 realm 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.986+0000 7fec18746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.986+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b921d220 con 0x5636b921a200 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec18746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec18746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b921daf0 con 0x5636b921a200 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec18746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921a200 2024-09-10T05:11:51.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec18746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec18746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec18746800 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5636b921ebf0 0x5636b9220fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b92215a0 con 0x5636b921ebf0 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.987+0000 7fec16237640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5636b921ebf0 0x5636b9220fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.988+0000 7fec16237640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5636b921ebf0 0x5636b9220fe0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.988+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.988+0000 7fec18746800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.988+0000 7fec18746800 20 searching for the correct realm 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.988+0000 7fec18746800 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5636b9223550 0x5636b9225a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.988+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b92260e0 con 0x5636b9223550 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.988+0000 7fec0ffff640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5636b9223550 0x5636b9225a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.988+0000 7fec0ffff640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5636b9223550 0x5636b9225a10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.989+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:51.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.989+0000 7fec0ffff640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fec0002e910 0x7fec0003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:51.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.989+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b92260e0 con 0x7fec0002e910 2024-09-10T05:11:51.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.989+0000 7fec16a38640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fec0002e910 0x7fec0003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:51.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.989+0000 7fec16a38640 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fec0002e910 0x7fec0003a3c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:51.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.989+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:51.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.989+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921ebf0 2024-09-10T05:11:51.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.990+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:51.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.990+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921a200 2024-09-10T05:11:51.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.990+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:51.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.990+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921a200 2024-09-10T05:11:51.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.990+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:51.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.990+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921ebf0 2024-09-10T05:11:52.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.991+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.991+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921ebf0 2024-09-10T05:11:52.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.991+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.991+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x7fec0002e910 2024-09-10T05:11:52.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.991+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.991+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b9223550 2024-09-10T05:11:52.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.991+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.991+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921a200 2024-09-10T05:11:52.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.992+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.992+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921ebf0 2024-09-10T05:11:52.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.992+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.992+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921a200 2024-09-10T05:11:52.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.992+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.992+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x7fec0002e910 2024-09-10T05:11:52.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.992+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.992+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b9223550 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.993+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.993+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b9223550 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.993+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.993+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921ebf0 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.993+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.993+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b9223550 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.993+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.993+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b9223550 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.993+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.993+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921a200 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.994+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.994+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921a200 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.994+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.994+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921ebf0 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.994+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.994+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b9223550 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.995+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.995+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x7fec0002e910 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.995+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.995+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921a200 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.995+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.995+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921ebf0 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.995+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.995+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b9223550 2024-09-10T05:11:52.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.995+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.995+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921ebf0 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.996+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.996+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x7fec0002e910 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.996+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.996+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b9223550 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.996+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.996+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921ebf0 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x5636b921a200 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5636b921de90 con 0x7fec0002e910 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b9221e60 con 0x5636b921a200 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b9221e60 con 0x5636b921a200 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.997+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b9221e60 con 0x7fec0002e910 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 20 zone default found 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 4 Realm: () 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 20 zonegroup default 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b9221e40 con 0x5636b921ebf0 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b9227f50 con 0x5636b9223550 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.998+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b92282f0 con 0x5636b9223550 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.999+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.999+0000 7fec18746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.999+0000 7fec18746800 20 started sync module instance, tier type = 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.999+0000 7fec18746800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:51.999+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b92273f0 con 0x7fec0002e910 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.000+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.000+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94793034266896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b92273f0 con 0x7fec0002e910 2024-09-10T05:11:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.000+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9228b40 con 0x5636b921a200 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.001+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94793034266896] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.001+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.001+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94793034264384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9228ba0 con 0x5636b921a200 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.001+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b92296b0 con 0x5636b9223550 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.002+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94793034264384] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.002+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.002+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94793034273120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9229aa0 con 0x5636b9223550 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.002+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922a4a0 con 0x7fec0002e910 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.003+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94793034273120] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.003+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.003+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94793034270352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922a8c0 con 0x7fec0002e910 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.003+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922b2e0 con 0x5636b921a200 2024-09-10T05:11:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.004+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94793034270352] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.005+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.005+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94793034280400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922b2a0 con 0x5636b921a200 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.005+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922bcf0 con 0x5636b921ebf0 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.006+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94793034280400] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.006+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.006+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94793034283072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922c090 con 0x5636b921ebf0 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.006+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922ca50 con 0x5636b921ebf0 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.007+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94793034283072] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.007+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.007+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94793034286496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922c9c0 con 0x5636b921ebf0 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.007+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922d810 con 0x5636b921ebf0 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.008+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94793034286496] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.008+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.008+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94793034288608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922d810 con 0x5636b921ebf0 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.008+0000 7fec18746800 20 add_watcher() i=0 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.008+0000 7fec18746800 20 add_watcher() i=1 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.008+0000 7fec18746800 20 add_watcher() i=2 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.008+0000 7fec18746800 20 add_watcher() i=3 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.008+0000 7fec18746800 20 add_watcher() i=4 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.008+0000 7fec18746800 20 add_watcher() i=5 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.008+0000 7fec18746800 20 add_watcher() i=6 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.009+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94793034288608] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.009+0000 7fec18746800 20 add_watcher() i=7 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.009+0000 7fec18746800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.009+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b9230ca0 con 0x5636b921a200 2024-09-10T05:11:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.009+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.009+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94793034289664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922e160 con 0x5636b921a200 2024-09-10T05:11:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.010+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94793034289664] v35'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.010+0000 7feaccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.010+0000 7fec18746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.010+0000 7fec18746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.010+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b92394d0 con 0x5636b921a200 2024-09-10T05:11:52.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.011+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'46 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.011+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9239ae0 con 0x5636b921ebf0 2024-09-10T05:11:52.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.012+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.012+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9239aa0 con 0x5636b9223550 2024-09-10T05:11:52.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.013+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.013+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922fdb0 con 0x5636b921a200 2024-09-10T05:11:52.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.014+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'141 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.014+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922f900 con 0x7fec0002e910 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.015+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'44 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.015+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922f900 con 0x5636b9223550 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.016+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'37 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.016+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923b780 con 0x5636b921a200 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.017+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.017+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923b780 con 0x5636b921ebf0 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.019+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'31 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.019+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923b780 con 0x7fec0002e910 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.020+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.020+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923b910 con 0x5636b9223550 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.021+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.021+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923bfa0 con 0x7fec0002e910 2024-09-10T05:11:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.022+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'45 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.022+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923bfa0 con 0x5636b921ebf0 2024-09-10T05:11:52.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.023+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.023+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c030 con 0x7fec0002e910 2024-09-10T05:11:52.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.024+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.024+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c030 con 0x5636b921ebf0 2024-09-10T05:11:52.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.025+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'43 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.025+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c030 con 0x5636b921a200 2024-09-10T05:11:52.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.026+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'142 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.026+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c030 con 0x5636b9223550 2024-09-10T05:11:52.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.027+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.027+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c030 con 0x7fec0002e910 2024-09-10T05:11:52.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.028+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'46 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.028+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c070 con 0x5636b9223550 2024-09-10T05:11:52.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.029+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.029+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c140 con 0x5636b921a200 2024-09-10T05:11:52.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.030+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.030+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c140 con 0x5636b921a200 2024-09-10T05:11:52.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.031+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'143 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.031+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c140 con 0x5636b9223550 2024-09-10T05:11:52.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.032+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.032+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c210 con 0x7fec0002e910 2024-09-10T05:11:52.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.033+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.033+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c1d0 con 0x5636b9223550 2024-09-10T05:11:52.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.034+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.034+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c1d0 con 0x5636b9223550 2024-09-10T05:11:52.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.035+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.035+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c1d0 con 0x5636b9223550 2024-09-10T05:11:52.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.036+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.036+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c1d0 con 0x5636b9223550 2024-09-10T05:11:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.037+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.037+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c1d0 con 0x5636b921ebf0 2024-09-10T05:11:52.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.038+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.038+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c1d0 con 0x5636b9223550 2024-09-10T05:11:52.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.039+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.039+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c1d0 con 0x5636b921ebf0 2024-09-10T05:11:52.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.040+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.041+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c1d0 con 0x5636b9223550 2024-09-10T05:11:52.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.041+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.042+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c1d0 con 0x5636b921ebf0 2024-09-10T05:11:52.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.043+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'44 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.043+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b923c1d0 con 0x7fec0002e910 2024-09-10T05:11:52.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.044+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.044+0000 7fea477fe640 20 reqs_thread_entry: start 2024-09-10T05:11:52.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.044+0000 7fec18746800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:52.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.044+0000 7fec18746800 20 Filter name: none 2024-09-10T05:11:52.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.044+0000 7fea457fa640 20 reqs_thread_entry: start 2024-09-10T05:11:52.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.045+0000 7fec18746800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-10T05:11:52.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.045+0000 7fec18746800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.045+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b9267470 con 0x5636b921ebf0 2024-09-10T05:11:52.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.045+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.045+0000 7fec18746800 20 rados_obj.operate() r=0 bl.length=419 2024-09-10T05:11:52.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.045+0000 7fec18746800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-10T05:11:52.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.045+0000 7fec18746800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-10T05:11:52.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.045+0000 7fec18746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:52.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.045+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b9267470 con 0x5636b921a200 2024-09-10T05:11:52.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.045+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.045+0000 7fec18746800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T05:11:52.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.045+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9267430 con 0x5636b921ebf0 2024-09-10T05:11:52.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.046+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v35'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.046+0000 7fec18746800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:11:52.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.047+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94793034533024 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b926a260 con 0x5636b9223550 2024-09-10T05:11:52.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.047+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== watch-notify(notify (1) cookie 94793034273120 notify 150323855367 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5636b923bdd0 con 0x5636b9223550 2024-09-10T05:11:52.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.047+0000 7feaf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855367 cookie 94793034273120 notifier 4574 bl.length()=170 2024-09-10T05:11:52.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.047+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(97 notify.2 [notify cookie 94793034533024 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.047+0000 7feaf9ffb640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7feadc003d60 con 0x5636b9223550 2024-09-10T05:11:52.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.047+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 28 ==== watch-notify(notify_complete (2) cookie 94793034533024 notify 150323855367 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5636b9230340 con 0x5636b9223550 2024-09-10T05:11:52.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.047+0000 7fec18746800 10 removing email index: 2024-09-10T05:11:52.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.047+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.047+0000 7fec18746800 10 removing user buckets index 2024-09-10T05:11:52.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.047+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9267d40 con 0x5636b921a200 2024-09-10T05:11:52.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.048+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v35'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.048+0000 7fec18746800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-10T05:11:52.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.048+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94793034528912 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b9267cb0 con 0x5636b921a200 2024-09-10T05:11:52.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.048+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== watch-notify(notify (1) cookie 94793034280400 notify 150323855373 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5636b9230510 con 0x5636b921a200 2024-09-10T05:11:52.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.049+0000 7feaf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855373 cookie 94793034280400 notifier 4574 bl.length()=175 2024-09-10T05:11:52.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.049+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(100 notify.4 [notify cookie 94793034528912 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.049+0000 7feaf9ffb640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7feadc003d60 con 0x5636b921a200 2024-09-10T05:11:52.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.049+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== watch-notify(notify_complete (2) cookie 94793034528912 notify 150323855373 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5636b922fca0 con 0x5636b921a200 2024-09-10T05:11:52.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.049+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.049+0000 7fec18746800 10 removing user index: testx$tenanteduser 2024-09-10T05:11:52.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.049+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9269150 con 0x5636b921ebf0 2024-09-10T05:11:52.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.050+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v35'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.050+0000 7fec18746800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-10T05:11:52.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.050+0000 7fec18746800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-10T05:11:52.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.050+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94793034536720 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5636b9269150 con 0x7fec0002e910 2024-09-10T05:11:52.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.050+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== watch-notify(notify (1) cookie 94793034270352 notify 150323855378 ret 0) ==== 209+0+0 (crc 0 0 0) 0x5636b922fca0 con 0x7fec0002e910 2024-09-10T05:11:52.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.050+0000 7feaf97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855378 cookie 94793034270352 notifier 4574 bl.length()=167 2024-09-10T05:11:52.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.050+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(103 notify.3 [notify cookie 94793034536720 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.050+0000 7feaf97fa640 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fea4c0032c0 con 0x7fec0002e910 2024-09-10T05:11:52.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.051+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== watch-notify(notify_complete (2) cookie 94793034536720 notify 150323855378 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5636b9239110 con 0x7fec0002e910 2024-09-10T05:11:52.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.051+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.052+0000 7feaccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:52.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.052+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94793034289664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9237060 con 0x5636b921a200 2024-09-10T05:11:52.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.052+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94793034289664] v35'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.052+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94793034266896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922d200 con 0x7fec0002e910 2024-09-10T05:11:52.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.053+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94793034266896] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.053+0000 7fec18746800 20 remove_watcher() i=0 2024-09-10T05:11:52.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.053+0000 7fec18746800 2 removed watcher, disabling cache 2024-09-10T05:11:52.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.053+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94793034264384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9227910 con 0x5636b921a200 2024-09-10T05:11:52.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.054+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94793034264384] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.055+0000 7fec18746800 20 remove_watcher() i=1 2024-09-10T05:11:52.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.055+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94793034273120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9226f40 con 0x5636b9223550 2024-09-10T05:11:52.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.056+0000 7fec0ffff640 1 -- 172.21.15.192:0/3286217817 <== osd.3 v2:172.21.15.192:6816/1620624472 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94793034273120] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec00037040 con 0x5636b9223550 2024-09-10T05:11:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.056+0000 7fec18746800 20 remove_watcher() i=2 2024-09-10T05:11:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.056+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94793034270352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9226f40 con 0x7fec0002e910 2024-09-10T05:11:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.057+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.2 v2:172.21.15.192:6801/2435677948 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94793034270352] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x7fec0002e910 2024-09-10T05:11:52.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.057+0000 7fec18746800 20 remove_watcher() i=3 2024-09-10T05:11:52.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.057+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94793034280400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9226f40 con 0x5636b921a200 2024-09-10T05:11:52.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.058+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 <== osd.1 v2:172.21.15.192:6800/3487349558 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94793034280400] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec1000a4d0 con 0x5636b921a200 2024-09-10T05:11:52.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.058+0000 7fec18746800 20 remove_watcher() i=4 2024-09-10T05:11:52.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.058+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94793034283072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9226f40 con 0x5636b921ebf0 2024-09-10T05:11:52.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.059+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94793034283072] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.059+0000 7fec18746800 20 remove_watcher() i=5 2024-09-10T05:11:52.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.059+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94793034286496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b922b840 con 0x5636b921ebf0 2024-09-10T05:11:52.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.060+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94793034286496] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.060+0000 7fec18746800 20 remove_watcher() i=6 2024-09-10T05:11:52.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.060+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94793034288608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5636b9226f40 con 0x5636b921ebf0 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.060+0000 7fec16237640 1 -- 172.21.15.192:0/3286217817 <== osd.0 v2:172.21.15.139:6800/2915567440 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94793034288608] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec080bd030 con 0x5636b921ebf0 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.060+0000 7fec18746800 20 remove_watcher() i=7 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5636b921ebf0 msgr2=0x5636b9220fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5636b921ebf0 0x5636b9220fe0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5636b921a200 msgr2=0x5636b921c6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5636b921a200 0x5636b921c6c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fec0002e910 msgr2=0x7fec0003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fec0002e910 0x7fec0003a3c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5636b9223550 msgr2=0x5636b9225a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5636b9223550 0x5636b9225a10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feae003c780 msgr2=0x7feae003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feae003c780 0x7feae003ec40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fec0000ffd0 tx=0x7fec00023040 comp rx=0 tx=0).stop 2024-09-10T05:11:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 msgr2=0x5636b920ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec16a38640 1 -- 172.21.15.192:0/3286217817 reap_dead start 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 0x5636b920ec90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fec08005570 tx=0x7fec0807ef90 comp rx=0 tx=0).stop 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 shutdown_connections 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 --2- 172.21.15.192:0/3286217817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b92078d0 0x5636b920ec90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 >> 172.21.15.192:0/3286217817 conn(0x5636b9203cd0 msgr2=0x5636b9201ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 shutdown_connections 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/3286217817 wait complete. 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/1810960718 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feaf003c780 msgr2=0x7feaf003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 --2- 172.21.15.192:0/1810960718 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feaf003c780 0x7feaf003ec40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x5636b91e9810 tx=0x7fec00006000 comp rx=0 tx=0).stop 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/1810960718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b91fb090 msgr2=0x5636b91fb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 --2- 172.21.15.192:0/1810960718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b91fb090 0x5636b91fb4b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fec08095ab0 tx=0x7fec0805ae80 comp rx=0 tx=0).stop 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/1810960718 shutdown_connections 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 --2- 172.21.15.192:0/1810960718 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feaf003c780 0x7feaf003ec40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 --2- 172.21.15.192:0/1810960718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b91fb090 0x5636b91fb4b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/1810960718 >> 172.21.15.192:0/1810960718 conn(0x5636b91ef440 msgr2=0x5636b91ef820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/1810960718 shutdown_connections 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.061+0000 7fec18746800 1 -- 172.21.15.192:0/1810960718 wait complete. 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5636b91e6840 msgr2=0x5636b91e8ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5636b91e6840 0x5636b91e8ce0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5636b90e7030 msgr2=0x5636b91e4460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5636b90e7030 0x5636b91e4460 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5636b91ea8d0 msgr2=0x5636b91eccc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5636b91ea8d0 0x5636b91eccc0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feafc03c780 msgr2=0x7feafc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feafc03c780 0x7feafc03ec40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fec00000c00 tx=0x7fec000013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 msgr2=0x5636b91dce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 --2- 172.21.15.192:0/1179490623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b90e46a0 0x5636b91dce10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fec08025da0 tx=0x7fec08002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec16a38640 1 -- 172.21.15.192:0/1179490623 reap_dead start 2024-09-10T05:11:52.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 shutdown_connections 2024-09-10T05:11:52.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 >> 172.21.15.192:0/1179490623 conn(0x5636b90de200 msgr2=0x5636b91ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 shutdown_connections 2024-09-10T05:11:52.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.062+0000 7fec18746800 1 -- 172.21.15.192:0/1179490623 wait complete. 2024-09-10T05:11:52.077 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-10T05:11:52.082 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-10T05:11:52.126 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:11:52.126 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-10T05:11:52.126 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-10T05:11:52.126 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-10T05:11:52.174 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:52.174 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:52.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.173+0000 7f4c41b31800 1 Processor -- start 2024-09-10T05:11:52.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.173+0000 7f4c41b31800 1 -- start start 2024-09-10T05:11:52.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.173+0000 7f4c41b31800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c8e03ac200 0x55c8e03b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.173+0000 7f4c41b31800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c8e0255e40 con 0x55c8e03aadf0 2024-09-10T05:11:52.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.173+0000 7f4c41b31800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55c8e0220680 con 0x55c8e03ac200 2024-09-10T05:11:52.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.174+0000 7f4c35075640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c8e03ac200 0x55c8e03b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.174+0000 7f4c3d876640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55c8e03aadf0 0x55c8e03abaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:36534/0 (socket says 172.21.15.192:36534) 2024-09-10T05:11:52.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.174+0000 7f4c3d876640 1 -- 172.21.15.192:0/872326942 learned_addr learned my addr 172.21.15.192:0/872326942 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:52.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.174+0000 7f4c35075640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c8e03ac200 0x55c8e03b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33004/0 (socket says 172.21.15.192:33004) 2024-09-10T05:11:52.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.174+0000 7f4c35075640 1 -- 172.21.15.192:0/872326942 >> v1:172.21.15.139:6789/0 conn(0x55c8e03aadf0 legacy=0x55c8e03abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.174+0000 7f4c35075640 1 -- 172.21.15.192:0/872326942 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e023c6b0 con 0x55c8e03ac200 2024-09-10T05:11:52.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.176+0000 7f4c35075640 1 --2- 172.21.15.192:0/872326942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03ac200 0x55c8e03b1da0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800a470 tx=0x7f4c28045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2825d362f64477e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.176+0000 7f4c3d075640 1 -- 172.21.15.192:0/872326942 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c28053570 con 0x55c8e03ac200 2024-09-10T05:11:52.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.176+0000 7f4c3d075640 1 -- 172.21.15.192:0/872326942 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c28058070 con 0x55c8e03ac200 2024-09-10T05:11:52.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.176+0000 7f4c3d075640 1 -- 172.21.15.192:0/872326942 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c28053880 con 0x55c8e03ac200 2024-09-10T05:11:52.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.176+0000 7f4c41b31800 1 -- 172.21.15.192:0/872326942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03ac200 msgr2=0x55c8e03b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.176+0000 7f4c41b31800 1 --2- 172.21.15.192:0/872326942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03ac200 0x55c8e03b1da0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800a470 tx=0x7f4c28045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:52.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.176+0000 7f4c41b31800 1 -- 172.21.15.192:0/872326942 shutdown_connections 2024-09-10T05:11:52.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.176+0000 7f4c41b31800 1 --2- 172.21.15.192:0/872326942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03ac200 0x55c8e03b1da0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.176+0000 7f4c41b31800 1 -- 172.21.15.192:0/872326942 >> 172.21.15.192:0/872326942 conn(0x55c8e03a61c0 msgr2=0x55c8e03a8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.176+0000 7f4c41b31800 1 -- 172.21.15.192:0/872326942 shutdown_connections 2024-09-10T05:11:52.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.176+0000 7f4c41b31800 1 -- 172.21.15.192:0/872326942 wait complete. 2024-09-10T05:11:52.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.190+0000 7f4c41b31800 1 Processor -- start 2024-09-10T05:11:52.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.190+0000 7f4c41b31800 1 -- start start 2024-09-10T05:11:52.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.190+0000 7f4c41b31800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 0x55c8e049a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.190+0000 7f4c41b31800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c8e0244dd0 con 0x55c8e03aadf0 2024-09-10T05:11:52.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.191+0000 7f4c3d876640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 0x55c8e049a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.191+0000 7f4c3d876640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 0x55c8e049a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33010/0 (socket says 172.21.15.192:33010) 2024-09-10T05:11:52.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.191+0000 7f4c3d876640 1 -- 172.21.15.192:0/2821176633 learned_addr learned my addr 172.21.15.192:0/2821176633 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.191+0000 7f4c3d876640 1 -- 172.21.15.192:0/2821176633 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e025de10 con 0x55c8e03aadf0 2024-09-10T05:11:52.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.191+0000 7f4c3d876640 1 --2- 172.21.15.192:0/2821176633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 0x55c8e049a570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4c30001e40 tx=0x7f4c30001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287e946dfa8bdea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.191+0000 7f4b2be07640 1 -- 172.21.15.192:0/2821176633 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c30012020 con 0x55c8e03aadf0 2024-09-10T05:11:52.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.191+0000 7f4b2be07640 1 -- 172.21.15.192:0/2821176633 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3000e5a0 con 0x55c8e03aadf0 2024-09-10T05:11:52.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.191+0000 7f4b2be07640 1 -- 172.21.15.192:0/2821176633 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3000e8a0 con 0x55c8e03aadf0 2024-09-10T05:11:52.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.192+0000 7f4c41b31800 1 -- 172.21.15.192:0/2821176633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 msgr2=0x55c8e049a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.192+0000 7f4c41b31800 1 --2- 172.21.15.192:0/2821176633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 0x55c8e049a570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4c30001e40 tx=0x7f4c30001e70 comp rx=0 tx=0).stop 2024-09-10T05:11:52.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.192+0000 7f4c41b31800 1 -- 172.21.15.192:0/2821176633 shutdown_connections 2024-09-10T05:11:52.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.192+0000 7f4c41b31800 1 --2- 172.21.15.192:0/2821176633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 0x55c8e049a570 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.192+0000 7f4c41b31800 1 -- 172.21.15.192:0/2821176633 >> 172.21.15.192:0/2821176633 conn(0x55c8e03a61c0 msgr2=0x55c8e0495ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.192+0000 7f4c41b31800 1 -- 172.21.15.192:0/2821176633 shutdown_connections 2024-09-10T05:11:52.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.192+0000 7f4c41b31800 1 -- 172.21.15.192:0/2821176633 wait complete. 2024-09-10T05:11:52.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.192+0000 7f4c41b31800 1 Processor -- start 2024-09-10T05:11:52.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4c41b31800 1 -- start start 2024-09-10T05:11:52.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4c41b31800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 0x55c8e031f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4c41b31800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c8e03ac8f0 con 0x55c8e03aadf0 2024-09-10T05:11:52.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4c3d876640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 0x55c8e031f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4c3d876640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 0x55c8e031f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33018/0 (socket says 172.21.15.192:33018) 2024-09-10T05:11:52.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4c3d876640 1 -- 172.21.15.192:0/458341898 learned_addr learned my addr 172.21.15.192:0/458341898 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4c3d876640 1 -- 172.21.15.192:0/458341898 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e031faf0 con 0x55c8e03aadf0 2024-09-10T05:11:52.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4c3d876640 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 0x55c8e031f590 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c010 tx=0x7f4c30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4b2a604640 1 -- 172.21.15.192:0/458341898 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c30012030 con 0x55c8e03aadf0 2024-09-10T05:11:52.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4b2a604640 1 -- 172.21.15.192:0/458341898 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c300014a0 con 0x55c8e03aadf0 2024-09-10T05:11:52.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8e04a5c90 con 0x55c8e03aadf0 2024-09-10T05:11:52.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4b2a604640 1 -- 172.21.15.192:0/458341898 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3001a7a0 con 0x55c8e03aadf0 2024-09-10T05:11:52.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.193+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8e04a6250 con 0x55c8e03aadf0 2024-09-10T05:11:52.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.194+0000 7f4b2a604640 1 -- 172.21.15.192:0/458341898 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4c30015020 con 0x55c8e03aadf0 2024-09-10T05:11:52.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.194+0000 7f4b2a604640 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b2403c730 0x7f4b2403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.194+0000 7f4b2a604640 1 -- 172.21.15.192:0/458341898 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f4c30020030 con 0x55c8e03aadf0 2024-09-10T05:11:52.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.195+0000 7f4c35075640 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b2403c730 0x7f4b2403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.195+0000 7f4c41b31800 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c8e03ac200 0x55c8e04aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.195+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04aa850 con 0x55c8e03ac200 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.195+0000 7f4c3e077640 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c8e03ac200 0x55c8e04aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.195+0000 7f4c35075640 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b2403c730 0x7f4b2403ebf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4c28057000 tx=0x7f4c28052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.195+0000 7f4c3e077640 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c8e03ac200 0x55c8e04aa1e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.195+0000 7f4c3e077640 1 -- 172.21.15.192:0/458341898 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e03ac200 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.195+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04a7690 con 0x55c8e03ac200 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.196+0000 7f4c3e077640 1 -- 172.21.15.192:0/458341898 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e03ac200 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.196+0000 7f4c41b31800 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c8e04acba0 0x55c8e04aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.196+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04af660 con 0x55c8e04acba0 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.196+0000 7f4c3d876640 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c8e04acba0 0x55c8e04aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.196+0000 7f4c3d876640 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c8e04acba0 0x55c8e04aef90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.197+0000 7f4c3d876640 1 -- 172.21.15.192:0/458341898 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c3001ab20 con 0x55c8e04acba0 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.197+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04aba40 con 0x55c8e03ac200 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.197+0000 7f4c3e077640 1 -- 172.21.15.192:0/458341898 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e03ac200 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.197+0000 7f4c41b31800 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c8e04b0aa0 0x55c8e04b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.197+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04b35d0 con 0x55c8e04b0aa0 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.197+0000 7f4c35075640 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c8e04b0aa0 0x55c8e04b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.197+0000 7f4c35075640 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c8e04b0aa0 0x55c8e04b2e90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.198+0000 7f4c35075640 1 -- 172.21.15.192:0/458341898 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c28051070 con 0x55c8e04b0aa0 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.198+0000 7f4c41b31800 1 Processor -- start 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.198+0000 7f4c41b31800 1 -- start start 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.198+0000 7f4c41b31800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04a33c0 0x55c8e04a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.198+0000 7f4c41b31800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c8e02a2a00 con 0x55c8e04a33c0 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.198+0000 7f4c3d876640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04a33c0 0x55c8e04a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.198+0000 7f4c3d876640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04a33c0 0x55c8e04a1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33022/0 (socket says 172.21.15.192:33022) 2024-09-10T05:11:52.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.198+0000 7f4c3d876640 1 -- 172.21.15.192:0/1580003461 learned_addr learned my addr 172.21.15.192:0/1580003461 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.199+0000 7f4c3d876640 1 -- 172.21.15.192:0/1580003461 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e04a38e0 con 0x55c8e04a33c0 2024-09-10T05:11:52.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.199+0000 7f4c3d876640 1 --2- 172.21.15.192:0/1580003461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04a33c0 0x55c8e04a1c30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4c30051f90 tx=0x7f4c30017f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.199+0000 7f4b237fe640 1 -- 172.21.15.192:0/1580003461 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3000c790 con 0x55c8e04a33c0 2024-09-10T05:11:52.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.199+0000 7f4b237fe640 1 -- 172.21.15.192:0/1580003461 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c30041040 con 0x55c8e04a33c0 2024-09-10T05:11:52.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.199+0000 7f4c41b31800 1 -- 172.21.15.192:0/1580003461 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8e04a2170 con 0x55c8e04a33c0 2024-09-10T05:11:52.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.199+0000 7f4b237fe640 1 -- 172.21.15.192:0/1580003461 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3000ca80 con 0x55c8e04a33c0 2024-09-10T05:11:52.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.199+0000 7f4c41b31800 1 -- 172.21.15.192:0/1580003461 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8e04a2170 con 0x55c8e04a33c0 2024-09-10T05:11:52.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.200+0000 7f4b237fe640 1 -- 172.21.15.192:0/1580003461 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4c3000cc20 con 0x55c8e04a33c0 2024-09-10T05:11:52.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.200+0000 7f4b237fe640 1 --2- 172.21.15.192:0/1580003461 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b1803c780 0x7f4b1803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.200+0000 7f4b237fe640 1 -- 172.21.15.192:0/1580003461 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f4c30038cb0 con 0x55c8e04a33c0 2024-09-10T05:11:52.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.200+0000 7f4c35075640 1 --2- 172.21.15.192:0/1580003461 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b1803c780 0x7f4b1803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.200+0000 7f4c41b31800 1 Processor -- start 2024-09-10T05:11:52.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.200+0000 7f4c41b31800 1 -- start start 2024-09-10T05:11:52.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.200+0000 7f4c35075640 1 --2- 172.21.15.192:0/1580003461 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b1803c780 0x7f4b1803ec40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55c8e04aad20 tx=0x7f4c28005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.200+0000 7f4c41b31800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 0x55c8e04cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.200+0000 7f4c41b31800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c8e049adc0 con 0x55c8e04cfa70 2024-09-10T05:11:52.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.201+0000 7f4c3d876640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 0x55c8e04cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.201+0000 7f4c3d876640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 0x55c8e04cfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33038/0 (socket says 172.21.15.192:33038) 2024-09-10T05:11:52.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.201+0000 7f4c3d876640 1 -- 172.21.15.192:0/3050144782 learned_addr learned my addr 172.21.15.192:0/3050144782 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.201+0000 7f4c3d876640 1 -- 172.21.15.192:0/3050144782 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e04d0460 con 0x55c8e04cfa70 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.201+0000 7f4c3d876640 1 --2- 172.21.15.192:0/3050144782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 0x55c8e04cfe70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4c3001a6f0 tx=0x7f4c3002dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359ddf18c8cd0286 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.201+0000 7f4b217fa640 1 -- 172.21.15.192:0/3050144782 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3004be10 con 0x55c8e04cfa70 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.201+0000 7f4b217fa640 1 -- 172.21.15.192:0/3050144782 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3002d3f0 con 0x55c8e04cfa70 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.201+0000 7f4b217fa640 1 -- 172.21.15.192:0/3050144782 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c30043a80 con 0x55c8e04cfa70 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c41b31800 1 -- 172.21.15.192:0/3050144782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 msgr2=0x55c8e04cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c41b31800 1 --2- 172.21.15.192:0/3050144782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 0x55c8e04cfe70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4c3001a6f0 tx=0x7f4c3002dd40 comp rx=0 tx=0).stop 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c41b31800 1 -- 172.21.15.192:0/3050144782 shutdown_connections 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c41b31800 1 --2- 172.21.15.192:0/3050144782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 0x55c8e04cfe70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c41b31800 1 -- 172.21.15.192:0/3050144782 >> 172.21.15.192:0/3050144782 conn(0x55c8e04cbe70 msgr2=0x55c8e04ca0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c41b31800 1 -- 172.21.15.192:0/3050144782 shutdown_connections 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c41b31800 1 -- 172.21.15.192:0/3050144782 wait complete. 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c41b31800 1 Processor -- start 2024-09-10T05:11:52.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c41b31800 1 -- start start 2024-09-10T05:11:52.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c41b31800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 0x55c8e04d6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c41b31800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c8e04d08d0 con 0x55c8e04cfa70 2024-09-10T05:11:52.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c3d876640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 0x55c8e04d6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c3d876640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 0x55c8e04d6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33046/0 (socket says 172.21.15.192:33046) 2024-09-10T05:11:52.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.202+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 learned_addr learned my addr 172.21.15.192:0/356771933 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.203+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e04d73d0 con 0x55c8e04cfa70 2024-09-10T05:11:52.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.203+0000 7f4c3d876640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 0x55c8e04d6e70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4c30036580 tx=0x7f4c30042060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.203+0000 7f4b0f7fe640 1 -- 172.21.15.192:0/356771933 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c30070070 con 0x55c8e04cfa70 2024-09-10T05:11:52.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.203+0000 7f4b0f7fe640 1 -- 172.21.15.192:0/356771933 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3004be10 con 0x55c8e04cfa70 2024-09-10T05:11:52.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.203+0000 7f4b0f7fe640 1 -- 172.21.15.192:0/356771933 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c3004c240 con 0x55c8e04cfa70 2024-09-10T05:11:52.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.203+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8e04d73d0 con 0x55c8e04cfa70 2024-09-10T05:11:52.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.203+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8e04d73d0 con 0x55c8e04cfa70 2024-09-10T05:11:52.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.204+0000 7f4b0f7fe640 1 -- 172.21.15.192:0/356771933 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f4c30073070 con 0x55c8e04cfa70 2024-09-10T05:11:52.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.204+0000 7f4b0f7fe640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b0803c780 0x7f4b0803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.204+0000 7f4b0f7fe640 1 -- 172.21.15.192:0/356771933 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f4c3005b070 con 0x55c8e04cfa70 2024-09-10T05:11:52.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.204+0000 7f4c35075640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b0803c780 0x7f4b0803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.204+0000 7f4c35075640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b0803c780 0x7f4b0803ec40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4c28000c00 tx=0x7f4c28053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.205+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.205+0000 7f4c41b31800 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c8e04e2450 0x55c8e04e4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.205+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e5060 con 0x55c8e04e2450 2024-09-10T05:11:52.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.205+0000 7f4c3e077640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c8e04e2450 0x55c8e04e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.205+0000 7f4c3e077640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c8e04e2450 0x55c8e04e4910 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.205+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.205+0000 7f4c41b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.205+0000 7f4c41b31800 20 realm 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.205+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.205+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e5470 con 0x55c8e04e2450 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c41b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c41b31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e5d40 con 0x55c8e04e2450 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c41b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e2450 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c41b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c41b31800 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c8e04e6e40 0x55c8e04e9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e97f0 con 0x55c8e04e6e40 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.206+0000 7f4c3d876640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c8e04e6e40 0x55c8e04e9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.207+0000 7f4c3d876640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c8e04e6e40 0x55c8e04e9230 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.207+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.207+0000 7f4c41b31800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.207+0000 7f4c41b31800 20 searching for the correct realm 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.207+0000 7f4c41b31800 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c8e04eb7a0 0x55c8e04edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.207+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ee330 con 0x55c8e04eb7a0 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.207+0000 7f4c35075640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c8e04eb7a0 0x55c8e04edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.207+0000 7f4c35075640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c8e04eb7a0 0x55c8e04edc60 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.208+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.208+0000 7f4c35075640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f4c2805f040 0x7f4c2806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.208+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ee330 con 0x7f4c2805f040 2024-09-10T05:11:52.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.208+0000 7f4c3e077640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f4c2805f040 0x7f4c2806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.208+0000 7f4c3e077640 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f4c2805f040 0x7f4c2806b410 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.208+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.208+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e6e40 2024-09-10T05:11:52.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.209+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.209+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e2450 2024-09-10T05:11:52.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.209+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.209+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e2450 2024-09-10T05:11:52.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.209+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.209+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e6e40 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.210+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.210+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e6e40 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.210+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.210+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x7f4c2805f040 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.210+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.210+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.210+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.210+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e2450 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.211+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.211+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e6e40 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.211+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.211+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e2450 2024-09-10T05:11:52.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.211+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.211+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x7f4c2805f040 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.211+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.211+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.211+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.212+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.212+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.212+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e6e40 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.212+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.212+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.212+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.212+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.212+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.212+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e2450 2024-09-10T05:11:52.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.213+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.213+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e2450 2024-09-10T05:11:52.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.213+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.213+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e6e40 2024-09-10T05:11:52.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.213+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.213+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.213+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.213+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x7f4c2805f040 2024-09-10T05:11:52.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.214+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.214+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e2450 2024-09-10T05:11:52.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.214+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.214+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e6e40 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.214+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.214+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.214+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.214+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e6e40 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.215+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.215+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x7f4c2805f040 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.215+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.215+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.215+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.215+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e6e40 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.215+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x55c8e04e2450 2024-09-10T05:11:52.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04e60e0 con 0x7f4c2805f040 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c41b31800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c41b31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c41b31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c41b31800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c41b31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c41b31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ea0b0 con 0x55c8e04e2450 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c41b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ea0b0 con 0x55c8e04e2450 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.216+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ea0b0 con 0x7f4c2805f040 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 20 zone default found 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 4 Realm: () 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 20 zonegroup default 2024-09-10T05:11:52.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ea090 con 0x55c8e04e6e40 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f01a0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.217+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f0540 con 0x55c8e04eb7a0 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.218+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.218+0000 7f4c41b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.218+0000 7f4c41b31800 20 started sync module instance, tier type = 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.218+0000 7f4c41b31800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:52.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.218+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ef640 con 0x7f4c2805f040 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.219+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.219+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94321245092720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ef640 con 0x7f4c2805f040 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.219+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f0f00 con 0x55c8e04e2450 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.220+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94321245092720] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.220+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.220+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94321245090672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f0f00 con 0x55c8e04e2450 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.220+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f1900 con 0x55c8e04eb7a0 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.221+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94321245090672] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.221+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.221+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94321245096528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f0e70 con 0x55c8e04eb7a0 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.221+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f26c0 con 0x7f4c2805f040 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.222+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94321245096528] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.222+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.222+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94321245101344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f2ae0 con 0x7f4c2805f040 2024-09-10T05:11:52.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.222+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f34e0 con 0x55c8e04e2450 2024-09-10T05:11:52.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.224+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.224+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94321245101344] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.224+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94321245106160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f3410 con 0x55c8e04e2450 2024-09-10T05:11:52.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.224+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f2160 con 0x55c8e04e6e40 2024-09-10T05:11:52.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.225+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.225+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94321245106160] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.225+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94321245110048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f4340 con 0x55c8e04e6e40 2024-09-10T05:11:52.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.225+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f4d00 con 0x55c8e04e6e40 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.226+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94321245110048] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.226+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.226+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94321245108432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f5550 con 0x55c8e04e6e40 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.226+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f5e00 con 0x55c8e04e6e40 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.227+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94321245108432] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.227+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.227+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94321245116656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f6060 con 0x55c8e04e6e40 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.227+0000 7f4c41b31800 20 add_watcher() i=0 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.227+0000 7f4c41b31800 20 add_watcher() i=1 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.227+0000 7f4c41b31800 20 add_watcher() i=2 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.227+0000 7f4c41b31800 20 add_watcher() i=3 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.227+0000 7f4c41b31800 20 add_watcher() i=4 2024-09-10T05:11:52.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.227+0000 7f4c41b31800 20 add_watcher() i=5 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.227+0000 7f4c41b31800 20 add_watcher() i=6 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.228+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94321245116656] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.228+0000 7f4c41b31800 20 add_watcher() i=7 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.228+0000 7f4c41b31800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.228+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f95d0 con 0x55c8e04e2450 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.228+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.228+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94321245114528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04f6af0 con 0x55c8e04e2450 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.229+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94321245114528] v35'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.229+0000 7f4aef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.229+0000 7f4c41b31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.229+0000 7f4c41b31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.229+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0501e30 con 0x55c8e04e2450 2024-09-10T05:11:52.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.231+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'47 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.231+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e05024e0 con 0x55c8e04e6e40 2024-09-10T05:11:52.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.232+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.232+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e05024e0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.233+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.233+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0502af0 con 0x55c8e04e2450 2024-09-10T05:11:52.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.234+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'146 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.234+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0502fa0 con 0x7f4c2805f040 2024-09-10T05:11:52.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.235+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'47 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.235+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ffc70 con 0x55c8e04eb7a0 2024-09-10T05:11:52.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.236+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'39 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.236+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ffc70 con 0x55c8e04e2450 2024-09-10T05:11:52.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.237+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.237+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0503b00 con 0x55c8e04e6e40 2024-09-10T05:11:52.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.237+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'33 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.237+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0503b00 con 0x7f4c2805f040 2024-09-10T05:11:52.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.239+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.239+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0503b00 con 0x55c8e04eb7a0 2024-09-10T05:11:52.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.240+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.240+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ff9e0 con 0x7f4c2805f040 2024-09-10T05:11:52.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.241+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'48 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.241+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ff9e0 con 0x55c8e04e6e40 2024-09-10T05:11:52.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.242+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.242+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ff9e0 con 0x7f4c2805f040 2024-09-10T05:11:52.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.243+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.243+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ff9e0 con 0x55c8e04e6e40 2024-09-10T05:11:52.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.244+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'45 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.244+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04ff9e0 con 0x55c8e04e2450 2024-09-10T05:11:52.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.245+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'147 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.245+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e05040b0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.246+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.246+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e05046a0 con 0x7f4c2805f040 2024-09-10T05:11:52.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.247+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.247+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504390 con 0x55c8e04eb7a0 2024-09-10T05:11:52.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.248+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.248+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504390 con 0x55c8e04e2450 2024-09-10T05:11:52.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.249+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.249+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504390 con 0x55c8e04e2450 2024-09-10T05:11:52.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.249+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'148 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.249+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504390 con 0x55c8e04eb7a0 2024-09-10T05:11:52.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.250+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.250+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504390 con 0x7f4c2805f040 2024-09-10T05:11:52.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.251+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.251+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504390 con 0x55c8e04eb7a0 2024-09-10T05:11:52.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.252+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.252+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504390 con 0x55c8e04eb7a0 2024-09-10T05:11:52.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.253+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.253+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504340 con 0x55c8e04eb7a0 2024-09-10T05:11:52.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.254+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'20 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.254+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504340 con 0x55c8e04eb7a0 2024-09-10T05:11:52.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.255+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'40 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.255+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504340 con 0x55c8e04e6e40 2024-09-10T05:11:52.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.256+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.256+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504380 con 0x55c8e04eb7a0 2024-09-10T05:11:52.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.257+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.257+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504340 con 0x55c8e04e6e40 2024-09-10T05:11:52.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.258+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'34 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.258+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504340 con 0x55c8e04eb7a0 2024-09-10T05:11:52.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.259+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.259+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504340 con 0x55c8e04e6e40 2024-09-10T05:11:52.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.260+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'46 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.260+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0504380 con 0x7f4c2805f040 2024-09-10T05:11:52.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.261+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.261+0000 7f4aee7fc640 20 reqs_thread_entry: start 2024-09-10T05:11:52.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4c41b31800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:52.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4c41b31800 20 Filter name: none 2024-09-10T05:11:52.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4a5ffff640 20 reqs_thread_entry: start 2024-09-10T05:11:52.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4c41b31800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:11:52.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e052f2a0 con 0x7f4c2805f040 2024-09-10T05:11:52.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4c41b31800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:52.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4c41b31800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:11:52.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4c41b31800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:52.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4c41b31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 : miss 2024-09-10T05:11:52.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4c41b31800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.262+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:95 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0530cf0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(95 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 20 get_obj_state: octx=0x7f4c3800ab20 obj=myfoo:four state=0x55c8e0531aa8 s->prefetch_data=0 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:96 3.2ds0 3:b75f71b7:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0532b00 con 0x55c8e04eb7a0 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(96 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 10 manifest: total_size = 4 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 20 get_obj_state: setting s->obj_tag to 92aa256a-2802-419e-96e0-ba675846cbc3.4238.9781334026174720705 2024-09-10T05:11:52.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 20 get_obj_state: octx=0x7f4c3800ab20 obj=myfoo:four state=0x55c8e0531aa8 s->prefetch_data=0 2024-09-10T05:11:52.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 20 prepare_atomic_modification: state is not atomic. state=0x55c8e0531aa8 2024-09-10T05:11:52.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 20 bucket index object: :.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6 2024-09-10T05:11:52.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.263+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:97 4.e 4:71344637:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e05375a0 con 0x7f4c2805f040 2024-09-10T05:11:52.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.264+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(97 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6 [stat,call,call] v35'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.264+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:98 3.2ds0 3:b75f71b7:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e05375a0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.265+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 28 ==== osd_op_reply(98 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1_four [call] v35'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.265+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:99 4.e 4:71344637:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0537ed0 con 0x7f4c2805f040 2024-09-10T05:11:52.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.266+0000 7f4aef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:52.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.266+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94321245114528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0537ed0 con 0x55c8e04e2450 2024-09-10T05:11:52.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.267+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(99 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6 [stat,call,call] v35'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.267+0000 7f4b217fa640 20 handle_completion(): completion ok for obj=four 2024-09-10T05:11:52.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.270+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94321245114528] v35'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.270+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94321245092720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e0537ed0 con 0x7f4c2805f040 2024-09-10T05:11:52.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.271+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94321245092720] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.271+0000 7f4c41b31800 20 remove_watcher() i=0 2024-09-10T05:11:52.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.271+0000 7f4c41b31800 2 removed watcher, disabling cache 2024-09-10T05:11:52.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.271+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94321245090672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04fe8c0 con 0x55c8e04e2450 2024-09-10T05:11:52.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.272+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94321245090672] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.272+0000 7f4c41b31800 20 remove_watcher() i=1 2024-09-10T05:11:52.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.272+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94321245096528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04fe8c0 con 0x55c8e04eb7a0 2024-09-10T05:11:52.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.273+0000 7f4c35075640 1 -- 172.21.15.192:0/356771933 <== osd.3 v2:172.21.15.192:6816/1620624472 29 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94321245096528] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c2807c040 con 0x55c8e04eb7a0 2024-09-10T05:11:52.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.273+0000 7f4c41b31800 20 remove_watcher() i=2 2024-09-10T05:11:52.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.273+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94321245101344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04fe8c0 con 0x7f4c2805f040 2024-09-10T05:11:52.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.274+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94321245101344] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x7f4c2805f040 2024-09-10T05:11:52.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.274+0000 7f4c41b31800 20 remove_watcher() i=3 2024-09-10T05:11:52.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.274+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94321245106160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04fe8c0 con 0x55c8e04e2450 2024-09-10T05:11:52.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.275+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94321245106160] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c3800a4d0 con 0x55c8e04e2450 2024-09-10T05:11:52.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.275+0000 7f4c41b31800 20 remove_watcher() i=4 2024-09-10T05:11:52.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.275+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94321245110048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04fe8c0 con 0x55c8e04e6e40 2024-09-10T05:11:52.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.276+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94321245110048] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.276+0000 7f4c41b31800 20 remove_watcher() i=5 2024-09-10T05:11:52.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.276+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94321245108432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04fe8c0 con 0x55c8e04e6e40 2024-09-10T05:11:52.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.276+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94321245108432] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.276+0000 7f4c41b31800 20 remove_watcher() i=6 2024-09-10T05:11:52.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.276+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94321245116656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c8e04fe8c0 con 0x55c8e04e6e40 2024-09-10T05:11:52.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c3d876640 1 -- 172.21.15.192:0/356771933 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94321245116656] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c30072030 con 0x55c8e04e6e40 2024-09-10T05:11:52.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 20 remove_watcher() i=7 2024-09-10T05:11:52.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c8e04e6e40 msgr2=0x55c8e04e9230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c8e04e6e40 0x55c8e04e9230 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c8e04e2450 msgr2=0x55c8e04e4910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c8e04e2450 0x55c8e04e4910 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f4c2805f040 msgr2=0x7f4c2806b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f4c2805f040 0x7f4c2806b410 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c8e04eb7a0 msgr2=0x55c8e04edc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c8e04eb7a0 0x55c8e04edc60 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b0803c780 msgr2=0x7f4b0803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b0803c780 0x7f4b0803ec40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4c28000c00 tx=0x7f4c28053000 comp rx=0 tx=0).stop 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 msgr2=0x55c8e04d6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c3e077640 1 -- 172.21.15.192:0/356771933 reap_dead start 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 0x55c8e04d6e70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4c30036580 tx=0x7f4c30042060 comp rx=0 tx=0).stop 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 shutdown_connections 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 --2- 172.21.15.192:0/356771933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04cfa70 0x55c8e04d6e70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 >> 172.21.15.192:0/356771933 conn(0x55c8e04cbe70 msgr2=0x55c8e04ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 shutdown_connections 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/356771933 wait complete. 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/1580003461 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b1803c780 msgr2=0x7f4b1803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 --2- 172.21.15.192:0/1580003461 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b1803c780 0x7f4b1803ec40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55c8e04aad20 tx=0x7f4c28005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/1580003461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04a33c0 msgr2=0x55c8e04a1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 --2- 172.21.15.192:0/1580003461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04a33c0 0x55c8e04a1c30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4c30051f90 tx=0x7f4c30017f80 comp rx=0 tx=0).stop 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/1580003461 shutdown_connections 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 --2- 172.21.15.192:0/1580003461 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b1803c780 0x7f4b1803ec40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 --2- 172.21.15.192:0/1580003461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e04a33c0 0x55c8e04a1c30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/1580003461 >> 172.21.15.192:0/1580003461 conn(0x55c8e04b55e0 msgr2=0x55c8e04b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/1580003461 shutdown_connections 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.278+0000 7f4c41b31800 1 -- 172.21.15.192:0/1580003461 wait complete. 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c8e04acba0 msgr2=0x55c8e04aef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c8e04acba0 0x55c8e04aef90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c8e03ac200 msgr2=0x55c8e04aa1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c8e03ac200 0x55c8e04aa1e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c8e04b0aa0 msgr2=0x55c8e04b2e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c8e04b0aa0 0x55c8e04b2e90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b2403c730 msgr2=0x7f4b2403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f4b2403c730 0x7f4b2403ebf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4c28057000 tx=0x7f4c28052000 comp rx=0 tx=0).stop 2024-09-10T05:11:52.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 msgr2=0x55c8e031f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 --2- 172.21.15.192:0/458341898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8e03aadf0 0x55c8e031f590 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c010 tx=0x7f4c30000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c3e077640 1 -- 172.21.15.192:0/458341898 reap_dead start 2024-09-10T05:11:52.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 shutdown_connections 2024-09-10T05:11:52.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 >> 172.21.15.192:0/458341898 conn(0x55c8e03a61c0 msgr2=0x55c8e049b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 shutdown_connections 2024-09-10T05:11:52.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.279+0000 7f4c41b31800 1 -- 172.21.15.192:0/458341898 wait complete. 2024-09-10T05:11:52.289 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T05:11:52.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-10T05:11:52.290 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-10T05:11:52.334 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:52.335 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:52.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.334+0000 7f7290b2b800 1 Processor -- start 2024-09-10T05:11:52.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.334+0000 7f7290b2b800 1 -- start start 2024-09-10T05:11:52.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.334+0000 7f7290b2b800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55f57d145ff0 0x55f57d146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.334+0000 7f7290b2b800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f57cfefe40 con 0x55f57d1470f0 2024-09-10T05:11:52.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.334+0000 7f7290b2b800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55f57cfba680 con 0x55f57d145ff0 2024-09-10T05:11:52.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.334+0000 7f728c873640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55f57d145ff0 0x55f57d146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.334+0000 7f7287fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55f57d1470f0 0x55f57d14be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:53012/0 (socket says 172.21.15.192:53012) 2024-09-10T05:11:52.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.334+0000 7f7287fff640 1 -- 172.21.15.192:0/1064712152 learned_addr learned my addr 172.21.15.192:0/1064712152 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:52.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.334+0000 7f728c873640 1 --2- 172.21.15.192:0/1064712152 >> v2:172.21.15.139:3300/0 conn(0x55f57d145ff0 0x55f57d146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33310/0 (socket says 172.21.15.192:33310) 2024-09-10T05:11:52.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.334+0000 7f728c873640 1 -- 172.21.15.192:0/1064712152 >> v1:172.21.15.139:6789/0 conn(0x55f57d1470f0 legacy=0x55f57d14be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.334+0000 7f72877fe640 1 -- 172.21.15.192:0/1064712152 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3262939735 0 0) 0x55f57cfefe40 con 0x55f57d1470f0 2024-09-10T05:11:52.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.334+0000 7f728c873640 1 -- 172.21.15.192:0/1064712152 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57cfd66b0 con 0x55f57d145ff0 2024-09-10T05:11:52.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.336+0000 7f728c873640 1 --2- 172.21.15.192:0/1064712152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d146bb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f728000a470 tx=0x7f7280045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817fdcde5cfdc28c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.336+0000 7f72877fe640 1 -- 172.21.15.192:0/1064712152 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280053570 con 0x55f57d145ff0 2024-09-10T05:11:52.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.336+0000 7f72877fe640 1 -- 172.21.15.192:0/1064712152 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7280058070 con 0x55f57d145ff0 2024-09-10T05:11:52.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.336+0000 7f72877fe640 1 -- 172.21.15.192:0/1064712152 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280053880 con 0x55f57d145ff0 2024-09-10T05:11:52.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.337+0000 7f7290b2b800 1 -- 172.21.15.192:0/1064712152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 msgr2=0x55f57d146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.337+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1064712152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d146bb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f728000a470 tx=0x7f7280045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:52.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.337+0000 7f7290b2b800 1 -- 172.21.15.192:0/1064712152 shutdown_connections 2024-09-10T05:11:52.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.337+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1064712152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d146bb0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.337+0000 7f7290b2b800 1 -- 172.21.15.192:0/1064712152 >> 172.21.15.192:0/1064712152 conn(0x55f57d1413c0 msgr2=0x55f57d143820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.337+0000 7f7290b2b800 1 -- 172.21.15.192:0/1064712152 shutdown_connections 2024-09-10T05:11:52.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.337+0000 7f7290b2b800 1 -- 172.21.15.192:0/1064712152 wait complete. 2024-09-10T05:11:52.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.351+0000 7f7290b2b800 1 Processor -- start 2024-09-10T05:11:52.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.351+0000 7f7290b2b800 1 -- start start 2024-09-10T05:11:52.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.351+0000 7f7290b2b800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d235470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.351+0000 7f7290b2b800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f57cfdedd0 con 0x55f57d145ff0 2024-09-10T05:11:52.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.352+0000 7f728c873640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d235470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.352+0000 7f728c873640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d235470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33326/0 (socket says 172.21.15.192:33326) 2024-09-10T05:11:52.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.352+0000 7f728c873640 1 -- 172.21.15.192:0/1791125922 learned_addr learned my addr 172.21.15.192:0/1791125922 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.352+0000 7f728c873640 1 -- 172.21.15.192:0/1791125922 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57cff7e10 con 0x55f57d145ff0 2024-09-10T05:11:52.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.352+0000 7f728c873640 1 --2- 172.21.15.192:0/1791125922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d235470 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7280025c20 tx=0x7f7280051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a07ecf994b26fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.352+0000 7f717a60c640 1 -- 172.21.15.192:0/1791125922 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280053a20 con 0x55f57d145ff0 2024-09-10T05:11:52.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.352+0000 7f717a60c640 1 -- 172.21.15.192:0/1791125922 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7280063070 con 0x55f57d145ff0 2024-09-10T05:11:52.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.352+0000 7f717a60c640 1 -- 172.21.15.192:0/1791125922 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280053d30 con 0x55f57d145ff0 2024-09-10T05:11:52.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.353+0000 7f7290b2b800 1 -- 172.21.15.192:0/1791125922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 msgr2=0x55f57d235470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.353+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1791125922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d235470 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7280025c20 tx=0x7f7280051000 comp rx=0 tx=0).stop 2024-09-10T05:11:52.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.353+0000 7f7290b2b800 1 -- 172.21.15.192:0/1791125922 shutdown_connections 2024-09-10T05:11:52.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.353+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1791125922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d235470 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.353+0000 7f7290b2b800 1 -- 172.21.15.192:0/1791125922 >> 172.21.15.192:0/1791125922 conn(0x55f57d1413c0 msgr2=0x55f57d230df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.353+0000 7f7290b2b800 1 -- 172.21.15.192:0/1791125922 shutdown_connections 2024-09-10T05:11:52.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.353+0000 7f7290b2b800 1 -- 172.21.15.192:0/1791125922 wait complete. 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.353+0000 7f7290b2b800 1 Processor -- start 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.353+0000 7f7290b2b800 1 -- start start 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.354+0000 7f7290b2b800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d0bb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.354+0000 7f7290b2b800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f57d1477e0 con 0x55f57d145ff0 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.354+0000 7f728c873640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d0bb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.354+0000 7f728c873640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d0bb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33334/0 (socket says 172.21.15.192:33334) 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.354+0000 7f728c873640 1 -- 172.21.15.192:0/1350940381 learned_addr learned my addr 172.21.15.192:0/1350940381 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.354+0000 7f728c873640 1 -- 172.21.15.192:0/1350940381 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57d0bbbe0 con 0x55f57d145ff0 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.354+0000 7f728c873640 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d0bb680 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7280025c20 tx=0x7f7280002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.354+0000 7f7178e09640 1 -- 172.21.15.192:0/1350940381 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280078070 con 0x55f57d145ff0 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.354+0000 7f7178e09640 1 -- 172.21.15.192:0/1350940381 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7280073470 con 0x55f57d145ff0 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.354+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f57d0b9f90 con 0x55f57d145ff0 2024-09-10T05:11:52.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.354+0000 7f7178e09640 1 -- 172.21.15.192:0/1350940381 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280073750 con 0x55f57d145ff0 2024-09-10T05:11:52.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.354+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f57d0ba5b0 con 0x55f57d145ff0 2024-09-10T05:11:52.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.355+0000 7f7178e09640 1 -- 172.21.15.192:0/1350940381 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f728007b070 con 0x55f57d145ff0 2024-09-10T05:11:52.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.355+0000 7f7178e09640 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f717403c730 0x7f717403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.355+0000 7f7178e09640 1 -- 172.21.15.192:0/1350940381 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f7280097be0 con 0x55f57d145ff0 2024-09-10T05:11:52.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.355+0000 7f7287fff640 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f717403c730 0x7f717403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.355+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f57d1470f0 0x55f57d23fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.356+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2403e0 con 0x55f57d1470f0 2024-09-10T05:11:52.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.356+0000 7f728d074640 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f57d1470f0 0x55f57d23fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.356+0000 7f7287fff640 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f717403c730 0x7f717403ebf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f727c000c00 tx=0x7f727c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.356+0000 7f728d074640 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f57d1470f0 0x55f57d23fea0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.356+0000 7f728d074640 1 -- 172.21.15.192:0/1350940381 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d1470f0 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.356+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d0baa10 con 0x55f57d1470f0 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.356+0000 7f728d074640 1 -- 172.21.15.192:0/1350940381 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d1470f0 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.356+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f57d24ced0 0x55f57d24f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.357+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d24f990 con 0x55f57d24ced0 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.357+0000 7f728c873640 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f57d24ced0 0x55f57d24f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.357+0000 7f728c873640 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f57d24ced0 0x55f57d24f2c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.357+0000 7f728c873640 1 -- 172.21.15.192:0/1350940381 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f728007a030 con 0x55f57d24ced0 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.357+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d24bda0 con 0x55f57d1470f0 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.357+0000 7f728d074640 1 -- 172.21.15.192:0/1350940381 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d1470f0 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.358+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55f57d250dd0 0x55f57d2531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.358+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2538c0 con 0x55f57d250dd0 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.358+0000 7f7287fff640 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55f57d250dd0 0x55f57d2531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.358+0000 7f7287fff640 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55f57d250dd0 0x55f57d2531c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.358+0000 7f7287fff640 1 -- 172.21.15.192:0/1350940381 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f727c00f670 con 0x55f57d250dd0 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.359+0000 7f7290b2b800 1 Processor -- start 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.359+0000 7f7290b2b800 1 -- start start 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.359+0000 7f7290b2b800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d2614c0 0x55f57d2618e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.359+0000 7f7290b2b800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f57d03ca00 con 0x55f57d2614c0 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.359+0000 7f728c873640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d2614c0 0x55f57d2618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.359+0000 7f728c873640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d2614c0 0x55f57d2618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33344/0 (socket says 172.21.15.192:33344) 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.359+0000 7f728c873640 1 -- 172.21.15.192:0/505028071 learned_addr learned my addr 172.21.15.192:0/505028071 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.359+0000 7f728c873640 1 -- 172.21.15.192:0/505028071 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57d261f20 con 0x55f57d2614c0 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.359+0000 7f728c873640 1 --2- 172.21.15.192:0/505028071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d2614c0 0x55f57d2618e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7280095f60 tx=0x7f728005de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.359+0000 7f7171ffb640 1 -- 172.21.15.192:0/505028071 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728007c6a0 con 0x55f57d2614c0 2024-09-10T05:11:52.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.359+0000 7f7171ffb640 1 -- 172.21.15.192:0/505028071 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728007c840 con 0x55f57d2614c0 2024-09-10T05:11:52.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.360+0000 7f7171ffb640 1 -- 172.21.15.192:0/505028071 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72800685e0 con 0x55f57d2614c0 2024-09-10T05:11:52.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.360+0000 7f7290b2b800 1 -- 172.21.15.192:0/505028071 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f57d262750 con 0x55f57d2614c0 2024-09-10T05:11:52.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.360+0000 7f7290b2b800 1 -- 172.21.15.192:0/505028071 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f57d262cf0 con 0x55f57d2614c0 2024-09-10T05:11:52.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.360+0000 7f7171ffb640 1 -- 172.21.15.192:0/505028071 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7280068780 con 0x55f57d2614c0 2024-09-10T05:11:52.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.360+0000 7f7171ffb640 1 --2- 172.21.15.192:0/505028071 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f716403c780 0x7f716403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.360+0000 7f7171ffb640 1 -- 172.21.15.192:0/505028071 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f728008f070 con 0x55f57d2614c0 2024-09-10T05:11:52.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.361+0000 7f7287fff640 1 --2- 172.21.15.192:0/505028071 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f716403c780 0x7f716403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.361+0000 7f7290b2b800 1 Processor -- start 2024-09-10T05:11:52.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.361+0000 7f7290b2b800 1 -- start start 2024-09-10T05:11:52.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.361+0000 7f7287fff640 1 --2- 172.21.15.192:0/505028071 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f716403c780 0x7f716403ec40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55f57d240880 tx=0x7f727c006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.361+0000 7f7290b2b800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 0x55f57d26e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.361+0000 7f7290b2b800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f57d235c60 con 0x55f57d26dd40 2024-09-10T05:11:52.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.361+0000 7f728c873640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 0x55f57d26e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.361+0000 7f728c873640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 0x55f57d26e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33354/0 (socket says 172.21.15.192:33354) 2024-09-10T05:11:52.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.361+0000 7f728c873640 1 -- 172.21.15.192:0/1609405634 learned_addr learned my addr 172.21.15.192:0/1609405634 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.361+0000 7f728c873640 1 -- 172.21.15.192:0/1609405634 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57d26e710 con 0x55f57d26dd40 2024-09-10T05:11:52.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.362+0000 7f728c873640 1 --2- 172.21.15.192:0/1609405634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 0x55f57d26e120 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7280051330 tx=0x7f7280051360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadb9545a0e1f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.362+0000 7f71637fe640 1 -- 172.21.15.192:0/1609405634 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728005cd20 con 0x55f57d26dd40 2024-09-10T05:11:52.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.362+0000 7f71637fe640 1 -- 172.21.15.192:0/1609405634 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72800923c0 con 0x55f57d26dd40 2024-09-10T05:11:52.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.362+0000 7f71637fe640 1 -- 172.21.15.192:0/1609405634 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728007d440 con 0x55f57d26dd40 2024-09-10T05:11:52.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.362+0000 7f7290b2b800 1 -- 172.21.15.192:0/1609405634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 msgr2=0x55f57d26e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.362+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1609405634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 0x55f57d26e120 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7280051330 tx=0x7f7280051360 comp rx=0 tx=0).stop 2024-09-10T05:11:52.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.362+0000 7f7290b2b800 1 -- 172.21.15.192:0/1609405634 shutdown_connections 2024-09-10T05:11:52.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.362+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1609405634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 0x55f57d26e120 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.362+0000 7f7290b2b800 1 -- 172.21.15.192:0/1609405634 >> 172.21.15.192:0/1609405634 conn(0x55f57d26a140 msgr2=0x55f57d268380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.362+0000 7f7290b2b800 1 -- 172.21.15.192:0/1609405634 shutdown_connections 2024-09-10T05:11:52.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.362+0000 7f7290b2b800 1 -- 172.21.15.192:0/1609405634 wait complete. 2024-09-10T05:11:52.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.362+0000 7f7290b2b800 1 Processor -- start 2024-09-10T05:11:52.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.363+0000 7f7290b2b800 1 -- start start 2024-09-10T05:11:52.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.363+0000 7f7290b2b800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 0x55f57d275130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.363+0000 7f7290b2b800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f57d26eba0 con 0x55f57d26dd40 2024-09-10T05:11:52.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.363+0000 7f728c873640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 0x55f57d275130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.363+0000 7f728c873640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 0x55f57d275130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33360/0 (socket says 172.21.15.192:33360) 2024-09-10T05:11:52.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.363+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 learned_addr learned my addr 172.21.15.192:0/2811943395 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.363+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57d275690 con 0x55f57d26dd40 2024-09-10T05:11:52.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.363+0000 7f728c873640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 0x55f57d275130 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f728005ca30 tx=0x7f7280066f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.363+0000 7f7161ffb640 1 -- 172.21.15.192:0/2811943395 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72800bd070 con 0x55f57d26dd40 2024-09-10T05:11:52.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.363+0000 7f7161ffb640 1 -- 172.21.15.192:0/2811943395 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72800929c0 con 0x55f57d26dd40 2024-09-10T05:11:52.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.363+0000 7f7161ffb640 1 -- 172.21.15.192:0/2811943395 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280092ce0 con 0x55f57d26dd40 2024-09-10T05:11:52.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.364+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f57d275690 con 0x55f57d26dd40 2024-09-10T05:11:52.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.364+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f57d275690 con 0x55f57d26dd40 2024-09-10T05:11:52.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.365+0000 7f7161ffb640 1 -- 172.21.15.192:0/2811943395 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f72800c0070 con 0x55f57d26dd40 2024-09-10T05:11:52.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.365+0000 7f7161ffb640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f715403c730 0x7f715403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.365+0000 7f7161ffb640 1 -- 172.21.15.192:0/2811943395 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f72800c3c80 con 0x55f57d26dd40 2024-09-10T05:11:52.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.365+0000 7f7287fff640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f715403c730 0x7f715403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.365+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.365+0000 7f7290b2b800 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f57d2806a0 0x55f57d282b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.365+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2832b0 con 0x55f57d2806a0 2024-09-10T05:11:52.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.365+0000 7f728d074640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f57d2806a0 0x55f57d282b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f7287fff640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f715403c730 0x7f715403ebf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f727c00ffd0 tx=0x7f727c023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f728d074640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f57d2806a0 0x55f57d282b60 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f7290b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f7290b2b800 20 realm 2024-09-10T05:11:52.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2836c0 con 0x55f57d2806a0 2024-09-10T05:11:52.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f7290b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f7290b2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:52.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d283f90 con 0x55f57d2806a0 2024-09-10T05:11:52.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f7290b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.366+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2806a0 2024-09-10T05:11:52.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.367+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.367+0000 7f7290b2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:52.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.367+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.367+0000 7f7290b2b800 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f57d284e20 0x55f57d287210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.367+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d287950 con 0x55f57d284e20 2024-09-10T05:11:52.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.367+0000 7f728c873640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f57d284e20 0x55f57d287210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.367+0000 7f728c873640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f57d284e20 0x55f57d287210 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.367+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.367+0000 7f7290b2b800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.367+0000 7f7290b2b800 20 searching for the correct realm 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.367+0000 7f7290b2b800 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55f57d2899f0 0x55f57d28beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.367+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d28c580 con 0x55f57d2899f0 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.368+0000 7f7287fff640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55f57d2899f0 0x55f57d28beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.368+0000 7f7287fff640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55f57d2899f0 0x55f57d28beb0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.368+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.368+0000 7f7287fff640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f727c02e910 0x7f727c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.368+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d28c580 con 0x7f727c02e910 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.368+0000 7f728d074640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f727c02e910 0x7f727c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.369+0000 7f728d074640 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f727c02e910 0x7f727c03a3c0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.369+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.369+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d284e20 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.369+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.369+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2806a0 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.369+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.369+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2806a0 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.369+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.369+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d284e20 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.370+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.370+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d284e20 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.370+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.370+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x7f727c02e910 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.370+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.370+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2899f0 2024-09-10T05:11:52.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.371+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.371+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2806a0 2024-09-10T05:11:52.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.371+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.371+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d284e20 2024-09-10T05:11:52.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.371+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.371+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2806a0 2024-09-10T05:11:52.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.371+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.371+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x7f727c02e910 2024-09-10T05:11:52.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.371+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.371+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2899f0 2024-09-10T05:11:52.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.372+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.372+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2899f0 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.372+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.372+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d284e20 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.372+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.372+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2899f0 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.372+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.372+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2899f0 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.372+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.372+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2806a0 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.373+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.373+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2806a0 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.373+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.373+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d284e20 2024-09-10T05:11:52.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.373+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.373+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2899f0 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.373+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.373+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x7f727c02e910 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.373+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.373+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2806a0 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.374+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.374+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d284e20 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.374+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.374+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2899f0 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.374+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.374+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d284e20 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.374+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.374+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x7f727c02e910 2024-09-10T05:11:52.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.375+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.375+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2899f0 2024-09-10T05:11:52.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.375+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.375+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d284e20 2024-09-10T05:11:52.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.375+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.375+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x55f57d2806a0 2024-09-10T05:11:52.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.375+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.375+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f57d284330 con 0x7f727c02e910 2024-09-10T05:11:52.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.375+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:52.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:52.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:52.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:52.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:52.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:52.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2882f0 con 0x55f57d2806a0 2024-09-10T05:11:52.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2882f0 con 0x55f57d2806a0 2024-09-10T05:11:52.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:52.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2882f0 con 0x7f727c02e910 2024-09-10T05:11:52.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:52.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 zone default found 2024-09-10T05:11:52.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 4 Realm: () 2024-09-10T05:11:52.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:52.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 zonegroup default 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.376+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2886e0 con 0x55f57d284e20 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f7290b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2880b0 con 0x55f57d2899f0 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f7290b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d28e3f0 con 0x55f57d2899f0 2024-09-10T05:11:52.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f7290b2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f7290b2b800 20 started sync module instance, tier type = 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f7290b2b800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.377+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d28d890 con 0x7f727c02e910 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.378+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.378+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94512855178640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d28d890 con 0x7f727c02e910 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.378+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d28ef00 con 0x55f57d2806a0 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.379+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94512855178640] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.380+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.380+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94512855181776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d28d890 con 0x55f57d2806a0 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.380+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d28f990 con 0x55f57d2899f0 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.381+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94512855181776] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.381+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.381+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94512855176160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d28d800 con 0x55f57d2899f0 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.381+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d290850 con 0x7f727c02e910 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.382+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94512855176160] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.382+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.382+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94512855188384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d290c70 con 0x7f727c02e910 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.382+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d291630 con 0x55f57d2806a0 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.383+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.383+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94512855191936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d291a50 con 0x55f57d2806a0 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.383+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d292530 con 0x55f57d284e20 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.383+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94512855188384] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.384+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.384+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94512855195712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d291a50 con 0x55f57d284e20 2024-09-10T05:11:52.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.384+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94512855191936] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.384+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d292dd0 con 0x55f57d284e20 2024-09-10T05:11:52.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.385+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94512855195712] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.388+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.388+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94512855189440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2928d0 con 0x55f57d284e20 2024-09-10T05:11:52.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.388+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2933c0 con 0x55f57d284e20 2024-09-10T05:11:52.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.389+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(58 notify.7 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.389+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94512855189440] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.389+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94512855199376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d293830 con 0x55f57d284e20 2024-09-10T05:11:52.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.389+0000 7f7290b2b800 20 add_watcher() i=0 2024-09-10T05:11:52.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.389+0000 7f7290b2b800 20 add_watcher() i=1 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.389+0000 7f7290b2b800 20 add_watcher() i=2 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.389+0000 7f7290b2b800 20 add_watcher() i=3 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.389+0000 7f7290b2b800 20 add_watcher() i=4 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.389+0000 7f7290b2b800 20 add_watcher() i=5 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.389+0000 7f7290b2b800 20 add_watcher() i=6 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.390+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94512855199376] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.390+0000 7f7290b2b800 20 add_watcher() i=7 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.390+0000 7f7290b2b800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.390+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d293830 con 0x55f57d2806a0 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.391+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.391+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94512855200640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2937d0 con 0x55f57d2806a0 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.392+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94512855200640] v35'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.392+0000 7f7142fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:52.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.392+0000 7f7290b2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.392+0000 7f7290b2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.392+0000 7f7290b2b800 5 note: GC not initialized 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.392+0000 7f7141fdb640 20 reqs_thread_entry: start 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.392+0000 7f7290b2b800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.392+0000 7f7290b2b800 20 Filter name: none 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.392+0000 7f70b37fe640 20 reqs_thread_entry: start 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.392+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.392+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2c98f0 con 0x7f727c02e910 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f7290b2b800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:63 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2ca180 con 0x55f57d2899f0 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(63 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f7290b2b800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f7290b2b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2c9d10 con 0x7f727c02e910 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f7290b2b800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f7290b2b800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.393+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:65 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2cbc40 con 0x55f57d2899f0 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(65 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 4.5 4:a13f7d51:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2cb6f0 con 0x55f57d2899f0 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:67 4.23 4:c5bf8a98:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2d0630 con 0x55f57d284e20 2024-09-10T05:11:52.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:68 4.26 4:6764b625:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2d31f0 con 0x55f57d284e20 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 4.19 4:9b146b93:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2cb6f0 con 0x55f57d2899f0 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 4.2a 4:54fd2db9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2d81d0 con 0x55f57d2806a0 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 4.23 4:c6e2b706:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2daa40 con 0x55f57d284e20 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 4.e 4:71344637:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2daa40 con 0x7f727c02e910 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 4.29 4:950bf6db:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2dfd70 con 0x55f57d2899f0 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:74 4.d 4:b0727371:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2e2bd0 con 0x55f57d2899f0 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 4.26 4:64e4daa4:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2e5540 con 0x55f57d284e20 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(66 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(67 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(68 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:76 4.3f 4:fc8f57a3:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2e7ed0 con 0x7f727c02e910 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(69 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(70 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(73 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(71 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.5 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(75 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(74 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(72 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.6 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.394+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(76 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.395+0000 7f7142fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:52.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.395+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94512855200640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2c7290 con 0x55f57d2806a0 2024-09-10T05:11:52.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.396+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94512855200640] v35'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.396+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94512855178640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2c7290 con 0x7f727c02e910 2024-09-10T05:11:52.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.397+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94512855178640] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.397+0000 7f7290b2b800 20 remove_watcher() i=0 2024-09-10T05:11:52.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.397+0000 7f7290b2b800 2 removed watcher, disabling cache 2024-09-10T05:11:52.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.397+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94512855181776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2c7290 con 0x55f57d2806a0 2024-09-10T05:11:52.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.398+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94512855181776] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.398+0000 7f7290b2b800 20 remove_watcher() i=1 2024-09-10T05:11:52.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.398+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94512855176160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2c7290 con 0x55f57d2899f0 2024-09-10T05:11:52.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.399+0000 7f7287fff640 1 -- 172.21.15.192:0/2811943395 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94512855176160] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f727c037040 con 0x55f57d2899f0 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.399+0000 7f7290b2b800 20 remove_watcher() i=2 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.399+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94512855188384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2c7290 con 0x7f727c02e910 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.400+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94512855188384] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x7f727c02e910 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.400+0000 7f7290b2b800 20 remove_watcher() i=3 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.400+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94512855191936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2c7290 con 0x55f57d2806a0 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.401+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94512855191936] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728800a4d0 con 0x55f57d2806a0 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.401+0000 7f7290b2b800 20 remove_watcher() i=4 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.401+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94512855195712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2c7290 con 0x55f57d284e20 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.403+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94512855195712] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.403+0000 7f7290b2b800 20 remove_watcher() i=5 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.403+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94512855189440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2c7290 con 0x55f57d284e20 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.404+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94512855189440] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.404+0000 7f7290b2b800 20 remove_watcher() i=6 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.404+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94512855199376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f57d2c7290 con 0x55f57d284e20 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f728c873640 1 -- 172.21.15.192:0/2811943395 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94512855199376] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72800bf030 con 0x55f57d284e20 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 20 remove_watcher() i=7 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f57d284e20 msgr2=0x55f57d287210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f57d284e20 0x55f57d287210 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f57d2806a0 msgr2=0x55f57d282b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f57d2806a0 0x55f57d282b60 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f727c02e910 msgr2=0x7f727c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f727c02e910 0x7f727c03a3c0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55f57d2899f0 msgr2=0x55f57d28beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55f57d2899f0 0x55f57d28beb0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f715403c730 msgr2=0x7f715403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f715403c730 0x7f715403ebf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f727c00ffd0 tx=0x7f727c023040 comp rx=0 tx=0).stop 2024-09-10T05:11:52.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 msgr2=0x55f57d275130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f728d074640 1 -- 172.21.15.192:0/2811943395 reap_dead start 2024-09-10T05:11:52.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 0x55f57d275130 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f728005ca30 tx=0x7f7280066f20 comp rx=0 tx=0).stop 2024-09-10T05:11:52.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 shutdown_connections 2024-09-10T05:11:52.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 --2- 172.21.15.192:0/2811943395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d26dd40 0x55f57d275130 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 >> 172.21.15.192:0/2811943395 conn(0x55f57d26a140 msgr2=0x55f57d268350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 shutdown_connections 2024-09-10T05:11:52.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/2811943395 wait complete. 2024-09-10T05:11:52.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/505028071 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f716403c780 msgr2=0x7f716403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 --2- 172.21.15.192:0/505028071 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f716403c780 0x7f716403ec40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55f57d240880 tx=0x7f727c006000 comp rx=0 tx=0).stop 2024-09-10T05:11:52.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/505028071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d2614c0 msgr2=0x55f57d2618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 --2- 172.21.15.192:0/505028071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d2614c0 0x55f57d2618e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7280095f60 tx=0x7f728005de70 comp rx=0 tx=0).stop 2024-09-10T05:11:52.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 -- 172.21.15.192:0/505028071 shutdown_connections 2024-09-10T05:11:52.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.405+0000 7f7290b2b800 1 --2- 172.21.15.192:0/505028071 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f716403c780 0x7f716403ec40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 --2- 172.21.15.192:0/505028071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d2614c0 0x55f57d2618e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 -- 172.21.15.192:0/505028071 >> 172.21.15.192:0/505028071 conn(0x55f57d255870 msgr2=0x55f57d255c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 -- 172.21.15.192:0/505028071 shutdown_connections 2024-09-10T05:11:52.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 -- 172.21.15.192:0/505028071 wait complete. 2024-09-10T05:11:52.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f57d24ced0 msgr2=0x55f57d24f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f57d24ced0 0x55f57d24f2c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f57d1470f0 msgr2=0x55f57d23fea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f57d1470f0 0x55f57d23fea0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55f57d250dd0 msgr2=0x55f57d2531c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55f57d250dd0 0x55f57d2531c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f717403c730 msgr2=0x7f717403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f717403c730 0x7f717403ebf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f727c000c00 tx=0x7f727c0013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 msgr2=0x55f57d0bb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 --2- 172.21.15.192:0/1350940381 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f57d145ff0 0x55f57d0bb680 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7280025c20 tx=0x7f7280002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f728d074640 1 -- 172.21.15.192:0/1350940381 reap_dead start 2024-09-10T05:11:52.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 shutdown_connections 2024-09-10T05:11:52.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 >> 172.21.15.192:0/1350940381 conn(0x55f57d1413c0 msgr2=0x55f57d2366c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 shutdown_connections 2024-09-10T05:11:52.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.406+0000 7f7290b2b800 1 -- 172.21.15.192:0/1350940381 wait complete. 2024-09-10T05:11:52.441 INFO:teuthology.orchestra.run.smithi192.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"236edb0a-22f9-4c79-a204-203688ed4bab","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1","marker":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-10T05:11:51.873529Z","creation_time":"2024-09-10T05:11:49.040226Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-10T05:11:52.442 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '236edb0a-22f9-4c79-a204-203688ed4bab', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1', 'marker': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:11:51.873529Z', 'creation_time': '2024-09-10T05:11:49.040226Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-10T05:11:52.442 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-10T05:11:52.442 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-10T05:11:52.442 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-10T05:11:52.485 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:52.485 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:52.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.484+0000 7f16cc416800 1 Processor -- start 2024-09-10T05:11:52.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.484+0000 7f16cc416800 1 -- start start 2024-09-10T05:11:52.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.485+0000 7f16cc416800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55ee7982eec0 0x55ee7982f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.485+0000 7f16cc416800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ee796d8e40 con 0x55ee7982e3b0 2024-09-10T05:11:52.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.485+0000 7f16cc416800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55ee796a3680 con 0x55ee7982eec0 2024-09-10T05:11:52.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.485+0000 7f16bf3e6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55ee7982eec0 0x55ee7982f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.485+0000 7f16bf3e6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55ee7982eec0 0x55ee7982f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33370/0 (socket says 172.21.15.192:33370) 2024-09-10T05:11:52.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.485+0000 7f16bf3e6640 1 -- 172.21.15.192:0/4228285288 learned_addr learned my addr 172.21.15.192:0/4228285288 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.485+0000 7f16bf3e6640 1 -- 172.21.15.192:0/4228285288 >> v1:172.21.15.139:6789/0 conn(0x55ee7982e3b0 legacy=0x55ee7982e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.485+0000 7f16c73e6640 1 -- 172.21.15.192:0/4228285288 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574943374 0 0) 0x55ee796d8e40 con 0x55ee7982e3b0 2024-09-10T05:11:52.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.485+0000 7f16bf3e6640 1 -- 172.21.15.192:0/4228285288 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee796bf6b0 con 0x55ee7982eec0 2024-09-10T05:11:52.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.487+0000 7f16bf3e6640 1 --2- 172.21.15.192:0/4228285288 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982eec0 0x55ee7982f370 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f16b000a520 tx=0x7f16b0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960ea3e4de1bf4a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.487+0000 7f16c73e6640 1 -- 172.21.15.192:0/4228285288 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b0055070 con 0x55ee7982eec0 2024-09-10T05:11:52.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.487+0000 7f16c73e6640 1 -- 172.21.15.192:0/4228285288 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b00515b0 con 0x55ee7982eec0 2024-09-10T05:11:52.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.487+0000 7f16c73e6640 1 -- 172.21.15.192:0/4228285288 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b00518d0 con 0x55ee7982eec0 2024-09-10T05:11:52.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.488+0000 7f16cc416800 1 -- 172.21.15.192:0/4228285288 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982eec0 msgr2=0x55ee7982f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.488+0000 7f16cc416800 1 --2- 172.21.15.192:0/4228285288 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982eec0 0x55ee7982f370 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f16b000a520 tx=0x7f16b0045ba0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.488+0000 7f16cc416800 1 -- 172.21.15.192:0/4228285288 shutdown_connections 2024-09-10T05:11:52.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.488+0000 7f16cc416800 1 --2- 172.21.15.192:0/4228285288 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982eec0 0x55ee7982f370 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.488+0000 7f16cc416800 1 -- 172.21.15.192:0/4228285288 >> 172.21.15.192:0/4228285288 conn(0x55ee79828910 msgr2=0x55ee7982ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.488+0000 7f16cc416800 1 -- 172.21.15.192:0/4228285288 shutdown_connections 2024-09-10T05:11:52.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.488+0000 7f16cc416800 1 -- 172.21.15.192:0/4228285288 wait complete. 2024-09-10T05:11:52.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.501+0000 7f16cc416800 1 Processor -- start 2024-09-10T05:11:52.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.501+0000 7f16cc416800 1 -- start start 2024-09-10T05:11:52.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.502+0000 7f16cc416800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 0x55ee7982d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.502+0000 7f16cc416800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee796c7dd0 con 0x55ee7982e3b0 2024-09-10T05:11:52.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.502+0000 7f16c7be7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 0x55ee7982d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.502+0000 7f16c7be7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 0x55ee7982d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33386/0 (socket says 172.21.15.192:33386) 2024-09-10T05:11:52.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.502+0000 7f16c7be7640 1 -- 172.21.15.192:0/177213808 learned_addr learned my addr 172.21.15.192:0/177213808 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.502+0000 7f16c7be7640 1 -- 172.21.15.192:0/177213808 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee796e0e10 con 0x55ee7982e3b0 2024-09-10T05:11:52.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.502+0000 7f16c7be7640 1 --2- 172.21.15.192:0/177213808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 0x55ee7982d590 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f16b8001de0 tx=0x7f16b800b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ee6e3ed9598724 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.502+0000 7f15b5e0b640 1 -- 172.21.15.192:0/177213808 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b8016070 con 0x55ee7982e3b0 2024-09-10T05:11:52.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.502+0000 7f15b5e0b640 1 -- 172.21.15.192:0/177213808 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b800f4d0 con 0x55ee7982e3b0 2024-09-10T05:11:52.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.502+0000 7f15b5e0b640 1 -- 172.21.15.192:0/177213808 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b800f830 con 0x55ee7982e3b0 2024-09-10T05:11:52.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.503+0000 7f16cc416800 1 -- 172.21.15.192:0/177213808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 msgr2=0x55ee7982d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.503+0000 7f16cc416800 1 --2- 172.21.15.192:0/177213808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 0x55ee7982d590 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f16b8001de0 tx=0x7f16b800b590 comp rx=0 tx=0).stop 2024-09-10T05:11:52.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.503+0000 7f16cc416800 1 -- 172.21.15.192:0/177213808 shutdown_connections 2024-09-10T05:11:52.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.503+0000 7f16cc416800 1 --2- 172.21.15.192:0/177213808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 0x55ee7982d590 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.503+0000 7f16cc416800 1 -- 172.21.15.192:0/177213808 >> 172.21.15.192:0/177213808 conn(0x55ee79828910 msgr2=0x55ee79918d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.503+0000 7f16cc416800 1 -- 172.21.15.192:0/177213808 shutdown_connections 2024-09-10T05:11:52.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.503+0000 7f16cc416800 1 -- 172.21.15.192:0/177213808 wait complete. 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.504+0000 7f16cc416800 1 Processor -- start 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.504+0000 7f16cc416800 1 -- start start 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.504+0000 7f16cc416800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 0x55ee79925e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.504+0000 7f16cc416800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee79835160 con 0x55ee7982e3b0 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.504+0000 7f16c7be7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 0x55ee79925e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.504+0000 7f16c7be7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 0x55ee79925e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33394/0 (socket says 172.21.15.192:33394) 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.504+0000 7f16c7be7640 1 -- 172.21.15.192:0/1483483553 learned_addr learned my addr 172.21.15.192:0/1483483553 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.504+0000 7f16c7be7640 1 -- 172.21.15.192:0/1483483553 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee79926390 con 0x55ee7982e3b0 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.504+0000 7f16c7be7640 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 0x55ee79925e30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55ee7982d0c0 tx=0x7f16b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.505+0000 7f15affff640 1 -- 172.21.15.192:0/1483483553 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b8016070 con 0x55ee7982e3b0 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.505+0000 7f15affff640 1 -- 172.21.15.192:0/1483483553 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b8023070 con 0x55ee7982e3b0 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.505+0000 7f15affff640 1 -- 172.21.15.192:0/1483483553 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b8011d40 con 0x55ee7982e3b0 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.505+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee79926620 con 0x55ee7982e3b0 2024-09-10T05:11:52.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.505+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee79927020 con 0x55ee7982e3b0 2024-09-10T05:11:52.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.505+0000 7f15affff640 1 -- 172.21.15.192:0/1483483553 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f16b8028460 con 0x55ee7982e3b0 2024-09-10T05:11:52.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.506+0000 7f15affff640 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f15b003c780 0x7f15b003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.506+0000 7f15affff640 1 -- 172.21.15.192:0/1483483553 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f16b8053be0 con 0x55ee7982e3b0 2024-09-10T05:11:52.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.506+0000 7f16bf3e6640 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f15b003c780 0x7f15b003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.506+0000 7f16cc416800 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee7982eec0 0x55ee7992d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.506+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee7992d9c0 con 0x55ee7982eec0 2024-09-10T05:11:52.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.506+0000 7f16c83e8640 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee7982eec0 0x55ee7992d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.506+0000 7f16bf3e6640 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f15b003c780 0x7f15b003ec40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f16b0057000 tx=0x7f16b0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.506+0000 7f16c83e8640 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee7982eec0 0x55ee7992d480 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.507+0000 7f16c83e8640 1 -- 172.21.15.192:0/1483483553 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee7982eec0 2024-09-10T05:11:52.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.507+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee7992dd60 con 0x55ee7982eec0 2024-09-10T05:11:52.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.507+0000 7f16c83e8640 1 -- 172.21.15.192:0/1483483553 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee7982eec0 2024-09-10T05:11:52.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.507+0000 7f16cc416800 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee7992f7e0 0x55ee79931c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.507+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee79932410 con 0x55ee7992f7e0 2024-09-10T05:11:52.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.507+0000 7f16c7be7640 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee7992f7e0 0x55ee79931c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.507+0000 7f16c7be7640 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee7992f7e0 0x55ee79931c80 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.508+0000 7f16c7be7640 1 -- 172.21.15.192:0/1483483553 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f16b8028c70 con 0x55ee7992f7e0 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.508+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee7992e5b0 con 0x55ee7982eec0 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.508+0000 7f16c83e8640 1 -- 172.21.15.192:0/1483483553 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee7982eec0 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.508+0000 7f16cc416800 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ee79933870 0x55ee79935c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.508+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee79936350 con 0x55ee79933870 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.508+0000 7f16bf3e6640 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ee79933870 0x55ee79935c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.508+0000 7f16bf3e6640 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ee79933870 0x55ee79935c60 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.509+0000 7f16bf3e6640 1 -- 172.21.15.192:0/1483483553 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f16b0057030 con 0x55ee79933870 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.509+0000 7f16cc416800 1 Processor -- start 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.509+0000 7f16cc416800 1 -- start start 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.509+0000 7f16cc416800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7991e7f0 0x55ee7991d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.509+0000 7f16cc416800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee79725a00 con 0x55ee7991e7f0 2024-09-10T05:11:52.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.509+0000 7f16c7be7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7991e7f0 0x55ee7991d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.509+0000 7f16c7be7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7991e7f0 0x55ee7991d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33398/0 (socket says 172.21.15.192:33398) 2024-09-10T05:11:52.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.509+0000 7f16c7be7640 1 -- 172.21.15.192:0/2652463907 learned_addr learned my addr 172.21.15.192:0/2652463907 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.510+0000 7f16c7be7640 1 -- 172.21.15.192:0/2652463907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee7991ed10 con 0x55ee7991e7f0 2024-09-10T05:11:52.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.510+0000 7f16c7be7640 1 --2- 172.21.15.192:0/2652463907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7991e7f0 0x55ee7991d060 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f16b80521c0 tx=0x7f16b800e5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.510+0000 7f15adffb640 1 -- 172.21.15.192:0/2652463907 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b8037070 con 0x55ee7991e7f0 2024-09-10T05:11:52.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.510+0000 7f15adffb640 1 -- 172.21.15.192:0/2652463907 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b8017040 con 0x55ee7991e7f0 2024-09-10T05:11:52.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.510+0000 7f16cc416800 1 -- 172.21.15.192:0/2652463907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee7991d5a0 con 0x55ee7991e7f0 2024-09-10T05:11:52.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.510+0000 7f15adffb640 1 -- 172.21.15.192:0/2652463907 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b80266e0 con 0x55ee7991e7f0 2024-09-10T05:11:52.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.510+0000 7f16cc416800 1 -- 172.21.15.192:0/2652463907 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee7991db40 con 0x55ee7991e7f0 2024-09-10T05:11:52.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.511+0000 7f15adffb640 1 -- 172.21.15.192:0/2652463907 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f16b803a070 con 0x55ee7991e7f0 2024-09-10T05:11:52.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.511+0000 7f15adffb640 1 --2- 172.21.15.192:0/2652463907 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f15a003c780 0x7f15a003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.511+0000 7f15adffb640 1 -- 172.21.15.192:0/2652463907 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f16b803dc80 con 0x55ee7991e7f0 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.511+0000 7f16bf3e6640 1 --2- 172.21.15.192:0/2652463907 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f15a003c780 0x7f15a003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.511+0000 7f16cc416800 1 Processor -- start 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.511+0000 7f16cc416800 1 -- start start 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.511+0000 7f16bf3e6640 1 --2- 172.21.15.192:0/2652463907 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f15a003c780 0x7f15a003ec40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55ee79927ef0 tx=0x7f16b0005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.511+0000 7f16cc416800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 0x55ee79953070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.511+0000 7f16cc416800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee79921190 con 0x55ee79952c70 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.511+0000 7f16c7be7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 0x55ee79953070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.511+0000 7f16c7be7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 0x55ee79953070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33412/0 (socket says 172.21.15.192:33412) 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.511+0000 7f16c7be7640 1 -- 172.21.15.192:0/2311487789 learned_addr learned my addr 172.21.15.192:0/2311487789 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.512+0000 7f16c7be7640 1 -- 172.21.15.192:0/2311487789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee79953660 con 0x55ee79952c70 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.512+0000 7f16c7be7640 1 --2- 172.21.15.192:0/2311487789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 0x55ee79953070 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f16b804afd0 tx=0x7f16b803bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e6e81f4b8b00d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.512+0000 7f15a6ffd640 1 -- 172.21.15.192:0/2311487789 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b8063070 con 0x55ee79952c70 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.512+0000 7f15a6ffd640 1 -- 172.21.15.192:0/2311487789 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b8026880 con 0x55ee79952c70 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.512+0000 7f15a6ffd640 1 -- 172.21.15.192:0/2311487789 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b8032d80 con 0x55ee79952c70 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.512+0000 7f16cc416800 1 -- 172.21.15.192:0/2311487789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 msgr2=0x55ee79953070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.512+0000 7f16cc416800 1 --2- 172.21.15.192:0/2311487789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 0x55ee79953070 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f16b804afd0 tx=0x7f16b803bb00 comp rx=0 tx=0).stop 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.512+0000 7f16cc416800 1 -- 172.21.15.192:0/2311487789 shutdown_connections 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.512+0000 7f16cc416800 1 --2- 172.21.15.192:0/2311487789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 0x55ee79953070 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.512+0000 7f16cc416800 1 -- 172.21.15.192:0/2311487789 >> 172.21.15.192:0/2311487789 conn(0x55ee7994f070 msgr2=0x55ee7994d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.512+0000 7f16cc416800 1 -- 172.21.15.192:0/2311487789 shutdown_connections 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.512+0000 7f16cc416800 1 -- 172.21.15.192:0/2311487789 wait complete. 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.513+0000 7f16cc416800 1 Processor -- start 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.513+0000 7f16cc416800 1 -- start start 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.513+0000 7f16cc416800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 0x55ee79959f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.513+0000 7f16cc416800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee79953ad0 con 0x55ee79952c70 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.513+0000 7f16c7be7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 0x55ee79959f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.513+0000 7f16c7be7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 0x55ee79959f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33426/0 (socket says 172.21.15.192:33426) 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.513+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 learned_addr learned my addr 172.21.15.192:0/98825783 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.513+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee7995a4b0 con 0x55ee79952c70 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.514+0000 7f16c7be7640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 0x55ee79959f50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f16b8061040 tx=0x7f16b8049ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.514+0000 7f15a57fa640 1 -- 172.21.15.192:0/98825783 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b806d070 con 0x55ee79952c70 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.514+0000 7f15a57fa640 1 -- 172.21.15.192:0/98825783 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b80278c0 con 0x55ee79952c70 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.514+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee7995a4b0 con 0x55ee79952c70 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.514+0000 7f15a57fa640 1 -- 172.21.15.192:0/98825783 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b8063040 con 0x55ee79952c70 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.514+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee7995a4b0 con 0x55ee79952c70 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.514+0000 7f15a57fa640 1 -- 172.21.15.192:0/98825783 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f16b8070070 con 0x55ee79952c70 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.515+0000 7f15a57fa640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f159003c730 0x7f159003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.515+0000 7f15a57fa640 1 -- 172.21.15.192:0/98825783 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f16b8073c90 con 0x55ee79952c70 2024-09-10T05:11:52.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.515+0000 7f16bf3e6640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f159003c730 0x7f159003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.515+0000 7f16cc416800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.515+0000 7f16cc416800 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee79965300 0x55ee799677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.515+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee79967f10 con 0x55ee79965300 2024-09-10T05:11:52.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.515+0000 7f16c83e8640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee79965300 0x55ee799677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.515+0000 7f16bf3e6640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f159003c730 0x7f159003ebf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f16b0000c00 tx=0x7f16b0053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.515+0000 7f16c83e8640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee79965300 0x55ee799677c0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 20 realm 2024-09-10T05:11:52.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968320 con 0x55ee79965300 2024-09-10T05:11:52.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968bf0 con 0x55ee79965300 2024-09-10T05:11:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee79969ac0 0x55ee7996beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.516+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee7996c610 con 0x55ee79969ac0 2024-09-10T05:11:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.517+0000 7f16c7be7640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee79969ac0 0x55ee7996beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.517+0000 7f16c7be7640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee79969ac0 0x55ee7996beb0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.517+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.517+0000 7f16cc416800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.517+0000 7f16cc416800 20 searching for the correct realm 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.517+0000 7f16cc416800 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ee7996e6c0 0x55ee79970b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.517+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79971250 con 0x55ee7996e6c0 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.517+0000 7f16bf3e6640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ee7996e6c0 0x55ee79970b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.517+0000 7f16bf3e6640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ee7996e6c0 0x55ee79970b80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.518+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.518+0000 7f16bf3e6640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f16b0069040 0x7f16b006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.518+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79971250 con 0x7f16b0069040 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.518+0000 7f16c83e8640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f16b0069040 0x7f16b006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.518+0000 7f16c83e8640 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f16b0069040 0x7f16b006a940 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.518+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.518+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79969ac0 2024-09-10T05:11:52.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.519+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.519+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.519+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.519+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.519+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.519+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79969ac0 2024-09-10T05:11:52.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.519+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.519+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79969ac0 2024-09-10T05:11:52.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.520+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.520+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x7f16b0069040 2024-09-10T05:11:52.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.520+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.520+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.520+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.520+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.520+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.520+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79969ac0 2024-09-10T05:11:52.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.521+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.521+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.521+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.521+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x7f16b0069040 2024-09-10T05:11:52.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.521+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.521+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.521+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.521+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.521+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.521+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79969ac0 2024-09-10T05:11:52.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.522+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.522+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.522+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.522+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.522+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.522+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.522+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.522+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.523+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.523+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79969ac0 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.523+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.523+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.523+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.523+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x7f16b0069040 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.523+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.523+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.524+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.524+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79969ac0 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.524+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.524+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.524+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.524+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79969ac0 2024-09-10T05:11:52.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.524+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.524+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x7f16b0069040 2024-09-10T05:11:52.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79969ac0 2024-09-10T05:11:52.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x7f16b0069040 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16cc416800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16cc416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16cc416800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16cc416800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16cc416800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.525+0000 7f16cc416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee7996cfc0 con 0x55ee79965300 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee7996cfc0 con 0x55ee79965300 2024-09-10T05:11:52.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:52.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee7996cf90 con 0x7f16b0069040 2024-09-10T05:11:52.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:52.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 20 zone default found 2024-09-10T05:11:52.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 4 Realm: () 2024-09-10T05:11:52.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:52.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:52.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 20 zonegroup default 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.526+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee7996d3b0 con 0x55ee79969ac0 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16cc416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16cc416800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee7996ced0 con 0x55ee7996e6c0 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16cc416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16cc416800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee799730c0 con 0x55ee7996e6c0 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16cc416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16cc416800 20 started sync module instance, tier type = 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16cc416800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.527+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79972560 con 0x7f16b0069040 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.528+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.528+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94482730527328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79972560 con 0x7f16b0069040 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.528+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79973a80 con 0x55ee79965300 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.529+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94482730527328] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.530+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.530+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94482730530736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79972560 con 0x55ee79965300 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.530+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee799744c0 con 0x55ee7996e6c0 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.531+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.531+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94482730532880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79974d90 con 0x55ee7996e6c0 2024-09-10T05:11:52.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.531+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79975830 con 0x7f16b0069040 2024-09-10T05:11:52.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.531+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94482730530736] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.532+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.532+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94482730532880] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.532+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94482730537728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee799720b0 con 0x7f16b0069040 2024-09-10T05:11:52.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.532+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee799760d0 con 0x55ee79965300 2024-09-10T05:11:52.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.533+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.533+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94482730539984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79975ff0 con 0x55ee79965300 2024-09-10T05:11:52.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.533+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977010 con 0x55ee79969ac0 2024-09-10T05:11:52.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.533+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94482730537728] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.534+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.534+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94482730543840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977400 con 0x55ee79969ac0 2024-09-10T05:11:52.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.534+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977dc0 con 0x55ee79969ac0 2024-09-10T05:11:52.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.534+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94482730539984] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.535+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94482730543840] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.535+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.535+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94482730547472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee799781b0 con 0x55ee79969ac0 2024-09-10T05:11:52.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.535+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79978a00 con 0x55ee79969ac0 2024-09-10T05:11:52.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.536+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94482730547472] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.536+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.536+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94482730549680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79978a80 con 0x55ee79969ac0 2024-09-10T05:11:52.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.536+0000 7f16cc416800 20 add_watcher() i=0 2024-09-10T05:11:52.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.536+0000 7f16cc416800 20 add_watcher() i=1 2024-09-10T05:11:52.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.536+0000 7f16cc416800 20 add_watcher() i=2 2024-09-10T05:11:52.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.536+0000 7f16cc416800 20 add_watcher() i=3 2024-09-10T05:11:52.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.536+0000 7f16cc416800 20 add_watcher() i=4 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.536+0000 7f16cc416800 20 add_watcher() i=5 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.536+0000 7f16cc416800 20 add_watcher() i=6 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.537+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94482730549680] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.537+0000 7f16cc416800 20 add_watcher() i=7 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.537+0000 7f16cc416800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.537+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee7997bd80 con 0x55ee79965300 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.537+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.537+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94482730551104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79979010 con 0x55ee79965300 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.538+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94482730551104] v35'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.538+0000 7f157dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.538+0000 7f16cc416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.538+0000 7f16cc416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.538+0000 7f16cc416800 5 note: GC not initialized 2024-09-10T05:11:52.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.539+0000 7f157cfe1640 20 reqs_thread_entry: start 2024-09-10T05:11:52.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.539+0000 7f16cc416800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:52.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.539+0000 7f16cc416800 20 Filter name: none 2024-09-10T05:11:52.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.539+0000 7f14f67fc640 20 reqs_thread_entry: start 2024-09-10T05:11:52.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.539+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee799ae580 con 0x55ee79969ac0 2024-09-10T05:11:52.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.540+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(62 [pgnls start_epoch 35 out=254b] v35'46 uv30 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.540+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977dc0 con 0x55ee79969ac0 2024-09-10T05:11:52.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.540+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(63 [pgnls start_epoch 35 out=131b] v35'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.540+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977dc0 con 0x55ee7996e6c0 2024-09-10T05:11:52.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.540+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 [pgnls start_epoch 35 out=295b] v35'35 uv27 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.540+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977dc0 con 0x55ee79969ac0 2024-09-10T05:11:52.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.541+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(65 [pgnls start_epoch 35 out=172b] v35'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.541+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977dc0 con 0x55ee79965300 2024-09-10T05:11:52.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.541+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(66 [pgnls start_epoch 35 out=335b] v35'152 uv29 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.541+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x7f16b0069040 2024-09-10T05:11:52.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.542+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(67 [pgnls start_epoch 35 out=213b] v35'22 uv22 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.542+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.542+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(68 [pgnls start_epoch 35 out=254b] v35'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.542+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.542+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(69 [pgnls start_epoch 35 out=295b] v35'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.542+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.542+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(70 [pgnls start_epoch 35 out=213b] v35'16 uv16 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.542+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x7f16b0069040 2024-09-10T05:11:52.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.543+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(71 [pgnls start_epoch 35 out=172b] v35'18 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.543+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x7f16b0069040 2024-09-10T05:11:52.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.543+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(72 [pgnls start_epoch 35 out=336b] v35'33 uv25 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f16c000a4d0 con 0x7f16b0069040 2024-09-10T05:11:52.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.543+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.543+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(73 [pgnls start_epoch 35 out=131b] v35'29 uv21 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.543+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.543+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(74 [pgnls start_epoch 35 out=254b] v35'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.543+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.544+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(75 [pgnls start_epoch 35 out=90b] v35'30 uv22 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.544+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.544+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(76 [pgnls start_epoch 35 out=213b] v35'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f16c000a4d0 con 0x55ee79965300 2024-09-10T05:11:52.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.544+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.544+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(77 [pgnls start_epoch 35 out=254b] v35'16 uv16 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.544+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.544+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(78 [pgnls start_epoch 35 out=254b] v35'21 uv21 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f16c004d110 con 0x55ee79965300 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.544+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.545+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(79 [pgnls start_epoch 35 out=213b] v35'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.545+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.545+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(80 [pgnls start_epoch 35 out=172b] v35'40 uv24 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.545+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.545+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(81 [pgnls start_epoch 35 out=295b] v35'47 uv39 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f16c004d110 con 0x55ee79965300 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.545+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x7f16b0069040 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.546+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(82 [pgnls start_epoch 35 out=276b] v35'16 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f16c004d110 con 0x7f16b0069040 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.546+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x7f16b0069040 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.546+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(83 [pgnls start_epoch 35 out=172b] v35'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f16c004d110 con 0x7f16b0069040 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.546+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.546+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(84 [pgnls start_epoch 35 out=295b] v35'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f16c004d110 con 0x55ee79965300 2024-09-10T05:11:52.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.546+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79969ac0 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.547+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(85 [pgnls start_epoch 35 out=172b] v35'34 uv18 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.547+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x7f16b0069040 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.547+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(86 [pgnls start_epoch 35 out=213b] v35'49 uv25 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f16c004d110 con 0x7f16b0069040 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.547+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79969ac0 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.547+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(87 [pgnls start_epoch 35 out=172b] v35'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.547+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.548+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(88 [pgnls start_epoch 35 out=172b] v35'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.548+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.548+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(89 [pgnls start_epoch 35 out=90b] v35'20 uv12 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.548+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee7996e6c0 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.548+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(90 [pgnls start_epoch 35 out=90b] v35'46 uv21 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.548+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79965300 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.549+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(91 [pgnls start_epoch 35 out=131b] v35'13 uv13 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f16c004d110 con 0x55ee79965300 2024-09-10T05:11:52.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.549+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x7f16b0069040 2024-09-10T05:11:52.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.549+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(92 [pgnls start_epoch 35 out=295b] v35'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f16c004d110 con 0x7f16b0069040 2024-09-10T05:11:52.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.549+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee79968f90 con 0x55ee79969ac0 2024-09-10T05:11:52.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.550+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(93 [pgnls start_epoch 35 out=213b] v35'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.564 INFO:teuthology.orchestra.run.smithi192.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-10T05:11:52.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.551+0000 7f157dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:52.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.551+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94482730551104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee799ae540 con 0x55ee79965300 2024-09-10T05:11:52.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.552+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94482730551104] v35'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f16c004d110 con 0x55ee79965300 2024-09-10T05:11:52.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.552+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94482730527328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee799aceb0 con 0x7f16b0069040 2024-09-10T05:11:52.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.553+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94482730527328] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c004d110 con 0x7f16b0069040 2024-09-10T05:11:52.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.553+0000 7f16cc416800 20 remove_watcher() i=0 2024-09-10T05:11:52.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.553+0000 7f16cc416800 2 removed watcher, disabling cache 2024-09-10T05:11:52.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.553+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94482730530736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977dc0 con 0x55ee79965300 2024-09-10T05:11:52.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.554+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94482730530736] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c004d110 con 0x55ee79965300 2024-09-10T05:11:52.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.554+0000 7f16cc416800 20 remove_watcher() i=1 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.554+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94482730532880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee799aceb0 con 0x55ee7996e6c0 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.555+0000 7f16bf3e6640 1 -- 172.21.15.192:0/98825783 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94482730532880] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b0057030 con 0x55ee7996e6c0 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.555+0000 7f16cc416800 20 remove_watcher() i=2 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.555+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94482730537728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977dc0 con 0x7f16b0069040 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.556+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94482730537728] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c004d110 con 0x7f16b0069040 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.556+0000 7f16cc416800 20 remove_watcher() i=3 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.556+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94482730539984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977dc0 con 0x55ee79965300 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.557+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94482730539984] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c004d110 con 0x55ee79965300 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.557+0000 7f16cc416800 20 remove_watcher() i=4 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.557+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94482730543840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977dc0 con 0x55ee79969ac0 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.558+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94482730543840] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.558+0000 7f16cc416800 20 remove_watcher() i=5 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.558+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94482730547472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977dc0 con 0x55ee79969ac0 2024-09-10T05:11:52.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.559+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94482730547472] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.559+0000 7f16cc416800 20 remove_watcher() i=6 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.559+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94482730549680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee79977dc0 con 0x55ee79969ac0 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16c7be7640 1 -- 172.21.15.192:0/98825783 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94482730549680] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b806f030 con 0x55ee79969ac0 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 20 remove_watcher() i=7 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee79969ac0 msgr2=0x55ee7996beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee79969ac0 0x55ee7996beb0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee79965300 msgr2=0x55ee799677c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee79965300 0x55ee799677c0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f16b0069040 msgr2=0x7f16b006a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f16b0069040 0x7f16b006a940 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ee7996e6c0 msgr2=0x55ee79970b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ee7996e6c0 0x55ee79970b80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f159003c730 msgr2=0x7f159003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f159003c730 0x7f159003ebf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f16b0000c00 tx=0x7f16b0053000 comp rx=0 tx=0).stop 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 msgr2=0x55ee79959f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16cc416800 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 0x55ee79959f50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f16b8061040 tx=0x7f16b8049ea0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.560+0000 7f16c83e8640 1 -- 172.21.15.192:0/98825783 reap_dead start 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 shutdown_connections 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 --2- 172.21.15.192:0/98825783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee79952c70 0x55ee79959f50 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 >> 172.21.15.192:0/98825783 conn(0x55ee7994f070 msgr2=0x55ee7994d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 shutdown_connections 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/98825783 wait complete. 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/2652463907 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f15a003c780 msgr2=0x7f15a003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 --2- 172.21.15.192:0/2652463907 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f15a003c780 0x7f15a003ec40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55ee79927ef0 tx=0x7f16b0005ac0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/2652463907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7991e7f0 msgr2=0x55ee7991d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 --2- 172.21.15.192:0/2652463907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7991e7f0 0x55ee7991d060 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f16b80521c0 tx=0x7f16b800e5c0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/2652463907 shutdown_connections 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 --2- 172.21.15.192:0/2652463907 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f15a003c780 0x7f15a003ec40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 --2- 172.21.15.192:0/2652463907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7991e7f0 0x55ee7991d060 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/2652463907 >> 172.21.15.192:0/2652463907 conn(0x55ee79938360 msgr2=0x55ee79938740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/2652463907 shutdown_connections 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/2652463907 wait complete. 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee7992f7e0 msgr2=0x55ee79931c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee7992f7e0 0x55ee79931c80 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee7982eec0 msgr2=0x55ee7992d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee7982eec0 0x55ee7992d480 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ee79933870 msgr2=0x55ee79935c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ee79933870 0x55ee79935c60 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f15b003c780 msgr2=0x7f15b003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f15b003c780 0x7f15b003ec40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f16b0057000 tx=0x7f16b0052000 comp rx=0 tx=0).stop 2024-09-10T05:11:52.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 msgr2=0x55ee79925e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.561+0000 7f16cc416800 1 --2- 172.21.15.192:0/1483483553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee7982e3b0 0x55ee79925e30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55ee7982d0c0 tx=0x7f16b8000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.562+0000 7f16c83e8640 1 -- 172.21.15.192:0/1483483553 reap_dead start 2024-09-10T05:11:52.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.562+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 shutdown_connections 2024-09-10T05:11:52.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.562+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 >> 172.21.15.192:0/1483483553 conn(0x55ee79828910 msgr2=0x55ee79917530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.562+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 shutdown_connections 2024-09-10T05:11:52.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.562+0000 7f16cc416800 1 -- 172.21.15.192:0/1483483553 wait complete. 2024-09-10T05:11:52.575 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-10T05:11:52.575 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-10T05:11:52.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-10T05:11:52.575 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-10T05:11:52.659 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:52.659 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:52.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.659+0000 7fb69b698800 1 Processor -- start 2024-09-10T05:11:52.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.659+0000 7fb69b698800 1 -- start start 2024-09-10T05:11:52.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.659+0000 7fb69b698800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56467b26d720 0x56467b26fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.659+0000 7fb69b698800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56467b116e40 con 0x56467b270050 2024-09-10T05:11:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.659+0000 7fb69b698800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x56467b0e1680 con 0x56467b26d720 2024-09-10T05:11:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.659+0000 7fb699182640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56467b26d720 0x56467b26fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.659+0000 7fb693fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x56467b270050 0x56467b2724e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:53034/0 (socket says 172.21.15.192:53034) 2024-09-10T05:11:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.659+0000 7fb693fff640 1 -- 172.21.15.192:0/829357847 learned_addr learned my addr 172.21.15.192:0/829357847 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.659+0000 7fb699182640 1 -- 172.21.15.192:0/829357847 >> v1:172.21.15.139:6789/0 conn(0x56467b270050 legacy=0x56467b2724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.659+0000 7fb698981640 1 -- 172.21.15.192:0/829357847 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239114938 0 0) 0x56467b116e40 con 0x56467b270050 2024-09-10T05:11:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.659+0000 7fb699182640 1 -- 172.21.15.192:0/829357847 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56467b0fd6b0 con 0x56467b26d720 2024-09-10T05:11:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.661+0000 7fb699182640 1 --2- 172.21.15.192:0/829357847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b26fb10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00a470 tx=0x7fb68c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924d39e14ef3814c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.661+0000 7fb698981640 1 -- 172.21.15.192:0/829357847 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c053570 con 0x56467b26d720 2024-09-10T05:11:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.661+0000 7fb698981640 1 -- 172.21.15.192:0/829357847 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c058070 con 0x56467b26d720 2024-09-10T05:11:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.661+0000 7fb698981640 1 -- 172.21.15.192:0/829357847 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c053880 con 0x56467b26d720 2024-09-10T05:11:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.662+0000 7fb69b698800 1 -- 172.21.15.192:0/829357847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 msgr2=0x56467b26fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.662+0000 7fb69b698800 1 --2- 172.21.15.192:0/829357847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b26fb10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00a470 tx=0x7fb68c045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.662+0000 7fb69b698800 1 -- 172.21.15.192:0/829357847 shutdown_connections 2024-09-10T05:11:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.662+0000 7fb69b698800 1 --2- 172.21.15.192:0/829357847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b26fb10 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.662+0000 7fb69b698800 1 -- 172.21.15.192:0/829357847 >> 172.21.15.192:0/829357847 conn(0x56467b2671c0 msgr2=0x56467b269620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.662+0000 7fb69b698800 1 -- 172.21.15.192:0/829357847 shutdown_connections 2024-09-10T05:11:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.662+0000 7fb69b698800 1 -- 172.21.15.192:0/829357847 wait complete. 2024-09-10T05:11:52.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.675+0000 7fb69b698800 1 Processor -- start 2024-09-10T05:11:52.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.676+0000 7fb69b698800 1 -- start start 2024-09-10T05:11:52.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.676+0000 7fb69b698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b26ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.676+0000 7fb69b698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56467b105dd0 con 0x56467b26d720 2024-09-10T05:11:52.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.676+0000 7fb699182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b26ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.676+0000 7fb699182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b26ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33436/0 (socket says 172.21.15.192:33436) 2024-09-10T05:11:52.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.676+0000 7fb699182640 1 -- 172.21.15.192:0/4001479809 learned_addr learned my addr 172.21.15.192:0/4001479809 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.676+0000 7fb699182640 1 -- 172.21.15.192:0/4001479809 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56467b11ee10 con 0x56467b26d720 2024-09-10T05:11:52.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.676+0000 7fb699182640 1 --2- 172.21.15.192:0/4001479809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b26ceb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb68c025c20 tx=0x7fb68c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad32aae8fe3682c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.677+0000 7fb587606640 1 -- 172.21.15.192:0/4001479809 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c053a20 con 0x56467b26d720 2024-09-10T05:11:52.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.677+0000 7fb587606640 1 -- 172.21.15.192:0/4001479809 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c063070 con 0x56467b26d720 2024-09-10T05:11:52.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.677+0000 7fb587606640 1 -- 172.21.15.192:0/4001479809 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c053d30 con 0x56467b26d720 2024-09-10T05:11:52.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.677+0000 7fb69b698800 1 -- 172.21.15.192:0/4001479809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 msgr2=0x56467b26ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.677+0000 7fb69b698800 1 --2- 172.21.15.192:0/4001479809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b26ceb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb68c025c20 tx=0x7fb68c051000 comp rx=0 tx=0).stop 2024-09-10T05:11:52.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.677+0000 7fb69b698800 1 -- 172.21.15.192:0/4001479809 shutdown_connections 2024-09-10T05:11:52.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.677+0000 7fb69b698800 1 --2- 172.21.15.192:0/4001479809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b26ceb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.677+0000 7fb69b698800 1 -- 172.21.15.192:0/4001479809 >> 172.21.15.192:0/4001479809 conn(0x56467b2671c0 msgr2=0x56467b357e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.677+0000 7fb69b698800 1 -- 172.21.15.192:0/4001479809 shutdown_connections 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.677+0000 7fb69b698800 1 -- 172.21.15.192:0/4001479809 wait complete. 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.678+0000 7fb69b698800 1 Processor -- start 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.678+0000 7fb69b698800 1 -- start start 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.678+0000 7fb69b698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b365f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.678+0000 7fb69b698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56467b274040 con 0x56467b26d720 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.678+0000 7fb699182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b365f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.678+0000 7fb699182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b365f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33450/0 (socket says 172.21.15.192:33450) 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.678+0000 7fb699182640 1 -- 172.21.15.192:0/2296839106 learned_addr learned my addr 172.21.15.192:0/2296839106 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.678+0000 7fb699182640 1 -- 172.21.15.192:0/2296839106 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56467b3664c0 con 0x56467b26d720 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.678+0000 7fb699182640 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b365f60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb68c025c20 tx=0x7fb68c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.679+0000 7fb585e03640 1 -- 172.21.15.192:0/2296839106 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c078070 con 0x56467b26d720 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.679+0000 7fb585e03640 1 -- 172.21.15.192:0/2296839106 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c073470 con 0x56467b26d720 2024-09-10T05:11:52.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.679+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56467b366750 con 0x56467b26d720 2024-09-10T05:11:52.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.679+0000 7fb585e03640 1 -- 172.21.15.192:0/2296839106 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c073750 con 0x56467b26d720 2024-09-10T05:11:52.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.679+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56467b367360 con 0x56467b26d720 2024-09-10T05:11:52.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.679+0000 7fb585e03640 1 -- 172.21.15.192:0/2296839106 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb68c07b070 con 0x56467b26d720 2024-09-10T05:11:52.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.680+0000 7fb585e03640 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb58003c780 0x7fb58003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.680+0000 7fb585e03640 1 -- 172.21.15.192:0/2296839106 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb68c097b80 con 0x56467b26d720 2024-09-10T05:11:52.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.680+0000 7fb693fff640 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb58003c780 0x7fb58003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.680+0000 7fb69b698800 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56467b270050 0x56467b36d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.680+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b367d20 con 0x56467b270050 2024-09-10T05:11:52.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.680+0000 7fb699983640 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56467b270050 0x56467b36d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.680+0000 7fb693fff640 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb58003c780 0x7fb58003ec40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb684000c00 tx=0x7fb6840013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.680+0000 7fb699983640 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56467b270050 0x56467b36d5b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.681+0000 7fb699983640 1 -- 172.21.15.192:0/2296839106 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b270050 2024-09-10T05:11:52.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.681+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3676d0 con 0x56467b270050 2024-09-10T05:11:52.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.681+0000 7fb699983640 1 -- 172.21.15.192:0/2296839106 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b270050 2024-09-10T05:11:52.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.681+0000 7fb69b698800 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56467b36fa20 0x56467b371e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.681+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3724e0 con 0x56467b36fa20 2024-09-10T05:11:52.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.681+0000 7fb699182640 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56467b36fa20 0x56467b371e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.681+0000 7fb699182640 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56467b36fa20 0x56467b371e10 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.682+0000 7fb699182640 1 -- 172.21.15.192:0/2296839106 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b36fa20 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.682+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b36e8c0 con 0x56467b270050 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.682+0000 7fb699983640 1 -- 172.21.15.192:0/2296839106 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b270050 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.682+0000 7fb69b698800 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56467b373920 0x56467b375d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.682+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b376450 con 0x56467b373920 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.682+0000 7fb693fff640 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56467b373920 0x56467b375d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.682+0000 7fb693fff640 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56467b373920 0x56467b375d10 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.683+0000 7fb693fff640 1 -- 172.21.15.192:0/2296839106 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb68400f670 con 0x56467b373920 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.683+0000 7fb69b698800 1 Processor -- start 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.683+0000 7fb69b698800 1 -- start start 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.683+0000 7fb69b698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b3840b0 0x56467b3844d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.683+0000 7fb69b698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56467b163a00 con 0x56467b3840b0 2024-09-10T05:11:52.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.683+0000 7fb699182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b3840b0 0x56467b3844d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.683+0000 7fb699182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b3840b0 0x56467b3844d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33458/0 (socket says 172.21.15.192:33458) 2024-09-10T05:11:52.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.683+0000 7fb699182640 1 -- 172.21.15.192:0/923514228 learned_addr learned my addr 172.21.15.192:0/923514228 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.683+0000 7fb699182640 1 -- 172.21.15.192:0/923514228 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56467b384b10 con 0x56467b3840b0 2024-09-10T05:11:52.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.684+0000 7fb699182640 1 --2- 172.21.15.192:0/923514228 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b3840b0 0x56467b3844d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb68c095f00 tx=0x7fb68c05de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.684+0000 7fb57effd640 1 -- 172.21.15.192:0/923514228 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c07c6a0 con 0x56467b3840b0 2024-09-10T05:11:52.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.684+0000 7fb57effd640 1 -- 172.21.15.192:0/923514228 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c07c840 con 0x56467b3840b0 2024-09-10T05:11:52.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.684+0000 7fb69b698800 1 -- 172.21.15.192:0/923514228 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56467b385340 con 0x56467b3840b0 2024-09-10T05:11:52.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.684+0000 7fb57effd640 1 -- 172.21.15.192:0/923514228 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c0685e0 con 0x56467b3840b0 2024-09-10T05:11:52.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.684+0000 7fb69b698800 1 -- 172.21.15.192:0/923514228 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56467b3858e0 con 0x56467b3840b0 2024-09-10T05:11:52.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.685+0000 7fb57effd640 1 -- 172.21.15.192:0/923514228 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb68c068780 con 0x56467b3840b0 2024-09-10T05:11:52.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.685+0000 7fb57effd640 1 --2- 172.21.15.192:0/923514228 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb57003c730 0x7fb57003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.685+0000 7fb57effd640 1 -- 172.21.15.192:0/923514228 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb68c08f070 con 0x56467b3840b0 2024-09-10T05:11:52.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.685+0000 7fb693fff640 1 --2- 172.21.15.192:0/923514228 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb57003c730 0x7fb57003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.685+0000 7fb69b698800 1 Processor -- start 2024-09-10T05:11:52.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.685+0000 7fb69b698800 1 -- start start 2024-09-10T05:11:52.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.685+0000 7fb693fff640 1 --2- 172.21.15.192:0/923514228 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb57003c730 0x7fb57003ebf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x56467b36dbc0 tx=0x7fb684006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.685+0000 7fb69b698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 0x56467b390d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.685+0000 7fb69b698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56467b26b750 con 0x56467b390930 2024-09-10T05:11:52.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.686+0000 7fb699182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 0x56467b390d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.686+0000 7fb699182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 0x56467b390d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33468/0 (socket says 172.21.15.192:33468) 2024-09-10T05:11:52.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.686+0000 7fb699182640 1 -- 172.21.15.192:0/2670576641 learned_addr learned my addr 172.21.15.192:0/2670576641 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.686+0000 7fb699182640 1 -- 172.21.15.192:0/2670576641 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56467b391300 con 0x56467b390930 2024-09-10T05:11:52.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.686+0000 7fb699182640 1 --2- 172.21.15.192:0/2670576641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 0x56467b390d10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb68c06afa0 tx=0x7fb68c061e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a6c13e1716edc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.686+0000 7fb57cff9640 1 -- 172.21.15.192:0/2670576641 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c07d440 con 0x56467b390930 2024-09-10T05:11:52.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.686+0000 7fb57cff9640 1 -- 172.21.15.192:0/2670576641 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c0923c0 con 0x56467b390930 2024-09-10T05:11:52.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.686+0000 7fb57cff9640 1 -- 172.21.15.192:0/2670576641 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c074040 con 0x56467b390930 2024-09-10T05:11:52.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb69b698800 1 -- 172.21.15.192:0/2670576641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 msgr2=0x56467b390d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb69b698800 1 --2- 172.21.15.192:0/2670576641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 0x56467b390d10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb68c06afa0 tx=0x7fb68c061e30 comp rx=0 tx=0).stop 2024-09-10T05:11:52.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb69b698800 1 -- 172.21.15.192:0/2670576641 shutdown_connections 2024-09-10T05:11:52.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb69b698800 1 --2- 172.21.15.192:0/2670576641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 0x56467b390d10 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb69b698800 1 -- 172.21.15.192:0/2670576641 >> 172.21.15.192:0/2670576641 conn(0x56467b38cd30 msgr2=0x56467b38af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb69b698800 1 -- 172.21.15.192:0/2670576641 shutdown_connections 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb69b698800 1 -- 172.21.15.192:0/2670576641 wait complete. 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb69b698800 1 Processor -- start 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb69b698800 1 -- start start 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb69b698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 0x56467b397cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb69b698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56467b391790 con 0x56467b390930 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb699182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 0x56467b397cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb699182640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 0x56467b397cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33474/0 (socket says 172.21.15.192:33474) 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.687+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 learned_addr learned my addr 172.21.15.192:0/1579909420 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.688+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56467b398230 con 0x56467b390930 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.688+0000 7fb699182640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 0x56467b397cd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb68c053730 tx=0x7fb68c06af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.688+0000 7fb56effd640 1 -- 172.21.15.192:0/1579909420 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c07d440 con 0x56467b390930 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.688+0000 7fb56effd640 1 -- 172.21.15.192:0/1579909420 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c052c70 con 0x56467b390930 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.688+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56467b398230 con 0x56467b390930 2024-09-10T05:11:52.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.688+0000 7fb56effd640 1 -- 172.21.15.192:0/1579909420 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb68c07d660 con 0x56467b390930 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.688+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56467b398230 con 0x56467b390930 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.689+0000 7fb56effd640 1 -- 172.21.15.192:0/1579909420 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb68c0bd030 con 0x56467b390930 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.689+0000 7fb56effd640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb56403c780 0x7fb56403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.689+0000 7fb56effd640 1 -- 172.21.15.192:0/1579909420 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb68c0bb070 con 0x56467b390930 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.689+0000 7fb693fff640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb56403c780 0x7fb56403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.689+0000 7fb693fff640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb56403c780 0x7fb56403ec40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb68400ffd0 tx=0x7fb684023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb69b698800 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56467b3a32b0 0x56467b3a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a5ec0 con 0x56467b3a32b0 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb699983640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56467b3a32b0 0x56467b3a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb699983640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56467b3a32b0 0x56467b3a5770 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb69b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb69b698800 20 realm 2024-09-10T05:11:52.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a62d0 con 0x56467b3a32b0 2024-09-10T05:11:52.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb69b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb69b698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:52.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.690+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6ba0 con 0x56467b3a32b0 2024-09-10T05:11:52.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.691+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.691+0000 7fb69b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.691+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.691+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a32b0 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.691+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.691+0000 7fb69b698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.691+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.691+0000 7fb69b698800 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56467b3a7ca0 0x56467b3aa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.691+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3aa650 con 0x56467b3a7ca0 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.691+0000 7fb699182640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56467b3a7ca0 0x56467b3aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.692+0000 7fb699182640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56467b3a7ca0 0x56467b3aa090 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.692+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.692+0000 7fb69b698800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.692+0000 7fb69b698800 20 searching for the correct realm 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.692+0000 7fb69b698800 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56467b3ac600 0x56467b3aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.692+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3af190 con 0x56467b3ac600 2024-09-10T05:11:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.692+0000 7fb693fff640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56467b3ac600 0x56467b3aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.692+0000 7fb693fff640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56467b3ac600 0x56467b3aeac0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.693+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.693+0000 7fb693fff640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb68402e910 0x7fb68403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.693+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3af190 con 0x7fb68402e910 2024-09-10T05:11:52.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.693+0000 7fb699983640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb68402e910 0x7fb68403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.693+0000 7fb699983640 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb68402e910 0x7fb68403a3c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.693+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.693+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a7ca0 2024-09-10T05:11:52.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.693+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.693+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a32b0 2024-09-10T05:11:52.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.694+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.694+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a32b0 2024-09-10T05:11:52.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.694+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.694+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a7ca0 2024-09-10T05:11:52.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.695+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.695+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a7ca0 2024-09-10T05:11:52.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.695+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.695+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x7fb68402e910 2024-09-10T05:11:52.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.695+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.695+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3ac600 2024-09-10T05:11:52.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.695+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.695+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a32b0 2024-09-10T05:11:52.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.696+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.696+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a7ca0 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.696+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.696+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a32b0 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.696+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.696+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x7fb68402e910 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.696+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.696+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3ac600 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.696+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.696+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3ac600 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.697+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.697+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a7ca0 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.697+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.697+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3ac600 2024-09-10T05:11:52.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.697+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.697+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3ac600 2024-09-10T05:11:52.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.697+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.697+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a32b0 2024-09-10T05:11:52.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.698+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.698+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a32b0 2024-09-10T05:11:52.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.698+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.698+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a7ca0 2024-09-10T05:11:52.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.698+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.698+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3ac600 2024-09-10T05:11:52.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.698+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.698+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x7fb68402e910 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.699+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.699+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a32b0 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.699+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.699+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a7ca0 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.699+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.699+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3ac600 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.699+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.700+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a7ca0 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.700+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.700+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x7fb68402e910 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.700+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.700+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3ac600 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.700+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.700+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a7ca0 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x56467b3a32b0 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56467b3a6f40 con 0x7fb68402e910 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb69b698800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb69b698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb69b698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb69b698800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb69b698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:52.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb69b698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3aaf10 con 0x56467b3a32b0 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb69b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.701+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3aaf10 con 0x56467b3a32b0 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3aaf10 con 0x7fb68402e910 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:52.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 20 zone default found 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 4 Realm: () 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 20 zonegroup default 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3aaef0 con 0x56467b3a7ca0 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b1000 con 0x56467b3ac600 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.702+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b13a0 con 0x56467b3ac600 2024-09-10T05:11:52.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.703+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.703+0000 7fb69b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.703+0000 7fb69b698800 20 started sync module instance, tier type = 2024-09-10T05:11:52.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.703+0000 7fb69b698800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:52.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.703+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b04a0 con 0x7fb68402e910 2024-09-10T05:11:52.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.704+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.704+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94860715166144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b04a0 con 0x7fb68402e910 2024-09-10T05:11:52.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.704+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b1d60 con 0x56467b3a32b0 2024-09-10T05:11:52.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.705+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94860715166144] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.705+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.705+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94860715170448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b04a0 con 0x56467b3a32b0 2024-09-10T05:11:52.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.705+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b27d0 con 0x56467b3ac600 2024-09-10T05:11:52.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.706+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94860715170448] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.706+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.706+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94860715163632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b0410 con 0x56467b3ac600 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.706+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b3690 con 0x7fb68402e910 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.707+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94860715163632] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.707+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.707+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94860715176416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b3ab0 con 0x7fb68402e910 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.707+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b4470 con 0x56467b3a32b0 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.708+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94860715176416] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.708+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.708+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94860715177952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b4470 con 0x56467b3a32b0 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.709+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b4e30 con 0x56467b3a7ca0 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.709+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94860715177952] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.710+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.710+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94860715182944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b4470 con 0x56467b3a7ca0 2024-09-10T05:11:52.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.710+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b5840 con 0x56467b3a7ca0 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.711+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94860715182944] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.711+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(56 notify.6 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.711+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94860715180480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b5840 con 0x56467b3a7ca0 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.711+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b6260 con 0x56467b3a7ca0 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.712+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94860715180480] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.712+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.712+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94860715187536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b5840 con 0x56467b3a7ca0 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.712+0000 7fb69b698800 20 add_watcher() i=0 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.712+0000 7fb69b698800 20 add_watcher() i=1 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.712+0000 7fb69b698800 20 add_watcher() i=2 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.712+0000 7fb69b698800 20 add_watcher() i=3 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.712+0000 7fb69b698800 20 add_watcher() i=4 2024-09-10T05:11:52.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.712+0000 7fb69b698800 20 add_watcher() i=5 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.712+0000 7fb69b698800 20 add_watcher() i=6 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.713+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94860715187536] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.713+0000 7fb69b698800 20 add_watcher() i=7 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.713+0000 7fb69b698800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.713+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b9680 con 0x56467b3a32b0 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.713+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.713+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94860715185504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3b6bd0 con 0x56467b3a32b0 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.714+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94860715185504] v35'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.714+0000 7fb54f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.714+0000 7fb69b698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.714+0000 7fb69b698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.714+0000 7fb69b698800 5 note: GC not initialized 2024-09-10T05:11:52.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.714+0000 7fb54e7e4640 20 reqs_thread_entry: start 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.714+0000 7fb69b698800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 20 Filter name: none 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb4bffff640 20 reqs_thread_entry: start 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ec740 con 0x56467b3a32b0 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ef070 con 0x7fb68402e910 2024-09-10T05:11:52.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 20 disabling bucket name=myfoo 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.715+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ed050 con 0x7fb68402e910 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 : miss 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:65 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ef940 con 0x56467b3ac600 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(65 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.716+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3f7630 con 0x56467b3ac600 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.717+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(66 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v35'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.717+0000 7fb69b698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.717+0000 7fb69b698800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.717+0000 7fb69b698800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.717+0000 7fb69b698800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1, ofs0, ns] 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.717+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94860715425760 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3f2d30 con 0x7fb68402e910 2024-09-10T05:11:52.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== watch-notify(notify (1) cookie 94860715176416 notify 150323855379 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7fb694045430 con 0x7fb68402e910 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb57cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855379 cookie 94860715176416 notifier 4602 bl.length()=760 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(67 notify.3 [notify cookie 94860715425760 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb57cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb57cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb57cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb57cff9640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fb55c003ea0 con 0x7fb68402e910 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== watch-notify(notify_complete (2) cookie 94860715425760 notify 150323855379 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb694045600 con 0x7fb68402e910 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb69b698800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): orig_sources= new_sources= 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb69b698800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): potential sources added=[] removed=[] 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb69b698800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): orig_dests= new_dests= 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb69b698800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): potential dests added=[] removed=[] 2024-09-10T05:11:52.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.718+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3f1780 con 0x56467b3a32b0 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.719+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v35'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.719+0000 7fb69b698800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.719+0000 7fb69b698800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.719+0000 7fb69b698800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.719+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94860715425728 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56467b3f1780 con 0x56467b3a32b0 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.719+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 94860715177952 notify 150323855374 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fb694045600 con 0x56467b3a32b0 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.719+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(70 notify.4 [notify cookie 94860715425728 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.720+0000 7fb57cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855374 cookie 94860715177952 notifier 4602 bl.length()=567 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.720+0000 7fb57cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.720+0000 7fb57cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.720+0000 7fb57cff9640 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fb55c003ea0 con 0x56467b3a32b0 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.720+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== watch-notify(notify_complete (2) cookie 94860715425728 notify 150323855374 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb694045d10 con 0x56467b3a32b0 2024-09-10T05:11:52.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.720+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.735 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:52.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.721+0000 7fb54f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:52.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.721+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94860715185504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ea5e0 con 0x56467b3a32b0 2024-09-10T05:11:52.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.722+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94860715185504] v35'155 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.722+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94860715166144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ea5e0 con 0x7fb68402e910 2024-09-10T05:11:52.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.723+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94860715166144] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.723+0000 7fb69b698800 20 remove_watcher() i=0 2024-09-10T05:11:52.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.723+0000 7fb69b698800 2 removed watcher, disabling cache 2024-09-10T05:11:52.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.723+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94860715170448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ea5e0 con 0x56467b3a32b0 2024-09-10T05:11:52.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.724+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94860715170448] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.724+0000 7fb69b698800 20 remove_watcher() i=1 2024-09-10T05:11:52.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.724+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94860715163632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ea5e0 con 0x56467b3ac600 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.725+0000 7fb693fff640 1 -- 172.21.15.192:0/1579909420 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94860715163632] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb684037040 con 0x56467b3ac600 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.725+0000 7fb69b698800 20 remove_watcher() i=2 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.725+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94860715176416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ea5e0 con 0x7fb68402e910 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.726+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94860715176416] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb68402e910 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.726+0000 7fb69b698800 20 remove_watcher() i=3 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.726+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94860715177952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ea5e0 con 0x56467b3a32b0 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.727+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94860715177952] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x56467b3a32b0 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.727+0000 7fb69b698800 20 remove_watcher() i=4 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.727+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94860715182944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ea5e0 con 0x56467b3a7ca0 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.728+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94860715182944] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.728+0000 7fb69b698800 20 remove_watcher() i=5 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.728+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94860715180480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ea5e0 con 0x56467b3a7ca0 2024-09-10T05:11:52.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.729+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94860715180480] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.729+0000 7fb69b698800 20 remove_watcher() i=6 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.729+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94860715187536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56467b3ea5e0 con 0x56467b3a7ca0 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb699182640 1 -- 172.21.15.192:0/1579909420 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94860715187536] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb68c07a030 con 0x56467b3a7ca0 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 20 remove_watcher() i=7 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56467b3a7ca0 msgr2=0x56467b3aa090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56467b3a7ca0 0x56467b3aa090 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56467b3a32b0 msgr2=0x56467b3a5770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56467b3a32b0 0x56467b3a5770 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb68402e910 msgr2=0x7fb68403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fb68402e910 0x7fb68403a3c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56467b3ac600 msgr2=0x56467b3aeac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56467b3ac600 0x56467b3aeac0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb56403c780 msgr2=0x7fb56403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb56403c780 0x7fb56403ec40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb68400ffd0 tx=0x7fb684023040 comp rx=0 tx=0).stop 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 msgr2=0x56467b397cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 --2- 172.21.15.192:0/1579909420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b390930 0x56467b397cd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb68c053730 tx=0x7fb68c06af00 comp rx=0 tx=0).stop 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 reap_dead start 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb699983640 1 -- 172.21.15.192:0/1579909420 reap_dead start 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 shutdown_connections 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 >> 172.21.15.192:0/1579909420 conn(0x56467b38cd30 msgr2=0x56467b38af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 shutdown_connections 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.730+0000 7fb69b698800 1 -- 172.21.15.192:0/1579909420 wait complete. 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/923514228 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb57003c730 msgr2=0x7fb57003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 --2- 172.21.15.192:0/923514228 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb57003c730 0x7fb57003ebf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x56467b36dbc0 tx=0x7fb684006000 comp rx=0 tx=0).stop 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/923514228 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b3840b0 msgr2=0x56467b3844d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 --2- 172.21.15.192:0/923514228 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b3840b0 0x56467b3844d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb68c095f00 tx=0x7fb68c05de70 comp rx=0 tx=0).stop 2024-09-10T05:11:52.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/923514228 shutdown_connections 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 --2- 172.21.15.192:0/923514228 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb57003c730 0x7fb57003ebf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 --2- 172.21.15.192:0/923514228 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b3840b0 0x56467b3844d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/923514228 >> 172.21.15.192:0/923514228 conn(0x56467b378460 msgr2=0x56467b378840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/923514228 shutdown_connections 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/923514228 wait complete. 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56467b36fa20 msgr2=0x56467b371e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56467b36fa20 0x56467b371e10 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56467b270050 msgr2=0x56467b36d5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56467b270050 0x56467b36d5b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56467b373920 msgr2=0x56467b375d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56467b373920 0x56467b375d10 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb58003c780 msgr2=0x7fb58003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb58003c780 0x7fb58003ec40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb684000c00 tx=0x7fb6840013b0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 msgr2=0x56467b365f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 --2- 172.21.15.192:0/2296839106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56467b26d720 0x56467b365f60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb68c025c20 tx=0x7fb68c002fb0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb699983640 1 -- 172.21.15.192:0/2296839106 reap_dead start 2024-09-10T05:11:52.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 shutdown_connections 2024-09-10T05:11:52.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 >> 172.21.15.192:0/2296839106 conn(0x56467b2671c0 msgr2=0x56467b357990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 shutdown_connections 2024-09-10T05:11:52.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.731+0000 7fb69b698800 1 -- 172.21.15.192:0/2296839106 wait complete. 2024-09-10T05:11:52.746 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:52.748 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-10T05:11:52.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-10T05:11:52.748 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-10T05:11:52.793 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:11:52.793 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:11:52.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.793+0000 7fdac5320800 1 Processor -- start 2024-09-10T05:11:52.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.793+0000 7fdac5320800 1 -- start start 2024-09-10T05:11:52.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.793+0000 7fdac5320800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562b884c9200 0x562b884cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.793+0000 7fdac5320800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b8836ee40 con 0x562b884c5690 2024-09-10T05:11:52.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.793+0000 7fdac5320800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x562b88339680 con 0x562b884c9200 2024-09-10T05:11:52.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.793+0000 7fdabbfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562b884c9200 0x562b884cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.793+0000 7fdac1068640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x562b884c5690 0x562b884c7a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:53050/0 (socket says 172.21.15.192:53050) 2024-09-10T05:11:52.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.793+0000 7fdac1068640 1 -- 172.21.15.192:0/244068340 learned_addr learned my addr 172.21.15.192:0/244068340 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:11:52.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.793+0000 7fdabbfff640 1 --2- 172.21.15.192:0/244068340 >> v2:172.21.15.139:3300/0 conn(0x562b884c9200 0x562b884cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33482/0 (socket says 172.21.15.192:33482) 2024-09-10T05:11:52.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.793+0000 7fdabbfff640 1 -- 172.21.15.192:0/244068340 >> v1:172.21.15.139:6789/0 conn(0x562b884c5690 legacy=0x562b884c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.793+0000 7fdac0867640 1 -- 172.21.15.192:0/244068340 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2506953787 0 0) 0x562b8836ee40 con 0x562b884c5690 2024-09-10T05:11:52.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.793+0000 7fdabbfff640 1 -- 172.21.15.192:0/244068340 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b883556b0 con 0x562b884c9200 2024-09-10T05:11:52.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.795+0000 7fdabbfff640 1 --2- 172.21.15.192:0/244068340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c9200 0x562b884cb6c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00a470 tx=0x7fdaac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4ab5fddcbbf2ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.795+0000 7fdac0867640 1 -- 172.21.15.192:0/244068340 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaac053570 con 0x562b884c9200 2024-09-10T05:11:52.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.795+0000 7fdac0867640 1 -- 172.21.15.192:0/244068340 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaac058070 con 0x562b884c9200 2024-09-10T05:11:52.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.795+0000 7fdac0867640 1 -- 172.21.15.192:0/244068340 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaac053880 con 0x562b884c9200 2024-09-10T05:11:52.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.796+0000 7fdac5320800 1 -- 172.21.15.192:0/244068340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c9200 msgr2=0x562b884cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.796+0000 7fdac5320800 1 --2- 172.21.15.192:0/244068340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c9200 0x562b884cb6c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00a470 tx=0x7fdaac045a20 comp rx=0 tx=0).stop 2024-09-10T05:11:52.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.796+0000 7fdac5320800 1 -- 172.21.15.192:0/244068340 shutdown_connections 2024-09-10T05:11:52.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.796+0000 7fdac5320800 1 --2- 172.21.15.192:0/244068340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c9200 0x562b884cb6c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.796+0000 7fdac5320800 1 -- 172.21.15.192:0/244068340 >> 172.21.15.192:0/244068340 conn(0x562b884bf1f0 msgr2=0x562b884c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.796+0000 7fdac5320800 1 -- 172.21.15.192:0/244068340 shutdown_connections 2024-09-10T05:11:52.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.796+0000 7fdac5320800 1 -- 172.21.15.192:0/244068340 wait complete. 2024-09-10T05:11:52.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.810+0000 7fdac5320800 1 Processor -- start 2024-09-10T05:11:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.810+0000 7fdac5320800 1 -- start start 2024-09-10T05:11:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.810+0000 7fdac5320800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 0x562b885b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.810+0000 7fdac5320800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562b8835ddd0 con 0x562b884c5690 2024-09-10T05:11:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.810+0000 7fdac1068640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 0x562b885b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.810+0000 7fdac1068640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 0x562b885b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33486/0 (socket says 172.21.15.192:33486) 2024-09-10T05:11:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.810+0000 7fdac1068640 1 -- 172.21.15.192:0/2244057309 learned_addr learned my addr 172.21.15.192:0/2244057309 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.811+0000 7fdac1068640 1 -- 172.21.15.192:0/2244057309 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b88376e10 con 0x562b884c5690 2024-09-10T05:11:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.811+0000 7fdac1068640 1 --2- 172.21.15.192:0/2244057309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 0x562b885b4480 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdab4001ea0 tx=0x7fdab400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed75adf25c0b254f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.811+0000 7fd9af606640 1 -- 172.21.15.192:0/2244057309 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab4008070 con 0x562b884c5690 2024-09-10T05:11:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.811+0000 7fd9af606640 1 -- 172.21.15.192:0/2244057309 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab400d500 con 0x562b884c5690 2024-09-10T05:11:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.811+0000 7fd9af606640 1 -- 172.21.15.192:0/2244057309 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab400d880 con 0x562b884c5690 2024-09-10T05:11:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac5320800 1 -- 172.21.15.192:0/2244057309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 msgr2=0x562b885b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac5320800 1 --2- 172.21.15.192:0/2244057309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 0x562b885b4480 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdab4001ea0 tx=0x7fdab400b6a0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac5320800 1 -- 172.21.15.192:0/2244057309 shutdown_connections 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac5320800 1 --2- 172.21.15.192:0/2244057309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 0x562b885b4480 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac5320800 1 -- 172.21.15.192:0/2244057309 >> 172.21.15.192:0/2244057309 conn(0x562b884bf1f0 msgr2=0x562b885afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac5320800 1 -- 172.21.15.192:0/2244057309 shutdown_connections 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac5320800 1 -- 172.21.15.192:0/2244057309 wait complete. 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac5320800 1 Processor -- start 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac5320800 1 -- start start 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac5320800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 0x562b885bbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac5320800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562b884cc040 con 0x562b884c5690 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac1068640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 0x562b885bbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.812+0000 7fdac1068640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 0x562b885bbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33494/0 (socket says 172.21.15.192:33494) 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.813+0000 7fdac1068640 1 -- 172.21.15.192:0/4110097222 learned_addr learned my addr 172.21.15.192:0/4110097222 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.813+0000 7fdac1068640 1 -- 172.21.15.192:0/4110097222 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b885bc330 con 0x562b884c5690 2024-09-10T05:11:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.813+0000 7fdac1068640 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 0x562b885bbdd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdab40012f0 tx=0x7fdab4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.813+0000 7fd9ade03640 1 -- 172.21.15.192:0/4110097222 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab400f9d0 con 0x562b884c5690 2024-09-10T05:11:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.813+0000 7fd9ade03640 1 -- 172.21.15.192:0/4110097222 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab400fb70 con 0x562b884c5690 2024-09-10T05:11:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.813+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b885bc5c0 con 0x562b884c5690 2024-09-10T05:11:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.813+0000 7fd9ade03640 1 -- 172.21.15.192:0/4110097222 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab400fe50 con 0x562b884c5690 2024-09-10T05:11:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.813+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b885bcfc0 con 0x562b884c5690 2024-09-10T05:11:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.814+0000 7fd9ade03640 1 -- 172.21.15.192:0/4110097222 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdab4017040 con 0x562b884c5690 2024-09-10T05:11:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.814+0000 7fd9ade03640 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd9a803c920 0x7fd9a803ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.814+0000 7fd9ade03640 1 -- 172.21.15.192:0/4110097222 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fdab4015020 con 0x562b884c5690 2024-09-10T05:11:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.814+0000 7fdabbfff640 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd9a803c920 0x7fd9a803ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.814+0000 7fdac5320800 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562b884c9200 0x562b885c3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.814+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b885c3960 con 0x562b884c9200 2024-09-10T05:11:52.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.814+0000 7fdac1869640 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562b884c9200 0x562b885c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.815+0000 7fdabbfff640 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd9a803c920 0x7fd9a803ede0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdaac057000 tx=0x7fdaac052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.815+0000 7fdac1869640 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562b884c9200 0x562b885c3420 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.815+0000 7fdac1869640 1 -- 172.21.15.192:0/4110097222 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b884c9200 2024-09-10T05:11:52.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.815+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b885c3d00 con 0x562b884c9200 2024-09-10T05:11:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.815+0000 7fdac1869640 1 -- 172.21.15.192:0/4110097222 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b884c9200 2024-09-10T05:11:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.815+0000 7fdac5320800 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562b885c5800 0x562b885c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.815+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b885c8410 con 0x562b885c5800 2024-09-10T05:11:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.816+0000 7fdac1068640 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562b885c5800 0x562b885c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.816+0000 7fdac1068640 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562b885c5800 0x562b885c7c80 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.816+0000 7fdac1068640 1 -- 172.21.15.192:0/4110097222 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdab402d070 con 0x562b885c5800 2024-09-10T05:11:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.816+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b885c4550 con 0x562b884c9200 2024-09-10T05:11:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.816+0000 7fdac1869640 1 -- 172.21.15.192:0/4110097222 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b884c9200 2024-09-10T05:11:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.816+0000 7fdac5320800 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562b885c9870 0x562b885cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.816+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b885cc3d0 con 0x562b885c9870 2024-09-10T05:11:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.817+0000 7fdabbfff640 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562b885c9870 0x562b885cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.817+0000 7fdabbfff640 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562b885c9870 0x562b885cbc60 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.817+0000 7fdabbfff640 1 -- 172.21.15.192:0/4110097222 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdaac051070 con 0x562b885c9870 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.817+0000 7fdac5320800 1 Processor -- start 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.818+0000 7fdac5320800 1 -- start start 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.818+0000 7fdac5320800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b885da000 0x562b885da420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.818+0000 7fdac5320800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562b883bba00 con 0x562b885da000 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.818+0000 7fdac1068640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b885da000 0x562b885da420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.818+0000 7fdac1068640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b885da000 0x562b885da420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33502/0 (socket says 172.21.15.192:33502) 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.818+0000 7fdac1068640 1 -- 172.21.15.192:0/1368759774 learned_addr learned my addr 172.21.15.192:0/1368759774 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.818+0000 7fdac1068640 1 -- 172.21.15.192:0/1368759774 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b885daa60 con 0x562b885da000 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.819+0000 7fdac1068640 1 --2- 172.21.15.192:0/1368759774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b885da000 0x562b885da420 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdab400e660 tx=0x7fdab4018e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.819+0000 7fd9a6ffd640 1 -- 172.21.15.192:0/1368759774 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab4048020 con 0x562b885da000 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.819+0000 7fd9a6ffd640 1 -- 172.21.15.192:0/1368759774 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab404b310 con 0x562b885da000 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.819+0000 7fd9a6ffd640 1 -- 172.21.15.192:0/1368759774 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab401a4f0 con 0x562b885da000 2024-09-10T05:11:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.819+0000 7fdac5320800 1 -- 172.21.15.192:0/1368759774 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b885db290 con 0x562b885da000 2024-09-10T05:11:52.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.819+0000 7fdac5320800 1 -- 172.21.15.192:0/1368759774 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b885db830 con 0x562b885da000 2024-09-10T05:11:52.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.819+0000 7fd9a6ffd640 1 -- 172.21.15.192:0/1368759774 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdab404b020 con 0x562b885da000 2024-09-10T05:11:52.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.820+0000 7fd9a6ffd640 1 --2- 172.21.15.192:0/1368759774 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd99803c6e0 0x7fd99803eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.820+0000 7fd9a6ffd640 1 -- 172.21.15.192:0/1368759774 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fdab403c620 con 0x562b885da000 2024-09-10T05:11:52.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.820+0000 7fdabbfff640 1 --2- 172.21.15.192:0/1368759774 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd99803c6e0 0x7fd99803eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.820+0000 7fdac5320800 1 Processor -- start 2024-09-10T05:11:52.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.820+0000 7fdac5320800 1 -- start start 2024-09-10T05:11:52.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.820+0000 7fdabbfff640 1 --2- 172.21.15.192:0/1368759774 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd99803c6e0 0x7fd99803eba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdaac000c00 tx=0x7fdaac005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.820+0000 7fdac5320800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 0x562b884c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.820+0000 7fdac5320800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562b885b4cd0 con 0x562b884c3690 2024-09-10T05:11:52.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.820+0000 7fdac1068640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 0x562b884c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.820+0000 7fdac1068640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 0x562b884c3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33508/0 (socket says 172.21.15.192:33508) 2024-09-10T05:11:52.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.820+0000 7fdac1068640 1 -- 172.21.15.192:0/3332867834 learned_addr learned my addr 172.21.15.192:0/3332867834 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.821+0000 7fdac1068640 1 -- 172.21.15.192:0/3332867834 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b884c4080 con 0x562b884c3690 2024-09-10T05:11:52.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.821+0000 7fdac1068640 1 --2- 172.21.15.192:0/3332867834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 0x562b884c3a90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdab4008fd0 tx=0x7fdab4026d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c500af524c13759 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.821+0000 7fd9a4ff9640 1 -- 172.21.15.192:0/3332867834 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab4035030 con 0x562b884c3690 2024-09-10T05:11:52.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.821+0000 7fd9a4ff9640 1 -- 172.21.15.192:0/3332867834 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab401cc60 con 0x562b884c3690 2024-09-10T05:11:52.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.821+0000 7fd9a4ff9640 1 -- 172.21.15.192:0/3332867834 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab4019470 con 0x562b884c3690 2024-09-10T05:11:52.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.821+0000 7fdac5320800 1 -- 172.21.15.192:0/3332867834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 msgr2=0x562b884c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.821+0000 7fdac5320800 1 --2- 172.21.15.192:0/3332867834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 0x562b884c3a90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdab4008fd0 tx=0x7fdab4026d00 comp rx=0 tx=0).stop 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.821+0000 7fdac5320800 1 -- 172.21.15.192:0/3332867834 shutdown_connections 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.821+0000 7fdac5320800 1 --2- 172.21.15.192:0/3332867834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 0x562b884c3a90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.821+0000 7fdac5320800 1 -- 172.21.15.192:0/3332867834 >> 172.21.15.192:0/3332867834 conn(0x562b885e2c20 msgr2=0x562b885e0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.821+0000 7fdac5320800 1 -- 172.21.15.192:0/3332867834 shutdown_connections 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.821+0000 7fdac5320800 1 -- 172.21.15.192:0/3332867834 wait complete. 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.822+0000 7fdac5320800 1 Processor -- start 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.822+0000 7fdac5320800 1 -- start start 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.822+0000 7fdac5320800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 0x562b885efef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.822+0000 7fdac5320800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562b884c4570 con 0x562b884c3690 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.822+0000 7fdac1068640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 0x562b885efef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.822+0000 7fdac1068640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 0x562b885efef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33522/0 (socket says 172.21.15.192:33522) 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.822+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 learned_addr learned my addr 172.21.15.192:0/4267005556 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.822+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b885f0450 con 0x562b884c3690 2024-09-10T05:11:52.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.822+0000 7fdac1068640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 0x562b885efef0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdab4014390 tx=0x7fdab403a9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.823+0000 7fd996ffd640 1 -- 172.21.15.192:0/4267005556 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab4035070 con 0x562b884c3690 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.823+0000 7fd996ffd640 1 -- 172.21.15.192:0/4267005556 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab4065030 con 0x562b884c3690 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.823+0000 7fd996ffd640 1 -- 172.21.15.192:0/4267005556 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab404b890 con 0x562b884c3690 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.823+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b885f0450 con 0x562b884c3690 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.823+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b885f0450 con 0x562b884c3690 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.824+0000 7fd996ffd640 1 -- 172.21.15.192:0/4267005556 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fdab401aae0 con 0x562b884c3690 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.824+0000 7fd996ffd640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd98c03c780 0x7fd98c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.824+0000 7fd996ffd640 1 -- 172.21.15.192:0/4267005556 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fdab406bc60 con 0x562b884c3690 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.824+0000 7fdabbfff640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd98c03c780 0x7fd98c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.824+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.824+0000 7fdabbfff640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd98c03c780 0x7fd98c03ec40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x562b885cc7d0 tx=0x7fdaac053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.824+0000 7fdac5320800 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562b885fb440 0x562b885fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.824+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b885fe050 con 0x562b885fb440 2024-09-10T05:11:52.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.824+0000 7fdac1869640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562b885fb440 0x562b885fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.825+0000 7fdac1869640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562b885fb440 0x562b885fd900 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.825+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.825+0000 7fdac5320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.825+0000 7fdac5320800 20 realm 2024-09-10T05:11:52.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.825+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.825+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b885fe460 con 0x562b885fb440 2024-09-10T05:11:52.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.825+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.825+0000 7fdac5320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.825+0000 7fdac5320800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:11:52.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.825+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.825+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b885fed30 con 0x562b885fb440 2024-09-10T05:11:52.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.825+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.826+0000 7fdac5320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.826+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.826+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885fb440 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.826+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.826+0000 7fdac5320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.826+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.826+0000 7fdac5320800 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562b885ffe30 0x562b88602220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.826+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b886027e0 con 0x562b885ffe30 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.826+0000 7fdac1068640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562b885ffe30 0x562b88602220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.827+0000 7fdac1068640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562b885ffe30 0x562b88602220 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.827+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.827+0000 7fdac5320800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.827+0000 7fdac5320800 20 searching for the correct realm 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.827+0000 7fdac5320800 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562b88604790 0x562b88606c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.827+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b88607320 con 0x562b88604790 2024-09-10T05:11:52.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.827+0000 7fdabbfff640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562b88604790 0x562b88606c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.827+0000 7fdabbfff640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562b88604790 0x562b88606c50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.827+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.827+0000 7fdabbfff640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fdaac05f040 0x7fdaac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:11:52.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.827+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b88607320 con 0x7fdaac05f040 2024-09-10T05:11:52.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.828+0000 7fdac1869640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fdaac05f040 0x7fdaac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:11:52.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.828+0000 7fdac1869640 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fdaac05f040 0x7fdaac06b410 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:11:52.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.828+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.828+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885ffe30 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.828+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.828+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885fb440 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.829+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.829+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885fb440 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.829+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.829+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885ffe30 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.829+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.829+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885ffe30 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.829+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.829+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x7fdaac05f040 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.829+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.829+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b88604790 2024-09-10T05:11:52.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.830+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.830+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885fb440 2024-09-10T05:11:52.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.830+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.830+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885ffe30 2024-09-10T05:11:52.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.830+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.830+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885fb440 2024-09-10T05:11:52.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.830+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.830+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x7fdaac05f040 2024-09-10T05:11:52.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.831+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.831+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b88604790 2024-09-10T05:11:52.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.831+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.831+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b88604790 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.831+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.831+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885ffe30 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.831+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.831+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b88604790 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.832+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.832+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b88604790 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.832+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.832+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885fb440 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.832+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.832+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885fb440 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.832+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.832+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885ffe30 2024-09-10T05:11:52.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.833+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.833+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b88604790 2024-09-10T05:11:52.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.833+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.833+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x7fdaac05f040 2024-09-10T05:11:52.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.833+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.833+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885fb440 2024-09-10T05:11:52.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.833+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.833+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885ffe30 2024-09-10T05:11:52.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.834+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.834+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b88604790 2024-09-10T05:11:52.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.834+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.834+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885ffe30 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.834+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.834+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x7fdaac05f040 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.834+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.834+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b88604790 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885ffe30 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x562b885fb440 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562b885ff0d0 con 0x7fdaac05f040 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac5320800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:11:52.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac5320800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac5320800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac5320800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac5320800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac5320800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.835+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b886030a0 con 0x562b885fb440 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b886030a0 con 0x562b885fb440 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:11:52.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b886030a0 con 0x7fdaac05f040 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 20 zone default found 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 4 Realm: () 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 20 zonegroup default 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b88603940 con 0x562b885ffe30 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.836+0000 7fdac5320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.837+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.837+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b88609190 con 0x562b88604790 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.837+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.837+0000 7fdac5320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.837+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.837+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b88609530 con 0x562b88604790 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.837+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.837+0000 7fdac5320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.837+0000 7fdac5320800 20 started sync module instance, tier type = 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.837+0000 7fdac5320800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.837+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b88608630 con 0x7fdaac05f040 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.838+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(44 notify.0 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.838+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94744971611008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b88608630 con 0x7fdaac05f040 2024-09-10T05:11:52.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.838+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b88609ef0 con 0x562b885fb440 2024-09-10T05:11:52.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.839+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.839+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94744971614784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860a350 con 0x562b885fb440 2024-09-10T05:11:52.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.839+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860ae40 con 0x562b88604790 2024-09-10T05:11:52.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.839+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94744971611008] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.840+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94744971614784] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.840+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.840+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94744971618576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b88609e60 con 0x562b88604790 2024-09-10T05:11:52.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.841+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860b850 con 0x7fdaac05f040 2024-09-10T05:11:52.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.841+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94744971618576] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.842+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(50 notify.3 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.842+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94744971621280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860bc70 con 0x7fdaac05f040 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.842+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860c500 con 0x562b885fb440 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.843+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.843+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94744971621280] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.843+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94744971623536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860c090 con 0x562b885fb440 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.843+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860cf40 con 0x562b885ffe30 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.844+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(54 notify.5 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.844+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94744971622336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860d7e0 con 0x562b885ffe30 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.844+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860e200 con 0x562b885ffe30 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.844+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94744971623536] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.844+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(56 notify.6 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94744971626736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860ea50 con 0x562b885ffe30 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860f410 con 0x562b885ffe30 2024-09-10T05:11:52.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94744971622336] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94744971626736] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(58 notify.7 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94744971634080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860e9c0 con 0x562b885ffe30 2024-09-10T05:11:52.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac5320800 20 add_watcher() i=0 2024-09-10T05:11:52.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac5320800 20 add_watcher() i=1 2024-09-10T05:11:52.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac5320800 20 add_watcher() i=2 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac5320800 20 add_watcher() i=3 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac5320800 20 add_watcher() i=4 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac5320800 20 add_watcher() i=5 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.845+0000 7fdac5320800 20 add_watcher() i=6 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.846+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94744971634080] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.846+0000 7fdac5320800 20 add_watcher() i=7 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.846+0000 7fdac5320800 2 all 8 watchers are set, enabling cache 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.847+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b88612440 con 0x562b885fb440 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.847+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.847+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94744971636576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8860f8a0 con 0x562b885fb440 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.848+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94744971636576] v35'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.848+0000 7fd9777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:52.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.848+0000 7fdac5320800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:11:52.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.848+0000 7fdac5320800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:11:52.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.848+0000 7fdac5320800 5 note: GC not initialized 2024-09-10T05:11:52.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.848+0000 7fd9767e4640 20 reqs_thread_entry: start 2024-09-10T05:11:52.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.849+0000 7fdac5320800 20 init_complete bucket index max shards: 11 2024-09-10T05:11:52.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.849+0000 7fdac5320800 20 Filter name: none 2024-09-10T05:11:52.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.849+0000 7fd8e7fff640 20 reqs_thread_entry: start 2024-09-10T05:11:52.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.849+0000 7fdac5320800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:11:52.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.849+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.849+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b88645350 con 0x562b885fb440 2024-09-10T05:11:52.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.849+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.849+0000 7fdac5320800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.849+0000 7fdac5320800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.849+0000 7fdac5320800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.849+0000 7fdac5320800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.849+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b88647c80 con 0x7fdaac05f040 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 20 enabling bucket name=myfoo 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b88645c60 con 0x7fdaac05f040 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:11:52.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 : miss 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 20 rados->read ofs=0 len=0 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:65 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b88648520 con 0x562b88604790 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(65 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.850+0000 7fdac5320800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.851+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 8.14 8:2cbe1686:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8864fe70 con 0x562b88604790 2024-09-10T05:11:52.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(66 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v35'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac5320800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac5320800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac5320800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac5320800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1, ofs0, ns] 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94744971900688 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b8864d350 con 0x7fdaac05f040 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== watch-notify(notify (1) cookie 94744971621280 notify 150323855380 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7fdabc045430 con 0x7fdaac05f040 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fd9a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855380 cookie 94744971621280 notifier 4609 bl.length()=760 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fd9a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 info.flags=0x17 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fd9a4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1 to cache LRU end 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fd9a4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(67 notify.3 [notify cookie 94744971900688 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fd9a4ff9640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd984003ea0 con 0x7fdaac05f040 2024-09-10T05:11:52.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== watch-notify(notify_complete (2) cookie 94744971900688 notify 150323855380 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdabc045600 con 0x7fdaac05f040 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac5320800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): orig_sources= new_sources= 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac5320800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): potential sources added=[] removed=[] 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac5320800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): orig_dests= new_dests= 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac5320800 20 handle_bi_update(): bucket=:myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.1]): potential dests added=[] removed=[] 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.852+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b8864f6f0 con 0x562b885fb440 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.853+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v35'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.854+0000 7fdac5320800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.854+0000 7fdac5320800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.854+0000 7fdac5320800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.854+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94744971852240 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562b886442a0 con 0x562b885fb440 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.854+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 94744971623536 notify 150323855375 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fdabc045600 con 0x562b885fb440 2024-09-10T05:11:52.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.854+0000 7fd997fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855375 cookie 94744971623536 notifier 4609 bl.length()=567 2024-09-10T05:11:52.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.854+0000 7fd997fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:11:52.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.854+0000 7fd997fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:11:52.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.854+0000 7fd997fff640 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd8f4003430 con 0x562b885fb440 2024-09-10T05:11:52.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.854+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(70 notify.4 [notify cookie 94744971852240 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.854+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== watch-notify(notify_complete (2) cookie 94744971852240 notify 150323855375 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdabc045d50 con 0x562b885fb440 2024-09-10T05:11:52.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.854+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.871 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:11:52.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.855+0000 7fd9777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:11:52.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.855+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94744971636576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b886431f0 con 0x562b885fb440 2024-09-10T05:11:52.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.856+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94744971636576] v35'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.856+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94744971611008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b886431f0 con 0x7fdaac05f040 2024-09-10T05:11:52.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.857+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94744971611008] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.857+0000 7fdac5320800 20 remove_watcher() i=0 2024-09-10T05:11:52.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.857+0000 7fdac5320800 2 removed watcher, disabling cache 2024-09-10T05:11:52.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.857+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94744971614784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b886431f0 con 0x562b885fb440 2024-09-10T05:11:52.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.858+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94744971614784] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.858+0000 7fdac5320800 20 remove_watcher() i=1 2024-09-10T05:11:52.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.858+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94744971618576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b886431f0 con 0x562b88604790 2024-09-10T05:11:52.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.859+0000 7fdabbfff640 1 -- 172.21.15.192:0/4267005556 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94744971618576] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdaac07c040 con 0x562b88604790 2024-09-10T05:11:52.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.859+0000 7fdac5320800 20 remove_watcher() i=2 2024-09-10T05:11:52.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.859+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94744971621280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b886431f0 con 0x7fdaac05f040 2024-09-10T05:11:52.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.860+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94744971621280] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x7fdaac05f040 2024-09-10T05:11:52.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.860+0000 7fdac5320800 20 remove_watcher() i=3 2024-09-10T05:11:52.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.860+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94744971623536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b886431f0 con 0x562b885fb440 2024-09-10T05:11:52.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.861+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94744971623536] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdabc00a4d0 con 0x562b885fb440 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.861+0000 7fdac5320800 20 remove_watcher() i=4 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.861+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94744971622336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b886431f0 con 0x562b885ffe30 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.862+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94744971622336] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.862+0000 7fdac5320800 20 remove_watcher() i=5 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.862+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94744971626736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b886431f0 con 0x562b885ffe30 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.863+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94744971626736] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.863+0000 7fdac5320800 20 remove_watcher() i=6 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.863+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94744971634080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562b886431f0 con 0x562b885ffe30 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.864+0000 7fdac1068640 1 -- 172.21.15.192:0/4267005556 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94744971634080] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdab4071070 con 0x562b885ffe30 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.864+0000 7fdac5320800 20 remove_watcher() i=7 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.864+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562b885ffe30 msgr2=0x562b88602220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.864+0000 7fdac5320800 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562b885ffe30 0x562b88602220 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.864+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562b885fb440 msgr2=0x562b885fd900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.864+0000 7fdac5320800 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562b885fb440 0x562b885fd900 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.864+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fdaac05f040 msgr2=0x7fdaac06b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.864+0000 7fdac5320800 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fdaac05f040 0x7fdaac06b410 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.864+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562b88604790 msgr2=0x562b88606c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.864+0000 7fdac5320800 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562b88604790 0x562b88606c50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd98c03c780 msgr2=0x7fd98c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd98c03c780 0x7fd98c03ec40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x562b885cc7d0 tx=0x7fdaac053000 comp rx=0 tx=0).stop 2024-09-10T05:11:52.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 msgr2=0x562b885efef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 --2- 172.21.15.192:0/4267005556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c3690 0x562b885efef0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdab4014390 tx=0x7fdab403a9e0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 reap_dead start 2024-09-10T05:11:52.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac1869640 1 -- 172.21.15.192:0/4267005556 reap_dead start 2024-09-10T05:11:52.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 shutdown_connections 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 >> 172.21.15.192:0/4267005556 conn(0x562b885e2c20 msgr2=0x562b885e0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 shutdown_connections 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/4267005556 wait complete. 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/1368759774 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd99803c6e0 msgr2=0x7fd99803eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 --2- 172.21.15.192:0/1368759774 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd99803c6e0 0x7fd99803eba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdaac000c00 tx=0x7fdaac005a00 comp rx=0 tx=0).stop 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/1368759774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b885da000 msgr2=0x562b885da420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 --2- 172.21.15.192:0/1368759774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b885da000 0x562b885da420 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdab400e660 tx=0x7fdab4018e20 comp rx=0 tx=0).stop 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/1368759774 shutdown_connections 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 --2- 172.21.15.192:0/1368759774 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd99803c6e0 0x7fd99803eba0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 --2- 172.21.15.192:0/1368759774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b885da000 0x562b885da420 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/1368759774 >> 172.21.15.192:0/1368759774 conn(0x562b885ce360 msgr2=0x562b885ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/1368759774 shutdown_connections 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/1368759774 wait complete. 2024-09-10T05:11:52.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562b885c5800 msgr2=0x562b885c7c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.865+0000 7fdac5320800 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562b885c5800 0x562b885c7c80 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562b884c9200 msgr2=0x562b885c3420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac5320800 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562b884c9200 0x562b885c3420 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562b885c9870 msgr2=0x562b885cbc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac5320800 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562b885c9870 0x562b885cbc60 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd9a803c920 msgr2=0x7fd9a803ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac5320800 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fd9a803c920 0x7fd9a803ede0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdaac057000 tx=0x7fdaac052000 comp rx=0 tx=0).stop 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 msgr2=0x562b885bbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac5320800 1 --2- 172.21.15.192:0/4110097222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b884c5690 0x562b885bbdd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdab40012f0 tx=0x7fdab4000ed0 comp rx=0 tx=0).stop 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac1869640 1 -- 172.21.15.192:0/4110097222 reap_dead start 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 shutdown_connections 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 >> 172.21.15.192:0/4110097222 conn(0x562b884bf1f0 msgr2=0x562b885b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 shutdown_connections 2024-09-10T05:11:52.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:11:52.866+0000 7fdac5320800 1 -- 172.21.15.192:0/4110097222 wait complete. 2024-09-10T05:11:52.883 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:11:52.891 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T05:11:53.160 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-10T05:11:53.172 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:08.173 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-10T05:12:08.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-10T05:12:08.174 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-10T05:12:08.225 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:08.225 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:08.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.225+0000 7f76fb098800 1 Processor -- start 2024-09-10T05:12:08.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.225+0000 7f76fb098800 1 -- start start 2024-09-10T05:12:08.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.225+0000 7f76fb098800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5633c108e690 0x5633c1090a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.225+0000 7f76fb098800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5633c0f37e40 con 0x5633c1091020 2024-09-10T05:12:08.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.225+0000 7f76fb098800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5633c0f02680 con 0x5633c108e690 2024-09-10T05:12:08.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.226+0000 7f76f8b82640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5633c108e690 0x5633c1090a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.226+0000 7f76f8381640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5633c1091020 0x5633c10934c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:33662/0 (socket says 172.21.15.192:33662) 2024-09-10T05:12:08.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.226+0000 7f76f8381640 1 -- 172.21.15.192:0/2616187788 learned_addr learned my addr 172.21.15.192:0/2616187788 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:08.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.226+0000 7f76f8b82640 1 -- 172.21.15.192:0/2616187788 >> v1:172.21.15.139:6789/0 conn(0x5633c1091020 legacy=0x5633c10934c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.226+0000 7f76f7b80640 1 -- 172.21.15.192:0/2616187788 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373282845 0 0) 0x5633c0f37e40 con 0x5633c1091020 2024-09-10T05:12:08.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.226+0000 7f76f8b82640 1 -- 172.21.15.192:0/2616187788 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633c0f1e6b0 con 0x5633c108e690 2024-09-10T05:12:08.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.228+0000 7f76f8b82640 1 --2- 172.21.15.192:0/2616187788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c1090a80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f76e8005fd0 tx=0x7f76e8045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ad6d61af1b3afd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.228+0000 7f76f7b80640 1 -- 172.21.15.192:0/2616187788 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e8058530 con 0x5633c108e690 2024-09-10T05:12:08.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.228+0000 7f76f7b80640 1 -- 172.21.15.192:0/2616187788 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e80586d0 con 0x5633c108e690 2024-09-10T05:12:08.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.228+0000 7f76f7b80640 1 -- 172.21.15.192:0/2616187788 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e80589d0 con 0x5633c108e690 2024-09-10T05:12:08.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.229+0000 7f76fb098800 1 -- 172.21.15.192:0/2616187788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 msgr2=0x5633c1090a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.229+0000 7f76fb098800 1 --2- 172.21.15.192:0/2616187788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c1090a80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f76e8005fd0 tx=0x7f76e8045c30 comp rx=0 tx=0).stop 2024-09-10T05:12:08.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.229+0000 7f76fb098800 1 -- 172.21.15.192:0/2616187788 shutdown_connections 2024-09-10T05:12:08.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.229+0000 7f76fb098800 1 --2- 172.21.15.192:0/2616187788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c1090a80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.229+0000 7f76fb098800 1 -- 172.21.15.192:0/2616187788 >> 172.21.15.192:0/2616187788 conn(0x5633c10881b0 msgr2=0x5633c108a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.229+0000 7f76fb098800 1 -- 172.21.15.192:0/2616187788 shutdown_connections 2024-09-10T05:12:08.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.229+0000 7f76fb098800 1 -- 172.21.15.192:0/2616187788 wait complete. 2024-09-10T05:12:08.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.244+0000 7f76fb098800 1 Processor -- start 2024-09-10T05:12:08.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.245+0000 7f76fb098800 1 -- start start 2024-09-10T05:12:08.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.245+0000 7f76fb098800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c117d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.245+0000 7f76fb098800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5633c0f26dd0 con 0x5633c108e690 2024-09-10T05:12:08.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.245+0000 7f76f8b82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c117d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.245+0000 7f76f8b82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c117d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60282/0 (socket says 172.21.15.192:60282) 2024-09-10T05:12:08.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.245+0000 7f76f8b82640 1 -- 172.21.15.192:0/641409054 learned_addr learned my addr 172.21.15.192:0/641409054 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.245+0000 7f76f8b82640 1 -- 172.21.15.192:0/641409054 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633c0f3fe10 con 0x5633c108e690 2024-09-10T05:12:08.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.246+0000 7f76f8b82640 1 --2- 172.21.15.192:0/641409054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c117d4f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f76e8025a60 tx=0x7f76e8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0430a4f41ab7211 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.246+0000 7f75e6e0d640 1 -- 172.21.15.192:0/641409054 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e8068070 con 0x5633c108e690 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.246+0000 7f75e6e0d640 1 -- 172.21.15.192:0/641409054 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e8058880 con 0x5633c108e690 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.246+0000 7f75e6e0d640 1 -- 172.21.15.192:0/641409054 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e8058ba0 con 0x5633c108e690 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.247+0000 7f76fb098800 1 -- 172.21.15.192:0/641409054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 msgr2=0x5633c117d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.247+0000 7f76fb098800 1 --2- 172.21.15.192:0/641409054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c117d4f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f76e8025a60 tx=0x7f76e8051000 comp rx=0 tx=0).stop 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.247+0000 7f76fb098800 1 -- 172.21.15.192:0/641409054 shutdown_connections 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.247+0000 7f76fb098800 1 --2- 172.21.15.192:0/641409054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c117d4f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.247+0000 7f76fb098800 1 -- 172.21.15.192:0/641409054 >> 172.21.15.192:0/641409054 conn(0x5633c10881b0 msgr2=0x5633c1178e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.247+0000 7f76fb098800 1 -- 172.21.15.192:0/641409054 shutdown_connections 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.247+0000 7f76fb098800 1 -- 172.21.15.192:0/641409054 wait complete. 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.247+0000 7f76fb098800 1 Processor -- start 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.247+0000 7f76fb098800 1 -- start start 2024-09-10T05:12:08.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.247+0000 7f76fb098800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c1184d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.247+0000 7f76fb098800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5633c1095020 con 0x5633c108e690 2024-09-10T05:12:08.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.248+0000 7f76f8b82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c1184d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.248+0000 7f76f8b82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c1184d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60298/0 (socket says 172.21.15.192:60298) 2024-09-10T05:12:08.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.248+0000 7f76f8b82640 1 -- 172.21.15.192:0/1325521850 learned_addr learned my addr 172.21.15.192:0/1325521850 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.248+0000 7f76f8b82640 1 -- 172.21.15.192:0/1325521850 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633c11852e0 con 0x5633c108e690 2024-09-10T05:12:08.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.248+0000 7f76f8b82640 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c1184d80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f76e8025a60 tx=0x7f76e8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.248+0000 7f75e560a640 1 -- 172.21.15.192:0/1325521850 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e8068040 con 0x5633c108e690 2024-09-10T05:12:08.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.248+0000 7f75e560a640 1 -- 172.21.15.192:0/1325521850 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e8071070 con 0x5633c108e690 2024-09-10T05:12:08.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.248+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633c1185570 con 0x5633c108e690 2024-09-10T05:12:08.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.248+0000 7f75e560a640 1 -- 172.21.15.192:0/1325521850 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e80637b0 con 0x5633c108e690 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.248+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633c1185ef0 con 0x5633c108e690 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.249+0000 7f75e560a640 1 -- 172.21.15.192:0/1325521850 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f76e8063950 con 0x5633c108e690 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.249+0000 7f75e560a640 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75e003c780 0x7f75e003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.250+0000 7f75e560a640 1 -- 172.21.15.192:0/1325521850 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f76e8097460 con 0x5633c108e690 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.250+0000 7f76f8381640 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75e003c780 0x7f75e003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.250+0000 7f76fb098800 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5633c1091020 0x5633c118c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.250+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c118c910 con 0x5633c1091020 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.250+0000 7f76f9383640 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5633c1091020 0x5633c118c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.250+0000 7f76f8381640 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75e003c780 0x7f75e003ec40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76ec000c00 tx=0x7f76ec0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.250+0000 7f76f9383640 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5633c1091020 0x5633c118c3d0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.251+0000 7f76f9383640 1 -- 172.21.15.192:0/1325521850 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f76f00083e0 con 0x5633c1091020 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.251+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c118ccb0 con 0x5633c1091020 2024-09-10T05:12:08.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.251+0000 7f76f9383640 1 -- 172.21.15.192:0/1325521850 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f76f00083e0 con 0x5633c1091020 2024-09-10T05:12:08.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.251+0000 7f76fb098800 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5633c118e730 0x5633c1190ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.251+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c1191330 con 0x5633c118e730 2024-09-10T05:12:08.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.251+0000 7f76f8b82640 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5633c118e730 0x5633c1190ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.252+0000 7f76f8b82640 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5633c118e730 0x5633c1190ba0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.252+0000 7f76f8b82640 1 -- 172.21.15.192:0/1325521850 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c118e730 2024-09-10T05:12:08.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.252+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c118d500 con 0x5633c1091020 2024-09-10T05:12:08.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.252+0000 7f76f9383640 1 -- 172.21.15.192:0/1325521850 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f76f00083e0 con 0x5633c1091020 2024-09-10T05:12:08.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.252+0000 7f76fb098800 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5633c1192790 0x5633c1194b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.252+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11952f0 con 0x5633c1192790 2024-09-10T05:12:08.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.252+0000 7f76f8381640 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5633c1192790 0x5633c1194b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.253+0000 7f76f8381640 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5633c1192790 0x5633c1194b80 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.253+0000 7f76f8381640 1 -- 172.21.15.192:0/1325521850 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f76ec00f670 con 0x5633c1192790 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.253+0000 7f76fb098800 1 Processor -- start 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.254+0000 7f76fb098800 1 -- start start 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.254+0000 7f76fb098800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11a2f30 0x5633c11a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.254+0000 7f76fb098800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5633c0f84a00 con 0x5633c11a2f30 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.254+0000 7f76f8b82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11a2f30 0x5633c11a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.254+0000 7f76f8b82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11a2f30 0x5633c11a3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60312/0 (socket says 172.21.15.192:60312) 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.254+0000 7f76f8b82640 1 -- 172.21.15.192:0/74294056 learned_addr learned my addr 172.21.15.192:0/74294056 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.254+0000 7f76f8b82640 1 -- 172.21.15.192:0/74294056 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633c11a3990 con 0x5633c11a2f30 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.254+0000 7f76f8b82640 1 --2- 172.21.15.192:0/74294056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11a2f30 0x5633c11a3350 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f76e8095860 tx=0x7f76e806b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.255+0000 7f75de7fc640 1 -- 172.21.15.192:0/74294056 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e8063e00 con 0x5633c11a2f30 2024-09-10T05:12:08.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.255+0000 7f75de7fc640 1 -- 172.21.15.192:0/74294056 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e8086070 con 0x5633c11a2f30 2024-09-10T05:12:08.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.255+0000 7f76fb098800 1 -- 172.21.15.192:0/74294056 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633c11a41c0 con 0x5633c11a2f30 2024-09-10T05:12:08.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.255+0000 7f75de7fc640 1 -- 172.21.15.192:0/74294056 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e806b760 con 0x5633c11a2f30 2024-09-10T05:12:08.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.255+0000 7f76fb098800 1 -- 172.21.15.192:0/74294056 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633c11a4760 con 0x5633c11a2f30 2024-09-10T05:12:08.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.255+0000 7f75de7fc640 1 -- 172.21.15.192:0/74294056 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f76e8088030 con 0x5633c11a2f30 2024-09-10T05:12:08.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.256+0000 7f75de7fc640 1 --2- 172.21.15.192:0/74294056 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75d003c780 0x7f75d003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.256+0000 7f75de7fc640 1 -- 172.21.15.192:0/74294056 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f76e808bd20 con 0x5633c11a2f30 2024-09-10T05:12:08.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.256+0000 7f76f8381640 1 --2- 172.21.15.192:0/74294056 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75d003c780 0x7f75d003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.256+0000 7f76fb098800 1 Processor -- start 2024-09-10T05:12:08.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.256+0000 7f76fb098800 1 -- start start 2024-09-10T05:12:08.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.256+0000 7f76f8381640 1 --2- 172.21.15.192:0/74294056 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75d003c780 0x7f75d003ec40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5633c11916d0 tx=0x7f76ec006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.256+0000 7f76fb098800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 0x5633c11afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.256+0000 7f76fb098800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5633c117dc80 con 0x5633c11af810 2024-09-10T05:12:08.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.257+0000 7f76f8b82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 0x5633c11afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.257+0000 7f76f8b82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 0x5633c11afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60314/0 (socket says 172.21.15.192:60314) 2024-09-10T05:12:08.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.257+0000 7f76f8b82640 1 -- 172.21.15.192:0/2787834615 learned_addr learned my addr 172.21.15.192:0/2787834615 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.257+0000 7f76f8b82640 1 -- 172.21.15.192:0/2787834615 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633c11b01e0 con 0x5633c11af810 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.257+0000 7f76f8b82640 1 --2- 172.21.15.192:0/2787834615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 0x5633c11afbf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f76e8008030 tx=0x7f76e808e7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3043a54292b4f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.257+0000 7f75cffff640 1 -- 172.21.15.192:0/2787834615 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e806e480 con 0x5633c11af810 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.257+0000 7f75cffff640 1 -- 172.21.15.192:0/2787834615 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e8075cc0 con 0x5633c11af810 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.257+0000 7f75cffff640 1 -- 172.21.15.192:0/2787834615 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e808c080 con 0x5633c11af810 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76fb098800 1 -- 172.21.15.192:0/2787834615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 msgr2=0x5633c11afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76fb098800 1 --2- 172.21.15.192:0/2787834615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 0x5633c11afbf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f76e8008030 tx=0x7f76e808e7a0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76fb098800 1 -- 172.21.15.192:0/2787834615 shutdown_connections 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76fb098800 1 --2- 172.21.15.192:0/2787834615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 0x5633c11afbf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76fb098800 1 -- 172.21.15.192:0/2787834615 >> 172.21.15.192:0/2787834615 conn(0x5633c11abc10 msgr2=0x5633c11a9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76fb098800 1 -- 172.21.15.192:0/2787834615 shutdown_connections 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76fb098800 1 -- 172.21.15.192:0/2787834615 wait complete. 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76fb098800 1 Processor -- start 2024-09-10T05:12:08.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76fb098800 1 -- start start 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76fb098800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 0x5633c11b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76fb098800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5633c11b0670 con 0x5633c11af810 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76f8b82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 0x5633c11b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76f8b82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 0x5633c11b6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60316/0 (socket says 172.21.15.192:60316) 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.258+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 learned_addr learned my addr 172.21.15.192:0/2586223484 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.259+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633c11b7180 con 0x5633c11af810 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.259+0000 7f76f8b82640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 0x5633c11b6c20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f76e806b6f0 tx=0x7f76e8078ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.259+0000 7f75ce7fc640 1 -- 172.21.15.192:0/2586223484 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e8065070 con 0x5633c11af810 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.259+0000 7f75ce7fc640 1 -- 172.21.15.192:0/2586223484 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e80755e0 con 0x5633c11af810 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.259+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633c11b7180 con 0x5633c11af810 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.259+0000 7f75ce7fc640 1 -- 172.21.15.192:0/2586223484 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e8065760 con 0x5633c11af810 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.259+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633c11b7780 con 0x5633c11af810 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.260+0000 7f75ce7fc640 1 -- 172.21.15.192:0/2586223484 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f76e80ba030 con 0x5633c11af810 2024-09-10T05:12:08.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.260+0000 7f75ce7fc640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75c403c780 0x7f75c403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.260+0000 7f75ce7fc640 1 -- 172.21.15.192:0/2586223484 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f76e80b8070 con 0x5633c11af810 2024-09-10T05:12:08.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.261+0000 7f76fb098800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.261+0000 7f76f8381640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75c403c780 0x7f75c403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.261+0000 7f76fb098800 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5633c11c21b0 0x5633c11c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.261+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c4d50 con 0x5633c11c21b0 2024-09-10T05:12:08.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.261+0000 7f76f9383640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5633c11c21b0 0x5633c11c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.261+0000 7f76f8381640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75c403c780 0x7f75c403ec40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00ffd0 tx=0x7f76ec023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.261+0000 7f76f9383640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5633c11c21b0 0x5633c11c4600 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.261+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f76f00083e0 con 0x5633c11c21b0 2024-09-10T05:12:08.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.261+0000 7f76fb098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.261+0000 7f76fb098800 20 realm 2024-09-10T05:12:08.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.261+0000 7f76fb098800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.261+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5160 con 0x5633c11c21b0 2024-09-10T05:12:08.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f76f00083e0 con 0x5633c11c21b0 2024-09-10T05:12:08.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76fb098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76fb098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:08.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76fb098800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c21b0 2024-09-10T05:12:08.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f76f00083e0 con 0x5633c11c21b0 2024-09-10T05:12:08.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76fb098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76fb098800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5dd0 con 0x5633c11c21b0 2024-09-10T05:12:08.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f76f00083e0 con 0x5633c11c21b0 2024-09-10T05:12:08.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76fb098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:08.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76fb098800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76fb098800 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5633c11c6520 0x5633c11c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c9080 con 0x5633c11c6520 2024-09-10T05:12:08.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.262+0000 7f76f8b82640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5633c11c6520 0x5633c11c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.263+0000 7f76f8b82640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5633c11c6520 0x5633c11c8910 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.263+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.263+0000 7f76fb098800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.263+0000 7f76fb098800 20 searching for the correct realm 2024-09-10T05:12:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.263+0000 7f76fb098800 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5633c11cb170 0x5633c11cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.263+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11cdd00 con 0x5633c11cb170 2024-09-10T05:12:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.263+0000 7f76f8381640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5633c11cb170 0x5633c11cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.264+0000 7f76f8381640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5633c11cb170 0x5633c11cd630 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.264+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.264+0000 7f76f8381640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f76ec02e910 0x7f76ec03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.264+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11cdd00 con 0x7f76ec02e910 2024-09-10T05:12:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.264+0000 7f76f9383640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f76ec02e910 0x7f76ec03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.264+0000 7f76f9383640 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f76ec02e910 0x7f76ec03a3c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.265+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f76f00083e0 con 0x7f76ec02e910 2024-09-10T05:12:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.265+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c6520 2024-09-10T05:12:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.265+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.265+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c21b0 2024-09-10T05:12:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.265+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76f00083e0 con 0x5633c11c21b0 2024-09-10T05:12:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.265+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c21b0 2024-09-10T05:12:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.265+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76f0026040 con 0x5633c11c21b0 2024-09-10T05:12:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.265+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c6520 2024-09-10T05:12:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.266+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.266+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c6520 2024-09-10T05:12:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.266+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.266+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x7f76ec02e910 2024-09-10T05:12:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.266+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76f0026040 con 0x7f76ec02e910 2024-09-10T05:12:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.266+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11cb170 2024-09-10T05:12:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.267+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.267+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c21b0 2024-09-10T05:12:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.267+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76f0026040 con 0x5633c11c21b0 2024-09-10T05:12:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.267+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c6520 2024-09-10T05:12:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.267+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.267+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c21b0 2024-09-10T05:12:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.267+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76f0026040 con 0x5633c11c21b0 2024-09-10T05:12:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.267+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x7f76ec02e910 2024-09-10T05:12:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.268+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f76f0026040 con 0x7f76ec02e910 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.268+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11cb170 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.268+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.268+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11cb170 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.268+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.268+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c6520 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.269+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.269+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11cb170 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.269+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.269+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11cb170 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.269+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.269+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c21b0 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.269+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76f0026040 con 0x5633c11c21b0 2024-09-10T05:12:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.269+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c21b0 2024-09-10T05:12:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.269+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f76f0026040 con 0x5633c11c21b0 2024-09-10T05:12:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.269+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x7f76ec02e910 2024-09-10T05:12:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.270+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76f0026040 con 0x7f76ec02e910 2024-09-10T05:12:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.270+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11cb170 2024-09-10T05:12:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.270+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.270+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x7f76ec02e910 2024-09-10T05:12:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.270+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76f0026040 con 0x7f76ec02e910 2024-09-10T05:12:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.270+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c21b0 2024-09-10T05:12:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.270+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.270+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c6520 2024-09-10T05:12:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.271+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.271+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11cb170 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.271+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.271+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11c6520 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.271+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.271+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x7f76ec02e910 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.272+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.272+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x5633c11cb170 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.272+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.272+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a30 con 0x7f76ec02e910 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.272+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.272+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f76f003a040 con 0x5633c11c21b0 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.272+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.272+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f76f003a040 con 0x7f76ec02e910 2024-09-10T05:12:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a10 con 0x5633c11c21b0 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a10 con 0x5633c11c21b0 2024-09-10T05:12:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.273+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c5a10 con 0x7f76ec02e910 2024-09-10T05:12:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 20 zone default found 2024-09-10T05:12:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 4 Realm: () 2024-09-10T05:12:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 20 zonegroup default 2024-09-10T05:12:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11c9a00 con 0x5633c11c6520 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11cf290 con 0x5633c11cb170 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11cfb30 con 0x5633c11cb170 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 20 started sync module instance, tier type = 2024-09-10T05:12:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.274+0000 7f76fb098800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:08.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.275+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11ce630 con 0x7f76ec02e910 2024-09-10T05:12:08.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.276+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.276+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94780283218512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11ce630 con 0x7f76ec02e910 2024-09-10T05:12:08.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.276+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d0380 con 0x5633c11c21b0 2024-09-10T05:12:08.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.277+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94780283218512] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.277+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.277+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94780283216736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d0380 con 0x5633c11c21b0 2024-09-10T05:12:08.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.277+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d0da0 con 0x5633c11cb170 2024-09-10T05:12:08.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.278+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94780283216736] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.279+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.279+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94780283223760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d02f0 con 0x5633c11cb170 2024-09-10T05:12:08.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.279+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d1c60 con 0x7f76ec02e910 2024-09-10T05:12:08.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.280+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94780283223760] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.280+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.280+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94780283230128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d2080 con 0x7f76ec02e910 2024-09-10T05:12:08.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.280+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d2a40 con 0x5633c11c21b0 2024-09-10T05:12:08.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.281+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94780283230128] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.281+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.281+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94780283231664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d2a40 con 0x5633c11c21b0 2024-09-10T05:12:08.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.281+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d3400 con 0x5633c11c6520 2024-09-10T05:12:08.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.282+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.282+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94780283236176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d3ca0 con 0x5633c11c6520 2024-09-10T05:12:08.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.282+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d4720 con 0x5633c11c6520 2024-09-10T05:12:08.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.283+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94780283231664] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.283+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94780283236176] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.284+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.284+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94780283240976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d4b40 con 0x5633c11c6520 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.284+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d5390 con 0x5633c11c6520 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.285+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(58 notify.7 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.285+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94780283244800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d5b70 con 0x5633c11c6520 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.285+0000 7f76fb098800 20 add_watcher() i=0 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.285+0000 7f76fb098800 20 add_watcher() i=1 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.285+0000 7f76fb098800 20 add_watcher() i=2 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.285+0000 7f76fb098800 20 add_watcher() i=3 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.285+0000 7f76fb098800 20 add_watcher() i=4 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.285+0000 7f76fb098800 20 add_watcher() i=5 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.286+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94780283244800] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.286+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94780283240976] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.286+0000 7f76fb098800 20 add_watcher() i=6 2024-09-10T05:12:08.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.286+0000 7f76fb098800 20 add_watcher() i=7 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.286+0000 7f76fb098800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.286+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d5600 con 0x5633c11c21b0 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.286+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.286+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94780283233680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11d55c0 con 0x5633c11c21b0 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.287+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94780283233680] v37'159 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.288+0000 7f75aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.288+0000 7f76fb098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.288+0000 7f76fb098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.288+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11daf70 con 0x5633c11c21b0 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.289+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'48 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.289+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e16f0 con 0x5633c11c6520 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.290+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.290+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e16f0 con 0x5633c11cb170 2024-09-10T05:12:08.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.291+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.291+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e1f40 con 0x5633c11c21b0 2024-09-10T05:12:08.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.292+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'160 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.292+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e24b0 con 0x7f76ec02e910 2024-09-10T05:12:08.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.293+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'50 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.293+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e2960 con 0x5633c11cb170 2024-09-10T05:12:08.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.294+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'41 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.294+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3380 con 0x5633c11c21b0 2024-09-10T05:12:08.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.295+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.295+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3380 con 0x5633c11c6520 2024-09-10T05:12:08.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.297+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'35 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.297+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3380 con 0x7f76ec02e910 2024-09-10T05:12:08.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.298+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.298+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3380 con 0x5633c11cb170 2024-09-10T05:12:08.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.299+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.299+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e38f0 con 0x7f76ec02e910 2024-09-10T05:12:08.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.300+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'51 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.300+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e38f0 con 0x5633c11c6520 2024-09-10T05:12:08.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.302+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.302+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e38f0 con 0x7f76ec02e910 2024-09-10T05:12:08.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.303+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.303+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e38f0 con 0x5633c11c6520 2024-09-10T05:12:08.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.304+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'47 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.304+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e38f0 con 0x5633c11c21b0 2024-09-10T05:12:08.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.305+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'161 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.305+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e38f0 con 0x5633c11cb170 2024-09-10T05:12:08.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.307+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'47 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.307+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x7f76ec02e910 2024-09-10T05:12:08.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.308+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'52 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.308+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11cb170 2024-09-10T05:12:08.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.309+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.309+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11c21b0 2024-09-10T05:12:08.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.310+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.310+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11c21b0 2024-09-10T05:12:08.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.311+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'162 uv158 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.311+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11cb170 2024-09-10T05:12:08.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.312+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.312+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x7f76ec02e910 2024-09-10T05:12:08.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.313+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.313+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11cb170 2024-09-10T05:12:08.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.314+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.314+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11cb170 2024-09-10T05:12:08.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.315+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.315+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11cb170 2024-09-10T05:12:08.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.316+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.316+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11cb170 2024-09-10T05:12:08.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.317+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'42 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.317+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11c6520 2024-09-10T05:12:08.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.318+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.318+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11cb170 2024-09-10T05:12:08.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.319+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.319+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11c6520 2024-09-10T05:12:08.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.321+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'36 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.321+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11cb170 2024-09-10T05:12:08.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.322+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.322+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x5633c11c6520 2024-09-10T05:12:08.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.323+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'48 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.323+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11e3bd0 con 0x7f76ec02e910 2024-09-10T05:12:08.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.324+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.324+0000 7f75adfe3640 20 reqs_thread_entry: start 2024-09-10T05:12:08.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.324+0000 7f76fb098800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:08.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.324+0000 7f76fb098800 20 Filter name: none 2024-09-10T05:12:08.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.324+0000 7f751f7fe640 20 reqs_thread_entry: start 2024-09-10T05:12:08.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.325+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c21b0 2024-09-10T05:12:08.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.325+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.325+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c21b0 2024-09-10T05:12:08.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.325+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.325+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c21b0 2024-09-10T05:12:08.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.325+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.325+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c6520 2024-09-10T05:12:08.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.326+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.326+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c6520 2024-09-10T05:12:08.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.326+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.326+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c6520 2024-09-10T05:12:08.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.327+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.327+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11cb170 2024-09-10T05:12:08.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.327+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.327+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11cb170 2024-09-10T05:12:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.328+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.328+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11cb170 2024-09-10T05:12:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.328+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.328+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c21b0 2024-09-10T05:12:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.328+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv19 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.328+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c21b0 2024-09-10T05:12:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.328+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv19 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.328+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c21b0 2024-09-10T05:12:08.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.329+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv19 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.329+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x7f76ec02e910 2024-09-10T05:12:08.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.329+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv17 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.329+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x7f76ec02e910 2024-09-10T05:12:08.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.329+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv17 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.329+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x7f76ec02e910 2024-09-10T05:12:08.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.329+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv17 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.329+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11cb170 2024-09-10T05:12:08.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.330+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.330+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11cb170 2024-09-10T05:12:08.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.330+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.330+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11cb170 2024-09-10T05:12:08.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.330+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.330+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c21b0 2024-09-10T05:12:08.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.330+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.330+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c21b0 2024-09-10T05:12:08.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.331+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.331+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c21b0 2024-09-10T05:12:08.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.331+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76f0035040 con 0x5633c11c21b0 2024-09-10T05:12:08.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.331+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c6520 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.331+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv14 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.331+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c6520 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.332+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv14 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.332+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c6520 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.332+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv14 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.332+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x7f76ec02e910 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.332+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76f0035040 con 0x7f76ec02e910 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.333+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x7f76ec02e910 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.333+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.333+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x7f76ec02e910 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.333+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.333+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11cb170 2024-09-10T05:12:08.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.333+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.333+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11cb170 2024-09-10T05:12:08.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.333+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.334+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11cb170 2024-09-10T05:12:08.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.334+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.334+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x7f76ec02e910 2024-09-10T05:12:08.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.334+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.334+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x7f76ec02e910 2024-09-10T05:12:08.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.334+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv19 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.334+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x7f76ec02e910 2024-09-10T05:12:08.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.335+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.335+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c6520 2024-09-10T05:12:08.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.335+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.335+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c6520 2024-09-10T05:12:08.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.335+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.335+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c6520 2024-09-10T05:12:08.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.336+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.336+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x7f76ec02e910 2024-09-10T05:12:08.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.336+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.336+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x7f76ec02e910 2024-09-10T05:12:08.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.336+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.336+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x7f76ec02e910 2024-09-10T05:12:08.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.336+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.336+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c6520 2024-09-10T05:12:08.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.337+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.337+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c6520 2024-09-10T05:12:08.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.337+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.337+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c6520 2024-09-10T05:12:08.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.338+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.338+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c21b0 2024-09-10T05:12:08.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.338+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x5633c11c21b0 2024-09-10T05:12:08.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.338+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c21b0 2024-09-10T05:12:08.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.338+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76f004f040 con 0x5633c11c21b0 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.338+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c21b0 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.339+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x5633c11c21b0 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.339+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11cb170 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.339+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.339+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11cb170 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.339+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.339+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11cb170 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.339+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.339+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x7f76ec02e910 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.340+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.340+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x7f76ec02e910 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.340+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.340+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x7f76ec02e910 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.340+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.340+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11cb170 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.340+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.340+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11cb170 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.341+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.341+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11cb170 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.341+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.341+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c21b0 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.341+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x5633c11c21b0 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.341+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c21b0 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.341+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76f004f040 con 0x5633c11c21b0 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.341+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c21b0 2024-09-10T05:12:08.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.342+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x5633c11c21b0 2024-09-10T05:12:08.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.342+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c21b0 2024-09-10T05:12:08.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.342+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv158 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x5633c11c21b0 2024-09-10T05:12:08.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.342+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120dff0 con 0x5633c11c21b0 2024-09-10T05:12:08.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.342+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv158 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76f004f040 con 0x5633c11c21b0 2024-09-10T05:12:08.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.342+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120f000 con 0x5633c11c21b0 2024-09-10T05:12:08.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.342+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 44 ==== osd_op_reply(153 gc.19 [call out=1702b] v0'0 uv158 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f76f004f040 con 0x5633c11c21b0 2024-09-10T05:12:08.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.342+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.343+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.343+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120efc0 con 0x5633c11cb170 2024-09-10T05:12:08.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.343+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.343+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.343+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec037040 con 0x5633c11cb170 2024-09-10T05:12:08.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.343+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x7f76ec02e910 2024-09-10T05:12:08.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.343+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.343+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120efc0 con 0x7f76ec02e910 2024-09-10T05:12:08.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.344+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.344+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x7f76ec02e910 2024-09-10T05:12:08.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.344+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.344+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.344+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.344+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120efc0 con 0x5633c11cb170 2024-09-10T05:12:08.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.344+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.344+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.345+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.345+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.345+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.345+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120efc0 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.345+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.345+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.345+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.345+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.345+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.345+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120efc0 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.346+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.346+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.346+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.346+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.346+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.346+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120efc0 con 0x5633c11cb170 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.346+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.346+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.347+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.347+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11c6520 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.347+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.347+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120efc0 con 0x5633c11c6520 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.348+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.348+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11c6520 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.348+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.348+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.348+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.348+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120efc0 con 0x5633c11cb170 2024-09-10T05:12:08.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.349+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.349+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.349+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.349+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11c6520 2024-09-10T05:12:08.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.350+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.350+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120efc0 con 0x5633c11c6520 2024-09-10T05:12:08.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.350+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.350+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11c6520 2024-09-10T05:12:08.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.350+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.350+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.351+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.351+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120efc0 con 0x5633c11cb170 2024-09-10T05:12:08.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.351+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.351+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11cb170 2024-09-10T05:12:08.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.351+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.351+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11c6520 2024-09-10T05:12:08.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.352+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.352+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120efc0 con 0x5633c11c6520 2024-09-10T05:12:08.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.352+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.352+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x5633c11c6520 2024-09-10T05:12:08.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.352+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.352+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x7f76ec02e910 2024-09-10T05:12:08.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.353+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.353+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120efc0 con 0x7f76ec02e910 2024-09-10T05:12:08.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.353+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.353+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633c120ffd0 con 0x7f76ec02e910 2024-09-10T05:12:08.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.353+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.354+0000 7f75aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:08.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.354+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94780283233680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c11db8c0 con 0x5633c11c21b0 2024-09-10T05:12:08.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.355+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94780283233680] v37'163 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f76f004f040 con 0x5633c11c21b0 2024-09-10T05:12:08.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.355+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94780283218512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c120cf90 con 0x7f76ec02e910 2024-09-10T05:12:08.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.356+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94780283218512] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.356+0000 7f76fb098800 20 remove_watcher() i=0 2024-09-10T05:12:08.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.356+0000 7f76fb098800 2 removed watcher, disabling cache 2024-09-10T05:12:08.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.356+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94780283216736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c120cf90 con 0x5633c11c21b0 2024-09-10T05:12:08.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.357+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94780283216736] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76f004f040 con 0x5633c11c21b0 2024-09-10T05:12:08.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.357+0000 7f76fb098800 20 remove_watcher() i=1 2024-09-10T05:12:08.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.357+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94780283223760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c120cf90 con 0x5633c11cb170 2024-09-10T05:12:08.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.358+0000 7f76f8381640 1 -- 172.21.15.192:0/2586223484 <== osd.3 v2:172.21.15.192:6816/1620624472 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94780283223760] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76ec053040 con 0x5633c11cb170 2024-09-10T05:12:08.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.358+0000 7f76fb098800 20 remove_watcher() i=2 2024-09-10T05:12:08.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.358+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94780283230128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c120cf90 con 0x7f76ec02e910 2024-09-10T05:12:08.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.359+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.2 v2:172.21.15.192:6801/2435677948 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94780283230128] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76f004f040 con 0x7f76ec02e910 2024-09-10T05:12:08.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.359+0000 7f76fb098800 20 remove_watcher() i=3 2024-09-10T05:12:08.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.359+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94780283231664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c120cf90 con 0x5633c11c21b0 2024-09-10T05:12:08.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.361+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 <== osd.1 v2:172.21.15.192:6800/3487349558 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94780283231664] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76f004f040 con 0x5633c11c21b0 2024-09-10T05:12:08.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.361+0000 7f76fb098800 20 remove_watcher() i=4 2024-09-10T05:12:08.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.361+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94780283236176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c120cf90 con 0x5633c11c6520 2024-09-10T05:12:08.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.362+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94780283236176] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.362+0000 7f76fb098800 20 remove_watcher() i=5 2024-09-10T05:12:08.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.362+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94780283240976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c120cf90 con 0x5633c11c6520 2024-09-10T05:12:08.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.363+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94780283240976] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.363+0000 7f76fb098800 20 remove_watcher() i=6 2024-09-10T05:12:08.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.363+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94780283244800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633c120cf90 con 0x5633c11c6520 2024-09-10T05:12:08.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76f8b82640 1 -- 172.21.15.192:0/2586223484 <== osd.0 v2:172.21.15.139:6800/2915567440 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94780283244800] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76e80769d0 con 0x5633c11c6520 2024-09-10T05:12:08.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 20 remove_watcher() i=7 2024-09-10T05:12:08.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5633c11c6520 msgr2=0x5633c11c8910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5633c11c6520 0x5633c11c8910 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5633c11c21b0 msgr2=0x5633c11c4600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5633c11c21b0 0x5633c11c4600 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f76ec02e910 msgr2=0x7f76ec03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f76ec02e910 0x7f76ec03a3c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5633c11cb170 msgr2=0x5633c11cd630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5633c11cb170 0x5633c11cd630 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75c403c780 msgr2=0x7f75c403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75c403c780 0x7f75c403ec40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00ffd0 tx=0x7f76ec023040 comp rx=0 tx=0).stop 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 msgr2=0x5633c11b6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76f9383640 1 -- 172.21.15.192:0/2586223484 reap_dead start 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.364+0000 7f76fb098800 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 0x5633c11b6c20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f76e806b6f0 tx=0x7f76e8078ed0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 shutdown_connections 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 --2- 172.21.15.192:0/2586223484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11af810 0x5633c11b6c20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 >> 172.21.15.192:0/2586223484 conn(0x5633c11abc10 msgr2=0x5633c11a9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 shutdown_connections 2024-09-10T05:12:08.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/2586223484 wait complete. 2024-09-10T05:12:08.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/74294056 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75d003c780 msgr2=0x7f75d003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 --2- 172.21.15.192:0/74294056 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75d003c780 0x7f75d003ec40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5633c11916d0 tx=0x7f76ec006000 comp rx=0 tx=0).stop 2024-09-10T05:12:08.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/74294056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11a2f30 msgr2=0x5633c11a3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 --2- 172.21.15.192:0/74294056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11a2f30 0x5633c11a3350 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f76e8095860 tx=0x7f76e806b680 comp rx=0 tx=0).stop 2024-09-10T05:12:08.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/74294056 shutdown_connections 2024-09-10T05:12:08.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 --2- 172.21.15.192:0/74294056 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75d003c780 0x7f75d003ec40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 --2- 172.21.15.192:0/74294056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c11a2f30 0x5633c11a3350 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/74294056 >> 172.21.15.192:0/74294056 conn(0x5633c11972e0 msgr2=0x5633c11976c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/74294056 shutdown_connections 2024-09-10T05:12:08.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/74294056 wait complete. 2024-09-10T05:12:08.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5633c118e730 msgr2=0x5633c1190ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5633c118e730 0x5633c1190ba0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5633c1091020 msgr2=0x5633c118c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5633c1091020 0x5633c118c3d0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5633c1192790 msgr2=0x5633c1194b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5633c1192790 0x5633c1194b80 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75e003c780 msgr2=0x7f75e003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f75e003c780 0x7f75e003ec40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76ec000c00 tx=0x7f76ec0013b0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 msgr2=0x5633c1184d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 --2- 172.21.15.192:0/1325521850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5633c108e690 0x5633c1184d80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f76e8025a60 tx=0x7f76e8003330 comp rx=0 tx=0).stop 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76f9383640 1 -- 172.21.15.192:0/1325521850 reap_dead start 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 shutdown_connections 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.365+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 >> 172.21.15.192:0/1325521850 conn(0x5633c10881b0 msgr2=0x5633c117e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.366+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 shutdown_connections 2024-09-10T05:12:08.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.366+0000 7f76fb098800 1 -- 172.21.15.192:0/1325521850 wait complete. 2024-09-10T05:12:08.375 INFO:teuthology.orchestra.run.smithi192.stdout:[{"tag":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.12108225515191003156\u0000","time":"2024-09-10T05:12:08.166213+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_7","key":"","instance":""}]}] 2024-09-10T05:12:08.375 DEBUG:tasks.util.rgw: json result: [{'tag': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.12108225515191003156\x00', 'time': '2024-09-10T05:12:08.166213+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_7', 'key': '', 'instance': ''}]}] 2024-09-10T05:12:08.375 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-10T05:12:08.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-10T05:12:08.375 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-10T05:12:08.418 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:08.418 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:08.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.418+0000 7f6dbaf46800 1 Processor -- start 2024-09-10T05:12:08.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.418+0000 7f6dbaf46800 1 -- start start 2024-09-10T05:12:08.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.418+0000 7f6dbaf46800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x560a6d2d8710 0x560a6d2dab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.418+0000 7f6dbaf46800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560a6d181e40 con 0x560a6d2db040 2024-09-10T05:12:08.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.418+0000 7f6dbaf46800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x560a6d14c680 con 0x560a6d2d8710 2024-09-10T05:12:08.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.418+0000 7f6db8a37640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x560a6d2d8710 0x560a6d2dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.418+0000 7f6db8a37640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x560a6d2d8710 0x560a6d2dab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60326/0 (socket says 172.21.15.192:60326) 2024-09-10T05:12:08.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.418+0000 7f6db8a37640 1 -- 172.21.15.192:0/3786831265 learned_addr learned my addr 172.21.15.192:0/3786831265 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.418+0000 7f6db8a37640 1 -- 172.21.15.192:0/3786831265 >> v1:172.21.15.139:6789/0 conn(0x560a6d2db040 legacy=0x560a6d2dd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.418+0000 7f6db7a35640 1 -- 172.21.15.192:0/3786831265 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3533828465 0 0) 0x560a6d181e40 con 0x560a6d2db040 2024-09-10T05:12:08.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.418+0000 7f6db8a37640 1 -- 172.21.15.192:0/3786831265 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6d1686b0 con 0x560a6d2d8710 2024-09-10T05:12:08.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.420+0000 7f6db8a37640 1 --2- 172.21.15.192:0/3786831265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d2dab00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6da800a520 tx=0x7f6da8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56396748cc739525 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.420+0000 7f6db7a35640 1 -- 172.21.15.192:0/3786831265 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da8055070 con 0x560a6d2d8710 2024-09-10T05:12:08.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.420+0000 7f6db7a35640 1 -- 172.21.15.192:0/3786831265 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da80515b0 con 0x560a6d2d8710 2024-09-10T05:12:08.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.420+0000 7f6db7a35640 1 -- 172.21.15.192:0/3786831265 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da80518d0 con 0x560a6d2d8710 2024-09-10T05:12:08.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.421+0000 7f6dbaf46800 1 -- 172.21.15.192:0/3786831265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 msgr2=0x560a6d2dab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.421+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/3786831265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d2dab00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6da800a520 tx=0x7f6da8045ba0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.421+0000 7f6dbaf46800 1 -- 172.21.15.192:0/3786831265 shutdown_connections 2024-09-10T05:12:08.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.421+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/3786831265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d2dab00 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.421+0000 7f6dbaf46800 1 -- 172.21.15.192:0/3786831265 >> 172.21.15.192:0/3786831265 conn(0x560a6d2d21b0 msgr2=0x560a6d2d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.421+0000 7f6dbaf46800 1 -- 172.21.15.192:0/3786831265 shutdown_connections 2024-09-10T05:12:08.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.421+0000 7f6dbaf46800 1 -- 172.21.15.192:0/3786831265 wait complete. 2024-09-10T05:12:08.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.435+0000 7f6dbaf46800 1 Processor -- start 2024-09-10T05:12:08.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.435+0000 7f6dbaf46800 1 -- start start 2024-09-10T05:12:08.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.435+0000 7f6dbaf46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d2d7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.435+0000 7f6dbaf46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560a6d170dd0 con 0x560a6d2d8710 2024-09-10T05:12:08.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.435+0000 7f6db8a37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d2d7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.435+0000 7f6db8a37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d2d7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60342/0 (socket says 172.21.15.192:60342) 2024-09-10T05:12:08.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.435+0000 7f6db8a37640 1 -- 172.21.15.192:0/3387311017 learned_addr learned my addr 172.21.15.192:0/3387311017 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.436+0000 7f6db8a37640 1 -- 172.21.15.192:0/3387311017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6d189e10 con 0x560a6d2d8710 2024-09-10T05:12:08.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.436+0000 7f6db8a37640 1 --2- 172.21.15.192:0/3387311017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d2d7ea0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6da8025da0 tx=0x7f6da8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f171bd3a7eb96c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.436+0000 7f6ca6e0d640 1 -- 172.21.15.192:0/3387311017 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da8051950 con 0x560a6d2d8710 2024-09-10T05:12:08.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.436+0000 7f6ca6e0d640 1 -- 172.21.15.192:0/3387311017 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da8051af0 con 0x560a6d2d8710 2024-09-10T05:12:08.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.436+0000 7f6ca6e0d640 1 -- 172.21.15.192:0/3387311017 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da8051dd0 con 0x560a6d2d8710 2024-09-10T05:12:08.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.437+0000 7f6dbaf46800 1 -- 172.21.15.192:0/3387311017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 msgr2=0x560a6d2d7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.437+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/3387311017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d2d7ea0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6da8025da0 tx=0x7f6da8051000 comp rx=0 tx=0).stop 2024-09-10T05:12:08.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.437+0000 7f6dbaf46800 1 -- 172.21.15.192:0/3387311017 shutdown_connections 2024-09-10T05:12:08.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.437+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/3387311017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d2d7ea0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.437+0000 7f6dbaf46800 1 -- 172.21.15.192:0/3387311017 >> 172.21.15.192:0/3387311017 conn(0x560a6d2d21b0 msgr2=0x560a6d3c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.437+0000 7f6dbaf46800 1 -- 172.21.15.192:0/3387311017 shutdown_connections 2024-09-10T05:12:08.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.437+0000 7f6dbaf46800 1 -- 172.21.15.192:0/3387311017 wait complete. 2024-09-10T05:12:08.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.437+0000 7f6dbaf46800 1 Processor -- start 2024-09-10T05:12:08.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.437+0000 7f6dbaf46800 1 -- start start 2024-09-10T05:12:08.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.437+0000 7f6dbaf46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d3d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.437+0000 7f6dbaf46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560a6d2df030 con 0x560a6d2d8710 2024-09-10T05:12:08.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.437+0000 7f6db8a37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d3d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.438+0000 7f6db8a37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d3d0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60348/0 (socket says 172.21.15.192:60348) 2024-09-10T05:12:08.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.438+0000 7f6db8a37640 1 -- 172.21.15.192:0/232475214 learned_addr learned my addr 172.21.15.192:0/232475214 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.438+0000 7f6db8a37640 1 -- 172.21.15.192:0/232475214 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6d3d1390 con 0x560a6d2d8710 2024-09-10T05:12:08.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.438+0000 7f6db8a37640 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d3d0e30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6da8025da0 tx=0x7f6da8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.438+0000 7f6ca560a640 1 -- 172.21.15.192:0/232475214 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da805a600 con 0x560a6d2d8710 2024-09-10T05:12:08.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.438+0000 7f6ca560a640 1 -- 172.21.15.192:0/232475214 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da8073070 con 0x560a6d2d8710 2024-09-10T05:12:08.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.438+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a6d3d1620 con 0x560a6d2d8710 2024-09-10T05:12:08.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.438+0000 7f6ca560a640 1 -- 172.21.15.192:0/232475214 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da805a910 con 0x560a6d2d8710 2024-09-10T05:12:08.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.438+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a6d3d2230 con 0x560a6d2d8710 2024-09-10T05:12:08.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.439+0000 7f6ca560a640 1 -- 172.21.15.192:0/232475214 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6da8058070 con 0x560a6d2d8710 2024-09-10T05:12:08.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.439+0000 7f6ca560a640 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6ca003c780 0x7f6ca003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.439+0000 7f6ca560a640 1 -- 172.21.15.192:0/232475214 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6da806b040 con 0x560a6d2d8710 2024-09-10T05:12:08.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.439+0000 7f6db8236640 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6ca003c780 0x7f6ca003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.440+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560a6d2db040 0x560a6d3d8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.440+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d3d89c0 con 0x560a6d2db040 2024-09-10T05:12:08.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.440+0000 7f6db9238640 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560a6d2db040 0x560a6d3d8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.440+0000 7f6db8236640 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6ca003c780 0x7f6ca003ec40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6dac000f60 tx=0x7f6dac0013f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.440+0000 7f6db9238640 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560a6d2db040 0x560a6d3d8480 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.440+0000 7f6db9238640 1 -- 172.21.15.192:0/232475214 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d2db040 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.440+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d3d8d60 con 0x560a6d2db040 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.440+0000 7f6db9238640 1 -- 172.21.15.192:0/232475214 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d2db040 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.440+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560a6d3da8a0 0x560a6d3dcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.441+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d3dd4b0 con 0x560a6d3da8a0 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.441+0000 7f6db8a37640 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560a6d3da8a0 0x560a6d3dcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.441+0000 7f6db8a37640 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560a6d3da8a0 0x560a6d3dcd20 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.441+0000 7f6db8a37640 1 -- 172.21.15.192:0/232475214 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6da8057030 con 0x560a6d3da8a0 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.442+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d3d95b0 con 0x560a6d2db040 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.442+0000 7f6db9238640 1 -- 172.21.15.192:0/232475214 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d2db040 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.442+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560a6d3de910 0x560a6d3e0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.442+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d3e1440 con 0x560a6d3de910 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.442+0000 7f6db8236640 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560a6d3de910 0x560a6d3e0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.442+0000 7f6db8236640 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560a6d3de910 0x560a6d3e0d00 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.443+0000 7f6db8236640 1 -- 172.21.15.192:0/232475214 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6dac010540 con 0x560a6d3de910 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.443+0000 7f6dbaf46800 1 Processor -- start 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.443+0000 7f6dbaf46800 1 -- start start 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.443+0000 7f6dbaf46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3ef080 0x560a6d3ef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.443+0000 7f6dbaf46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560a6d1cea00 con 0x560a6d3ef080 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.443+0000 7f6db8a37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3ef080 0x560a6d3ef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.443+0000 7f6db8a37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3ef080 0x560a6d3ef4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60352/0 (socket says 172.21.15.192:60352) 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.443+0000 7f6db8a37640 1 -- 172.21.15.192:0/996536293 learned_addr learned my addr 172.21.15.192:0/996536293 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.444+0000 7f6db8a37640 1 -- 172.21.15.192:0/996536293 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6d3efae0 con 0x560a6d3ef080 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.444+0000 7f6db8a37640 1 --2- 172.21.15.192:0/996536293 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3ef080 0x560a6d3ef4a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6da80507d0 tx=0x7f6da8064b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.444+0000 7f6c9e7fc640 1 -- 172.21.15.192:0/996536293 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da8000ed0 con 0x560a6d3ef080 2024-09-10T05:12:08.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.444+0000 7f6c9e7fc640 1 -- 172.21.15.192:0/996536293 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da8001090 con 0x560a6d3ef080 2024-09-10T05:12:08.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.444+0000 7f6dbaf46800 1 -- 172.21.15.192:0/996536293 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a6d3f0310 con 0x560a6d3ef080 2024-09-10T05:12:08.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.444+0000 7f6c9e7fc640 1 -- 172.21.15.192:0/996536293 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da8078460 con 0x560a6d3ef080 2024-09-10T05:12:08.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.444+0000 7f6dbaf46800 1 -- 172.21.15.192:0/996536293 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a6d3f08b0 con 0x560a6d3ef080 2024-09-10T05:12:08.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.445+0000 7f6c9e7fc640 1 -- 172.21.15.192:0/996536293 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6da804f070 con 0x560a6d3ef080 2024-09-10T05:12:08.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.445+0000 7f6c9e7fc640 1 --2- 172.21.15.192:0/996536293 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c9003c730 0x7f6c9003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.445+0000 7f6c9e7fc640 1 -- 172.21.15.192:0/996536293 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6da808e070 con 0x560a6d3ef080 2024-09-10T05:12:08.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.445+0000 7f6db8236640 1 --2- 172.21.15.192:0/996536293 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c9003c730 0x7f6c9003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.445+0000 7f6dbaf46800 1 Processor -- start 2024-09-10T05:12:08.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.445+0000 7f6db8236640 1 --2- 172.21.15.192:0/996536293 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c9003c730 0x7f6c9003ebf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00c010 tx=0x7f6dac006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.445+0000 7f6dbaf46800 1 -- start start 2024-09-10T05:12:08.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.445+0000 7f6dbaf46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 0x560a6d3fbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.445+0000 7f6dbaf46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560a6d2d6740 con 0x560a6d3fb8b0 2024-09-10T05:12:08.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.446+0000 7f6db8a37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 0x560a6d3fbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.446+0000 7f6db8a37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 0x560a6d3fbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60358/0 (socket says 172.21.15.192:60358) 2024-09-10T05:12:08.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.446+0000 7f6db8a37640 1 -- 172.21.15.192:0/2090108100 learned_addr learned my addr 172.21.15.192:0/2090108100 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.446+0000 7f6db8a37640 1 -- 172.21.15.192:0/2090108100 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6d3fc2a0 con 0x560a6d3fb8b0 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.446+0000 7f6db8a37640 1 --2- 172.21.15.192:0/2090108100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 0x560a6d3fbcb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6da807dff0 tx=0x7f6da806e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a7b721b732b136 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.446+0000 7f6c8ffff640 1 -- 172.21.15.192:0/2090108100 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da806e970 con 0x560a6d3fb8b0 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.446+0000 7f6c8ffff640 1 -- 172.21.15.192:0/2090108100 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da806ee00 con 0x560a6d3fb8b0 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.446+0000 7f6c8ffff640 1 -- 172.21.15.192:0/2090108100 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da8050970 con 0x560a6d3fb8b0 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6dbaf46800 1 -- 172.21.15.192:0/2090108100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 msgr2=0x560a6d3fbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/2090108100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 0x560a6d3fbcb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6da807dff0 tx=0x7f6da806e870 comp rx=0 tx=0).stop 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6dbaf46800 1 -- 172.21.15.192:0/2090108100 shutdown_connections 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/2090108100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 0x560a6d3fbcb0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6dbaf46800 1 -- 172.21.15.192:0/2090108100 >> 172.21.15.192:0/2090108100 conn(0x560a6d3f7cb0 msgr2=0x560a6d3f5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6dbaf46800 1 -- 172.21.15.192:0/2090108100 shutdown_connections 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6dbaf46800 1 -- 172.21.15.192:0/2090108100 wait complete. 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6dbaf46800 1 Processor -- start 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6dbaf46800 1 -- start start 2024-09-10T05:12:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6dbaf46800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 0x560a6d402cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6dbaf46800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560a6d3fc710 con 0x560a6d3fb8b0 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6db8a37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 0x560a6d402cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6db8a37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 0x560a6d402cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60376/0 (socket says 172.21.15.192:60376) 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.447+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 learned_addr learned my addr 172.21.15.192:0/1646895565 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.448+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6d403250 con 0x560a6d3fb8b0 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.448+0000 7f6db8a37640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 0x560a6d402cf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6da806efd0 tx=0x7f6da8074fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.448+0000 7f6c8e7fc640 1 -- 172.21.15.192:0/1646895565 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da80bb070 con 0x560a6d3fb8b0 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.448+0000 7f6c8e7fc640 1 -- 172.21.15.192:0/1646895565 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da806e970 con 0x560a6d3fb8b0 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.448+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a6d403250 con 0x560a6d3fb8b0 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.448+0000 7f6c8e7fc640 1 -- 172.21.15.192:0/1646895565 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6da8006d70 con 0x560a6d3fb8b0 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.448+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a6d403250 con 0x560a6d3fb8b0 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.449+0000 7f6c8e7fc640 1 -- 172.21.15.192:0/1646895565 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6da80be070 con 0x560a6d3fb8b0 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.449+0000 7f6c8e7fc640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c8403c6e0 0x7f6c8403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.449+0000 7f6c8e7fc640 1 -- 172.21.15.192:0/1646895565 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6da8062070 con 0x560a6d3fb8b0 2024-09-10T05:12:08.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.449+0000 7f6db8236640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c8403c6e0 0x7f6c8403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.450+0000 7f6dbaf46800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.450+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560a6d40e030 0x560a6d4104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.450+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d410c40 con 0x560a6d40e030 2024-09-10T05:12:08.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.450+0000 7f6db8236640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c8403c6e0 0x7f6c8403eba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x560a6d3dd850 tx=0x7f6dac022040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.450+0000 7f6db9238640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560a6d40e030 0x560a6d4104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.450+0000 7f6db9238640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560a6d40e030 0x560a6d4104f0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.450+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.450+0000 7f6dbaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.450+0000 7f6dbaf46800 20 realm 2024-09-10T05:12:08.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.450+0000 7f6dbaf46800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.450+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411050 con 0x560a6d40e030 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6dbaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6dbaf46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6dbaf46800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411920 con 0x560a6d40e030 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6dbaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6dbaf46800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d40e030 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6dbaf46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6dbaf46800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560a6d412a20 0x560a6d414e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d4153d0 con 0x560a6d412a20 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.451+0000 7f6db8a37640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560a6d412a20 0x560a6d414e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.452+0000 7f6db8a37640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560a6d412a20 0x560a6d414e10 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.452+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.452+0000 7f6dbaf46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.452+0000 7f6dbaf46800 20 searching for the correct realm 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.452+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560a6d417380 0x560a6d419840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.452+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d419f10 con 0x560a6d417380 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.452+0000 7f6db8236640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560a6d417380 0x560a6d419840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.452+0000 7f6db8236640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560a6d417380 0x560a6d419840 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.453+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.453+0000 7f6db8236640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6dac02d910 0x7f6dac0393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.453+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d419f10 con 0x7f6dac02d910 2024-09-10T05:12:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.453+0000 7f6db9238640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6dac02d910 0x7f6dac0393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.453+0000 7f6db9238640 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6dac02d910 0x7f6dac0393c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.453+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.453+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d412a20 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.454+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.454+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d40e030 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.454+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.454+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d40e030 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.454+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.454+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d412a20 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.455+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.455+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d412a20 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.455+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.455+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x7f6dac02d910 2024-09-10T05:12:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.455+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.455+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d417380 2024-09-10T05:12:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.455+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.455+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d40e030 2024-09-10T05:12:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.455+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.456+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d412a20 2024-09-10T05:12:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.456+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.456+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d40e030 2024-09-10T05:12:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.456+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.456+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x7f6dac02d910 2024-09-10T05:12:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.456+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.456+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d417380 2024-09-10T05:12:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.456+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.457+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d417380 2024-09-10T05:12:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.457+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.457+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d412a20 2024-09-10T05:12:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.457+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.457+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d417380 2024-09-10T05:12:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.457+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.457+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d417380 2024-09-10T05:12:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.457+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.457+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d40e030 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.458+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.458+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d40e030 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.458+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.458+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x7f6dac02d910 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.458+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.458+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d417380 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.458+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.458+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x7f6dac02d910 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.458+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.458+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d40e030 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.459+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.459+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d412a20 2024-09-10T05:12:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.459+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.459+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d417380 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.459+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.459+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d412a20 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.460+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.460+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x7f6dac02d910 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.460+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.460+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d417380 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.460+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.460+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x7f6dac02d910 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.460+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.460+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x560a6d40e030 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560a6d411cc0 con 0x7f6dac02d910 2024-09-10T05:12:08.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d415c90 con 0x560a6d40e030 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d415c90 con 0x560a6d40e030 2024-09-10T05:12:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.461+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d415c90 con 0x7f6dac02d910 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 20 zone default found 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 4 Realm: () 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 20 zonegroup default 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d415c80 con 0x560a6d412a20 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41bd80 con 0x560a6d417380 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41c120 con 0x560a6d417380 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 20 started sync module instance, tier type = 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.462+0000 7f6dbaf46800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.463+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41b220 con 0x7f6dac02d910 2024-09-10T05:12:08.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.464+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.464+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94602782685008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41b220 con 0x7f6dac02d910 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.464+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41cb50 con 0x560a6d40e030 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.464+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94602782685008] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.465+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.465+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94602782688864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41b220 con 0x560a6d40e030 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.465+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41d600 con 0x560a6d417380 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.466+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94602782688864] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.466+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.466+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94602782682480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41b190 con 0x560a6d417380 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.466+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41e4f0 con 0x7f6dac02d910 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.467+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94602782682480] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.467+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.467+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94602782695488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41e910 con 0x7f6dac02d910 2024-09-10T05:12:08.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.467+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41f2d0 con 0x560a6d40e030 2024-09-10T05:12:08.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.468+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94602782695488] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.468+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.468+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94602782697024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41f2d0 con 0x560a6d40e030 2024-09-10T05:12:08.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.468+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41fc90 con 0x560a6d412a20 2024-09-10T05:12:08.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.469+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.469+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94602782701536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d4204e0 con 0x560a6d412a20 2024-09-10T05:12:08.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.469+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d420f60 con 0x560a6d412a20 2024-09-10T05:12:08.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.469+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94602782697024] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.470+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.470+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94602782699040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d4217b0 con 0x560a6d412a20 2024-09-10T05:12:08.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.470+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d422170 con 0x560a6d412a20 2024-09-10T05:12:08.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.470+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94602782701536] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.471+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(58 notify.7 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.471+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94602782710976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d422590 con 0x560a6d412a20 2024-09-10T05:12:08.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.471+0000 7f6dbaf46800 20 add_watcher() i=0 2024-09-10T05:12:08.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.471+0000 7f6dbaf46800 20 add_watcher() i=1 2024-09-10T05:12:08.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.471+0000 7f6dbaf46800 20 add_watcher() i=2 2024-09-10T05:12:08.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.471+0000 7f6dbaf46800 20 add_watcher() i=3 2024-09-10T05:12:08.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.471+0000 7f6dbaf46800 20 add_watcher() i=4 2024-09-10T05:12:08.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.471+0000 7f6dbaf46800 20 add_watcher() i=5 2024-09-10T05:12:08.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.471+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94602782699040] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.471+0000 7f6dbaf46800 20 add_watcher() i=6 2024-09-10T05:12:08.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.474+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94602782710976] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.474+0000 7f6dbaf46800 20 add_watcher() i=7 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.474+0000 7f6dbaf46800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.474+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d4255c0 con 0x560a6d40e030 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.474+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.474+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94602782712032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d4229b0 con 0x560a6d40e030 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.475+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94602782712032] v37'164 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.475+0000 7f6c6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.475+0000 7f6dbaf46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.475+0000 7f6dbaf46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.476+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d42dd20 con 0x560a6d40e030 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.476+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'49 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.477+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d42dd20 con 0x560a6d412a20 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.478+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.478+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d42dd20 con 0x560a6d417380 2024-09-10T05:12:08.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.479+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.479+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d42d420 con 0x560a6d40e030 2024-09-10T05:12:08.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.480+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'165 uv19 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.480+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d42d420 con 0x7f6dac02d910 2024-09-10T05:12:08.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.480+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'53 uv17 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.481+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d42f4c0 con 0x560a6d417380 2024-09-10T05:12:08.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.481+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'43 uv20 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.481+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d42fa30 con 0x560a6d40e030 2024-09-10T05:12:08.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.483+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.483+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d42fee0 con 0x560a6d412a20 2024-09-10T05:12:08.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.483+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'37 uv14 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.483+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d42fee0 con 0x7f6dac02d910 2024-09-10T05:12:08.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.484+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.484+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d42fee0 con 0x560a6d417380 2024-09-10T05:12:08.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.485+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.485+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430450 con 0x7f6dac02d910 2024-09-10T05:12:08.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.486+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'54 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.486+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430450 con 0x560a6d412a20 2024-09-10T05:12:08.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.488+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.488+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430450 con 0x7f6dac02d910 2024-09-10T05:12:08.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.489+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.489+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430450 con 0x560a6d412a20 2024-09-10T05:12:08.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.490+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'49 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.490+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430450 con 0x560a6d40e030 2024-09-10T05:12:08.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.491+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'166 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.491+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430450 con 0x560a6d417380 2024-09-10T05:12:08.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.492+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'50 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.492+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x7f6dac02d910 2024-09-10T05:12:08.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.493+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'55 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.493+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d417380 2024-09-10T05:12:08.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.494+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.494+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d40e030 2024-09-10T05:12:08.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.495+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.495+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d40e030 2024-09-10T05:12:08.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.496+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'167 uv158 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.496+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d417380 2024-09-10T05:12:08.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.497+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'51 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.497+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x7f6dac02d910 2024-09-10T05:12:08.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.498+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.498+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d417380 2024-09-10T05:12:08.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.499+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.499+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d417380 2024-09-10T05:12:08.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.500+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.500+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d417380 2024-09-10T05:12:08.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.501+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'22 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.501+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d417380 2024-09-10T05:12:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.502+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'44 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.502+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d412a20 2024-09-10T05:12:08.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.503+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.503+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d417380 2024-09-10T05:12:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.504+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.504+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d412a20 2024-09-10T05:12:08.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.505+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'38 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.505+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d417380 2024-09-10T05:12:08.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.506+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'52 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.506+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x560a6d412a20 2024-09-10T05:12:08.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.508+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'50 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.508+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d430900 con 0x7f6dac02d910 2024-09-10T05:12:08.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.509+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.509+0000 7f6c6e7e4640 20 reqs_thread_entry: start 2024-09-10T05:12:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.509+0000 7f6dbaf46800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.509+0000 7f6dbaf46800 20 Filter name: none 2024-09-10T05:12:08.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.509+0000 7f6c677fe640 20 reqs_thread_entry: start 2024-09-10T05:12:08.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.509+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-10T05:12:08.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.509+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.510+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(94 gc.3 [call] v37'168 uv168 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.510+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:95 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.511+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(95 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.511+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.511+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:96 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x560a6d40e030 2024-09-10T05:12:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.511+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(96 gc.3 [call out=24b] v0'0 uv168 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.511+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:97 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.511+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(97 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.511+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.511+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:98 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.511+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(98 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.511+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.511+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:99 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.512+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(99 gc.3 [call] v37'169 uv169 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.512+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-10T05:12:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.512+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:100 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.513+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(100 gc.4 [call] v37'56 uv56 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.513+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:101 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.514+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(101 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.514+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.514+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:102 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x7f6dac02d910 2024-09-10T05:12:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.514+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(102 gc.4 [call out=24b] v0'0 uv56 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.514+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:103 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.514+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 24 ==== osd_op_reply(103 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.514+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.514+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:104 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.514+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 25 ==== osd_op_reply(104 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.514+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.514+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:105 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.515+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 26 ==== osd_op_reply(105 gc.4 [call] v37'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.515+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-10T05:12:08.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.515+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:106 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.516+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(106 gc.5 [call] v37'45 uv45 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.516+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:107 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.516+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(107 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.516+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.516+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:108 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x560a6d417380 2024-09-10T05:12:08.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.516+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 28 ==== osd_op_reply(108 gc.5 [call out=24b] v0'0 uv45 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.516+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.517+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.517+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.517+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.517+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 30 ==== osd_op_reply(110 gc.5 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.517+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.517+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.518+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 31 ==== osd_op_reply(111 gc.5 [call] v37'46 uv46 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.518+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-10T05:12:08.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.518+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.519+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(112 gc.6 [call] v37'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.519+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.519+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 34 ==== osd_op_reply(113 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.519+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.519+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x560a6d40e030 2024-09-10T05:12:08.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.520+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 35 ==== osd_op_reply(114 gc.6 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.520+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:115 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.520+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 36 ==== osd_op_reply(115 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.520+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.520+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:116 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.520+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 37 ==== osd_op_reply(116 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.520+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.520+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:117 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.521+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 38 ==== osd_op_reply(117 gc.6 [call] v37'29 uv29 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x560a6d40e030 2024-09-10T05:12:08.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.521+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-10T05:12:08.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.521+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:118 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.522+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(118 gc.7 [call] v37'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.522+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:119 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.522+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(119 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.522+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.522+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:120 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x560a6d412a20 2024-09-10T05:12:08.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.522+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(120 gc.7 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.522+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:121 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.523+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(121 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.523+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.523+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:122 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.523+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(122 gc.7 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.523+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.523+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:123 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.524+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(123 gc.7 [call] v37'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.524+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.524+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:124 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.525+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 27 ==== osd_op_reply(124 gc.8 [call] v37'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.525+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:125 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.525+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 28 ==== osd_op_reply(125 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.525+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.525+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:126 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x7f6dac02d910 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.525+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 29 ==== osd_op_reply(126 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.525+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:127 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.526+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 30 ==== osd_op_reply(127 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.526+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.526+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:128 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.526+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 31 ==== osd_op_reply(128 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.526+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.526+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:129 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.527+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 32 ==== osd_op_reply(129 gc.8 [call] v37'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6db000a4d0 con 0x7f6dac02d910 2024-09-10T05:12:08.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.527+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-10T05:12:08.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.527+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:130 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.528+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 32 ==== osd_op_reply(130 gc.9 [call] v37'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.528+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:131 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.528+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 33 ==== osd_op_reply(131 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.528+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.528+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:132 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x560a6d417380 2024-09-10T05:12:08.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.528+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 34 ==== osd_op_reply(132 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.528+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:133 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.529+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 35 ==== osd_op_reply(133 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.529+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.529+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:134 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.529+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 36 ==== osd_op_reply(134 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.529+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.529+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:135 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.530+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 37 ==== osd_op_reply(135 gc.9 [call] v37'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.530+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.530+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:136 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 33 ==== osd_op_reply(136 gc.10 [call] v37'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:137 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 34 ==== osd_op_reply(137 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:138 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x7f6dac02d910 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 35 ==== osd_op_reply(138 gc.10 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:139 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 36 ==== osd_op_reply(139 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:140 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 37 ==== osd_op_reply(140 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.531+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:141 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.532+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 38 ==== osd_op_reply(141 gc.10 [call] v37'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.532+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-10T05:12:08.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.532+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:142 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.534+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(142 gc.11 [call] v37'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.534+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:143 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.534+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 30 ==== osd_op_reply(143 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.534+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.534+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:144 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x560a6d412a20 2024-09-10T05:12:08.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.534+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 31 ==== osd_op_reply(144 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.534+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:145 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.534+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 32 ==== osd_op_reply(145 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.534+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.534+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:146 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.535+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 33 ==== osd_op_reply(146 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.535+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.535+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:147 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.536+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 34 ==== osd_op_reply(147 gc.11 [call] v37'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.536+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.536+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:148 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.537+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 39 ==== osd_op_reply(148 gc.12 [call] v37'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.537+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:149 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.537+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 40 ==== osd_op_reply(149 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.537+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.537+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:150 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x7f6dac02d910 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.537+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 41 ==== osd_op_reply(150 gc.12 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.537+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:151 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.537+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 42 ==== osd_op_reply(151 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.537+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.537+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:152 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.538+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 43 ==== osd_op_reply(152 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.538+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.538+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:153 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.538+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 44 ==== osd_op_reply(153 gc.12 [call] v37'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.538+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-10T05:12:08.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.538+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:154 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.540+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 35 ==== osd_op_reply(154 gc.13 [call] v37'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.540+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:155 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.540+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 36 ==== osd_op_reply(155 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.540+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.540+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:156 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x560a6d412a20 2024-09-10T05:12:08.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.540+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 37 ==== osd_op_reply(156 gc.13 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.540+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:157 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.541+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 38 ==== osd_op_reply(157 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.541+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.541+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:158 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.541+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 39 ==== osd_op_reply(158 gc.13 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.541+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.541+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:159 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d412a20 2024-09-10T05:12:08.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.542+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 40 ==== osd_op_reply(159 gc.13 [call] v37'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.542+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-10T05:12:08.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.542+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:160 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.543+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 39 ==== osd_op_reply(160 gc.14 [call] v37'170 uv170 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.544+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:161 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.544+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 40 ==== osd_op_reply(161 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.544+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.544+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:162 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x560a6d40e030 2024-09-10T05:12:08.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.544+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 41 ==== osd_op_reply(162 gc.14 [call out=24b] v0'0 uv170 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.544+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:163 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.544+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 42 ==== osd_op_reply(163 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.544+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.544+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:164 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.544+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 43 ==== osd_op_reply(164 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.544+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.544+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:165 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.545+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 44 ==== osd_op_reply(165 gc.14 [call] v37'171 uv171 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.545+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-10T05:12:08.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.545+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:166 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.547+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 38 ==== osd_op_reply(166 gc.15 [call] v37'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.547+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:167 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.547+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 39 ==== osd_op_reply(167 gc.15 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.547+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.547+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:168 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x560a6d417380 2024-09-10T05:12:08.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.547+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 40 ==== osd_op_reply(168 gc.15 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.547+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:169 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.547+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 41 ==== osd_op_reply(169 gc.15 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.547+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.547+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:170 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.548+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 42 ==== osd_op_reply(170 gc.15 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.548+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.548+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:171 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.549+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 43 ==== osd_op_reply(171 gc.15 [call] v37'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.549+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-10T05:12:08.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.549+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:172 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.550+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 45 ==== osd_op_reply(172 gc.16 [call] v37'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.550+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:173 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.550+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 46 ==== osd_op_reply(173 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.550+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.550+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:174 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x7f6dac02d910 2024-09-10T05:12:08.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.550+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 47 ==== osd_op_reply(174 gc.16 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.550+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:175 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.551+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 48 ==== osd_op_reply(175 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.551+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.551+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:176 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.551+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 49 ==== osd_op_reply(176 gc.16 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.551+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.551+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:177 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x7f6dac02d910 2024-09-10T05:12:08.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.552+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 50 ==== osd_op_reply(177 gc.16 [call] v37'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.552+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-10T05:12:08.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.552+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:178 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.553+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 44 ==== osd_op_reply(178 gc.17 [call] v37'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.553+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:179 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.553+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 45 ==== osd_op_reply(179 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.553+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.553+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:180 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x560a6d417380 2024-09-10T05:12:08.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.553+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 46 ==== osd_op_reply(180 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.553+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:181 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.553+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 47 ==== osd_op_reply(181 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.553+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.553+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:182 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.554+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 48 ==== osd_op_reply(182 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.554+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.554+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:183 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d417380 2024-09-10T05:12:08.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.555+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 49 ==== osd_op_reply(183 gc.17 [call] v37'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.555+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-10T05:12:08.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.555+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:184 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.556+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 45 ==== osd_op_reply(184 gc.18 [call] v37'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.556+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:185 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.556+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 46 ==== osd_op_reply(185 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.556+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.556+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:186 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x560a6d40e030 2024-09-10T05:12:08.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.556+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 47 ==== osd_op_reply(186 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.556+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:187 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.557+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 48 ==== osd_op_reply(187 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.557+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.557+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:188 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.557+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 49 ==== osd_op_reply(188 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.557+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.557+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:189 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.558+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 50 ==== osd_op_reply(189 gc.18 [call] v37'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.558+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.558+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:190 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.559+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 51 ==== osd_op_reply(190 gc.19 [call] v37'172 uv172 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.559+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:191 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.559+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 52 ==== osd_op_reply(191 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.559+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.559+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:192 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45b8c0 con 0x560a6d40e030 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.559+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 53 ==== osd_op_reply(192 gc.19 [call out=24b] v0'0 uv172 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.559+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:193 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 54 ==== osd_op_reply(193 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:194 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45c8d0 con 0x560a6d40e030 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 55 ==== osd_op_reply(194 gc.19 [call out=1702b] v0'0 uv172 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 20 garbage collection: RGWGC::process iterating over entry tag='92aa256a-2802-419e-96e0-ba675846cbc3.4238.12108225515191003156', time=2024-09-10T05:12:08.166213+0000, chain.objs.size()=7 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_1 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:195 3.1as0 3:5a488a65:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45cde0 con 0x560a6d40e030 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_2 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:196 3.2cs0 3:34d0411d:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45f950 con 0x560a6d417380 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_3 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:197 3.21s0 3:87b25b5f:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d4621c0 con 0x560a6d412a20 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_4 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:198 3.1es0 3:7b3d3b9d:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d464b00 con 0x560a6d412a20 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_5 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:199 3.15s0 3:a9a11e43:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d464b00 con 0x7f6dac02d910 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_6 2024-09-10T05:12:08.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:200 3.1as0 3:5b7d4428:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d469940 con 0x560a6d40e030 2024-09-10T05:12:08.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_7 2024-09-10T05:12:08.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.560+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:201 3.16s0 3:6bbd27d7:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x7f6dac02d910 2024-09-10T05:12:08.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.562+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 56 ==== osd_op_reply(195 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_1 [call] v37'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.562+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 50 ==== osd_op_reply(196 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_2 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.562+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 41 ==== osd_op_reply(198 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_4 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.563+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 42 ==== osd_op_reply(197 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_3 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.563+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 51 ==== osd_op_reply(199 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_5 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.563+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 52 ==== osd_op_reply(201 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_7 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.563+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 57 ==== osd_op_reply(200 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1__shadow_.YY7LP6CQ38j7GFgsuoQtJkcHJJMZIfa_6 [call] v37'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.563+0000 7f6dbaf46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-10T05:12:08.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.563+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:202 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x560a6d40e030 2024-09-10T05:12:08.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.565+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 58 ==== osd_op_reply(202 gc.19 [call] v37'173 uv173 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.565+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:203 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x560a6d40e030 2024-09-10T05:12:08.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.567+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 59 ==== osd_op_reply(203 gc.19 [call] v37'174 uv174 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.567+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-10T05:12:08.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.567+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:204 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x560a6d417380 2024-09-10T05:12:08.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.568+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 51 ==== osd_op_reply(204 gc.20 [call] v37'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.568+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:205 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x560a6d417380 2024-09-10T05:12:08.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.569+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 52 ==== osd_op_reply(205 gc.20 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.569+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.569+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:206 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x560a6d417380 2024-09-10T05:12:08.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.569+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 53 ==== osd_op_reply(206 gc.20 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.569+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:207 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x560a6d417380 2024-09-10T05:12:08.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.569+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 54 ==== osd_op_reply(207 gc.20 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.569+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.569+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:208 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x560a6d417380 2024-09-10T05:12:08.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.569+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 55 ==== osd_op_reply(208 gc.20 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.569+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.569+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:209 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x560a6d417380 2024-09-10T05:12:08.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.571+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 56 ==== osd_op_reply(209 gc.20 [call] v37'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.571+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-10T05:12:08.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.571+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:210 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x7f6dac02d910 2024-09-10T05:12:08.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.572+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 53 ==== osd_op_reply(210 gc.21 [call] v37'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.572+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:211 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x7f6dac02d910 2024-09-10T05:12:08.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.572+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 54 ==== osd_op_reply(211 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.572+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.572+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:212 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x7f6dac02d910 2024-09-10T05:12:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.572+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 55 ==== osd_op_reply(212 gc.21 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.572+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:213 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x7f6dac02d910 2024-09-10T05:12:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.572+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 56 ==== osd_op_reply(213 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.572+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.572+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:214 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d46c640 con 0x7f6dac02d910 2024-09-10T05:12:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.573+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 57 ==== osd_op_reply(214 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.573+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.573+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:215 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x7f6dac02d910 2024-09-10T05:12:08.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.574+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 58 ==== osd_op_reply(215 gc.21 [call] v37'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.574+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-10T05:12:08.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.574+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:216 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.575+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 57 ==== osd_op_reply(216 gc.22 [call] v37'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.575+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:217 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.575+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 58 ==== osd_op_reply(217 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.575+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.575+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:218 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45bd70 con 0x560a6d417380 2024-09-10T05:12:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.575+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 59 ==== osd_op_reply(218 gc.22 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.575+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:219 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.575+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 60 ==== osd_op_reply(219 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.575+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.575+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:220 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.576+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 61 ==== osd_op_reply(220 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.576+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.576+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:221 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.577+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 62 ==== osd_op_reply(221 gc.22 [call] v37'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.577+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-10T05:12:08.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.577+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:222 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.578+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 63 ==== osd_op_reply(222 gc.23 [call] v37'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.578+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:223 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.578+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 64 ==== osd_op_reply(223 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.578+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.578+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:224 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45bd70 con 0x560a6d417380 2024-09-10T05:12:08.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.578+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 65 ==== osd_op_reply(224 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.578+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:225 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.579+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 66 ==== osd_op_reply(225 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.579+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.579+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:226 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.579+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 67 ==== osd_op_reply(226 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.579+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.579+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:227 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.580+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 68 ==== osd_op_reply(227 gc.23 [call] v37'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.580+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-10T05:12:08.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.580+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:228 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.581+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 69 ==== osd_op_reply(228 gc.24 [call] v37'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.581+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:229 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.581+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 70 ==== osd_op_reply(229 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.581+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.581+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:230 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45bd70 con 0x560a6d417380 2024-09-10T05:12:08.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.581+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 71 ==== osd_op_reply(230 gc.24 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.581+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:231 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.581+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 72 ==== osd_op_reply(231 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.581+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.581+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:232 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.582+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 73 ==== osd_op_reply(232 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.582+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.582+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:233 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.582+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 74 ==== osd_op_reply(233 gc.24 [call] v37'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.582+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-10T05:12:08.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.582+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:234 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.583+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 75 ==== osd_op_reply(234 gc.25 [call] v37'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.583+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:235 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.584+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 76 ==== osd_op_reply(235 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.584+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.584+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:236 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45bd70 con 0x560a6d417380 2024-09-10T05:12:08.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.584+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 77 ==== osd_op_reply(236 gc.25 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.584+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:237 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.584+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 78 ==== osd_op_reply(237 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.584+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.584+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:238 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.584+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 79 ==== osd_op_reply(238 gc.25 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.584+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.584+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:239 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.586+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 80 ==== osd_op_reply(239 gc.25 [call] v37'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.586+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-10T05:12:08.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.586+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:240 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.587+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 43 ==== osd_op_reply(240 gc.26 [call] v37'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.587+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:241 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.587+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 44 ==== osd_op_reply(241 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.587+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.587+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:242 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45bd70 con 0x560a6d412a20 2024-09-10T05:12:08.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.588+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 45 ==== osd_op_reply(242 gc.26 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.588+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:243 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.588+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 46 ==== osd_op_reply(243 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.588+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.588+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:244 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.588+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 47 ==== osd_op_reply(244 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.588+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.588+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:245 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.589+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 48 ==== osd_op_reply(245 gc.26 [call] v37'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.589+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-10T05:12:08.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.589+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:246 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.590+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 81 ==== osd_op_reply(246 gc.27 [call] v37'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.590+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:247 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.590+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 82 ==== osd_op_reply(247 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.590+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.590+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:248 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.591+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 83 ==== osd_op_reply(248 gc.27 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.591+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:249 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.591+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 84 ==== osd_op_reply(249 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.591+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.591+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:250 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.591+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 85 ==== osd_op_reply(250 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.591+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.591+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:251 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.592+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 86 ==== osd_op_reply(251 gc.27 [call] v37'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.592+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-10T05:12:08.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.592+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:252 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.593+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 49 ==== osd_op_reply(252 gc.28 [call] v37'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.593+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:253 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.594+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 50 ==== osd_op_reply(253 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.594+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.594+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:254 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45bd70 con 0x560a6d412a20 2024-09-10T05:12:08.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.594+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 51 ==== osd_op_reply(254 gc.28 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.594+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:255 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.594+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 52 ==== osd_op_reply(255 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.594+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.594+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:256 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.594+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 53 ==== osd_op_reply(256 gc.28 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.594+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.594+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:257 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.595+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 54 ==== osd_op_reply(257 gc.28 [call] v37'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.595+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-10T05:12:08.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.595+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:258 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.596+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 87 ==== osd_op_reply(258 gc.29 [call] v37'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.596+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:259 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.596+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 88 ==== osd_op_reply(259 gc.29 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.596+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.596+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:260 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.597+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 89 ==== osd_op_reply(260 gc.29 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.597+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:261 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.597+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 90 ==== osd_op_reply(261 gc.29 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.597+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.597+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:262 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.597+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 91 ==== osd_op_reply(262 gc.29 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.597+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.597+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:263 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.598+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 92 ==== osd_op_reply(263 gc.29 [call] v37'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.598+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-10T05:12:08.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.598+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:264 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.599+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 55 ==== osd_op_reply(264 gc.30 [call] v37'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.599+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:265 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.599+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 56 ==== osd_op_reply(265 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.599+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.599+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:266 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.600+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 57 ==== osd_op_reply(266 gc.30 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.600+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:267 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.600+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 58 ==== osd_op_reply(267 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.600+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.600+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:268 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.600+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 59 ==== osd_op_reply(268 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.600+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.600+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:269 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.601+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 60 ==== osd_op_reply(269 gc.30 [call] v37'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.601+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-10T05:12:08.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.601+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:270 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x7f6dac02d910 2024-09-10T05:12:08.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.602+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 59 ==== osd_op_reply(270 gc.31 [call] v37'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.602+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:271 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x7f6dac02d910 2024-09-10T05:12:08.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.603+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 60 ==== osd_op_reply(271 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.603+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.603+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:272 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x7f6dac02d910 2024-09-10T05:12:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.603+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 61 ==== osd_op_reply(272 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.603+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:273 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x7f6dac02d910 2024-09-10T05:12:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.603+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 62 ==== osd_op_reply(273 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.603+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.603+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:274 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x7f6dac02d910 2024-09-10T05:12:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.603+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 63 ==== osd_op_reply(274 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.603+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.603+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:275 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x7f6dac02d910 2024-09-10T05:12:08.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.604+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 64 ==== osd_op_reply(275 gc.31 [call] v37'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.604+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-10T05:12:08.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.604+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:276 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d40e030 2024-09-10T05:12:08.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.606+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 60 ==== osd_op_reply(276 gc.0 [call] v37'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.606+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:277 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d40e030 2024-09-10T05:12:08.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.606+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 61 ==== osd_op_reply(277 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.606+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.606+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:278 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d40e030 2024-09-10T05:12:08.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.606+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 62 ==== osd_op_reply(278 gc.0 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.606+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:279 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d40e030 2024-09-10T05:12:08.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.606+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 63 ==== osd_op_reply(279 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.606+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.606+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:280 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d40e030 2024-09-10T05:12:08.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.606+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 64 ==== osd_op_reply(280 gc.0 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.607+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.607+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:281 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d40e030 2024-09-10T05:12:08.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.607+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 65 ==== osd_op_reply(281 gc.0 [call] v37'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.608+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-10T05:12:08.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.608+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:282 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.609+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 61 ==== osd_op_reply(282 gc.1 [call] v37'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.609+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:283 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.609+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 62 ==== osd_op_reply(283 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.609+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.609+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:284 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.609+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 63 ==== osd_op_reply(284 gc.1 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.609+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:285 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.609+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 64 ==== osd_op_reply(285 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.609+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.609+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:286 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.610+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 65 ==== osd_op_reply(286 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.610+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.610+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:287 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d412a20 2024-09-10T05:12:08.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.611+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 66 ==== osd_op_reply(287 gc.1 [call] v37'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.611+0000 7f6dbaf46800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-10T05:12:08.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.611+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:288 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 93 ==== osd_op_reply(288 gc.2 [call] v37'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:289 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 94 ==== osd_op_reply(289 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:290 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 95 ==== osd_op_reply(290 gc.2 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:291 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 96 ==== osd_op_reply(291 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:12:08.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:292 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 97 ==== osd_op_reply(292 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6dbaf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:12:08.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.612+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:293 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.613+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 98 ==== osd_op_reply(293 gc.2 [call] v37'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.614+0000 7f6c6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:08.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.614+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94602782712032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d40e030 2024-09-10T05:12:08.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.615+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94602782712032] v37'175 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.615+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94602782685008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x7f6dac02d910 2024-09-10T05:12:08.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.616+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 65 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94602782685008] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.616+0000 7f6dbaf46800 20 remove_watcher() i=0 2024-09-10T05:12:08.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.616+0000 7f6dbaf46800 2 removed watcher, disabling cache 2024-09-10T05:12:08.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.616+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94602782688864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d40e030 2024-09-10T05:12:08.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.617+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94602782688864] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.617+0000 7f6dbaf46800 20 remove_watcher() i=1 2024-09-10T05:12:08.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.617+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94602782682480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d45fcf0 con 0x560a6d417380 2024-09-10T05:12:08.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.618+0000 7f6db8236640 1 -- 172.21.15.192:0/1646895565 <== osd.3 v2:172.21.15.192:6816/1620624472 99 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94602782682480] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dac036040 con 0x560a6d417380 2024-09-10T05:12:08.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.618+0000 7f6dbaf46800 20 remove_watcher() i=2 2024-09-10T05:12:08.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.618+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94602782695488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41ad70 con 0x7f6dac02d910 2024-09-10T05:12:08.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.619+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.2 v2:172.21.15.192:6801/2435677948 66 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94602782695488] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x7f6dac02d910 2024-09-10T05:12:08.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.619+0000 7f6dbaf46800 20 remove_watcher() i=3 2024-09-10T05:12:08.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.619+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94602782697024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41e040 con 0x560a6d40e030 2024-09-10T05:12:08.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.620+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 <== osd.1 v2:172.21.15.192:6800/3487349558 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94602782697024] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db004e040 con 0x560a6d40e030 2024-09-10T05:12:08.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.620+0000 7f6dbaf46800 20 remove_watcher() i=4 2024-09-10T05:12:08.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.620+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94602782701536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41ad70 con 0x560a6d412a20 2024-09-10T05:12:08.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.621+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94602782701536] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.621+0000 7f6dbaf46800 20 remove_watcher() i=5 2024-09-10T05:12:08.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.621+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94602782699040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41e640 con 0x560a6d412a20 2024-09-10T05:12:08.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.622+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94602782699040] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.622+0000 7f6dbaf46800 20 remove_watcher() i=6 2024-09-10T05:12:08.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.622+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94602782710976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560a6d41e040 con 0x560a6d412a20 2024-09-10T05:12:08.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.623+0000 7f6db8a37640 1 -- 172.21.15.192:0/1646895565 <== osd.0 v2:172.21.15.139:6800/2915567440 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94602782710976] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da80bd030 con 0x560a6d412a20 2024-09-10T05:12:08.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.623+0000 7f6dbaf46800 20 remove_watcher() i=7 2024-09-10T05:12:08.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.623+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560a6d412a20 msgr2=0x560a6d414e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.623+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560a6d412a20 0x560a6d414e10 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.623+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560a6d40e030 msgr2=0x560a6d4104f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.623+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560a6d40e030 0x560a6d4104f0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.623+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6dac02d910 msgr2=0x7f6dac0393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.623+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6dac02d910 0x7f6dac0393c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.623+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560a6d417380 msgr2=0x560a6d419840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.623+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560a6d417380 0x560a6d419840 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.623+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c8403c6e0 msgr2=0x7f6c8403eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c8403c6e0 0x7f6c8403eba0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x560a6d3dd850 tx=0x7f6dac022040 comp rx=0 tx=0).stop 2024-09-10T05:12:08.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 msgr2=0x560a6d402cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6db9238640 1 -- 172.21.15.192:0/1646895565 reap_dead start 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 0x560a6d402cf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6da806efd0 tx=0x7f6da8074fc0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 shutdown_connections 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/1646895565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3fb8b0 0x560a6d402cf0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 >> 172.21.15.192:0/1646895565 conn(0x560a6d3f7cb0 msgr2=0x560a6d3f5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 shutdown_connections 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/1646895565 wait complete. 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/996536293 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c9003c730 msgr2=0x7f6c9003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/996536293 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c9003c730 0x7f6c9003ebf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00c010 tx=0x7f6dac006000 comp rx=0 tx=0).stop 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/996536293 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3ef080 msgr2=0x560a6d3ef4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/996536293 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3ef080 0x560a6d3ef4a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6da80507d0 tx=0x7f6da8064b00 comp rx=0 tx=0).stop 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/996536293 shutdown_connections 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/996536293 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c9003c730 0x7f6c9003ebf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/996536293 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d3ef080 0x560a6d3ef4a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/996536293 >> 172.21.15.192:0/996536293 conn(0x560a6d3e3430 msgr2=0x560a6d3e3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/996536293 shutdown_connections 2024-09-10T05:12:08.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/996536293 wait complete. 2024-09-10T05:12:08.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560a6d3da8a0 msgr2=0x560a6d3dcd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560a6d3da8a0 0x560a6d3dcd20 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560a6d2db040 msgr2=0x560a6d3d8480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560a6d2db040 0x560a6d3d8480 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.624+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560a6d3de910 msgr2=0x560a6d3e0d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.625+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560a6d3de910 0x560a6d3e0d00 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.625+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6ca003c780 msgr2=0x7f6ca003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.625+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6ca003c780 0x7f6ca003ec40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6dac000f60 tx=0x7f6dac0013f0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.625+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 msgr2=0x560a6d3d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.625+0000 7f6dbaf46800 1 --2- 172.21.15.192:0/232475214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560a6d2d8710 0x560a6d3d0e30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6da8025da0 tx=0x7f6da8002fb0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.625+0000 7f6db9238640 1 -- 172.21.15.192:0/232475214 reap_dead start 2024-09-10T05:12:08.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.625+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 shutdown_connections 2024-09-10T05:12:08.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.625+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 >> 172.21.15.192:0/232475214 conn(0x560a6d2d21b0 msgr2=0x560a6d3c2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.625+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 shutdown_connections 2024-09-10T05:12:08.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.625+0000 7f6dbaf46800 1 -- 172.21.15.192:0/232475214 wait complete. 2024-09-10T05:12:08.634 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-10T05:12:08.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-10T05:12:08.634 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-10T05:12:08.718 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:08.718 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:08.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.718+0000 7fe52192e800 1 Processor -- start 2024-09-10T05:12:08.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.718+0000 7fe52192e800 1 -- start start 2024-09-10T05:12:08.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.718+0000 7fe52192e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x561e0d6884c0 0x561e0d6888c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.718+0000 7fe52192e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561e0d533e40 con 0x561e0d688e00 2024-09-10T05:12:08.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.718+0000 7fe52192e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x561e0d4fe680 con 0x561e0d6884c0 2024-09-10T05:12:08.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.718+0000 7fe51d6dd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x561e0d6884c0 0x561e0d6888c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.718+0000 7fe517fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x561e0d688e00 0x561e0d6892b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:33678/0 (socket says 172.21.15.192:33678) 2024-09-10T05:12:08.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.718+0000 7fe517fff640 1 -- 172.21.15.192:0/1876855245 learned_addr learned my addr 172.21.15.192:0/1876855245 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:08.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.719+0000 7fe51d6dd640 1 -- 172.21.15.192:0/1876855245 >> v1:172.21.15.139:6789/0 conn(0x561e0d688e00 legacy=0x561e0d6892b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.719+0000 7fe51cedc640 1 -- 172.21.15.192:0/1876855245 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479722433 0 0) 0x561e0d533e40 con 0x561e0d688e00 2024-09-10T05:12:08.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.719+0000 7fe51d6dd640 1 -- 172.21.15.192:0/1876855245 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e0d51a6b0 con 0x561e0d6884c0 2024-09-10T05:12:08.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.721+0000 7fe51d6dd640 1 --2- 172.21.15.192:0/1876855245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d6888c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe51000a470 tx=0x7fe510045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3af5c288ce4471 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.721+0000 7fe51cedc640 1 -- 172.21.15.192:0/1876855245 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe510053570 con 0x561e0d6884c0 2024-09-10T05:12:08.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.721+0000 7fe51cedc640 1 -- 172.21.15.192:0/1876855245 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe510058070 con 0x561e0d6884c0 2024-09-10T05:12:08.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.721+0000 7fe51cedc640 1 -- 172.21.15.192:0/1876855245 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe510053880 con 0x561e0d6884c0 2024-09-10T05:12:08.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.721+0000 7fe52192e800 1 -- 172.21.15.192:0/1876855245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 msgr2=0x561e0d6888c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.721+0000 7fe52192e800 1 --2- 172.21.15.192:0/1876855245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d6888c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe51000a470 tx=0x7fe510045a20 comp rx=0 tx=0).stop 2024-09-10T05:12:08.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.721+0000 7fe52192e800 1 -- 172.21.15.192:0/1876855245 shutdown_connections 2024-09-10T05:12:08.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.721+0000 7fe52192e800 1 --2- 172.21.15.192:0/1876855245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d6888c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.721+0000 7fe52192e800 1 -- 172.21.15.192:0/1876855245 >> 172.21.15.192:0/1876855245 conn(0x561e0d6841b0 msgr2=0x561e0d686610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.721+0000 7fe52192e800 1 -- 172.21.15.192:0/1876855245 shutdown_connections 2024-09-10T05:12:08.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.721+0000 7fe52192e800 1 -- 172.21.15.192:0/1876855245 wait complete. 2024-09-10T05:12:08.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.735+0000 7fe52192e800 1 Processor -- start 2024-09-10T05:12:08.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.735+0000 7fe52192e800 1 -- start start 2024-09-10T05:12:08.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.735+0000 7fe52192e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d77b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.735+0000 7fe52192e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561e0d522dd0 con 0x561e0d6884c0 2024-09-10T05:12:08.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.735+0000 7fe51d6dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d77b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.735+0000 7fe51d6dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d77b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60386/0 (socket says 172.21.15.192:60386) 2024-09-10T05:12:08.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.736+0000 7fe51d6dd640 1 -- 172.21.15.192:0/1282221895 learned_addr learned my addr 172.21.15.192:0/1282221895 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.736+0000 7fe51d6dd640 1 -- 172.21.15.192:0/1282221895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e0d53be10 con 0x561e0d6884c0 2024-09-10T05:12:08.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.736+0000 7fe51d6dd640 1 --2- 172.21.15.192:0/1282221895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d77b650 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe51000a470 tx=0x7fe510051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20cdb40abecb9ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.736+0000 7fe40b606640 1 -- 172.21.15.192:0/1282221895 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe510053570 con 0x561e0d6884c0 2024-09-10T05:12:08.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.736+0000 7fe40b606640 1 -- 172.21.15.192:0/1282221895 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe510063030 con 0x561e0d6884c0 2024-09-10T05:12:08.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.736+0000 7fe40b606640 1 -- 172.21.15.192:0/1282221895 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe510053840 con 0x561e0d6884c0 2024-09-10T05:12:08.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.737+0000 7fe52192e800 1 -- 172.21.15.192:0/1282221895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 msgr2=0x561e0d77b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.737+0000 7fe52192e800 1 --2- 172.21.15.192:0/1282221895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d77b650 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe51000a470 tx=0x7fe510051000 comp rx=0 tx=0).stop 2024-09-10T05:12:08.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.737+0000 7fe52192e800 1 -- 172.21.15.192:0/1282221895 shutdown_connections 2024-09-10T05:12:08.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.737+0000 7fe52192e800 1 --2- 172.21.15.192:0/1282221895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d77b650 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.737+0000 7fe52192e800 1 -- 172.21.15.192:0/1282221895 >> 172.21.15.192:0/1282221895 conn(0x561e0d6841b0 msgr2=0x561e0d776fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.737+0000 7fe52192e800 1 -- 172.21.15.192:0/1282221895 shutdown_connections 2024-09-10T05:12:08.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.737+0000 7fe52192e800 1 -- 172.21.15.192:0/1282221895 wait complete. 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.737+0000 7fe52192e800 1 Processor -- start 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.737+0000 7fe52192e800 1 -- start start 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.738+0000 7fe52192e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d782ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.738+0000 7fe52192e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561e0d689d20 con 0x561e0d6884c0 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.738+0000 7fe51d6dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d782ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.738+0000 7fe51d6dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d782ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60396/0 (socket says 172.21.15.192:60396) 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.738+0000 7fe51d6dd640 1 -- 172.21.15.192:0/733141783 learned_addr learned my addr 172.21.15.192:0/733141783 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.738+0000 7fe51d6dd640 1 -- 172.21.15.192:0/733141783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e0d783400 con 0x561e0d6884c0 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.738+0000 7fe51d6dd640 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d782ea0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe51000a470 tx=0x7fe510002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.738+0000 7fe409e03640 1 -- 172.21.15.192:0/733141783 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe510078070 con 0x561e0d6884c0 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.738+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e0d783690 con 0x561e0d6884c0 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.738+0000 7fe409e03640 1 -- 172.21.15.192:0/733141783 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe510068420 con 0x561e0d6884c0 2024-09-10T05:12:08.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.739+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e0d7842a0 con 0x561e0d6884c0 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.739+0000 7fe409e03640 1 -- 172.21.15.192:0/733141783 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe510068700 con 0x561e0d6884c0 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.739+0000 7fe409e03640 1 -- 172.21.15.192:0/733141783 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe51007b070 con 0x561e0d6884c0 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.740+0000 7fe409e03640 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe40403c730 0x7fe40403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.740+0000 7fe409e03640 1 -- 172.21.15.192:0/733141783 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe510097b50 con 0x561e0d6884c0 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.740+0000 7fe517fff640 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe40403c730 0x7fe40403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.740+0000 7fe52192e800 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561e0d688e00 0x561e0d78a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.740+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d78aa30 con 0x561e0d688e00 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.740+0000 7fe51dede640 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561e0d688e00 0x561e0d78a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.740+0000 7fe517fff640 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe40403c730 0x7fe40403ebf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe508000c00 tx=0x7fe5080013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.740+0000 7fe51dede640 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561e0d688e00 0x561e0d78a4f0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.741+0000 7fe51dede640 1 -- 172.21.15.192:0/733141783 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d688e00 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.741+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d78add0 con 0x561e0d688e00 2024-09-10T05:12:08.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.741+0000 7fe51dede640 1 -- 172.21.15.192:0/733141783 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d688e00 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.741+0000 7fe52192e800 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561e0d78c850 0x561e0d78ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.741+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d78f480 con 0x561e0d78c850 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.741+0000 7fe51d6dd640 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561e0d78c850 0x561e0d78ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.741+0000 7fe51d6dd640 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561e0d78c850 0x561e0d78ecf0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.742+0000 7fe51d6dd640 1 -- 172.21.15.192:0/733141783 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe51007a030 con 0x561e0d78c850 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.742+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d78b620 con 0x561e0d688e00 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.742+0000 7fe51dede640 1 -- 172.21.15.192:0/733141783 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d688e00 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.742+0000 7fe52192e800 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561e0d7908e0 0x561e0d792cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.742+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d793320 con 0x561e0d7908e0 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.742+0000 7fe517fff640 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561e0d7908e0 0x561e0d792cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.742+0000 7fe517fff640 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561e0d7908e0 0x561e0d792cd0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.743+0000 7fe517fff640 1 -- 172.21.15.192:0/733141783 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe50800f670 con 0x561e0d7908e0 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.743+0000 7fe52192e800 1 Processor -- start 2024-09-10T05:12:08.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.743+0000 7fe52192e800 1 -- start start 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.743+0000 7fe52192e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7a0f50 0x561e0d7a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.743+0000 7fe52192e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561e0d580a00 con 0x561e0d7a0f50 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.743+0000 7fe51d6dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7a0f50 0x561e0d7a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.743+0000 7fe51d6dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7a0f50 0x561e0d7a1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60404/0 (socket says 172.21.15.192:60404) 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.743+0000 7fe51d6dd640 1 -- 172.21.15.192:0/1293435660 learned_addr learned my addr 172.21.15.192:0/1293435660 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.744+0000 7fe51d6dd640 1 -- 172.21.15.192:0/1293435660 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e0d7a19b0 con 0x561e0d7a0f50 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.744+0000 7fe51d6dd640 1 --2- 172.21.15.192:0/1293435660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7a0f50 0x561e0d7a1370 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe510095ef0 tx=0x7fe510068a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.744+0000 7fe402ffd640 1 -- 172.21.15.192:0/1293435660 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe51005cd30 con 0x561e0d7a0f50 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.744+0000 7fe402ffd640 1 -- 172.21.15.192:0/1293435660 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe510073940 con 0x561e0d7a0f50 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.744+0000 7fe402ffd640 1 -- 172.21.15.192:0/1293435660 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe510073c20 con 0x561e0d7a0f50 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.744+0000 7fe52192e800 1 -- 172.21.15.192:0/1293435660 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e0d7a21e0 con 0x561e0d7a0f50 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.744+0000 7fe52192e800 1 -- 172.21.15.192:0/1293435660 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e0d7a2780 con 0x561e0d7a0f50 2024-09-10T05:12:08.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.745+0000 7fe402ffd640 1 -- 172.21.15.192:0/1293435660 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe51008b040 con 0x561e0d7a0f50 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.745+0000 7fe402ffd640 1 --2- 172.21.15.192:0/1293435660 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe3f403c780 0x7fe3f403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.745+0000 7fe402ffd640 1 -- 172.21.15.192:0/1293435660 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe510055070 con 0x561e0d7a0f50 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.745+0000 7fe517fff640 1 --2- 172.21.15.192:0/1293435660 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe3f403c780 0x7fe3f403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.745+0000 7fe52192e800 1 Processor -- start 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.745+0000 7fe52192e800 1 -- start start 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.745+0000 7fe517fff640 1 --2- 172.21.15.192:0/1293435660 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe3f403c780 0x7fe3f403ec40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x561e0d784f60 tx=0x7fe508006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.746+0000 7fe52192e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 0x561e0d7adc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.746+0000 7fe52192e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561e0d77be40 con 0x561e0d7ad850 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.746+0000 7fe51d6dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 0x561e0d7adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.746+0000 7fe51d6dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 0x561e0d7adc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60410/0 (socket says 172.21.15.192:60410) 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.746+0000 7fe51d6dd640 1 -- 172.21.15.192:0/170109748 learned_addr learned my addr 172.21.15.192:0/170109748 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.746+0000 7fe51d6dd640 1 -- 172.21.15.192:0/170109748 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e0d7ae220 con 0x561e0d7ad850 2024-09-10T05:12:08.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.746+0000 7fe51d6dd640 1 --2- 172.21.15.192:0/170109748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 0x561e0d7adc30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe51005f8d0 tx=0x7fe510073f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf576e39acc8045 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.746+0000 7fe400ff9640 1 -- 172.21.15.192:0/170109748 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe51007de20 con 0x561e0d7ad850 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.746+0000 7fe400ff9640 1 -- 172.21.15.192:0/170109748 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5100a9030 con 0x561e0d7ad850 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.746+0000 7fe400ff9640 1 -- 172.21.15.192:0/170109748 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe510097860 con 0x561e0d7ad850 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe52192e800 1 -- 172.21.15.192:0/170109748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 msgr2=0x561e0d7adc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe52192e800 1 --2- 172.21.15.192:0/170109748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 0x561e0d7adc30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe51005f8d0 tx=0x7fe510073f30 comp rx=0 tx=0).stop 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe52192e800 1 -- 172.21.15.192:0/170109748 shutdown_connections 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe52192e800 1 --2- 172.21.15.192:0/170109748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 0x561e0d7adc30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe52192e800 1 -- 172.21.15.192:0/170109748 >> 172.21.15.192:0/170109748 conn(0x561e0d7a9c50 msgr2=0x561e0d7a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe52192e800 1 -- 172.21.15.192:0/170109748 shutdown_connections 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe52192e800 1 -- 172.21.15.192:0/170109748 wait complete. 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe52192e800 1 Processor -- start 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe52192e800 1 -- start start 2024-09-10T05:12:08.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe52192e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 0x561e0d7b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe52192e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561e0d7ae6b0 con 0x561e0d7ad850 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe51d6dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 0x561e0d7b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe51d6dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 0x561e0d7b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60418/0 (socket says 172.21.15.192:60418) 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.747+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 learned_addr learned my addr 172.21.15.192:0/86111862 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.748+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e0d7b51b0 con 0x561e0d7ad850 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.748+0000 7fe51d6dd640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 0x561e0d7b4c50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe51005cad0 tx=0x7fe510090ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.748+0000 7fe3f2ffd640 1 -- 172.21.15.192:0/86111862 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe51005bc20 con 0x561e0d7ad850 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.748+0000 7fe3f2ffd640 1 -- 172.21.15.192:0/86111862 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5100b8030 con 0x561e0d7ad850 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.748+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e0d7b51b0 con 0x561e0d7ad850 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.748+0000 7fe3f2ffd640 1 -- 172.21.15.192:0/86111862 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe51008fa70 con 0x561e0d7ad850 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.748+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e0d7b51b0 con 0x561e0d7ad850 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.749+0000 7fe3f2ffd640 1 -- 172.21.15.192:0/86111862 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe51008fc10 con 0x561e0d7ad850 2024-09-10T05:12:08.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.749+0000 7fe3f2ffd640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe3e803c780 0x7fe3e803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.749+0000 7fe3f2ffd640 1 -- 172.21.15.192:0/86111862 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe5100bed30 con 0x561e0d7ad850 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.749+0000 7fe517fff640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe3e803c780 0x7fe3e803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.749+0000 7fe52192e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.749+0000 7fe52192e800 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561e0d7c0080 0x561e0d7c2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.749+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c2c90 con 0x561e0d7c0080 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.749+0000 7fe51dede640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561e0d7c0080 0x561e0d7c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe517fff640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe3e803c780 0x7fe3e803ec40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe50800ffd0 tx=0x7fe508023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe51dede640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561e0d7c0080 0x561e0d7c2540 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe52192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe52192e800 20 realm 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe52192e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c30a0 con 0x561e0d7c0080 2024-09-10T05:12:08.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe52192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe52192e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:08.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe52192e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3970 con 0x561e0d7c0080 2024-09-10T05:12:08.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe52192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe52192e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.750+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c0080 2024-09-10T05:12:08.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe52192e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:08.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe52192e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe52192e800 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561e0d7c4840 0x561e0d7c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c7390 con 0x561e0d7c4840 2024-09-10T05:12:08.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe51d6dd640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561e0d7c4840 0x561e0d7c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe51d6dd640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561e0d7c4840 0x561e0d7c6c30 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe52192e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:08.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe52192e800 20 searching for the correct realm 2024-09-10T05:12:08.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe52192e800 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561e0d7c9440 0x561e0d7cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cbfd0 con 0x561e0d7c9440 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.751+0000 7fe517fff640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561e0d7c9440 0x561e0d7cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.752+0000 7fe517fff640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561e0d7c9440 0x561e0d7cb900 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.752+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.752+0000 7fe517fff640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe50802e910 0x7fe50803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.752+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cbfd0 con 0x7fe50802e910 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.752+0000 7fe51dede640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe50802e910 0x7fe50803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.752+0000 7fe51dede640 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe50802e910 0x7fe50803a3c0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.753+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.753+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c4840 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.753+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.753+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c0080 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.753+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.753+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c0080 2024-09-10T05:12:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.753+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.753+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c4840 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.754+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.754+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c4840 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.754+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.754+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x7fe50802e910 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.754+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.754+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c9440 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.754+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.754+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c0080 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.755+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.755+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c4840 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.755+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.755+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c0080 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.755+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.755+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x7fe50802e910 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.755+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.755+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c9440 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.756+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.756+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c9440 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.756+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.756+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c4840 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.756+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.756+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c9440 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.756+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.756+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c9440 2024-09-10T05:12:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.756+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.756+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c0080 2024-09-10T05:12:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.757+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.757+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c0080 2024-09-10T05:12:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.757+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.757+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x7fe50802e910 2024-09-10T05:12:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.757+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.757+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c9440 2024-09-10T05:12:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.757+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.757+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x7fe50802e910 2024-09-10T05:12:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.758+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.758+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c0080 2024-09-10T05:12:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.758+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.758+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c4840 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.758+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.758+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c9440 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.758+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.758+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c4840 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.759+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.759+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x7fe50802e910 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.759+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.759+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c9440 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.759+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.759+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x7fe50802e910 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.759+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.759+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x561e0d7c0080 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.759+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.759+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c3d10 con 0x7fe50802e910 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c7d40 con 0x561e0d7c0080 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c7d40 con 0x561e0d7c0080 2024-09-10T05:12:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c7d10 con 0x7fe50802e910 2024-09-10T05:12:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 zone default found 2024-09-10T05:12:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 4 Realm: () 2024-09-10T05:12:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 zonegroup default 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.760+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c8130 con 0x561e0d7c4840 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe52192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe52192e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7c7c40 con 0x561e0d7c9440 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe52192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe52192e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cde40 con 0x561e0d7c9440 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe52192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe52192e800 20 started sync module instance, tier type = 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe52192e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.761+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cd2e0 con 0x7fe50802e910 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.762+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.762+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94687075293152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cd2e0 con 0x7fe50802e910 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.762+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7ce8d0 con 0x561e0d7c0080 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.763+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94687075293152] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.764+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.764+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94687075296208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cd2e0 con 0x561e0d7c0080 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.764+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cf350 con 0x561e0d7c9440 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.765+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94687075296208] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.765+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.765+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94687075290672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cd250 con 0x561e0d7c9440 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.765+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d0210 con 0x7fe50802e910 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.766+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94687075290672] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.766+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.766+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94687075302752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d0630 con 0x7fe50802e910 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.766+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d0ff0 con 0x561e0d7c0080 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.767+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.767+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94687075306304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d1410 con 0x561e0d7c0080 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.767+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d1ed0 con 0x561e0d7c4840 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.767+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94687075302752] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.768+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.768+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94687075309984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d22c0 con 0x561e0d7c4840 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.768+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d2cc0 con 0x561e0d7c4840 2024-09-10T05:12:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.768+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94687075306304] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.769+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94687075309984] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.769+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.769+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94687075307360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d3060 con 0x561e0d7c4840 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.769+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d38b0 con 0x561e0d7c4840 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.770+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94687075307360] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.770+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.770+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94687075315808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d3930 con 0x561e0d7c4840 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.770+0000 7fe52192e800 20 add_watcher() i=0 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.770+0000 7fe52192e800 20 add_watcher() i=1 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.770+0000 7fe52192e800 20 add_watcher() i=2 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.770+0000 7fe52192e800 20 add_watcher() i=3 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.770+0000 7fe52192e800 20 add_watcher() i=4 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.770+0000 7fe52192e800 20 add_watcher() i=5 2024-09-10T05:12:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.770+0000 7fe52192e800 20 add_watcher() i=6 2024-09-10T05:12:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.771+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94687075315808] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.771+0000 7fe52192e800 20 add_watcher() i=7 2024-09-10T05:12:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.771+0000 7fe52192e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.771+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d6c90 con 0x561e0d7c0080 2024-09-10T05:12:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.772+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.772+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94687075329680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d3aa0 con 0x561e0d7c0080 2024-09-10T05:12:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.773+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94687075329680] v37'176 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.773+0000 7fe3d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.773+0000 7fe52192e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.773+0000 7fe52192e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.773+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7df1f0 con 0x561e0d7c0080 2024-09-10T05:12:08.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.774+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'52 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.774+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7df7e0 con 0x561e0d7c4840 2024-09-10T05:12:08.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.775+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.776+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7df7c0 con 0x561e0d7c9440 2024-09-10T05:12:08.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.776+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.776+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e01e0 con 0x561e0d7c0080 2024-09-10T05:12:08.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.778+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'177 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.778+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dd3d0 con 0x7fe50802e910 2024-09-10T05:12:08.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.778+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'62 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.779+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dd3a0 con 0x561e0d7c9440 2024-09-10T05:12:08.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.780+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'49 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.780+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e13c0 con 0x561e0d7c0080 2024-09-10T05:12:08.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.781+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.781+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e13c0 con 0x561e0d7c4840 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.782+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.782+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1400 con 0x7fe50802e910 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.782+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.783+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1460 con 0x561e0d7c9440 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.783+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.783+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1ad0 con 0x7fe50802e910 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.784+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'63 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.784+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1a60 con 0x561e0d7c4840 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.785+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.786+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1a60 con 0x7fe50802e910 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.786+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.786+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1a60 con 0x561e0d7c4840 2024-09-10T05:12:08.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.787+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'55 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.787+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e19d0 con 0x561e0d7c0080 2024-09-10T05:12:08.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.788+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'178 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.789+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e19d0 con 0x561e0d7c9440 2024-09-10T05:12:08.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.789+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'59 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.789+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e2020 con 0x7fe50802e910 2024-09-10T05:12:08.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.790+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'64 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.790+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f60 con 0x561e0d7c9440 2024-09-10T05:12:08.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.791+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'35 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.791+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f60 con 0x561e0d7c0080 2024-09-10T05:12:08.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.792+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.792+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f60 con 0x561e0d7c0080 2024-09-10T05:12:08.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.793+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'179 uv174 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.793+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f60 con 0x561e0d7c9440 2024-09-10T05:12:08.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.794+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'60 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.794+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f40 con 0x7fe50802e910 2024-09-10T05:12:08.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.795+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.795+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f40 con 0x561e0d7c9440 2024-09-10T05:12:08.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.796+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.796+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f20 con 0x561e0d7c9440 2024-09-10T05:12:08.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.797+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'40 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.798+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f20 con 0x561e0d7c9440 2024-09-10T05:12:08.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.798+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.798+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f20 con 0x561e0d7c9440 2024-09-10T05:12:08.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.799+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'50 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.799+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f20 con 0x561e0d7c4840 2024-09-10T05:12:08.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.801+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.801+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f20 con 0x561e0d7c9440 2024-09-10T05:12:08.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.802+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.802+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f20 con 0x561e0d7c4840 2024-09-10T05:12:08.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.803+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.803+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f20 con 0x561e0d7c9440 2024-09-10T05:12:08.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.804+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'61 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.804+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f20 con 0x561e0d7c4840 2024-09-10T05:12:08.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.806+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'56 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.806+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7e1f20 con 0x7fe50802e910 2024-09-10T05:12:08.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.807+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.807+0000 7fe3d2fe5640 20 reqs_thread_entry: start 2024-09-10T05:12:08.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.807+0000 7fe52192e800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:08.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.807+0000 7fe52192e800 20 Filter name: none 2024-09-10T05:12:08.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.807+0000 7fe3d0fe1640 20 reqs_thread_entry: start 2024-09-10T05:12:08.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.807+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.808+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.808+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.808+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.808+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.808+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.808+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.809+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.809+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.809+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.809+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.809+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.809+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.810+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.810+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.810+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.810+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.810+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.810+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.810+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv169 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.810+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.810+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv169 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.811+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.811+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv169 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.811+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.811+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.811+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.811+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.811+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.812+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.812+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.812+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv46 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.812+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.812+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv46 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.812+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.812+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv46 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.812+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.813+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.813+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.813+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.813+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.813+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.813+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.814+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.814+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.814+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.814+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.815+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.815+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.815+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.815+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.815+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.815+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.816+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.816+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.816+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.816+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.816+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.816+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.816+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.816+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.817+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.817+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.817+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.817+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.817+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.817+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.818+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.818+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.818+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.818+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.819+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.819+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.819+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.819+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.819+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.819+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.820+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.820+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.820+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.820+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.820+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.820+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.820+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.820+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.821+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.821+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.821+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv171 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.821+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.821+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.821+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.821+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.821+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.822+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.822+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.822+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.822+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.822+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.822+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.822+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv61 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.822+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.823+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.823+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.823+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.823+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.823+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.823+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.823+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.823+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.824+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.824+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.824+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.824+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.824+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.824+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.824+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv174 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.824+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.825+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv174 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.825+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c0080 2024-09-10T05:12:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.825+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv174 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.825+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.825+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.825+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.825+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.825+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.826+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.826+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.826+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.826+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.826+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.826+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.826+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.826+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.826+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.827+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.827+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.827+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.827+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.827+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.827+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508037040 con 0x561e0d7c9440 2024-09-10T05:12:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.827+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.827+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.827+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.828+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.828+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.828+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.828+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.828+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.828+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.829+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.829+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.829+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.829+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.829+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.829+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.829+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.829+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.830+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.830+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.830+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.830+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.830+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.830+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.831+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.831+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.831+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.831+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.831+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.831+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.832+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.832+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.832+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.832+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.832+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.832+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.832+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.832+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.833+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.833+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c9440 2024-09-10T05:12:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.833+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.833+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.834+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.834+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.834+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.834+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x561e0d7c4840 2024-09-10T05:12:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.834+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.834+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.834+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.834+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.835+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.835+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc920 con 0x7fe50802e910 2024-09-10T05:12:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.835+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.836+0000 7fe3d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.836+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94687075329680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7dc8c0 con 0x561e0d7c0080 2024-09-10T05:12:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.837+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94687075329680] v37'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.837+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94687075293152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d6690 con 0x7fe50802e910 2024-09-10T05:12:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.838+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94687075293152] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.838+0000 7fe52192e800 20 remove_watcher() i=0 2024-09-10T05:12:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.838+0000 7fe52192e800 2 removed watcher, disabling cache 2024-09-10T05:12:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.838+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94687075296208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cd7e0 con 0x561e0d7c0080 2024-09-10T05:12:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.839+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94687075296208] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.839+0000 7fe52192e800 20 remove_watcher() i=1 2024-09-10T05:12:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.839+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94687075290672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cd7e0 con 0x561e0d7c9440 2024-09-10T05:12:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.840+0000 7fe517fff640 1 -- 172.21.15.192:0/86111862 <== osd.3 v2:172.21.15.192:6816/1620624472 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94687075290672] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe508053040 con 0x561e0d7c9440 2024-09-10T05:12:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.840+0000 7fe52192e800 20 remove_watcher() i=2 2024-09-10T05:12:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.840+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94687075302752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cd7e0 con 0x7fe50802e910 2024-09-10T05:12:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.841+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.2 v2:172.21.15.192:6801/2435677948 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94687075302752] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x7fe50802e910 2024-09-10T05:12:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.841+0000 7fe52192e800 20 remove_watcher() i=3 2024-09-10T05:12:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.841+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94687075306304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cfd60 con 0x561e0d7c0080 2024-09-10T05:12:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.842+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 <== osd.1 v2:172.21.15.192:6800/3487349558 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94687075306304] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe51800a4d0 con 0x561e0d7c0080 2024-09-10T05:12:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.842+0000 7fe52192e800 20 remove_watcher() i=4 2024-09-10T05:12:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.842+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94687075309984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cd7e0 con 0x561e0d7c4840 2024-09-10T05:12:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.843+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94687075309984] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.844+0000 7fe52192e800 20 remove_watcher() i=5 2024-09-10T05:12:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.844+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94687075307360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7d0b40 con 0x561e0d7c4840 2024-09-10T05:12:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.844+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94687075307360] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.845+0000 7fe52192e800 20 remove_watcher() i=6 2024-09-10T05:12:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.845+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94687075315808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561e0d7cfd60 con 0x561e0d7c4840 2024-09-10T05:12:08.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.845+0000 7fe51d6dd640 1 -- 172.21.15.192:0/86111862 <== osd.0 v2:172.21.15.139:6800/2915567440 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94687075315808] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5100c4070 con 0x561e0d7c4840 2024-09-10T05:12:08.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.845+0000 7fe52192e800 20 remove_watcher() i=7 2024-09-10T05:12:08.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561e0d7c4840 msgr2=0x561e0d7c6c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561e0d7c4840 0x561e0d7c6c30 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561e0d7c0080 msgr2=0x561e0d7c2540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561e0d7c0080 0x561e0d7c2540 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe50802e910 msgr2=0x7fe50803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe50802e910 0x7fe50803a3c0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561e0d7c9440 msgr2=0x561e0d7cb900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561e0d7c9440 0x561e0d7cb900 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe3e803c780 msgr2=0x7fe3e803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe3e803c780 0x7fe3e803ec40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe50800ffd0 tx=0x7fe508023040 comp rx=0 tx=0).stop 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 msgr2=0x561e0d7b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe51dede640 1 -- 172.21.15.192:0/86111862 reap_dead start 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 0x561e0d7b4c50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe51005cad0 tx=0x7fe510090ea0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 shutdown_connections 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 --2- 172.21.15.192:0/86111862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7ad850 0x561e0d7b4c50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 >> 172.21.15.192:0/86111862 conn(0x561e0d7a9c50 msgr2=0x561e0d7a7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 shutdown_connections 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/86111862 wait complete. 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/1293435660 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe3f403c780 msgr2=0x7fe3f403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 --2- 172.21.15.192:0/1293435660 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe3f403c780 0x7fe3f403ec40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x561e0d784f60 tx=0x7fe508006000 comp rx=0 tx=0).stop 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/1293435660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7a0f50 msgr2=0x561e0d7a1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 --2- 172.21.15.192:0/1293435660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7a0f50 0x561e0d7a1370 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe510095ef0 tx=0x7fe510068a70 comp rx=0 tx=0).stop 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/1293435660 shutdown_connections 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 --2- 172.21.15.192:0/1293435660 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe3f403c780 0x7fe3f403ec40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 --2- 172.21.15.192:0/1293435660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d7a0f50 0x561e0d7a1370 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/1293435660 >> 172.21.15.192:0/1293435660 conn(0x561e0d795330 msgr2=0x561e0d795710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/1293435660 shutdown_connections 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.846+0000 7fe52192e800 1 -- 172.21.15.192:0/1293435660 wait complete. 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561e0d78c850 msgr2=0x561e0d78ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561e0d78c850 0x561e0d78ecf0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561e0d688e00 msgr2=0x561e0d78a4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561e0d688e00 0x561e0d78a4f0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561e0d7908e0 msgr2=0x561e0d792cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561e0d7908e0 0x561e0d792cd0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe40403c730 msgr2=0x7fe40403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe40403c730 0x7fe40403ebf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe508000c00 tx=0x7fe5080013b0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 msgr2=0x561e0d782ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 --2- 172.21.15.192:0/733141783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e0d6884c0 0x561e0d782ea0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe51000a470 tx=0x7fe510002fb0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe51dede640 1 -- 172.21.15.192:0/733141783 reap_dead start 2024-09-10T05:12:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 shutdown_connections 2024-09-10T05:12:08.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 >> 172.21.15.192:0/733141783 conn(0x561e0d6841b0 msgr2=0x561e0d7757c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 shutdown_connections 2024-09-10T05:12:08.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.847+0000 7fe52192e800 1 -- 172.21.15.192:0/733141783 wait complete. 2024-09-10T05:12:08.856 INFO:teuthology.orchestra.run.smithi192.stdout:[] 2024-09-10T05:12:08.856 DEBUG:tasks.util.rgw: json result: [] 2024-09-10T05:12:08.857 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T05:12:08.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T05:12:08.857 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T05:12:08.941 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:08.941 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:08.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.941+0000 7f415dd25800 1 Processor -- start 2024-09-10T05:12:08.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.941+0000 7f415dd25800 1 -- start start 2024-09-10T05:12:08.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.941+0000 7f415dd25800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55de9f5d2600 0x55de9f5d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.941+0000 7f415dd25800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de9f47be40 con 0x55de9f5d5020 2024-09-10T05:12:08.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.941+0000 7f415dd25800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55de9f446680 con 0x55de9f5d2600 2024-09-10T05:12:08.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.941+0000 7f4159933640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55de9f5d2600 0x55de9f5d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.941+0000 7f4159933640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55de9f5d2600 0x55de9f5d49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60424/0 (socket says 172.21.15.192:60424) 2024-09-10T05:12:08.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.941+0000 7f4153fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55de9f5d5020 0x55de9f5d74e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:33684/0 (socket says 172.21.15.192:33684) 2024-09-10T05:12:08.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.941+0000 7f4159933640 1 -- 172.21.15.192:0/1456293854 learned_addr learned my addr 172.21.15.192:0/1456293854 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.942+0000 7f4159933640 1 -- 172.21.15.192:0/1456293854 >> v1:172.21.15.139:6789/0 conn(0x55de9f5d5020 legacy=0x55de9f5d74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.942+0000 7f4159132640 1 -- 172.21.15.192:0/1456293854 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360151168 0 0) 0x55de9f47be40 con 0x55de9f5d5020 2024-09-10T05:12:08.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.942+0000 7f4159933640 1 -- 172.21.15.192:0/1456293854 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9f4626b0 con 0x55de9f5d2600 2024-09-10T05:12:08.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.943+0000 7f4159933640 1 --2- 172.21.15.192:0/1456293854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f5d49f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f414c00a520 tx=0x7f414c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb49d2c8ea4eb16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.944+0000 7f4159132640 1 -- 172.21.15.192:0/1456293854 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f414c055070 con 0x55de9f5d2600 2024-09-10T05:12:08.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.944+0000 7f4159132640 1 -- 172.21.15.192:0/1456293854 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f414c0515b0 con 0x55de9f5d2600 2024-09-10T05:12:08.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.944+0000 7f4159132640 1 -- 172.21.15.192:0/1456293854 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f414c0518d0 con 0x55de9f5d2600 2024-09-10T05:12:08.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.944+0000 7f415dd25800 1 -- 172.21.15.192:0/1456293854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 msgr2=0x55de9f5d49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.944+0000 7f415dd25800 1 --2- 172.21.15.192:0/1456293854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f5d49f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f414c00a520 tx=0x7f414c045ba0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.944+0000 7f415dd25800 1 -- 172.21.15.192:0/1456293854 shutdown_connections 2024-09-10T05:12:08.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.944+0000 7f415dd25800 1 --2- 172.21.15.192:0/1456293854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f5d49f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.944+0000 7f415dd25800 1 -- 172.21.15.192:0/1456293854 >> 172.21.15.192:0/1456293854 conn(0x55de9f5cc1c0 msgr2=0x55de9f5ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.944+0000 7f415dd25800 1 -- 172.21.15.192:0/1456293854 shutdown_connections 2024-09-10T05:12:08.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.944+0000 7f415dd25800 1 -- 172.21.15.192:0/1456293854 wait complete. 2024-09-10T05:12:08.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.958+0000 7f415dd25800 1 Processor -- start 2024-09-10T05:12:08.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.958+0000 7f415dd25800 1 -- start start 2024-09-10T05:12:08.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.958+0000 7f415dd25800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f6c1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.958+0000 7f415dd25800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55de9f46add0 con 0x55de9f5d2600 2024-09-10T05:12:08.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.958+0000 7f4159933640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f6c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.958+0000 7f4159933640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f6c1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60432/0 (socket says 172.21.15.192:60432) 2024-09-10T05:12:08.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.958+0000 7f4159933640 1 -- 172.21.15.192:0/1015930329 learned_addr learned my addr 172.21.15.192:0/1015930329 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.958+0000 7f4159933640 1 -- 172.21.15.192:0/1015930329 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9f483e10 con 0x55de9f5d2600 2024-09-10T05:12:08.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.958+0000 7f4159933640 1 --2- 172.21.15.192:0/1015930329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f6c1470 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f414c045be0 tx=0x7f414c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e3aec6ac40c204 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.962+0000 7f4047e07640 1 -- 172.21.15.192:0/1015930329 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f414c051ac0 con 0x55de9f5d2600 2024-09-10T05:12:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.962+0000 7f4047e07640 1 -- 172.21.15.192:0/1015930329 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f414c051c60 con 0x55de9f5d2600 2024-09-10T05:12:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.962+0000 7f4047e07640 1 -- 172.21.15.192:0/1015930329 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f414c066460 con 0x55de9f5d2600 2024-09-10T05:12:08.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.963+0000 7f415dd25800 1 -- 172.21.15.192:0/1015930329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 msgr2=0x55de9f6c1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.963+0000 7f415dd25800 1 --2- 172.21.15.192:0/1015930329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f6c1470 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f414c045be0 tx=0x7f414c051000 comp rx=0 tx=0).stop 2024-09-10T05:12:08.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.963+0000 7f415dd25800 1 -- 172.21.15.192:0/1015930329 shutdown_connections 2024-09-10T05:12:08.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.963+0000 7f415dd25800 1 --2- 172.21.15.192:0/1015930329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f6c1470 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.963+0000 7f415dd25800 1 -- 172.21.15.192:0/1015930329 >> 172.21.15.192:0/1015930329 conn(0x55de9f5cc1c0 msgr2=0x55de9f6bcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.963+0000 7f415dd25800 1 -- 172.21.15.192:0/1015930329 shutdown_connections 2024-09-10T05:12:08.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.963+0000 7f415dd25800 1 -- 172.21.15.192:0/1015930329 wait complete. 2024-09-10T05:12:08.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.964+0000 7f415dd25800 1 Processor -- start 2024-09-10T05:12:08.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.964+0000 7f415dd25800 1 -- start start 2024-09-10T05:12:08.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.964+0000 7f415dd25800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f5d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.964+0000 7f415dd25800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55de9f5d9040 con 0x55de9f5d2600 2024-09-10T05:12:08.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.964+0000 7f4159933640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f5d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.964+0000 7f4159933640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f5d1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60440/0 (socket says 172.21.15.192:60440) 2024-09-10T05:12:08.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.964+0000 7f4159933640 1 -- 172.21.15.192:0/1704510385 learned_addr learned my addr 172.21.15.192:0/1704510385 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.964+0000 7f4159933640 1 -- 172.21.15.192:0/1704510385 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9f5d2280 con 0x55de9f5d2600 2024-09-10T05:12:08.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.965+0000 7f4159933640 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f5d1d20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f414c025da0 tx=0x7f414c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.965+0000 7f4046604640 1 -- 172.21.15.192:0/1704510385 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f414c066590 con 0x55de9f5d2600 2024-09-10T05:12:08.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.965+0000 7f4046604640 1 -- 172.21.15.192:0/1704510385 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f414c075070 con 0x55de9f5d2600 2024-09-10T05:12:08.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.965+0000 7f4046604640 1 -- 172.21.15.192:0/1704510385 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f414c066860 con 0x55de9f5d2600 2024-09-10T05:12:08.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.965+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de9f5d0630 con 0x55de9f5d2600 2024-09-10T05:12:08.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.965+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de9f5d0bf0 con 0x55de9f5d2600 2024-09-10T05:12:08.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.966+0000 7f4046604640 1 -- 172.21.15.192:0/1704510385 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f414c058070 con 0x55de9f5d2600 2024-09-10T05:12:08.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.966+0000 7f4046604640 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f404003c780 0x7f404003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.966+0000 7f4046604640 1 -- 172.21.15.192:0/1704510385 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f414c062070 con 0x55de9f5d2600 2024-09-10T05:12:08.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.966+0000 7f4153fff640 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f404003c780 0x7f404003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.966+0000 7f415dd25800 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de9f5d5020 0x55de9f6d2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.966+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f6d2770 con 0x55de9f5d5020 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.966+0000 7f415a134640 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de9f5d5020 0x55de9f6d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.966+0000 7f4153fff640 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f404003c780 0x7f404003ec40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4144000c00 tx=0x7f41440013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.966+0000 7f415a134640 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de9f5d5020 0x55de9f6d2230 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.967+0000 7f415a134640 1 -- 172.21.15.192:0/1704510385 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f5d5020 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.967+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f5d10d0 con 0x55de9f5d5020 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.967+0000 7f415a134640 1 -- 172.21.15.192:0/1704510385 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f5d5020 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.967+0000 7f415dd25800 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de9f6d4a80 0x55de9f6d6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.967+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f6d7540 con 0x55de9f6d4a80 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.967+0000 7f4159933640 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de9f6d4a80 0x55de9f6d6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.967+0000 7f4159933640 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de9f6d4a80 0x55de9f6d6e70 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.968+0000 7f4159933640 1 -- 172.21.15.192:0/1704510385 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f414c057030 con 0x55de9f6d4a80 2024-09-10T05:12:08.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.968+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f6d3920 con 0x55de9f5d5020 2024-09-10T05:12:08.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.968+0000 7f415a134640 1 -- 172.21.15.192:0/1704510385 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f5d5020 2024-09-10T05:12:08.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.968+0000 7f415dd25800 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55de9f6d8980 0x55de9f6dad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.968+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f6db4b0 con 0x55de9f6d8980 2024-09-10T05:12:08.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.968+0000 7f4153fff640 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55de9f6d8980 0x55de9f6dad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.968+0000 7f4153fff640 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55de9f6d8980 0x55de9f6dad70 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.969+0000 7f4153fff640 1 -- 172.21.15.192:0/1704510385 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f414400f670 con 0x55de9f6d8980 2024-09-10T05:12:08.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.969+0000 7f415dd25800 1 Processor -- start 2024-09-10T05:12:08.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.969+0000 7f415dd25800 1 -- start start 2024-09-10T05:12:08.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.969+0000 7f415dd25800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6e9110 0x55de9f6e9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.969+0000 7f415dd25800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55de9f4c8a00 con 0x55de9f6e9110 2024-09-10T05:12:08.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.969+0000 7f4159933640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6e9110 0x55de9f6e9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.969+0000 7f4159933640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6e9110 0x55de9f6e9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60452/0 (socket says 172.21.15.192:60452) 2024-09-10T05:12:08.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.969+0000 7f4159933640 1 -- 172.21.15.192:0/234232918 learned_addr learned my addr 172.21.15.192:0/234232918 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.970+0000 7f4159933640 1 -- 172.21.15.192:0/234232918 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9f6e9b70 con 0x55de9f6e9110 2024-09-10T05:12:08.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.970+0000 7f4159933640 1 --2- 172.21.15.192:0/234232918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6e9110 0x55de9f6e9530 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f414c050940 tx=0x7f414c065690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.970+0000 7f403f7fe640 1 -- 172.21.15.192:0/234232918 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f414c08d020 con 0x55de9f6e9110 2024-09-10T05:12:08.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.970+0000 7f403f7fe640 1 -- 172.21.15.192:0/234232918 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f414c06f530 con 0x55de9f6e9110 2024-09-10T05:12:08.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.970+0000 7f403f7fe640 1 -- 172.21.15.192:0/234232918 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f414c097040 con 0x55de9f6e9110 2024-09-10T05:12:08.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.970+0000 7f415dd25800 1 -- 172.21.15.192:0/234232918 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de9f6ea3a0 con 0x55de9f6e9110 2024-09-10T05:12:08.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.970+0000 7f415dd25800 1 -- 172.21.15.192:0/234232918 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de9f6ea940 con 0x55de9f6e9110 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.971+0000 7f403f7fe640 1 -- 172.21.15.192:0/234232918 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f414c09e060 con 0x55de9f6e9110 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.971+0000 7f403f7fe640 1 --2- 172.21.15.192:0/234232918 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f403403c780 0x7f403403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.971+0000 7f403f7fe640 1 -- 172.21.15.192:0/234232918 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f414c091030 con 0x55de9f6e9110 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.971+0000 7f4153fff640 1 --2- 172.21.15.192:0/234232918 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f403403c780 0x7f403403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.971+0000 7f415dd25800 1 Processor -- start 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.971+0000 7f415dd25800 1 -- start start 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.971+0000 7f4153fff640 1 --2- 172.21.15.192:0/234232918 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f403403c780 0x7f403403ec40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55de9f6d2c20 tx=0x7f4144006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.972+0000 7f415dd25800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 0x55de9f6f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.972+0000 7f415dd25800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55de9f6c1c00 con 0x55de9f6f59f0 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.972+0000 7f4159933640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 0x55de9f6f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.972+0000 7f4159933640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 0x55de9f6f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60456/0 (socket says 172.21.15.192:60456) 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.972+0000 7f4159933640 1 -- 172.21.15.192:0/3594082112 learned_addr learned my addr 172.21.15.192:0/3594082112 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.972+0000 7f4159933640 1 -- 172.21.15.192:0/3594082112 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9f6f63c0 con 0x55de9f6f59f0 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.972+0000 7f4159933640 1 --2- 172.21.15.192:0/3594082112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 0x55de9f6f5dd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f414c065720 tx=0x7f414c057bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875afe4cb070fdff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.972+0000 7f403d7fa640 1 -- 172.21.15.192:0/3594082112 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f414c0ae020 con 0x55de9f6f59f0 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.972+0000 7f403d7fa640 1 -- 172.21.15.192:0/3594082112 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f414c065840 con 0x55de9f6f59f0 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.972+0000 7f403d7fa640 1 -- 172.21.15.192:0/3594082112 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f414c065bc0 con 0x55de9f6f59f0 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f415dd25800 1 -- 172.21.15.192:0/3594082112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 msgr2=0x55de9f6f5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f415dd25800 1 --2- 172.21.15.192:0/3594082112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 0x55de9f6f5dd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f414c065720 tx=0x7f414c057bd0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f415dd25800 1 -- 172.21.15.192:0/3594082112 shutdown_connections 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f415dd25800 1 --2- 172.21.15.192:0/3594082112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 0x55de9f6f5dd0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f415dd25800 1 -- 172.21.15.192:0/3594082112 >> 172.21.15.192:0/3594082112 conn(0x55de9f6f1df0 msgr2=0x55de9f6f0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f415dd25800 1 -- 172.21.15.192:0/3594082112 shutdown_connections 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f415dd25800 1 -- 172.21.15.192:0/3594082112 wait complete. 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f415dd25800 1 Processor -- start 2024-09-10T05:12:08.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f415dd25800 1 -- start start 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f415dd25800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 0x55de9f6fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f415dd25800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55de9f6f6850 con 0x55de9f6f59f0 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f4159933640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 0x55de9f6fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f4159933640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 0x55de9f6fcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60470/0 (socket says 172.21.15.192:60470) 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.973+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 learned_addr learned my addr 172.21.15.192:0/356271049 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.974+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9f6fd2f0 con 0x55de9f6f59f0 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.974+0000 7f4159933640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 0x55de9f6fcd90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f414c053fe0 tx=0x7f414c09ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.974+0000 7f402b7fe640 1 -- 172.21.15.192:0/356271049 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f414c0c3070 con 0x55de9f6f59f0 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.974+0000 7f402b7fe640 1 -- 172.21.15.192:0/356271049 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f414c097710 con 0x55de9f6f59f0 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.974+0000 7f402b7fe640 1 -- 172.21.15.192:0/356271049 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f414c066a00 con 0x55de9f6f59f0 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.974+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de9f6fd2f0 con 0x55de9f6f59f0 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.974+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de9f6fd2f0 con 0x55de9f6f59f0 2024-09-10T05:12:08.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.975+0000 7f402b7fe640 1 -- 172.21.15.192:0/356271049 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f414c0c6070 con 0x55de9f6f59f0 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.975+0000 7f402b7fe640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f402403c730 0x7f402403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.975+0000 7f402b7fe640 1 -- 172.21.15.192:0/356271049 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f414c0b9030 con 0x55de9f6f59f0 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.975+0000 7f4153fff640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f402403c730 0x7f402403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.976+0000 7f4153fff640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f402403c730 0x7f402403ebf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f414400ffd0 tx=0x7f4144023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.976+0000 7f415dd25800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.976+0000 7f415dd25800 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de9f708220 0x55de9f70a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.976+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70ae30 con 0x55de9f708220 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.976+0000 7f415a134640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de9f708220 0x55de9f70a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.976+0000 7f415a134640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de9f708220 0x55de9f70a6e0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 20 realm 2024-09-10T05:12:08.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70b240 con 0x55de9f708220 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70bb10 con 0x55de9f708220 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f708220 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:08.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 20 rados->read ofs=0 len=0 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de9f70cc10 0x55de9f70f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.977+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70f5c0 con 0x55de9f70cc10 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.978+0000 7f4159933640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de9f70cc10 0x55de9f70f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.978+0000 7f4159933640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de9f70cc10 0x55de9f70f000 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.978+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.978+0000 7f415dd25800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.978+0000 7f415dd25800 20 searching for the correct realm 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.978+0000 7f415dd25800 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55de9f711570 0x55de9f713a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.978+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f714100 con 0x55de9f711570 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.978+0000 7f4153fff640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55de9f711570 0x55de9f713a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.979+0000 7f4153fff640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55de9f711570 0x55de9f713a30 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.979+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:08.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.979+0000 7f4153fff640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f414402e910 0x7f414403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:08.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.979+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f714100 con 0x7f414402e910 2024-09-10T05:12:08.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.979+0000 7f415a134640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f414402e910 0x7f414403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:08.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.979+0000 7f415a134640 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f414402e910 0x7f414403a3c0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:08.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.979+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:08.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.979+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f70cc10 2024-09-10T05:12:08.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.980+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:08.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.980+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f708220 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.980+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.980+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f708220 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.980+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.980+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f70cc10 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.981+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.981+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f70cc10 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.981+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.981+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x7f414402e910 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.981+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.981+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f711570 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.981+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.981+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f708220 2024-09-10T05:12:08.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.982+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.982+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f70cc10 2024-09-10T05:12:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.982+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.982+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f708220 2024-09-10T05:12:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.982+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.982+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x7f414402e910 2024-09-10T05:12:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.982+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.982+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f711570 2024-09-10T05:12:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.983+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.983+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f711570 2024-09-10T05:12:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.983+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.983+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f70cc10 2024-09-10T05:12:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.983+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:08.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.983+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f711570 2024-09-10T05:12:08.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.983+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:08.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.983+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f711570 2024-09-10T05:12:08.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.983+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:08.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.983+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f708220 2024-09-10T05:12:08.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.984+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:08.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.984+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f708220 2024-09-10T05:12:08.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.984+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:08.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.984+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x7f414402e910 2024-09-10T05:12:08.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.984+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:08.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.984+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f711570 2024-09-10T05:12:08.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.984+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.984+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x7f414402e910 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.984+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.984+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f708220 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.985+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.985+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f70cc10 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.985+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.985+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f711570 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.985+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.985+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f70cc10 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.986+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.986+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x7f414402e910 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.986+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.986+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f711570 2024-09-10T05:12:09.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.986+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.986+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x7f414402e910 2024-09-10T05:12:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.986+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.986+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x55de9f708220 2024-09-10T05:12:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.986+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.986+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70beb0 con 0x7f414402e910 2024-09-10T05:12:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70fe80 con 0x55de9f708220 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70fe80 con 0x55de9f708220 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f70fe80 con 0x7f414402e910 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 zone default found 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 4 Realm: () 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 zonegroup default 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.987+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f710720 con 0x55de9f70cc10 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f415dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f415dd25800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f715f70 con 0x55de9f711570 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f415dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f415dd25800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f716310 con 0x55de9f711570 2024-09-10T05:12:09.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f415dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f415dd25800 20 started sync module instance, tier type = 2024-09-10T05:12:09.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f415dd25800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:09.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.988+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f715410 con 0x7f414402e910 2024-09-10T05:12:09.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.989+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.989+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94414646104176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f715af0 con 0x7f414402e910 2024-09-10T05:12:09.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.989+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f716d10 con 0x55de9f708220 2024-09-10T05:12:09.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.990+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94414646104176] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.991+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.991+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94414646110240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f715ab0 con 0x55de9f708220 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.991+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f717740 con 0x55de9f711570 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.992+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94414646110240] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.992+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.992+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94414646105600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f717b60 con 0x55de9f711570 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.992+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f718520 con 0x7f414402e910 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.993+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94414646105600] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.993+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.993+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94414646116464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f718490 con 0x7f414402e910 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.993+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f7192b0 con 0x55de9f708220 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.994+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.994+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94414646119872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f7192b0 con 0x55de9f708220 2024-09-10T05:12:09.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.994+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f71a230 con 0x55de9f70cc10 2024-09-10T05:12:09.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.997+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.997+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94414646116464] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.997+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94414646118672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f71a620 con 0x55de9f70cc10 2024-09-10T05:12:09.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.997+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f71b040 con 0x55de9f70cc10 2024-09-10T05:12:09.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.997+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94414646119872] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.998+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.998+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94414646122144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f71b8e0 con 0x55de9f70cc10 2024-09-10T05:12:09.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.998+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f71b8e0 con 0x55de9f70cc10 2024-09-10T05:12:09.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.998+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94414646118672] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.999+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94414646122144] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.999+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.999+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94414646129632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f71b800 con 0x55de9f70cc10 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.999+0000 7f415dd25800 20 add_watcher() i=0 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.999+0000 7f415dd25800 20 add_watcher() i=1 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.999+0000 7f415dd25800 20 add_watcher() i=2 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.999+0000 7f415dd25800 20 add_watcher() i=3 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.999+0000 7f415dd25800 20 add_watcher() i=4 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.999+0000 7f415dd25800 20 add_watcher() i=5 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:08.999+0000 7f415dd25800 20 add_watcher() i=6 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.000+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94414646129632] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.000+0000 7f415dd25800 20 add_watcher() i=7 2024-09-10T05:12:09.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.000+0000 7f415dd25800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.000+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f71f2d0 con 0x55de9f708220 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.000+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.000+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94414646132208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f71c6c0 con 0x55de9f708220 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.001+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94414646132208] v37'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.001+0000 7f400b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.001+0000 7f415dd25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.001+0000 7f415dd25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.001+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f727a20 con 0x55de9f708220 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.003+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'53 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.003+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f727a20 con 0x55de9f70cc10 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.004+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.004+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f727a20 con 0x55de9f711570 2024-09-10T05:12:09.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.005+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.005+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f7289f0 con 0x55de9f708220 2024-09-10T05:12:09.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.006+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'182 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.006+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f7271e0 con 0x7f414402e910 2024-09-10T05:12:09.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.007+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'65 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.007+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f7271e0 con 0x55de9f711570 2024-09-10T05:12:09.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.008+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'51 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.008+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f729b30 con 0x55de9f708220 2024-09-10T05:12:09.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.009+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.009+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f726080 con 0x55de9f70cc10 2024-09-10T05:12:09.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.010+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.010+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f726080 con 0x7f414402e910 2024-09-10T05:12:09.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.011+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.011+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f726080 con 0x55de9f711570 2024-09-10T05:12:09.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.012+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.012+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f726080 con 0x7f414402e910 2024-09-10T05:12:09.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.013+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'66 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.013+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72a690 con 0x55de9f70cc10 2024-09-10T05:12:09.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.014+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.014+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72a690 con 0x7f414402e910 2024-09-10T05:12:09.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.015+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.015+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72a690 con 0x55de9f70cc10 2024-09-10T05:12:09.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.016+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'57 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.016+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72a690 con 0x55de9f708220 2024-09-10T05:12:09.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.017+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'183 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.017+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72a690 con 0x55de9f711570 2024-09-10T05:12:09.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.018+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'62 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.018+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x7f414402e910 2024-09-10T05:12:09.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.019+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'67 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.019+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f711570 2024-09-10T05:12:09.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.020+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'36 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.020+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f708220 2024-09-10T05:12:09.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.022+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.022+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f708220 2024-09-10T05:12:09.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.022+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'184 uv174 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.022+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f711570 2024-09-10T05:12:09.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.023+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'63 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.023+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x7f414402e910 2024-09-10T05:12:09.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.024+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.024+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f711570 2024-09-10T05:12:09.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.025+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.025+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f711570 2024-09-10T05:12:09.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.026+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'41 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.026+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f711570 2024-09-10T05:12:09.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.027+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.027+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f711570 2024-09-10T05:12:09.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.028+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'52 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.028+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f70cc10 2024-09-10T05:12:09.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.029+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.029+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f711570 2024-09-10T05:12:09.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.030+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.030+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f70cc10 2024-09-10T05:12:09.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.032+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.032+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f711570 2024-09-10T05:12:09.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.033+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'64 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.033+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x55de9f70cc10 2024-09-10T05:12:09.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.034+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'58 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.034+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f72ab40 con 0x7f414402e910 2024-09-10T05:12:09.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.035+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.035+0000 7f400a7fc640 20 reqs_thread_entry: start 2024-09-10T05:12:09.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.035+0000 7f415dd25800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:09.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.035+0000 7f415dd25800 20 Filter name: none 2024-09-10T05:12:09.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.035+0000 7f3f7bfff640 20 reqs_thread_entry: start 2024-09-10T05:12:09.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.035+0000 7f415dd25800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:12:09.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.035+0000 7f415dd25800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.035+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f7255f0 con 0x55de9f708220 2024-09-10T05:12:09.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.036+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.036+0000 7f415dd25800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:12:09.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.036+0000 7f415dd25800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:12:09.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.036+0000 7f415dd25800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:12:09.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.036+0000 7f415dd25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:09.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.036+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55de9f757b60 con 0x7f414402e910 2024-09-10T05:12:09.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.036+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.038 INFO:teuthology.orchestra.run.smithi192.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T05:12:09.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.037+0000 7f400b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:09.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.037+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94414646132208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f728d10 con 0x55de9f708220 2024-09-10T05:12:09.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.038+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94414646132208] v37'185 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.038+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94414646104176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f728d10 con 0x7f414402e910 2024-09-10T05:12:09.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.039+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94414646104176] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.039+0000 7f415dd25800 20 remove_watcher() i=0 2024-09-10T05:12:09.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.039+0000 7f415dd25800 2 removed watcher, disabling cache 2024-09-10T05:12:09.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.039+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94414646110240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f715070 con 0x55de9f708220 2024-09-10T05:12:09.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.040+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94414646110240] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.040+0000 7f415dd25800 20 remove_watcher() i=1 2024-09-10T05:12:09.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.040+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94414646105600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f715070 con 0x55de9f711570 2024-09-10T05:12:09.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.041+0000 7f4153fff640 1 -- 172.21.15.192:0/356271049 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94414646105600] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4144037040 con 0x55de9f711570 2024-09-10T05:12:09.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.041+0000 7f415dd25800 20 remove_watcher() i=2 2024-09-10T05:12:09.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.041+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94414646116464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f715070 con 0x7f414402e910 2024-09-10T05:12:09.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.042+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94414646116464] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x7f414402e910 2024-09-10T05:12:09.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.042+0000 7f415dd25800 20 remove_watcher() i=3 2024-09-10T05:12:09.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.042+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94414646119872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f715070 con 0x55de9f708220 2024-09-10T05:12:09.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.043+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94414646119872] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f415400a4d0 con 0x55de9f708220 2024-09-10T05:12:09.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.043+0000 7f415dd25800 20 remove_watcher() i=4 2024-09-10T05:12:09.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.043+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94414646118672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f718dc0 con 0x55de9f70cc10 2024-09-10T05:12:09.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.044+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94414646118672] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.044+0000 7f415dd25800 20 remove_watcher() i=5 2024-09-10T05:12:09.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.044+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94414646122144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f715070 con 0x55de9f70cc10 2024-09-10T05:12:09.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.045+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94414646122144] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.045+0000 7f415dd25800 20 remove_watcher() i=6 2024-09-10T05:12:09.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.045+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94414646129632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55de9f7196a0 con 0x55de9f70cc10 2024-09-10T05:12:09.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.046+0000 7f4159933640 1 -- 172.21.15.192:0/356271049 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94414646129632] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f414c0c5030 con 0x55de9f70cc10 2024-09-10T05:12:09.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.046+0000 7f415dd25800 20 remove_watcher() i=7 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.046+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de9f70cc10 msgr2=0x55de9f70f000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.046+0000 7f415dd25800 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de9f70cc10 0x55de9f70f000 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.046+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de9f708220 msgr2=0x55de9f70a6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.046+0000 7f415dd25800 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de9f708220 0x55de9f70a6e0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.046+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f414402e910 msgr2=0x7f414403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.046+0000 7f415dd25800 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f414402e910 0x7f414403a3c0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.046+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55de9f711570 msgr2=0x55de9f713a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.046+0000 7f415dd25800 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55de9f711570 0x55de9f713a30 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f402403c730 msgr2=0x7f402403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f402403c730 0x7f402403ebf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f414400ffd0 tx=0x7f4144023040 comp rx=0 tx=0).stop 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 msgr2=0x55de9f6fcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415a134640 1 -- 172.21.15.192:0/356271049 reap_dead start 2024-09-10T05:12:09.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 0x55de9f6fcd90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f414c053fe0 tx=0x7f414c09ef30 comp rx=0 tx=0).stop 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 shutdown_connections 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 --2- 172.21.15.192:0/356271049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6f59f0 0x55de9f6fcd90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 >> 172.21.15.192:0/356271049 conn(0x55de9f6f1df0 msgr2=0x55de9f6f0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 shutdown_connections 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/356271049 wait complete. 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/234232918 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f403403c780 msgr2=0x7f403403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 --2- 172.21.15.192:0/234232918 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f403403c780 0x7f403403ec40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55de9f6d2c20 tx=0x7f4144006000 comp rx=0 tx=0).stop 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/234232918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6e9110 msgr2=0x55de9f6e9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 --2- 172.21.15.192:0/234232918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6e9110 0x55de9f6e9530 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f414c050940 tx=0x7f414c065690 comp rx=0 tx=0).stop 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/234232918 shutdown_connections 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 --2- 172.21.15.192:0/234232918 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f403403c780 0x7f403403ec40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 --2- 172.21.15.192:0/234232918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f6e9110 0x55de9f6e9530 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/234232918 >> 172.21.15.192:0/234232918 conn(0x55de9f6dd4c0 msgr2=0x55de9f6dd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/234232918 shutdown_connections 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/234232918 wait complete. 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de9f6d4a80 msgr2=0x55de9f6d6e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55de9f6d4a80 0x55de9f6d6e70 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de9f5d5020 msgr2=0x55de9f6d2230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55de9f5d5020 0x55de9f6d2230 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55de9f6d8980 msgr2=0x55de9f6dad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.047+0000 7f415dd25800 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55de9f6d8980 0x55de9f6dad70 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.048+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f404003c780 msgr2=0x7f404003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.048+0000 7f415dd25800 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f404003c780 0x7f404003ec40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4144000c00 tx=0x7f41440013b0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.048+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 msgr2=0x55de9f5d1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.048+0000 7f415dd25800 1 --2- 172.21.15.192:0/1704510385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55de9f5d2600 0x55de9f5d1d20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f414c025da0 tx=0x7f414c002fb0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.048+0000 7f415a134640 1 -- 172.21.15.192:0/1704510385 reap_dead start 2024-09-10T05:12:09.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.048+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 shutdown_connections 2024-09-10T05:12:09.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.048+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 >> 172.21.15.192:0/1704510385 conn(0x55de9f5cc1c0 msgr2=0x55de9f6c2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.048+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 shutdown_connections 2024-09-10T05:12:09.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.048+0000 7f415dd25800 1 -- 172.21.15.192:0/1704510385 wait complete. 2024-09-10T05:12:09.057 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T05:12:09.065 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-10T05:12:09.070 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:09.095 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:09.105 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:09.150 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-10T05:12:09.155 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:09.155 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T05:12:09.155 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T05:12:09.156 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-10T05:12:09.201 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:09.201 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:09.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.201+0000 7fad9bb0a800 1 Processor -- start 2024-09-10T05:12:09.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.201+0000 7fad9bb0a800 1 -- start start 2024-09-10T05:12:09.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.201+0000 7fad9bb0a800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55d4366bd480 0x55d4366bd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.201+0000 7fad9bb0a800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d436568e40 con 0x55d4366bddc0 2024-09-10T05:12:09.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.201+0000 7fad9bb0a800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55d436533680 con 0x55d4366bd480 2024-09-10T05:12:09.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.201+0000 7fad995f4640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55d4366bd480 0x55d4366bd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.201+0000 7fad98df3640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55d4366bddc0 0x55d4366be270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:33698/0 (socket says 172.21.15.192:33698) 2024-09-10T05:12:09.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.201+0000 7fad98df3640 1 -- 172.21.15.192:0/2777009040 learned_addr learned my addr 172.21.15.192:0/2777009040 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:09.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.202+0000 7fad995f4640 1 -- 172.21.15.192:0/2777009040 >> v1:172.21.15.139:6789/0 conn(0x55d4366bddc0 legacy=0x55d4366be270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.202+0000 7fad93fff640 1 -- 172.21.15.192:0/2777009040 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 728603579 0 0) 0x55d436568e40 con 0x55d4366bddc0 2024-09-10T05:12:09.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.202+0000 7fad995f4640 1 -- 172.21.15.192:0/2777009040 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d43654f6b0 con 0x55d4366bd480 2024-09-10T05:12:09.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.203+0000 7fad995f4640 1 --2- 172.21.15.192:0/2777009040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4366bd880 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fad8c005fd0 tx=0x7fad8c045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb56232dbb0dab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.204+0000 7fad93fff640 1 -- 172.21.15.192:0/2777009040 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c058530 con 0x55d4366bd480 2024-09-10T05:12:09.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.204+0000 7fad93fff640 1 -- 172.21.15.192:0/2777009040 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8c0586d0 con 0x55d4366bd480 2024-09-10T05:12:09.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.204+0000 7fad93fff640 1 -- 172.21.15.192:0/2777009040 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c0589d0 con 0x55d4366bd480 2024-09-10T05:12:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.204+0000 7fad9bb0a800 1 -- 172.21.15.192:0/2777009040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 msgr2=0x55d4366bd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.204+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/2777009040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4366bd880 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fad8c005fd0 tx=0x7fad8c045c30 comp rx=0 tx=0).stop 2024-09-10T05:12:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.204+0000 7fad9bb0a800 1 -- 172.21.15.192:0/2777009040 shutdown_connections 2024-09-10T05:12:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.204+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/2777009040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4366bd880 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.204+0000 7fad9bb0a800 1 -- 172.21.15.192:0/2777009040 >> 172.21.15.192:0/2777009040 conn(0x55d4366b91d0 msgr2=0x55d4366bb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.204+0000 7fad9bb0a800 1 -- 172.21.15.192:0/2777009040 shutdown_connections 2024-09-10T05:12:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.204+0000 7fad9bb0a800 1 -- 172.21.15.192:0/2777009040 wait complete. 2024-09-10T05:12:09.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.218+0000 7fad9bb0a800 1 Processor -- start 2024-09-10T05:12:09.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.218+0000 7fad9bb0a800 1 -- start start 2024-09-10T05:12:09.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.218+0000 7fad9bb0a800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4367b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.218+0000 7fad9bb0a800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d436557dd0 con 0x55d4366bd480 2024-09-10T05:12:09.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.218+0000 7fad995f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4367b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.218+0000 7fad995f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4367b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60492/0 (socket says 172.21.15.192:60492) 2024-09-10T05:12:09.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.218+0000 7fad995f4640 1 -- 172.21.15.192:0/2305624522 learned_addr learned my addr 172.21.15.192:0/2305624522 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.219+0000 7fad995f4640 1 -- 172.21.15.192:0/2305624522 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d436570e10 con 0x55d4366bd480 2024-09-10T05:12:09.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.219+0000 7fad995f4640 1 --2- 172.21.15.192:0/2305624522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4367b06d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fad8c025a60 tx=0x7fad8c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bae047a0cab530 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.219+0000 7fac87606640 1 -- 172.21.15.192:0/2305624522 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c058a30 con 0x55d4366bd480 2024-09-10T05:12:09.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.219+0000 7fac87606640 1 -- 172.21.15.192:0/2305624522 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8c068070 con 0x55d4366bd480 2024-09-10T05:12:09.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.219+0000 7fac87606640 1 -- 172.21.15.192:0/2305624522 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c058d00 con 0x55d4366bd480 2024-09-10T05:12:09.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.220+0000 7fad9bb0a800 1 -- 172.21.15.192:0/2305624522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 msgr2=0x55d4367b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.220+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/2305624522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4367b06d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fad8c025a60 tx=0x7fad8c051000 comp rx=0 tx=0).stop 2024-09-10T05:12:09.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.220+0000 7fad9bb0a800 1 -- 172.21.15.192:0/2305624522 shutdown_connections 2024-09-10T05:12:09.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.220+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/2305624522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4367b06d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.220+0000 7fad9bb0a800 1 -- 172.21.15.192:0/2305624522 >> 172.21.15.192:0/2305624522 conn(0x55d4366b91d0 msgr2=0x55d4367ac050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.220+0000 7fad9bb0a800 1 -- 172.21.15.192:0/2305624522 shutdown_connections 2024-09-10T05:12:09.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.220+0000 7fad9bb0a800 1 -- 172.21.15.192:0/2305624522 wait complete. 2024-09-10T05:12:09.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.220+0000 7fad9bb0a800 1 Processor -- start 2024-09-10T05:12:09.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.220+0000 7fad9bb0a800 1 -- start start 2024-09-10T05:12:09.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.220+0000 7fad9bb0a800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4367b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.220+0000 7fad9bb0a800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d4366bed40 con 0x55d4366bd480 2024-09-10T05:12:09.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.221+0000 7fad995f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4367b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.221+0000 7fad995f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4367b7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60502/0 (socket says 172.21.15.192:60502) 2024-09-10T05:12:09.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.221+0000 7fad995f4640 1 -- 172.21.15.192:0/3306616966 learned_addr learned my addr 172.21.15.192:0/3306616966 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.221+0000 7fad995f4640 1 -- 172.21.15.192:0/3306616966 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4367b83f0 con 0x55d4366bd480 2024-09-10T05:12:09.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.221+0000 7fad995f4640 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4367b7e90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fad8c025a60 tx=0x7fad8c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.221+0000 7fac85e03640 1 -- 172.21.15.192:0/3306616966 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c063650 con 0x55d4366bd480 2024-09-10T05:12:09.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.221+0000 7fac85e03640 1 -- 172.21.15.192:0/3306616966 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8c0637f0 con 0x55d4366bd480 2024-09-10T05:12:09.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.221+0000 7fac85e03640 1 -- 172.21.15.192:0/3306616966 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c063b10 con 0x55d4366bd480 2024-09-10T05:12:09.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.221+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4367b8680 con 0x55d4366bd480 2024-09-10T05:12:09.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.221+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4367b9080 con 0x55d4366bd480 2024-09-10T05:12:09.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.222+0000 7fac85e03640 1 -- 172.21.15.192:0/3306616966 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fad8c075020 con 0x55d4366bd480 2024-09-10T05:12:09.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.222+0000 7fac85e03640 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac8003c780 0x7fac8003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.222+0000 7fac85e03640 1 -- 172.21.15.192:0/3306616966 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fad8c097f70 con 0x55d4366bd480 2024-09-10T05:12:09.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.222+0000 7fad98df3640 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac8003c780 0x7fac8003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.222+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d4366bddc0 0x55d4367bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.223+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367b9c20 con 0x55d4366bddc0 2024-09-10T05:12:09.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.223+0000 7fad99df5640 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d4366bddc0 0x55d4367bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.223+0000 7fad98df3640 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac8003c780 0x7fac8003ec40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fad84000c00 tx=0x7fad840013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.223+0000 7fad99df5640 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d4366bddc0 0x55d4367bf4e0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.223+0000 7fad99df5640 1 -- 172.21.15.192:0/3306616966 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad940083e0 con 0x55d4366bddc0 2024-09-10T05:12:09.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.223+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367b9510 con 0x55d4366bddc0 2024-09-10T05:12:09.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.224+0000 7fad99df5640 1 -- 172.21.15.192:0/3306616966 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad940083e0 con 0x55d4366bddc0 2024-09-10T05:12:09.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.224+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d4367c1970 0x55d4367c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.224+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367c4430 con 0x55d4367c1970 2024-09-10T05:12:09.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.224+0000 7fad995f4640 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d4367c1970 0x55d4367c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.224+0000 7fad995f4640 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d4367c1970 0x55d4367c3d60 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.224+0000 7fad995f4640 1 -- 172.21.15.192:0/3306616966 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367c1970 2024-09-10T05:12:09.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.224+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367c0810 con 0x55d4366bddc0 2024-09-10T05:12:09.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.225+0000 7fad99df5640 1 -- 172.21.15.192:0/3306616966 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad940083e0 con 0x55d4366bddc0 2024-09-10T05:12:09.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.225+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55d4367c5870 0x55d4367c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.225+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367c83f0 con 0x55d4367c5870 2024-09-10T05:12:09.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.225+0000 7fad98df3640 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55d4367c5870 0x55d4367c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.225+0000 7fad98df3640 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55d4367c5870 0x55d4367c7c60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.225+0000 7fad98df3640 1 -- 172.21.15.192:0/3306616966 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fad8400f670 con 0x55d4367c5870 2024-09-10T05:12:09.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.226+0000 7fad9bb0a800 1 Processor -- start 2024-09-10T05:12:09.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.226+0000 7fad9bb0a800 1 -- start start 2024-09-10T05:12:09.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.226+0000 7fad9bb0a800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367d6010 0x55d4367d6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.226+0000 7fad9bb0a800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d4365b5a00 con 0x55d4367d6010 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.226+0000 7fad995f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367d6010 0x55d4367d6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.226+0000 7fad995f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367d6010 0x55d4367d6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60510/0 (socket says 172.21.15.192:60510) 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.226+0000 7fad995f4640 1 -- 172.21.15.192:0/3561246625 learned_addr learned my addr 172.21.15.192:0/3561246625 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.227+0000 7fad995f4640 1 -- 172.21.15.192:0/3561246625 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4367d6a70 con 0x55d4367d6010 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.227+0000 7fad995f4640 1 --2- 172.21.15.192:0/3561246625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367d6010 0x55d4367d6430 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fad8c063d60 tx=0x7fad8c06ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.227+0000 7fac7effd640 1 -- 172.21.15.192:0/3561246625 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c06bb90 con 0x55d4367d6010 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.227+0000 7fac7effd640 1 -- 172.21.15.192:0/3561246625 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8c06bd30 con 0x55d4367d6010 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.227+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3561246625 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4367d72a0 con 0x55d4367d6010 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.227+0000 7fac7effd640 1 -- 172.21.15.192:0/3561246625 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c04f610 con 0x55d4367d6010 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.227+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3561246625 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4367d7840 con 0x55d4367d6010 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.228+0000 7fac7effd640 1 -- 172.21.15.192:0/3561246625 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fad8c04f7d0 con 0x55d4367d6010 2024-09-10T05:12:09.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.228+0000 7fac7effd640 1 --2- 172.21.15.192:0/3561246625 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac7403c730 0x7fac7403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.228+0000 7fac7effd640 1 -- 172.21.15.192:0/3561246625 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fad8c090070 con 0x55d4367d6010 2024-09-10T05:12:09.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.228+0000 7fad98df3640 1 --2- 172.21.15.192:0/3561246625 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac7403c730 0x7fac7403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.228+0000 7fad9bb0a800 1 Processor -- start 2024-09-10T05:12:09.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.228+0000 7fad9bb0a800 1 -- start start 2024-09-10T05:12:09.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.228+0000 7fad98df3640 1 --2- 172.21.15.192:0/3561246625 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac7403c730 0x7fac7403ebf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55d4367c87f0 tx=0x7fad84006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.228+0000 7fad9bb0a800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 0x55d4367e2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.228+0000 7fad9bb0a800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d4367b0e60 con 0x55d4367e2910 2024-09-10T05:12:09.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.228+0000 7fad995f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 0x55d4367e2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.229+0000 7fad995f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 0x55d4367e2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60520/0 (socket says 172.21.15.192:60520) 2024-09-10T05:12:09.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.229+0000 7fad995f4640 1 -- 172.21.15.192:0/4220809839 learned_addr learned my addr 172.21.15.192:0/4220809839 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.229+0000 7fad995f4640 1 -- 172.21.15.192:0/4220809839 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4367e32e0 con 0x55d4367e2910 2024-09-10T05:12:09.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.229+0000 7fad995f4640 1 --2- 172.21.15.192:0/4220809839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 0x55d4367e2cf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fad8c06b500 tx=0x7fad8c09c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85bda0b8b24583e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.229+0000 7fac7cff9640 1 -- 172.21.15.192:0/4220809839 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c0619f0 con 0x55d4367e2910 2024-09-10T05:12:09.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.229+0000 7fac7cff9640 1 -- 172.21.15.192:0/4220809839 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8c0ad070 con 0x55d4367e2910 2024-09-10T05:12:09.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.229+0000 7fac7cff9640 1 -- 172.21.15.192:0/4220809839 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c061300 con 0x55d4367e2910 2024-09-10T05:12:09.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.229+0000 7fad9bb0a800 1 -- 172.21.15.192:0/4220809839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 msgr2=0x55d4367e2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.229+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/4220809839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 0x55d4367e2cf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fad8c06b500 tx=0x7fad8c09c6d0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad9bb0a800 1 -- 172.21.15.192:0/4220809839 shutdown_connections 2024-09-10T05:12:09.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/4220809839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 0x55d4367e2cf0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad9bb0a800 1 -- 172.21.15.192:0/4220809839 >> 172.21.15.192:0/4220809839 conn(0x55d4367ded10 msgr2=0x55d4367dcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad9bb0a800 1 -- 172.21.15.192:0/4220809839 shutdown_connections 2024-09-10T05:12:09.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad9bb0a800 1 -- 172.21.15.192:0/4220809839 wait complete. 2024-09-10T05:12:09.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad9bb0a800 1 Processor -- start 2024-09-10T05:12:09.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad9bb0a800 1 -- start start 2024-09-10T05:12:09.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad9bb0a800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 0x55d4367e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad9bb0a800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d4367e3770 con 0x55d4367e2910 2024-09-10T05:12:09.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad995f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 0x55d4367e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad995f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 0x55d4367e9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60524/0 (socket says 172.21.15.192:60524) 2024-09-10T05:12:09.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 learned_addr learned my addr 172.21.15.192:0/3662948117 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.230+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4367ea2a0 con 0x55d4367e2910 2024-09-10T05:12:09.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.231+0000 7fad995f4640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 0x55d4367e9d40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fad8c051010 tx=0x7fad8c062f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.231+0000 7fac6affd640 1 -- 172.21.15.192:0/3662948117 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c0619f0 con 0x55d4367e2910 2024-09-10T05:12:09.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.231+0000 7fac6affd640 1 -- 172.21.15.192:0/3662948117 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8c0b8070 con 0x55d4367e2910 2024-09-10T05:12:09.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.231+0000 7fac6affd640 1 -- 172.21.15.192:0/3662948117 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8c0614e0 con 0x55d4367e2910 2024-09-10T05:12:09.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.231+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4367ea2a0 con 0x55d4367e2910 2024-09-10T05:12:09.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.231+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4367ea2a0 con 0x55d4367e2910 2024-09-10T05:12:09.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.232+0000 7fac6affd640 1 -- 172.21.15.192:0/3662948117 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fad8c061680 con 0x55d4367e2910 2024-09-10T05:12:09.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.232+0000 7fac6affd640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac6403c730 0x7fac6403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.232+0000 7fac6affd640 1 -- 172.21.15.192:0/3662948117 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fad8c0ac180 con 0x55d4367e2910 2024-09-10T05:12:09.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.232+0000 7fad98df3640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac6403c730 0x7fac6403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.232+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.232+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d4367f5320 0x55d4367f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.232+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f7f30 con 0x55d4367f5320 2024-09-10T05:12:09.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad98df3640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac6403c730 0x7fac6403ebf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fad8400ffd0 tx=0x7fad84023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad99df5640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d4367f5320 0x55d4367f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad99df5640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d4367f5320 0x55d4367f77e0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad940083e0 con 0x55d4367f5320 2024-09-10T05:12:09.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad9bb0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad9bb0a800 20 realm 2024-09-10T05:12:09.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8340 con 0x55d4367f5320 2024-09-10T05:12:09.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad940083e0 con 0x55d4367f5320 2024-09-10T05:12:09.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad9bb0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad9bb0a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:09.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.233+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f5320 2024-09-10T05:12:09.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.234+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad940083e0 con 0x55d4367f5320 2024-09-10T05:12:09.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.234+0000 7fad9bb0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.234+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.234+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8fb0 con 0x55d4367f5320 2024-09-10T05:12:09.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.234+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad940083e0 con 0x55d4367f5320 2024-09-10T05:12:09.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.234+0000 7fad9bb0a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:09.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.234+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.234+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d4367f9970 0x55d4367fbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.234+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367fc3b0 con 0x55d4367f9970 2024-09-10T05:12:09.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.234+0000 7fad995f4640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d4367f9970 0x55d4367fbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.234+0000 7fad995f4640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d4367f9970 0x55d4367fbd60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.235+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.235+0000 7fad9bb0a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:09.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.235+0000 7fad9bb0a800 20 searching for the correct realm 2024-09-10T05:12:09.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.235+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55d4367fe340 0x55d436800800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.235+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d436800e80 con 0x55d4367fe340 2024-09-10T05:12:09.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.235+0000 7fad98df3640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55d4367fe340 0x55d436800800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.235+0000 7fad98df3640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55d4367fe340 0x55d436800800 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.235+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.235+0000 7fad98df3640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fad8402e910 0x7fad8403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.235+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d436800e80 con 0x7fad8402e910 2024-09-10T05:12:09.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.235+0000 7fad99df5640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fad8402e910 0x7fad8403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.236+0000 7fad99df5640 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fad8402e910 0x7fad8403a3c0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.236+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fad940083e0 con 0x7fad8402e910 2024-09-10T05:12:09.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.236+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f9970 2024-09-10T05:12:09.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.236+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.236+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f5320 2024-09-10T05:12:09.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.237+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad940083e0 con 0x55d4367f5320 2024-09-10T05:12:09.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.237+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f5320 2024-09-10T05:12:09.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.237+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad94026040 con 0x55d4367f5320 2024-09-10T05:12:09.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.237+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f9970 2024-09-10T05:12:09.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.237+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.237+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f9970 2024-09-10T05:12:09.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.237+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.237+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x7fad8402e910 2024-09-10T05:12:09.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.238+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad94026040 con 0x7fad8402e910 2024-09-10T05:12:09.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.238+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367fe340 2024-09-10T05:12:09.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.238+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.238+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f5320 2024-09-10T05:12:09.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.238+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad94026040 con 0x55d4367f5320 2024-09-10T05:12:09.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.238+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f9970 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.239+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.239+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f5320 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.239+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad94026040 con 0x55d4367f5320 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.239+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x7fad8402e910 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.239+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fad94026040 con 0x7fad8402e910 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.239+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367fe340 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.239+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.239+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367fe340 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.240+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.240+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f9970 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.240+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.240+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367fe340 2024-09-10T05:12:09.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.240+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.240+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367fe340 2024-09-10T05:12:09.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.240+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.241+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f5320 2024-09-10T05:12:09.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.241+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad94026040 con 0x55d4367f5320 2024-09-10T05:12:09.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.241+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f5320 2024-09-10T05:12:09.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.241+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fad94026040 con 0x55d4367f5320 2024-09-10T05:12:09.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.241+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x7fad8402e910 2024-09-10T05:12:09.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.241+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad94026040 con 0x7fad8402e910 2024-09-10T05:12:09.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.241+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367fe340 2024-09-10T05:12:09.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.241+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.241+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x7fad8402e910 2024-09-10T05:12:09.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.242+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad94026040 con 0x7fad8402e910 2024-09-10T05:12:09.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.242+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f5320 2024-09-10T05:12:09.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.242+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.242+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f9970 2024-09-10T05:12:09.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.242+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.242+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367fe340 2024-09-10T05:12:09.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.242+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.242+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f9970 2024-09-10T05:12:09.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.243+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.243+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x7fad8402e910 2024-09-10T05:12:09.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.243+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad94035040 con 0x7fad8402e910 2024-09-10T05:12:09.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.243+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367fe340 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.243+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.243+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x7fad8402e910 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.243+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad94035040 con 0x7fad8402e910 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.243+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fad9403a040 con 0x55d4367f5320 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fad9403a040 con 0x7fad8402e910 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad94035040 con 0x7fad8402e910 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:09.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f5320 2024-09-10T05:12:09.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x55d4367f5320 2024-09-10T05:12:09.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:09.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.244+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367f8c10 con 0x7fad8402e910 2024-09-10T05:12:09.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fad94035040 con 0x7fad8402e910 2024-09-10T05:12:09.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 20 zone default found 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 4 Realm: () 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 20 zonegroup default 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4367fcd10 con 0x55d4367f9970 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4368027c0 con 0x55d4367fe340 2024-09-10T05:12:09.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.245+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d436802b60 con 0x55d4367fe340 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.246+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.246+0000 7fad9bb0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.246+0000 7fad9bb0a800 20 started sync module instance, tier type = 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.246+0000 7fad9bb0a800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.246+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436801c50 con 0x7fad8402e910 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.247+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad94035040 con 0x7fad8402e910 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.247+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94369935794560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436801c50 con 0x7fad8402e910 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.247+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d4368035e0 con 0x55d4367f5320 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.248+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94369935794560] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad94035040 con 0x7fad8402e910 2024-09-10T05:12:09.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.248+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.248+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94369935798512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436801c50 con 0x55d4367f5320 2024-09-10T05:12:09.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.248+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436804060 con 0x55d4367fe340 2024-09-10T05:12:09.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.249+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94369935798512] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.249+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.249+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94369935792032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436801bc0 con 0x55d4367fe340 2024-09-10T05:12:09.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.249+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436804f20 con 0x7fad8402e910 2024-09-10T05:12:09.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.250+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94369935792032] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.251+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad94035040 con 0x7fad8402e910 2024-09-10T05:12:09.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.251+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94369935805040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436805340 con 0x7fad8402e910 2024-09-10T05:12:09.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.251+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436805bf0 con 0x55d4367f5320 2024-09-10T05:12:09.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.252+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.252+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94369935807296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436805760 con 0x55d4367f5320 2024-09-10T05:12:09.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.252+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436806ba0 con 0x55d4367f9970 2024-09-10T05:12:09.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.252+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94369935805040] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad94035040 con 0x7fad8402e910 2024-09-10T05:12:09.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.252+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94369935807296] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.253+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.253+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94369935810528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436806680 con 0x55d4367f9970 2024-09-10T05:12:09.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.253+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436807440 con 0x55d4367f9970 2024-09-10T05:12:09.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.254+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94369935810528] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.254+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.254+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94369935806096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436807440 con 0x55d4367f9970 2024-09-10T05:12:09.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.254+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436807e60 con 0x55d4367f9970 2024-09-10T05:12:09.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.255+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(58 notify.7 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.255+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94369935806096] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.255+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94369935817040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d4368082d0 con 0x55d4367f9970 2024-09-10T05:12:09.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.255+0000 7fad9bb0a800 20 add_watcher() i=0 2024-09-10T05:12:09.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.255+0000 7fad9bb0a800 20 add_watcher() i=1 2024-09-10T05:12:09.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.255+0000 7fad9bb0a800 20 add_watcher() i=2 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.255+0000 7fad9bb0a800 20 add_watcher() i=3 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.255+0000 7fad9bb0a800 20 add_watcher() i=4 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.255+0000 7fad9bb0a800 20 add_watcher() i=5 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.255+0000 7fad9bb0a800 20 add_watcher() i=6 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.256+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94369935817040] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.256+0000 7fad9bb0a800 20 add_watcher() i=7 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.256+0000 7fad9bb0a800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.256+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d4368082d0 con 0x55d4367f5320 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.256+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.256+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94369935818272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436808bd0 con 0x55d4367f5320 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.257+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94369935818272] v37'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.257+0000 7fac4ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:09.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.257+0000 7fad9bb0a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.257+0000 7fad9bb0a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.257+0000 7fad9bb0a800 5 note: GC not initialized 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fac4efe5640 20 reqs_thread_entry: start 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fad9bb0a800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fad9bb0a800 20 Filter name: none 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fac4cfe1640 20 reqs_thread_entry: start 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fad9bb0a800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d43683ea10 con 0x7fad8402e910 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fad94035040 con 0x7fad8402e910 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fad9bb0a800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fad9bb0a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:12:09.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fad9bb0a800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fad9bb0a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 : miss 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fad9bb0a800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.258+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:63 8.11 8:8f8d60cd:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d436840460 con 0x55d4367fe340 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.259+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(63 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.259+0000 7fad9bb0a800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.259+0000 7fad9bb0a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 info.flags=0x17 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.259+0000 7fad9bb0a800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 to cache LRU end 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.259+0000 7fad9bb0a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.259+0000 7fad9bb0a800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.259+0000 7fad9bb0a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.259+0000 7fad9bb0a800 20 get_obj_state: octx=0x7fad94008c60 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d436842c88 s->prefetch_data=0 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.259+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 3.cs0 3:3279caba:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d436843e70 con 0x55d4367fe340 2024-09-10T05:12:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.259+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(64 92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.259+0000 7fad9bb0a800 10 manifest: total_size = 5 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.259+0000 7fad9bb0a800 20 get_obj_state: setting s->obj_tag to _06E1NsyGIy_7rj3zBc-DL1Mm6cBWYM8 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.260+0000 7fac4ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.260+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94369935818272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d43683c260 con 0x55d4367f5320 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.261+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94369935818272] v37'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.261+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94369935794560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d43683c260 con 0x7fad8402e910 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.262+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94369935794560] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad94035040 con 0x7fad8402e910 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.262+0000 7fad9bb0a800 20 remove_watcher() i=0 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.262+0000 7fad9bb0a800 2 removed watcher, disabling cache 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.262+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94369935798512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d43683c260 con 0x55d4367f5320 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.263+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94369935798512] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.263+0000 7fad9bb0a800 20 remove_watcher() i=1 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.263+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94369935792032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d43683c260 con 0x55d4367fe340 2024-09-10T05:12:09.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.265+0000 7fad98df3640 1 -- 172.21.15.192:0/3662948117 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94369935792032] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad84037040 con 0x55d4367fe340 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.265+0000 7fad9bb0a800 20 remove_watcher() i=2 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.265+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94369935805040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d4368017a0 con 0x7fad8402e910 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.266+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94369935805040] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad94035040 con 0x7fad8402e910 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.266+0000 7fad9bb0a800 20 remove_watcher() i=3 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.266+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94369935807296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d43683c260 con 0x55d4367f5320 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.267+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94369935807296] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad94035040 con 0x55d4367f5320 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.267+0000 7fad9bb0a800 20 remove_watcher() i=4 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.267+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94369935810528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d436804a70 con 0x55d4367f9970 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.268+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94369935810528] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.268+0000 7fad9bb0a800 20 remove_watcher() i=5 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.268+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94369935806096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d4368017a0 con 0x55d4367f9970 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.269+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94369935806096] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.269+0000 7fad9bb0a800 20 remove_watcher() i=6 2024-09-10T05:12:09.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.269+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94369935817040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d43683c260 con 0x55d4367f9970 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.270+0000 7fad995f4640 1 -- 172.21.15.192:0/3662948117 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94369935817040] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8c077ce0 con 0x55d4367f9970 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.270+0000 7fad9bb0a800 20 remove_watcher() i=7 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.270+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d4367f9970 msgr2=0x55d4367fbd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.270+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d4367f9970 0x55d4367fbd60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d4367f5320 msgr2=0x55d4367f77e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d4367f5320 0x55d4367f77e0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fad8402e910 msgr2=0x7fad8403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fad8402e910 0x7fad8403a3c0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55d4367fe340 msgr2=0x55d436800800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55d4367fe340 0x55d436800800 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac6403c730 msgr2=0x7fac6403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac6403c730 0x7fac6403ebf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fad8400ffd0 tx=0x7fad84023040 comp rx=0 tx=0).stop 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 msgr2=0x55d4367e9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad99df5640 1 -- 172.21.15.192:0/3662948117 reap_dead start 2024-09-10T05:12:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 0x55d4367e9d40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fad8c051010 tx=0x7fad8c062f30 comp rx=0 tx=0).stop 2024-09-10T05:12:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 shutdown_connections 2024-09-10T05:12:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3662948117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367e2910 0x55d4367e9d40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 >> 172.21.15.192:0/3662948117 conn(0x55d4367ded10 msgr2=0x55d4367dcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 shutdown_connections 2024-09-10T05:12:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3662948117 wait complete. 2024-09-10T05:12:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3561246625 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac7403c730 msgr2=0x7fac7403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3561246625 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac7403c730 0x7fac7403ebf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55d4367c87f0 tx=0x7fad84006000 comp rx=0 tx=0).stop 2024-09-10T05:12:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3561246625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367d6010 msgr2=0x55d4367d6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3561246625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367d6010 0x55d4367d6430 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fad8c063d60 tx=0x7fad8c06ce70 comp rx=0 tx=0).stop 2024-09-10T05:12:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3561246625 shutdown_connections 2024-09-10T05:12:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3561246625 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac7403c730 0x7fac7403ebf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3561246625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4367d6010 0x55d4367d6430 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3561246625 >> 172.21.15.192:0/3561246625 conn(0x55d4367ca3c0 msgr2=0x55d4367ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3561246625 shutdown_connections 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.271+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3561246625 wait complete. 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d4367c1970 msgr2=0x55d4367c3d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d4367c1970 0x55d4367c3d60 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d4366bddc0 msgr2=0x55d4367bf4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d4366bddc0 0x55d4367bf4e0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55d4367c5870 msgr2=0x55d4367c7c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55d4367c5870 0x55d4367c7c60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac8003c780 msgr2=0x7fac8003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fac8003c780 0x7fac8003ec40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fad84000c00 tx=0x7fad840013b0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 msgr2=0x55d4367b7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 --2- 172.21.15.192:0/3306616966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4366bd480 0x55d4367b7e90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fad8c025a60 tx=0x7fad8c003330 comp rx=0 tx=0).stop 2024-09-10T05:12:09.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad99df5640 1 -- 172.21.15.192:0/3306616966 reap_dead start 2024-09-10T05:12:09.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 shutdown_connections 2024-09-10T05:12:09.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 >> 172.21.15.192:0/3306616966 conn(0x55d4366b91d0 msgr2=0x55d4367b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 shutdown_connections 2024-09-10T05:12:09.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.272+0000 7fad9bb0a800 1 -- 172.21.15.192:0/3306616966 wait complete. 2024-09-10T05:12:09.288 INFO:teuthology.orchestra.run.smithi192.stdout:fooFoofooFooFULL_CONTROL 2024-09-10T05:12:09.288 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-10T05:12:09.290 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-10T05:12:09.295 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:09.296 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T05:12:09.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-10T05:12:09.296 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-10T05:12:09.341 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:09.341 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:09.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.341+0000 7f44a080e800 1 Processor -- start 2024-09-10T05:12:09.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.341+0000 7f44a080e800 1 -- start start 2024-09-10T05:12:09.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.341+0000 7f44a080e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c42d5f2fd0 0x55c42d5fbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.341+0000 7f44a080e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c42d49ce40 con 0x55c42d5f14b0 2024-09-10T05:12:09.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.341+0000 7f44a080e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55c42d467680 con 0x55c42d5f2fd0 2024-09-10T05:12:09.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.341+0000 7f4493fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c42d5f2fd0 0x55c42d5fbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.341+0000 7f449bf6b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55c42d5f14b0 0x55c42d5f18b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:33710/0 (socket says 172.21.15.192:33710) 2024-09-10T05:12:09.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.342+0000 7f449bf6b640 1 -- 172.21.15.192:0/912643950 learned_addr learned my addr 172.21.15.192:0/912643950 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:09.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.342+0000 7f4493fff640 1 -- 172.21.15.192:0/912643950 >> v1:172.21.15.139:6789/0 conn(0x55c42d5f14b0 legacy=0x55c42d5f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.342+0000 7f449b76a640 1 -- 172.21.15.192:0/912643950 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813839275 0 0) 0x55c42d49ce40 con 0x55c42d5f14b0 2024-09-10T05:12:09.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.342+0000 7f4493fff640 1 -- 172.21.15.192:0/912643950 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42d4836b0 con 0x55c42d5f2fd0 2024-09-10T05:12:09.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.344+0000 7f4493fff640 1 --2- 172.21.15.192:0/912643950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f2fd0 0x55c42d5fbaf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f448400a470 tx=0x7f4484045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fba8324dd12eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.344+0000 7f449b76a640 1 -- 172.21.15.192:0/912643950 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4484053570 con 0x55c42d5f2fd0 2024-09-10T05:12:09.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.344+0000 7f449b76a640 1 -- 172.21.15.192:0/912643950 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4484058070 con 0x55c42d5f2fd0 2024-09-10T05:12:09.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.344+0000 7f449b76a640 1 -- 172.21.15.192:0/912643950 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4484053880 con 0x55c42d5f2fd0 2024-09-10T05:12:09.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.344+0000 7f44a080e800 1 -- 172.21.15.192:0/912643950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f2fd0 msgr2=0x55c42d5fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.344+0000 7f44a080e800 1 --2- 172.21.15.192:0/912643950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f2fd0 0x55c42d5fbaf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f448400a470 tx=0x7f4484045a20 comp rx=0 tx=0).stop 2024-09-10T05:12:09.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.344+0000 7f44a080e800 1 -- 172.21.15.192:0/912643950 shutdown_connections 2024-09-10T05:12:09.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.344+0000 7f44a080e800 1 --2- 172.21.15.192:0/912643950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f2fd0 0x55c42d5fbaf0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.344+0000 7f44a080e800 1 -- 172.21.15.192:0/912643950 >> 172.21.15.192:0/912643950 conn(0x55c42d5ed200 msgr2=0x55c42d5ef640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.344+0000 7f44a080e800 1 -- 172.21.15.192:0/912643950 shutdown_connections 2024-09-10T05:12:09.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.344+0000 7f44a080e800 1 -- 172.21.15.192:0/912643950 wait complete. 2024-09-10T05:12:09.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.358+0000 7f44a080e800 1 Processor -- start 2024-09-10T05:12:09.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.358+0000 7f44a080e800 1 -- start start 2024-09-10T05:12:09.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.358+0000 7f44a080e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 0x55c42d6e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.358+0000 7f44a080e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c42d48bdd0 con 0x55c42d5f14b0 2024-09-10T05:12:09.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.358+0000 7f449bf6b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 0x55c42d6e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.359+0000 7f449bf6b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 0x55c42d6e46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60532/0 (socket says 172.21.15.192:60532) 2024-09-10T05:12:09.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.359+0000 7f449bf6b640 1 -- 172.21.15.192:0/1336340060 learned_addr learned my addr 172.21.15.192:0/1336340060 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.359+0000 7f449bf6b640 1 -- 172.21.15.192:0/1336340060 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42d4a4e10 con 0x55c42d5f14b0 2024-09-10T05:12:09.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.359+0000 7f449bf6b640 1 --2- 172.21.15.192:0/1336340060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 0x55c42d6e46d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f448c001ea0 tx=0x7f448c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b15a1db464dda4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.359+0000 7f4389e0b640 1 -- 172.21.15.192:0/1336340060 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f448c008070 con 0x55c42d5f14b0 2024-09-10T05:12:09.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.359+0000 7f4389e0b640 1 -- 172.21.15.192:0/1336340060 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448c00d500 con 0x55c42d5f14b0 2024-09-10T05:12:09.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.359+0000 7f4389e0b640 1 -- 172.21.15.192:0/1336340060 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f448c00d880 con 0x55c42d5f14b0 2024-09-10T05:12:09.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.360+0000 7f44a080e800 1 -- 172.21.15.192:0/1336340060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 msgr2=0x55c42d6e46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.360+0000 7f44a080e800 1 --2- 172.21.15.192:0/1336340060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 0x55c42d6e46d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f448c001ea0 tx=0x7f448c00b6a0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.360+0000 7f44a080e800 1 -- 172.21.15.192:0/1336340060 shutdown_connections 2024-09-10T05:12:09.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.360+0000 7f44a080e800 1 --2- 172.21.15.192:0/1336340060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 0x55c42d6e46d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.360+0000 7f44a080e800 1 -- 172.21.15.192:0/1336340060 >> 172.21.15.192:0/1336340060 conn(0x55c42d5ed200 msgr2=0x55c42d6e0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.360+0000 7f44a080e800 1 -- 172.21.15.192:0/1336340060 shutdown_connections 2024-09-10T05:12:09.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.360+0000 7f44a080e800 1 -- 172.21.15.192:0/1336340060 wait complete. 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.360+0000 7f44a080e800 1 Processor -- start 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.360+0000 7f44a080e800 1 -- start start 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.360+0000 7f44a080e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 0x55c42d6ebff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.360+0000 7f44a080e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c42d5fc300 con 0x55c42d5f14b0 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.361+0000 7f449bf6b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 0x55c42d6ebff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.361+0000 7f449bf6b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 0x55c42d6ebff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60542/0 (socket says 172.21.15.192:60542) 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.361+0000 7f449bf6b640 1 -- 172.21.15.192:0/1464025690 learned_addr learned my addr 172.21.15.192:0/1464025690 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.361+0000 7f449bf6b640 1 -- 172.21.15.192:0/1464025690 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42d6ec550 con 0x55c42d5f14b0 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.361+0000 7f449bf6b640 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 0x55c42d6ebff0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f448c0012f0 tx=0x7f448c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.361+0000 7f4383fff640 1 -- 172.21.15.192:0/1464025690 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f448c00f9d0 con 0x55c42d5f14b0 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.361+0000 7f4383fff640 1 -- 172.21.15.192:0/1464025690 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448c00fb70 con 0x55c42d5f14b0 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.361+0000 7f4383fff640 1 -- 172.21.15.192:0/1464025690 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f448c00fe50 con 0x55c42d5f14b0 2024-09-10T05:12:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.361+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c42d6ec7e0 con 0x55c42d5f14b0 2024-09-10T05:12:09.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.361+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c42d6ed1e0 con 0x55c42d5f14b0 2024-09-10T05:12:09.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.362+0000 7f4383fff640 1 -- 172.21.15.192:0/1464025690 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f448c017040 con 0x55c42d5f14b0 2024-09-10T05:12:09.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.362+0000 7f4383fff640 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f438403c8d0 0x7f438403ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.362+0000 7f4383fff640 1 -- 172.21.15.192:0/1464025690 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f448c015020 con 0x55c42d5f14b0 2024-09-10T05:12:09.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.362+0000 7f4493fff640 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f438403c8d0 0x7f438403ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.363+0000 7f44a080e800 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c42d5f2fd0 0x55c42d6f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.363+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d6f3b80 con 0x55c42d5f2fd0 2024-09-10T05:12:09.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.363+0000 7f449c76c640 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c42d5f2fd0 0x55c42d6f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.363+0000 7f4493fff640 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f438403c8d0 0x7f438403ed90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4484057000 tx=0x7f4484052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.363+0000 7f449c76c640 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c42d5f2fd0 0x55c42d6f3640 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.363+0000 7f449c76c640 1 -- 172.21.15.192:0/1464025690 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d5f2fd0 2024-09-10T05:12:09.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.363+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d6f3f20 con 0x55c42d5f2fd0 2024-09-10T05:12:09.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.363+0000 7f449c76c640 1 -- 172.21.15.192:0/1464025690 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d5f2fd0 2024-09-10T05:12:09.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.363+0000 7f44a080e800 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c42d6f5a20 0x55c42d6f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.363+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d6f8630 con 0x55c42d6f5a20 2024-09-10T05:12:09.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.364+0000 7f449bf6b640 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c42d6f5a20 0x55c42d6f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.364+0000 7f449bf6b640 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c42d6f5a20 0x55c42d6f7ea0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.364+0000 7f449bf6b640 1 -- 172.21.15.192:0/1464025690 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f448c02d070 con 0x55c42d6f5a20 2024-09-10T05:12:09.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.364+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d6f4770 con 0x55c42d5f2fd0 2024-09-10T05:12:09.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.365+0000 7f449c76c640 1 -- 172.21.15.192:0/1464025690 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d5f2fd0 2024-09-10T05:12:09.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.365+0000 7f44a080e800 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c42d6f9a90 0x55c42d6fbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.365+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d6fc5c0 con 0x55c42d6f9a90 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.365+0000 7f4493fff640 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c42d6f9a90 0x55c42d6fbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.365+0000 7f4493fff640 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c42d6f9a90 0x55c42d6fbe80 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.365+0000 7f4493fff640 1 -- 172.21.15.192:0/1464025690 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4484051070 con 0x55c42d6f9a90 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.366+0000 7f44a080e800 1 Processor -- start 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.366+0000 7f44a080e800 1 -- start start 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.366+0000 7f44a080e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d70a1e0 0x55c42d70a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.366+0000 7f44a080e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c42d4e9a00 con 0x55c42d70a1e0 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.366+0000 7f449bf6b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d70a1e0 0x55c42d70a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.366+0000 7f449bf6b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d70a1e0 0x55c42d70a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60554/0 (socket says 172.21.15.192:60554) 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.366+0000 7f449bf6b640 1 -- 172.21.15.192:0/1466828388 learned_addr learned my addr 172.21.15.192:0/1466828388 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.366+0000 7f449bf6b640 1 -- 172.21.15.192:0/1466828388 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42d70ac40 con 0x55c42d70a1e0 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.366+0000 7f449bf6b640 1 --2- 172.21.15.192:0/1466828388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d70a1e0 0x55c42d70a600 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f448c052760 tx=0x7f448c00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.367+0000 7f43817fa640 1 -- 172.21.15.192:0/1466828388 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f448c01ace0 con 0x55c42d70a1e0 2024-09-10T05:12:09.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.367+0000 7f43817fa640 1 -- 172.21.15.192:0/1466828388 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448c048030 con 0x55c42d70a1e0 2024-09-10T05:12:09.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.367+0000 7f43817fa640 1 -- 172.21.15.192:0/1466828388 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f448c01c970 con 0x55c42d70a1e0 2024-09-10T05:12:09.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.367+0000 7f44a080e800 1 -- 172.21.15.192:0/1466828388 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c42d70b470 con 0x55c42d70a1e0 2024-09-10T05:12:09.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.367+0000 7f44a080e800 1 -- 172.21.15.192:0/1466828388 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c42d70ba10 con 0x55c42d70a1e0 2024-09-10T05:12:09.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.367+0000 7f43817fa640 1 -- 172.21.15.192:0/1466828388 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f448c01cb10 con 0x55c42d70a1e0 2024-09-10T05:12:09.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.367+0000 7f43817fa640 1 --2- 172.21.15.192:0/1466828388 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f437403c780 0x7f437403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.368+0000 7f43817fa640 1 -- 172.21.15.192:0/1466828388 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f448c03b970 con 0x55c42d70a1e0 2024-09-10T05:12:09.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.368+0000 7f4493fff640 1 --2- 172.21.15.192:0/1466828388 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f437403c780 0x7f437403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.368+0000 7f44a080e800 1 Processor -- start 2024-09-10T05:12:09.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.368+0000 7f4493fff640 1 --2- 172.21.15.192:0/1466828388 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f437403c780 0x7f437403ec40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55c42d6f8a00 tx=0x7f4484005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.368+0000 7f44a080e800 1 -- start start 2024-09-10T05:12:09.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.368+0000 7f44a080e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 0x55c42d717080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.368+0000 7f44a080e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c42d6e4f20 con 0x55c42d716c80 2024-09-10T05:12:09.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.368+0000 7f449bf6b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 0x55c42d717080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.368+0000 7f449bf6b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 0x55c42d717080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60568/0 (socket says 172.21.15.192:60568) 2024-09-10T05:12:09.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.368+0000 7f449bf6b640 1 -- 172.21.15.192:0/3023447955 learned_addr learned my addr 172.21.15.192:0/3023447955 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.369+0000 7f449bf6b640 1 -- 172.21.15.192:0/3023447955 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42d717670 con 0x55c42d716c80 2024-09-10T05:12:09.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.369+0000 7f449bf6b640 1 --2- 172.21.15.192:0/3023447955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 0x55c42d717080 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f448c001600 tx=0x7f448c019b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f362653db45ca9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.369+0000 7f437affd640 1 -- 172.21.15.192:0/3023447955 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f448c03f980 con 0x55c42d716c80 2024-09-10T05:12:09.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.369+0000 7f437affd640 1 -- 172.21.15.192:0/3023447955 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448c044c70 con 0x55c42d716c80 2024-09-10T05:12:09.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.369+0000 7f437affd640 1 -- 172.21.15.192:0/3023447955 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f448c03fb20 con 0x55c42d716c80 2024-09-10T05:12:09.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.369+0000 7f44a080e800 1 -- 172.21.15.192:0/3023447955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 msgr2=0x55c42d717080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.369+0000 7f44a080e800 1 --2- 172.21.15.192:0/3023447955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 0x55c42d717080 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f448c001600 tx=0x7f448c019b10 comp rx=0 tx=0).stop 2024-09-10T05:12:09.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.369+0000 7f44a080e800 1 -- 172.21.15.192:0/3023447955 shutdown_connections 2024-09-10T05:12:09.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.369+0000 7f44a080e800 1 --2- 172.21.15.192:0/3023447955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 0x55c42d717080 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.369+0000 7f44a080e800 1 -- 172.21.15.192:0/3023447955 >> 172.21.15.192:0/3023447955 conn(0x55c42d713080 msgr2=0x55c42d7112c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.369+0000 7f44a080e800 1 -- 172.21.15.192:0/3023447955 shutdown_connections 2024-09-10T05:12:09.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.369+0000 7f44a080e800 1 -- 172.21.15.192:0/3023447955 wait complete. 2024-09-10T05:12:09.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.370+0000 7f44a080e800 1 Processor -- start 2024-09-10T05:12:09.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.370+0000 7f44a080e800 1 -- start start 2024-09-10T05:12:09.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.370+0000 7f44a080e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 0x55c42d71e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.370+0000 7f44a080e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c42d717ae0 con 0x55c42d716c80 2024-09-10T05:12:09.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.370+0000 7f449bf6b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 0x55c42d71e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.370+0000 7f449bf6b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 0x55c42d71e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60582/0 (socket says 172.21.15.192:60582) 2024-09-10T05:12:09.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.370+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 learned_addr learned my addr 172.21.15.192:0/3965373254 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.370+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42d71e5b0 con 0x55c42d716c80 2024-09-10T05:12:09.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.370+0000 7f449bf6b640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 0x55c42d71e050 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f448c001600 tx=0x7f448c043f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.371+0000 7f43797fa640 1 -- 172.21.15.192:0/3965373254 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f448c06d070 con 0x55c42d716c80 2024-09-10T05:12:09.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.371+0000 7f43797fa640 1 -- 172.21.15.192:0/3965373254 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448c0281e0 con 0x55c42d716c80 2024-09-10T05:12:09.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.371+0000 7f43797fa640 1 -- 172.21.15.192:0/3965373254 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f448c026560 con 0x55c42d716c80 2024-09-10T05:12:09.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.371+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c42d71e5b0 con 0x55c42d716c80 2024-09-10T05:12:09.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.371+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c42d71e5b0 con 0x55c42d716c80 2024-09-10T05:12:09.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.372+0000 7f43797fa640 1 -- 172.21.15.192:0/3965373254 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f448c070070 con 0x55c42d716c80 2024-09-10T05:12:09.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.372+0000 7f43797fa640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f436403c730 0x7f436403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.372+0000 7f43797fa640 1 -- 172.21.15.192:0/3965373254 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f448c073d50 con 0x55c42d716c80 2024-09-10T05:12:09.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.372+0000 7f4493fff640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f436403c730 0x7f436403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.372+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.372+0000 7f4493fff640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f436403c730 0x7f436403ebf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4484000c00 tx=0x7f4484053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.372+0000 7f44a080e800 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c42d7293e0 0x55c42d72b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.372+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72bff0 con 0x55c42d7293e0 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f449c76c640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c42d7293e0 0x55c42d72b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f449c76c640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c42d7293e0 0x55c42d72b8a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f44a080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f44a080e800 20 realm 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72c400 con 0x55c42d7293e0 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f44a080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f44a080e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72ccd0 con 0x55c42d7293e0 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f44a080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.373+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d7293e0 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.374+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.374+0000 7f44a080e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.374+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.374+0000 7f44a080e800 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c42d72ddd0 0x55c42d7301c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.374+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d730780 con 0x55c42d72ddd0 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.374+0000 7f449bf6b640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c42d72ddd0 0x55c42d7301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.374+0000 7f449bf6b640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c42d72ddd0 0x55c42d7301c0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.374+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.374+0000 7f44a080e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.375+0000 7f44a080e800 20 searching for the correct realm 2024-09-10T05:12:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.375+0000 7f44a080e800 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c42d732730 0x55c42d734bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.375+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d7352c0 con 0x55c42d732730 2024-09-10T05:12:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.375+0000 7f4493fff640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c42d732730 0x55c42d734bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.375+0000 7f4493fff640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c42d732730 0x55c42d734bf0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.375+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.375+0000 7f4493fff640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f448405f040 0x7f448406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.375+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d7352c0 con 0x7f448405f040 2024-09-10T05:12:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.375+0000 7f449c76c640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f448405f040 0x7f448406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.376+0000 7f449c76c640 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f448405f040 0x7f448406b410 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.376+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.376+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d72ddd0 2024-09-10T05:12:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.376+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.376+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d7293e0 2024-09-10T05:12:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.376+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.376+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d7293e0 2024-09-10T05:12:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.377+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.377+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d72ddd0 2024-09-10T05:12:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.377+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.377+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d72ddd0 2024-09-10T05:12:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.377+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.377+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x7f448405f040 2024-09-10T05:12:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.377+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.377+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d732730 2024-09-10T05:12:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.378+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.378+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d7293e0 2024-09-10T05:12:09.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.378+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.378+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d72ddd0 2024-09-10T05:12:09.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.378+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.378+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d7293e0 2024-09-10T05:12:09.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.378+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.378+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x7f448405f040 2024-09-10T05:12:09.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.379+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.379+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d732730 2024-09-10T05:12:09.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.379+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.379+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d732730 2024-09-10T05:12:09.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.379+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.379+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d72ddd0 2024-09-10T05:12:09.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.379+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.379+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d732730 2024-09-10T05:12:09.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.380+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.380+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d732730 2024-09-10T05:12:09.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.380+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.380+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d7293e0 2024-09-10T05:12:09.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.380+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.380+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d7293e0 2024-09-10T05:12:09.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.380+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.380+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x7f448405f040 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.381+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.381+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d732730 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.381+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.381+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x7f448405f040 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.381+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.381+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d7293e0 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.381+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.381+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d72ddd0 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.382+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.382+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d732730 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.382+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.382+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d72ddd0 2024-09-10T05:12:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.382+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.382+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x7f448405f040 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.382+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.382+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d732730 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x7f448405f040 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x55c42d7293e0 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c42d72d070 con 0x7f448405f040 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f44a080e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f44a080e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:09.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f44a080e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f44a080e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f44a080e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f44a080e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.383+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d731040 con 0x55c42d7293e0 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d731040 con 0x55c42d7293e0 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d731040 con 0x7f448405f040 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 20 zone default found 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 4 Realm: () 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 20 zonegroup default 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d7318e0 con 0x55c42d72ddd0 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.384+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.385+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d737130 con 0x55c42d732730 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.385+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.385+0000 7f44a080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.385+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.385+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d7374d0 con 0x55c42d732730 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.385+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.385+0000 7f44a080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.385+0000 7f44a080e800 20 started sync module instance, tier type = 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.385+0000 7f44a080e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.385+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d7365d0 con 0x7f448405f040 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.386+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.386+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94301064489680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d7365d0 con 0x7f448405f040 2024-09-10T05:12:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.386+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d737e90 con 0x55c42d7293e0 2024-09-10T05:12:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.387+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94301064489680] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.387+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.387+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94301064487680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d737e90 con 0x55c42d7293e0 2024-09-10T05:12:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.387+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d7388b0 con 0x55c42d732730 2024-09-10T05:12:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.388+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94301064487680] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.388+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.388+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94301064493536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d737e00 con 0x55c42d732730 2024-09-10T05:12:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.388+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d739770 con 0x7f448405f040 2024-09-10T05:12:09.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.389+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94301064493536] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.389+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.389+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94301064499904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d739b90 con 0x7f448405f040 2024-09-10T05:12:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.390+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d73a550 con 0x55c42d7293e0 2024-09-10T05:12:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.391+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.391+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94301064499904] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.391+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94301064503456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d73a4c0 con 0x55c42d7293e0 2024-09-10T05:12:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.391+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d7396e0 con 0x55c42d72ddd0 2024-09-10T05:12:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.392+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.392+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94301064503456] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.392+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94301064507360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d73b8b0 con 0x55c42d72ddd0 2024-09-10T05:12:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.392+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d73a940 con 0x55c42d72ddd0 2024-09-10T05:12:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.392+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.392+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94301064511392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d73c910 con 0x55c42d72ddd0 2024-09-10T05:12:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.393+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d73d400 con 0x55c42d72ddd0 2024-09-10T05:12:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.393+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94301064507360] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.393+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(58 notify.7 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.393+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94301064511392] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.393+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94301064515280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d73d680 con 0x55c42d72ddd0 2024-09-10T05:12:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.393+0000 7f44a080e800 20 add_watcher() i=0 2024-09-10T05:12:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.393+0000 7f44a080e800 20 add_watcher() i=1 2024-09-10T05:12:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.393+0000 7f44a080e800 20 add_watcher() i=2 2024-09-10T05:12:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.393+0000 7f44a080e800 20 add_watcher() i=3 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.393+0000 7f44a080e800 20 add_watcher() i=4 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.393+0000 7f44a080e800 20 add_watcher() i=5 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.393+0000 7f44a080e800 20 add_watcher() i=6 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.394+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94301064515280] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.394+0000 7f44a080e800 20 add_watcher() i=7 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.394+0000 7f44a080e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.394+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d73c4b0 con 0x55c42d7293e0 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.395+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.395+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94301064508416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d73c4b0 con 0x55c42d7293e0 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.396+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94301064508416] v37'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.396+0000 7f4351fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.396+0000 7f44a080e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.396+0000 7f44a080e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.396+0000 7f44a080e800 5 note: GC not initialized 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.396+0000 7f4350fe1640 20 reqs_thread_entry: start 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.396+0000 7f44a080e800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.396+0000 7f44a080e800 20 Filter name: none 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.396+0000 7f42ca7fc640 20 reqs_thread_entry: start 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.396+0000 7f44a080e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.396+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d773e00 con 0x7f448405f040 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:12:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 : miss 2024-09-10T05:12:09.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:63 8.11 8:8f8d60cd:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d7758a0 con 0x55c42d732730 2024-09-10T05:12:09.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(63 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:12:09.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 info.flags=0x17 2024-09-10T05:12:09.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 to cache LRU end 2024-09-10T05:12:09.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:09.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:12:09.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 2024-09-10T05:12:09.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 20 get_obj_state: octx=0x7f449400ab20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55c42d777f98 s->prefetch_data=0 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.397+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 3.cs0 3:3279caba:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c42d779010 con 0x55c42d732730 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.398+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(64 92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.398+0000 7f44a080e800 10 manifest: total_size = 5 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.398+0000 7f44a080e800 20 get_obj_state: setting s->obj_tag to _Gwyr___zd8RG7XC0cXdN2J0BPZ0p3TH 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.398+0000 7f4351fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.398+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94301064508416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d771650 con 0x55c42d7293e0 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.399+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94301064508416] v37'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.399+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94301064489680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d771650 con 0x7f448405f040 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.400+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94301064489680] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.400+0000 7f44a080e800 20 remove_watcher() i=0 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.400+0000 7f44a080e800 2 removed watcher, disabling cache 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.400+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94301064487680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d736ad0 con 0x55c42d7293e0 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.401+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94301064487680] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.401+0000 7f44a080e800 20 remove_watcher() i=1 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.401+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94301064493536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d771650 con 0x55c42d732730 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.402+0000 7f4493fff640 1 -- 172.21.15.192:0/3965373254 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94301064493536] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448407c040 con 0x55c42d732730 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.402+0000 7f44a080e800 20 remove_watcher() i=2 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.402+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94301064499904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d736ad0 con 0x7f448405f040 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.403+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94301064499904] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x7f448405f040 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.403+0000 7f44a080e800 20 remove_watcher() i=3 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.403+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94301064503456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d7379e0 con 0x55c42d7293e0 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.404+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94301064503456] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f449400a4d0 con 0x55c42d7293e0 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.404+0000 7f44a080e800 20 remove_watcher() i=4 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.404+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94301064507360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d771650 con 0x55c42d72ddd0 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.406+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94301064507360] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.406+0000 7f44a080e800 20 remove_watcher() i=5 2024-09-10T05:12:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.406+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94301064511392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d7392c0 con 0x55c42d72ddd0 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.407+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94301064511392] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.407+0000 7f44a080e800 20 remove_watcher() i=6 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.407+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94301064515280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c42d736ad0 con 0x55c42d72ddd0 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f449bf6b640 1 -- 172.21.15.192:0/3965373254 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94301064515280] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448c06f030 con 0x55c42d72ddd0 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 20 remove_watcher() i=7 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c42d72ddd0 msgr2=0x55c42d7301c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c42d72ddd0 0x55c42d7301c0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c42d7293e0 msgr2=0x55c42d72b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c42d7293e0 0x55c42d72b8a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f448405f040 msgr2=0x7f448406b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f448405f040 0x7f448406b410 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c42d732730 msgr2=0x55c42d734bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c42d732730 0x55c42d734bf0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f436403c730 msgr2=0x7f436403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f436403c730 0x7f436403ebf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4484000c00 tx=0x7f4484053000 comp rx=0 tx=0).stop 2024-09-10T05:12:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 msgr2=0x55c42d71e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f449c76c640 1 -- 172.21.15.192:0/3965373254 reap_dead start 2024-09-10T05:12:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 0x55c42d71e050 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f448c001600 tx=0x7f448c043f90 comp rx=0 tx=0).stop 2024-09-10T05:12:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 shutdown_connections 2024-09-10T05:12:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 --2- 172.21.15.192:0/3965373254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d716c80 0x55c42d71e050 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 >> 172.21.15.192:0/3965373254 conn(0x55c42d713080 msgr2=0x55c42d711290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 shutdown_connections 2024-09-10T05:12:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/3965373254 wait complete. 2024-09-10T05:12:09.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/1466828388 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f437403c780 msgr2=0x7f437403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 --2- 172.21.15.192:0/1466828388 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f437403c780 0x7f437403ec40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55c42d6f8a00 tx=0x7f4484005a00 comp rx=0 tx=0).stop 2024-09-10T05:12:09.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/1466828388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d70a1e0 msgr2=0x55c42d70a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 --2- 172.21.15.192:0/1466828388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d70a1e0 0x55c42d70a600 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f448c052760 tx=0x7f448c00e940 comp rx=0 tx=0).stop 2024-09-10T05:12:09.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/1466828388 shutdown_connections 2024-09-10T05:12:09.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 --2- 172.21.15.192:0/1466828388 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f437403c780 0x7f437403ec40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 --2- 172.21.15.192:0/1466828388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d70a1e0 0x55c42d70a600 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.408+0000 7f44a080e800 1 -- 172.21.15.192:0/1466828388 >> 172.21.15.192:0/1466828388 conn(0x55c42d6fe590 msgr2=0x55c42d6fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 -- 172.21.15.192:0/1466828388 shutdown_connections 2024-09-10T05:12:09.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 -- 172.21.15.192:0/1466828388 wait complete. 2024-09-10T05:12:09.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c42d6f5a20 msgr2=0x55c42d6f7ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c42d6f5a20 0x55c42d6f7ea0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c42d5f2fd0 msgr2=0x55c42d6f3640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c42d5f2fd0 0x55c42d6f3640 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c42d6f9a90 msgr2=0x55c42d6fbe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c42d6f9a90 0x55c42d6fbe80 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f438403c8d0 msgr2=0x7f438403ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f438403c8d0 0x7f438403ed90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4484057000 tx=0x7f4484052000 comp rx=0 tx=0).stop 2024-09-10T05:12:09.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 msgr2=0x55c42d6ebff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 --2- 172.21.15.192:0/1464025690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c42d5f14b0 0x55c42d6ebff0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f448c0012f0 tx=0x7f448c000ed0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f449c76c640 1 -- 172.21.15.192:0/1464025690 reap_dead start 2024-09-10T05:12:09.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 shutdown_connections 2024-09-10T05:12:09.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 >> 172.21.15.192:0/1464025690 conn(0x55c42d5ed200 msgr2=0x55c42d6e59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 shutdown_connections 2024-09-10T05:12:09.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.409+0000 7f44a080e800 1 -- 172.21.15.192:0/1464025690 wait complete. 2024-09-10T05:12:09.425 INFO:teuthology.orchestra.run.smithi192.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-10T05:12:09.425 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-10T05:12:09.428 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-10T05:12:09.441 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:09.502 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-10T05:12:09.502 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-10T05:12:09.502 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-10T05:12:09.503 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-10T05:12:09.503 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-10T05:12:09.503 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-10T05:12:09.503 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-10T05:12:09.549 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:09.549 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:09.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.549+0000 7f5ff080e800 1 Processor -- start 2024-09-10T05:12:09.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.549+0000 7f5ff080e800 1 -- start start 2024-09-10T05:12:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.549+0000 7f5ff080e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x556ee5f33200 0x556ee5f38da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.549+0000 7f5ff080e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ee5ddce40 con 0x556ee5f31df0 2024-09-10T05:12:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.549+0000 7f5ff080e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x556ee5da7680 con 0x556ee5f33200 2024-09-10T05:12:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.549+0000 7f5fe3fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x556ee5f33200 0x556ee5f38da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.549+0000 7f5febe59640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x556ee5f31df0 0x556ee5f32af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:33720/0 (socket says 172.21.15.192:33720) 2024-09-10T05:12:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.549+0000 7f5febe59640 1 -- 172.21.15.192:0/362662047 learned_addr learned my addr 172.21.15.192:0/362662047 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.549+0000 7f5fe3fff640 1 -- 172.21.15.192:0/362662047 >> v1:172.21.15.139:6789/0 conn(0x556ee5f31df0 legacy=0x556ee5f32af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.549+0000 7f5feb658640 1 -- 172.21.15.192:0/362662047 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2900796121 0 0) 0x556ee5ddce40 con 0x556ee5f31df0 2024-09-10T05:12:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.549+0000 7f5fe3fff640 1 -- 172.21.15.192:0/362662047 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ee5dc36b0 con 0x556ee5f33200 2024-09-10T05:12:09.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.551+0000 7f5fe3fff640 1 --2- 172.21.15.192:0/362662047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f33200 0x556ee5f38da0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400a470 tx=0x7f5fd4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21681af06de13ef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.551+0000 7f5feb658640 1 -- 172.21.15.192:0/362662047 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd4053570 con 0x556ee5f33200 2024-09-10T05:12:09.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.551+0000 7f5feb658640 1 -- 172.21.15.192:0/362662047 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd4058070 con 0x556ee5f33200 2024-09-10T05:12:09.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.551+0000 7f5feb658640 1 -- 172.21.15.192:0/362662047 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd4053880 con 0x556ee5f33200 2024-09-10T05:12:09.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.552+0000 7f5ff080e800 1 -- 172.21.15.192:0/362662047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f33200 msgr2=0x556ee5f38da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.552+0000 7f5ff080e800 1 --2- 172.21.15.192:0/362662047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f33200 0x556ee5f38da0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400a470 tx=0x7f5fd4045a20 comp rx=0 tx=0).stop 2024-09-10T05:12:09.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.552+0000 7f5ff080e800 1 -- 172.21.15.192:0/362662047 shutdown_connections 2024-09-10T05:12:09.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.552+0000 7f5ff080e800 1 --2- 172.21.15.192:0/362662047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f33200 0x556ee5f38da0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.552+0000 7f5ff080e800 1 -- 172.21.15.192:0/362662047 >> 172.21.15.192:0/362662047 conn(0x556ee5f2d1c0 msgr2=0x556ee5f2f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.552+0000 7f5ff080e800 1 -- 172.21.15.192:0/362662047 shutdown_connections 2024-09-10T05:12:09.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.552+0000 7f5ff080e800 1 -- 172.21.15.192:0/362662047 wait complete. 2024-09-10T05:12:09.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.565+0000 7f5ff080e800 1 Processor -- start 2024-09-10T05:12:09.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.566+0000 7f5ff080e800 1 -- start start 2024-09-10T05:12:09.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.566+0000 7f5ff080e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 0x556ee6021380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.566+0000 7f5ff080e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556ee5dcbdd0 con 0x556ee5f31df0 2024-09-10T05:12:09.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.566+0000 7f5febe59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 0x556ee6021380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.566+0000 7f5febe59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 0x556ee6021380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60594/0 (socket says 172.21.15.192:60594) 2024-09-10T05:12:09.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.566+0000 7f5febe59640 1 -- 172.21.15.192:0/677084560 learned_addr learned my addr 172.21.15.192:0/677084560 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.566+0000 7f5febe59640 1 -- 172.21.15.192:0/677084560 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ee5de4e10 con 0x556ee5f31df0 2024-09-10T05:12:09.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.567+0000 7f5febe59640 1 --2- 172.21.15.192:0/677084560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 0x556ee6021380 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc001ea0 tx=0x7f5fdc00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d27b1a0bd94306 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.567+0000 7f5ed9e0b640 1 -- 172.21.15.192:0/677084560 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc008070 con 0x556ee5f31df0 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.567+0000 7f5ed9e0b640 1 -- 172.21.15.192:0/677084560 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc00d500 con 0x556ee5f31df0 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.567+0000 7f5ed9e0b640 1 -- 172.21.15.192:0/677084560 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc00d880 con 0x556ee5f31df0 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.567+0000 7f5ff080e800 1 -- 172.21.15.192:0/677084560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 msgr2=0x556ee6021380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.567+0000 7f5ff080e800 1 --2- 172.21.15.192:0/677084560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 0x556ee6021380 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc001ea0 tx=0x7f5fdc00b6a0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.568+0000 7f5ff080e800 1 -- 172.21.15.192:0/677084560 shutdown_connections 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.568+0000 7f5ff080e800 1 --2- 172.21.15.192:0/677084560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 0x556ee6021380 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.568+0000 7f5ff080e800 1 -- 172.21.15.192:0/677084560 >> 172.21.15.192:0/677084560 conn(0x556ee5f2d1c0 msgr2=0x556ee601cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.568+0000 7f5ff080e800 1 -- 172.21.15.192:0/677084560 shutdown_connections 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.568+0000 7f5ff080e800 1 -- 172.21.15.192:0/677084560 wait complete. 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.568+0000 7f5ff080e800 1 Processor -- start 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.568+0000 7f5ff080e800 1 -- start start 2024-09-10T05:12:09.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.568+0000 7f5ff080e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 0x556ee6028d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.568+0000 7f5ff080e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556ee5f338f0 con 0x556ee5f31df0 2024-09-10T05:12:09.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.568+0000 7f5febe59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 0x556ee6028d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.568+0000 7f5febe59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 0x556ee6028d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60606/0 (socket says 172.21.15.192:60606) 2024-09-10T05:12:09.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.568+0000 7f5febe59640 1 -- 172.21.15.192:0/1145914026 learned_addr learned my addr 172.21.15.192:0/1145914026 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.569+0000 7f5febe59640 1 -- 172.21.15.192:0/1145914026 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ee60292d0 con 0x556ee5f31df0 2024-09-10T05:12:09.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.569+0000 7f5febe59640 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 0x556ee6028d70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0012f0 tx=0x7f5fdc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.569+0000 7f5ed3fff640 1 -- 172.21.15.192:0/1145914026 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc00f9d0 con 0x556ee5f31df0 2024-09-10T05:12:09.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.569+0000 7f5ed3fff640 1 -- 172.21.15.192:0/1145914026 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc00fb70 con 0x556ee5f31df0 2024-09-10T05:12:09.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.569+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ee6029560 con 0x556ee5f31df0 2024-09-10T05:12:09.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.569+0000 7f5ed3fff640 1 -- 172.21.15.192:0/1145914026 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc00fe50 con 0x556ee5f31df0 2024-09-10T05:12:09.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.569+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ee6029f60 con 0x556ee5f31df0 2024-09-10T05:12:09.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.570+0000 7f5ed3fff640 1 -- 172.21.15.192:0/1145914026 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5fdc017040 con 0x556ee5f31df0 2024-09-10T05:12:09.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.570+0000 7f5ed3fff640 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5ed403c920 0x7f5ed403ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.570+0000 7f5ed3fff640 1 -- 172.21.15.192:0/1145914026 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5fdc015020 con 0x556ee5f31df0 2024-09-10T05:12:09.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.570+0000 7f5fe3fff640 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5ed403c920 0x7f5ed403ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.570+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556ee5f33200 0x556ee60303c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.570+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6030900 con 0x556ee5f33200 2024-09-10T05:12:09.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.571+0000 7f5fec65a640 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556ee5f33200 0x556ee60303c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.571+0000 7f5fe3fff640 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5ed403c920 0x7f5ed403ede0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4057000 tx=0x7f5fd4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.571+0000 7f5fec65a640 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556ee5f33200 0x556ee60303c0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.571+0000 7f5fec65a640 1 -- 172.21.15.192:0/1145914026 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee5f33200 2024-09-10T05:12:09.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.571+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6030ca0 con 0x556ee5f33200 2024-09-10T05:12:09.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.571+0000 7f5fec65a640 1 -- 172.21.15.192:0/1145914026 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee5f33200 2024-09-10T05:12:09.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.571+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556ee60327a0 0x556ee6034c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.571+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60353b0 con 0x556ee60327a0 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.572+0000 7f5febe59640 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556ee60327a0 0x556ee6034c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.572+0000 7f5febe59640 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556ee60327a0 0x556ee6034c20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.572+0000 7f5febe59640 1 -- 172.21.15.192:0/1145914026 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5fdc02d070 con 0x556ee60327a0 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.572+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60314f0 con 0x556ee5f33200 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.572+0000 7f5fec65a640 1 -- 172.21.15.192:0/1145914026 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee5f33200 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.573+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556ee6036810 0x556ee6038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.573+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6039370 con 0x556ee6036810 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.573+0000 7f5fe3fff640 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556ee6036810 0x556ee6038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.573+0000 7f5fe3fff640 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556ee6036810 0x556ee6038c00 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.573+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1145914026 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6036810 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.574+0000 7f5ff080e800 1 Processor -- start 2024-09-10T05:12:09.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.574+0000 7f5ff080e800 1 -- start start 2024-09-10T05:12:09.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.574+0000 7f5ff080e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5ea6550 0x556ee604d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.574+0000 7f5ff080e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556ee5e29a00 con 0x556ee5ea6550 2024-09-10T05:12:09.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.574+0000 7f5febe59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5ea6550 0x556ee604d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.574+0000 7f5febe59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5ea6550 0x556ee604d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60618/0 (socket says 172.21.15.192:60618) 2024-09-10T05:12:09.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.574+0000 7f5febe59640 1 -- 172.21.15.192:0/2721902159 learned_addr learned my addr 172.21.15.192:0/2721902159 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.574+0000 7f5febe59640 1 -- 172.21.15.192:0/2721902159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ee5ea6970 con 0x556ee5ea6550 2024-09-10T05:12:09.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.574+0000 7f5febe59640 1 --2- 172.21.15.192:0/2721902159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5ea6550 0x556ee604d0b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00e660 tx=0x7f5fdc018e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.574+0000 7f5ed17fa640 1 -- 172.21.15.192:0/2721902159 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc048020 con 0x556ee5ea6550 2024-09-10T05:12:09.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.574+0000 7f5ed17fa640 1 -- 172.21.15.192:0/2721902159 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc04b310 con 0x556ee5ea6550 2024-09-10T05:12:09.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.574+0000 7f5ff080e800 1 -- 172.21.15.192:0/2721902159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ee604d5f0 con 0x556ee5ea6550 2024-09-10T05:12:09.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.575+0000 7f5ed17fa640 1 -- 172.21.15.192:0/2721902159 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc01a4f0 con 0x556ee5ea6550 2024-09-10T05:12:09.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.575+0000 7f5ff080e800 1 -- 172.21.15.192:0/2721902159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ee604da80 con 0x556ee5ea6550 2024-09-10T05:12:09.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.575+0000 7f5ed17fa640 1 -- 172.21.15.192:0/2721902159 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5fdc04b020 con 0x556ee5ea6550 2024-09-10T05:12:09.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.575+0000 7f5ed17fa640 1 --2- 172.21.15.192:0/2721902159 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5ec403c730 0x7f5ec403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.575+0000 7f5ed17fa640 1 -- 172.21.15.192:0/2721902159 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5fdc03c6f0 con 0x556ee5ea6550 2024-09-10T05:12:09.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.575+0000 7f5fe3fff640 1 --2- 172.21.15.192:0/2721902159 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5ec403c730 0x7f5ec403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.576+0000 7f5ff080e800 1 Processor -- start 2024-09-10T05:12:09.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.576+0000 7f5ff080e800 1 -- start start 2024-09-10T05:12:09.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.576+0000 7f5fe3fff640 1 --2- 172.21.15.192:0/2721902159 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5ec403c730 0x7f5ec403ebf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4045f20 tx=0x7f5fd4005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.576+0000 7f5ff080e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 0x556ee6056ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.576+0000 7f5ff080e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556ee6021bd0 con 0x556ee6056ad0 2024-09-10T05:12:09.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.576+0000 7f5febe59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 0x556ee6056ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.576+0000 7f5febe59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 0x556ee6056ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60628/0 (socket says 172.21.15.192:60628) 2024-09-10T05:12:09.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.576+0000 7f5febe59640 1 -- 172.21.15.192:0/3318537206 learned_addr learned my addr 172.21.15.192:0/3318537206 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.576+0000 7f5febe59640 1 -- 172.21.15.192:0/3318537206 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ee60574c0 con 0x556ee6056ad0 2024-09-10T05:12:09.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.576+0000 7f5febe59640 1 --2- 172.21.15.192:0/3318537206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 0x556ee6056ed0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc014390 tx=0x7f5fdc028f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af326e7bf32024be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.577+0000 7f5ecaffd640 1 -- 172.21.15.192:0/3318537206 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc035030 con 0x556ee6056ad0 2024-09-10T05:12:09.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.577+0000 7f5ecaffd640 1 -- 172.21.15.192:0/3318537206 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc044910 con 0x556ee6056ad0 2024-09-10T05:12:09.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.577+0000 7f5ecaffd640 1 -- 172.21.15.192:0/3318537206 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc026d00 con 0x556ee6056ad0 2024-09-10T05:12:09.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.577+0000 7f5ff080e800 1 -- 172.21.15.192:0/3318537206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 msgr2=0x556ee6056ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.577+0000 7f5ff080e800 1 --2- 172.21.15.192:0/3318537206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 0x556ee6056ed0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc014390 tx=0x7f5fdc028f90 comp rx=0 tx=0).stop 2024-09-10T05:12:09.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.577+0000 7f5ff080e800 1 -- 172.21.15.192:0/3318537206 shutdown_connections 2024-09-10T05:12:09.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.577+0000 7f5ff080e800 1 --2- 172.21.15.192:0/3318537206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 0x556ee6056ed0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.577+0000 7f5ff080e800 1 -- 172.21.15.192:0/3318537206 >> 172.21.15.192:0/3318537206 conn(0x556ee6052ed0 msgr2=0x556ee6051110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.577+0000 7f5ff080e800 1 -- 172.21.15.192:0/3318537206 shutdown_connections 2024-09-10T05:12:09.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.577+0000 7f5ff080e800 1 -- 172.21.15.192:0/3318537206 wait complete. 2024-09-10T05:12:09.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.577+0000 7f5ff080e800 1 Processor -- start 2024-09-10T05:12:09.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.577+0000 7f5ff080e800 1 -- start start 2024-09-10T05:12:09.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.578+0000 7f5ff080e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 0x556ee605deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.578+0000 7f5ff080e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556ee6057930 con 0x556ee6056ad0 2024-09-10T05:12:09.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.578+0000 7f5febe59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 0x556ee605deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.578+0000 7f5febe59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 0x556ee605deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60630/0 (socket says 172.21.15.192:60630) 2024-09-10T05:12:09.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.578+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 learned_addr learned my addr 172.21.15.192:0/1002011793 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.578+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ee605e410 con 0x556ee6056ad0 2024-09-10T05:12:09.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.578+0000 7f5febe59640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 0x556ee605deb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc039890 tx=0x7f5fdc03a9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.578+0000 7f5ec97fa640 1 -- 172.21.15.192:0/1002011793 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc019470 con 0x556ee6056ad0 2024-09-10T05:12:09.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.578+0000 7f5ec97fa640 1 -- 172.21.15.192:0/1002011793 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc019610 con 0x556ee6056ad0 2024-09-10T05:12:09.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.578+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ee605e410 con 0x556ee6056ad0 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.578+0000 7f5ec97fa640 1 -- 172.21.15.192:0/1002011793 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc044290 con 0x556ee6056ad0 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.578+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ee605e410 con 0x556ee6056ad0 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.579+0000 7f5ec97fa640 1 -- 172.21.15.192:0/1002011793 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5fdc044540 con 0x556ee6056ad0 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.579+0000 7f5ec97fa640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5eb403c730 0x7f5eb403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.579+0000 7f5ec97fa640 1 -- 172.21.15.192:0/1002011793 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5fdc066070 con 0x556ee6056ad0 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.579+0000 7f5fe3fff640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5eb403c730 0x7f5eb403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.580+0000 7f5fe3fff640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5eb403c730 0x7f5eb403ebf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40539f0 tx=0x7f5fd406b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.580+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.580+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556ee6069440 0x556ee606b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.580+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee606c050 con 0x556ee6069440 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.580+0000 7f5fec65a640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556ee6069440 0x556ee606b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.580+0000 7f5fec65a640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556ee6069440 0x556ee606b900 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 20 realm 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee606c460 con 0x556ee6069440 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee606cd30 con 0x556ee6069440 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6069440 2024-09-10T05:12:09.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:09.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556ee606de30 0x556ee6070220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60707e0 con 0x556ee606de30 2024-09-10T05:12:09.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.581+0000 7f5febe59640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556ee606de30 0x556ee6070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.582+0000 7f5febe59640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556ee606de30 0x556ee6070220 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.582+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.582+0000 7f5ff080e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:09.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.582+0000 7f5ff080e800 20 searching for the correct realm 2024-09-10T05:12:09.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.582+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556ee6072790 0x556ee6074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.582+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee6075320 con 0x556ee6072790 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.582+0000 7f5fe3fff640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556ee6072790 0x556ee6074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.583+0000 7f5fe3fff640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556ee6072790 0x556ee6074c50 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.583+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.583+0000 7f5fe3fff640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5fd408a040 0x7f5fd408a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.583+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee6075320 con 0x7f5fd408a040 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.583+0000 7f5fec65a640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5fd408a040 0x7f5fd408a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.583+0000 7f5fec65a640 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5fd408a040 0x7f5fd408a420 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.583+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.583+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee606de30 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.584+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.584+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6069440 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.584+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.584+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6069440 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.584+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.584+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee606de30 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.584+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.584+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee606de30 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.585+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.585+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x7f5fd408a040 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.585+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.585+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6072790 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.585+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.585+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6069440 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.585+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.585+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee606de30 2024-09-10T05:12:09.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.586+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.586+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6069440 2024-09-10T05:12:09.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.586+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.586+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x7f5fd408a040 2024-09-10T05:12:09.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.586+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.586+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6072790 2024-09-10T05:12:09.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.586+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.586+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6072790 2024-09-10T05:12:09.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.587+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.587+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee606de30 2024-09-10T05:12:09.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.587+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.587+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6072790 2024-09-10T05:12:09.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.587+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.587+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6072790 2024-09-10T05:12:09.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.587+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.587+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6069440 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.588+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.588+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6069440 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.588+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.588+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x7f5fd408a040 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.588+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.588+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6072790 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.588+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.588+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x7f5fd408a040 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.589+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.589+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6069440 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.589+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.589+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee606de30 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.589+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.589+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6072790 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.589+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.589+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee606de30 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.590+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.590+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x7f5fd408a040 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.590+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.590+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6072790 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.590+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.590+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x7f5fd408a040 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.590+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.590+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x556ee6069440 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556ee606d0d0 con 0x7f5fd408a040 2024-09-10T05:12:09.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:09.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:09.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:09.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:09.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:09.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:09.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60710a0 con 0x556ee6069440 2024-09-10T05:12:09.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60710a0 con 0x556ee6069440 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.591+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60710a0 con 0x7f5fd408a040 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 20 zone default found 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 4 Realm: () 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 20 zonegroup default 2024-09-10T05:12:09.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6071090 con 0x556ee606de30 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6077190 con 0x556ee6072790 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6077530 con 0x556ee6072790 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 20 started sync module instance, tier type = 2024-09-10T05:12:09.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:09.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.592+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6076630 con 0x7f5fd408a040 2024-09-10T05:12:09.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.594+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.594+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93934794009392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6076630 con 0x7f5fd408a040 2024-09-10T05:12:09.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.594+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6077ef0 con 0x556ee6069440 2024-09-10T05:12:09.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.595+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93934794009392] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.595+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.595+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93934794007424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6077ef0 con 0x556ee6069440 2024-09-10T05:12:09.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.595+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6078930 con 0x556ee6072790 2024-09-10T05:12:09.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.596+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93934794007424] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.596+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.596+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93934794013248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6077e60 con 0x556ee6072790 2024-09-10T05:12:09.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.596+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60797f0 con 0x7f5fd408a040 2024-09-10T05:12:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.597+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93934794013248] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.597+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.597+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93934794019648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6079760 con 0x7f5fd408a040 2024-09-10T05:12:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.597+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee607a6b0 con 0x556ee6069440 2024-09-10T05:12:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.598+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93934794019648] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.598+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.598+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93934794021744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee607a6b0 con 0x556ee6069440 2024-09-10T05:12:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.598+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee607b070 con 0x556ee606de30 2024-09-10T05:12:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.599+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93934794021744] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.599+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.599+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93934794023424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee607a620 con 0x556ee606de30 2024-09-10T05:12:09.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.600+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee607bdb0 con 0x556ee606de30 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.600+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.600+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93934794031520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee607ca70 con 0x556ee606de30 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.600+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee607d4b0 con 0x556ee606de30 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.601+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93934794023424] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.601+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93934794031520] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.601+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.602+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93934794032576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee607b410 con 0x556ee606de30 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.602+0000 7f5ff080e800 20 add_watcher() i=0 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.602+0000 7f5ff080e800 20 add_watcher() i=1 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.602+0000 7f5ff080e800 20 add_watcher() i=2 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.602+0000 7f5ff080e800 20 add_watcher() i=3 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.602+0000 7f5ff080e800 20 add_watcher() i=4 2024-09-10T05:12:09.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.602+0000 7f5ff080e800 20 add_watcher() i=5 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.602+0000 7f5ff080e800 20 add_watcher() i=6 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.602+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93934794032576] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.602+0000 7f5ff080e800 20 add_watcher() i=7 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.602+0000 7f5ff080e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.603+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6080750 con 0x556ee6069440 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.603+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.603+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93934794035072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee607dca0 con 0x556ee6069440 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.604+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93934794035072] v37'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.604+0000 7f5ea1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.604+0000 7f5ff080e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.604+0000 7f5ff080e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.604+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6089090 con 0x556ee6069440 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.606+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'54 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.606+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6089090 con 0x556ee606de30 2024-09-10T05:12:09.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.607+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.607+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6089090 con 0x556ee6072790 2024-09-10T05:12:09.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.607+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.607+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6088850 con 0x556ee6069440 2024-09-10T05:12:09.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.608+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'191 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.608+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6088850 con 0x7f5fd408a040 2024-09-10T05:12:09.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.609+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'68 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.609+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608a7e0 con 0x556ee6072790 2024-09-10T05:12:09.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.610+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'53 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.610+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608ad50 con 0x556ee6069440 2024-09-10T05:12:09.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.611+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.611+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608ade0 con 0x556ee606de30 2024-09-10T05:12:09.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.613+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.613+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608ae70 con 0x7f5fd408a040 2024-09-10T05:12:09.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.614+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.614+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608ae70 con 0x556ee6072790 2024-09-10T05:12:09.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.615+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.615+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b4a0 con 0x7f5fd408a040 2024-09-10T05:12:09.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.616+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'69 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.616+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b430 con 0x556ee606de30 2024-09-10T05:12:09.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.617+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.617+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b430 con 0x7f5fd408a040 2024-09-10T05:12:09.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.618+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.618+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b410 con 0x556ee606de30 2024-09-10T05:12:09.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.619+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'59 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.619+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b3b0 con 0x556ee6069440 2024-09-10T05:12:09.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.620+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'192 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.620+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b3b0 con 0x556ee6072790 2024-09-10T05:12:09.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.621+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'65 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.621+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b3b0 con 0x7f5fd408a040 2024-09-10T05:12:09.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.622+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'70 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.622+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b3b0 con 0x556ee6072790 2024-09-10T05:12:09.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.623+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.623+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b4b0 con 0x556ee6069440 2024-09-10T05:12:09.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.624+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.624+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b4b0 con 0x556ee6069440 2024-09-10T05:12:09.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.625+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'193 uv174 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.625+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b4b0 con 0x556ee6072790 2024-09-10T05:12:09.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.626+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'66 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.626+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b580 con 0x7f5fd408a040 2024-09-10T05:12:09.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.627+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.627+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b580 con 0x556ee6072790 2024-09-10T05:12:09.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.628+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.628+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b580 con 0x556ee6072790 2024-09-10T05:12:09.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.629+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'42 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.629+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b580 con 0x556ee6072790 2024-09-10T05:12:09.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.630+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.630+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b580 con 0x556ee6072790 2024-09-10T05:12:09.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.631+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'54 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.631+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b5c0 con 0x556ee606de30 2024-09-10T05:12:09.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.632+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.632+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b5c0 con 0x556ee6072790 2024-09-10T05:12:09.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.633+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.633+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b5c0 con 0x556ee606de30 2024-09-10T05:12:09.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.634+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.634+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b5c0 con 0x556ee6072790 2024-09-10T05:12:09.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.635+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'67 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.635+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b5c0 con 0x556ee606de30 2024-09-10T05:12:09.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.636+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'60 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.636+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee608b5c0 con 0x7f5fd408a040 2024-09-10T05:12:09.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.637+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.637+0000 7f5ea0fe1640 20 reqs_thread_entry: start 2024-09-10T05:12:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.637+0000 7f5ff080e800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.637+0000 7f5ff080e800 20 Filter name: none 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.637+0000 7f5e1a7fc640 20 reqs_thread_entry: start 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.637+0000 7f5ff080e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.637+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.637+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b6540 con 0x7f5fd408a040 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 : miss 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:95 8.11 8:8f8d60cd:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b7fe0 con 0x556ee6072790 2024-09-10T05:12:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(95 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:12:09.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 info.flags=0x17 2024-09-10T05:12:09.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 to cache LRU end 2024-09-10T05:12:09.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:09.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:12:09.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 2024-09-10T05:12:09.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.638+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:96 4.d 4:b2f9c9ae:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6135580 con 0x556ee6072790 2024-09-10T05:12:09.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.639+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(96 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.639+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:97 4.2e 4:75b608a1:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee61355c0 con 0x556ee6072790 2024-09-10T05:12:09.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.639+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 28 ==== osd_op_reply(97 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.639+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:98 4.2b 4:d788f7d5:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6135600 con 0x556ee6069440 2024-09-10T05:12:09.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.639+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(98 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2 [call out=430b] v0'0 uv9 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.639+0000 7f5ff080e800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-10T05:12:09.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.639+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:99 4.25 4:a68a81d9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6135600 con 0x556ee6072790 2024-09-10T05:12:09.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.640+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 29 ==== osd_op_reply(99 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.640+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:100 4.27 4:e7a39403:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6135600 con 0x556ee6069440 2024-09-10T05:12:09.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.640+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(100 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.640+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:101 4.c 4:328396ae:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6135600 con 0x556ee6069440 2024-09-10T05:12:09.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.640+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(101 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.640+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 4.26 4:67269879:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6135600 con 0x556ee606de30 2024-09-10T05:12:09.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.641+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(102 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6 [call out=430b] v0'0 uv7 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.641+0000 7f5ff080e800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.641+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:103 4.3b 4:dc0e4eb0:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6135600 con 0x556ee6072790 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.641+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 30 ==== osd_op_reply(103 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.641+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:104 4.f 4:f3c7e8a7:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6135600 con 0x556ee6069440 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.641+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(104 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8 [call out=430b] v0'0 uv6 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.641+0000 7f5ff080e800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.641+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:105 4.f 4:f151958f:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6135600 con 0x556ee6069440 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(105 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:106 4.b 4:d2cd3ab9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6135e00 con 0x7f5fd408a040 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(106 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10 [call out=701b] v0'0 uv9 ondisk = 0) ==== 195+0+701 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5ff080e800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5ff080e800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5ff080e800 20 get_obj_state: octx=0x7f5fe400ab20 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x556ee6134a18 s->prefetch_data=0 2024-09-10T05:12:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:107 3.38s0 3:1f0b1fbb:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6132f10 con 0x556ee606de30 2024-09-10T05:12:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(107 92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5ff080e800 10 manifest: total_size = 6 2024-09-10T05:12:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5ff080e800 20 get_obj_state: setting s->obj_tag to 92aa256a-2802-419e-96e0-ba675846cbc3.4238.17890085028749940970 2024-09-10T05:12:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5ff080e800 20 get_obj_state: octx=0x7f5fe400ab20 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x556ee6134a18 s->prefetch_data=0 2024-09-10T05:12:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5ff080e800 20 prepare_atomic_modification: state is not atomic. state=0x556ee6134a18 2024-09-10T05:12:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5ff080e800 20 bucket index object: :.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2 2024-09-10T05:12:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.642+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:108 4.2b 4:d788f7d5:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bd1e0 con 0x556ee6069440 2024-09-10T05:12:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.644+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(108 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2 [stat,call,call] v37'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.644+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:109 3.38s0 3:1f0b1fbb:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bd2a0 con 0x556ee606de30 2024-09-10T05:12:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.645+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(109 92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_9c8454ddf7aa50116496bac348d7550d [call] v37'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.645+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:110 4.2b 4:d788f7d5:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bdb10 con 0x556ee6069440 2024-09-10T05:12:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.645+0000 7f5ff080e800 20 get_obj_state: octx=0x7f5fe400ab20 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x556ee6134a18 s->prefetch_data=0 2024-09-10T05:12:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.645+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:111 3.1s0 3:82fcde74:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bdb10 con 0x556ee606de30 2024-09-10T05:12:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.646+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(111 92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.646+0000 7f5ff080e800 10 manifest: total_size = 3 2024-09-10T05:12:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.646+0000 7f5ff080e800 20 get_obj_state: setting s->obj_tag to 92aa256a-2802-419e-96e0-ba675846cbc3.4238.13436150253228655908 2024-09-10T05:12:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.646+0000 7f5ff080e800 20 get_obj_state: octx=0x7f5fe400ab20 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x556ee6134a18 s->prefetch_data=0 2024-09-10T05:12:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.646+0000 7f5ff080e800 20 prepare_atomic_modification: state is not atomic. state=0x556ee6134a18 2024-09-10T05:12:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.646+0000 7f5ff080e800 20 bucket index object: :.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6 2024-09-10T05:12:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.646+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:112 4.26 4:67269879:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60c27f0 con 0x556ee606de30 2024-09-10T05:12:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.647+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(110 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2 [stat,call,call] v37'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.647+0000 7f5ecaffd640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-10T05:12:09.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.647+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(112 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6 [stat,call,call] v37'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.647+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:113 3.1s0 3:82fcde74:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b9b40 con 0x556ee606de30 2024-09-10T05:12:09.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.648+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(113 92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_b1b9a972ccd8c962a473909b97007eb4 [call] v37'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.648+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:114 4.26 4:67269879:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60be7b0 con 0x556ee606de30 2024-09-10T05:12:09.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.648+0000 7f5ff080e800 20 get_obj_state: octx=0x7f5fe400ab20 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x556ee6134a18 s->prefetch_data=0 2024-09-10T05:12:09.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.648+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:115 3.24s0 3:25a1bcaf:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bef70 con 0x556ee606de30 2024-09-10T05:12:09.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.649+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(115 92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.649+0000 7f5ff080e800 10 manifest: total_size = 4 2024-09-10T05:12:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.649+0000 7f5ff080e800 20 get_obj_state: setting s->obj_tag to 92aa256a-2802-419e-96e0-ba675846cbc3.4238.11008507135468346851 2024-09-10T05:12:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.649+0000 7f5ff080e800 20 get_obj_state: octx=0x7f5fe400ab20 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x556ee6134a18 s->prefetch_data=0 2024-09-10T05:12:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.649+0000 7f5ff080e800 20 prepare_atomic_modification: state is not atomic. state=0x556ee6134a18 2024-09-10T05:12:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.649+0000 7f5ff080e800 20 bucket index object: :.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8 2024-09-10T05:12:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.649+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:116 4.f 4:f3c7e8a7:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60c2fb0 con 0x556ee6069440 2024-09-10T05:12:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.649+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 30 ==== osd_op_reply(114 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6 [stat,call,call] v37'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.649+0000 7f5eca7fc640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-10T05:12:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.650+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 34 ==== osd_op_reply(116 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8 [stat,call,call] v37'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.650+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:117 3.24s0 3:25a1bcaf:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60be7b0 con 0x556ee606de30 2024-09-10T05:12:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.651+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 31 ==== osd_op_reply(117 92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v37'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.651+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:118 4.f 4:f3c7e8a7:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bef70 con 0x556ee6069440 2024-09-10T05:12:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.651+0000 7f5ff080e800 20 get_obj_state: octx=0x7f5fe400ab20 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x556ee6134a18 s->prefetch_data=0 2024-09-10T05:12:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.651+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:119 3.3as0 3:5e463c8f:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bef70 con 0x7f5fd408a040 2024-09-10T05:12:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.652+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(119 92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.652+0000 7f5ff080e800 10 manifest: total_size = 5 2024-09-10T05:12:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.652+0000 7f5ff080e800 20 get_obj_state: setting s->obj_tag to 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1859825308255894984 2024-09-10T05:12:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.652+0000 7f5ff080e800 20 get_obj_state: octx=0x7f5fe400ab20 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x556ee6134a18 s->prefetch_data=0 2024-09-10T05:12:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.652+0000 7f5ff080e800 20 prepare_atomic_modification: state is not atomic. state=0x556ee6134a18 2024-09-10T05:12:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.652+0000 7f5ff080e800 20 bucket index object: :.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10 2024-09-10T05:12:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.652+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:120 4.b 4:d2cd3ab9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bef70 con 0x7f5fd408a040 2024-09-10T05:12:09.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.653+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 35 ==== osd_op_reply(118 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8 [stat,call,call] v37'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.653+0000 7f5ecaffd640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-10T05:12:09.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.653+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 24 ==== osd_op_reply(120 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10 [stat,call,call] v37'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.653+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:121 3.3as0 3:5e463c8f:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bef70 con 0x7f5fd408a040 2024-09-10T05:12:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.654+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 25 ==== osd_op_reply(121 92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_24d27c169c2c881eb09a065116f2aa5c [call] v37'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.654+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:122 4.b 4:d2cd3ab9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bef70 con 0x7f5fd408a040 2024-09-10T05:12:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.654+0000 7f5ff080e800 20 get_obj_state: octx=0x7f5fe400ab20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x556ee6134a18 s->prefetch_data=0 2024-09-10T05:12:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.654+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:123 3.cs0 3:3279caba:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bef70 con 0x556ee6072790 2024-09-10T05:12:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.655+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 31 ==== osd_op_reply(123 92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.655+0000 7f5ff080e800 10 manifest: total_size = 5 2024-09-10T05:12:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.655+0000 7f5ff080e800 20 get_obj_state: setting s->obj_tag to _Gwyr___zd8RG7XC0cXdN2J0BPZ0p3TH 2024-09-10T05:12:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.655+0000 7f5ff080e800 20 get_obj_state: octx=0x7f5fe400ab20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x556ee6134a18 s->prefetch_data=0 2024-09-10T05:12:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.655+0000 7f5ff080e800 20 prepare_atomic_modification: state is not atomic. state=0x556ee6134a18 2024-09-10T05:12:09.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.655+0000 7f5ff080e800 20 bucket index object: :.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10 2024-09-10T05:12:09.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.655+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:124 4.b 4:d2cd3ab9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bef70 con 0x7f5fd408a040 2024-09-10T05:12:09.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.655+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 26 ==== osd_op_reply(122 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10 [stat,call,call] v37'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.656+0000 7f5eca7fc640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-10T05:12:09.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.656+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 27 ==== osd_op_reply(124 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10 [stat,call,call] v37'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.656+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:125 3.cs0 3:3279caba:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bef70 con 0x556ee6072790 2024-09-10T05:12:09.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 32 ==== osd_op_reply(125 92aa256a-2802-419e-96e0-ba675846cbc3.4238.5_bb3aec0fdcdbc2974890f805c585d432 [call] v37'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:126 4.b 4:d2cd3ab9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bef70 con 0x7f5fd408a040 2024-09-10T05:12:09.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 20 list_objects_ordered: starting attempt 1 2024-09-10T05:12:09.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:127 4.d 4:b2f9c9ae:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bef70 con 0x556ee6072790 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:128 4.2e 4:75b608a1:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6134ce0 con 0x556ee6072790 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:129 4.2b 4:d788f7d5:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60c6a70 con 0x556ee6069440 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:130 4.25 4:a68a81d9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60bef70 con 0x556ee6072790 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:131 4.27 4:e7a39403:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60cba30 con 0x556ee6069440 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:132 4.c 4:328396ae:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60ce7b0 con 0x556ee6069440 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:133 4.26 4:67269879:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60d1460 con 0x556ee606de30 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:134 4.3b 4:dc0e4eb0:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60ce7b0 con 0x556ee6072790 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:135 4.f 4:f3c7e8a7:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60d6490 con 0x556ee6069440 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:136 4.f 4:f151958f:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60d8d80 con 0x556ee6069440 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.657+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:137 4.b 4:d2cd3ab9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60db880 con 0x7f5fd408a040 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.658+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 32 ==== osd_op_reply(133 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.658+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 33 ==== osd_op_reply(128 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.658+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 34 ==== osd_op_reply(130 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.658+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 35 ==== osd_op_reply(127 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.658+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 36 ==== osd_op_reply(134 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.658+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 36 ==== osd_op_reply(129 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2 [call out=128b] v0'0 uv11 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.658+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 37 ==== osd_op_reply(131 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.658+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 38 ==== osd_op_reply(132 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.658+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 39 ==== osd_op_reply(135 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8 [call out=128b] v0'0 uv8 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.658+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 28 ==== osd_op_reply(126 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10 [stat,call,call] v37'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.658+0000 7f5eca7fc640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.658+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 40 ==== osd_op_reply(136 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 29 ==== osd_op_reply(137 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10 [call out=128b] v0'0 uv13 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T05:12:09.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.5])"; uploads.size()=0; is_truncated=0 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:138 4.d 4:b2f9c9ae:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60db880 con 0x556ee6072790 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:139 4.2e 4:75b608a1:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6132ed0 con 0x556ee6072790 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:140 4.2b 4:d788f7d5:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60cb4e0 con 0x556ee6069440 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:141 4.25 4:a68a81d9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60ce160 con 0x556ee6072790 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:142 4.27 4:e7a39403:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60d8510 con 0x556ee6069440 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:143 4.c 4:328396ae:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60db880 con 0x556ee6069440 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:144 4.26 4:67269879:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60d8990 con 0x556ee606de30 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:145 4.3b 4:dc0e4eb0:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60cb4e0 con 0x556ee6072790 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:146 4.f 4:f3c7e8a7:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee6132ed0 con 0x556ee6069440 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:147 4.f 4:f151958f:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60db880 con 0x556ee6069440 2024-09-10T05:12:09.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:148 4.b 4:d2cd3ab9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60ce160 con 0x7f5fd408a040 2024-09-10T05:12:09.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 41 ==== osd_op_reply(140 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2 [call out=128b] v0'0 uv11 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 42 ==== osd_op_reply(142 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 43 ==== osd_op_reply(143 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 30 ==== osd_op_reply(148 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10 [call out=128b] v0'0 uv13 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 33 ==== osd_op_reply(144 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 44 ==== osd_op_reply(146 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8 [call out=128b] v0'0 uv8 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 37 ==== osd_op_reply(138 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 38 ==== osd_op_reply(139 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 45 ==== osd_op_reply(147 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 39 ==== osd_op_reply(141 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 40 ==== osd_op_reply(145 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.659+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60db880 con 0x7f5fd408a040 2024-09-10T05:12:09.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.661+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 31 ==== osd_op_reply(149 foo.buckets [call] v37'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.661+0000 7f5ff080e800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-10T05:12:09.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.661+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60db880 con 0x7f5fd408a040 2024-09-10T05:12:09.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.662+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 32 ==== osd_op_reply(150 myfoo [call,call,delete] v37'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.662+0000 7f5ff080e800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T05:12:09.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.662+0000 7f5ff080e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:12:09.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.662+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93934794786864 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60db880 con 0x556ee606de30 2024-09-10T05:12:09.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.662+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 34 ==== watch-notify(notify (1) cookie 93934794031520 notify 158913789970 ret 0) ==== 191+0+0 (crc 0 0 0) 0x556ee6088250 con 0x556ee606de30 2024-09-10T05:12:09.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.662+0000 7f5eca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789970 cookie 93934794031520 notifier 4658 bl.length()=149 2024-09-10T05:12:09.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.662+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 35 ==== osd_op_reply(151 notify.6 [notify cookie 93934794786864 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.662+0000 7f5eca7fc640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5e200032c0 con 0x556ee606de30 2024-09-10T05:12:09.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.663+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 36 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.663+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 37 ==== watch-notify(notify_complete (2) cookie 93934794786864 notify 158913789970 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556ee5ea6970 con 0x556ee606de30 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.663+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:153 8.11 8:8f8d60cd:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60db880 con 0x556ee6072790 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.664+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 41 ==== osd_op_reply(153 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 [call,call,delete] v37'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.664+0000 7f5ff080e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 from cache 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.664+0000 7f5ff080e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.5, ofs0, ns] 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.664+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify cookie 93934794786864 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60db880 con 0x7f5fd408a040 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.664+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 33 ==== watch-notify(notify (1) cookie 93934794019648 notify 158913789977 ret 0) ==== 248+0+0 (crc 0 0 0) 0x556ee608a9b0 con 0x7f5fd408a040 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.664+0000 7f5ecaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789977 cookie 93934794019648 notifier 4658 bl.length()=206 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.664+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 34 ==== osd_op_reply(154 notify.3 [notify cookie 93934794786864 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.664+0000 7f5ecaffd640 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:155 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5eb0003d60 con 0x7f5fd408a040 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.664+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 35 ==== osd_op_reply(155 notify.3 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.664+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 36 ==== watch-notify(notify_complete (2) cookie 93934794786864 notify 158913789977 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556ee608a610 con 0x7f5fd408a040 2024-09-10T05:12:09.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.665+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:156 4.d 4:b2f9c9ae:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60db880 con 0x556ee6072790 2024-09-10T05:12:09.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.665+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:157 4.2e 4:75b608a1:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee6134e80 con 0x556ee6072790 2024-09-10T05:12:09.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.665+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:158 4.2b 4:d788f7d5:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5080 con 0x556ee6069440 2024-09-10T05:12:09.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.665+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:159 4.25 4:a68a81d9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b58d0 con 0x556ee6072790 2024-09-10T05:12:09.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.665+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:160 4.27 4:e7a39403:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b6e00 con 0x556ee6069440 2024-09-10T05:12:09.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.665+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:161 4.c 4:328396ae:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60cec20 con 0x556ee6069440 2024-09-10T05:12:09.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.665+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:162 4.26 4:67269879:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60cf4b0 con 0x556ee606de30 2024-09-10T05:12:09.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.665+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:163 4.3b 4:dc0e4eb0:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60db880 con 0x556ee6072790 2024-09-10T05:12:09.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.665+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:164 4.f 4:f3c7e8a7:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60cfd40 con 0x556ee6069440 2024-09-10T05:12:09.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.665+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:165 4.f 4:f151958f:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60d07f0 con 0x556ee6069440 2024-09-10T05:12:09.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.665+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:166 4.b 4:d2cd3ab9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60cbaf0 con 0x7f5fd408a040 2024-09-10T05:12:09.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.666+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 42 ==== osd_op_reply(159 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.3 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.666+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 43 ==== osd_op_reply(163 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.7 [delete] v37'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.666+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 38 ==== osd_op_reply(162 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.6 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.666+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 37 ==== osd_op_reply(166 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.10 [delete] v37'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.666+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 44 ==== osd_op_reply(156 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.0 [delete] v37'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.667+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 46 ==== osd_op_reply(158 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.2 [delete] v37'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.667+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 47 ==== osd_op_reply(161 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.5 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.667+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 48 ==== osd_op_reply(160 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.4 [delete] v37'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.667+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 45 ==== osd_op_reply(157 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.1 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.667+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 49 ==== osd_op_reply(164 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.8 [delete] v37'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.668+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 50 ==== osd_op_reply(165 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.5.9 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.668+0000 7f5ff080e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 : miss 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.668+0000 7f5ff080e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.668+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:167 6.2 6:40c2416e:::pubsub..bucket.myfoo%2f92aa256a-2802-419e-96e0-ba675846cbc3.4238.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5cf0 con 0x556ee6072790 2024-09-10T05:12:09.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.668+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 46 ==== osd_op_reply(167 pubsub..bucket.myfoo/92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.668+0000 7f5ff080e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.668+0000 7f5ff080e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 info.flags=0x0 2024-09-10T05:12:09.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.668+0000 7f5ff080e800 10 adding default.rgw.log++pubsub..bucket.myfoo/92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 to cache LRU end 2024-09-10T05:12:09.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.668+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:168 6.2 6:40c2416e:::pubsub..bucket.myfoo%2f92aa256a-2802-419e-96e0-ba675846cbc3.4238.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5cf0 con 0x556ee6072790 2024-09-10T05:12:09.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.669+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 47 ==== osd_op_reply(168 pubsub..bucket.myfoo/92aa256a-2802-419e-96e0-ba675846cbc3.4238.5 [delete] v37'17 uv16 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.669+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5cf0 con 0x7f5fd408a040 2024-09-10T05:12:09.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.670+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 38 ==== osd_op_reply(169 foo.buckets [call] v37'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.671+0000 7f5ea1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:09.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.671+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93934794035072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5cf0 con 0x556ee6069440 2024-09-10T05:12:09.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.672+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 51 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 93934794035072] v37'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.672+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93934794009392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5cf0 con 0x7f5fd408a040 2024-09-10T05:12:09.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.673+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 39 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 93934794009392] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.673+0000 7f5ff080e800 20 remove_watcher() i=0 2024-09-10T05:12:09.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.673+0000 7f5ff080e800 2 removed watcher, disabling cache 2024-09-10T05:12:09.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.673+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93934794007424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5cf0 con 0x556ee6069440 2024-09-10T05:12:09.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.674+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 52 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 93934794007424] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.674+0000 7f5ff080e800 20 remove_watcher() i=1 2024-09-10T05:12:09.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.674+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93934794013248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5cf0 con 0x556ee6072790 2024-09-10T05:12:09.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.675+0000 7f5fe3fff640 1 -- 172.21.15.192:0/1002011793 <== osd.3 v2:172.21.15.192:6816/1620624472 48 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 93934794013248] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fd4051070 con 0x556ee6072790 2024-09-10T05:12:09.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.675+0000 7f5ff080e800 20 remove_watcher() i=2 2024-09-10T05:12:09.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.675+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93934794019648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5cf0 con 0x7f5fd408a040 2024-09-10T05:12:09.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.676+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.2 v2:172.21.15.192:6801/2435677948 40 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 93934794019648] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x7f5fd408a040 2024-09-10T05:12:09.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.676+0000 7f5ff080e800 20 remove_watcher() i=3 2024-09-10T05:12:09.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.676+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93934794021744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5cf0 con 0x556ee6069440 2024-09-10T05:12:09.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.677+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 <== osd.1 v2:172.21.15.192:6800/3487349558 53 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 93934794021744] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe400a4d0 con 0x556ee6069440 2024-09-10T05:12:09.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.677+0000 7f5ff080e800 20 remove_watcher() i=4 2024-09-10T05:12:09.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.677+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93934794023424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5cf0 con 0x556ee606de30 2024-09-10T05:12:09.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.678+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 39 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 93934794023424] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.678+0000 7f5ff080e800 20 remove_watcher() i=5 2024-09-10T05:12:09.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.678+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93934794031520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5cf0 con 0x556ee606de30 2024-09-10T05:12:09.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.679+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 40 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 93934794031520] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.679+0000 7f5ff080e800 20 remove_watcher() i=6 2024-09-10T05:12:09.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.679+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93934794032576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556ee60b5cf0 con 0x556ee606de30 2024-09-10T05:12:09.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5febe59640 1 -- 172.21.15.192:0/1002011793 <== osd.0 v2:172.21.15.139:6800/2915567440 41 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 93934794032576] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc070020 con 0x556ee606de30 2024-09-10T05:12:09.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 20 remove_watcher() i=7 2024-09-10T05:12:09.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556ee606de30 msgr2=0x556ee6070220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556ee606de30 0x556ee6070220 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556ee6069440 msgr2=0x556ee606b900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556ee6069440 0x556ee606b900 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5fd408a040 msgr2=0x7f5fd408a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5fd408a040 0x7f5fd408a420 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556ee6072790 msgr2=0x556ee6074c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556ee6072790 0x556ee6074c50 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5eb403c730 msgr2=0x7f5eb403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5eb403c730 0x7f5eb403ebf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40539f0 tx=0x7f5fd406b040 comp rx=0 tx=0).stop 2024-09-10T05:12:09.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 msgr2=0x556ee605deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5fec65a640 1 -- 172.21.15.192:0/1002011793 reap_dead start 2024-09-10T05:12:09.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 0x556ee605deb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc039890 tx=0x7f5fdc03a9e0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 shutdown_connections 2024-09-10T05:12:09.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1002011793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee6056ad0 0x556ee605deb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 >> 172.21.15.192:0/1002011793 conn(0x556ee6052ed0 msgr2=0x556ee60510e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 shutdown_connections 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.680+0000 7f5ff080e800 1 -- 172.21.15.192:0/1002011793 wait complete. 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/2721902159 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5ec403c730 msgr2=0x7f5ec403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 --2- 172.21.15.192:0/2721902159 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5ec403c730 0x7f5ec403ebf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4045f20 tx=0x7f5fd4005a00 comp rx=0 tx=0).stop 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/2721902159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5ea6550 msgr2=0x556ee604d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 --2- 172.21.15.192:0/2721902159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5ea6550 0x556ee604d0b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00e660 tx=0x7f5fdc018e20 comp rx=0 tx=0).stop 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/2721902159 shutdown_connections 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 --2- 172.21.15.192:0/2721902159 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5ec403c730 0x7f5ec403ebf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 --2- 172.21.15.192:0/2721902159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5ea6550 0x556ee604d0b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/2721902159 >> 172.21.15.192:0/2721902159 conn(0x556ee603b280 msgr2=0x556ee603b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/2721902159 shutdown_connections 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/2721902159 wait complete. 2024-09-10T05:12:09.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556ee60327a0 msgr2=0x556ee6034c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556ee60327a0 0x556ee6034c20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556ee5f33200 msgr2=0x556ee60303c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556ee5f33200 0x556ee60303c0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556ee6036810 msgr2=0x556ee6038c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556ee6036810 0x556ee6038c00 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5ed403c920 msgr2=0x7f5ed403ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5ed403c920 0x7f5ed403ede0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4057000 tx=0x7f5fd4052000 comp rx=0 tx=0).stop 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 msgr2=0x556ee6028d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 --2- 172.21.15.192:0/1145914026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556ee5f31df0 0x556ee6028d70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0012f0 tx=0x7f5fdc000ed0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5fec65a640 1 -- 172.21.15.192:0/1145914026 reap_dead start 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 shutdown_connections 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 >> 172.21.15.192:0/1145914026 conn(0x556ee5f2d1c0 msgr2=0x556ee6022660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 shutdown_connections 2024-09-10T05:12:09.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.681+0000 7f5ff080e800 1 -- 172.21.15.192:0/1145914026 wait complete. 2024-09-10T05:12:09.691 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T05:12:09.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T05:12:09.691 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-10T05:12:09.739 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:09.739 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:09.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.739+0000 7f64fab39800 1 Processor -- start 2024-09-10T05:12:09.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.739+0000 7f64fab39800 1 -- start start 2024-09-10T05:12:09.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.739+0000 7f64fab39800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55dbfcddf220 0x55dbfcde4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.739+0000 7f64fab39800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dbfcc88e40 con 0x55dbfcddde10 2024-09-10T05:12:09.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.739+0000 7f64fab39800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55dbfcc53680 con 0x55dbfcddf220 2024-09-10T05:12:09.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.739+0000 7f64effff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55dbfcddf220 0x55dbfcde4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.739+0000 7f64f67c7640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55dbfcddde10 0x55dbfcddeb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:33726/0 (socket says 172.21.15.192:33726) 2024-09-10T05:12:09.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.739+0000 7f64effff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55dbfcddf220 0x55dbfcde4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60634/0 (socket says 172.21.15.192:60634) 2024-09-10T05:12:09.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.739+0000 7f64f67c7640 1 -- 172.21.15.192:0/2481487384 learned_addr learned my addr 172.21.15.192:0/2481487384 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:09.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.740+0000 7f64effff640 1 -- 172.21.15.192:0/2481487384 >> v1:172.21.15.139:6789/0 conn(0x55dbfcddde10 legacy=0x55dbfcddeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.740+0000 7f64f5fc6640 1 -- 172.21.15.192:0/2481487384 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4004369942 0 0) 0x55dbfcc88e40 con 0x55dbfcddde10 2024-09-10T05:12:09.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.740+0000 7f64effff640 1 -- 172.21.15.192:0/2481487384 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbfcc6f6b0 con 0x55dbfcddf220 2024-09-10T05:12:09.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.741+0000 7f64effff640 1 --2- 172.21.15.192:0/2481487384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddf220 0x55dbfcde4dc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f64e000a470 tx=0x7f64e0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b044ee4cb9e0c99c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.742+0000 7f64f5fc6640 1 -- 172.21.15.192:0/2481487384 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e0053570 con 0x55dbfcddf220 2024-09-10T05:12:09.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.742+0000 7f64f5fc6640 1 -- 172.21.15.192:0/2481487384 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e0058070 con 0x55dbfcddf220 2024-09-10T05:12:09.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.742+0000 7f64f5fc6640 1 -- 172.21.15.192:0/2481487384 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e0053880 con 0x55dbfcddf220 2024-09-10T05:12:09.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.742+0000 7f64fab39800 1 -- 172.21.15.192:0/2481487384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddf220 msgr2=0x55dbfcde4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.742+0000 7f64fab39800 1 --2- 172.21.15.192:0/2481487384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddf220 0x55dbfcde4dc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f64e000a470 tx=0x7f64e0045a20 comp rx=0 tx=0).stop 2024-09-10T05:12:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.742+0000 7f64fab39800 1 -- 172.21.15.192:0/2481487384 shutdown_connections 2024-09-10T05:12:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.742+0000 7f64fab39800 1 --2- 172.21.15.192:0/2481487384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddf220 0x55dbfcde4dc0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.742+0000 7f64fab39800 1 -- 172.21.15.192:0/2481487384 >> 172.21.15.192:0/2481487384 conn(0x55dbfcdd9200 msgr2=0x55dbfcddb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.743+0000 7f64fab39800 1 -- 172.21.15.192:0/2481487384 shutdown_connections 2024-09-10T05:12:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.743+0000 7f64fab39800 1 -- 172.21.15.192:0/2481487384 wait complete. 2024-09-10T05:12:09.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.756+0000 7f64fab39800 1 Processor -- start 2024-09-10T05:12:09.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.757+0000 7f64fab39800 1 -- start start 2024-09-10T05:12:09.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.757+0000 7f64fab39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 0x55dbfcd52620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.757+0000 7f64fab39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dbfcc77dd0 con 0x55dbfcddde10 2024-09-10T05:12:09.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.757+0000 7f64f67c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 0x55dbfcd52620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.757+0000 7f64f67c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 0x55dbfcd52620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60646/0 (socket says 172.21.15.192:60646) 2024-09-10T05:12:09.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.757+0000 7f64f67c7640 1 -- 172.21.15.192:0/2144416180 learned_addr learned my addr 172.21.15.192:0/2144416180 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.757+0000 7f64f67c7640 1 -- 172.21.15.192:0/2144416180 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbfcc90e10 con 0x55dbfcddde10 2024-09-10T05:12:09.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.757+0000 7f64f67c7640 1 --2- 172.21.15.192:0/2144416180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 0x55dbfcd52620 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f64e8001ea0 tx=0x7f64e800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ba7f8a632d75e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.758+0000 7f63e4608640 1 -- 172.21.15.192:0/2144416180 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e8008070 con 0x55dbfcddde10 2024-09-10T05:12:09.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.758+0000 7f63e4608640 1 -- 172.21.15.192:0/2144416180 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e800d500 con 0x55dbfcddde10 2024-09-10T05:12:09.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.758+0000 7f63e4608640 1 -- 172.21.15.192:0/2144416180 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e800d880 con 0x55dbfcddde10 2024-09-10T05:12:09.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64fab39800 1 -- 172.21.15.192:0/2144416180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 msgr2=0x55dbfcd52620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64fab39800 1 --2- 172.21.15.192:0/2144416180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 0x55dbfcd52620 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f64e8001ea0 tx=0x7f64e800b6a0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64fab39800 1 -- 172.21.15.192:0/2144416180 shutdown_connections 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64fab39800 1 --2- 172.21.15.192:0/2144416180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 0x55dbfcd52620 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64fab39800 1 -- 172.21.15.192:0/2144416180 >> 172.21.15.192:0/2144416180 conn(0x55dbfcdd9200 msgr2=0x55dbfcec8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64fab39800 1 -- 172.21.15.192:0/2144416180 shutdown_connections 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64fab39800 1 -- 172.21.15.192:0/2144416180 wait complete. 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64fab39800 1 Processor -- start 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64fab39800 1 -- start start 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64fab39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 0x55dbfcece720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64fab39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dbfcddf910 con 0x55dbfcddde10 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64f67c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 0x55dbfcece720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64f67c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 0x55dbfcece720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60652/0 (socket says 172.21.15.192:60652) 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.759+0000 7f64f67c7640 1 -- 172.21.15.192:0/162157429 learned_addr learned my addr 172.21.15.192:0/162157429 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.760+0000 7f64f67c7640 1 -- 172.21.15.192:0/162157429 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbfcecec80 con 0x55dbfcddde10 2024-09-10T05:12:09.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.760+0000 7f64f67c7640 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 0x55dbfcece720 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f64e800b6e0 tx=0x7f64e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.760+0000 7f63e2e05640 1 -- 172.21.15.192:0/162157429 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e800f950 con 0x55dbfcddde10 2024-09-10T05:12:09.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.760+0000 7f63e2e05640 1 -- 172.21.15.192:0/162157429 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e800faf0 con 0x55dbfcddde10 2024-09-10T05:12:09.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.760+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbfcecd030 con 0x55dbfcddde10 2024-09-10T05:12:09.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.760+0000 7f63e2e05640 1 -- 172.21.15.192:0/162157429 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e800fdd0 con 0x55dbfcddde10 2024-09-10T05:12:09.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.760+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbfcecd5f0 con 0x55dbfcddde10 2024-09-10T05:12:09.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.761+0000 7f63e2e05640 1 -- 172.21.15.192:0/162157429 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f64e8017040 con 0x55dbfcddde10 2024-09-10T05:12:09.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.761+0000 7f63e2e05640 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63dc03c6e0 0x7f63dc03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.761+0000 7f63e2e05640 1 -- 172.21.15.192:0/162157429 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f64e8015020 con 0x55dbfcddde10 2024-09-10T05:12:09.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.761+0000 7f64effff640 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63dc03c6e0 0x7f63dc03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.761+0000 7f64fab39800 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55dbfcddf220 0x55dbfcedf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.761+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcedf7b0 con 0x55dbfcddf220 2024-09-10T05:12:09.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.761+0000 7f64f6fc8640 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55dbfcddf220 0x55dbfcedf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.762+0000 7f64effff640 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63dc03c6e0 0x7f63dc03eba0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f64e0057000 tx=0x7f64e0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.762+0000 7f64f6fc8640 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55dbfcddf220 0x55dbfcedf270 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.762+0000 7f64f6fc8640 1 -- 172.21.15.192:0/162157429 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcddf220 2024-09-10T05:12:09.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.762+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcecdaf0 con 0x55dbfcddf220 2024-09-10T05:12:09.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.762+0000 7f64f6fc8640 1 -- 172.21.15.192:0/162157429 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcddf220 2024-09-10T05:12:09.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.763+0000 7f64fab39800 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55dbfcee1b00 0x55dbfcee3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.763+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcee45c0 con 0x55dbfcee1b00 2024-09-10T05:12:09.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.763+0000 7f64f67c7640 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55dbfcee1b00 0x55dbfcee3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.763+0000 7f64f67c7640 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55dbfcee1b00 0x55dbfcee3ef0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.763+0000 7f64f67c7640 1 -- 172.21.15.192:0/162157429 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f64e804bd70 con 0x55dbfcee1b00 2024-09-10T05:12:09.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.763+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcee09a0 con 0x55dbfcddf220 2024-09-10T05:12:09.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.764+0000 7f64f6fc8640 1 -- 172.21.15.192:0/162157429 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcddf220 2024-09-10T05:12:09.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.764+0000 7f64fab39800 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55dbfcee5a00 0x55dbfcee7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.764+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcee8530 con 0x55dbfcee5a00 2024-09-10T05:12:09.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.764+0000 7f64effff640 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55dbfcee5a00 0x55dbfcee7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.764+0000 7f64effff640 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55dbfcee5a00 0x55dbfcee7df0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.764+0000 7f64effff640 1 -- 172.21.15.192:0/162157429 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f64e0051070 con 0x55dbfcee5a00 2024-09-10T05:12:09.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.765+0000 7f64fab39800 1 Processor -- start 2024-09-10T05:12:09.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.765+0000 7f64fab39800 1 -- start start 2024-09-10T05:12:09.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.765+0000 7f64fab39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcef6190 0x55dbfcef65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.765+0000 7f64fab39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dbfccd5a00 con 0x55dbfcef6190 2024-09-10T05:12:09.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.765+0000 7f64f67c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcef6190 0x55dbfcef65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.765+0000 7f64f67c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcef6190 0x55dbfcef65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60656/0 (socket says 172.21.15.192:60656) 2024-09-10T05:12:09.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.765+0000 7f64f67c7640 1 -- 172.21.15.192:0/3452802842 learned_addr learned my addr 172.21.15.192:0/3452802842 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.765+0000 7f64f67c7640 1 -- 172.21.15.192:0/3452802842 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbfcef6bf0 con 0x55dbfcef6190 2024-09-10T05:12:09.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.766+0000 7f64f67c7640 1 --2- 172.21.15.192:0/3452802842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcef6190 0x55dbfcef65b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f64e800e500 tx=0x7f64e8018e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.766+0000 7f63dbfff640 1 -- 172.21.15.192:0/3452802842 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e804b350 con 0x55dbfcef6190 2024-09-10T05:12:09.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.766+0000 7f63dbfff640 1 -- 172.21.15.192:0/3452802842 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e801ac80 con 0x55dbfcef6190 2024-09-10T05:12:09.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.766+0000 7f63dbfff640 1 -- 172.21.15.192:0/3452802842 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e80449d0 con 0x55dbfcef6190 2024-09-10T05:12:09.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.766+0000 7f64fab39800 1 -- 172.21.15.192:0/3452802842 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbfcef7420 con 0x55dbfcef6190 2024-09-10T05:12:09.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.766+0000 7f64fab39800 1 -- 172.21.15.192:0/3452802842 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbfcef79c0 con 0x55dbfcef6190 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.767+0000 7f63dbfff640 1 -- 172.21.15.192:0/3452802842 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f64e8044b70 con 0x55dbfcef6190 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.767+0000 7f63dbfff640 1 --2- 172.21.15.192:0/3452802842 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63d003c780 0x7f63d003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.767+0000 7f63dbfff640 1 -- 172.21.15.192:0/3452802842 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f64e803c790 con 0x55dbfcef6190 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.767+0000 7f64effff640 1 --2- 172.21.15.192:0/3452802842 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63d003c780 0x7f63d003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.767+0000 7f64fab39800 1 Processor -- start 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.767+0000 7f64fab39800 1 -- start start 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.768+0000 7f64fab39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 0x55dbfcf02e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.768+0000 7f64fab39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dbfced11b0 con 0x55dbfcf02a70 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.768+0000 7f64effff640 1 --2- 172.21.15.192:0/3452802842 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63d003c780 0x7f63d003ec40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55dbfcedfc80 tx=0x7f64e0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.768+0000 7f64f67c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 0x55dbfcf02e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.768+0000 7f64f67c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 0x55dbfcf02e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60664/0 (socket says 172.21.15.192:60664) 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.768+0000 7f64f67c7640 1 -- 172.21.15.192:0/3719132340 learned_addr learned my addr 172.21.15.192:0/3719132340 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.768+0000 7f64f67c7640 1 -- 172.21.15.192:0/3719132340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbfcf03420 con 0x55dbfcf02a70 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.768+0000 7f64f67c7640 1 --2- 172.21.15.192:0/3719132340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 0x55dbfcf02e50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f64e800e6b0 tx=0x7f64e80397b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666c9c5f2f6ed74 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.768+0000 7f63d9ffb640 1 -- 172.21.15.192:0/3719132340 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e8044070 con 0x55dbfcf02a70 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.768+0000 7f63d9ffb640 1 -- 172.21.15.192:0/3719132340 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e800edc0 con 0x55dbfcf02a70 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.768+0000 7f63d9ffb640 1 -- 172.21.15.192:0/3719132340 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e8026d50 con 0x55dbfcf02a70 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64fab39800 1 -- 172.21.15.192:0/3719132340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 msgr2=0x55dbfcf02e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64fab39800 1 --2- 172.21.15.192:0/3719132340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 0x55dbfcf02e50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f64e800e6b0 tx=0x7f64e80397b0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64fab39800 1 -- 172.21.15.192:0/3719132340 shutdown_connections 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64fab39800 1 --2- 172.21.15.192:0/3719132340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 0x55dbfcf02e50 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64fab39800 1 -- 172.21.15.192:0/3719132340 >> 172.21.15.192:0/3719132340 conn(0x55dbfcefee70 msgr2=0x55dbfcefd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64fab39800 1 -- 172.21.15.192:0/3719132340 shutdown_connections 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64fab39800 1 -- 172.21.15.192:0/3719132340 wait complete. 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64fab39800 1 Processor -- start 2024-09-10T05:12:09.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64fab39800 1 -- start start 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64fab39800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 0x55dbfcf09e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64fab39800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dbfcf038d0 con 0x55dbfcf02a70 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64f67c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 0x55dbfcf09e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64f67c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 0x55dbfcf09e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60668/0 (socket says 172.21.15.192:60668) 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.769+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 learned_addr learned my addr 172.21.15.192:0/2113991486 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.770+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbfcf0a3f0 con 0x55dbfcf02a70 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.770+0000 7f64f67c7640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 0x55dbfcf09e90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f64e8019fd0 tx=0x7f64e803aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.770+0000 7f63c7fff640 1 -- 172.21.15.192:0/2113991486 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e8026430 con 0x55dbfcf02a70 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.770+0000 7f63c7fff640 1 -- 172.21.15.192:0/2113991486 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e80265d0 con 0x55dbfcf02a70 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.770+0000 7f63c7fff640 1 -- 172.21.15.192:0/2113991486 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e802f8d0 con 0x55dbfcf02a70 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.770+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbfcf0a3f0 con 0x55dbfcf02a70 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.770+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbfcf0a3f0 con 0x55dbfcf02a70 2024-09-10T05:12:09.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.771+0000 7f63c7fff640 1 -- 172.21.15.192:0/2113991486 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f64e805d070 con 0x55dbfcf02a70 2024-09-10T05:12:09.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.771+0000 7f63c7fff640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63c003c730 0x7f63c003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.771+0000 7f63c7fff640 1 -- 172.21.15.192:0/2113991486 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f64e805b070 con 0x55dbfcf02a70 2024-09-10T05:12:09.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.771+0000 7f64effff640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63c003c730 0x7f63c003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.772+0000 7f64effff640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63c003c730 0x7f63c003ebf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f64e0000c00 tx=0x7f64e0053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.772+0000 7f64fab39800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.772+0000 7f64fab39800 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55dbfcf15330 0x55dbfcf177f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.772+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf17f40 con 0x55dbfcf15330 2024-09-10T05:12:09.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.772+0000 7f64f6fc8640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55dbfcf15330 0x55dbfcf177f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.772+0000 7f64f6fc8640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55dbfcf15330 0x55dbfcf177f0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 20 realm 2024-09-10T05:12:09.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18350 con 0x55dbfcf15330 2024-09-10T05:12:09.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:09.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18c20 con 0x55dbfcf15330 2024-09-10T05:12:09.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf15330 2024-09-10T05:12:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55dbfcf19d20 0x55dbfcf1c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.773+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf1c720 con 0x55dbfcf19d20 2024-09-10T05:12:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.774+0000 7f64f67c7640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55dbfcf19d20 0x55dbfcf1c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.774+0000 7f64f67c7640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55dbfcf19d20 0x55dbfcf1c110 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.774+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.774+0000 7f64fab39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.774+0000 7f64fab39800 20 searching for the correct realm 2024-09-10T05:12:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.774+0000 7f64fab39800 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55dbfcf1e6d0 0x55dbfcf20b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.774+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf21210 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.774+0000 7f64effff640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55dbfcf1e6d0 0x55dbfcf20b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.775+0000 7f64effff640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55dbfcf1e6d0 0x55dbfcf20b90 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.775+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.775+0000 7f64effff640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f64e005f040 0x7f64e006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.775+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf21210 con 0x7f64e005f040 2024-09-10T05:12:09.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.775+0000 7f64f6fc8640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f64e005f040 0x7f64e006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.775+0000 7f64f6fc8640 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f64e005f040 0x7f64e006b410 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.775+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.775+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf19d20 2024-09-10T05:12:09.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.776+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.776+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf15330 2024-09-10T05:12:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.776+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.776+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf15330 2024-09-10T05:12:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.776+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.776+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf19d20 2024-09-10T05:12:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.777+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.777+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf19d20 2024-09-10T05:12:09.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.777+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.777+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x7f64e005f040 2024-09-10T05:12:09.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.777+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.777+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.777+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.777+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf15330 2024-09-10T05:12:09.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.778+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.778+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf19d20 2024-09-10T05:12:09.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.778+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.778+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf15330 2024-09-10T05:12:09.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.778+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.778+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x7f64e005f040 2024-09-10T05:12:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.778+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.778+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.778+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.779+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.779+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.779+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf19d20 2024-09-10T05:12:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.779+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.779+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.779+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.779+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.779+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.779+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf15330 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.780+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.780+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf15330 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.780+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.780+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x7f64e005f040 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.780+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.780+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.780+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.780+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x7f64e005f040 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.780+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.780+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf15330 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.781+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.781+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf19d20 2024-09-10T05:12:09.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.781+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.781+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.781+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.781+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf19d20 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.781+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.781+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x7f64e005f040 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x7f64e005f040 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x55dbfcf15330 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf18fc0 con 0x7f64e005f040 2024-09-10T05:12:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64fab39800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64fab39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64fab39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64fab39800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64fab39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64fab39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64fab39800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.782+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf1cfe0 con 0x55dbfcf15330 2024-09-10T05:12:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf1cfe0 con 0x55dbfcf15330 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf1cfe0 con 0x7f64e005f040 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 20 zone default found 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 4 Realm: () 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 20 zonegroup default 2024-09-10T05:12:09.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.783+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf1d8d0 con 0x55dbfcf19d20 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64fab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64fab39800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf23080 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64fab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64fab39800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf23420 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64fab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64fab39800 20 started sync module instance, tier type = 2024-09-10T05:12:09.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64fab39800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:09.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.784+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf22520 con 0x7f64e005f040 2024-09-10T05:12:09.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.785+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.785+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94403329927792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf22520 con 0x7f64e005f040 2024-09-10T05:12:09.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.785+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf23de0 con 0x55dbfcf15330 2024-09-10T05:12:09.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.786+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94403329927792] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.787+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.787+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94403329932048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf22520 con 0x55dbfcf15330 2024-09-10T05:12:09.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.787+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf247f0 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.788+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94403329932048] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.788+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.788+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94403329925232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf22490 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.788+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf25660 con 0x7f64e005f040 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.789+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94403329925232] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.789+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.789+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94403329937840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf25a80 con 0x7f64e005f040 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.789+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf26440 con 0x55dbfcf15330 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.790+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.790+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94403329941392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf26860 con 0x55dbfcf15330 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.790+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf272c0 con 0x55dbfcf19d20 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.790+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94403329937840] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.791+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.791+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94403329941392] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.791+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94403329938896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf276b0 con 0x55dbfcf19d20 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.791+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf263b0 con 0x55dbfcf19d20 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.794+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94403329938896] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.794+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.794+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94403329948608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf28490 con 0x55dbfcf19d20 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.794+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf28ce0 con 0x55dbfcf19d20 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.795+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94403329948608] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.795+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.795+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94403329951792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf29100 con 0x55dbfcf19d20 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.795+0000 7f64fab39800 20 add_watcher() i=0 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.795+0000 7f64fab39800 20 add_watcher() i=1 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.795+0000 7f64fab39800 20 add_watcher() i=2 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.795+0000 7f64fab39800 20 add_watcher() i=3 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.795+0000 7f64fab39800 20 add_watcher() i=4 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.795+0000 7f64fab39800 20 add_watcher() i=5 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.795+0000 7f64fab39800 20 add_watcher() i=6 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.797+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94403329951792] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.797+0000 7f64fab39800 20 add_watcher() i=7 2024-09-10T05:12:09.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.797+0000 7f64fab39800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:09.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.797+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf2c430 con 0x55dbfcf15330 2024-09-10T05:12:09.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.797+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.797+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94403329953216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf29690 con 0x55dbfcf15330 2024-09-10T05:12:09.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.798+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94403329953216] v37'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.798+0000 7f63acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:09.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.798+0000 7f64fab39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:09.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.798+0000 7f64fab39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:09.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.798+0000 7f64fab39800 5 note: GC not initialized 2024-09-10T05:12:09.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.798+0000 7f63277fe640 20 reqs_thread_entry: start 2024-09-10T05:12:09.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.798+0000 7f64fab39800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:09.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.798+0000 7f64fab39800 20 Filter name: none 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.799+0000 7f63257fa640 20 reqs_thread_entry: start 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.799+0000 7f64fab39800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.799+0000 7f64fab39800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.799+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf5f500 con 0x55dbfcf15330 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.799+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.799+0000 7f64fab39800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.799+0000 7f64fab39800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.799+0000 7f64fab39800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.799+0000 7f64fab39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.799+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf65530 con 0x55dbfcf15330 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.800+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v37'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.800+0000 7f64fab39800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.800+0000 7f64fab39800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:12:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.800+0000 7f64fab39800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:12:09.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.800+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94403330199296 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf60e20 con 0x55dbfcf15330 2024-09-10T05:12:09.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.800+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 94403329941392 notify 158913789968 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f64f0018cc0 con 0x55dbfcf15330 2024-09-10T05:12:09.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.800+0000 7f63d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789968 cookie 94403329941392 notifier 4665 bl.length()=579 2024-09-10T05:12:09.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.801+0000 7f63d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:12:09.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.801+0000 7f63d9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:12:09.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.801+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(64 notify.4 [notify cookie 94403330199296 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.801+0000 7f63d9ffb640 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f63bc003ea0 con 0x55dbfcf15330 2024-09-10T05:12:09.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.801+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.801+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== watch-notify(notify_complete (2) cookie 94403330199296 notify 158913789968 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f64f0026410 con 0x55dbfcf15330 2024-09-10T05:12:09.835 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:12:09.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.802+0000 7f63acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:09.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.802+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94403329953216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf5d3a0 con 0x55dbfcf15330 2024-09-10T05:12:09.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.803+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94403329953216] v37'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.803+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94403329927792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf5d3a0 con 0x7f64e005f040 2024-09-10T05:12:09.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.804+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94403329927792] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.804+0000 7f64fab39800 20 remove_watcher() i=0 2024-09-10T05:12:09.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.804+0000 7f64fab39800 2 removed watcher, disabling cache 2024-09-10T05:12:09.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.804+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94403329932048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf5d3a0 con 0x55dbfcf15330 2024-09-10T05:12:09.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.805+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94403329932048] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.805+0000 7f64fab39800 20 remove_watcher() i=1 2024-09-10T05:12:09.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.805+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94403329925232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf5d3a0 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.806+0000 7f64effff640 1 -- 172.21.15.192:0/2113991486 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94403329925232] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e007c040 con 0x55dbfcf1e6d0 2024-09-10T05:12:09.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.806+0000 7f64fab39800 20 remove_watcher() i=2 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.806+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94403329937840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf5d3a0 con 0x7f64e005f040 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.807+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94403329937840] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x7f64e005f040 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.807+0000 7f64fab39800 20 remove_watcher() i=3 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.807+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94403329941392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf5d3a0 con 0x55dbfcf15330 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.808+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94403329941392] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64f000a4d0 con 0x55dbfcf15330 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.808+0000 7f64fab39800 20 remove_watcher() i=4 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.808+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94403329938896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf5d3a0 con 0x55dbfcf19d20 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.809+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94403329938896] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.809+0000 7f64fab39800 20 remove_watcher() i=5 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.809+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94403329948608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf5d3a0 con 0x55dbfcf19d20 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.810+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94403329948608] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.810+0000 7f64fab39800 20 remove_watcher() i=6 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.810+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94403329951792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dbfcf5d3a0 con 0x55dbfcf19d20 2024-09-10T05:12:09.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64f67c7640 1 -- 172.21.15.192:0/2113991486 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94403329951792] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64e8071070 con 0x55dbfcf19d20 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 20 remove_watcher() i=7 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55dbfcf19d20 msgr2=0x55dbfcf1c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55dbfcf19d20 0x55dbfcf1c110 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55dbfcf15330 msgr2=0x55dbfcf177f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55dbfcf15330 0x55dbfcf177f0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f64e005f040 msgr2=0x7f64e006b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f64e005f040 0x7f64e006b410 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55dbfcf1e6d0 msgr2=0x55dbfcf20b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55dbfcf1e6d0 0x55dbfcf20b90 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63c003c730 msgr2=0x7f63c003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63c003c730 0x7f63c003ebf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f64e0000c00 tx=0x7f64e0053000 comp rx=0 tx=0).stop 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 msgr2=0x55dbfcf09e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 0x55dbfcf09e90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f64e8019fd0 tx=0x7f64e803aa40 comp rx=0 tx=0).stop 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64f6fc8640 1 -- 172.21.15.192:0/2113991486 reap_dead start 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 shutdown_connections 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 --2- 172.21.15.192:0/2113991486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcf02a70 0x55dbfcf09e90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 >> 172.21.15.192:0/2113991486 conn(0x55dbfcefee70 msgr2=0x55dbfcefd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 shutdown_connections 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.811+0000 7f64fab39800 1 -- 172.21.15.192:0/2113991486 wait complete. 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/3452802842 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63d003c780 msgr2=0x7f63d003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 --2- 172.21.15.192:0/3452802842 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63d003c780 0x7f63d003ec40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55dbfcedfc80 tx=0x7f64e0005a00 comp rx=0 tx=0).stop 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/3452802842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcef6190 msgr2=0x55dbfcef65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 --2- 172.21.15.192:0/3452802842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcef6190 0x55dbfcef65b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f64e800e500 tx=0x7f64e8018e80 comp rx=0 tx=0).stop 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/3452802842 shutdown_connections 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 --2- 172.21.15.192:0/3452802842 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63d003c780 0x7f63d003ec40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 --2- 172.21.15.192:0/3452802842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcef6190 0x55dbfcef65b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/3452802842 >> 172.21.15.192:0/3452802842 conn(0x55dbfceea540 msgr2=0x55dbfceea920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/3452802842 shutdown_connections 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/3452802842 wait complete. 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55dbfcee1b00 msgr2=0x55dbfcee3ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55dbfcee1b00 0x55dbfcee3ef0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55dbfcddf220 msgr2=0x55dbfcedf270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55dbfcddf220 0x55dbfcedf270 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55dbfcee5a00 msgr2=0x55dbfcee7df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55dbfcee5a00 0x55dbfcee7df0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63dc03c6e0 msgr2=0x7f63dc03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f63dc03c6e0 0x7f63dc03eba0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f64e0057000 tx=0x7f64e0052000 comp rx=0 tx=0).stop 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 msgr2=0x55dbfcece720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 --2- 172.21.15.192:0/162157429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dbfcddde10 0x55dbfcece720 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f64e800b6e0 tx=0x7f64e8000ed0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64f6fc8640 1 -- 172.21.15.192:0/162157429 reap_dead start 2024-09-10T05:12:09.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 shutdown_connections 2024-09-10T05:12:09.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 >> 172.21.15.192:0/162157429 conn(0x55dbfcdd9200 msgr2=0x55dbfcec7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 shutdown_connections 2024-09-10T05:12:09.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.812+0000 7f64fab39800 1 -- 172.21.15.192:0/162157429 wait complete. 2024-09-10T05:12:09.846 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:12:09.846 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T05:12:09.846 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-10T05:12:09.846 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-10T05:12:09.894 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:09.894 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:09.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.893+0000 7f05cd014800 1 Processor -- start 2024-09-10T05:12:09.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.894+0000 7f05cd014800 1 -- start start 2024-09-10T05:12:09.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.894+0000 7f05cd014800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x556b89a3f600 0x556b89a419f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.894+0000 7f05cd014800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b898e8e40 con 0x556b89a42020 2024-09-10T05:12:09.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.894+0000 7f05cd014800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x556b898b3680 con 0x556b89a3f600 2024-09-10T05:12:09.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.894+0000 7f05c86cb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x556b89a3f600 0x556b89a419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.894+0000 7f05bfeca640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x556b89a42020 0x556b89a444e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:33742/0 (socket says 172.21.15.192:33742) 2024-09-10T05:12:09.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.894+0000 7f05c86cb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x556b89a3f600 0x556b89a419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60670/0 (socket says 172.21.15.192:60670) 2024-09-10T05:12:09.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.894+0000 7f05bfeca640 1 -- 172.21.15.192:0/285278247 learned_addr learned my addr 172.21.15.192:0/285278247 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:09.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.894+0000 7f05c86cb640 1 -- 172.21.15.192:0/285278247 >> v1:172.21.15.139:6789/0 conn(0x556b89a42020 legacy=0x556b89a444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.894+0000 7f05c86cb640 1 -- 172.21.15.192:0/285278247 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b898cf6b0 con 0x556b89a3f600 2024-09-10T05:12:09.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.894+0000 7f05c7eca640 1 -- 172.21.15.192:0/285278247 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445936559 0 0) 0x556b898e8e40 con 0x556b89a42020 2024-09-10T05:12:09.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.896+0000 7f05c86cb640 1 --2- 172.21.15.192:0/285278247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89a419f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f05b800a470 tx=0x7f05b8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b6712d04a87beb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.896+0000 7f05c7eca640 1 -- 172.21.15.192:0/285278247 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b8053570 con 0x556b89a3f600 2024-09-10T05:12:09.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.896+0000 7f05c7eca640 1 -- 172.21.15.192:0/285278247 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b8058070 con 0x556b89a3f600 2024-09-10T05:12:09.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.896+0000 7f05c7eca640 1 -- 172.21.15.192:0/285278247 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b8053880 con 0x556b89a3f600 2024-09-10T05:12:09.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.897+0000 7f05cd014800 1 -- 172.21.15.192:0/285278247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 msgr2=0x556b89a419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.897+0000 7f05cd014800 1 --2- 172.21.15.192:0/285278247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89a419f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f05b800a470 tx=0x7f05b8045a20 comp rx=0 tx=0).stop 2024-09-10T05:12:09.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.897+0000 7f05cd014800 1 -- 172.21.15.192:0/285278247 shutdown_connections 2024-09-10T05:12:09.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.897+0000 7f05cd014800 1 --2- 172.21.15.192:0/285278247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89a419f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.897+0000 7f05cd014800 1 -- 172.21.15.192:0/285278247 >> 172.21.15.192:0/285278247 conn(0x556b89a391c0 msgr2=0x556b89a3b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.897+0000 7f05cd014800 1 -- 172.21.15.192:0/285278247 shutdown_connections 2024-09-10T05:12:09.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.897+0000 7f05cd014800 1 -- 172.21.15.192:0/285278247 wait complete. 2024-09-10T05:12:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.910+0000 7f05cd014800 1 Processor -- start 2024-09-10T05:12:09.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.910+0000 7f05cd014800 1 -- start start 2024-09-10T05:12:09.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.910+0000 7f05cd014800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89b2e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.910+0000 7f05cd014800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556b898d7dd0 con 0x556b89a3f600 2024-09-10T05:12:09.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.911+0000 7f05c86cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89b2e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.911+0000 7f05c86cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89b2e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60678/0 (socket says 172.21.15.192:60678) 2024-09-10T05:12:09.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.911+0000 7f05c86cb640 1 -- 172.21.15.192:0/2016962551 learned_addr learned my addr 172.21.15.192:0/2016962551 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.911+0000 7f05c86cb640 1 -- 172.21.15.192:0/2016962551 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b898f0e10 con 0x556b89a3f600 2024-09-10T05:12:09.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.911+0000 7f05c86cb640 1 --2- 172.21.15.192:0/2016962551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89b2e480 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f05b800a470 tx=0x7f05b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5c5004f9a37947 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.911+0000 7f04b660c640 1 -- 172.21.15.192:0/2016962551 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b8053570 con 0x556b89a3f600 2024-09-10T05:12:09.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.911+0000 7f04b660c640 1 -- 172.21.15.192:0/2016962551 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b8063030 con 0x556b89a3f600 2024-09-10T05:12:09.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.911+0000 7f04b660c640 1 -- 172.21.15.192:0/2016962551 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b8053840 con 0x556b89a3f600 2024-09-10T05:12:09.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.912+0000 7f05cd014800 1 -- 172.21.15.192:0/2016962551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 msgr2=0x556b89b2e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.912+0000 7f05cd014800 1 --2- 172.21.15.192:0/2016962551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89b2e480 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f05b800a470 tx=0x7f05b8051000 comp rx=0 tx=0).stop 2024-09-10T05:12:09.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.912+0000 7f05cd014800 1 -- 172.21.15.192:0/2016962551 shutdown_connections 2024-09-10T05:12:09.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.912+0000 7f05cd014800 1 --2- 172.21.15.192:0/2016962551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89b2e480 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.912+0000 7f05cd014800 1 -- 172.21.15.192:0/2016962551 >> 172.21.15.192:0/2016962551 conn(0x556b89a391c0 msgr2=0x556b89b29e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.912+0000 7f05cd014800 1 -- 172.21.15.192:0/2016962551 shutdown_connections 2024-09-10T05:12:09.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.912+0000 7f05cd014800 1 -- 172.21.15.192:0/2016962551 wait complete. 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.912+0000 7f05cd014800 1 Processor -- start 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.913+0000 7f05cd014800 1 -- start start 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.913+0000 7f05cd014800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89a3ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.913+0000 7f05cd014800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556b89a46040 con 0x556b89a3f600 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.913+0000 7f05c86cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89a3ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.913+0000 7f05c86cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89a3ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60692/0 (socket says 172.21.15.192:60692) 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.913+0000 7f05c86cb640 1 -- 172.21.15.192:0/2724218104 learned_addr learned my addr 172.21.15.192:0/2724218104 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.913+0000 7f05c86cb640 1 -- 172.21.15.192:0/2724218104 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b89a3f260 con 0x556b89a3f600 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.913+0000 7f05c86cb640 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89a3ed00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f05b800a470 tx=0x7f05b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.913+0000 7f04b4e09640 1 -- 172.21.15.192:0/2724218104 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b8078070 con 0x556b89a3f600 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.914+0000 7f04b4e09640 1 -- 172.21.15.192:0/2724218104 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b8068420 con 0x556b89a3f600 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.914+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b89a3d610 con 0x556b89a3f600 2024-09-10T05:12:09.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.914+0000 7f04b4e09640 1 -- 172.21.15.192:0/2724218104 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b8068700 con 0x556b89a3f600 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.914+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b89a3dc30 con 0x556b89a3f600 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.914+0000 7f04b4e09640 1 -- 172.21.15.192:0/2724218104 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f05b807b070 con 0x556b89a3f600 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.915+0000 7f04b4e09640 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f04b003c780 0x7f04b003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.915+0000 7f04b4e09640 1 -- 172.21.15.192:0/2724218104 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f05b80979a0 con 0x556b89a3f600 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.915+0000 7f05bfeca640 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f04b003c780 0x7f04b003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.915+0000 7f05cd014800 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556b89a42020 0x556b89b3f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.915+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b3f7c0 con 0x556b89a42020 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.915+0000 7f05c8ecc640 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556b89a42020 0x556b89b3f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.915+0000 7f05bfeca640 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f04b003c780 0x7f04b003ec40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f05b0000c00 tx=0x7f05b00013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.915+0000 7f05c8ecc640 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556b89a42020 0x556b89b3f280 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.915+0000 7f05c8ecc640 1 -- 172.21.15.192:0/2724218104 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89a42020 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.916+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89a3e110 con 0x556b89a42020 2024-09-10T05:12:09.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.916+0000 7f05c8ecc640 1 -- 172.21.15.192:0/2724218104 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89a42020 2024-09-10T05:12:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.916+0000 7f05cd014800 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556b89b41a90 0x556b89b43e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.916+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b44550 con 0x556b89b41a90 2024-09-10T05:12:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.916+0000 7f05c86cb640 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556b89b41a90 0x556b89b43e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.916+0000 7f05c86cb640 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556b89b41a90 0x556b89b43e80 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.917+0000 7f05c86cb640 1 -- 172.21.15.192:0/2724218104 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b41a90 2024-09-10T05:12:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.917+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b40870 con 0x556b89a42020 2024-09-10T05:12:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.917+0000 7f05c8ecc640 1 -- 172.21.15.192:0/2724218104 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89a42020 2024-09-10T05:12:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.917+0000 7f05cd014800 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556b89b45990 0x556b89b47d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.917+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b48420 con 0x556b89b45990 2024-09-10T05:12:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.917+0000 7f05bfeca640 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556b89b45990 0x556b89b47d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.917+0000 7f05bfeca640 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556b89b45990 0x556b89b47d80 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.918+0000 7f05bfeca640 1 -- 172.21.15.192:0/2724218104 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f05b000f670 con 0x556b89b45990 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.918+0000 7f05cd014800 1 Processor -- start 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.918+0000 7f05cd014800 1 -- start start 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.918+0000 7f05cd014800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b56060 0x556b89b56480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.918+0000 7f05cd014800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556b89935a00 con 0x556b89b56060 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.918+0000 7f05c86cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b56060 0x556b89b56480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.918+0000 7f05c86cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b56060 0x556b89b56480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60700/0 (socket says 172.21.15.192:60700) 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.918+0000 7f05c86cb640 1 -- 172.21.15.192:0/4156769366 learned_addr learned my addr 172.21.15.192:0/4156769366 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.918+0000 7f05c86cb640 1 -- 172.21.15.192:0/4156769366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b89b56ac0 con 0x556b89b56060 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.919+0000 7f05c86cb640 1 --2- 172.21.15.192:0/4156769366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b56060 0x556b89b56480 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f05b8067ff0 tx=0x7f05b807cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.919+0000 7f04adffb640 1 -- 172.21.15.192:0/4156769366 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b8068ab0 con 0x556b89b56060 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.919+0000 7f04adffb640 1 -- 172.21.15.192:0/4156769366 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b8068c50 con 0x556b89b56060 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.919+0000 7f05cd014800 1 -- 172.21.15.192:0/4156769366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b89b572f0 con 0x556b89b56060 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.919+0000 7f04adffb640 1 -- 172.21.15.192:0/4156769366 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b807c4e0 con 0x556b89b56060 2024-09-10T05:12:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.919+0000 7f05cd014800 1 -- 172.21.15.192:0/4156769366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b89b57890 con 0x556b89b56060 2024-09-10T05:12:09.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.920+0000 7f04adffb640 1 -- 172.21.15.192:0/4156769366 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f05b807c680 con 0x556b89b56060 2024-09-10T05:12:09.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.920+0000 7f04adffb640 1 --2- 172.21.15.192:0/4156769366 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f04a003c780 0x7f04a003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.920+0000 7f04adffb640 1 -- 172.21.15.192:0/4156769366 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f05b808e070 con 0x556b89b56060 2024-09-10T05:12:09.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.920+0000 7f05bfeca640 1 --2- 172.21.15.192:0/4156769366 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f04a003c780 0x7f04a003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.920+0000 7f05cd014800 1 Processor -- start 2024-09-10T05:12:09.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.920+0000 7f05cd014800 1 -- start start 2024-09-10T05:12:09.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.920+0000 7f05bfeca640 1 --2- 172.21.15.192:0/4156769366 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f04a003c780 0x7f04a003ec40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x556b89b3fc30 tx=0x7f05b0006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.920+0000 7f05cd014800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 0x556b89b62d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.920+0000 7f05cd014800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556b89b2ec70 con 0x556b89b62940 2024-09-10T05:12:09.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.920+0000 7f05c86cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 0x556b89b62d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.920+0000 7f05c86cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 0x556b89b62d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60712/0 (socket says 172.21.15.192:60712) 2024-09-10T05:12:09.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.920+0000 7f05c86cb640 1 -- 172.21.15.192:0/1664762512 learned_addr learned my addr 172.21.15.192:0/1664762512 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.921+0000 7f05c86cb640 1 -- 172.21.15.192:0/1664762512 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b89b63310 con 0x556b89b62940 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.921+0000 7f05c86cb640 1 --2- 172.21.15.192:0/1664762512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 0x556b89b62d20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f05b8062040 tx=0x7f05b80745f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcc456ff097c3e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.921+0000 7f04a77fe640 1 -- 172.21.15.192:0/1664762512 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b8074990 con 0x556b89b62940 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.921+0000 7f04a77fe640 1 -- 172.21.15.192:0/1664762512 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b80a6070 con 0x556b89b62940 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.921+0000 7f04a77fe640 1 -- 172.21.15.192:0/1664762512 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b80951b0 con 0x556b89b62940 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.921+0000 7f05cd014800 1 -- 172.21.15.192:0/1664762512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 msgr2=0x556b89b62d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.921+0000 7f05cd014800 1 --2- 172.21.15.192:0/1664762512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 0x556b89b62d20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f05b8062040 tx=0x7f05b80745f0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.921+0000 7f05cd014800 1 -- 172.21.15.192:0/1664762512 shutdown_connections 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.921+0000 7f05cd014800 1 --2- 172.21.15.192:0/1664762512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 0x556b89b62d20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.921+0000 7f05cd014800 1 -- 172.21.15.192:0/1664762512 >> 172.21.15.192:0/1664762512 conn(0x556b89b5ed40 msgr2=0x556b89b5cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.921+0000 7f05cd014800 1 -- 172.21.15.192:0/1664762512 shutdown_connections 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.921+0000 7f05cd014800 1 -- 172.21.15.192:0/1664762512 wait complete. 2024-09-10T05:12:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.922+0000 7f05cd014800 1 Processor -- start 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.922+0000 7f05cd014800 1 -- start start 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.922+0000 7f05cd014800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 0x556b89b69d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.922+0000 7f05cd014800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556b89b637a0 con 0x556b89b62940 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.922+0000 7f05c86cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 0x556b89b69d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.922+0000 7f05c86cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 0x556b89b69d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60722/0 (socket says 172.21.15.192:60722) 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.922+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 learned_addr learned my addr 172.21.15.192:0/1555510321 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.922+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b89b6a2c0 con 0x556b89b62940 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.922+0000 7f05c86cb640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 0x556b89b69d60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f05b8074940 tx=0x7f05b8090f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.923+0000 7f04a5ffb640 1 -- 172.21.15.192:0/1555510321 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b80b7020 con 0x556b89b62940 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.923+0000 7f04a5ffb640 1 -- 172.21.15.192:0/1555510321 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b8074990 con 0x556b89b62940 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.923+0000 7f04a5ffb640 1 -- 172.21.15.192:0/1555510321 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b8074e20 con 0x556b89b62940 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.923+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b89b6a2c0 con 0x556b89b62940 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.923+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b89b6a760 con 0x556b89b62940 2024-09-10T05:12:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.924+0000 7f04a5ffb640 1 -- 172.21.15.192:0/1555510321 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f05b80ba020 con 0x556b89b62940 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.924+0000 7f04a5ffb640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f049803c6e0 0x7f049803eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.924+0000 7f04a5ffb640 1 -- 172.21.15.192:0/1555510321 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f05b80bdd10 con 0x556b89b62940 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.924+0000 7f05bfeca640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f049803c6e0 0x7f049803eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.924+0000 7f05cd014800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.924+0000 7f05cd014800 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556b89b75200 0x556b89b776c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.924+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b77e10 con 0x556b89b75200 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05c8ecc640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556b89b75200 0x556b89b776c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05c8ecc640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556b89b75200 0x556b89b776c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05bfeca640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f049803c6e0 0x7f049803eba0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f05b000ffd0 tx=0x7f05b0023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05cd014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05cd014800 20 realm 2024-09-10T05:12:09.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05cd014800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78220 con 0x556b89b75200 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05cd014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05cd014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05cd014800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.925+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78af0 con 0x556b89b75200 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.926+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.926+0000 7f05cd014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.926+0000 7f05cd014800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.926+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b75200 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.926+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.926+0000 7f05cd014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:09.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.926+0000 7f05cd014800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.926+0000 7f05cd014800 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556b89b79bf0 0x556b89b7bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.926+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b7c5a0 con 0x556b89b79bf0 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.926+0000 7f05c86cb640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556b89b79bf0 0x556b89b7bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.926+0000 7f05c86cb640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556b89b79bf0 0x556b89b7bfe0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.927+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.927+0000 7f05cd014800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.927+0000 7f05cd014800 20 searching for the correct realm 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.927+0000 7f05cd014800 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556b89b7e550 0x556b89b80a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.927+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b810e0 con 0x556b89b7e550 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.927+0000 7f05bfeca640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556b89b7e550 0x556b89b80a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.927+0000 7f05bfeca640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556b89b7e550 0x556b89b80a10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.927+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.927+0000 7f05bfeca640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f05b002e910 0x7f05b003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.927+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b810e0 con 0x7f05b002e910 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.927+0000 7f05c8ecc640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f05b002e910 0x7f05b003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.928+0000 7f05c8ecc640 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f05b002e910 0x7f05b003a3c0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.928+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.928+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b79bf0 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.928+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.928+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b75200 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.929+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.929+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b75200 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.929+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.929+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b79bf0 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.929+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.929+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b79bf0 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.929+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.929+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x7f05b002e910 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.929+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.929+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b7e550 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.930+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.930+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b75200 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.930+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.930+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b79bf0 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.930+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.930+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b75200 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.930+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.930+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x7f05b002e910 2024-09-10T05:12:09.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.931+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.931+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b7e550 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.931+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.931+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b7e550 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.931+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.931+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b79bf0 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.931+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.931+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b7e550 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.932+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.932+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b7e550 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.932+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.932+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b75200 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.932+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.932+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b75200 2024-09-10T05:12:09.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.932+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.932+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x7f05b002e910 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.932+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.932+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b7e550 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.933+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.933+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x7f05b002e910 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.933+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.933+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b75200 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.933+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.933+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b79bf0 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.933+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.933+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b7e550 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.934+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.934+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b79bf0 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.934+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.934+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x7f05b002e910 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.934+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.934+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b7e550 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.934+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.934+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x7f05b002e910 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x556b89b75200 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556b89b78e90 con 0x7f05b002e910 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05cd014800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:09.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05cd014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05cd014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05cd014800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05cd014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05cd014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05cd014800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b7ce60 con 0x556b89b75200 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05cd014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05cd014800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.935+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b7ce60 con 0x556b89b75200 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b7ce60 con 0x7f05b002e910 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 20 zone default found 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 4 Realm: () 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 20 zonegroup default 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b7ce60 con 0x556b89b79bf0 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b82f50 con 0x556b89b7e550 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.936+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.937+0000 7f05cd014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.937+0000 7f05cd014800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.937+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b832f0 con 0x556b89b7e550 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.937+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.937+0000 7f05cd014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.937+0000 7f05cd014800 20 started sync module instance, tier type = 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.937+0000 7f05cd014800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.937+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b823f0 con 0x7f05b002e910 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.938+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.938+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920360409328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b823f0 con 0x7f05b002e910 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.938+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b83cf0 con 0x556b89b75200 2024-09-10T05:12:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.939+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920360409328] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.939+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.939+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920360413184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b823f0 con 0x556b89b75200 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.939+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b847b0 con 0x556b89b7e550 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.940+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920360413184] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.940+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.940+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920360406848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b82360 con 0x556b89b7e550 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.940+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b85670 con 0x7f05b002e910 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.941+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920360406848] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.941+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.941+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920360419776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b855e0 con 0x7f05b002e910 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.941+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b86530 con 0x556b89b75200 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.942+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.942+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920360423552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b86950 con 0x556b89b75200 2024-09-10T05:12:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.942+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b873b0 con 0x556b89b79bf0 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.942+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920360419776] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.943+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.943+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920360421984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b877a0 con 0x556b89b79bf0 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.943+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920360423552] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.943+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b881c0 con 0x556b89b79bf0 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.944+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.944+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920360430768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b885b0 con 0x556b89b79bf0 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.944+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b88fb0 con 0x556b89b79bf0 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.944+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920360421984] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.945+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(58 notify.7 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.945+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920360430768] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.945+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920360427152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b88f70 con 0x556b89b79bf0 2024-09-10T05:12:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.945+0000 7f05cd014800 20 add_watcher() i=0 2024-09-10T05:12:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.945+0000 7f05cd014800 20 add_watcher() i=1 2024-09-10T05:12:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.945+0000 7f05cd014800 20 add_watcher() i=2 2024-09-10T05:12:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.945+0000 7f05cd014800 20 add_watcher() i=3 2024-09-10T05:12:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.945+0000 7f05cd014800 20 add_watcher() i=4 2024-09-10T05:12:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.945+0000 7f05cd014800 20 add_watcher() i=5 2024-09-10T05:12:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.945+0000 7f05cd014800 20 add_watcher() i=6 2024-09-10T05:12:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.946+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920360427152] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.946+0000 7f05cd014800 20 add_watcher() i=7 2024-09-10T05:12:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.946+0000 7f05cd014800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.946+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89b8bfa0 con 0x556b89b75200 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.946+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.946+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920360434368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b89430 con 0x556b89b75200 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.947+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920360434368] v37'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.948+0000 7f047efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.948+0000 7f05cd014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.948+0000 7f05cd014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.948+0000 7f05cd014800 5 note: GC not initialized 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.948+0000 7f047dfe3640 20 reqs_thread_entry: start 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.948+0000 7f05cd014800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.948+0000 7f05cd014800 20 Filter name: none 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.948+0000 7f04777fe640 20 reqs_thread_entry: start 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.948+0000 7f05cd014800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:12:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.948+0000 7f05cd014800 20 rados->read ofs=0 len=0 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.948+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89bbefb0 con 0x556b89b75200 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.949+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.949+0000 7f05cd014800 20 rados_obj.operate() r=0 bl.length=403 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.949+0000 7f05cd014800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.949+0000 7f05cd014800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.949+0000 7f05cd014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.949+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89bc5040 con 0x556b89b75200 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v37'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f05cd014800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f05cd014800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f05cd014800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93920360680000 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556b89bc08d0 con 0x556b89b75200 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== watch-notify(notify (1) cookie 93920360423552 notify 158913789969 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f05c0018cc0 con 0x556b89b75200 2024-09-10T05:12:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f04a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789969 cookie 93920360423552 notifier 4672 bl.length()=567 2024-09-10T05:12:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f04a77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-10T05:12:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f04a77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:12:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f04a77fe640 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f048c003ea0 con 0x556b89b75200 2024-09-10T05:12:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(64 notify.4 [notify cookie 93920360680000 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.950+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== watch-notify(notify_complete (2) cookie 93920360680000 notify 158913789969 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f05c0005040 con 0x556b89b75200 2024-09-10T05:12:09.978 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-10T05:11:46.406330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:11:46.406322Z","tags":[],"group_ids":[]} 2024-09-10T05:12:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.951+0000 7f047efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.951+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920360434368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89bbce10 con 0x556b89b75200 2024-09-10T05:12:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.952+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93920360434368] v37'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.952+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920360409328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89bbce10 con 0x7f05b002e910 2024-09-10T05:12:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.953+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93920360409328] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.953+0000 7f05cd014800 20 remove_watcher() i=0 2024-09-10T05:12:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.953+0000 7f05cd014800 2 removed watcher, disabling cache 2024-09-10T05:12:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.953+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920360413184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89bbce10 con 0x556b89b75200 2024-09-10T05:12:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.954+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93920360413184] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.954+0000 7f05cd014800 20 remove_watcher() i=1 2024-09-10T05:12:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.954+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920360406848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89bbce10 con 0x556b89b7e550 2024-09-10T05:12:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.955+0000 7f05bfeca640 1 -- 172.21.15.192:0/1555510321 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93920360406848] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b0037040 con 0x556b89b7e550 2024-09-10T05:12:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.955+0000 7f05cd014800 20 remove_watcher() i=2 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.955+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920360419776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b83800 con 0x7f05b002e910 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.956+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93920360419776] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x7f05b002e910 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.956+0000 7f05cd014800 20 remove_watcher() i=3 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.956+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920360423552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b81f40 con 0x556b89b75200 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.957+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93920360423552] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c000a4d0 con 0x556b89b75200 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.957+0000 7f05cd014800 20 remove_watcher() i=4 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.957+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920360421984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b851c0 con 0x556b89b79bf0 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.958+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93920360421984] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.958+0000 7f05cd014800 20 remove_watcher() i=5 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.958+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920360430768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b83800 con 0x556b89b79bf0 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.959+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93920360430768] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.959+0000 7f05cd014800 20 remove_watcher() i=6 2024-09-10T05:12:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.959+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920360427152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556b89b81f40 con 0x556b89b79bf0 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05c86cb640 1 -- 172.21.15.192:0/1555510321 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93920360427152] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b807a030 con 0x556b89b79bf0 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 20 remove_watcher() i=7 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556b89b79bf0 msgr2=0x556b89b7bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556b89b79bf0 0x556b89b7bfe0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556b89b75200 msgr2=0x556b89b776c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556b89b75200 0x556b89b776c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f05b002e910 msgr2=0x7f05b003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f05b002e910 0x7f05b003a3c0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556b89b7e550 msgr2=0x556b89b80a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556b89b7e550 0x556b89b80a10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f049803c6e0 msgr2=0x7f049803eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f049803c6e0 0x7f049803eba0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f05b000ffd0 tx=0x7f05b0023040 comp rx=0 tx=0).stop 2024-09-10T05:12:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 msgr2=0x556b89b69d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05cd014800 1 --2- 172.21.15.192:0/1555510321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b62940 0x556b89b69d60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f05b8074940 tx=0x7f05b8090f50 comp rx=0 tx=0).stop 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 reap_dead start 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.960+0000 7f05c8ecc640 1 -- 172.21.15.192:0/1555510321 reap_dead start 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 shutdown_connections 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 >> 172.21.15.192:0/1555510321 conn(0x556b89b5ed40 msgr2=0x556b89b5cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 shutdown_connections 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/1555510321 wait complete. 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/4156769366 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f04a003c780 msgr2=0x7f04a003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 --2- 172.21.15.192:0/4156769366 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f04a003c780 0x7f04a003ec40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x556b89b3fc30 tx=0x7f05b0006000 comp rx=0 tx=0).stop 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/4156769366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b56060 msgr2=0x556b89b56480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 --2- 172.21.15.192:0/4156769366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b56060 0x556b89b56480 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f05b8067ff0 tx=0x7f05b807cac0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/4156769366 shutdown_connections 2024-09-10T05:12:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 --2- 172.21.15.192:0/4156769366 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f04a003c780 0x7f04a003ec40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 --2- 172.21.15.192:0/4156769366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89b56060 0x556b89b56480 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/4156769366 >> 172.21.15.192:0/4156769366 conn(0x556b89b4a410 msgr2=0x556b89b4a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/4156769366 shutdown_connections 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/4156769366 wait complete. 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556b89b41a90 msgr2=0x556b89b43e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556b89b41a90 0x556b89b43e80 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556b89a42020 msgr2=0x556b89b3f280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556b89a42020 0x556b89b3f280 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556b89b45990 msgr2=0x556b89b47d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556b89b45990 0x556b89b47d80 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f04b003c780 msgr2=0x7f04b003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f04b003c780 0x7f04b003ec40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f05b0000c00 tx=0x7f05b00013b0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 msgr2=0x556b89a3ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 --2- 172.21.15.192:0/2724218104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556b89a3f600 0x556b89a3ed00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f05b800a470 tx=0x7f05b8002fb0 comp rx=0 tx=0).stop 2024-09-10T05:12:09.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05c8ecc640 1 -- 172.21.15.192:0/2724218104 reap_dead start 2024-09-10T05:12:09.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.961+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 shutdown_connections 2024-09-10T05:12:09.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.962+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 >> 172.21.15.192:0/2724218104 conn(0x556b89a391c0 msgr2=0x556b89b285f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:09.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.962+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 shutdown_connections 2024-09-10T05:12:09.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:09.962+0000 7f05cd014800 1 -- 172.21.15.192:0/2724218104 wait complete. 2024-09-10T05:12:09.989 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-10T05:11:46.406330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:11:46.406322Z', 'tags': [], 'group_ids': []} 2024-09-10T05:12:09.999 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:09.999 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-10T05:12:09.999 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-10T05:12:09.999 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-10T05:12:10.044 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:10.044 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:10.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.043+0000 7f9abde98800 1 Processor -- start 2024-09-10T05:12:10.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.043+0000 7f9abde98800 1 -- start start 2024-09-10T05:12:10.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.044+0000 7f9abde98800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56081eefd690 0x56081eeffa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.044+0000 7f9abde98800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56081eda6e40 con 0x56081ef00020 2024-09-10T05:12:10.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.044+0000 7f9abde98800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x56081ed71680 con 0x56081eefd690 2024-09-10T05:12:10.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.044+0000 7f9abb982640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56081eefd690 0x56081eeffa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.044+0000 7f9abb181640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x56081ef00020 0x56081ef024c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:33746/0 (socket says 172.21.15.192:33746) 2024-09-10T05:12:10.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.044+0000 7f9abb982640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56081eefd690 0x56081eeffa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60726/0 (socket says 172.21.15.192:60726) 2024-09-10T05:12:10.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.044+0000 7f9abb181640 1 -- 172.21.15.192:0/3902321140 learned_addr learned my addr 172.21.15.192:0/3902321140 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:10.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.044+0000 7f9abb982640 1 -- 172.21.15.192:0/3902321140 >> v1:172.21.15.139:6789/0 conn(0x56081ef00020 legacy=0x56081ef024c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.044+0000 7f9aba980640 1 -- 172.21.15.192:0/3902321140 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788336157 0 0) 0x56081eda6e40 con 0x56081ef00020 2024-09-10T05:12:10.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.044+0000 7f9abb982640 1 -- 172.21.15.192:0/3902321140 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56081ed8d6b0 con 0x56081eefd690 2024-09-10T05:12:10.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.046+0000 7f9abb982640 1 --2- 172.21.15.192:0/3902321140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081eeffa80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9aac005fd0 tx=0x7f9aac045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c463e989e566382e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.046+0000 7f9aba980640 1 -- 172.21.15.192:0/3902321140 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aac058530 con 0x56081eefd690 2024-09-10T05:12:10.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.046+0000 7f9aba980640 1 -- 172.21.15.192:0/3902321140 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aac0586d0 con 0x56081eefd690 2024-09-10T05:12:10.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.046+0000 7f9aba980640 1 -- 172.21.15.192:0/3902321140 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aac0589d0 con 0x56081eefd690 2024-09-10T05:12:10.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.047+0000 7f9abde98800 1 -- 172.21.15.192:0/3902321140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 msgr2=0x56081eeffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.047+0000 7f9abde98800 1 --2- 172.21.15.192:0/3902321140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081eeffa80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9aac005fd0 tx=0x7f9aac045c30 comp rx=0 tx=0).stop 2024-09-10T05:12:10.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.047+0000 7f9abde98800 1 -- 172.21.15.192:0/3902321140 shutdown_connections 2024-09-10T05:12:10.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.047+0000 7f9abde98800 1 --2- 172.21.15.192:0/3902321140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081eeffa80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.047+0000 7f9abde98800 1 -- 172.21.15.192:0/3902321140 >> 172.21.15.192:0/3902321140 conn(0x56081eef71b0 msgr2=0x56081eef9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:10.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.047+0000 7f9abde98800 1 -- 172.21.15.192:0/3902321140 shutdown_connections 2024-09-10T05:12:10.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.047+0000 7f9abde98800 1 -- 172.21.15.192:0/3902321140 wait complete. 2024-09-10T05:12:10.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.060+0000 7f9abde98800 1 Processor -- start 2024-09-10T05:12:10.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.060+0000 7f9abde98800 1 -- start start 2024-09-10T05:12:10.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.060+0000 7f9abde98800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081efec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.060+0000 7f9abde98800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56081ed95dd0 con 0x56081eefd690 2024-09-10T05:12:10.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.061+0000 7f9abb982640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081efec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.061+0000 7f9abb982640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081efec4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60738/0 (socket says 172.21.15.192:60738) 2024-09-10T05:12:10.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.061+0000 7f9abb982640 1 -- 172.21.15.192:0/2118558813 learned_addr learned my addr 172.21.15.192:0/2118558813 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:10.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.061+0000 7f9abb982640 1 -- 172.21.15.192:0/2118558813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56081edaee10 con 0x56081eefd690 2024-09-10T05:12:10.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.061+0000 7f9abb982640 1 --2- 172.21.15.192:0/2118558813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081efec4f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9aac025a60 tx=0x7f9aac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd492fc1aa9ae36e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.061+0000 7f99a9e0b640 1 -- 172.21.15.192:0/2118558813 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aac068070 con 0x56081eefd690 2024-09-10T05:12:10.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.061+0000 7f99a9e0b640 1 -- 172.21.15.192:0/2118558813 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aac058880 con 0x56081eefd690 2024-09-10T05:12:10.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.061+0000 7f99a9e0b640 1 -- 172.21.15.192:0/2118558813 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aac058ba0 con 0x56081eefd690 2024-09-10T05:12:10.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.062+0000 7f9abde98800 1 -- 172.21.15.192:0/2118558813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 msgr2=0x56081efec4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.062+0000 7f9abde98800 1 --2- 172.21.15.192:0/2118558813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081efec4f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9aac025a60 tx=0x7f9aac051000 comp rx=0 tx=0).stop 2024-09-10T05:12:10.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.062+0000 7f9abde98800 1 -- 172.21.15.192:0/2118558813 shutdown_connections 2024-09-10T05:12:10.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.062+0000 7f9abde98800 1 --2- 172.21.15.192:0/2118558813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081efec4f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.062+0000 7f9abde98800 1 -- 172.21.15.192:0/2118558813 >> 172.21.15.192:0/2118558813 conn(0x56081eef71b0 msgr2=0x56081efe7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:10.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.062+0000 7f9abde98800 1 -- 172.21.15.192:0/2118558813 shutdown_connections 2024-09-10T05:12:10.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.062+0000 7f9abde98800 1 -- 172.21.15.192:0/2118558813 wait complete. 2024-09-10T05:12:10.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.062+0000 7f9abde98800 1 Processor -- start 2024-09-10T05:12:10.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.062+0000 7f9abde98800 1 -- start start 2024-09-10T05:12:10.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.062+0000 7f9abde98800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081eefcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.062+0000 7f9abde98800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56081ef04020 con 0x56081eefd690 2024-09-10T05:12:10.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.063+0000 7f9abb982640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081eefcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.063+0000 7f9abb982640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081eefcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60744/0 (socket says 172.21.15.192:60744) 2024-09-10T05:12:10.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.063+0000 7f9abb982640 1 -- 172.21.15.192:0/422527929 learned_addr learned my addr 172.21.15.192:0/422527929 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:10.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.063+0000 7f9abb982640 1 -- 172.21.15.192:0/422527929 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56081eefd310 con 0x56081eefd690 2024-09-10T05:12:10.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.063+0000 7f9abb982640 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081eefcdb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9aac025a60 tx=0x7f9aac003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.063+0000 7f99a3fff640 1 -- 172.21.15.192:0/422527929 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aac068040 con 0x56081eefd690 2024-09-10T05:12:10.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.063+0000 7f99a3fff640 1 -- 172.21.15.192:0/422527929 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aac071070 con 0x56081eefd690 2024-09-10T05:12:10.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.063+0000 7f99a3fff640 1 -- 172.21.15.192:0/422527929 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aac0637b0 con 0x56081eefd690 2024-09-10T05:12:10.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.063+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56081eefb6c0 con 0x56081eefd690 2024-09-10T05:12:10.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.063+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56081eefbc20 con 0x56081eefd690 2024-09-10T05:12:10.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.064+0000 7f99a3fff640 1 -- 172.21.15.192:0/422527929 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9aac0639e0 con 0x56081eefd690 2024-09-10T05:12:10.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.064+0000 7f99a3fff640 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99a403c730 0x7f99a403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.064+0000 7f99a3fff640 1 -- 172.21.15.192:0/422527929 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9aac097610 con 0x56081eefd690 2024-09-10T05:12:10.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.064+0000 7f9abb181640 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99a403c730 0x7f99a403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.064+0000 7f9abde98800 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56081ef00020 0x56081effd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.064+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081effd7e0 con 0x56081ef00020 2024-09-10T05:12:10.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.064+0000 7f9abc183640 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56081ef00020 0x56081effd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.065+0000 7f9abb181640 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99a403c730 0x7f99a403ebf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0000c00 tx=0x7f9ab00013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.065+0000 7f9abc183640 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56081ef00020 0x56081effd2a0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.065+0000 7f9abc183640 1 -- 172.21.15.192:0/422527929 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ab40083e0 con 0x56081ef00020 2024-09-10T05:12:10.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.065+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081eefc0e0 con 0x56081ef00020 2024-09-10T05:12:10.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.065+0000 7f9abc183640 1 -- 172.21.15.192:0/422527929 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ab40083e0 con 0x56081ef00020 2024-09-10T05:12:10.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.065+0000 7f9abde98800 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56081efffab0 0x56081f001ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.065+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f002540 con 0x56081efffab0 2024-09-10T05:12:10.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.065+0000 7f9abb982640 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56081efffab0 0x56081f001ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.066+0000 7f9abb982640 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56081efffab0 0x56081f001ea0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.066+0000 7f9abb982640 1 -- 172.21.15.192:0/422527929 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081efffab0 2024-09-10T05:12:10.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.066+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081effe950 con 0x56081ef00020 2024-09-10T05:12:10.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.066+0000 7f9abc183640 1 -- 172.21.15.192:0/422527929 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ab40083e0 con 0x56081ef00020 2024-09-10T05:12:10.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.066+0000 7f9abde98800 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56081f0039a0 0x56081f005d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.066+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f006500 con 0x56081f0039a0 2024-09-10T05:12:10.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.067+0000 7f9abb181640 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56081f0039a0 0x56081f005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.067+0000 7f9abb181640 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56081f0039a0 0x56081f005d90 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.067+0000 7f9abb181640 1 -- 172.21.15.192:0/422527929 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9ab000f670 con 0x56081f0039a0 2024-09-10T05:12:10.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.067+0000 7f9abde98800 1 Processor -- start 2024-09-10T05:12:10.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.067+0000 7f9abde98800 1 -- start start 2024-09-10T05:12:10.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.068+0000 7f9abde98800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f014140 0x56081f014560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.068+0000 7f9abde98800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56081edf3a00 con 0x56081f014140 2024-09-10T05:12:10.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.068+0000 7f9abb982640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f014140 0x56081f014560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.068+0000 7f9abb982640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f014140 0x56081f014560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60752/0 (socket says 172.21.15.192:60752) 2024-09-10T05:12:10.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.068+0000 7f9abb982640 1 -- 172.21.15.192:0/2899039826 learned_addr learned my addr 172.21.15.192:0/2899039826 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:10.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.068+0000 7f9abb982640 1 -- 172.21.15.192:0/2899039826 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56081f014ba0 con 0x56081f014140 2024-09-10T05:12:10.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.068+0000 7f9abb982640 1 --2- 172.21.15.192:0/2899039826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f014140 0x56081f014560 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0958f0 tx=0x7f9aac04ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.068+0000 7f99a17fa640 1 -- 172.21.15.192:0/2899039826 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aac086070 con 0x56081f014140 2024-09-10T05:12:10.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.068+0000 7f99a17fa640 1 -- 172.21.15.192:0/2899039826 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aac06b510 con 0x56081f014140 2024-09-10T05:12:10.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.068+0000 7f9abde98800 1 -- 172.21.15.192:0/2899039826 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56081f0153d0 con 0x56081f014140 2024-09-10T05:12:10.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.068+0000 7f99a17fa640 1 -- 172.21.15.192:0/2899039826 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aac094380 con 0x56081f014140 2024-09-10T05:12:10.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.068+0000 7f9abde98800 1 -- 172.21.15.192:0/2899039826 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56081f015970 con 0x56081f014140 2024-09-10T05:12:10.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.069+0000 7f99a17fa640 1 -- 172.21.15.192:0/2899039826 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9aac08e120 con 0x56081f014140 2024-09-10T05:12:10.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.069+0000 7f99a17fa640 1 --2- 172.21.15.192:0/2899039826 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f999403c780 0x7f999403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.069+0000 7f99a17fa640 1 -- 172.21.15.192:0/2899039826 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9aac08cd70 con 0x56081f014140 2024-09-10T05:12:10.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.069+0000 7f9abb181640 1 --2- 172.21.15.192:0/2899039826 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f999403c780 0x7f999403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.070+0000 7f9abde98800 1 Processor -- start 2024-09-10T05:12:10.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.070+0000 7f9abb181640 1 --2- 172.21.15.192:0/2899039826 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f999403c780 0x7f999403ec40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x56081effecf0 tx=0x7f9ab0006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.070+0000 7f9abde98800 1 -- start start 2024-09-10T05:12:10.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.070+0000 7f9abde98800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 0x56081f020e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.070+0000 7f9abde98800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56081efecc80 con 0x56081f020a40 2024-09-10T05:12:10.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.070+0000 7f9abb982640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 0x56081f020e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.070+0000 7f9abb982640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 0x56081f020e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60754/0 (socket says 172.21.15.192:60754) 2024-09-10T05:12:10.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.070+0000 7f9abb982640 1 -- 172.21.15.192:0/827717809 learned_addr learned my addr 172.21.15.192:0/827717809 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.070+0000 7f9abb982640 1 -- 172.21.15.192:0/827717809 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56081f021410 con 0x56081f020a40 2024-09-10T05:12:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.071+0000 7f9abb982640 1 --2- 172.21.15.192:0/827717809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 0x56081f020e20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9aac094670 tx=0x7f9aac06baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b8b97a7051aef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.071+0000 7f999affd640 1 -- 172.21.15.192:0/827717809 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aac08e540 con 0x56081f020a40 2024-09-10T05:12:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.071+0000 7f999affd640 1 -- 172.21.15.192:0/827717809 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aac097930 con 0x56081f020a40 2024-09-10T05:12:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.071+0000 7f999affd640 1 -- 172.21.15.192:0/827717809 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aac093580 con 0x56081f020a40 2024-09-10T05:12:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.071+0000 7f9abde98800 1 -- 172.21.15.192:0/827717809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 msgr2=0x56081f020e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.071+0000 7f9abde98800 1 --2- 172.21.15.192:0/827717809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 0x56081f020e20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9aac094670 tx=0x7f9aac06baf0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.071+0000 7f9abde98800 1 -- 172.21.15.192:0/827717809 shutdown_connections 2024-09-10T05:12:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.071+0000 7f9abde98800 1 --2- 172.21.15.192:0/827717809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 0x56081f020e20 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.071+0000 7f9abde98800 1 -- 172.21.15.192:0/827717809 >> 172.21.15.192:0/827717809 conn(0x56081f01ce40 msgr2=0x56081f01b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.071+0000 7f9abde98800 1 -- 172.21.15.192:0/827717809 shutdown_connections 2024-09-10T05:12:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.071+0000 7f9abde98800 1 -- 172.21.15.192:0/827717809 wait complete. 2024-09-10T05:12:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.072+0000 7f9abde98800 1 Processor -- start 2024-09-10T05:12:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.072+0000 7f9abde98800 1 -- start start 2024-09-10T05:12:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.072+0000 7f9abde98800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 0x56081f027de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.072+0000 7f9abde98800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56081f0218a0 con 0x56081f020a40 2024-09-10T05:12:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.072+0000 7f9abb982640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 0x56081f027de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.072+0000 7f9abb982640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 0x56081f027de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:60762/0 (socket says 172.21.15.192:60762) 2024-09-10T05:12:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.072+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 learned_addr learned my addr 172.21.15.192:0/2576891806 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.072+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56081f028340 con 0x56081f020a40 2024-09-10T05:12:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.072+0000 7f9abb982640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 0x56081f027de0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9aac094670 tx=0x7f9aac056ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.073+0000 7f99997fa640 1 -- 172.21.15.192:0/2576891806 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aac0af040 con 0x56081f020a40 2024-09-10T05:12:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.073+0000 7f99997fa640 1 -- 172.21.15.192:0/2576891806 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aac0ba070 con 0x56081f020a40 2024-09-10T05:12:10.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.073+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56081f028340 con 0x56081f020a40 2024-09-10T05:12:10.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.073+0000 7f99997fa640 1 -- 172.21.15.192:0/2576891806 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aac08ebf0 con 0x56081f020a40 2024-09-10T05:12:10.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.073+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56081f028340 con 0x56081f020a40 2024-09-10T05:12:10.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.073+0000 7f99997fa640 1 -- 172.21.15.192:0/2576891806 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9aac0753c0 con 0x56081f020a40 2024-09-10T05:12:10.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.074+0000 7f99997fa640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f998403c730 0x7f998403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.074+0000 7f99997fa640 1 -- 172.21.15.192:0/2576891806 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9aac09a150 con 0x56081f020a40 2024-09-10T05:12:10.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.074+0000 7f9abb181640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f998403c730 0x7f998403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.074+0000 7f9abb181640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f998403c730 0x7f998403ebf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000ffd0 tx=0x7f9ab0023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.074+0000 7f9abde98800 20 rados->read ofs=0 len=0 2024-09-10T05:12:10.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.074+0000 7f9abde98800 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56081f0333b0 0x56081f035870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.074+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f035fc0 con 0x56081f0333b0 2024-09-10T05:12:10.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.074+0000 7f9abc183640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56081f0333b0 0x56081f035870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abc183640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56081f0333b0 0x56081f035870 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ab40083e0 con 0x56081f0333b0 2024-09-10T05:12:10.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abde98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:10.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abde98800 20 realm 2024-09-10T05:12:10.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abde98800 20 rados->read ofs=0 len=0 2024-09-10T05:12:10.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f0363d0 con 0x56081f0333b0 2024-09-10T05:12:10.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ab40083e0 con 0x56081f0333b0 2024-09-10T05:12:10.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abde98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:10.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abde98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:10.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abde98800 20 rados->read ofs=0 len=0 2024-09-10T05:12:10.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f0333b0 2024-09-10T05:12:10.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ab40083e0 con 0x56081f0333b0 2024-09-10T05:12:10.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abde98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:10.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abde98800 20 rados->read ofs=0 len=0 2024-09-10T05:12:10.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.075+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f037040 con 0x56081f0333b0 2024-09-10T05:12:10.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.076+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ab40083e0 con 0x56081f0333b0 2024-09-10T05:12:10.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.076+0000 7f9abde98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:10.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.076+0000 7f9abde98800 20 rados->read ofs=0 len=0 2024-09-10T05:12:10.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.076+0000 7f9abde98800 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56081f037a00 0x56081f039df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.076+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f03a440 con 0x56081f037a00 2024-09-10T05:12:10.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.076+0000 7f9abb982640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56081f037a00 0x56081f039df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.076+0000 7f9abb982640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56081f037a00 0x56081f039df0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.077+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.077+0000 7f9abde98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.077+0000 7f9abde98800 20 searching for the correct realm 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.077+0000 7f9abde98800 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56081f03c3d0 0x56081f03e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.077+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f03ef10 con 0x56081f03c3d0 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.077+0000 7f9abb181640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56081f03c3d0 0x56081f03e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.077+0000 7f9abb181640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56081f03c3d0 0x56081f03e890 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.077+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.077+0000 7f9abb181640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f9ab002e910 0x7f9ab003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.077+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f03ef10 con 0x7f9ab002e910 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.077+0000 7f9abc183640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f9ab002e910 0x7f9ab003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.078+0000 7f9abc183640 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f9ab002e910 0x7f9ab003a3c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.078+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9ab40083e0 con 0x7f9ab002e910 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.078+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f037a00 2024-09-10T05:12:10.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.078+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.078+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f0333b0 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.078+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab40083e0 con 0x56081f0333b0 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.078+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f0333b0 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.079+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab4026040 con 0x56081f0333b0 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.079+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f037a00 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.079+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.079+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f037a00 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.079+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.079+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x7f9ab002e910 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.079+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab4026040 con 0x7f9ab002e910 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.079+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f03c3d0 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.080+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.080+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f0333b0 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.080+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab4026040 con 0x56081f0333b0 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.080+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f037a00 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.080+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.080+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f0333b0 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.080+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab4026040 con 0x56081f0333b0 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.080+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x7f9ab002e910 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.081+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9ab4026040 con 0x7f9ab002e910 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.081+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f03c3d0 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.081+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.081+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f03c3d0 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.081+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.081+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f037a00 2024-09-10T05:12:10.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.081+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.081+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f03c3d0 2024-09-10T05:12:10.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.081+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.081+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f03c3d0 2024-09-10T05:12:10.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.082+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.082+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f0333b0 2024-09-10T05:12:10.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.082+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab4026040 con 0x56081f0333b0 2024-09-10T05:12:10.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.082+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f0333b0 2024-09-10T05:12:10.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.082+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9ab4026040 con 0x56081f0333b0 2024-09-10T05:12:10.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.082+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x7f9ab002e910 2024-09-10T05:12:10.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.082+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab4026040 con 0x7f9ab002e910 2024-09-10T05:12:10.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.082+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f03c3d0 2024-09-10T05:12:10.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.083+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.083+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x7f9ab002e910 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.083+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab4026040 con 0x7f9ab002e910 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.083+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f0333b0 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.083+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.083+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f037a00 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.083+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.083+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f03c3d0 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.084+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.084+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f037a00 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.084+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.084+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x7f9ab002e910 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.084+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.084+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f03c3d0 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.084+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.084+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x7f9ab002e910 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.084+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.084+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9ab403a040 con 0x56081f0333b0 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9ab403a040 con 0x7f9ab002e910 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:10.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 20 rados->read ofs=0 len=0 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f0333b0 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 20 rados->read ofs=0 len=0 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x56081f0333b0 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 20 rados->read ofs=0 len=0 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.085+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f036ca0 con 0x7f9ab002e910 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:10.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 20 zone default found 2024-09-10T05:12:10.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 4 Realm: () 2024-09-10T05:12:10.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:10.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:10.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:10.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 20 zonegroup default 2024-09-10T05:12:10.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 20 rados->read ofs=0 len=0 2024-09-10T05:12:10.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f03ad90 con 0x56081f037a00 2024-09-10T05:12:10.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:10.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 20 rados->read ofs=0 len=0 2024-09-10T05:12:10.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f040850 con 0x56081f03c3d0 2024-09-10T05:12:10.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 20 rados->read ofs=0 len=0 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.086+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f040bf0 con 0x56081f03c3d0 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.087+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.087+0000 7f9abde98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.087+0000 7f9abde98800 20 started sync module instance, tier type = 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.087+0000 7f9abde98800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.087+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f03fce0 con 0x7f9ab002e910 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.088+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.088+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94592880083456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f03fce0 con 0x7f9ab002e910 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.088+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f0416e0 con 0x56081f0333b0 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.089+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94592880083456] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.089+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.089+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94592880087536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f03fce0 con 0x56081f0333b0 2024-09-10T05:12:10.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.089+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f042190 con 0x56081f03c3d0 2024-09-10T05:12:10.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.090+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94592880087536] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.090+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.090+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94592880080944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f03fc50 con 0x56081f03c3d0 2024-09-10T05:12:10.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.090+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f043050 con 0x7f9ab002e910 2024-09-10T05:12:10.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.091+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94592880080944] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.091+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.091+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94592880094112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f043470 con 0x7f9ab002e910 2024-09-10T05:12:10.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.091+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f043e30 con 0x56081f0333b0 2024-09-10T05:12:10.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.092+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.092+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94592880097664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f044250 con 0x56081f0333b0 2024-09-10T05:12:10.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.092+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94592880094112] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.092+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f044d00 con 0x56081f037a00 2024-09-10T05:12:10.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.093+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.093+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94592880095296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f0450a0 con 0x56081f037a00 2024-09-10T05:12:10.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.093+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f045b00 con 0x56081f037a00 2024-09-10T05:12:10.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.094+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94592880097664] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.094+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94592880095296] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.094+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.095+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94592880098720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f045ef0 con 0x56081f037a00 2024-09-10T05:12:10.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.095+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f046740 con 0x56081f037a00 2024-09-10T05:12:10.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(58 notify.7 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94592880098720] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94592880107760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f046b60 con 0x56081f037a00 2024-09-10T05:12:10.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abde98800 20 add_watcher() i=0 2024-09-10T05:12:10.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abde98800 20 add_watcher() i=1 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abde98800 20 add_watcher() i=2 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abde98800 20 add_watcher() i=3 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abde98800 20 add_watcher() i=4 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abde98800 20 add_watcher() i=5 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abde98800 20 add_watcher() i=6 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94592880107760] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abde98800 20 add_watcher() i=7 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abde98800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.096+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f0456a0 con 0x56081f0333b0 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.097+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.097+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94592880109040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f047430 con 0x56081f0333b0 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.098+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94592880109040] v37'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.098+0000 7f9971fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.098+0000 7f9abde98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.098+0000 7f9abde98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.098+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f0524b0 con 0x56081f0333b0 2024-09-10T05:12:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.099+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'55 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.099+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f0524b0 con 0x56081f037a00 2024-09-10T05:12:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.100+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.100+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f0524b0 con 0x56081f03c3d0 2024-09-10T05:12:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.101+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.101+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f053550 con 0x56081f0333b0 2024-09-10T05:12:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.102+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'200 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.102+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f051b20 con 0x7f9ab002e910 2024-09-10T05:12:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.103+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'71 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.103+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f051b20 con 0x56081f03c3d0 2024-09-10T05:12:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.104+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'55 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.104+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054730 con 0x56081f0333b0 2024-09-10T05:12:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.106+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.106+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054730 con 0x56081f037a00 2024-09-10T05:12:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.107+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.107+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054730 con 0x7f9ab002e910 2024-09-10T05:12:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.108+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.108+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054730 con 0x56081f03c3d0 2024-09-10T05:12:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.109+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.109+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054ca0 con 0x7f9ab002e910 2024-09-10T05:12:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.109+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'72 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.109+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054ca0 con 0x56081f037a00 2024-09-10T05:12:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.110+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.110+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054ca0 con 0x7f9ab002e910 2024-09-10T05:12:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.111+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.111+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054ca0 con 0x56081f037a00 2024-09-10T05:12:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.112+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'61 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.112+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054ca0 con 0x56081f0333b0 2024-09-10T05:12:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.114+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'201 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.114+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054ca0 con 0x56081f03c3d0 2024-09-10T05:12:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.115+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'68 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.115+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054f50 con 0x7f9ab002e910 2024-09-10T05:12:10.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.116+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'73 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.116+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054f50 con 0x56081f03c3d0 2024-09-10T05:12:10.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.117+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.117+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054f50 con 0x56081f0333b0 2024-09-10T05:12:10.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.118+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.118+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054f50 con 0x56081f0333b0 2024-09-10T05:12:10.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.119+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'202 uv174 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.119+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054f50 con 0x56081f03c3d0 2024-09-10T05:12:10.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.120+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'69 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.120+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054fe0 con 0x7f9ab002e910 2024-09-10T05:12:10.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.121+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.121+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054fe0 con 0x56081f03c3d0 2024-09-10T05:12:10.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.122+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.122+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f054fe0 con 0x56081f03c3d0 2024-09-10T05:12:10.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.123+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'43 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.123+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f055040 con 0x56081f03c3d0 2024-09-10T05:12:10.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.124+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.124+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f055040 con 0x56081f03c3d0 2024-09-10T05:12:10.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.125+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'56 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.125+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f055000 con 0x56081f037a00 2024-09-10T05:12:10.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.126+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.126+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f055060 con 0x56081f03c3d0 2024-09-10T05:12:10.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.127+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.127+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f055060 con 0x56081f037a00 2024-09-10T05:12:10.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.128+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.128+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f055060 con 0x56081f03c3d0 2024-09-10T05:12:10.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.129+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'70 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.129+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f055060 con 0x56081f037a00 2024-09-10T05:12:10.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.131+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'62 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.131+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f055060 con 0x7f9ab002e910 2024-09-10T05:12:10.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.132+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.132+0000 7f9970fe1640 20 reqs_thread_entry: start 2024-09-10T05:12:10.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.132+0000 7f9abde98800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:10.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.132+0000 7f9abde98800 20 Filter name: none 2024-09-10T05:12:10.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.132+0000 7f98ea7fc640 20 reqs_thread_entry: start 2024-09-10T05:12:10.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.132+0000 7f9abde98800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:12:10.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.132+0000 7f9abde98800 20 rados->read ofs=0 len=0 2024-09-10T05:12:10.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.132+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f07ff40 con 0x56081f0333b0 2024-09-10T05:12:10.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.133+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.133+0000 7f9abde98800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:12:10.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.133+0000 7f9abde98800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:12:10.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.133+0000 7f9abde98800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:12:10.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.133+0000 7f9abde98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:10.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.133+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56081f082300 con 0x7f9ab002e910 2024-09-10T05:12:10.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.133+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.136 INFO:teuthology.orchestra.run.smithi192.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-10T05:12:10.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.134+0000 7f9971fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:10.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.134+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94592880109040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f053550 con 0x56081f0333b0 2024-09-10T05:12:10.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.135+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94592880109040] v37'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.135+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94592880083456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f0465b0 con 0x7f9ab002e910 2024-09-10T05:12:10.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.136+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94592880083456] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.136+0000 7f9abde98800 20 remove_watcher() i=0 2024-09-10T05:12:10.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.136+0000 7f9abde98800 2 removed watcher, disabling cache 2024-09-10T05:12:10.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.136+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94592880087536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f040200 con 0x56081f0333b0 2024-09-10T05:12:10.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.137+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94592880087536] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.137+0000 7f9abde98800 20 remove_watcher() i=1 2024-09-10T05:12:10.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.137+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94592880080944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f040200 con 0x56081f03c3d0 2024-09-10T05:12:10.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.138+0000 7f9abb181640 1 -- 172.21.15.192:0/2576891806 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94592880080944] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab0037040 con 0x56081f03c3d0 2024-09-10T05:12:10.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.138+0000 7f9abde98800 20 remove_watcher() i=2 2024-09-10T05:12:10.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.138+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94592880094112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f03f830 con 0x7f9ab002e910 2024-09-10T05:12:10.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.139+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94592880094112] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x7f9ab002e910 2024-09-10T05:12:10.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.139+0000 7f9abde98800 20 remove_watcher() i=3 2024-09-10T05:12:10.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.139+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94592880097664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f042ba0 con 0x56081f0333b0 2024-09-10T05:12:10.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.140+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94592880097664] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ab4035040 con 0x56081f0333b0 2024-09-10T05:12:10.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.140+0000 7f9abde98800 20 remove_watcher() i=4 2024-09-10T05:12:10.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.140+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94592880095296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f03f830 con 0x56081f037a00 2024-09-10T05:12:10.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.141+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94592880095296] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.141+0000 7f9abde98800 20 remove_watcher() i=5 2024-09-10T05:12:10.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.141+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94592880098720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f043980 con 0x56081f037a00 2024-09-10T05:12:10.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.142+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94592880098720] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.142+0000 7f9abde98800 20 remove_watcher() i=6 2024-09-10T05:12:10.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.142+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94592880107760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56081f043e30 con 0x56081f037a00 2024-09-10T05:12:10.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.143+0000 7f9abb982640 1 -- 172.21.15.192:0/2576891806 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94592880107760] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aac063cd0 con 0x56081f037a00 2024-09-10T05:12:10.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.143+0000 7f9abde98800 20 remove_watcher() i=7 2024-09-10T05:12:10.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56081f037a00 msgr2=0x56081f039df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56081f037a00 0x56081f039df0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56081f0333b0 msgr2=0x56081f035870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56081f0333b0 0x56081f035870 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f9ab002e910 msgr2=0x7f9ab003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f9ab002e910 0x7f9ab003a3c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56081f03c3d0 msgr2=0x56081f03e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56081f03c3d0 0x56081f03e890 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f998403c730 msgr2=0x7f998403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f998403c730 0x7f998403ebf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000ffd0 tx=0x7f9ab0023040 comp rx=0 tx=0).stop 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 msgr2=0x56081f027de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 --2- 172.21.15.192:0/2576891806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f020a40 0x56081f027de0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9aac094670 tx=0x7f9aac056ec0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 reap_dead start 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abc183640 1 -- 172.21.15.192:0/2576891806 reap_dead start 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 shutdown_connections 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 >> 172.21.15.192:0/2576891806 conn(0x56081f01ce40 msgr2=0x56081f01b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 shutdown_connections 2024-09-10T05:12:10.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2576891806 wait complete. 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2899039826 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f999403c780 msgr2=0x7f999403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 --2- 172.21.15.192:0/2899039826 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f999403c780 0x7f999403ec40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x56081effecf0 tx=0x7f9ab0006000 comp rx=0 tx=0).stop 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2899039826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f014140 msgr2=0x56081f014560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 --2- 172.21.15.192:0/2899039826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f014140 0x56081f014560 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0958f0 tx=0x7f9aac04ee90 comp rx=0 tx=0).stop 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2899039826 shutdown_connections 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 --2- 172.21.15.192:0/2899039826 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f999403c780 0x7f999403ec40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 --2- 172.21.15.192:0/2899039826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081f014140 0x56081f014560 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2899039826 >> 172.21.15.192:0/2899039826 conn(0x56081f0084f0 msgr2=0x56081f0088d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2899039826 shutdown_connections 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.144+0000 7f9abde98800 1 -- 172.21.15.192:0/2899039826 wait complete. 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56081efffab0 msgr2=0x56081f001ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56081efffab0 0x56081f001ea0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56081ef00020 msgr2=0x56081effd2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56081ef00020 0x56081effd2a0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56081f0039a0 msgr2=0x56081f005d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56081f0039a0 0x56081f005d90 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99a403c730 msgr2=0x7f99a403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99a403c730 0x7f99a403ebf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0000c00 tx=0x7f9ab00013b0 comp rx=0 tx=0).stop 2024-09-10T05:12:10.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 msgr2=0x56081eefcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:10.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 --2- 172.21.15.192:0/422527929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56081eefd690 0x56081eefcdb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9aac025a60 tx=0x7f9aac003330 comp rx=0 tx=0).stop 2024-09-10T05:12:10.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abc183640 1 -- 172.21.15.192:0/422527929 reap_dead start 2024-09-10T05:12:10.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 shutdown_connections 2024-09-10T05:12:10.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 >> 172.21.15.192:0/422527929 conn(0x56081eef71b0 msgr2=0x56081efed6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:10.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 shutdown_connections 2024-09-10T05:12:10.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:10.145+0000 7f9abde98800 1 -- 172.21.15.192:0/422527929 wait complete. 2024-09-10T05:12:10.154 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T05:12:10.174 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:10.221 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-10T05:12:45.222 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-10T05:12:45.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-10T05:12:45.223 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-10T05:12:45.276 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:45.276 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:45.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.276+0000 7ff79b12f800 1 Processor -- start 2024-09-10T05:12:45.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.276+0000 7ff79b12f800 1 -- start start 2024-09-10T05:12:45.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.276+0000 7ff79b12f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b8209744b0 0x55b8209748b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.276+0000 7ff79b12f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b82081fe40 con 0x55b820974df0 2024-09-10T05:12:45.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.276+0000 7ff79b12f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55b8207ea680 con 0x55b8209744b0 2024-09-10T05:12:45.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.277+0000 7ff796e1a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b8209744b0 0x55b8209748b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.277+0000 7ff796619640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55b820974df0 0x55b8209752a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:34178/0 (socket says 172.21.15.192:34178) 2024-09-10T05:12:45.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.277+0000 7ff796e1a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b8209744b0 0x55b8209748b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42232/0 (socket says 172.21.15.192:42232) 2024-09-10T05:12:45.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.277+0000 7ff796619640 1 -- 172.21.15.192:0/2068213044 learned_addr learned my addr 172.21.15.192:0/2068213044 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:45.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.277+0000 7ff796e1a640 1 -- 172.21.15.192:0/2068213044 >> v1:172.21.15.139:6789/0 conn(0x55b820974df0 legacy=0x55b8209752a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.277+0000 7ff796e1a640 1 -- 172.21.15.192:0/2068213044 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8208066b0 con 0x55b8209744b0 2024-09-10T05:12:45.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.279+0000 7ff796e1a640 1 --2- 172.21.15.192:0/2068213044 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b8209748b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff78800a470 tx=0x7ff788045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b8fef1c5f04469 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.279+0000 7ff795e18640 1 -- 172.21.15.192:0/2068213044 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff788053570 con 0x55b8209744b0 2024-09-10T05:12:45.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.279+0000 7ff795e18640 1 -- 172.21.15.192:0/2068213044 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff788058070 con 0x55b8209744b0 2024-09-10T05:12:45.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.279+0000 7ff795e18640 1 -- 172.21.15.192:0/2068213044 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff788053880 con 0x55b8209744b0 2024-09-10T05:12:45.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.280+0000 7ff79b12f800 1 -- 172.21.15.192:0/2068213044 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 msgr2=0x55b8209748b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.280+0000 7ff79b12f800 1 --2- 172.21.15.192:0/2068213044 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b8209748b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff78800a470 tx=0x7ff788045a20 comp rx=0 tx=0).stop 2024-09-10T05:12:45.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.280+0000 7ff79b12f800 1 -- 172.21.15.192:0/2068213044 shutdown_connections 2024-09-10T05:12:45.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.280+0000 7ff79b12f800 1 --2- 172.21.15.192:0/2068213044 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b8209748b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.280+0000 7ff79b12f800 1 -- 172.21.15.192:0/2068213044 >> 172.21.15.192:0/2068213044 conn(0x55b8209701c0 msgr2=0x55b820972620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.280+0000 7ff79b12f800 1 -- 172.21.15.192:0/2068213044 shutdown_connections 2024-09-10T05:12:45.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.280+0000 7ff79b12f800 1 -- 172.21.15.192:0/2068213044 wait complete. 2024-09-10T05:12:45.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.296+0000 7ff79b12f800 1 Processor -- start 2024-09-10T05:12:45.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.296+0000 7ff79b12f800 1 -- start start 2024-09-10T05:12:45.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.296+0000 7ff79b12f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b820a678c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.296+0000 7ff79b12f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b82080edd0 con 0x55b8209744b0 2024-09-10T05:12:45.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.296+0000 7ff796e1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b820a678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.296+0000 7ff796e1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b820a678c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42238/0 (socket says 172.21.15.192:42238) 2024-09-10T05:12:45.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.296+0000 7ff796e1a640 1 -- 172.21.15.192:0/2604413336 learned_addr learned my addr 172.21.15.192:0/2604413336 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.297+0000 7ff796e1a640 1 -- 172.21.15.192:0/2604413336 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b820827e10 con 0x55b8209744b0 2024-09-10T05:12:45.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.297+0000 7ff796e1a640 1 --2- 172.21.15.192:0/2604413336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b820a678c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff788025c20 tx=0x7ff788051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6361df004f69242f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.297+0000 7ff684e09640 1 -- 172.21.15.192:0/2604413336 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff788053a20 con 0x55b8209744b0 2024-09-10T05:12:45.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.297+0000 7ff684e09640 1 -- 172.21.15.192:0/2604413336 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff788063070 con 0x55b8209744b0 2024-09-10T05:12:45.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.297+0000 7ff684e09640 1 -- 172.21.15.192:0/2604413336 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff788053cf0 con 0x55b8209744b0 2024-09-10T05:12:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.298+0000 7ff79b12f800 1 -- 172.21.15.192:0/2604413336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 msgr2=0x55b820a678c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.298+0000 7ff79b12f800 1 --2- 172.21.15.192:0/2604413336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b820a678c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff788025c20 tx=0x7ff788051000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.298+0000 7ff79b12f800 1 -- 172.21.15.192:0/2604413336 shutdown_connections 2024-09-10T05:12:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.298+0000 7ff79b12f800 1 --2- 172.21.15.192:0/2604413336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b820a678c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.298+0000 7ff79b12f800 1 -- 172.21.15.192:0/2604413336 >> 172.21.15.192:0/2604413336 conn(0x55b8209701c0 msgr2=0x55b820a63240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.298+0000 7ff79b12f800 1 -- 172.21.15.192:0/2604413336 shutdown_connections 2024-09-10T05:12:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.298+0000 7ff79b12f800 1 -- 172.21.15.192:0/2604413336 wait complete. 2024-09-10T05:12:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.298+0000 7ff79b12f800 1 Processor -- start 2024-09-10T05:12:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.298+0000 7ff79b12f800 1 -- start start 2024-09-10T05:12:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.298+0000 7ff79b12f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b820a6f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.298+0000 7ff79b12f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b820975d10 con 0x55b8209744b0 2024-09-10T05:12:45.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.299+0000 7ff796e1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b820a6f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.299+0000 7ff796e1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b820a6f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42250/0 (socket says 172.21.15.192:42250) 2024-09-10T05:12:45.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.299+0000 7ff796e1a640 1 -- 172.21.15.192:0/1077671589 learned_addr learned my addr 172.21.15.192:0/1077671589 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.299+0000 7ff796e1a640 1 -- 172.21.15.192:0/1077671589 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b820a6f640 con 0x55b8209744b0 2024-09-10T05:12:45.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.299+0000 7ff796e1a640 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b820a6f0e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff788025c20 tx=0x7ff788002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.299+0000 7ff683606640 1 -- 172.21.15.192:0/1077671589 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff78806c030 con 0x55b8209744b0 2024-09-10T05:12:45.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.299+0000 7ff683606640 1 -- 172.21.15.192:0/1077671589 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff788068660 con 0x55b8209744b0 2024-09-10T05:12:45.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.299+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b820a6f8d0 con 0x55b8209744b0 2024-09-10T05:12:45.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.299+0000 7ff683606640 1 -- 172.21.15.192:0/1077671589 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff788068940 con 0x55b8209744b0 2024-09-10T05:12:45.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.300+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b820a702d0 con 0x55b8209744b0 2024-09-10T05:12:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.300+0000 7ff683606640 1 -- 172.21.15.192:0/1077671589 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff788068ae0 con 0x55b8209744b0 2024-09-10T05:12:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.301+0000 7ff683606640 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff67c03c730 0x7ff67c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.301+0000 7ff683606640 1 -- 172.21.15.192:0/1077671589 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7ff7880980d0 con 0x55b8209744b0 2024-09-10T05:12:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.301+0000 7ff796619640 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff67c03c730 0x7ff67c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.301+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b820974df0 0x55b820a76730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.301+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820a76c70 con 0x55b820974df0 2024-09-10T05:12:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.301+0000 7ff79761b640 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b820974df0 0x55b820a76730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.301+0000 7ff796619640 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff67c03c730 0x7ff67c03ebf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff78c001d70 tx=0x7ff78c0012d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.301+0000 7ff79761b640 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b820974df0 0x55b820a76730 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.302+0000 7ff79761b640 1 -- 172.21.15.192:0/1077671589 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820974df0 2024-09-10T05:12:45.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.302+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820a77010 con 0x55b820974df0 2024-09-10T05:12:45.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.302+0000 7ff79761b640 1 -- 172.21.15.192:0/1077671589 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820974df0 2024-09-10T05:12:45.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.302+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b820a78b10 0x55b820a7af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.302+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820a7b720 con 0x55b820a78b10 2024-09-10T05:12:45.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.302+0000 7ff796e1a640 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b820a78b10 0x55b820a7af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.303+0000 7ff796e1a640 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b820a78b10 0x55b820a7af90 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.303+0000 7ff796e1a640 1 -- 172.21.15.192:0/1077671589 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff788051070 con 0x55b820a78b10 2024-09-10T05:12:45.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.303+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820a77860 con 0x55b820974df0 2024-09-10T05:12:45.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.303+0000 7ff79761b640 1 -- 172.21.15.192:0/1077671589 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820974df0 2024-09-10T05:12:45.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.304+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b820a7cb80 0x55b820a7ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.304+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820a7f6e0 con 0x55b820a7cb80 2024-09-10T05:12:45.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.304+0000 7ff796619640 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b820a7cb80 0x55b820a7ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.304+0000 7ff796619640 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b820a7cb80 0x55b820a7ef70 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.304+0000 7ff796619640 1 -- 172.21.15.192:0/1077671589 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff78c009050 con 0x55b820a7cb80 2024-09-10T05:12:45.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.305+0000 7ff79b12f800 1 Processor -- start 2024-09-10T05:12:45.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.305+0000 7ff79b12f800 1 -- start start 2024-09-10T05:12:45.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.305+0000 7ff79b12f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a8d310 0x55b820a8d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.305+0000 7ff79b12f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b82086ca00 con 0x55b820a8d310 2024-09-10T05:12:45.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.305+0000 7ff796e1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a8d310 0x55b820a8d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.305+0000 7ff796e1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a8d310 0x55b820a8d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42260/0 (socket says 172.21.15.192:42260) 2024-09-10T05:12:45.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.305+0000 7ff796e1a640 1 -- 172.21.15.192:0/4112688640 learned_addr learned my addr 172.21.15.192:0/4112688640 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.305+0000 7ff796e1a640 1 -- 172.21.15.192:0/4112688640 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b820a8dd70 con 0x55b820a8d310 2024-09-10T05:12:45.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.305+0000 7ff796e1a640 1 --2- 172.21.15.192:0/4112688640 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a8d310 0x55b820a8d730 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff78807b8e0 tx=0x7ff7880523a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.306+0000 7ff680e01640 1 -- 172.21.15.192:0/4112688640 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff78807bd00 con 0x55b820a8d310 2024-09-10T05:12:45.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.306+0000 7ff680e01640 1 -- 172.21.15.192:0/4112688640 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78805daf0 con 0x55b820a8d310 2024-09-10T05:12:45.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.306+0000 7ff79b12f800 1 -- 172.21.15.192:0/4112688640 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b820a8e5a0 con 0x55b820a8d310 2024-09-10T05:12:45.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.306+0000 7ff680e01640 1 -- 172.21.15.192:0/4112688640 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff78805de10 con 0x55b820a8d310 2024-09-10T05:12:45.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.306+0000 7ff79b12f800 1 -- 172.21.15.192:0/4112688640 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b820a8eb40 con 0x55b820a8d310 2024-09-10T05:12:45.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.307+0000 7ff680e01640 1 -- 172.21.15.192:0/4112688640 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff78805d560 con 0x55b820a8d310 2024-09-10T05:12:45.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.307+0000 7ff680e01640 1 --2- 172.21.15.192:0/4112688640 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff67003c970 0x7ff67003ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.307+0000 7ff680e01640 1 -- 172.21.15.192:0/4112688640 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7ff788083040 con 0x55b820a8d310 2024-09-10T05:12:45.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.307+0000 7ff796619640 1 --2- 172.21.15.192:0/4112688640 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff67003c970 0x7ff67003ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.307+0000 7ff79b12f800 1 Processor -- start 2024-09-10T05:12:45.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.307+0000 7ff79b12f800 1 -- start start 2024-09-10T05:12:45.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.307+0000 7ff796619640 1 --2- 172.21.15.192:0/4112688640 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff67003c970 0x7ff67003ee30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00bf40 tx=0x7ff78c00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.307+0000 7ff79b12f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 0x55b820a99fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.307+0000 7ff79b12f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b820a680b0 con 0x55b820a99bd0 2024-09-10T05:12:45.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.308+0000 7ff796e1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 0x55b820a99fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.308+0000 7ff796e1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 0x55b820a99fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42268/0 (socket says 172.21.15.192:42268) 2024-09-10T05:12:45.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.308+0000 7ff796e1a640 1 -- 172.21.15.192:0/3968097002 learned_addr learned my addr 172.21.15.192:0/3968097002 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.308+0000 7ff796e1a640 1 -- 172.21.15.192:0/3968097002 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b820a9a5a0 con 0x55b820a99bd0 2024-09-10T05:12:45.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.308+0000 7ff796e1a640 1 --2- 172.21.15.192:0/3968097002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 0x55b820a99fb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff78804d870 tx=0x7ff78804d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ab97f5705ef59c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.308+0000 7ff67a7fc640 1 -- 172.21.15.192:0/3968097002 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7880aa020 con 0x55b820a99bd0 2024-09-10T05:12:45.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.308+0000 7ff67a7fc640 1 -- 172.21.15.192:0/3968097002 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78808f980 con 0x55b820a99bd0 2024-09-10T05:12:45.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.308+0000 7ff67a7fc640 1 -- 172.21.15.192:0/3968097002 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff78805f420 con 0x55b820a99bd0 2024-09-10T05:12:45.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.309+0000 7ff79b12f800 1 -- 172.21.15.192:0/3968097002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 msgr2=0x55b820a99fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.309+0000 7ff79b12f800 1 --2- 172.21.15.192:0/3968097002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 0x55b820a99fb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff78804d870 tx=0x7ff78804d680 comp rx=0 tx=0).stop 2024-09-10T05:12:45.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.309+0000 7ff79b12f800 1 -- 172.21.15.192:0/3968097002 shutdown_connections 2024-09-10T05:12:45.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.309+0000 7ff79b12f800 1 --2- 172.21.15.192:0/3968097002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 0x55b820a99fb0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.309+0000 7ff79b12f800 1 -- 172.21.15.192:0/3968097002 >> 172.21.15.192:0/3968097002 conn(0x55b820a95fd0 msgr2=0x55b820a94210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.309+0000 7ff79b12f800 1 -- 172.21.15.192:0/3968097002 shutdown_connections 2024-09-10T05:12:45.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.309+0000 7ff79b12f800 1 -- 172.21.15.192:0/3968097002 wait complete. 2024-09-10T05:12:45.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.309+0000 7ff79b12f800 1 Processor -- start 2024-09-10T05:12:45.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.309+0000 7ff79b12f800 1 -- start start 2024-09-10T05:12:45.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.309+0000 7ff79b12f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 0x55b820aa0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.309+0000 7ff79b12f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b820a9aa30 con 0x55b820a99bd0 2024-09-10T05:12:45.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.310+0000 7ff796e1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 0x55b820aa0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.310+0000 7ff796e1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 0x55b820aa0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42280/0 (socket says 172.21.15.192:42280) 2024-09-10T05:12:45.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.310+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 learned_addr learned my addr 172.21.15.192:0/1304961936 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.310+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b820aa14d0 con 0x55b820a99bd0 2024-09-10T05:12:45.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.310+0000 7ff796e1a640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 0x55b820aa0f70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff78805da80 tx=0x7ff78806ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.310+0000 7ff678ff9640 1 -- 172.21.15.192:0/1304961936 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7880bf070 con 0x55b820a99bd0 2024-09-10T05:12:45.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.310+0000 7ff678ff9640 1 -- 172.21.15.192:0/1304961936 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78804d960 con 0x55b820a99bd0 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.310+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b820aa14d0 con 0x55b820a99bd0 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.310+0000 7ff678ff9640 1 -- 172.21.15.192:0/1304961936 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff78805e720 con 0x55b820a99bd0 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.310+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b820aa14d0 con 0x55b820a99bd0 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.311+0000 7ff678ff9640 1 -- 172.21.15.192:0/1304961936 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff7880c2070 con 0x55b820a99bd0 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.311+0000 7ff678ff9640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff66003c6e0 0x7ff66003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.312+0000 7ff678ff9640 1 -- 172.21.15.192:0/1304961936 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7ff7880b5030 con 0x55b820a99bd0 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.312+0000 7ff796619640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff66003c6e0 0x7ff66003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.312+0000 7ff79b12f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.312+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b820aac3b0 0x55b820aae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.312+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820aaefc0 con 0x55b820aac3b0 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.312+0000 7ff79761b640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b820aac3b0 0x55b820aae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.312+0000 7ff796619640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff66003c6e0 0x7ff66003eba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00c010 tx=0x7ff78c010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.312+0000 7ff79761b640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b820aac3b0 0x55b820aae870 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.312+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 20 realm 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820aaf3d0 con 0x55b820aac3b0 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820aafca0 con 0x55b820aac3b0 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820aac3b0 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b820ab0b30 0x55b820ab2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab3660 con 0x55b820ab0b30 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.313+0000 7ff796e1a640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b820ab0b30 0x55b820ab2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.314+0000 7ff796e1a640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b820ab0b30 0x55b820ab2f20 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.314+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.314+0000 7ff79b12f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.314+0000 7ff79b12f800 20 searching for the correct realm 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.314+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b820ab5700 0x55b820ab7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.314+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab8290 con 0x55b820ab5700 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.314+0000 7ff796619640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b820ab5700 0x55b820ab7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.315+0000 7ff796619640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b820ab5700 0x55b820ab7bc0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.315+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.315+0000 7ff796619640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7ff78c037040 0x7ff78c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.315+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab8290 con 0x7ff78c037040 2024-09-10T05:12:45.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.315+0000 7ff79761b640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7ff78c037040 0x7ff78c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.315+0000 7ff79761b640 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7ff78c037040 0x7ff78c036410 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.316+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.316+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab0b30 2024-09-10T05:12:45.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.316+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.316+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820aac3b0 2024-09-10T05:12:45.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.316+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.316+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820aac3b0 2024-09-10T05:12:45.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.317+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.317+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab0b30 2024-09-10T05:12:45.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.317+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.317+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab0b30 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.317+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.317+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x7ff78c037040 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.317+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.317+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab5700 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.318+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.318+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820aac3b0 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.318+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.318+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab0b30 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.318+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.318+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820aac3b0 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.318+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.318+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x7ff78c037040 2024-09-10T05:12:45.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.319+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.319+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab5700 2024-09-10T05:12:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.319+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.319+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab5700 2024-09-10T05:12:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.319+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.319+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab0b30 2024-09-10T05:12:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.319+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.319+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab5700 2024-09-10T05:12:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.320+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.320+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab5700 2024-09-10T05:12:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.320+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.320+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820aac3b0 2024-09-10T05:12:45.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.320+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.320+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820aac3b0 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.320+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.320+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x7ff78c037040 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.320+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.320+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab5700 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.321+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.321+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x7ff78c037040 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.321+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.321+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820aac3b0 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.321+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.321+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab0b30 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.322+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.322+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab5700 2024-09-10T05:12:45.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.322+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.322+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab0b30 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.322+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.322+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x7ff78c037040 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.322+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.322+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820ab5700 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x7ff78c037040 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x55b820aac3b0 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab0040 con 0x7ff78c037040 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79b12f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79b12f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79b12f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79b12f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79b12f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79b12f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79b12f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.323+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab4000 con 0x55b820aac3b0 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab4000 con 0x55b820aac3b0 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab3fb0 con 0x7ff78c037040 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 20 zone default found 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 4 Realm: () 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 20 zonegroup default 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.324+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab43f0 con 0x55b820ab0b30 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff79b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff79b12f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab3cf0 con 0x55b820ab5700 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff79b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff79b12f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820aba100 con 0x55b820ab5700 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff79b12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff79b12f800 20 started sync module instance, tier type = 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff79b12f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.325+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab95a0 con 0x7ff78c037040 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.326+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.326+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94249310460640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab95a0 con 0x7ff78c037040 2024-09-10T05:12:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.326+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abac30 con 0x55b820aac3b0 2024-09-10T05:12:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.327+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94249310460640] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.328+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.328+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94249310463744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab95a0 con 0x55b820aac3b0 2024-09-10T05:12:45.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.328+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abb680 con 0x55b820ab5700 2024-09-10T05:12:45.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.329+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94249310463744] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.329+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.329+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94249310458096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab9510 con 0x55b820ab5700 2024-09-10T05:12:45.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.329+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abc540 con 0x7ff78c037040 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.330+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.330+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94249310458096] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.330+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94249310470768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abbb70 con 0x7ff78c037040 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.330+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abd2e0 con 0x55b820aac3b0 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.332+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94249310470768] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.332+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.332+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94249310471920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abd6d0 con 0x55b820aac3b0 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.332+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abe090 con 0x55b820ab0b30 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.333+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94249310471920] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.333+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.333+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94249310477280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abe430 con 0x55b820ab0b30 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.333+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abee30 con 0x55b820ab0b30 2024-09-10T05:12:45.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.334+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.334+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94249310480704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abf700 con 0x55b820ab0b30 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.334+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820ac0170 con 0x55b820ab0b30 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.334+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94249310477280] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.335+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94249310480704] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.335+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.335+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94249310485568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abf290 con 0x55b820ab0b30 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.335+0000 7ff79b12f800 20 add_watcher() i=0 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.335+0000 7ff79b12f800 20 add_watcher() i=1 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.335+0000 7ff79b12f800 20 add_watcher() i=2 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.335+0000 7ff79b12f800 20 add_watcher() i=3 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.335+0000 7ff79b12f800 20 add_watcher() i=4 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.335+0000 7ff79b12f800 20 add_watcher() i=5 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.335+0000 7ff79b12f800 20 add_watcher() i=6 2024-09-10T05:12:45.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.336+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94249310485568] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.336+0000 7ff79b12f800 20 add_watcher() i=7 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.336+0000 7ff79b12f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.337+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820ac3270 con 0x55b820aac3b0 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.337+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.337+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94249310473712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820ac06f0 con 0x55b820aac3b0 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.338+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94249310473712] v37'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.338+0000 7ff64d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.338+0000 7ff79b12f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.338+0000 7ff79b12f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.338+0000 7ff79b12f800 5 note: GC not initialized 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.338+0000 7ff5c7fff640 20 reqs_thread_entry: start 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.339+0000 7ff79b12f800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:45.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.339+0000 7ff79b12f800 20 Filter name: none 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.339+0000 7ff5c5ffb640 20 reqs_thread_entry: start 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.339+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6710 con 0x55b820aac3b0 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.339+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.339+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6710 con 0x7ff78c037040 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.339+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.339+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af66d0 con 0x55b820aac3b0 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.340+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.340+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af66d0 con 0x55b820ab5700 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.340+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.340+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6be0 con 0x55b820ab5700 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.340+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.340+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6ff0 con 0x55b820ab5700 2024-09-10T05:12:45.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.340+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.340+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6ff0 con 0x55b820aac3b0 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.340+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.341+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6ff0 con 0x55b820aac3b0 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.341+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.341+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6ff0 con 0x55b820ab5700 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.341+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.341+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6ff0 con 0x55b820ab5700 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.341+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.341+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6ff0 con 0x55b820ab0b30 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.342+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.342+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820aac3b0 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.342+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.342+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x7ff78c037040 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.343+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.343+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab5700 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.343+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.343+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab0b30 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.343+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.343+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab0b30 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.343+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.344+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab5700 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.344+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.344+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab0b30 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.344+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.344+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820aac3b0 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.344+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.344+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab5700 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.345+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.345+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab0b30 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.345+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.345+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x7ff78c037040 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.345+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.345+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab0b30 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.346+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.346+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820aac3b0 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.346+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.346+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820aac3b0 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.346+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.346+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab5700 2024-09-10T05:12:45.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.346+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.346+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820aac3b0 2024-09-10T05:12:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.346+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.347+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820aac3b0 2024-09-10T05:12:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.347+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.347+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab5700 2024-09-10T05:12:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.347+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.347+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab5700 2024-09-10T05:12:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.347+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.347+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab5700 2024-09-10T05:12:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.347+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.347+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b820af6070 con 0x55b820ab0b30 2024-09-10T05:12:45.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.348+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.349+0000 7ff64d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.349+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94249310473712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820af7a50 con 0x55b820aac3b0 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.350+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94249310473712] v37'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.350+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94249310460640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abcdf0 con 0x7ff78c037040 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.351+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94249310460640] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.351+0000 7ff79b12f800 20 remove_watcher() i=0 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.351+0000 7ff79b12f800 2 removed watcher, disabling cache 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.351+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94249310463744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abcdf0 con 0x55b820aac3b0 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.352+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94249310463744] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.352+0000 7ff79b12f800 20 remove_watcher() i=1 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.352+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94249310458096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abcdf0 con 0x55b820ab5700 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.353+0000 7ff796619640 1 -- 172.21.15.192:0/1304961936 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94249310458096] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff78c009050 con 0x55b820ab5700 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.353+0000 7ff79b12f800 20 remove_watcher() i=2 2024-09-10T05:12:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.353+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94249310470768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab90f0 con 0x7ff78c037040 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.354+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94249310470768] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x7ff78c037040 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.354+0000 7ff79b12f800 20 remove_watcher() i=3 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.354+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94249310471920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abcdf0 con 0x55b820aac3b0 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.356+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94249310471920] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff79000a4d0 con 0x55b820aac3b0 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.356+0000 7ff79b12f800 20 remove_watcher() i=4 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.356+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94249310477280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abc270 con 0x55b820ab0b30 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.357+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94249310477280] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.357+0000 7ff79b12f800 20 remove_watcher() i=5 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.357+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94249310480704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820ab90f0 con 0x55b820ab0b30 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.358+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94249310480704] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.358+0000 7ff79b12f800 20 remove_watcher() i=6 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.358+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94249310485568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b820abcdf0 con 0x55b820ab0b30 2024-09-10T05:12:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff796e1a640 1 -- 172.21.15.192:0/1304961936 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94249310485568] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7880c1030 con 0x55b820ab0b30 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 20 remove_watcher() i=7 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b820ab0b30 msgr2=0x55b820ab2f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b820ab0b30 0x55b820ab2f20 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b820aac3b0 msgr2=0x55b820aae870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b820aac3b0 0x55b820aae870 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7ff78c037040 msgr2=0x7ff78c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7ff78c037040 0x7ff78c036410 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b820ab5700 msgr2=0x55b820ab7bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b820ab5700 0x55b820ab7bc0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff66003c6e0 msgr2=0x7ff66003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff66003c6e0 0x7ff66003eba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00c010 tx=0x7ff78c010000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 msgr2=0x55b820aa0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 0x55b820aa0f70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff78805da80 tx=0x7ff78806ff90 comp rx=0 tx=0).stop 2024-09-10T05:12:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79761b640 1 -- 172.21.15.192:0/1304961936 reap_dead start 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 shutdown_connections 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1304961936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a99bd0 0x55b820aa0f70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 >> 172.21.15.192:0/1304961936 conn(0x55b820a95fd0 msgr2=0x55b820a941e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 shutdown_connections 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/1304961936 wait complete. 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/4112688640 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff67003c970 msgr2=0x7ff67003ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 --2- 172.21.15.192:0/4112688640 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff67003c970 0x7ff67003ee30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00bf40 tx=0x7ff78c00f000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/4112688640 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a8d310 msgr2=0x55b820a8d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 --2- 172.21.15.192:0/4112688640 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a8d310 0x55b820a8d730 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff78807b8e0 tx=0x7ff7880523a0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/4112688640 shutdown_connections 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 --2- 172.21.15.192:0/4112688640 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff67003c970 0x7ff67003ee30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 --2- 172.21.15.192:0/4112688640 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b820a8d310 0x55b820a8d730 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/4112688640 >> 172.21.15.192:0/4112688640 conn(0x55b820a81670 msgr2=0x55b820a81a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/4112688640 shutdown_connections 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.360+0000 7ff79b12f800 1 -- 172.21.15.192:0/4112688640 wait complete. 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b820a78b10 msgr2=0x55b820a7af90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b820a78b10 0x55b820a7af90 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b820974df0 msgr2=0x55b820a76730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b820974df0 0x55b820a76730 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b820a7cb80 msgr2=0x55b820a7ef70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b820a7cb80 0x55b820a7ef70 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff67c03c730 msgr2=0x7ff67c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff67c03c730 0x7ff67c03ebf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff78c001d70 tx=0x7ff78c0012d0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 msgr2=0x55b820a6f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 --2- 172.21.15.192:0/1077671589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8209744b0 0x55b820a6f0e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff788025c20 tx=0x7ff788002fb0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79761b640 1 -- 172.21.15.192:0/1077671589 reap_dead start 2024-09-10T05:12:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 shutdown_connections 2024-09-10T05:12:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 >> 172.21.15.192:0/1077671589 conn(0x55b8209701c0 msgr2=0x55b820a61a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 shutdown_connections 2024-09-10T05:12:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.361+0000 7ff79b12f800 1 -- 172.21.15.192:0/1077671589 wait complete. 2024-09-10T05:12:45.371 INFO:teuthology.orchestra.run.smithi192.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:12:45.371 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:12:45.372 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-10T05:12:45.372 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-10T05:12:45.372 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-10T05:12:45.414 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:45.415 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:45.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.414+0000 7f0a22717800 1 Processor -- start 2024-09-10T05:12:45.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.414+0000 7f0a22717800 1 -- start start 2024-09-10T05:12:45.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.415+0000 7f0a22717800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562203d5f490 0x562203d5f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.415+0000 7f0a22717800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562203c0ae40 con 0x562203d5fdd0 2024-09-10T05:12:45.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.415+0000 7f0a22717800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x562203bd5680 con 0x562203d5f490 2024-09-10T05:12:45.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.415+0000 7f0a20201640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562203d5f490 0x562203d5f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.415+0000 7f0a20201640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562203d5f490 0x562203d5f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42282/0 (socket says 172.21.15.192:42282) 2024-09-10T05:12:45.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.415+0000 7f0a20201640 1 -- 172.21.15.192:0/2338941028 learned_addr learned my addr 172.21.15.192:0/2338941028 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.415+0000 7f0a20201640 1 -- 172.21.15.192:0/2338941028 >> v1:172.21.15.139:6789/0 conn(0x562203d5fdd0 legacy=0x562203d60280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.415+0000 7f0a20201640 1 -- 172.21.15.192:0/2338941028 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562203bf16b0 con 0x562203d5f490 2024-09-10T05:12:45.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.417+0000 7f0a20201640 1 --2- 172.21.15.192:0/2338941028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203d5f890 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000a520 tx=0x7f0a10045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed783f3f2d4d17a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.417+0000 7f0a1f1ff640 1 -- 172.21.15.192:0/2338941028 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10055070 con 0x562203d5f490 2024-09-10T05:12:45.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.417+0000 7f0a1f1ff640 1 -- 172.21.15.192:0/2338941028 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a100515b0 con 0x562203d5f490 2024-09-10T05:12:45.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.417+0000 7f0a1f1ff640 1 -- 172.21.15.192:0/2338941028 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a100518d0 con 0x562203d5f490 2024-09-10T05:12:45.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.418+0000 7f0a22717800 1 -- 172.21.15.192:0/2338941028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 msgr2=0x562203d5f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.418+0000 7f0a22717800 1 --2- 172.21.15.192:0/2338941028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203d5f890 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000a520 tx=0x7f0a10045ba0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.418+0000 7f0a22717800 1 -- 172.21.15.192:0/2338941028 shutdown_connections 2024-09-10T05:12:45.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.418+0000 7f0a22717800 1 --2- 172.21.15.192:0/2338941028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203d5f890 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.418+0000 7f0a22717800 1 -- 172.21.15.192:0/2338941028 >> 172.21.15.192:0/2338941028 conn(0x562203d5b1e0 msgr2=0x562203d5d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.418+0000 7f0a22717800 1 -- 172.21.15.192:0/2338941028 shutdown_connections 2024-09-10T05:12:45.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.418+0000 7f0a22717800 1 -- 172.21.15.192:0/2338941028 wait complete. 2024-09-10T05:12:45.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.432+0000 7f0a22717800 1 Processor -- start 2024-09-10T05:12:45.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.432+0000 7f0a22717800 1 -- start start 2024-09-10T05:12:45.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.432+0000 7f0a22717800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203e52800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.432+0000 7f0a22717800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562203bf9dd0 con 0x562203d5f490 2024-09-10T05:12:45.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.432+0000 7f0a20201640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203e52800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.432+0000 7f0a20201640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203e52800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42290/0 (socket says 172.21.15.192:42290) 2024-09-10T05:12:45.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.432+0000 7f0a20201640 1 -- 172.21.15.192:0/3748354731 learned_addr learned my addr 172.21.15.192:0/3748354731 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.432+0000 7f0a20201640 1 -- 172.21.15.192:0/3748354731 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562203c12e10 con 0x562203d5f490 2024-09-10T05:12:45.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.433+0000 7f0a20201640 1 --2- 172.21.15.192:0/3748354731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203e52800 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0a10025da0 tx=0x7f0a10051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a6e9fa53fe01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.433+0000 7f090e60c640 1 -- 172.21.15.192:0/3748354731 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10051ac0 con 0x562203d5f490 2024-09-10T05:12:45.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.433+0000 7f090e60c640 1 -- 172.21.15.192:0/3748354731 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10051c60 con 0x562203d5f490 2024-09-10T05:12:45.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.433+0000 7f090e60c640 1 -- 172.21.15.192:0/3748354731 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1005a450 con 0x562203d5f490 2024-09-10T05:12:45.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a22717800 1 -- 172.21.15.192:0/3748354731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 msgr2=0x562203e52800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a22717800 1 --2- 172.21.15.192:0/3748354731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203e52800 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0a10025da0 tx=0x7f0a10051000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a22717800 1 -- 172.21.15.192:0/3748354731 shutdown_connections 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a22717800 1 --2- 172.21.15.192:0/3748354731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203e52800 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a22717800 1 -- 172.21.15.192:0/3748354731 >> 172.21.15.192:0/3748354731 conn(0x562203d5b1e0 msgr2=0x562203e4e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a22717800 1 -- 172.21.15.192:0/3748354731 shutdown_connections 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a22717800 1 -- 172.21.15.192:0/3748354731 wait complete. 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a22717800 1 Processor -- start 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a22717800 1 -- start start 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a22717800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203e59f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a22717800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562203d60d50 con 0x562203d5f490 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a20201640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203e59f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a20201640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203e59f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42304/0 (socket says 172.21.15.192:42304) 2024-09-10T05:12:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.434+0000 7f0a20201640 1 -- 172.21.15.192:0/2043794843 learned_addr learned my addr 172.21.15.192:0/2043794843 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.435+0000 7f0a20201640 1 -- 172.21.15.192:0/2043794843 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562203e5a490 con 0x562203d5f490 2024-09-10T05:12:45.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.435+0000 7f0a20201640 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203e59f30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0a10025da0 tx=0x7f0a10002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.435+0000 7f090ce09640 1 -- 172.21.15.192:0/2043794843 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10073070 con 0x562203d5f490 2024-09-10T05:12:45.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.435+0000 7f090ce09640 1 -- 172.21.15.192:0/2043794843 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1005a640 con 0x562203d5f490 2024-09-10T05:12:45.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.435+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562203e5a720 con 0x562203d5f490 2024-09-10T05:12:45.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.435+0000 7f090ce09640 1 -- 172.21.15.192:0/2043794843 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1005a920 con 0x562203d5f490 2024-09-10T05:12:45.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.435+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562203e5b330 con 0x562203d5f490 2024-09-10T05:12:45.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.436+0000 7f090ce09640 1 -- 172.21.15.192:0/2043794843 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0a10076070 con 0x562203d5f490 2024-09-10T05:12:45.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.436+0000 7f090ce09640 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f090803c730 0x7f090803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.436+0000 7f090ce09640 1 -- 172.21.15.192:0/2043794843 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f0a10062070 con 0x562203d5f490 2024-09-10T05:12:45.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.436+0000 7f0a1fa00640 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f090803c730 0x7f090803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.436+0000 7f0a22717800 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562203d5fdd0 0x562203e61580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.436+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e61ac0 con 0x562203d5fdd0 2024-09-10T05:12:45.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.437+0000 7f0a20a02640 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562203d5fdd0 0x562203e61580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.437+0000 7f0a1fa00640 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f090803c730 0x7f090803ebf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0a14001e50 tx=0x7f0a140013d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.437+0000 7f0a20a02640 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562203d5fdd0 0x562203e61580 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.437+0000 7f0a20a02640 1 -- 172.21.15.192:0/2043794843 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203d5fdd0 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.437+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e61e60 con 0x562203d5fdd0 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.437+0000 7f0a20a02640 1 -- 172.21.15.192:0/2043794843 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203d5fdd0 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.437+0000 7f0a22717800 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562203e63bd0 0x562203e65fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.437+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e66610 con 0x562203e63bd0 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.438+0000 7f0a20201640 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562203e63bd0 0x562203e65fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.438+0000 7f0a20201640 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562203e63bd0 0x562203e65fc0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.438+0000 7f0a20201640 1 -- 172.21.15.192:0/2043794843 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0a1007f070 con 0x562203e63bd0 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.438+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e62a70 con 0x562203d5fdd0 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.439+0000 7f0a20a02640 1 -- 172.21.15.192:0/2043794843 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203d5fdd0 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.439+0000 7f0a22717800 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562203e67a70 0x562203e69e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.439+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e6a5a0 con 0x562203e67a70 2024-09-10T05:12:45.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.439+0000 7f0a1fa00640 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562203e67a70 0x562203e69e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.439+0000 7f0a1fa00640 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562203e67a70 0x562203e69e60 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.439+0000 7f0a1fa00640 1 -- 172.21.15.192:0/2043794843 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0a14010600 con 0x562203e67a70 2024-09-10T05:12:45.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.440+0000 7f0a22717800 1 Processor -- start 2024-09-10T05:12:45.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.440+0000 7f0a22717800 1 -- start start 2024-09-10T05:12:45.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.440+0000 7f0a22717800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e78200 0x562203e78620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.440+0000 7f0a22717800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562203c57a00 con 0x562203e78200 2024-09-10T05:12:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.440+0000 7f0a20201640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e78200 0x562203e78620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.440+0000 7f0a20201640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e78200 0x562203e78620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42310/0 (socket says 172.21.15.192:42310) 2024-09-10T05:12:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.440+0000 7f0a20201640 1 -- 172.21.15.192:0/2817349126 learned_addr learned my addr 172.21.15.192:0/2817349126 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.441+0000 7f0a20201640 1 -- 172.21.15.192:0/2817349126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562203e78c60 con 0x562203e78200 2024-09-10T05:12:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.441+0000 7f0a20201640 1 --2- 172.21.15.192:0/2817349126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e78200 0x562203e78620 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0a10076750 tx=0x7f0a1005ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.441+0000 7f0905ffb640 1 -- 172.21.15.192:0/2817349126 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10096070 con 0x562203e78200 2024-09-10T05:12:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.441+0000 7f0905ffb640 1 -- 172.21.15.192:0/2817349126 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10076c30 con 0x562203e78200 2024-09-10T05:12:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.441+0000 7f0a22717800 1 -- 172.21.15.192:0/2817349126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562203e79490 con 0x562203e78200 2024-09-10T05:12:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.441+0000 7f0905ffb640 1 -- 172.21.15.192:0/2817349126 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10096740 con 0x562203e78200 2024-09-10T05:12:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.441+0000 7f0a22717800 1 -- 172.21.15.192:0/2817349126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562203e79a30 con 0x562203e78200 2024-09-10T05:12:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.442+0000 7f0905ffb640 1 -- 172.21.15.192:0/2817349126 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0a10058070 con 0x562203e78200 2024-09-10T05:12:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.442+0000 7f0905ffb640 1 --2- 172.21.15.192:0/2817349126 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f08f803c780 0x7f08f803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.442+0000 7f0905ffb640 1 -- 172.21.15.192:0/2817349126 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f0a10099020 con 0x562203e78200 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.442+0000 7f0a1fa00640 1 --2- 172.21.15.192:0/2817349126 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f08f803c780 0x7f08f803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.442+0000 7f0a22717800 1 Processor -- start 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.442+0000 7f0a22717800 1 -- start start 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.442+0000 7f0a1fa00640 1 --2- 172.21.15.192:0/2817349126 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f08f803c780 0x7f08f803ec40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x562203e5b5f0 tx=0x7f0a14006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.443+0000 7f0a22717800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 0x562203e84e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.443+0000 7f0a22717800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562203e52f90 con 0x562203e84a70 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.443+0000 7f0a20201640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 0x562203e84e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.443+0000 7f0a20201640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 0x562203e84e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42320/0 (socket says 172.21.15.192:42320) 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.443+0000 7f0a20201640 1 -- 172.21.15.192:0/2914000198 learned_addr learned my addr 172.21.15.192:0/2914000198 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.443+0000 7f0a20201640 1 -- 172.21.15.192:0/2914000198 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562203e85440 con 0x562203e84a70 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.443+0000 7f0a20201640 1 --2- 172.21.15.192:0/2914000198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 0x562203e84e50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0a10070fb0 tx=0x7f0a10087f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e69d4c3d27923b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.443+0000 7f08ff7fe640 1 -- 172.21.15.192:0/2914000198 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a100968e0 con 0x562203e84a70 2024-09-10T05:12:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.443+0000 7f08ff7fe640 1 -- 172.21.15.192:0/2914000198 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10082d50 con 0x562203e84a70 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.443+0000 7f08ff7fe640 1 -- 172.21.15.192:0/2914000198 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10064700 con 0x562203e84a70 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.444+0000 7f0a22717800 1 -- 172.21.15.192:0/2914000198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 msgr2=0x562203e84e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.444+0000 7f0a22717800 1 --2- 172.21.15.192:0/2914000198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 0x562203e84e50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0a10070fb0 tx=0x7f0a10087f10 comp rx=0 tx=0).stop 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.444+0000 7f0a22717800 1 -- 172.21.15.192:0/2914000198 shutdown_connections 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.444+0000 7f0a22717800 1 --2- 172.21.15.192:0/2914000198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 0x562203e84e50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.444+0000 7f0a22717800 1 -- 172.21.15.192:0/2914000198 >> 172.21.15.192:0/2914000198 conn(0x562203e80e70 msgr2=0x562203e7f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.444+0000 7f0a22717800 1 -- 172.21.15.192:0/2914000198 shutdown_connections 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.444+0000 7f0a22717800 1 -- 172.21.15.192:0/2914000198 wait complete. 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.444+0000 7f0a22717800 1 Processor -- start 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.444+0000 7f0a22717800 1 -- start start 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.444+0000 7f0a22717800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 0x562203e8bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.444+0000 7f0a22717800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562203e858d0 con 0x562203e84a70 2024-09-10T05:12:45.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.445+0000 7f0a20201640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 0x562203e8bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.445+0000 7f0a20201640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 0x562203e8bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42322/0 (socket says 172.21.15.192:42322) 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.445+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 learned_addr learned my addr 172.21.15.192:0/4193066387 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.445+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562203e8c450 con 0x562203e84a70 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.445+0000 7f0a20201640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 0x562203e8bef0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0a10070fb0 tx=0x7f0a1007a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.445+0000 7f08fdffb640 1 -- 172.21.15.192:0/4193066387 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10078450 con 0x562203e84a70 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.445+0000 7f08fdffb640 1 -- 172.21.15.192:0/4193066387 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a100645d0 con 0x562203e84a70 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.445+0000 7f08fdffb640 1 -- 172.21.15.192:0/4193066387 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a100785f0 con 0x562203e84a70 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.445+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562203e8c450 con 0x562203e84a70 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.445+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562203e8c450 con 0x562203e84a70 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.446+0000 7f08fdffb640 1 -- 172.21.15.192:0/4193066387 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0a100b1040 con 0x562203e84a70 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.446+0000 7f08fdffb640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f08f003c730 0x7f08f003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.446+0000 7f08fdffb640 1 -- 172.21.15.192:0/4193066387 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f0a100af020 con 0x562203e84a70 2024-09-10T05:12:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.446+0000 7f0a22717800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.446+0000 7f0a1fa00640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f08f003c730 0x7f08f003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.447+0000 7f0a22717800 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562203e97470 0x562203e99900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.447+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e9a050 con 0x562203e97470 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.447+0000 7f0a20a02640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562203e97470 0x562203e99900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.447+0000 7f0a1fa00640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f08f003c730 0x7f08f003ebf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400bf70 tx=0x7f0a14011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.447+0000 7f0a20a02640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562203e97470 0x562203e99900 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.447+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.447+0000 7f0a22717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.447+0000 7f0a22717800 20 realm 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.447+0000 7f0a22717800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.447+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e9a460 con 0x562203e97470 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.447+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a22717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a22717800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a22717800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e9ad30 con 0x562203e97470 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a22717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a22717800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e97470 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a22717800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a22717800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a22717800 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562203e9bbc0 0x562203e9dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e9e6f0 con 0x562203e9bbc0 2024-09-10T05:12:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.448+0000 7f0a20201640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562203e9bbc0 0x562203e9dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.449+0000 7f0a20201640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562203e9bbc0 0x562203e9dfb0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.449+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.449+0000 7f0a22717800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.449+0000 7f0a22717800 20 searching for the correct realm 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.449+0000 7f0a22717800 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562203ea0790 0x562203ea2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.449+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203ea3320 con 0x562203ea0790 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.449+0000 7f0a1fa00640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562203ea0790 0x562203ea2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.449+0000 7f0a1fa00640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562203ea0790 0x562203ea2c50 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.449+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.450+0000 7f0a1fa00640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0a140393c0 0x7f0a140397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.450+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203ea3320 con 0x7f0a140393c0 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.450+0000 7f0a20a02640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0a140393c0 0x7f0a140397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.450+0000 7f0a20a02640 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0a140393c0 0x7f0a140397e0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.450+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.450+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e9bbc0 2024-09-10T05:12:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.451+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.451+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e97470 2024-09-10T05:12:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.451+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.451+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e97470 2024-09-10T05:12:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.451+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.451+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e9bbc0 2024-09-10T05:12:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.451+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.451+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e9bbc0 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.452+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.452+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x7f0a140393c0 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.452+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.452+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203ea0790 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.452+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.452+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e97470 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.452+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.452+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e9bbc0 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.453+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.453+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e97470 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.453+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.453+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x7f0a140393c0 2024-09-10T05:12:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.453+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.453+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203ea0790 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.453+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.453+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203ea0790 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.454+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.454+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e9bbc0 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.454+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.454+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203ea0790 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.454+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.454+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203ea0790 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.454+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.454+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e97470 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.455+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.455+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e97470 2024-09-10T05:12:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.455+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.455+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x7f0a140393c0 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.455+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.455+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203ea0790 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.455+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.455+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x7f0a140393c0 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.455+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.455+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e97470 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.456+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.456+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e9bbc0 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.456+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.456+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203ea0790 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.456+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.456+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e9bbc0 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.457+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.457+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x7f0a140393c0 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.457+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.457+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203ea0790 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.457+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.457+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x7f0a140393c0 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.457+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.457+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x562203e97470 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.457+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.457+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562203e9b0d0 con 0x7f0a140393c0 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:45.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:45.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:45.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:45.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:45.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:45.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e9f090 con 0x562203e97470 2024-09-10T05:12:45.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e9f090 con 0x562203e97470 2024-09-10T05:12:45.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:45.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e9f040 con 0x7f0a140393c0 2024-09-10T05:12:45.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.458+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:45.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 20 zone default found 2024-09-10T05:12:45.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 4 Realm: () 2024-09-10T05:12:45.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:45.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:45.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:45.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 20 zonegroup default 2024-09-10T05:12:45.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203e9f480 con 0x562203e9bbc0 2024-09-10T05:12:45.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ea5190 con 0x562203ea0790 2024-09-10T05:12:45.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ea5530 con 0x562203ea0790 2024-09-10T05:12:45.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 20 started sync module instance, tier type = 2024-09-10T05:12:45.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:45.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.459+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea4630 con 0x7f0a140393c0 2024-09-10T05:12:45.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.460+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.460+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94704094562848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea4630 con 0x7f0a140393c0 2024-09-10T05:12:45.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.460+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea5d80 con 0x562203e97470 2024-09-10T05:12:45.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.462+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94704094562848] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.462+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.462+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94704094561120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea5d80 con 0x562203e97470 2024-09-10T05:12:45.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.462+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea6740 con 0x562203ea0790 2024-09-10T05:12:45.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.463+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94704094561120] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.463+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.463+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94704094566608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea5cf0 con 0x562203ea0790 2024-09-10T05:12:45.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.463+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea7600 con 0x7f0a140393c0 2024-09-10T05:12:45.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.464+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.464+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94704094573360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea7da0 con 0x7f0a140393c0 2024-09-10T05:12:45.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.465+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea88c0 con 0x562203e97470 2024-09-10T05:12:45.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.465+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94704094566608] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.466+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.466+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94704094577552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea8880 con 0x562203e97470 2024-09-10T05:12:45.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.466+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea92d0 con 0x562203e9bbc0 2024-09-10T05:12:45.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.466+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94704094573360] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.467+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.467+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94704094580256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea9670 con 0x562203e9bbc0 2024-09-10T05:12:45.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.467+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94704094577552] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.467+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea9b80 con 0x562203e9bbc0 2024-09-10T05:12:45.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.468+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.468+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94704094571312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203eaa370 con 0x562203e9bbc0 2024-09-10T05:12:45.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.468+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203eaae90 con 0x562203e9bbc0 2024-09-10T05:12:45.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.468+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94704094580256] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.469+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(58 notify.7 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.469+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94704094587232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203eaae50 con 0x562203e9bbc0 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.469+0000 7f0a22717800 20 add_watcher() i=0 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.469+0000 7f0a22717800 20 add_watcher() i=1 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.469+0000 7f0a22717800 20 add_watcher() i=2 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.469+0000 7f0a22717800 20 add_watcher() i=3 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.469+0000 7f0a22717800 20 add_watcher() i=4 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.469+0000 7f0a22717800 20 add_watcher() i=5 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.469+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94704094571312] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.469+0000 7f0a22717800 20 add_watcher() i=6 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.470+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94704094587232] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.470+0000 7f0a22717800 20 add_watcher() i=7 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.470+0000 7f0a22717800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:45.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.470+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ea9e00 con 0x562203e97470 2024-09-10T05:12:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.470+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.470+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94704094574576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ea9dc0 con 0x562203e97470 2024-09-10T05:12:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.471+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94704094574576] v37'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.472+0000 7f08d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.472+0000 7f0a22717800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.472+0000 7f0a22717800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.472+0000 7f0a22717800 5 note: GC not initialized 2024-09-10T05:12:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.472+0000 7f08d57e2640 20 reqs_thread_entry: start 2024-09-10T05:12:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.472+0000 7f0a22717800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.472+0000 7f0a22717800 20 Filter name: none 2024-09-10T05:12:45.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.472+0000 7f0846ffd640 20 reqs_thread_entry: start 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.472+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee1400 con 0x562203e97470 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.472+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.472+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee1400 con 0x7f0a140393c0 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.473+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.473+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee13c0 con 0x562203e97470 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.473+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.473+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee13c0 con 0x562203ea0790 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.473+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.473+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee18c0 con 0x562203ea0790 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.473+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.473+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee18c0 con 0x562203ea0790 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.474+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.474+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee1880 con 0x562203e97470 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.474+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.474+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee17e0 con 0x562203e97470 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.474+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.474+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee17c0 con 0x562203ea0790 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.474+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.474+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee1780 con 0x562203ea0790 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.474+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.474+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee1780 con 0x562203e9bbc0 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.475+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.475+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203e97470 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.475+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.475+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x7f0a140393c0 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.475+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.475+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203ea0790 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.475+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.475+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203e9bbc0 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.476+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.476+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203e9bbc0 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.476+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.476+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203ea0790 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.476+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.476+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203e9bbc0 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.477+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.477+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203e97470 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.477+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.477+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203ea0790 2024-09-10T05:12:45.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.477+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.477+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203e9bbc0 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.477+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.477+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x7f0a140393c0 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.477+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.477+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203e9bbc0 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.478+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.478+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203e97470 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.478+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.478+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203e97470 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.478+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.478+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203ea0790 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.478+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.478+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203e97470 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.478+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.478+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203e97470 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.479+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.479+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203ea0790 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.479+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.479+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203ea0790 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.479+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.479+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203ea0790 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.479+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.479+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562203ee0e10 con 0x562203e9bbc0 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.479+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.480+0000 7f08d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:45.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.480+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94704094574576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ede810 con 0x562203e97470 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.481+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94704094574576] v37'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.481+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94704094562848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ede810 con 0x7f0a140393c0 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.482+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94704094562848] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.482+0000 7f0a22717800 20 remove_watcher() i=0 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.482+0000 7f0a22717800 2 removed watcher, disabling cache 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.482+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94704094561120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ede810 con 0x562203e97470 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.483+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94704094561120] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.483+0000 7f0a22717800 20 remove_watcher() i=1 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.483+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94704094566608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ede810 con 0x562203ea0790 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.484+0000 7f0a1fa00640 1 -- 172.21.15.192:0/4193066387 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94704094566608] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a14036040 con 0x562203ea0790 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.484+0000 7f0a22717800 20 remove_watcher() i=2 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.484+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94704094573360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ede810 con 0x7f0a140393c0 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.485+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94704094573360] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x7f0a140393c0 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.485+0000 7f0a22717800 20 remove_watcher() i=3 2024-09-10T05:12:45.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.485+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94704094577552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ede810 con 0x562203e97470 2024-09-10T05:12:45.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.486+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94704094577552] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4d0 con 0x562203e97470 2024-09-10T05:12:45.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.487+0000 7f0a22717800 20 remove_watcher() i=4 2024-09-10T05:12:45.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.487+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94704094580256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ede810 con 0x562203e9bbc0 2024-09-10T05:12:45.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.488+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94704094580256] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.488+0000 7f0a22717800 20 remove_watcher() i=5 2024-09-10T05:12:45.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.488+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94704094571312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ede810 con 0x562203e9bbc0 2024-09-10T05:12:45.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.488+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94704094571312] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.489+0000 7f0a22717800 20 remove_watcher() i=6 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.489+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94704094587232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562203ede810 con 0x562203e9bbc0 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a20201640 1 -- 172.21.15.192:0/4193066387 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94704094587232] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a100a8030 con 0x562203e9bbc0 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 20 remove_watcher() i=7 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562203e9bbc0 msgr2=0x562203e9dfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562203e9bbc0 0x562203e9dfb0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562203e97470 msgr2=0x562203e99900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562203e97470 0x562203e99900 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0a140393c0 msgr2=0x7f0a140397e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0a140393c0 0x7f0a140397e0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562203ea0790 msgr2=0x562203ea2c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562203ea0790 0x562203ea2c50 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f08f003c730 msgr2=0x7f08f003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f08f003c730 0x7f08f003ebf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400bf70 tx=0x7f0a14011000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 msgr2=0x562203e8bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 --2- 172.21.15.192:0/4193066387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e84a70 0x562203e8bef0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0a10070fb0 tx=0x7f0a1007a8f0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 reap_dead start 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a20a02640 1 -- 172.21.15.192:0/4193066387 reap_dead start 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 shutdown_connections 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 >> 172.21.15.192:0/4193066387 conn(0x562203e80e70 msgr2=0x562203e7f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 shutdown_connections 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.490+0000 7f0a22717800 1 -- 172.21.15.192:0/4193066387 wait complete. 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2817349126 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f08f803c780 msgr2=0x7f08f803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 --2- 172.21.15.192:0/2817349126 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f08f803c780 0x7f08f803ec40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x562203e5b5f0 tx=0x7f0a14006000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2817349126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e78200 msgr2=0x562203e78620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 --2- 172.21.15.192:0/2817349126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e78200 0x562203e78620 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0a10076750 tx=0x7f0a1005ae90 comp rx=0 tx=0).stop 2024-09-10T05:12:45.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2817349126 shutdown_connections 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 --2- 172.21.15.192:0/2817349126 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f08f803c780 0x7f08f803ec40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 --2- 172.21.15.192:0/2817349126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203e78200 0x562203e78620 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2817349126 >> 172.21.15.192:0/2817349126 conn(0x562203e6c5b0 msgr2=0x562203e6c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2817349126 shutdown_connections 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2817349126 wait complete. 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562203e63bd0 msgr2=0x562203e65fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562203e63bd0 0x562203e65fc0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562203d5fdd0 msgr2=0x562203e61580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562203d5fdd0 0x562203e61580 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562203e67a70 msgr2=0x562203e69e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562203e67a70 0x562203e69e60 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f090803c730 msgr2=0x7f090803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f090803c730 0x7f090803ebf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0a14001e50 tx=0x7f0a140013d0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 msgr2=0x562203e59f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 --2- 172.21.15.192:0/2043794843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562203d5f490 0x562203e59f30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0a10025da0 tx=0x7f0a10002fb0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a20a02640 1 -- 172.21.15.192:0/2043794843 reap_dead start 2024-09-10T05:12:45.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 shutdown_connections 2024-09-10T05:12:45.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 >> 172.21.15.192:0/2043794843 conn(0x562203d5b1e0 msgr2=0x562203e4c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 shutdown_connections 2024-09-10T05:12:45.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.491+0000 7f0a22717800 1 -- 172.21.15.192:0/2043794843 wait complete. 2024-09-10T05:12:45.504 INFO:teuthology.orchestra.run.smithi192.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:12:45.504 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:12:45.504 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-10T05:12:45.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-10T05:12:45.505 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-10T05:12:45.588 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:45.588 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:45.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.588+0000 7fe650887800 1 Processor -- start 2024-09-10T05:12:45.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.588+0000 7fe650887800 1 -- start start 2024-09-10T05:12:45.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.588+0000 7fe650887800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a937858600 0x55a93785a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.588+0000 7fe650887800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a937701e40 con 0x55a93785b020 2024-09-10T05:12:45.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.588+0000 7fe650887800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55a9376cc680 con 0x55a937858600 2024-09-10T05:12:45.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.588+0000 7fe64e371640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a937858600 0x55a93785a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.588+0000 7fe647fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55a93785b020 0x55a93785d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:34200/0 (socket says 172.21.15.192:34200) 2024-09-10T05:12:45.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.588+0000 7fe647fff640 1 -- 172.21.15.192:0/3874921935 learned_addr learned my addr 172.21.15.192:0/3874921935 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:45.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.589+0000 7fe64e371640 1 -- 172.21.15.192:0/3874921935 >> v1:172.21.15.139:6789/0 conn(0x55a93785b020 legacy=0x55a93785d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.589+0000 7fe64e371640 1 -- 172.21.15.192:0/3874921935 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9376e86b0 con 0x55a937858600 2024-09-10T05:12:45.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.590+0000 7fe64e371640 1 --2- 172.21.15.192:0/3874921935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a93785a9f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe64000a470 tx=0x7fe640045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fdd4f1f557bb23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.591+0000 7fe64db70640 1 -- 172.21.15.192:0/3874921935 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe640053570 con 0x55a937858600 2024-09-10T05:12:45.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.591+0000 7fe64db70640 1 -- 172.21.15.192:0/3874921935 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe640058070 con 0x55a937858600 2024-09-10T05:12:45.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.591+0000 7fe64db70640 1 -- 172.21.15.192:0/3874921935 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe640053880 con 0x55a937858600 2024-09-10T05:12:45.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.591+0000 7fe650887800 1 -- 172.21.15.192:0/3874921935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 msgr2=0x55a93785a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.591+0000 7fe650887800 1 --2- 172.21.15.192:0/3874921935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a93785a9f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe64000a470 tx=0x7fe640045a20 comp rx=0 tx=0).stop 2024-09-10T05:12:45.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.591+0000 7fe650887800 1 -- 172.21.15.192:0/3874921935 shutdown_connections 2024-09-10T05:12:45.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.591+0000 7fe650887800 1 --2- 172.21.15.192:0/3874921935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a93785a9f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.591+0000 7fe650887800 1 -- 172.21.15.192:0/3874921935 >> 172.21.15.192:0/3874921935 conn(0x55a9378521c0 msgr2=0x55a937854620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.591+0000 7fe650887800 1 -- 172.21.15.192:0/3874921935 shutdown_connections 2024-09-10T05:12:45.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.591+0000 7fe650887800 1 -- 172.21.15.192:0/3874921935 wait complete. 2024-09-10T05:12:45.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.605+0000 7fe650887800 1 Processor -- start 2024-09-10T05:12:45.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.605+0000 7fe650887800 1 -- start start 2024-09-10T05:12:45.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.605+0000 7fe650887800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a9379476a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.605+0000 7fe650887800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a9376f0dd0 con 0x55a937858600 2024-09-10T05:12:45.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.606+0000 7fe64e371640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a9379476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.606+0000 7fe64e371640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a9379476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42332/0 (socket says 172.21.15.192:42332) 2024-09-10T05:12:45.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.606+0000 7fe64e371640 1 -- 172.21.15.192:0/3956087443 learned_addr learned my addr 172.21.15.192:0/3956087443 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.606+0000 7fe64e371640 1 -- 172.21.15.192:0/3956087443 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a937709e10 con 0x55a937858600 2024-09-10T05:12:45.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.606+0000 7fe64e371640 1 --2- 172.21.15.192:0/3956087443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a9379476a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe640025c20 tx=0x7fe640051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ec84cd5e54eaa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.606+0000 7fe53c608640 1 -- 172.21.15.192:0/3956087443 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe640053570 con 0x55a937858600 2024-09-10T05:12:45.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.606+0000 7fe53c608640 1 -- 172.21.15.192:0/3956087443 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe640063070 con 0x55a937858600 2024-09-10T05:12:45.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.606+0000 7fe53c608640 1 -- 172.21.15.192:0/3956087443 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe640053840 con 0x55a937858600 2024-09-10T05:12:45.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.607+0000 7fe650887800 1 -- 172.21.15.192:0/3956087443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 msgr2=0x55a9379476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.607+0000 7fe650887800 1 --2- 172.21.15.192:0/3956087443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a9379476a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe640025c20 tx=0x7fe640051000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.607+0000 7fe650887800 1 -- 172.21.15.192:0/3956087443 shutdown_connections 2024-09-10T05:12:45.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.607+0000 7fe650887800 1 --2- 172.21.15.192:0/3956087443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a9379476a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.607+0000 7fe650887800 1 -- 172.21.15.192:0/3956087443 >> 172.21.15.192:0/3956087443 conn(0x55a9378521c0 msgr2=0x55a937943020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.607+0000 7fe650887800 1 -- 172.21.15.192:0/3956087443 shutdown_connections 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.607+0000 7fe650887800 1 -- 172.21.15.192:0/3956087443 wait complete. 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.607+0000 7fe650887800 1 Processor -- start 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.607+0000 7fe650887800 1 -- start start 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.607+0000 7fe650887800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a937857d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.607+0000 7fe650887800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a93785f040 con 0x55a937858600 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.608+0000 7fe64e371640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a937857d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.608+0000 7fe64e371640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a937857d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42338/0 (socket says 172.21.15.192:42338) 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.608+0000 7fe64e371640 1 -- 172.21.15.192:0/3625127648 learned_addr learned my addr 172.21.15.192:0/3625127648 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.608+0000 7fe64e371640 1 -- 172.21.15.192:0/3625127648 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a937858280 con 0x55a937858600 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.608+0000 7fe64e371640 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a937857d20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe640053d60 tx=0x7fe640002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.608+0000 7fe53ae05640 1 -- 172.21.15.192:0/3625127648 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe640068470 con 0x55a937858600 2024-09-10T05:12:45.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.608+0000 7fe53ae05640 1 -- 172.21.15.192:0/3625127648 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe640068610 con 0x55a937858600 2024-09-10T05:12:45.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.608+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a937856630 con 0x55a937858600 2024-09-10T05:12:45.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.608+0000 7fe53ae05640 1 -- 172.21.15.192:0/3625127648 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6400688f0 con 0x55a937858600 2024-09-10T05:12:45.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.608+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a937856bf0 con 0x55a937858600 2024-09-10T05:12:45.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.609+0000 7fe53ae05640 1 -- 172.21.15.192:0/3625127648 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe640068a90 con 0x55a937858600 2024-09-10T05:12:45.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.609+0000 7fe53ae05640 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe53403c730 0x7fe53403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.610+0000 7fe647fff640 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe53403c730 0x7fe53403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.610+0000 7fe53ae05640 1 -- 172.21.15.192:0/3625127648 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe640097f30 con 0x55a937858600 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.610+0000 7fe650887800 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a93785b020 0x55a9379583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.610+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a937958920 con 0x55a93785b020 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.610+0000 7fe64eb72640 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a93785b020 0x55a9379583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.610+0000 7fe647fff640 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe53403c730 0x7fe53403ebf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe638001d70 tx=0x7fe6380012d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.610+0000 7fe64eb72640 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a93785b020 0x55a9379583e0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.610+0000 7fe64eb72640 1 -- 172.21.15.192:0/3625127648 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93785b020 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.610+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a9378570e0 con 0x55a93785b020 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.611+0000 7fe64eb72640 1 -- 172.21.15.192:0/3625127648 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93785b020 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.611+0000 7fe650887800 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a93795abe0 0x55a93795cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.611+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a93795d6a0 con 0x55a93795abe0 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.611+0000 7fe64e371640 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a93795abe0 0x55a93795cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.611+0000 7fe64e371640 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a93795abe0 0x55a93795cfd0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.612+0000 7fe64e371640 1 -- 172.21.15.192:0/3625127648 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe640079020 con 0x55a93795abe0 2024-09-10T05:12:45.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.612+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a9379599f0 con 0x55a93785b020 2024-09-10T05:12:45.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.612+0000 7fe64eb72640 1 -- 172.21.15.192:0/3625127648 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93785b020 2024-09-10T05:12:45.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.612+0000 7fe650887800 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a93795eae0 0x55a937960ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.612+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a937961530 con 0x55a93795eae0 2024-09-10T05:12:45.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.612+0000 7fe647fff640 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a93795eae0 0x55a937960ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.613+0000 7fe647fff640 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a93795eae0 0x55a937960ed0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.613+0000 7fe647fff640 1 -- 172.21.15.192:0/3625127648 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe638009050 con 0x55a93795eae0 2024-09-10T05:12:45.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.613+0000 7fe650887800 1 Processor -- start 2024-09-10T05:12:45.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.613+0000 7fe650887800 1 -- start start 2024-09-10T05:12:45.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.613+0000 7fe650887800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93796f190 0x55a93796f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.613+0000 7fe650887800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a93774ea00 con 0x55a93796f190 2024-09-10T05:12:45.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.614+0000 7fe64e371640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93796f190 0x55a93796f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.614+0000 7fe64e371640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93796f190 0x55a93796f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42350/0 (socket says 172.21.15.192:42350) 2024-09-10T05:12:45.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.614+0000 7fe64e371640 1 -- 172.21.15.192:0/2477131971 learned_addr learned my addr 172.21.15.192:0/2477131971 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.614+0000 7fe64e371640 1 -- 172.21.15.192:0/2477131971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a93796fbf0 con 0x55a93796f190 2024-09-10T05:12:45.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.614+0000 7fe64e371640 1 --2- 172.21.15.192:0/2477131971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93796f190 0x55a93796f5b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe6400962a0 tx=0x7fe640085390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.614+0000 7fe533fff640 1 -- 172.21.15.192:0/2477131971 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe64005ce30 con 0x55a93796f190 2024-09-10T05:12:45.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.614+0000 7fe533fff640 1 -- 172.21.15.192:0/2477131971 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe64005c410 con 0x55a93796f190 2024-09-10T05:12:45.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.614+0000 7fe533fff640 1 -- 172.21.15.192:0/2477131971 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe64005c6f0 con 0x55a93796f190 2024-09-10T05:12:45.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.614+0000 7fe650887800 1 -- 172.21.15.192:0/2477131971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a937970420 con 0x55a93796f190 2024-09-10T05:12:45.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.614+0000 7fe650887800 1 -- 172.21.15.192:0/2477131971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9379709c0 con 0x55a93796f190 2024-09-10T05:12:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.615+0000 7fe533fff640 1 -- 172.21.15.192:0/2477131971 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe64007c440 con 0x55a93796f190 2024-09-10T05:12:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.615+0000 7fe533fff640 1 --2- 172.21.15.192:0/2477131971 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe52803c780 0x7fe52803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.615+0000 7fe533fff640 1 -- 172.21.15.192:0/2477131971 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe64008d070 con 0x55a93796f190 2024-09-10T05:12:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.615+0000 7fe647fff640 1 --2- 172.21.15.192:0/2477131971 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe52803c780 0x7fe52803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.616+0000 7fe650887800 1 Processor -- start 2024-09-10T05:12:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.616+0000 7fe650887800 1 -- start start 2024-09-10T05:12:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.616+0000 7fe647fff640 1 --2- 172.21.15.192:0/2477131971 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe52803c780 0x7fe52803ec40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe63800bf40 tx=0x7fe63800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.616+0000 7fe650887800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 0x55a93797bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.616+0000 7fe650887800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a937947e90 con 0x55a93797ba10 2024-09-10T05:12:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.616+0000 7fe64e371640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 0x55a93797bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.616+0000 7fe64e371640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 0x55a93797bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42360/0 (socket says 172.21.15.192:42360) 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.616+0000 7fe64e371640 1 -- 172.21.15.192:0/1574090220 learned_addr learned my addr 172.21.15.192:0/1574090220 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.616+0000 7fe64e371640 1 -- 172.21.15.192:0/1574090220 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a93797c3e0 con 0x55a93797ba10 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.617+0000 7fe64e371640 1 --2- 172.21.15.192:0/1574090220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 0x55a93797bdf0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe6400962d0 tx=0x7fe64009ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ed38fc58bd72c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.617+0000 7fe531ffb640 1 -- 172.21.15.192:0/1574090220 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6400a9020 con 0x55a93797ba10 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.617+0000 7fe531ffb640 1 -- 172.21.15.192:0/1574090220 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe64005ee00 con 0x55a93797ba10 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.617+0000 7fe531ffb640 1 -- 172.21.15.192:0/1574090220 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe640088180 con 0x55a93797ba10 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.617+0000 7fe650887800 1 -- 172.21.15.192:0/1574090220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 msgr2=0x55a93797bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.617+0000 7fe650887800 1 --2- 172.21.15.192:0/1574090220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 0x55a93797bdf0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe6400962d0 tx=0x7fe64009ac90 comp rx=0 tx=0).stop 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.617+0000 7fe650887800 1 -- 172.21.15.192:0/1574090220 shutdown_connections 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.617+0000 7fe650887800 1 --2- 172.21.15.192:0/1574090220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 0x55a93797bdf0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.617+0000 7fe650887800 1 -- 172.21.15.192:0/1574090220 >> 172.21.15.192:0/1574090220 conn(0x55a937977e10 msgr2=0x55a937976050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.617+0000 7fe650887800 1 -- 172.21.15.192:0/1574090220 shutdown_connections 2024-09-10T05:12:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.617+0000 7fe650887800 1 -- 172.21.15.192:0/1574090220 wait complete. 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.617+0000 7fe650887800 1 Processor -- start 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.618+0000 7fe650887800 1 -- start start 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.618+0000 7fe650887800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 0x55a937982d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.618+0000 7fe650887800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a93797c870 con 0x55a93797ba10 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.618+0000 7fe64e371640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 0x55a937982d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.618+0000 7fe64e371640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 0x55a937982d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42370/0 (socket says 172.21.15.192:42370) 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.618+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 learned_addr learned my addr 172.21.15.192:0/3249295031 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.618+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9379832c0 con 0x55a93797ba10 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.618+0000 7fe64e371640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 0x55a937982d60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe640052990 tx=0x7fe64009df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.618+0000 7fe51ffff640 1 -- 172.21.15.192:0/3249295031 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6400be070 con 0x55a93797ba10 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.619+0000 7fe51ffff640 1 -- 172.21.15.192:0/3249295031 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe640074b40 con 0x55a93797ba10 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.619+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9379832c0 con 0x55a93797ba10 2024-09-10T05:12:45.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.619+0000 7fe51ffff640 1 -- 172.21.15.192:0/3249295031 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe640074e20 con 0x55a93797ba10 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.619+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9379832c0 con 0x55a93797ba10 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.619+0000 7fe51ffff640 1 -- 172.21.15.192:0/3249295031 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe6400c1070 con 0x55a93797ba10 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.620+0000 7fe51ffff640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe51803c780 0x7fe51803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.620+0000 7fe51ffff640 1 -- 172.21.15.192:0/3249295031 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe6400b4030 con 0x55a93797ba10 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.620+0000 7fe647fff640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe51803c780 0x7fe51803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.620+0000 7fe650887800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.620+0000 7fe650887800 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a93798e300 0x55a937990770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.620+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a937990ec0 con 0x55a93798e300 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.620+0000 7fe64eb72640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a93798e300 0x55a937990770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.620+0000 7fe647fff640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe51803c780 0x7fe51803ec40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe63800c010 tx=0x7fe638010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.620+0000 7fe64eb72640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a93798e300 0x55a937990770 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 20 realm 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a9379912d0 con 0x55a93798e300 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a937991ba0 con 0x55a93798e300 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a937991f40 con 0x55a93798e300 2024-09-10T05:12:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a937992a30 0x55a937994e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.621+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937992a30 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.622+0000 7fe64e371640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a937992a30 0x55a937994e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.622+0000 7fe64e371640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a937992a30 0x55a937994e20 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.622+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.622+0000 7fe650887800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.622+0000 7fe650887800 20 searching for the correct realm 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.622+0000 7fe650887800 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a937997600 0x55a937999ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.622+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a93799a190 con 0x55a937997600 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.622+0000 7fe647fff640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a937997600 0x55a937999ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.623+0000 7fe647fff640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a937997600 0x55a937999ac0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.623+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.623+0000 7fe647fff640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe638037040 0x7fe638036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.623+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a93799a190 con 0x7fe638037040 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.623+0000 7fe64eb72640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe638037040 0x7fe638036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.623+0000 7fe64eb72640 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe638037040 0x7fe638036410 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.624+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.624+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a93799a190 con 0x55a937992a30 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.624+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.624+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a93798e300 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.624+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.624+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a93798e300 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.624+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.624+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937992a30 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.625+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.625+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937992a30 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.625+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.625+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x7fe638037040 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.625+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.625+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937997600 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.625+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.625+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a93798e300 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.626+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.626+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937992a30 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.626+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.626+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a93798e300 2024-09-10T05:12:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.626+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.626+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x7fe638037040 2024-09-10T05:12:45.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.626+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.626+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937997600 2024-09-10T05:12:45.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.627+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.627+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937997600 2024-09-10T05:12:45.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.627+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.627+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937992a30 2024-09-10T05:12:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.627+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.627+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937997600 2024-09-10T05:12:45.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.628+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.628+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937997600 2024-09-10T05:12:45.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.628+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.628+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a93798e300 2024-09-10T05:12:45.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.628+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.628+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a93798e300 2024-09-10T05:12:45.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.628+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.628+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x7fe638037040 2024-09-10T05:12:45.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.628+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.628+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937997600 2024-09-10T05:12:45.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.629+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.629+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x7fe638037040 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.629+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.629+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a93798e300 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.629+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.629+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937992a30 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.629+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.629+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937997600 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.630+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.630+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937992a30 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.630+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.630+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x7fe638037040 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.630+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.630+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a937997600 2024-09-10T05:12:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.630+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.630+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x7fe638037040 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x55a93798e300 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a937995560 con 0x7fe638037040 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe650887800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe650887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe650887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe650887800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe650887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe650887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe650887800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a937995f00 con 0x55a93798e300 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe650887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe650887800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.631+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a937995f00 con 0x55a93798e300 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a937995eb0 con 0x7fe638037040 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 20 zone default found 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 4 Realm: () 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:45.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 20 zonegroup default 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a9379962f0 con 0x55a937992a30 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a937995c40 con 0x55a937997600 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.632+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a93799c000 con 0x55a937997600 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.633+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.633+0000 7fe650887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.633+0000 7fe650887800 20 started sync module instance, tier type = 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.633+0000 7fe650887800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.633+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799b4a0 con 0x7fe638037040 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.634+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.634+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94185270655472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799b4a0 con 0x7fe638037040 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.634+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799ca60 con 0x55a93798e300 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.635+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94185270655472] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.635+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.635+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94185270658368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799b4a0 con 0x55a93798e300 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.635+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799d470 con 0x55a937997600 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.636+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94185270658368] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.637+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.637+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94185270652912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799b410 con 0x55a937997600 2024-09-10T05:12:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.637+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799e1b0 con 0x7fe638037040 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.638+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.638+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94185270652912] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.638+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94185270664384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799ea50 con 0x7fe638037040 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.638+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799d830 con 0x55a93798e300 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.638+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94185270664384] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.639+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.639+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94185270666416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799efe0 con 0x55a93798e300 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.639+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799f9a0 con 0x55a937992a30 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.640+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.640+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94185270666416] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.640+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94185270667472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799f9a0 con 0x55a937992a30 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.640+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a9379a03f0 con 0x55a937992a30 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.641+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94185270667472] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.642+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.642+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94185270673152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a9379a05d0 con 0x55a937992a30 2024-09-10T05:12:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.642+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a9379a0e60 con 0x55a937992a30 2024-09-10T05:12:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.642+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94185270673152] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.643+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.643+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94185270670576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a9379a1040 con 0x55a937992a30 2024-09-10T05:12:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.643+0000 7fe650887800 20 add_watcher() i=0 2024-09-10T05:12:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.643+0000 7fe650887800 20 add_watcher() i=1 2024-09-10T05:12:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.643+0000 7fe650887800 20 add_watcher() i=2 2024-09-10T05:12:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.643+0000 7fe650887800 20 add_watcher() i=3 2024-09-10T05:12:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.643+0000 7fe650887800 20 add_watcher() i=4 2024-09-10T05:12:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.643+0000 7fe650887800 20 add_watcher() i=5 2024-09-10T05:12:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.643+0000 7fe650887800 20 add_watcher() i=6 2024-09-10T05:12:45.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.644+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94185270670576] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.644+0000 7fe650887800 20 add_watcher() i=7 2024-09-10T05:12:45.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.644+0000 7fe650887800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:45.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.644+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a9379a4410 con 0x55a93798e300 2024-09-10T05:12:45.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.644+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.644+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94185270677296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a9379a1800 con 0x55a93798e300 2024-09-10T05:12:45.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.645+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94185270677296] v37'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.645+0000 7fe504fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:45.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.645+0000 7fe650887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:45.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.645+0000 7fe650887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:45.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.645+0000 7fe650887800 5 note: GC not initialized 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.645+0000 7fe47f7fe640 20 reqs_thread_entry: start 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.646+0000 7fe650887800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.646+0000 7fe650887800 20 Filter name: none 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.646+0000 7fe47d7fa640 20 reqs_thread_entry: start 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.646+0000 7fe650887800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.646+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a9379d7000 con 0x55a93798e300 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.646+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.646+0000 7fe650887800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.646+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a9379d8420 con 0x55a937992a30 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.647+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.647+0000 7fe504fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.647+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94185270677296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a9379d6920 con 0x55a93798e300 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.648+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94185270677296] v37'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.648+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94185270655472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a9379d6920 con 0x7fe638037040 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.649+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94185270655472] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.649+0000 7fe650887800 20 remove_watcher() i=0 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.649+0000 7fe650887800 2 removed watcher, disabling cache 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.649+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94185270658368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799b9d0 con 0x55a93798e300 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.651+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94185270658368] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.651+0000 7fe650887800 20 remove_watcher() i=1 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.651+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94185270652912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799c540 con 0x55a937997600 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.652+0000 7fe647fff640 1 -- 172.21.15.192:0/3249295031 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94185270652912] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe638009050 con 0x55a937997600 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.652+0000 7fe650887800 20 remove_watcher() i=2 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.652+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94185270664384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799aff0 con 0x7fe638037040 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.653+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94185270664384] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x7fe638037040 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.653+0000 7fe650887800 20 remove_watcher() i=3 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.653+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94185270666416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799aff0 con 0x55a93798e300 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.654+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94185270666416] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe64800a4d0 con 0x55a93798e300 2024-09-10T05:12:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.654+0000 7fe650887800 20 remove_watcher() i=4 2024-09-10T05:12:45.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.654+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94185270667472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799aff0 con 0x55a937992a30 2024-09-10T05:12:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.655+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94185270667472] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.655+0000 7fe650887800 20 remove_watcher() i=5 2024-09-10T05:12:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.655+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94185270673152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799aff0 con 0x55a937992a30 2024-09-10T05:12:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.656+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94185270673152] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.656+0000 7fe650887800 20 remove_watcher() i=6 2024-09-10T05:12:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.656+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94185270670576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a93799aff0 con 0x55a937992a30 2024-09-10T05:12:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe64e371640 1 -- 172.21.15.192:0/3249295031 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94185270670576] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6400c0030 con 0x55a937992a30 2024-09-10T05:12:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 20 remove_watcher() i=7 2024-09-10T05:12:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a937992a30 msgr2=0x55a937994e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a937992a30 0x55a937994e20 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a93798e300 msgr2=0x55a937990770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a93798e300 0x55a937990770 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe638037040 msgr2=0x7fe638036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe638037040 0x7fe638036410 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a937997600 msgr2=0x55a937999ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a937997600 0x55a937999ac0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe51803c780 msgr2=0x7fe51803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe51803c780 0x7fe51803ec40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe63800c010 tx=0x7fe638010000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 msgr2=0x55a937982d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe64eb72640 1 -- 172.21.15.192:0/3249295031 reap_dead start 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.657+0000 7fe650887800 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 0x55a937982d60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe640052990 tx=0x7fe64009df00 comp rx=0 tx=0).stop 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 shutdown_connections 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 --2- 172.21.15.192:0/3249295031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93797ba10 0x55a937982d60 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 >> 172.21.15.192:0/3249295031 conn(0x55a937977e10 msgr2=0x55a937976020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 shutdown_connections 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/3249295031 wait complete. 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/2477131971 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe52803c780 msgr2=0x7fe52803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 --2- 172.21.15.192:0/2477131971 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe52803c780 0x7fe52803ec40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe63800bf40 tx=0x7fe63800f000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/2477131971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93796f190 msgr2=0x55a93796f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 --2- 172.21.15.192:0/2477131971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93796f190 0x55a93796f5b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe6400962a0 tx=0x7fe640085390 comp rx=0 tx=0).stop 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/2477131971 shutdown_connections 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 --2- 172.21.15.192:0/2477131971 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe52803c780 0x7fe52803ec40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 --2- 172.21.15.192:0/2477131971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a93796f190 0x55a93796f5b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/2477131971 >> 172.21.15.192:0/2477131971 conn(0x55a937963540 msgr2=0x55a937963920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/2477131971 shutdown_connections 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/2477131971 wait complete. 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a93795abe0 msgr2=0x55a93795cfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a93795abe0 0x55a93795cfd0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a93785b020 msgr2=0x55a9379583e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a93785b020 0x55a9379583e0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a93795eae0 msgr2=0x55a937960ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a93795eae0 0x55a937960ed0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe53403c730 msgr2=0x7fe53403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe53403c730 0x7fe53403ebf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe638001d70 tx=0x7fe6380012d0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 msgr2=0x55a937857d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 --2- 172.21.15.192:0/3625127648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a937858600 0x55a937857d20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe640053d60 tx=0x7fe640002fb0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe64eb72640 1 -- 172.21.15.192:0/3625127648 reap_dead start 2024-09-10T05:12:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 shutdown_connections 2024-09-10T05:12:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.658+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 >> 172.21.15.192:0/3625127648 conn(0x55a9378521c0 msgr2=0x55a937941810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.659+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 shutdown_connections 2024-09-10T05:12:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.659+0000 7fe650887800 1 -- 172.21.15.192:0/3625127648 wait complete. 2024-09-10T05:12:45.668 INFO:teuthology.orchestra.run.smithi192.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:12:45.668 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:12:45.668 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-10T05:12:45.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-10T05:12:45.668 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-10T05:12:45.714 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:45.714 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:45.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.714+0000 7f1884328800 1 Processor -- start 2024-09-10T05:12:45.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.714+0000 7f1884328800 1 -- start start 2024-09-10T05:12:45.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.714+0000 7f1884328800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55ca2b5d4ff0 0x55ca2b5ddb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.714+0000 7f1884328800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ca2b47ee40 con 0x55ca2b5d34d0 2024-09-10T05:12:45.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.715+0000 7f1884328800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55ca2b449680 con 0x55ca2b5d4ff0 2024-09-10T05:12:45.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.715+0000 7f187f86e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55ca2b5d4ff0 0x55ca2b5ddb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.715+0000 7f188006f640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55ca2b5d34d0 0x55ca2b5d38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:34204/0 (socket says 172.21.15.192:34204) 2024-09-10T05:12:45.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.715+0000 7f187f86e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55ca2b5d4ff0 0x55ca2b5ddb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42376/0 (socket says 172.21.15.192:42376) 2024-09-10T05:12:45.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.715+0000 7f188006f640 1 -- 172.21.15.192:0/1082149574 learned_addr learned my addr 172.21.15.192:0/1082149574 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:45.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.715+0000 7f187f86e640 1 -- 172.21.15.192:0/1082149574 >> v1:172.21.15.139:6789/0 conn(0x55ca2b5d34d0 legacy=0x55ca2b5d38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.715+0000 7f187f86e640 1 -- 172.21.15.192:0/1082149574 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca2b4656b0 con 0x55ca2b5d4ff0 2024-09-10T05:12:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.717+0000 7f187f86e640 1 --2- 172.21.15.192:0/1082149574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d4ff0 0x55ca2b5ddb10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f186800a470 tx=0x7f1868045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b287c3c4146ea6f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.717+0000 7f187f06d640 1 -- 172.21.15.192:0/1082149574 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1868053570 con 0x55ca2b5d4ff0 2024-09-10T05:12:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.717+0000 7f187f06d640 1 -- 172.21.15.192:0/1082149574 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1868058070 con 0x55ca2b5d4ff0 2024-09-10T05:12:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.717+0000 7f187f06d640 1 -- 172.21.15.192:0/1082149574 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1868053880 con 0x55ca2b5d4ff0 2024-09-10T05:12:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.718+0000 7f1884328800 1 -- 172.21.15.192:0/1082149574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d4ff0 msgr2=0x55ca2b5ddb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.718+0000 7f1884328800 1 --2- 172.21.15.192:0/1082149574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d4ff0 0x55ca2b5ddb10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f186800a470 tx=0x7f1868045a20 comp rx=0 tx=0).stop 2024-09-10T05:12:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.718+0000 7f1884328800 1 -- 172.21.15.192:0/1082149574 shutdown_connections 2024-09-10T05:12:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.718+0000 7f1884328800 1 --2- 172.21.15.192:0/1082149574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d4ff0 0x55ca2b5ddb10 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.718+0000 7f1884328800 1 -- 172.21.15.192:0/1082149574 >> 172.21.15.192:0/1082149574 conn(0x55ca2b5cf200 msgr2=0x55ca2b5d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.718+0000 7f1884328800 1 -- 172.21.15.192:0/1082149574 shutdown_connections 2024-09-10T05:12:45.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.718+0000 7f1884328800 1 -- 172.21.15.192:0/1082149574 wait complete. 2024-09-10T05:12:45.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.731+0000 7f1884328800 1 Processor -- start 2024-09-10T05:12:45.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.732+0000 7f1884328800 1 -- start start 2024-09-10T05:12:45.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.732+0000 7f1884328800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 0x55ca2b6c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.732+0000 7f1884328800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ca2b46ddd0 con 0x55ca2b5d34d0 2024-09-10T05:12:45.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.732+0000 7f188006f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 0x55ca2b6c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.732+0000 7f188006f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 0x55ca2b6c6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42390/0 (socket says 172.21.15.192:42390) 2024-09-10T05:12:45.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.732+0000 7f188006f640 1 -- 172.21.15.192:0/1508862315 learned_addr learned my addr 172.21.15.192:0/1508862315 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.732+0000 7f188006f640 1 -- 172.21.15.192:0/1508862315 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca2b486e10 con 0x55ca2b5d34d0 2024-09-10T05:12:45.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.732+0000 7f188006f640 1 --2- 172.21.15.192:0/1508862315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 0x55ca2b6c6890 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1870001800 tx=0x7f1870001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37cb17fb0e3593f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.733+0000 7f176e60c640 1 -- 172.21.15.192:0/1508862315 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1870004520 con 0x55ca2b5d34d0 2024-09-10T05:12:45.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.733+0000 7f176e60c640 1 -- 172.21.15.192:0/1508862315 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18700046c0 con 0x55ca2b5d34d0 2024-09-10T05:12:45.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.733+0000 7f176e60c640 1 -- 172.21.15.192:0/1508862315 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18700049e0 con 0x55ca2b5d34d0 2024-09-10T05:12:45.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.733+0000 7f1884328800 1 -- 172.21.15.192:0/1508862315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 msgr2=0x55ca2b6c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.733+0000 7f1884328800 1 --2- 172.21.15.192:0/1508862315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 0x55ca2b6c6890 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1870001800 tx=0x7f1870001cc0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.733+0000 7f1884328800 1 -- 172.21.15.192:0/1508862315 shutdown_connections 2024-09-10T05:12:45.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.733+0000 7f1884328800 1 --2- 172.21.15.192:0/1508862315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 0x55ca2b6c6890 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.733+0000 7f1884328800 1 -- 172.21.15.192:0/1508862315 >> 172.21.15.192:0/1508862315 conn(0x55ca2b5cf200 msgr2=0x55ca2b6c2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.733+0000 7f1884328800 1 -- 172.21.15.192:0/1508862315 shutdown_connections 2024-09-10T05:12:45.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.733+0000 7f1884328800 1 -- 172.21.15.192:0/1508862315 wait complete. 2024-09-10T05:12:45.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.734+0000 7f1884328800 1 Processor -- start 2024-09-10T05:12:45.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.734+0000 7f1884328800 1 -- start start 2024-09-10T05:12:45.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.734+0000 7f1884328800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 0x55ca2b6ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.734+0000 7f1884328800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ca2b5de350 con 0x55ca2b5d34d0 2024-09-10T05:12:45.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.734+0000 7f188006f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 0x55ca2b6ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.734+0000 7f188006f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 0x55ca2b6ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42396/0 (socket says 172.21.15.192:42396) 2024-09-10T05:12:45.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.734+0000 7f188006f640 1 -- 172.21.15.192:0/777088805 learned_addr learned my addr 172.21.15.192:0/777088805 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.734+0000 7f188006f640 1 -- 172.21.15.192:0/777088805 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca2b6ce740 con 0x55ca2b5d34d0 2024-09-10T05:12:45.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.735+0000 7f188006f640 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 0x55ca2b6ce1e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f18700066b0 tx=0x7f1870001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.735+0000 7f176ce09640 1 -- 172.21.15.192:0/777088805 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1870022020 con 0x55ca2b5d34d0 2024-09-10T05:12:45.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.735+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca2b6ce9d0 con 0x55ca2b5d34d0 2024-09-10T05:12:45.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.735+0000 7f176ce09640 1 -- 172.21.15.192:0/777088805 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18700148c0 con 0x55ca2b5d34d0 2024-09-10T05:12:45.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.735+0000 7f176ce09640 1 -- 172.21.15.192:0/777088805 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1870014be0 con 0x55ca2b5d34d0 2024-09-10T05:12:45.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.735+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca2b6cf3d0 con 0x55ca2b5d34d0 2024-09-10T05:12:45.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.736+0000 7f176ce09640 1 -- 172.21.15.192:0/777088805 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1870025020 con 0x55ca2b5d34d0 2024-09-10T05:12:45.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.736+0000 7f176ce09640 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f176803c730 0x7f176803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.736+0000 7f176ce09640 1 -- 172.21.15.192:0/777088805 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1870018030 con 0x55ca2b5d34d0 2024-09-10T05:12:45.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.736+0000 7f187f86e640 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f176803c730 0x7f176803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.736+0000 7f1884328800 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ca2b5d4ff0 0x55ca2b6d5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.736+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b6d5d70 con 0x55ca2b5d4ff0 2024-09-10T05:12:45.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.736+0000 7f1880870640 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ca2b5d4ff0 0x55ca2b6d5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.736+0000 7f187f86e640 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f176803c730 0x7f176803ebf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1868057000 tx=0x7f1868052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.737+0000 7f1880870640 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ca2b5d4ff0 0x55ca2b6d5830 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.737+0000 7f1880870640 1 -- 172.21.15.192:0/777088805 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18780083e0 con 0x55ca2b5d4ff0 2024-09-10T05:12:45.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.737+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b6d6110 con 0x55ca2b5d4ff0 2024-09-10T05:12:45.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.737+0000 7f1880870640 1 -- 172.21.15.192:0/777088805 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f18780083e0 con 0x55ca2b5d4ff0 2024-09-10T05:12:45.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.737+0000 7f1884328800 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ca2b6d7c50 0x55ca2b6da0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.737+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b6da880 con 0x55ca2b6d7c50 2024-09-10T05:12:45.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.738+0000 7f188006f640 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ca2b6d7c50 0x55ca2b6da0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.738+0000 7f188006f640 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ca2b6d7c50 0x55ca2b6da0f0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.738+0000 7f188006f640 1 -- 172.21.15.192:0/777088805 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f187001b070 con 0x55ca2b6d7c50 2024-09-10T05:12:45.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.738+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b6d6960 con 0x55ca2b5d4ff0 2024-09-10T05:12:45.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.738+0000 7f1880870640 1 -- 172.21.15.192:0/777088805 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f18780083e0 con 0x55ca2b5d4ff0 2024-09-10T05:12:45.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.738+0000 7f1884328800 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ca2b6dbce0 0x55ca2b6de0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.739+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b6de810 con 0x55ca2b6dbce0 2024-09-10T05:12:45.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.739+0000 7f187f86e640 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ca2b6dbce0 0x55ca2b6de0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.739+0000 7f187f86e640 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ca2b6dbce0 0x55ca2b6de0d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.739+0000 7f187f86e640 1 -- 172.21.15.192:0/777088805 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1868051070 con 0x55ca2b6dbce0 2024-09-10T05:12:45.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.740+0000 7f1884328800 1 Processor -- start 2024-09-10T05:12:45.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.740+0000 7f1884328800 1 -- start start 2024-09-10T05:12:45.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.740+0000 7f1884328800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6ec470 0x55ca2b6ec890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.740+0000 7f1884328800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ca2b4cba00 con 0x55ca2b6ec470 2024-09-10T05:12:45.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.740+0000 7f188006f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6ec470 0x55ca2b6ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.740+0000 7f188006f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6ec470 0x55ca2b6ec890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42406/0 (socket says 172.21.15.192:42406) 2024-09-10T05:12:45.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.740+0000 7f188006f640 1 -- 172.21.15.192:0/1077412770 learned_addr learned my addr 172.21.15.192:0/1077412770 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.740+0000 7f188006f640 1 -- 172.21.15.192:0/1077412770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca2b6eced0 con 0x55ca2b6ec470 2024-09-10T05:12:45.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.740+0000 7f188006f640 1 --2- 172.21.15.192:0/1077412770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6ec470 0x55ca2b6ec890 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1870052070 tx=0x7f1870010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.740+0000 7f1765ffb640 1 -- 172.21.15.192:0/1077412770 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187001e730 con 0x55ca2b6ec470 2024-09-10T05:12:45.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.740+0000 7f1765ffb640 1 -- 172.21.15.192:0/1077412770 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187001e8d0 con 0x55ca2b6ec470 2024-09-10T05:12:45.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.741+0000 7f1884328800 1 -- 172.21.15.192:0/1077412770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca2b6ed700 con 0x55ca2b6ec470 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.741+0000 7f1765ffb640 1 -- 172.21.15.192:0/1077412770 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187004b010 con 0x55ca2b6ec470 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.741+0000 7f1884328800 1 -- 172.21.15.192:0/1077412770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca2b6edca0 con 0x55ca2b6ec470 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.741+0000 7f1765ffb640 1 -- 172.21.15.192:0/1077412770 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1870010070 con 0x55ca2b6ec470 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.741+0000 7f1765ffb640 1 --2- 172.21.15.192:0/1077412770 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f175803c780 0x7f175803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.741+0000 7f1765ffb640 1 -- 172.21.15.192:0/1077412770 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1870042430 con 0x55ca2b6ec470 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.742+0000 7f187f86e640 1 --2- 172.21.15.192:0/1077412770 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f175803c780 0x7f175803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.742+0000 7f1884328800 1 Processor -- start 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.742+0000 7f1884328800 1 -- start start 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.742+0000 7f1884328800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 0x55ca2b6f9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.742+0000 7f1884328800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ca2b6c70e0 con 0x55ca2b6f8d90 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.742+0000 7f187f86e640 1 --2- 172.21.15.192:0/1077412770 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f175803c780 0x7f175803ec40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55ca2b6d6d00 tx=0x7f1868005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.742+0000 7f188006f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 0x55ca2b6f9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.742+0000 7f188006f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 0x55ca2b6f9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42416/0 (socket says 172.21.15.192:42416) 2024-09-10T05:12:45.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.742+0000 7f188006f640 1 -- 172.21.15.192:0/3606186175 learned_addr learned my addr 172.21.15.192:0/3606186175 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.743+0000 7f188006f640 1 -- 172.21.15.192:0/3606186175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca2b6f9780 con 0x55ca2b6f8d90 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.743+0000 7f188006f640 1 --2- 172.21.15.192:0/3606186175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 0x55ca2b6f9190 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1870014450 tx=0x7f1870027b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e6bc3bb1088a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.743+0000 7f175f7fe640 1 -- 172.21.15.192:0/3606186175 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1870027780 con 0x55ca2b6f8d90 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.743+0000 7f175f7fe640 1 -- 172.21.15.192:0/3606186175 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1870053a80 con 0x55ca2b6f8d90 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.743+0000 7f175f7fe640 1 -- 172.21.15.192:0/3606186175 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187001f070 con 0x55ca2b6f8d90 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.743+0000 7f1884328800 1 -- 172.21.15.192:0/3606186175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 msgr2=0x55ca2b6f9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.743+0000 7f1884328800 1 --2- 172.21.15.192:0/3606186175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 0x55ca2b6f9190 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1870014450 tx=0x7f1870027b70 comp rx=0 tx=0).stop 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.743+0000 7f1884328800 1 -- 172.21.15.192:0/3606186175 shutdown_connections 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.743+0000 7f1884328800 1 --2- 172.21.15.192:0/3606186175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 0x55ca2b6f9190 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.743+0000 7f1884328800 1 -- 172.21.15.192:0/3606186175 >> 172.21.15.192:0/3606186175 conn(0x55ca2b6f5190 msgr2=0x55ca2b6f33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.744+0000 7f1884328800 1 -- 172.21.15.192:0/3606186175 shutdown_connections 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.744+0000 7f1884328800 1 -- 172.21.15.192:0/3606186175 wait complete. 2024-09-10T05:12:45.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.744+0000 7f1884328800 1 Processor -- start 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.744+0000 7f1884328800 1 -- start start 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.744+0000 7f1884328800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 0x55ca2b7001d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.744+0000 7f1884328800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ca2b6f9bf0 con 0x55ca2b6f8d90 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.744+0000 7f188006f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 0x55ca2b7001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.744+0000 7f188006f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 0x55ca2b7001d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42426/0 (socket says 172.21.15.192:42426) 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.744+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 learned_addr learned my addr 172.21.15.192:0/4258831480 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.745+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca2b700730 con 0x55ca2b6f8d90 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.745+0000 7f188006f640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 0x55ca2b7001d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f187004bfd0 tx=0x7f187001da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.745+0000 7f175dffb640 1 -- 172.21.15.192:0/4258831480 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187006e070 con 0x55ca2b6f8d90 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.745+0000 7f175dffb640 1 -- 172.21.15.192:0/4258831480 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1870026960 con 0x55ca2b6f8d90 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.745+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca2b700730 con 0x55ca2b6f8d90 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.745+0000 7f175dffb640 1 -- 172.21.15.192:0/4258831480 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187004b2e0 con 0x55ca2b6f8d90 2024-09-10T05:12:45.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.745+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca2b700730 con 0x55ca2b6f8d90 2024-09-10T05:12:45.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.746+0000 7f175dffb640 1 -- 172.21.15.192:0/4258831480 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1870071070 con 0x55ca2b6f8d90 2024-09-10T05:12:45.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.746+0000 7f175dffb640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f175003c730 0x7f175003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.746+0000 7f175dffb640 1 -- 172.21.15.192:0/4258831480 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f187005a070 con 0x55ca2b6f8d90 2024-09-10T05:12:45.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.746+0000 7f187f86e640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f175003c730 0x7f175003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.747+0000 7f1884328800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.747+0000 7f1884328800 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ca2b70b780 0x55ca2b70dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.747+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70e390 con 0x55ca2b70b780 2024-09-10T05:12:45.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.747+0000 7f1880870640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ca2b70b780 0x55ca2b70dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.747+0000 7f187f86e640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f175003c730 0x7f175003ebf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1868053fd0 tx=0x7f1868053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.747+0000 7f1880870640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ca2b70b780 0x55ca2b70dc40 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.747+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18780083e0 con 0x55ca2b70b780 2024-09-10T05:12:45.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.747+0000 7f1884328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 20 realm 2024-09-10T05:12:45.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70e7a0 con 0x55ca2b70b780 2024-09-10T05:12:45.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18780083e0 con 0x55ca2b70b780 2024-09-10T05:12:45.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:45.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70b780 2024-09-10T05:12:45.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18780083e0 con 0x55ca2b70b780 2024-09-10T05:12:45.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f410 con 0x55ca2b70b780 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f18780083e0 con 0x55ca2b70b780 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ca2b70fb60 0x55ca2b711f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.748+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b712720 con 0x55ca2b70fb60 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.749+0000 7f188006f640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ca2b70fb60 0x55ca2b711f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.749+0000 7f188006f640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ca2b70fb60 0x55ca2b711f90 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.749+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.749+0000 7f1884328800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.749+0000 7f1884328800 20 searching for the correct realm 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.749+0000 7f1884328800 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ca2b714810 0x55ca2b716cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.749+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b7173a0 con 0x55ca2b714810 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.749+0000 7f187f86e640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ca2b714810 0x55ca2b716cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.750+0000 7f187f86e640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ca2b714810 0x55ca2b716cd0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.750+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.750+0000 7f187f86e640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f186805f040 0x7f186806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.750+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b7173a0 con 0x7f186805f040 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.750+0000 7f1880870640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f186805f040 0x7f186806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.750+0000 7f1880870640 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f186805f040 0x7f186806b410 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.751+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f18780083e0 con 0x7f186805f040 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.751+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70fb60 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.751+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.751+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70b780 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.751+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18780083e0 con 0x55ca2b70b780 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.751+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70b780 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.751+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878026040 con 0x55ca2b70b780 2024-09-10T05:12:45.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.751+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70fb60 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.752+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.752+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70fb60 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.752+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.752+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x7f186805f040 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.752+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878026040 con 0x7f186805f040 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.752+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b714810 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.752+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.752+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70b780 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.753+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878026040 con 0x55ca2b70b780 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.753+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70fb60 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.753+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.753+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70b780 2024-09-10T05:12:45.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.753+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878026040 con 0x55ca2b70b780 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.753+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x7f186805f040 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.753+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1878026040 con 0x7f186805f040 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.753+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b714810 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.754+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.754+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b714810 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.754+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.754+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70fb60 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.754+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.754+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b714810 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.754+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.754+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b714810 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.755+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.755+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70b780 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.755+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878026040 con 0x55ca2b70b780 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.755+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70b780 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.755+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1878026040 con 0x55ca2b70b780 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.755+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x7f186805f040 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.755+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878026040 con 0x7f186805f040 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.755+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b714810 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.755+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.755+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x7f186805f040 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.756+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878026040 con 0x7f186805f040 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.756+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70b780 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.756+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.756+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70fb60 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.756+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.756+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b714810 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.756+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.756+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b70fb60 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.757+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.757+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x7f186805f040 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.757+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878035040 con 0x7f186805f040 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.757+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x55ca2b714810 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.757+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.757+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f070 con 0x7f186805f040 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.757+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878035040 con 0x7f186805f040 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.757+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f187803a040 con 0x55ca2b70b780 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f187803a040 con 0x7f186805f040 2024-09-10T05:12:45.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878035040 con 0x7f186805f040 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f050 con 0x55ca2b70b780 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f050 con 0x55ca2b70b780 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:45.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.758+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b70f050 con 0x7f186805f040 2024-09-10T05:12:45.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1878035040 con 0x7f186805f040 2024-09-10T05:12:45.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:45.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 20 zone default found 2024-09-10T05:12:45.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 4 Realm: () 2024-09-10T05:12:45.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:45.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:45.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:45.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 20 zonegroup default 2024-09-10T05:12:45.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b7130a0 con 0x55ca2b70fb60 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b718860 con 0x55ca2b714810 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b718cf0 con 0x55ca2b714810 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.759+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.760+0000 7f1884328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.760+0000 7f1884328800 20 started sync module instance, tier type = 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.760+0000 7f1884328800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.760+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b717cd0 con 0x7f186805f040 2024-09-10T05:12:45.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.761+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878035040 con 0x7f186805f040 2024-09-10T05:12:45.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.761+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94326800613872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b717cd0 con 0x7f186805f040 2024-09-10T05:12:45.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.761+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b719870 con 0x55ca2b70b780 2024-09-10T05:12:45.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.762+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94326800613872] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878035040 con 0x7f186805f040 2024-09-10T05:12:45.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.762+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.762+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94326800618304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b717cd0 con 0x55ca2b70b780 2024-09-10T05:12:45.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.762+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71a2e0 con 0x55ca2b714810 2024-09-10T05:12:45.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.764+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94326800618304] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.764+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.764+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94326800611360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b717c40 con 0x55ca2b714810 2024-09-10T05:12:45.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.764+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71b1a0 con 0x7f186805f040 2024-09-10T05:12:45.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.765+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94326800611360] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.765+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878035040 con 0x7f186805f040 2024-09-10T05:12:45.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.765+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94326800624880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71b5c0 con 0x7f186805f040 2024-09-10T05:12:45.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.765+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71bf80 con 0x55ca2b70b780 2024-09-10T05:12:45.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.766+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.766+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94326800624880] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878035040 con 0x7f186805f040 2024-09-10T05:12:45.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.766+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94326800628432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71c3a0 con 0x55ca2b70b780 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.766+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71b150 con 0x55ca2b70fb60 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.767+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.767+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94326800632112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71d200 con 0x55ca2b70fb60 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.767+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71dc40 con 0x55ca2b70fb60 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.767+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94326800628432] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.768+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94326800632112] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.768+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.768+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94326800633168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71bf30 con 0x55ca2b70fb60 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.768+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71e4c0 con 0x55ca2b70fb60 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.769+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94326800633168] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.770+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.770+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94326800637840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71e480 con 0x55ca2b70fb60 2024-09-10T05:12:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.770+0000 7f1884328800 20 add_watcher() i=0 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.770+0000 7f1884328800 20 add_watcher() i=1 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.770+0000 7f1884328800 20 add_watcher() i=2 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.770+0000 7f1884328800 20 add_watcher() i=3 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.770+0000 7f1884328800 20 add_watcher() i=4 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.770+0000 7f1884328800 20 add_watcher() i=5 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.770+0000 7f1884328800 20 add_watcher() i=6 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.771+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94326800637840] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.771+0000 7f1884328800 20 add_watcher() i=7 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.771+0000 7f1884328800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.771+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b721910 con 0x55ca2b70b780 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.771+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.771+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94326800635664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71ee30 con 0x55ca2b70b780 2024-09-10T05:12:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.773+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94326800635664] v37'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.773+0000 7f17367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.773+0000 7f1884328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.773+0000 7f1884328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.773+0000 7f1884328800 5 note: GC not initialized 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.773+0000 7f17357e2640 20 reqs_thread_entry: start 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.773+0000 7f1884328800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.773+0000 7f1884328800 20 Filter name: none 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.773+0000 7f16a6ffd640 20 reqs_thread_entry: start 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.773+0000 7f1884328800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.773+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b754540 con 0x55ca2b70b780 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.774+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.774+0000 7f1884328800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:12:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.774+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b755960 con 0x55ca2b70fb60 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.774+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.775+0000 7f17367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.775+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94326800635664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b753e60 con 0x55ca2b70b780 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.776+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94326800635664] v37'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.776+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94326800613872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71d710 con 0x7f186805f040 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.777+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94326800613872] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878035040 con 0x7f186805f040 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.777+0000 7f1884328800 20 remove_watcher() i=0 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.777+0000 7f1884328800 2 removed watcher, disabling cache 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.777+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94326800618304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b7181f0 con 0x55ca2b70b780 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.778+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94326800618304] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.778+0000 7f1884328800 20 remove_watcher() i=1 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.778+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94326800611360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b7181f0 con 0x55ca2b714810 2024-09-10T05:12:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.779+0000 7f187f86e640 1 -- 172.21.15.192:0/4258831480 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94326800611360] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f186807c040 con 0x55ca2b714810 2024-09-10T05:12:45.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.779+0000 7f1884328800 20 remove_watcher() i=2 2024-09-10T05:12:45.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.779+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94326800624880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b7181f0 con 0x7f186805f040 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.780+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94326800624880] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878035040 con 0x7f186805f040 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.780+0000 7f1884328800 20 remove_watcher() i=3 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.780+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94326800628432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b7181f0 con 0x55ca2b70b780 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.781+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94326800628432] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878035040 con 0x55ca2b70b780 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.781+0000 7f1884328800 20 remove_watcher() i=4 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.781+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94326800632112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71bad0 con 0x55ca2b70fb60 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.782+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94326800632112] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.782+0000 7f1884328800 20 remove_watcher() i=5 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.782+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94326800633168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b7181f0 con 0x55ca2b70fb60 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.783+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94326800633168] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.783+0000 7f1884328800 20 remove_watcher() i=6 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.783+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94326800637840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ca2b71bad0 con 0x55ca2b70fb60 2024-09-10T05:12:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.784+0000 7f188006f640 1 -- 172.21.15.192:0/4258831480 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94326800637840] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1870070030 con 0x55ca2b70fb60 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.784+0000 7f1884328800 20 remove_watcher() i=7 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.784+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ca2b70fb60 msgr2=0x55ca2b711f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.784+0000 7f1884328800 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ca2b70fb60 0x55ca2b711f90 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.784+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ca2b70b780 msgr2=0x55ca2b70dc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.784+0000 7f1884328800 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ca2b70b780 0x55ca2b70dc40 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.784+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f186805f040 msgr2=0x7f186806b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.784+0000 7f1884328800 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f186805f040 0x7f186806b410 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.784+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ca2b714810 msgr2=0x55ca2b716cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.784+0000 7f1884328800 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ca2b714810 0x55ca2b716cd0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.784+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f175003c730 msgr2=0x7f175003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f175003c730 0x7f175003ebf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1868053fd0 tx=0x7f1868053000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 msgr2=0x55ca2b7001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 --2- 172.21.15.192:0/4258831480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6f8d90 0x55ca2b7001d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f187004bfd0 tx=0x7f187001da10 comp rx=0 tx=0).stop 2024-09-10T05:12:45.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 reap_dead start 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1880870640 1 -- 172.21.15.192:0/4258831480 reap_dead start 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 shutdown_connections 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 >> 172.21.15.192:0/4258831480 conn(0x55ca2b6f5190 msgr2=0x55ca2b6f33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 shutdown_connections 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/4258831480 wait complete. 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/1077412770 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f175803c780 msgr2=0x7f175803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 --2- 172.21.15.192:0/1077412770 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f175803c780 0x7f175803ec40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55ca2b6d6d00 tx=0x7f1868005a00 comp rx=0 tx=0).stop 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/1077412770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6ec470 msgr2=0x55ca2b6ec890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 --2- 172.21.15.192:0/1077412770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6ec470 0x55ca2b6ec890 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1870052070 tx=0x7f1870010e80 comp rx=0 tx=0).stop 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/1077412770 shutdown_connections 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 --2- 172.21.15.192:0/1077412770 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f175803c780 0x7f175803ec40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 --2- 172.21.15.192:0/1077412770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b6ec470 0x55ca2b6ec890 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/1077412770 >> 172.21.15.192:0/1077412770 conn(0x55ca2b6e0820 msgr2=0x55ca2b6e0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/1077412770 shutdown_connections 2024-09-10T05:12:45.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/1077412770 wait complete. 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ca2b6d7c50 msgr2=0x55ca2b6da0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ca2b6d7c50 0x55ca2b6da0f0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ca2b5d4ff0 msgr2=0x55ca2b6d5830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ca2b5d4ff0 0x55ca2b6d5830 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ca2b6dbce0 msgr2=0x55ca2b6de0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ca2b6dbce0 0x55ca2b6de0d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f176803c730 msgr2=0x7f176803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f176803c730 0x7f176803ebf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1868057000 tx=0x7f1868052000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 msgr2=0x55ca2b6ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.785+0000 7f1884328800 1 --2- 172.21.15.192:0/777088805 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca2b5d34d0 0x55ca2b6ce1e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f18700066b0 tx=0x7f1870001250 comp rx=0 tx=0).stop 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.786+0000 7f1880870640 1 -- 172.21.15.192:0/777088805 reap_dead start 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.786+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 shutdown_connections 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.786+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 >> 172.21.15.192:0/777088805 conn(0x55ca2b5cf200 msgr2=0x55ca2b6c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.786+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 shutdown_connections 2024-09-10T05:12:45.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.786+0000 7f1884328800 1 -- 172.21.15.192:0/777088805 wait complete. 2024-09-10T05:12:45.795 INFO:teuthology.orchestra.run.smithi192.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:12:45.795 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:12:45.795 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-10T05:12:45.795 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-10T05:12:45.796 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-10T05:12:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:45.842 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.842+0000 7f5b3880e800 1 Processor -- start 2024-09-10T05:12:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.842+0000 7f5b3880e800 1 -- start start 2024-09-10T05:12:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.842+0000 7f5b3880e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x556683171e10 0x556683172b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.842+0000 7f5b3880e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55668301ce40 con 0x556683173050 2024-09-10T05:12:45.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.842+0000 7f5b3880e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x556682fe7680 con 0x556683171e10 2024-09-10T05:12:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.843+0000 7f5b33fbc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x556683171e10 0x556683172b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.843+0000 7f5b2bfff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x556683173050 0x556683177db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:34216/0 (socket says 172.21.15.192:34216) 2024-09-10T05:12:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.843+0000 7f5b2bfff640 1 -- 172.21.15.192:0/274387894 learned_addr learned my addr 172.21.15.192:0/274387894 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.843+0000 7f5b33fbc640 1 -- 172.21.15.192:0/274387894 >> v1:172.21.15.139:6789/0 conn(0x556683173050 legacy=0x556683177db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.843+0000 7f5b33fbc640 1 -- 172.21.15.192:0/274387894 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566830036b0 con 0x556683171e10 2024-09-10T05:12:45.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.845+0000 7f5b33fbc640 1 --2- 172.21.15.192:0/274387894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x556683172b10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400a600 tx=0x7f5b24047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df25b6774d495a6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.845+0000 7f5b337bb640 1 -- 172.21.15.192:0/274387894 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b24056070 con 0x556683171e10 2024-09-10T05:12:45.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.845+0000 7f5b337bb640 1 -- 172.21.15.192:0/274387894 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2400a200 con 0x556683171e10 2024-09-10T05:12:45.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.845+0000 7f5b337bb640 1 -- 172.21.15.192:0/274387894 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b24008590 con 0x556683171e10 2024-09-10T05:12:45.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.845+0000 7f5b3880e800 1 -- 172.21.15.192:0/274387894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 msgr2=0x556683172b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.845+0000 7f5b3880e800 1 --2- 172.21.15.192:0/274387894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x556683172b10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400a600 tx=0x7f5b24047cb0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.845+0000 7f5b3880e800 1 -- 172.21.15.192:0/274387894 shutdown_connections 2024-09-10T05:12:45.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.845+0000 7f5b3880e800 1 --2- 172.21.15.192:0/274387894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x556683172b10 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.845+0000 7f5b3880e800 1 -- 172.21.15.192:0/274387894 >> 172.21.15.192:0/274387894 conn(0x55668316d200 msgr2=0x55668316f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.846+0000 7f5b3880e800 1 -- 172.21.15.192:0/274387894 shutdown_connections 2024-09-10T05:12:45.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.846+0000 7f5b3880e800 1 -- 172.21.15.192:0/274387894 wait complete. 2024-09-10T05:12:45.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.859+0000 7f5b3880e800 1 Processor -- start 2024-09-10T05:12:45.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.859+0000 7f5b3880e800 1 -- start start 2024-09-10T05:12:45.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.859+0000 7f5b3880e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x5566832604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.859+0000 7f5b3880e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55668300bdd0 con 0x556683171e10 2024-09-10T05:12:45.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.860+0000 7f5b33fbc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x5566832604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.860+0000 7f5b33fbc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x5566832604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42444/0 (socket says 172.21.15.192:42444) 2024-09-10T05:12:45.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.860+0000 7f5b33fbc640 1 -- 172.21.15.192:0/1065653124 learned_addr learned my addr 172.21.15.192:0/1065653124 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.860+0000 7f5b33fbc640 1 -- 172.21.15.192:0/1065653124 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556683024e10 con 0x556683171e10 2024-09-10T05:12:45.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.860+0000 7f5b33fbc640 1 --2- 172.21.15.192:0/1065653124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x5566832604b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5b24027ae0 tx=0x7f5b24053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a490421564367a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.860+0000 7f5a21e0b640 1 -- 172.21.15.192:0/1065653124 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b24009810 con 0x556683171e10 2024-09-10T05:12:45.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.860+0000 7f5a21e0b640 1 -- 172.21.15.192:0/1065653124 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b240099b0 con 0x556683171e10 2024-09-10T05:12:45.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.860+0000 7f5a21e0b640 1 -- 172.21.15.192:0/1065653124 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b24009cb0 con 0x556683171e10 2024-09-10T05:12:45.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.861+0000 7f5b3880e800 1 -- 172.21.15.192:0/1065653124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 msgr2=0x5566832604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.861+0000 7f5b3880e800 1 --2- 172.21.15.192:0/1065653124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x5566832604b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5b24027ae0 tx=0x7f5b24053000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.861+0000 7f5b3880e800 1 -- 172.21.15.192:0/1065653124 shutdown_connections 2024-09-10T05:12:45.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.861+0000 7f5b3880e800 1 --2- 172.21.15.192:0/1065653124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x5566832604b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.861+0000 7f5b3880e800 1 -- 172.21.15.192:0/1065653124 >> 172.21.15.192:0/1065653124 conn(0x55668316d200 msgr2=0x55668325be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.861+0000 7f5b3880e800 1 -- 172.21.15.192:0/1065653124 shutdown_connections 2024-09-10T05:12:45.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.861+0000 7f5b3880e800 1 -- 172.21.15.192:0/1065653124 wait complete. 2024-09-10T05:12:45.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.861+0000 7f5b3880e800 1 Processor -- start 2024-09-10T05:12:45.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.861+0000 7f5b3880e800 1 -- start start 2024-09-10T05:12:45.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.862+0000 7f5b3880e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x556683267cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.862+0000 7f5b3880e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556683173740 con 0x556683171e10 2024-09-10T05:12:45.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.862+0000 7f5b33fbc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x556683267cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.862+0000 7f5b33fbc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x556683267cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42460/0 (socket says 172.21.15.192:42460) 2024-09-10T05:12:45.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.862+0000 7f5b33fbc640 1 -- 172.21.15.192:0/1758631153 learned_addr learned my addr 172.21.15.192:0/1758631153 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.862+0000 7f5b33fbc640 1 -- 172.21.15.192:0/1758631153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556683268230 con 0x556683171e10 2024-09-10T05:12:45.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.862+0000 7f5b33fbc640 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x556683267cd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400a560 tx=0x7f5b24002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.862+0000 7f5a1bfff640 1 -- 172.21.15.192:0/1758631153 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b2406a040 con 0x556683171e10 2024-09-10T05:12:45.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.862+0000 7f5a1bfff640 1 -- 172.21.15.192:0/1758631153 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b24009b60 con 0x556683171e10 2024-09-10T05:12:45.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.862+0000 7f5a1bfff640 1 -- 172.21.15.192:0/1758631153 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b24051bf0 con 0x556683171e10 2024-09-10T05:12:45.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.862+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566832684c0 con 0x556683171e10 2024-09-10T05:12:45.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.863+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556683268ec0 con 0x556683171e10 2024-09-10T05:12:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.863+0000 7f5a1bfff640 1 -- 172.21.15.192:0/1758631153 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5b24075020 con 0x556683171e10 2024-09-10T05:12:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.864+0000 7f5a1bfff640 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a1c03c730 0x7f5a1c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.864+0000 7f5a1bfff640 1 -- 172.21.15.192:0/1758631153 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5b24073020 con 0x556683171e10 2024-09-10T05:12:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.864+0000 7f5b2bfff640 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a1c03c730 0x7f5a1c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.864+0000 7f5b3880e800 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556683173050 0x55668326f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.864+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55668326f860 con 0x556683173050 2024-09-10T05:12:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.864+0000 7f5b347bd640 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556683173050 0x55668326f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.864+0000 7f5b2bfff640 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a1c03c730 0x7f5a1c03ebf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c001d70 tx=0x7f5b1c0012d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.864+0000 7f5b347bd640 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556683173050 0x55668326f320 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.864+0000 7f5b347bd640 1 -- 172.21.15.192:0/1758631153 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x556683173050 2024-09-10T05:12:45.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.865+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55668326fc00 con 0x556683173050 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.865+0000 7f5b347bd640 1 -- 172.21.15.192:0/1758631153 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x556683173050 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.865+0000 7f5b3880e800 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556683271700 0x556683273b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.865+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556683274310 con 0x556683271700 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.865+0000 7f5b33fbc640 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556683271700 0x556683273b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.865+0000 7f5b33fbc640 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556683271700 0x556683273b80 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.866+0000 7f5b33fbc640 1 -- 172.21.15.192:0/1758631153 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b24058030 con 0x556683271700 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.866+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556683270450 con 0x556683173050 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.866+0000 7f5b347bd640 1 -- 172.21.15.192:0/1758631153 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x556683173050 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.866+0000 7f5b3880e800 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556683275770 0x556683277b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.866+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556683278200 con 0x556683275770 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.866+0000 7f5b2bfff640 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556683275770 0x556683277b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.866+0000 7f5b2bfff640 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556683275770 0x556683277b60 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.867+0000 7f5b2bfff640 1 -- 172.21.15.192:0/1758631153 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b1c009050 con 0x556683275770 2024-09-10T05:12:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.867+0000 7f5b3880e800 1 Processor -- start 2024-09-10T05:12:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.867+0000 7f5b3880e800 1 -- start start 2024-09-10T05:12:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.867+0000 7f5b3880e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683285e30 0x556683286250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.867+0000 7f5b3880e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556683069a00 con 0x556683285e30 2024-09-10T05:12:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.867+0000 7f5b33fbc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683285e30 0x556683286250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.867+0000 7f5b33fbc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683285e30 0x556683286250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42476/0 (socket says 172.21.15.192:42476) 2024-09-10T05:12:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.867+0000 7f5b33fbc640 1 -- 172.21.15.192:0/3332994641 learned_addr learned my addr 172.21.15.192:0/3332994641 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.868+0000 7f5b33fbc640 1 -- 172.21.15.192:0/3332994641 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556683286890 con 0x556683285e30 2024-09-10T05:12:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.868+0000 7f5b33fbc640 1 --2- 172.21.15.192:0/3332994641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683285e30 0x556683286250 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f5b2406d8c0 tx=0x7f5b24051f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.868+0000 7f5a197fa640 1 -- 172.21.15.192:0/3332994641 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b24050500 con 0x556683285e30 2024-09-10T05:12:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.868+0000 7f5a197fa640 1 -- 172.21.15.192:0/3332994641 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b24064a20 con 0x556683285e30 2024-09-10T05:12:45.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.868+0000 7f5b3880e800 1 -- 172.21.15.192:0/3332994641 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566832870c0 con 0x556683285e30 2024-09-10T05:12:45.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.868+0000 7f5a197fa640 1 -- 172.21.15.192:0/3332994641 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b24064d40 con 0x556683285e30 2024-09-10T05:12:45.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.869+0000 7f5b3880e800 1 -- 172.21.15.192:0/3332994641 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556683287660 con 0x556683285e30 2024-09-10T05:12:45.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.869+0000 7f5a197fa640 1 -- 172.21.15.192:0/3332994641 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5b24059070 con 0x556683285e30 2024-09-10T05:12:45.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.869+0000 7f5a197fa640 1 --2- 172.21.15.192:0/3332994641 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a0c03c710 0x7f5a0c03ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.869+0000 7f5a197fa640 1 -- 172.21.15.192:0/3332994641 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5b2408c070 con 0x556683285e30 2024-09-10T05:12:45.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.869+0000 7f5b2bfff640 1 --2- 172.21.15.192:0/3332994641 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a0c03c710 0x7f5a0c03ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.869+0000 7f5b3880e800 1 Processor -- start 2024-09-10T05:12:45.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.869+0000 7f5b3880e800 1 -- start start 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.870+0000 7f5b2bfff640 1 --2- 172.21.15.192:0/3332994641 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a0c03c710 0x7f5a0c03ebd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00bf40 tx=0x7f5b1c00f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.870+0000 7f5b3880e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 0x556683292bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.870+0000 7f5b3880e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556683260c40 con 0x5566832927d0 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.870+0000 7f5b33fbc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 0x556683292bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.870+0000 7f5b33fbc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 0x556683292bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42488/0 (socket says 172.21.15.192:42488) 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.870+0000 7f5b33fbc640 1 -- 172.21.15.192:0/543408433 learned_addr learned my addr 172.21.15.192:0/543408433 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.870+0000 7f5b33fbc640 1 -- 172.21.15.192:0/543408433 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566832931a0 con 0x5566832927d0 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.870+0000 7f5b33fbc640 1 --2- 172.21.15.192:0/543408433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 0x556683292bb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5b2406da70 tx=0x7f5b2406af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4536ebb31ca68cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.870+0000 7f5a12ffd640 1 -- 172.21.15.192:0/543408433 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b240a5020 con 0x5566832927d0 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.871+0000 7f5a12ffd640 1 -- 172.21.15.192:0/543408433 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2409b030 con 0x5566832927d0 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.871+0000 7f5a12ffd640 1 -- 172.21.15.192:0/543408433 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b240ab060 con 0x5566832927d0 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.871+0000 7f5b3880e800 1 -- 172.21.15.192:0/543408433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 msgr2=0x556683292bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.871+0000 7f5b3880e800 1 --2- 172.21.15.192:0/543408433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 0x556683292bb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5b2406da70 tx=0x7f5b2406af00 comp rx=0 tx=0).stop 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.871+0000 7f5b3880e800 1 -- 172.21.15.192:0/543408433 shutdown_connections 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.871+0000 7f5b3880e800 1 --2- 172.21.15.192:0/543408433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 0x556683292bb0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.871+0000 7f5b3880e800 1 -- 172.21.15.192:0/543408433 >> 172.21.15.192:0/543408433 conn(0x55668328ebd0 msgr2=0x55668328ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.871+0000 7f5b3880e800 1 -- 172.21.15.192:0/543408433 shutdown_connections 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.871+0000 7f5b3880e800 1 -- 172.21.15.192:0/543408433 wait complete. 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.871+0000 7f5b3880e800 1 Processor -- start 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.871+0000 7f5b3880e800 1 -- start start 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.872+0000 7f5b3880e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 0x556683299ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.872+0000 7f5b3880e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556683293630 con 0x5566832927d0 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.872+0000 7f5b33fbc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 0x556683299ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.872+0000 7f5b33fbc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 0x556683299ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42490/0 (socket says 172.21.15.192:42490) 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.872+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 learned_addr learned my addr 172.21.15.192:0/2888060152 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.872+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55668329a040 con 0x5566832927d0 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.872+0000 7f5b33fbc640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 0x556683299ae0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f5b24051af0 tx=0x7f5b24079eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.872+0000 7f5a117fa640 1 -- 172.21.15.192:0/2888060152 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b240be070 con 0x5566832927d0 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.872+0000 7f5a117fa640 1 -- 172.21.15.192:0/2888060152 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b2405c030 con 0x5566832927d0 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.872+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55668329a040 con 0x5566832927d0 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.872+0000 7f5a117fa640 1 -- 172.21.15.192:0/2888060152 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b24084500 con 0x5566832927d0 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.872+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55668329a040 con 0x5566832927d0 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.873+0000 7f5a117fa640 1 -- 172.21.15.192:0/2888060152 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5b240c1070 con 0x5566832927d0 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.873+0000 7f5a117fa640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59fc03c690 0x7f59fc03eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.873+0000 7f5a117fa640 1 -- 172.21.15.192:0/2888060152 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5b240b6050 con 0x5566832927d0 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.874+0000 7f5b2bfff640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59fc03c690 0x7f59fc03eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.874+0000 7f5b3880e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.874+0000 7f5b3880e800 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5566832a50a0 0x5566832a7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.874+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832a7cb0 con 0x5566832a50a0 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.874+0000 7f5b347bd640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5566832a50a0 0x5566832a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.874+0000 7f5b2bfff640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59fc03c690 0x7f59fc03eb50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c010 tx=0x7f5b1c010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.874+0000 7f5b347bd640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5566832a50a0 0x5566832a7560 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.874+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.874+0000 7f5b3880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.874+0000 7f5b3880e800 20 realm 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.874+0000 7f5b3880e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.874+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832a80c0 con 0x5566832a50a0 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b3880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b3880e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b3880e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8990 con 0x5566832a50a0 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b3880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b3880e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a50a0 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b3880e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b3880e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b3880e800 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5566832a9820 0x5566832abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832ac350 con 0x5566832a9820 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.875+0000 7f5b33fbc640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5566832a9820 0x5566832abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.876+0000 7f5b33fbc640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5566832a9820 0x5566832abc10 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.876+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.876+0000 7f5b3880e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:45.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.876+0000 7f5b3880e800 20 searching for the correct realm 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.876+0000 7f5b3880e800 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5566832ae3f0 0x5566832b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.876+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832b0f80 con 0x5566832ae3f0 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.876+0000 7f5b2bfff640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5566832ae3f0 0x5566832b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.877+0000 7f5b2bfff640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5566832ae3f0 0x5566832b08b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.877+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.877+0000 7f5b2bfff640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5b1c037040 0x7f5b1c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.877+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832b0f80 con 0x7f5b1c037040 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.877+0000 7f5b347bd640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5b1c037040 0x7f5b1c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.877+0000 7f5b347bd640 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5b1c037040 0x7f5b1c036410 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.878+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.878+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a9820 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.878+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.878+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a50a0 2024-09-10T05:12:45.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.878+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.878+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a50a0 2024-09-10T05:12:45.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.878+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.878+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a9820 2024-09-10T05:12:45.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.879+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.879+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a9820 2024-09-10T05:12:45.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.879+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.879+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x7f5b1c037040 2024-09-10T05:12:45.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.879+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.879+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832ae3f0 2024-09-10T05:12:45.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.879+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.879+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a50a0 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.879+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.880+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a9820 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.880+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.880+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a50a0 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.880+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.880+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x7f5b1c037040 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.880+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.880+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832ae3f0 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.880+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.881+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832ae3f0 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.881+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.881+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a9820 2024-09-10T05:12:45.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.881+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.881+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832ae3f0 2024-09-10T05:12:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.881+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.881+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832ae3f0 2024-09-10T05:12:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.881+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.882+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a50a0 2024-09-10T05:12:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.882+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.882+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a50a0 2024-09-10T05:12:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.882+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.882+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x7f5b1c037040 2024-09-10T05:12:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.882+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.882+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832ae3f0 2024-09-10T05:12:45.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.882+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.882+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x7f5b1c037040 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.883+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.883+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a50a0 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.883+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.883+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a9820 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.883+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.883+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832ae3f0 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.883+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.883+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a9820 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.884+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.884+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x7f5b1c037040 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.884+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.884+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832ae3f0 2024-09-10T05:12:45.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.884+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.884+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x7f5b1c037040 2024-09-10T05:12:45.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.884+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.884+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x5566832a50a0 2024-09-10T05:12:45.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5566832a8d30 con 0x7f5b1c037040 2024-09-10T05:12:45.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:45.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:45.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:45.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:45.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:45.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832accf0 con 0x5566832a50a0 2024-09-10T05:12:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832accf0 con 0x5566832a50a0 2024-09-10T05:12:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.885+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832acca0 con 0x7f5b1c037040 2024-09-10T05:12:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 20 zone default found 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 4 Realm: () 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 20 zonegroup default 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832ad0e0 con 0x5566832a9820 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832b2df0 con 0x5566832ae3f0 2024-09-10T05:12:45.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832b3190 con 0x5566832ae3f0 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.886+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.887+0000 7f5b3880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.887+0000 7f5b3880e800 20 started sync module instance, tier type = 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.887+0000 7f5b3880e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.887+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b2290 con 0x7f5b1c037040 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.888+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.888+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93898775668352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b2290 con 0x7f5b1c037040 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.888+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b39e0 con 0x5566832a50a0 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.889+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93898775668352] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.889+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.889+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93898775666624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b39e0 con 0x5566832a50a0 2024-09-10T05:12:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.889+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b43a0 con 0x5566832ae3f0 2024-09-10T05:12:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.890+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.890+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93898775666624] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.890+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93898775674608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b4790 con 0x5566832ae3f0 2024-09-10T05:12:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.890+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b5150 con 0x7f5b1c037040 2024-09-10T05:12:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.891+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93898775674608] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.891+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.891+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93898775678112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b50c0 con 0x7f5b1c037040 2024-09-10T05:12:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.891+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b6040 con 0x5566832a50a0 2024-09-10T05:12:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.892+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93898775678112] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.892+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.892+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93898775680224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b6040 con 0x5566832a50a0 2024-09-10T05:12:45.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.892+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b6a00 con 0x5566832a9820 2024-09-10T05:12:45.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.893+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.893+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93898775684432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b7250 con 0x5566832a9820 2024-09-10T05:12:45.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.893+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b7cd0 con 0x5566832a9820 2024-09-10T05:12:45.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.894+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93898775680224] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.895+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93898775684432] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.895+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.895+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93898775686560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b5bf0 con 0x5566832a9820 2024-09-10T05:12:45.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.895+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b8570 con 0x5566832a9820 2024-09-10T05:12:45.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.896+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(58 notify.7 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.896+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93898775691296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b89e0 con 0x5566832a9820 2024-09-10T05:12:45.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.896+0000 7f5b3880e800 20 add_watcher() i=0 2024-09-10T05:12:45.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.896+0000 7f5b3880e800 20 add_watcher() i=1 2024-09-10T05:12:45.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.896+0000 7f5b3880e800 20 add_watcher() i=2 2024-09-10T05:12:45.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.896+0000 7f5b3880e800 20 add_watcher() i=3 2024-09-10T05:12:45.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.896+0000 7f5b3880e800 20 add_watcher() i=4 2024-09-10T05:12:45.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.896+0000 7f5b3880e800 20 add_watcher() i=5 2024-09-10T05:12:45.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.896+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93898775686560] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.896+0000 7f5b3880e800 20 add_watcher() i=6 2024-09-10T05:12:45.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.898+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93898775691296] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.898+0000 7f5b3880e800 20 add_watcher() i=7 2024-09-10T05:12:45.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.898+0000 7f5b3880e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:45.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.898+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832b89e0 con 0x5566832a50a0 2024-09-10T05:12:45.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.898+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.898+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93898775692592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b8950 con 0x5566832a50a0 2024-09-10T05:12:45.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.899+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93898775692592] v37'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.899+0000 7f59e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:45.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.900+0000 7f5b3880e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:45.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.900+0000 7f5b3880e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.900+0000 7f5b3880e800 5 note: GC not initialized 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.900+0000 7f59e8fe1640 20 reqs_thread_entry: start 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.900+0000 7f5b3880e800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.900+0000 7f5b3880e800 20 Filter name: none 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.900+0000 7f59627fc640 20 reqs_thread_entry: start 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.900+0000 7f5b3880e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.900+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832ee780 con 0x5566832a50a0 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.900+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.900+0000 7f5b3880e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.901+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5566832efba0 con 0x5566832a9820 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.901+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.902+0000 7f59e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:45.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.902+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93898775692592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832ee0a0 con 0x5566832a50a0 2024-09-10T05:12:45.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.903+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93898775692592] v37'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.903+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93898775668352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b8530 con 0x7f5b1c037040 2024-09-10T05:12:45.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.904+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93898775668352] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.904+0000 7f5b3880e800 20 remove_watcher() i=0 2024-09-10T05:12:45.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.904+0000 7f5b3880e800 2 removed watcher, disabling cache 2024-09-10T05:12:45.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.904+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93898775666624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b8530 con 0x5566832a50a0 2024-09-10T05:12:45.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.905+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93898775666624] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.905+0000 7f5b3880e800 20 remove_watcher() i=1 2024-09-10T05:12:45.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.905+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93898775674608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b1fc0 con 0x5566832ae3f0 2024-09-10T05:12:45.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.906+0000 7f5b2bfff640 1 -- 172.21.15.192:0/2888060152 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93898775674608] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b1c009050 con 0x5566832ae3f0 2024-09-10T05:12:45.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.906+0000 7f5b3880e800 20 remove_watcher() i=2 2024-09-10T05:12:45.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.906+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93898775678112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b3ef0 con 0x7f5b1c037040 2024-09-10T05:12:45.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.907+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93898775678112] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x7f5b1c037040 2024-09-10T05:12:45.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.907+0000 7f5b3880e800 20 remove_watcher() i=3 2024-09-10T05:12:45.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.908+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93898775680224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b4ca0 con 0x5566832a50a0 2024-09-10T05:12:45.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.909+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93898775680224] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b2c00a4d0 con 0x5566832a50a0 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.909+0000 7f5b3880e800 20 remove_watcher() i=4 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.909+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93898775684432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b54e0 con 0x5566832a9820 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.910+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93898775684432] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.910+0000 7f5b3880e800 20 remove_watcher() i=5 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.910+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93898775686560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b4ca0 con 0x5566832a9820 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.911+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93898775686560] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.911+0000 7f5b3880e800 20 remove_watcher() i=6 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.911+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93898775691296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5566832b6550 con 0x5566832a9820 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.912+0000 7f5b33fbc640 1 -- 172.21.15.192:0/2888060152 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93898775691296] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b240c0030 con 0x5566832a9820 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.912+0000 7f5b3880e800 20 remove_watcher() i=7 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.912+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5566832a9820 msgr2=0x5566832abc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.912+0000 7f5b3880e800 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5566832a9820 0x5566832abc10 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.912+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5566832a50a0 msgr2=0x5566832a7560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.912+0000 7f5b3880e800 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5566832a50a0 0x5566832a7560 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.912+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5b1c037040 msgr2=0x7f5b1c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.912+0000 7f5b3880e800 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5b1c037040 0x7f5b1c036410 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.912+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5566832ae3f0 msgr2=0x5566832b08b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.912+0000 7f5b3880e800 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5566832ae3f0 0x5566832b08b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.912+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59fc03c690 msgr2=0x7f59fc03eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.912+0000 7f5b3880e800 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f59fc03c690 0x7f59fc03eb50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c010 tx=0x7f5b1c010000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 msgr2=0x556683299ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 --2- 172.21.15.192:0/2888060152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566832927d0 0x556683299ae0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f5b24051af0 tx=0x7f5b24079eb0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 reap_dead start 2024-09-10T05:12:45.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b347bd640 1 -- 172.21.15.192:0/2888060152 reap_dead start 2024-09-10T05:12:45.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 shutdown_connections 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 >> 172.21.15.192:0/2888060152 conn(0x55668328ebd0 msgr2=0x55668328cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 shutdown_connections 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/2888060152 wait complete. 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/3332994641 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a0c03c710 msgr2=0x7f5a0c03ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 --2- 172.21.15.192:0/3332994641 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a0c03c710 0x7f5a0c03ebd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00bf40 tx=0x7f5b1c00f000 comp rx=0 tx=0).stop 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/3332994641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683285e30 msgr2=0x556683286250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 --2- 172.21.15.192:0/3332994641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683285e30 0x556683286250 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f5b2406d8c0 tx=0x7f5b24051f90 comp rx=0 tx=0).stop 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/3332994641 shutdown_connections 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 --2- 172.21.15.192:0/3332994641 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a0c03c710 0x7f5a0c03ebd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 --2- 172.21.15.192:0/3332994641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683285e30 0x556683286250 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/3332994641 >> 172.21.15.192:0/3332994641 conn(0x55668327a190 msgr2=0x55668327a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/3332994641 shutdown_connections 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/3332994641 wait complete. 2024-09-10T05:12:45.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556683271700 msgr2=0x556683273b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556683271700 0x556683273b80 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556683173050 msgr2=0x55668326f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556683173050 0x55668326f320 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556683275770 msgr2=0x556683277b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.913+0000 7f5b3880e800 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556683275770 0x556683277b60 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.914+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a1c03c730 msgr2=0x7f5a1c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.914+0000 7f5b3880e800 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a1c03c730 0x7f5a1c03ebf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c001d70 tx=0x7f5b1c0012d0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.914+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 msgr2=0x556683267cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.914+0000 7f5b3880e800 1 --2- 172.21.15.192:0/1758631153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556683171e10 0x556683267cd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400a560 tx=0x7f5b24002fb0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.914+0000 7f5b347bd640 1 -- 172.21.15.192:0/1758631153 reap_dead start 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.914+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 shutdown_connections 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.914+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 >> 172.21.15.192:0/1758631153 conn(0x55668316d200 msgr2=0x556683261670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.914+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 shutdown_connections 2024-09-10T05:12:45.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.914+0000 7f5b3880e800 1 -- 172.21.15.192:0/1758631153 wait complete. 2024-09-10T05:12:45.923 INFO:teuthology.orchestra.run.smithi192.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:12:45.923 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:12:45.924 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-10T05:12:45.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-10T05:12:45.924 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-10T05:12:45.970 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:45.970 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:45.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.970+0000 7f6dcad2f800 1 Processor -- start 2024-09-10T05:12:45.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.970+0000 7f6dcad2f800 1 -- start start 2024-09-10T05:12:45.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.970+0000 7f6dcad2f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x563c8ab1e7e0 0x563c8abb2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.970+0000 7f6dcad2f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563c8aa53e40 con 0x563c8ab1fb70 2024-09-10T05:12:45.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.970+0000 7f6dcad2f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x563c8aa1e680 con 0x563c8ab1e7e0 2024-09-10T05:12:45.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.970+0000 7f6dc6219640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x563c8ab1e7e0 0x563c8abb2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.970+0000 7f6dc6a1a640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x563c8ab1fb70 0x563c8ab1df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:34226/0 (socket says 172.21.15.192:34226) 2024-09-10T05:12:45.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.970+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2961215053 learned_addr learned my addr 172.21.15.192:0/2961215053 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:45.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.971+0000 7f6dc6219640 1 -- 172.21.15.192:0/2961215053 >> v1:172.21.15.139:6789/0 conn(0x563c8ab1fb70 legacy=0x563c8ab1df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.971+0000 7f6dc6219640 1 -- 172.21.15.192:0/2961215053 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c8aa3a6b0 con 0x563c8ab1e7e0 2024-09-10T05:12:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.973+0000 7f6dc6219640 1 --2- 172.21.15.192:0/2961215053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8abb2b40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00a470 tx=0x7f6dbc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db412dc7bb50bd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.973+0000 7f6dc5a18640 1 -- 172.21.15.192:0/2961215053 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dbc053570 con 0x563c8ab1e7e0 2024-09-10T05:12:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.973+0000 7f6dc5a18640 1 -- 172.21.15.192:0/2961215053 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dbc058070 con 0x563c8ab1e7e0 2024-09-10T05:12:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.973+0000 7f6dc5a18640 1 -- 172.21.15.192:0/2961215053 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dbc053880 con 0x563c8ab1e7e0 2024-09-10T05:12:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.973+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2961215053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 msgr2=0x563c8abb2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.973+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2961215053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8abb2b40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00a470 tx=0x7f6dbc045a20 comp rx=0 tx=0).stop 2024-09-10T05:12:45.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.973+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2961215053 shutdown_connections 2024-09-10T05:12:45.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.973+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2961215053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8abb2b40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.973+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2961215053 >> 172.21.15.192:0/2961215053 conn(0x563c8aba53d0 msgr2=0x563c8aba7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.973+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2961215053 shutdown_connections 2024-09-10T05:12:45.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.973+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2961215053 wait complete. 2024-09-10T05:12:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.987+0000 7f6dcad2f800 1 Processor -- start 2024-09-10T05:12:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.987+0000 7f6dcad2f800 1 -- start start 2024-09-10T05:12:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.987+0000 7f6dcad2f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8ac9b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.987+0000 7f6dcad2f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563c8aa42dd0 con 0x563c8ab1e7e0 2024-09-10T05:12:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.987+0000 7f6dc6a1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8ac9b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.987+0000 7f6dc6a1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8ac9b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42498/0 (socket says 172.21.15.192:42498) 2024-09-10T05:12:45.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.987+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/4174775712 learned_addr learned my addr 172.21.15.192:0/4174775712 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.988+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/4174775712 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c8aa5be10 con 0x563c8ab1e7e0 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.988+0000 7f6dc6a1a640 1 --2- 172.21.15.192:0/4174775712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8ac9b830 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6db8001800 tx=0x7f6db8001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882a226d6bce535e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.988+0000 7f6cb4e09640 1 -- 172.21.15.192:0/4174775712 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db8004520 con 0x563c8ab1e7e0 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.988+0000 7f6cb4e09640 1 -- 172.21.15.192:0/4174775712 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db80046c0 con 0x563c8ab1e7e0 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.988+0000 7f6cb4e09640 1 -- 172.21.15.192:0/4174775712 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db80049e0 con 0x563c8ab1e7e0 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.989+0000 7f6dcad2f800 1 -- 172.21.15.192:0/4174775712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 msgr2=0x563c8ac9b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.989+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/4174775712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8ac9b830 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6db8001800 tx=0x7f6db8001cc0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.989+0000 7f6dcad2f800 1 -- 172.21.15.192:0/4174775712 shutdown_connections 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.989+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/4174775712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8ac9b830 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.989+0000 7f6dcad2f800 1 -- 172.21.15.192:0/4174775712 >> 172.21.15.192:0/4174775712 conn(0x563c8aba53d0 msgr2=0x563c8ac971b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.989+0000 7f6dcad2f800 1 -- 172.21.15.192:0/4174775712 shutdown_connections 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.989+0000 7f6dcad2f800 1 -- 172.21.15.192:0/4174775712 wait complete. 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.989+0000 7f6dcad2f800 1 Processor -- start 2024-09-10T05:12:45.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.989+0000 7f6dcad2f800 1 -- start start 2024-09-10T05:12:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.989+0000 7f6dcad2f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8aca3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.989+0000 7f6dcad2f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563c8abb3380 con 0x563c8ab1e7e0 2024-09-10T05:12:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.990+0000 7f6dc6a1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8aca3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.990+0000 7f6dc6a1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8aca3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42512/0 (socket says 172.21.15.192:42512) 2024-09-10T05:12:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.990+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/1912324271 learned_addr learned my addr 172.21.15.192:0/1912324271 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:45.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.990+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/1912324271 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c8aca36e0 con 0x563c8ab1e7e0 2024-09-10T05:12:45.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.990+0000 7f6dc6a1a640 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8aca3180 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6db80066b0 tx=0x7f6db8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.990+0000 7f6cb3606640 1 -- 172.21.15.192:0/1912324271 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db8022020 con 0x563c8ab1e7e0 2024-09-10T05:12:45.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.990+0000 7f6cb3606640 1 -- 172.21.15.192:0/1912324271 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db80148c0 con 0x563c8ab1e7e0 2024-09-10T05:12:45.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.990+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c8aca3970 con 0x563c8ab1e7e0 2024-09-10T05:12:45.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.990+0000 7f6cb3606640 1 -- 172.21.15.192:0/1912324271 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db8014be0 con 0x563c8ab1e7e0 2024-09-10T05:12:45.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.991+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c8aca4370 con 0x563c8ab1e7e0 2024-09-10T05:12:45.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.991+0000 7f6cb3606640 1 -- 172.21.15.192:0/1912324271 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6db8025020 con 0x563c8ab1e7e0 2024-09-10T05:12:45.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.992+0000 7f6cb3606640 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6cac03c730 0x7f6cac03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.992+0000 7f6cb3606640 1 -- 172.21.15.192:0/1912324271 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6db8018030 con 0x563c8ab1e7e0 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.992+0000 7f6dc6219640 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6cac03c730 0x7f6cac03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.992+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x563c8ab1fb70 0x563c8acaa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.992+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8acaad10 con 0x563c8ab1fb70 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.992+0000 7f6dc721b640 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x563c8ab1fb70 0x563c8acaa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.992+0000 7f6dc6219640 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6cac03c730 0x7f6cac03ebf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc057000 tx=0x7f6dbc052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.992+0000 7f6dc721b640 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x563c8ab1fb70 0x563c8acaa7d0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.992+0000 7f6dc721b640 1 -- 172.21.15.192:0/1912324271 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dc00083e0 con 0x563c8ab1fb70 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.992+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8acab0b0 con 0x563c8ab1fb70 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.993+0000 7f6dc721b640 1 -- 172.21.15.192:0/1912324271 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6dc00083e0 con 0x563c8ab1fb70 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.993+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x563c8acacbb0 0x563c8acaf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.993+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8acaf7c0 con 0x563c8acacbb0 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.993+0000 7f6dc6a1a640 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x563c8acacbb0 0x563c8acaf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.993+0000 7f6dc6a1a640 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x563c8acacbb0 0x563c8acaf030 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:45.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.994+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/1912324271 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6db801b070 con 0x563c8acacbb0 2024-09-10T05:12:45.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.994+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8acab900 con 0x563c8ab1fb70 2024-09-10T05:12:45.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.994+0000 7f6dc721b640 1 -- 172.21.15.192:0/1912324271 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6dc00083e0 con 0x563c8ab1fb70 2024-09-10T05:12:45.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.994+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x563c8acb0c20 0x563c8acb3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:45.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.994+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8acb3780 con 0x563c8acb0c20 2024-09-10T05:12:45.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.994+0000 7f6dc6219640 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x563c8acb0c20 0x563c8acb3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:45.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.994+0000 7f6dc6219640 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x563c8acb0c20 0x563c8acb3010 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.995+0000 7f6dc6219640 1 -- 172.21.15.192:0/1912324271 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6dbc051070 con 0x563c8acb0c20 2024-09-10T05:12:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.995+0000 7f6dcad2f800 1 Processor -- start 2024-09-10T05:12:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.995+0000 7f6dcad2f800 1 -- start start 2024-09-10T05:12:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.995+0000 7f6dcad2f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8acc13e0 0x563c8acc1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.995+0000 7f6dcad2f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563c8aaa0a00 con 0x563c8acc13e0 2024-09-10T05:12:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.995+0000 7f6dc6a1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8acc13e0 0x563c8acc1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.995+0000 7f6dc6a1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8acc13e0 0x563c8acc1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42516/0 (socket says 172.21.15.192:42516) 2024-09-10T05:12:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.995+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2951252025 learned_addr learned my addr 172.21.15.192:0/2951252025 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.996+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2951252025 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c8acc1e40 con 0x563c8acc13e0 2024-09-10T05:12:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.996+0000 7f6dc6a1a640 1 --2- 172.21.15.192:0/2951252025 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8acc13e0 0x563c8acc1800 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6db8052020 tx=0x7f6db804b290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.996+0000 7f6cb0e01640 1 -- 172.21.15.192:0/2951252025 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db8034020 con 0x563c8acc13e0 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.996+0000 7f6cb0e01640 1 -- 172.21.15.192:0/2951252025 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db801d8d0 con 0x563c8acc13e0 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.996+0000 7f6cb0e01640 1 -- 172.21.15.192:0/2951252025 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db80266a0 con 0x563c8acc13e0 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.996+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2951252025 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c8acc2670 con 0x563c8acc13e0 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.996+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2951252025 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c8acc2c10 con 0x563c8acc13e0 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.997+0000 7f6cb0e01640 1 -- 172.21.15.192:0/2951252025 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6db8037020 con 0x563c8acc13e0 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.997+0000 7f6cb0e01640 1 --2- 172.21.15.192:0/2951252025 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6ca003c780 0x7f6ca003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.997+0000 7f6cb0e01640 1 -- 172.21.15.192:0/2951252025 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6db803ad10 con 0x563c8acc13e0 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.997+0000 7f6dc6219640 1 --2- 172.21.15.192:0/2951252025 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6ca003c780 0x7f6ca003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.997+0000 7f6dcad2f800 1 Processor -- start 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.997+0000 7f6dcad2f800 1 -- start start 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.997+0000 7f6dc6219640 1 --2- 172.21.15.192:0/2951252025 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6ca003c780 0x7f6ca003ec40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x563c8acabca0 tx=0x7f6dbc005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.997+0000 7f6dcad2f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 0x563c8acce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.997+0000 7f6dcad2f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563c8ac9c080 con 0x563c8accdca0 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.998+0000 7f6dc6a1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 0x563c8acce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.998+0000 7f6dc6a1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 0x563c8acce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42520/0 (socket says 172.21.15.192:42520) 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.998+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2542677934 learned_addr learned my addr 172.21.15.192:0/2542677934 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.998+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2542677934 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c8acce690 con 0x563c8accdca0 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.998+0000 7f6dc6a1a640 1 --2- 172.21.15.192:0/2542677934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 0x563c8acce0a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6db803afd0 tx=0x7f6db8032190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6d84f78cb4be1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.998+0000 7f6caa7fc640 1 -- 172.21.15.192:0/2542677934 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db8063070 con 0x563c8accdca0 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.998+0000 7f6caa7fc640 1 -- 172.21.15.192:0/2542677934 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db8010490 con 0x563c8accdca0 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.998+0000 7f6caa7fc640 1 -- 172.21.15.192:0/2542677934 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db8030560 con 0x563c8accdca0 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.999+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2542677934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 msgr2=0x563c8acce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.999+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2542677934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 0x563c8acce0a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6db803afd0 tx=0x7f6db8032190 comp rx=0 tx=0).stop 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.999+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2542677934 shutdown_connections 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.999+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2542677934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 0x563c8acce0a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.999+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2542677934 >> 172.21.15.192:0/2542677934 conn(0x563c8acca0a0 msgr2=0x563c8acc82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.999+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2542677934 shutdown_connections 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.999+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2542677934 wait complete. 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.999+0000 7f6dcad2f800 1 Processor -- start 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.999+0000 7f6dcad2f800 1 -- start start 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.999+0000 7f6dcad2f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 0x563c8acd5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:45.999+0000 7f6dcad2f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563c8acceb00 con 0x563c8accdca0 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.000+0000 7f6dc6a1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 0x563c8acd5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.000+0000 7f6dc6a1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 0x563c8acd5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42522/0 (socket says 172.21.15.192:42522) 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.000+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 learned_addr learned my addr 172.21.15.192:0/2773379506 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.000+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c8acd5660 con 0x563c8accdca0 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.000+0000 7f6dc6a1a640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 0x563c8acd5100 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6db803afd0 tx=0x7f6db8031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.000+0000 7f6ca8ff9640 1 -- 172.21.15.192:0/2773379506 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db806e020 con 0x563c8accdca0 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.000+0000 7f6ca8ff9640 1 -- 172.21.15.192:0/2773379506 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db804bb00 con 0x563c8accdca0 2024-09-10T05:12:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.000+0000 7f6ca8ff9640 1 -- 172.21.15.192:0/2773379506 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db8063030 con 0x563c8accdca0 2024-09-10T05:12:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.000+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c8acd5660 con 0x563c8accdca0 2024-09-10T05:12:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.000+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c8acd5660 con 0x563c8accdca0 2024-09-10T05:12:46.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.001+0000 7f6ca8ff9640 1 -- 172.21.15.192:0/2773379506 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6db8071020 con 0x563c8accdca0 2024-09-10T05:12:46.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6ca8ff9640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c9003c780 0x7f6c9003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6ca8ff9640 1 -- 172.21.15.192:0/2773379506 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6db8064070 con 0x563c8accdca0 2024-09-10T05:12:46.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6dcad2f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6dc6219640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c9003c780 0x7f6c9003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x563c8ace06a0 0x563c8ace2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3280 con 0x563c8ace06a0 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6dc721b640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x563c8ace06a0 0x563c8ace2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6dc6219640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c9003c780 0x7f6c9003ec40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc053fd0 tx=0x7f6dbc053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6dc721b640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x563c8ace06a0 0x563c8ace2b30 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dc00083e0 con 0x563c8ace06a0 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6dcad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6dcad2f800 20 realm 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6dcad2f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.002+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3690 con 0x563c8ace06a0 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dc00083e0 con 0x563c8ace06a0 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dcad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dcad2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:46.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dcad2f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace06a0 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dc00083e0 con 0x563c8ace06a0 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dcad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dcad2f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace4300 con 0x563c8ace06a0 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6dc00083e0 con 0x563c8ace06a0 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dcad2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dcad2f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x563c8ace4a50 0x563c8ace6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace75d0 con 0x563c8ace4a50 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.003+0000 7f6dc6a1a640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x563c8ace4a50 0x563c8ace6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.004+0000 7f6dc6a1a640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x563c8ace4a50 0x563c8ace6e40 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.004+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.004+0000 7f6dcad2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:46.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.004+0000 7f6dcad2f800 20 searching for the correct realm 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.004+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x563c8ace96c0 0x563c8acebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.004+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8acec250 con 0x563c8ace96c0 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.004+0000 7f6dc6219640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x563c8ace96c0 0x563c8acebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.005+0000 7f6dc6219640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x563c8ace96c0 0x563c8acebb80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.005+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.005+0000 7f6dc6219640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6dbc05f040 0x7f6dbc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.005+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8acec250 con 0x7f6dbc05f040 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.005+0000 7f6dc721b640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6dbc05f040 0x7f6dbc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.005+0000 7f6dc721b640 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6dbc05f040 0x7f6dbc06b410 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.005+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6dc00083e0 con 0x7f6dbc05f040 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.005+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace4a50 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.006+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.006+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace06a0 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.006+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083e0 con 0x563c8ace06a0 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.006+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace06a0 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.006+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc0026040 con 0x563c8ace06a0 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.006+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace4a50 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.007+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.007+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace4a50 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.007+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.007+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x7f6dbc05f040 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.007+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc0026040 con 0x7f6dbc05f040 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.007+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace96c0 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.007+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.007+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace06a0 2024-09-10T05:12:46.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.007+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc0026040 con 0x563c8ace06a0 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.008+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace4a50 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.008+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.008+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace06a0 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.008+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc0026040 con 0x563c8ace06a0 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.008+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x7f6dbc05f040 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.008+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6dc0026040 con 0x7f6dbc05f040 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.008+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace96c0 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.008+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.009+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace96c0 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.009+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.009+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace4a50 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.009+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.009+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace96c0 2024-09-10T05:12:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.009+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.009+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace96c0 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.009+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.009+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace06a0 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.010+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc0026040 con 0x563c8ace06a0 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.010+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace06a0 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.010+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6dc0026040 con 0x563c8ace06a0 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.010+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x7f6dbc05f040 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.010+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc0026040 con 0x7f6dbc05f040 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.010+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace96c0 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.010+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.010+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x7f6dbc05f040 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.011+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc0026040 con 0x7f6dbc05f040 2024-09-10T05:12:46.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.011+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace06a0 2024-09-10T05:12:46.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.011+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.011+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace4a50 2024-09-10T05:12:46.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.011+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.011+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace96c0 2024-09-10T05:12:46.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.011+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.011+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace4a50 2024-09-10T05:12:46.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.012+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.012+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x7f6dbc05f040 2024-09-10T05:12:46.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.012+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc0035040 con 0x7f6dbc05f040 2024-09-10T05:12:46.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.012+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x563c8ace96c0 2024-09-10T05:12:46.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.012+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.012+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f60 con 0x7f6dbc05f040 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.012+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc0035040 con 0x7f6dbc05f040 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.012+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f6dc003a040 con 0x563c8ace06a0 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f6dc003a040 con 0x7f6dbc05f040 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc0035040 con 0x7f6dbc05f040 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f40 con 0x563c8ace06a0 2024-09-10T05:12:46.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f40 con 0x563c8ace06a0 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.013+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace3f40 con 0x7f6dbc05f040 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6dc0035040 con 0x7f6dbc05f040 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 20 zone default found 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 4 Realm: () 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:46.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 20 zonegroup default 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8ace7f50 con 0x563c8ace4a50 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8aced6e0 con 0x563c8ace96c0 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.014+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8acedbd0 con 0x563c8ace96c0 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.015+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.015+0000 7f6dcad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.015+0000 7f6dcad2f800 20 started sync module instance, tier type = 2024-09-10T05:12:46.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.015+0000 7f6dcad2f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:46.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.015+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acecb80 con 0x7f6dbc05f040 2024-09-10T05:12:46.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.016+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x7f6dbc05f040 2024-09-10T05:12:46.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.016+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94818026836128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acecb80 con 0x7f6dbc05f040 2024-09-10T05:12:46.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.016+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acee700 con 0x563c8ace06a0 2024-09-10T05:12:46.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.017+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94818026836128] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x7f6dbc05f040 2024-09-10T05:12:46.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.017+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.017+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94818026840528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acecb80 con 0x563c8ace06a0 2024-09-10T05:12:46.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.017+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acef1b0 con 0x563c8ace96c0 2024-09-10T05:12:46.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.018+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94818026840528] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.018+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.018+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94818026833616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acecaf0 con 0x563c8ace96c0 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.018+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf0070 con 0x7f6dbc05f040 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.019+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94818026833616] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.019+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x7f6dbc05f040 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.019+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94818026847168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf0490 con 0x7f6dbc05f040 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.019+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf0e50 con 0x563c8ace06a0 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.021+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.021+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94818026850720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf1270 con 0x563c8ace06a0 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.021+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf1d20 con 0x563c8ace4a50 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.021+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94818026847168] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x7f6dbc05f040 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.022+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.022+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94818026848224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf2110 con 0x563c8ace4a50 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.022+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94818026850720] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.022+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf0dc0 con 0x563c8ace4a50 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.023+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94818026848224] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.023+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.023+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94818026858016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf2ef0 con 0x563c8ace4a50 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.023+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf3740 con 0x563c8ace4a50 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.024+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(58 notify.7 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.024+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94818026858016] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.024+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94818026860784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf3b40 con 0x563c8ace4a50 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.024+0000 7f6dcad2f800 20 add_watcher() i=0 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.024+0000 7f6dcad2f800 20 add_watcher() i=1 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.024+0000 7f6dcad2f800 20 add_watcher() i=2 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.024+0000 7f6dcad2f800 20 add_watcher() i=3 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.024+0000 7f6dcad2f800 20 add_watcher() i=4 2024-09-10T05:12:46.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.024+0000 7f6dcad2f800 20 add_watcher() i=5 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.024+0000 7f6dcad2f800 20 add_watcher() i=6 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.025+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94818026860784] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.025+0000 7f6dcad2f800 20 add_watcher() i=7 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.025+0000 7f6dcad2f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.025+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf2b30 con 0x563c8ace06a0 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.025+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.025+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94818026862032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf4410 con 0x563c8ace06a0 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.026+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94818026862032] v37'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.026+0000 7f6c7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.026+0000 7f6dcad2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.026+0000 7f6dcad2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.026+0000 7f6dcad2f800 5 note: GC not initialized 2024-09-10T05:12:46.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.026+0000 7f6bf7fff640 20 reqs_thread_entry: start 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.027+0000 7f6dcad2f800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.027+0000 7f6dcad2f800 20 Filter name: none 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.027+0000 7f6bf5ffb640 20 reqs_thread_entry: start 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.027+0000 7f6dcad2f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.027+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8ad29800 con 0x563c8ace06a0 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.027+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.027+0000 7f6dcad2f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.027+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563c8ad2ac20 con 0x563c8ace4a50 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.028+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.029+0000 7f6c7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.029+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94818026862032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8ad29120 con 0x563c8ace06a0 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.030+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94818026862032] v37'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.030+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94818026836128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf3590 con 0x7f6dbc05f040 2024-09-10T05:12:46.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.031+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94818026836128] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x7f6dbc05f040 2024-09-10T05:12:46.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.031+0000 7f6dcad2f800 20 remove_watcher() i=0 2024-09-10T05:12:46.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.031+0000 7f6dcad2f800 2 removed watcher, disabling cache 2024-09-10T05:12:46.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.031+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94818026840528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8aced0a0 con 0x563c8ace06a0 2024-09-10T05:12:46.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.032+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94818026840528] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.032+0000 7f6dcad2f800 20 remove_watcher() i=1 2024-09-10T05:12:46.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.032+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94818026833616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8aced0a0 con 0x563c8ace96c0 2024-09-10T05:12:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.033+0000 7f6dc6219640 1 -- 172.21.15.192:0/2773379506 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94818026833616] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dbc07c040 con 0x563c8ace96c0 2024-09-10T05:12:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.033+0000 7f6dcad2f800 20 remove_watcher() i=2 2024-09-10T05:12:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.033+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94818026847168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acec6d0 con 0x7f6dbc05f040 2024-09-10T05:12:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.034+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94818026847168] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x7f6dbc05f040 2024-09-10T05:12:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.034+0000 7f6dcad2f800 20 remove_watcher() i=3 2024-09-10T05:12:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.034+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94818026850720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8aced0a0 con 0x563c8ace06a0 2024-09-10T05:12:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.035+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94818026850720] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc0035040 con 0x563c8ace06a0 2024-09-10T05:12:46.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.035+0000 7f6dcad2f800 20 remove_watcher() i=4 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.035+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94818026848224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acefbc0 con 0x563c8ace4a50 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.036+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94818026848224] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.036+0000 7f6dcad2f800 20 remove_watcher() i=5 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.036+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94818026858016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acec6d0 con 0x563c8ace4a50 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.037+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94818026858016] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.037+0000 7f6dcad2f800 20 remove_watcher() i=6 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.037+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94818026860784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563c8acf09a0 con 0x563c8ace4a50 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dc6a1a640 1 -- 172.21.15.192:0/2773379506 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94818026860784] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db801b070 con 0x563c8ace4a50 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 20 remove_watcher() i=7 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x563c8ace4a50 msgr2=0x563c8ace6e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x563c8ace4a50 0x563c8ace6e40 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x563c8ace06a0 msgr2=0x563c8ace2b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x563c8ace06a0 0x563c8ace2b30 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6dbc05f040 msgr2=0x7f6dbc06b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6dbc05f040 0x7f6dbc06b410 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x563c8ace96c0 msgr2=0x563c8acebb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x563c8ace96c0 0x563c8acebb80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c9003c780 msgr2=0x7f6c9003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6c9003c780 0x7f6c9003ec40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc053fd0 tx=0x7f6dbc053000 comp rx=0 tx=0).stop 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dc721b640 1 -- 172.21.15.192:0/2773379506 reap_dead start 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 msgr2=0x563c8acd5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.038+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 0x563c8acd5100 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6db803afd0 tx=0x7f6db8031ec0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 shutdown_connections 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2773379506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8accdca0 0x563c8acd5100 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 >> 172.21.15.192:0/2773379506 conn(0x563c8acca0a0 msgr2=0x563c8acc82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 shutdown_connections 2024-09-10T05:12:46.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2773379506 wait complete. 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2951252025 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6ca003c780 msgr2=0x7f6ca003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2951252025 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6ca003c780 0x7f6ca003ec40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x563c8acabca0 tx=0x7f6dbc005a00 comp rx=0 tx=0).stop 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2951252025 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8acc13e0 msgr2=0x563c8acc1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2951252025 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8acc13e0 0x563c8acc1800 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6db8052020 tx=0x7f6db804b290 comp rx=0 tx=0).stop 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2951252025 shutdown_connections 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2951252025 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6ca003c780 0x7f6ca003ec40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/2951252025 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8acc13e0 0x563c8acc1800 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2951252025 >> 172.21.15.192:0/2951252025 conn(0x563c8acb5790 msgr2=0x563c8acb5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2951252025 shutdown_connections 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/2951252025 wait complete. 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x563c8acacbb0 msgr2=0x563c8acaf030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x563c8acacbb0 0x563c8acaf030 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x563c8ab1fb70 msgr2=0x563c8acaa7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x563c8ab1fb70 0x563c8acaa7d0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x563c8acb0c20 msgr2=0x563c8acb3010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x563c8acb0c20 0x563c8acb3010 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6cac03c730 msgr2=0x7f6cac03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.039+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6cac03c730 0x7f6cac03ebf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc057000 tx=0x7f6dbc052000 comp rx=0 tx=0).stop 2024-09-10T05:12:46.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.040+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 msgr2=0x563c8aca3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.040+0000 7f6dcad2f800 1 --2- 172.21.15.192:0/1912324271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c8ab1e7e0 0x563c8aca3180 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6db80066b0 tx=0x7f6db8001250 comp rx=0 tx=0).stop 2024-09-10T05:12:46.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.040+0000 7f6dc721b640 1 -- 172.21.15.192:0/1912324271 reap_dead start 2024-09-10T05:12:46.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.040+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 shutdown_connections 2024-09-10T05:12:46.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.040+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 >> 172.21.15.192:0/1912324271 conn(0x563c8aba53d0 msgr2=0x563c8ac9cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.040+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 shutdown_connections 2024-09-10T05:12:46.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.040+0000 7f6dcad2f800 1 -- 172.21.15.192:0/1912324271 wait complete. 2024-09-10T05:12:46.049 INFO:teuthology.orchestra.run.smithi192.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:12:46.049 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:12:46.049 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-10T05:12:46.050 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-10T05:12:46.050 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-10T05:12:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:46.096 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:46.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.096+0000 7f1c12287800 1 Processor -- start 2024-09-10T05:12:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.096+0000 7f1c12287800 1 -- start start 2024-09-10T05:12:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.097+0000 7f1c12287800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55e1cb2106a0 0x55e1cb212a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.097+0000 7f1c12287800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e1cb0b9e40 con 0x55e1cb213030 2024-09-10T05:12:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.097+0000 7f1c12287800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55e1cb084680 con 0x55e1cb2106a0 2024-09-10T05:12:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.097+0000 7f1c0fd71640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55e1cb2106a0 0x55e1cb212a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.097+0000 7f1c07570640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55e1cb213030 0x55e1cb2154f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:34234/0 (socket says 172.21.15.192:34234) 2024-09-10T05:12:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.097+0000 7f1c07570640 1 -- 172.21.15.192:0/1819464001 learned_addr learned my addr 172.21.15.192:0/1819464001 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.097+0000 7f1c0fd71640 1 -- 172.21.15.192:0/1819464001 >> v1:172.21.15.139:6789/0 conn(0x55e1cb213030 legacy=0x55e1cb2154f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.097+0000 7f1c0fd71640 1 -- 172.21.15.192:0/1819464001 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1cb0a06b0 con 0x55e1cb2106a0 2024-09-10T05:12:46.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.099+0000 7f1c0fd71640 1 --2- 172.21.15.192:0/1819464001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb212a90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000a470 tx=0x7f1c00045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebc864c7b38aada server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.099+0000 7f1c0f570640 1 -- 172.21.15.192:0/1819464001 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c00053570 con 0x55e1cb2106a0 2024-09-10T05:12:46.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.099+0000 7f1c0f570640 1 -- 172.21.15.192:0/1819464001 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c00058070 con 0x55e1cb2106a0 2024-09-10T05:12:46.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.099+0000 7f1c0f570640 1 -- 172.21.15.192:0/1819464001 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c00053880 con 0x55e1cb2106a0 2024-09-10T05:12:46.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.100+0000 7f1c12287800 1 -- 172.21.15.192:0/1819464001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 msgr2=0x55e1cb212a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.100+0000 7f1c12287800 1 --2- 172.21.15.192:0/1819464001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb212a90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1c0000a470 tx=0x7f1c00045a20 comp rx=0 tx=0).stop 2024-09-10T05:12:46.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.100+0000 7f1c12287800 1 -- 172.21.15.192:0/1819464001 shutdown_connections 2024-09-10T05:12:46.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.100+0000 7f1c12287800 1 --2- 172.21.15.192:0/1819464001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb212a90 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.100+0000 7f1c12287800 1 -- 172.21.15.192:0/1819464001 >> 172.21.15.192:0/1819464001 conn(0x55e1cb20a200 msgr2=0x55e1cb20c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.100+0000 7f1c12287800 1 -- 172.21.15.192:0/1819464001 shutdown_connections 2024-09-10T05:12:46.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.100+0000 7f1c12287800 1 -- 172.21.15.192:0/1819464001 wait complete. 2024-09-10T05:12:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.113+0000 7f1c12287800 1 Processor -- start 2024-09-10T05:12:46.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.113+0000 7f1c12287800 1 -- start start 2024-09-10T05:12:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.114+0000 7f1c12287800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb2ff6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.114+0000 7f1c12287800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e1cb0a8dd0 con 0x55e1cb2106a0 2024-09-10T05:12:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.114+0000 7f1c0fd71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb2ff6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.114+0000 7f1c0fd71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb2ff6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42534/0 (socket says 172.21.15.192:42534) 2024-09-10T05:12:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.114+0000 7f1c0fd71640 1 -- 172.21.15.192:0/2500180630 learned_addr learned my addr 172.21.15.192:0/2500180630 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.114+0000 7f1c0fd71640 1 -- 172.21.15.192:0/2500180630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1cb0c1e10 con 0x55e1cb2106a0 2024-09-10T05:12:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.115+0000 7f1c0fd71640 1 --2- 172.21.15.192:0/2500180630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb2ff6a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1c00025c20 tx=0x7f1c00051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b3a9a009beb1df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.115+0000 7f1afde0b640 1 -- 172.21.15.192:0/2500180630 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c00053a20 con 0x55e1cb2106a0 2024-09-10T05:12:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.115+0000 7f1afde0b640 1 -- 172.21.15.192:0/2500180630 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c00063070 con 0x55e1cb2106a0 2024-09-10T05:12:46.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.115+0000 7f1afde0b640 1 -- 172.21.15.192:0/2500180630 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c00053cf0 con 0x55e1cb2106a0 2024-09-10T05:12:46.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.115+0000 7f1c12287800 1 -- 172.21.15.192:0/2500180630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 msgr2=0x55e1cb2ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.115+0000 7f1c12287800 1 --2- 172.21.15.192:0/2500180630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb2ff6a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1c00025c20 tx=0x7f1c00051000 comp rx=0 tx=0).stop 2024-09-10T05:12:46.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.115+0000 7f1c12287800 1 -- 172.21.15.192:0/2500180630 shutdown_connections 2024-09-10T05:12:46.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.115+0000 7f1c12287800 1 --2- 172.21.15.192:0/2500180630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb2ff6a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.115+0000 7f1c12287800 1 -- 172.21.15.192:0/2500180630 >> 172.21.15.192:0/2500180630 conn(0x55e1cb20a200 msgr2=0x55e1cb2fb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.116+0000 7f1c12287800 1 -- 172.21.15.192:0/2500180630 shutdown_connections 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.116+0000 7f1c12287800 1 -- 172.21.15.192:0/2500180630 wait complete. 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.116+0000 7f1c12287800 1 Processor -- start 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.116+0000 7f1c12287800 1 -- start start 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.116+0000 7f1c12287800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb20fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.116+0000 7f1c12287800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e1cb217050 con 0x55e1cb2106a0 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.116+0000 7f1c0fd71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb20fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.116+0000 7f1c0fd71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb20fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42536/0 (socket says 172.21.15.192:42536) 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.116+0000 7f1c0fd71640 1 -- 172.21.15.192:0/1929420957 learned_addr learned my addr 172.21.15.192:0/1929420957 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.116+0000 7f1c0fd71640 1 -- 172.21.15.192:0/1929420957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1cb210320 con 0x55e1cb2106a0 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.117+0000 7f1c0fd71640 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb20fdc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1c00025c20 tx=0x7f1c00002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.117+0000 7f1af7fff640 1 -- 172.21.15.192:0/1929420957 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c0006c030 con 0x55e1cb2106a0 2024-09-10T05:12:46.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.117+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1cb20e6d0 con 0x55e1cb2106a0 2024-09-10T05:12:46.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.117+0000 7f1af7fff640 1 -- 172.21.15.192:0/1929420957 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c00068660 con 0x55e1cb2106a0 2024-09-10T05:12:46.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.117+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1cb20ec90 con 0x55e1cb2106a0 2024-09-10T05:12:46.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.117+0000 7f1af7fff640 1 -- 172.21.15.192:0/1929420957 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c00068940 con 0x55e1cb2106a0 2024-09-10T05:12:46.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.118+0000 7f1af7fff640 1 -- 172.21.15.192:0/1929420957 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1c00068ae0 con 0x55e1cb2106a0 2024-09-10T05:12:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.118+0000 7f1af7fff640 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1af803c730 0x7f1af803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.118+0000 7f1af7fff640 1 -- 172.21.15.192:0/1929420957 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1c000980e0 con 0x55e1cb2106a0 2024-09-10T05:12:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.118+0000 7f1c07570640 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1af803c730 0x7f1af803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.118+0000 7f1c12287800 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e1cb213030 0x55e1cb3103e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.118+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb310920 con 0x55e1cb213030 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.118+0000 7f1c10572640 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e1cb213030 0x55e1cb3103e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.118+0000 7f1c07570640 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1af803c730 0x7f1af803ebf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8001d70 tx=0x7f1bf80012d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.119+0000 7f1c10572640 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e1cb213030 0x55e1cb3103e0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.119+0000 7f1c10572640 1 -- 172.21.15.192:0/1929420957 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb213030 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.119+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb20f190 con 0x55e1cb213030 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.119+0000 7f1c10572640 1 -- 172.21.15.192:0/1929420957 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb213030 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.119+0000 7f1c12287800 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e1cb312c10 0x55e1cb315000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.119+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb3156d0 con 0x55e1cb312c10 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.119+0000 7f1c0fd71640 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e1cb312c10 0x55e1cb315000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.120+0000 7f1c0fd71640 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e1cb312c10 0x55e1cb315000 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.120+0000 7f1c0fd71640 1 -- 172.21.15.192:0/1929420957 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1c00051070 con 0x55e1cb312c10 2024-09-10T05:12:46.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.120+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb311ab0 con 0x55e1cb213030 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.120+0000 7f1c10572640 1 -- 172.21.15.192:0/1929420957 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb213030 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.120+0000 7f1c12287800 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e1cb316b10 0x55e1cb318f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.120+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb319640 con 0x55e1cb316b10 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.120+0000 7f1c07570640 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e1cb316b10 0x55e1cb318f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.121+0000 7f1c07570640 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e1cb316b10 0x55e1cb318f00 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.121+0000 7f1c07570640 1 -- 172.21.15.192:0/1929420957 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb316b10 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.121+0000 7f1c12287800 1 Processor -- start 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.121+0000 7f1c12287800 1 -- start start 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.121+0000 7f1c12287800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb3272a0 0x55e1cb3276c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.121+0000 7f1c12287800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e1cb106a00 con 0x55e1cb3272a0 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.122+0000 7f1c0fd71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb3272a0 0x55e1cb3276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.122+0000 7f1c0fd71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb3272a0 0x55e1cb3276c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42548/0 (socket says 172.21.15.192:42548) 2024-09-10T05:12:46.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.122+0000 7f1c0fd71640 1 -- 172.21.15.192:0/757253647 learned_addr learned my addr 172.21.15.192:0/757253647 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.122+0000 7f1c0fd71640 1 -- 172.21.15.192:0/757253647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1cb327d00 con 0x55e1cb3272a0 2024-09-10T05:12:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.122+0000 7f1c0fd71640 1 --2- 172.21.15.192:0/757253647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb3272a0 0x55e1cb3276c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1c00096680 tx=0x7f1c0005de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.122+0000 7f1af57fa640 1 -- 172.21.15.192:0/757253647 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c0008f990 con 0x55e1cb3272a0 2024-09-10T05:12:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.122+0000 7f1af57fa640 1 -- 172.21.15.192:0/757253647 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0008fb30 con 0x55e1cb3272a0 2024-09-10T05:12:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.122+0000 7f1c12287800 1 -- 172.21.15.192:0/757253647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1cb328530 con 0x55e1cb3272a0 2024-09-10T05:12:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.122+0000 7f1af57fa640 1 -- 172.21.15.192:0/757253647 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c0008fe10 con 0x55e1cb3272a0 2024-09-10T05:12:46.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.122+0000 7f1c12287800 1 -- 172.21.15.192:0/757253647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1cb328530 con 0x55e1cb3272a0 2024-09-10T05:12:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.123+0000 7f1af57fa640 1 -- 172.21.15.192:0/757253647 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1c0008f400 con 0x55e1cb3272a0 2024-09-10T05:12:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.123+0000 7f1af57fa640 1 --2- 172.21.15.192:0/757253647 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ae803c730 0x7f1ae803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.123+0000 7f1af57fa640 1 -- 172.21.15.192:0/757253647 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1c00092050 con 0x55e1cb3272a0 2024-09-10T05:12:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.123+0000 7f1c07570640 1 --2- 172.21.15.192:0/757253647 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ae803c730 0x7f1ae803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.124+0000 7f1c12287800 1 Processor -- start 2024-09-10T05:12:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.124+0000 7f1c12287800 1 -- start start 2024-09-10T05:12:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.124+0000 7f1c07570640 1 --2- 172.21.15.192:0/757253647 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ae803c730 0x7f1ae803ebf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800bf40 tx=0x7f1bf800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.124+0000 7f1c12287800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 0x55e1cb333d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.124+0000 7f1c12287800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e1cb2ffe90 con 0x55e1cb333930 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.124+0000 7f1c0fd71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 0x55e1cb333d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.124+0000 7f1c0fd71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 0x55e1cb333d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42562/0 (socket says 172.21.15.192:42562) 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.124+0000 7f1c0fd71640 1 -- 172.21.15.192:0/840024795 learned_addr learned my addr 172.21.15.192:0/840024795 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.124+0000 7f1c0fd71640 1 -- 172.21.15.192:0/840024795 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1cb334300 con 0x55e1cb333930 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.124+0000 7f1c0fd71640 1 --2- 172.21.15.192:0/840024795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 0x55e1cb333d10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1c0005ef40 tx=0x7f1c00098b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e8d85814054e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.125+0000 7f1aeeffd640 1 -- 172.21.15.192:0/840024795 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c000ab020 con 0x55e1cb333930 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.125+0000 7f1aeeffd640 1 -- 172.21.15.192:0/840024795 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c00086450 con 0x55e1cb333930 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.125+0000 7f1aeeffd640 1 -- 172.21.15.192:0/840024795 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c0005c410 con 0x55e1cb333930 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.125+0000 7f1c12287800 1 -- 172.21.15.192:0/840024795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 msgr2=0x55e1cb333d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.125+0000 7f1c12287800 1 --2- 172.21.15.192:0/840024795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 0x55e1cb333d10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1c0005ef40 tx=0x7f1c00098b50 comp rx=0 tx=0).stop 2024-09-10T05:12:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.125+0000 7f1c12287800 1 -- 172.21.15.192:0/840024795 shutdown_connections 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.125+0000 7f1c12287800 1 --2- 172.21.15.192:0/840024795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 0x55e1cb333d10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.125+0000 7f1c12287800 1 -- 172.21.15.192:0/840024795 >> 172.21.15.192:0/840024795 conn(0x55e1cb32fd30 msgr2=0x55e1cb32df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.125+0000 7f1c12287800 1 -- 172.21.15.192:0/840024795 shutdown_connections 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.125+0000 7f1c12287800 1 -- 172.21.15.192:0/840024795 wait complete. 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.125+0000 7f1c12287800 1 Processor -- start 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.125+0000 7f1c12287800 1 -- start start 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.126+0000 7f1c12287800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 0x55e1cb33ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.126+0000 7f1c12287800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e1cb334790 con 0x55e1cb333930 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.126+0000 7f1c0fd71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 0x55e1cb33ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.126+0000 7f1c0fd71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 0x55e1cb33ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42568/0 (socket says 172.21.15.192:42568) 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.126+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 learned_addr learned my addr 172.21.15.192:0/166094630 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.126+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1cb33b2d0 con 0x55e1cb333930 2024-09-10T05:12:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.126+0000 7f1c0fd71640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 0x55e1cb33ad70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1c00086600 tx=0x7f1c00051ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.126+0000 7f1aed7fa640 1 -- 172.21.15.192:0/166094630 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c0005c410 con 0x55e1cb333930 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.126+0000 7f1aed7fa640 1 -- 172.21.15.192:0/166094630 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c000853b0 con 0x55e1cb333930 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.126+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1cb33b2d0 con 0x55e1cb333930 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.126+0000 7f1aed7fa640 1 -- 172.21.15.192:0/166094630 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c0005c5b0 con 0x55e1cb333930 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.126+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1cb33b2d0 con 0x55e1cb333930 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.127+0000 7f1aed7fa640 1 -- 172.21.15.192:0/166094630 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1c000ae020 con 0x55e1cb333930 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.127+0000 7f1aed7fa640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ad803c730 0x7f1ad803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.127+0000 7f1aed7fa640 1 -- 172.21.15.192:0/166094630 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1c000bcd40 con 0x55e1cb333930 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.127+0000 7f1c07570640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ad803c730 0x7f1ad803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c12287800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c12287800 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e1cb3462f0 0x55e1cb3487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb348f00 con 0x55e1cb3462f0 2024-09-10T05:12:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c10572640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e1cb3462f0 0x55e1cb3487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c07570640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ad803c730 0x7f1ad803ebf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800c010 tx=0x7f1bf8010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c10572640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e1cb3462f0 0x55e1cb3487b0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c12287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c12287800 20 realm 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c12287800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349310 con 0x55e1cb3462f0 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c12287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c12287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c12287800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.128+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349be0 con 0x55e1cb3462f0 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.129+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.129+0000 7f1c12287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.129+0000 7f1c12287800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.129+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb3462f0 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.129+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.129+0000 7f1c12287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.129+0000 7f1c12287800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.129+0000 7f1c12287800 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e1cb34aa70 0x55e1cb34ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.129+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb34d5a0 con 0x55e1cb34aa70 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.129+0000 7f1c0fd71640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e1cb34aa70 0x55e1cb34ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.130+0000 7f1c0fd71640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e1cb34aa70 0x55e1cb34ce60 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.130+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.130+0000 7f1c12287800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.130+0000 7f1c12287800 20 searching for the correct realm 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.130+0000 7f1c12287800 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e1cb34f640 0x55e1cb351b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.130+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb3521d0 con 0x55e1cb34f640 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.130+0000 7f1c07570640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e1cb34f640 0x55e1cb351b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.130+0000 7f1c07570640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e1cb34f640 0x55e1cb351b00 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.131+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.131+0000 7f1c07570640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1bf8037040 0x7f1bf8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.131+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb3521d0 con 0x7f1bf8037040 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.131+0000 7f1c10572640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1bf8037040 0x7f1bf8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.131+0000 7f1c10572640 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1bf8037040 0x7f1bf8036410 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.131+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.131+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34aa70 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.132+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.132+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb3462f0 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.132+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.132+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb3462f0 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.132+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.132+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34aa70 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.133+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.133+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34aa70 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.133+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.133+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x7f1bf8037040 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.133+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.133+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34f640 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.133+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.133+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb3462f0 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.133+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.133+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34aa70 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.134+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.134+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb3462f0 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.134+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.134+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x7f1bf8037040 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.134+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.134+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34f640 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.134+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.135+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34f640 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.135+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.135+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34aa70 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.135+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.135+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34f640 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.135+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.135+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34f640 2024-09-10T05:12:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.135+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.135+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb3462f0 2024-09-10T05:12:46.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.136+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.136+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb3462f0 2024-09-10T05:12:46.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.136+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.136+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x7f1bf8037040 2024-09-10T05:12:46.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.136+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.136+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34f640 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.136+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.136+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x7f1bf8037040 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.137+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.137+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb3462f0 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.137+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.137+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34aa70 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.137+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.137+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34f640 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.137+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.137+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34aa70 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.138+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.138+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x7f1bf8037040 2024-09-10T05:12:46.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.138+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.138+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb34f640 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.138+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.138+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x7f1bf8037040 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.138+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.138+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x55e1cb3462f0 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb349f80 con 0x7f1bf8037040 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:46.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb34df40 con 0x55e1cb3462f0 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb34df40 con 0x55e1cb3462f0 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.139+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb34def0 con 0x7f1bf8037040 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 20 zone default found 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 4 Realm: () 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 20 zonegroup default 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb34e330 con 0x55e1cb34aa70 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb354040 con 0x55e1cb34f640 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb3543e0 con 0x55e1cb34f640 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.140+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.141+0000 7f1c12287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.141+0000 7f1c12287800 20 started sync module instance, tier type = 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.141+0000 7f1c12287800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.141+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb3534e0 con 0x7f1bf8037040 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.142+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.142+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94428265265360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb3534e0 con 0x7f1bf8037040 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.142+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb354c30 con 0x55e1cb3462f0 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.143+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94428265265360] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.143+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.143+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94428265269600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb3534e0 con 0x55e1cb3462f0 2024-09-10T05:12:46.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.143+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb355680 con 0x55e1cb34f640 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.144+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94428265269600] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.144+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.144+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94428265263152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb353450 con 0x55e1cb34f640 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.144+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb356540 con 0x7f1bf8037040 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.145+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94428265263152] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.146+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.146+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94428265275536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb356960 con 0x7f1bf8037040 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.146+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb357210 con 0x55e1cb3462f0 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.147+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.147+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94428265277792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb356d80 con 0x55e1cb3462f0 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.147+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94428265275536] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.147+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb3564f0 con 0x55e1cb34aa70 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.148+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.148+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94428265282688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb358550 con 0x55e1cb34aa70 2024-09-10T05:12:46.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.148+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb358fd0 con 0x55e1cb34aa70 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.149+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.149+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94428265286336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb359800 con 0x55e1cb34aa70 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.149+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb35a320 con 0x55e1cb34aa70 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.149+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94428265277792] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.149+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94428265282688] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.150+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(58 notify.7 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.150+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94428265286336] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.150+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94428265283744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb357600 con 0x55e1cb34aa70 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.150+0000 7f1c12287800 20 add_watcher() i=0 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.150+0000 7f1c12287800 20 add_watcher() i=1 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.150+0000 7f1c12287800 20 add_watcher() i=2 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.150+0000 7f1c12287800 20 add_watcher() i=3 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.150+0000 7f1c12287800 20 add_watcher() i=4 2024-09-10T05:12:46.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.150+0000 7f1c12287800 20 add_watcher() i=5 2024-09-10T05:12:46.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.150+0000 7f1c12287800 20 add_watcher() i=6 2024-09-10T05:12:46.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.152+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94428265283744] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.152+0000 7f1c12287800 20 add_watcher() i=7 2024-09-10T05:12:46.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.152+0000 7f1c12287800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:46.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.152+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb359290 con 0x55e1cb3462f0 2024-09-10T05:12:46.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.153+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.153+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94428265291248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb359250 con 0x55e1cb3462f0 2024-09-10T05:12:46.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.154+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94428265291248] v37'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.154+0000 7f1ac5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:46.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.154+0000 7f1c12287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:46.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.154+0000 7f1c12287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:46.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.154+0000 7f1c12287800 5 note: GC not initialized 2024-09-10T05:12:46.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.154+0000 7f1ac4fe1640 20 reqs_thread_entry: start 2024-09-10T05:12:46.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.154+0000 7f1c12287800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:46.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.154+0000 7f1c12287800 20 Filter name: none 2024-09-10T05:12:46.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.154+0000 7f1a3e7fc640 20 reqs_thread_entry: start 2024-09-10T05:12:46.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.154+0000 7f1c12287800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.154+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb38f860 con 0x55e1cb3462f0 2024-09-10T05:12:46.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.155+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.155+0000 7f1c12287800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:12:46.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.155+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb390c80 con 0x55e1cb34aa70 2024-09-10T05:12:46.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.155+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.156+0000 7f1ac5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.156+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94428265291248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb38f180 con 0x55e1cb3462f0 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.157+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94428265291248] v37'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.157+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94428265265360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb359df0 con 0x7f1bf8037040 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.158+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94428265265360] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.158+0000 7f1c12287800 20 remove_watcher() i=0 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.158+0000 7f1c12287800 2 removed watcher, disabling cache 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.158+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94428265269600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb359df0 con 0x55e1cb3462f0 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.159+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94428265269600] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.159+0000 7f1c12287800 20 remove_watcher() i=1 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.159+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94428265263152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb359df0 con 0x55e1cb34f640 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.160+0000 7f1c07570640 1 -- 172.21.15.192:0/166094630 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94428265263152] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf8009050 con 0x55e1cb34f640 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.160+0000 7f1c12287800 20 remove_watcher() i=2 2024-09-10T05:12:46.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.160+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94428265275536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb353030 con 0x7f1bf8037040 2024-09-10T05:12:46.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.161+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94428265275536] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x7f1bf8037040 2024-09-10T05:12:46.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.161+0000 7f1c12287800 20 remove_watcher() i=3 2024-09-10T05:12:46.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.161+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94428265277792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb356090 con 0x55e1cb3462f0 2024-09-10T05:12:46.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.162+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94428265277792] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c0800a4d0 con 0x55e1cb3462f0 2024-09-10T05:12:46.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.162+0000 7f1c12287800 20 remove_watcher() i=4 2024-09-10T05:12:46.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.162+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94428265282688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb353030 con 0x55e1cb34aa70 2024-09-10T05:12:46.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.163+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94428265282688] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.163+0000 7f1c12287800 20 remove_watcher() i=5 2024-09-10T05:12:46.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.163+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94428265286336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb356960 con 0x55e1cb34aa70 2024-09-10T05:12:46.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.164+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94428265286336] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.164+0000 7f1c12287800 20 remove_watcher() i=6 2024-09-10T05:12:46.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.164+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94428265283744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e1cb357c80 con 0x55e1cb34aa70 2024-09-10T05:12:46.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c0fd71640 1 -- 172.21.15.192:0/166094630 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94428265283744] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c000c1020 con 0x55e1cb34aa70 2024-09-10T05:12:46.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 20 remove_watcher() i=7 2024-09-10T05:12:46.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e1cb34aa70 msgr2=0x55e1cb34ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e1cb34aa70 0x55e1cb34ce60 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e1cb3462f0 msgr2=0x55e1cb3487b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e1cb3462f0 0x55e1cb3487b0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1bf8037040 msgr2=0x7f1bf8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1bf8037040 0x7f1bf8036410 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e1cb34f640 msgr2=0x55e1cb351b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55e1cb34f640 0x55e1cb351b00 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ad803c730 msgr2=0x7f1ad803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ad803c730 0x7f1ad803ebf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800c010 tx=0x7f1bf8010000 comp rx=0 tx=0).stop 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 msgr2=0x55e1cb33ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c10572640 1 -- 172.21.15.192:0/166094630 reap_dead start 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 0x55e1cb33ad70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1c00086600 tx=0x7f1c00051ef0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 shutdown_connections 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 --2- 172.21.15.192:0/166094630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb333930 0x55e1cb33ad70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 >> 172.21.15.192:0/166094630 conn(0x55e1cb32fd30 msgr2=0x55e1cb32df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 shutdown_connections 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.165+0000 7f1c12287800 1 -- 172.21.15.192:0/166094630 wait complete. 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/757253647 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ae803c730 msgr2=0x7f1ae803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 --2- 172.21.15.192:0/757253647 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ae803c730 0x7f1ae803ebf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800bf40 tx=0x7f1bf800f000 comp rx=0 tx=0).stop 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/757253647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb3272a0 msgr2=0x55e1cb3276c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 --2- 172.21.15.192:0/757253647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb3272a0 0x55e1cb3276c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1c00096680 tx=0x7f1c0005de70 comp rx=0 tx=0).stop 2024-09-10T05:12:46.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/757253647 shutdown_connections 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 --2- 172.21.15.192:0/757253647 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ae803c730 0x7f1ae803ebf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 --2- 172.21.15.192:0/757253647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb3272a0 0x55e1cb3276c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/757253647 >> 172.21.15.192:0/757253647 conn(0x55e1cb31b650 msgr2=0x55e1cb31ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/757253647 shutdown_connections 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/757253647 wait complete. 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e1cb312c10 msgr2=0x55e1cb315000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55e1cb312c10 0x55e1cb315000 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e1cb213030 msgr2=0x55e1cb3103e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e1cb213030 0x55e1cb3103e0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e1cb316b10 msgr2=0x55e1cb318f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e1cb316b10 0x55e1cb318f00 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1af803c730 msgr2=0x7f1af803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1af803c730 0x7f1af803ebf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8001d70 tx=0x7f1bf80012d0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 msgr2=0x55e1cb20fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 --2- 172.21.15.192:0/1929420957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1cb2106a0 0x55e1cb20fdc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1c00025c20 tx=0x7f1c00002fb0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c10572640 1 -- 172.21.15.192:0/1929420957 reap_dead start 2024-09-10T05:12:46.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 shutdown_connections 2024-09-10T05:12:46.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 >> 172.21.15.192:0/1929420957 conn(0x55e1cb20a200 msgr2=0x55e1cb2f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 shutdown_connections 2024-09-10T05:12:46.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.166+0000 7f1c12287800 1 -- 172.21.15.192:0/1929420957 wait complete. 2024-09-10T05:12:46.176 INFO:teuthology.orchestra.run.smithi192.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-10T05:00:00.000000Z","epoch":1725944400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-10T05:12:46.176 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:12:46.176 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-10T05:12:46.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-10T05:12:46.176 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-10T05:12:46.228 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:46.229 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:46.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.228+0000 7f1dc3740800 1 Processor -- start 2024-09-10T05:12:46.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.228+0000 7f1dc3740800 1 -- start start 2024-09-10T05:12:46.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.228+0000 7f1dc3740800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5598ab2d56d0 0x5598ab2d7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.229+0000 7f1dc3740800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598ab17ee40 con 0x5598ab2d8060 2024-09-10T05:12:46.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.229+0000 7f1dc3740800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5598ab149680 con 0x5598ab2d56d0 2024-09-10T05:12:46.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.229+0000 7f1dbf4c0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5598ab2d56d0 0x5598ab2d7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.229+0000 7f1dbf4c0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5598ab2d56d0 0x5598ab2d7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42580/0 (socket says 172.21.15.192:42580) 2024-09-10T05:12:46.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.229+0000 7f1dbecbf640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5598ab2d8060 0x5598ab2da520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:34248/0 (socket says 172.21.15.192:34248) 2024-09-10T05:12:46.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.229+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/1506622018 learned_addr learned my addr 172.21.15.192:0/1506622018 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.229+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/1506622018 >> v1:172.21.15.139:6789/0 conn(0x5598ab2d8060 legacy=0x5598ab2da520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.229+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/1506622018 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ab1656b0 con 0x5598ab2d56d0 2024-09-10T05:12:46.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.231+0000 7f1dbf4c0640 1 --2- 172.21.15.192:0/1506622018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab2d7ac0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1db0005fd0 tx=0x7f1db0045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53658af9917934c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.231+0000 7f1dbe4be640 1 -- 172.21.15.192:0/1506622018 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db004e600 con 0x5598ab2d56d0 2024-09-10T05:12:46.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.231+0000 7f1dbe4be640 1 -- 172.21.15.192:0/1506622018 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db004e7a0 con 0x5598ab2d56d0 2024-09-10T05:12:46.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.231+0000 7f1dbe4be640 1 -- 172.21.15.192:0/1506622018 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db004eaa0 con 0x5598ab2d56d0 2024-09-10T05:12:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.232+0000 7f1dc3740800 1 -- 172.21.15.192:0/1506622018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 msgr2=0x5598ab2d7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.232+0000 7f1dc3740800 1 --2- 172.21.15.192:0/1506622018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab2d7ac0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1db0005fd0 tx=0x7f1db0045cf0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.232+0000 7f1dc3740800 1 -- 172.21.15.192:0/1506622018 shutdown_connections 2024-09-10T05:12:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.232+0000 7f1dc3740800 1 --2- 172.21.15.192:0/1506622018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab2d7ac0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.232+0000 7f1dc3740800 1 -- 172.21.15.192:0/1506622018 >> 172.21.15.192:0/1506622018 conn(0x5598ab2cf230 msgr2=0x5598ab2d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.232+0000 7f1dc3740800 1 -- 172.21.15.192:0/1506622018 shutdown_connections 2024-09-10T05:12:46.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.232+0000 7f1dc3740800 1 -- 172.21.15.192:0/1506622018 wait complete. 2024-09-10T05:12:46.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.246+0000 7f1dc3740800 1 Processor -- start 2024-09-10T05:12:46.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.246+0000 7f1dc3740800 1 -- start start 2024-09-10T05:12:46.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.246+0000 7f1dc3740800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab3c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.246+0000 7f1dc3740800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5598ab16ddd0 con 0x5598ab2d56d0 2024-09-10T05:12:46.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.246+0000 7f1dbf4c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab3c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.246+0000 7f1dbf4c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab3c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42594/0 (socket says 172.21.15.192:42594) 2024-09-10T05:12:46.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.246+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2485935812 learned_addr learned my addr 172.21.15.192:0/2485935812 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.246+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2485935812 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ab186e10 con 0x5598ab2d56d0 2024-09-10T05:12:46.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.247+0000 7f1dbf4c0640 1 --2- 172.21.15.192:0/2485935812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab3c4740 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1db0005fd0 tx=0x7f1db0050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5939b094d00aac31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.247+0000 7f1cad60a640 1 -- 172.21.15.192:0/2485935812 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db004eb40 con 0x5598ab2d56d0 2024-09-10T05:12:46.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.247+0000 7f1cad60a640 1 -- 172.21.15.192:0/2485935812 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db0066070 con 0x5598ab2d56d0 2024-09-10T05:12:46.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.247+0000 7f1cad60a640 1 -- 172.21.15.192:0/2485935812 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db004ee50 con 0x5598ab2d56d0 2024-09-10T05:12:46.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.247+0000 7f1dc3740800 1 -- 172.21.15.192:0/2485935812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 msgr2=0x5598ab3c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.247+0000 7f1dc3740800 1 --2- 172.21.15.192:0/2485935812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab3c4740 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1db0005fd0 tx=0x7f1db0050000 comp rx=0 tx=0).stop 2024-09-10T05:12:46.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.247+0000 7f1dc3740800 1 -- 172.21.15.192:0/2485935812 shutdown_connections 2024-09-10T05:12:46.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.247+0000 7f1dc3740800 1 --2- 172.21.15.192:0/2485935812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab3c4740 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.247+0000 7f1dc3740800 1 -- 172.21.15.192:0/2485935812 >> 172.21.15.192:0/2485935812 conn(0x5598ab2cf230 msgr2=0x5598ab3c00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.248+0000 7f1dc3740800 1 -- 172.21.15.192:0/2485935812 shutdown_connections 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.248+0000 7f1dc3740800 1 -- 172.21.15.192:0/2485935812 wait complete. 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.248+0000 7f1dc3740800 1 Processor -- start 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.248+0000 7f1dc3740800 1 -- start start 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.248+0000 7f1dc3740800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab3cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.248+0000 7f1dc3740800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5598ab2dc080 con 0x5598ab2d56d0 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.248+0000 7f1dbf4c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab3cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.248+0000 7f1dbf4c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab3cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42610/0 (socket says 172.21.15.192:42610) 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.248+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/3444471516 learned_addr learned my addr 172.21.15.192:0/3444471516 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.248+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/3444471516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ab3cc4c0 con 0x5598ab2d56d0 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.249+0000 7f1dbf4c0640 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab3cbf60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1db0005fd0 tx=0x7f1db0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.249+0000 7f1cabe07640 1 -- 172.21.15.192:0/3444471516 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db006d420 con 0x5598ab2d56d0 2024-09-10T05:12:46.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.249+0000 7f1cabe07640 1 -- 172.21.15.192:0/3444471516 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db0071030 con 0x5598ab2d56d0 2024-09-10T05:12:46.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.249+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598ab3cc750 con 0x5598ab2d56d0 2024-09-10T05:12:46.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.249+0000 7f1cabe07640 1 -- 172.21.15.192:0/3444471516 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db006d6f0 con 0x5598ab2d56d0 2024-09-10T05:12:46.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.249+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598ab3cd150 con 0x5598ab2d56d0 2024-09-10T05:12:46.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.250+0000 7f1cabe07640 1 -- 172.21.15.192:0/3444471516 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1db006d9a0 con 0x5598ab2d56d0 2024-09-10T05:12:46.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.250+0000 7f1cabe07640 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ca403c730 0x7f1ca403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.250+0000 7f1cabe07640 1 -- 172.21.15.192:0/3444471516 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1db00983a0 con 0x5598ab2d56d0 2024-09-10T05:12:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.250+0000 7f1dbecbf640 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ca403c730 0x7f1ca403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.250+0000 7f1dc3740800 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5598ab2d8060 0x5598ab3d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.250+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab3cdd40 con 0x5598ab2d8060 2024-09-10T05:12:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.250+0000 7f1dbfcc1640 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5598ab2d8060 0x5598ab3d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.250+0000 7f1dbecbf640 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ca403c730 0x7f1ca403ebf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1da8001e30 tx=0x7f1da8001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.251+0000 7f1dbfcc1640 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5598ab2d8060 0x5598ab3d35b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.251+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/3444471516 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1db80083e0 con 0x5598ab2d8060 2024-09-10T05:12:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.251+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab3d4030 con 0x5598ab2d8060 2024-09-10T05:12:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.251+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/3444471516 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1db80083e0 con 0x5598ab2d8060 2024-09-10T05:12:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.251+0000 7f1dc3740800 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5598ab3d5940 0x5598ab3d7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.251+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab3d8570 con 0x5598ab3d5940 2024-09-10T05:12:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.251+0000 7f1dbf4c0640 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5598ab3d5940 0x5598ab3d7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.252+0000 7f1dbf4c0640 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5598ab3d5940 0x5598ab3d7de0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.252+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/3444471516 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1db007d070 con 0x5598ab3d5940 2024-09-10T05:12:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.252+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab3d4880 con 0x5598ab2d8060 2024-09-10T05:12:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.252+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/3444471516 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1db80083e0 con 0x5598ab2d8060 2024-09-10T05:12:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.252+0000 7f1dc3740800 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5598ab3d99d0 0x5598ab3dbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.252+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab3dc530 con 0x5598ab3d99d0 2024-09-10T05:12:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.253+0000 7f1dbecbf640 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5598ab3d99d0 0x5598ab3dbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.253+0000 7f1dbecbf640 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5598ab3d99d0 0x5598ab3dbdc0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.253+0000 7f1dbecbf640 1 -- 172.21.15.192:0/3444471516 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1da800bd50 con 0x5598ab3d99d0 2024-09-10T05:12:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.253+0000 7f1dc3740800 1 Processor -- start 2024-09-10T05:12:46.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1dc3740800 1 -- start start 2024-09-10T05:12:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1dc3740800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3ea170 0x5598ab3ea590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1dc3740800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5598ab1cba00 con 0x5598ab3ea170 2024-09-10T05:12:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1dbf4c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3ea170 0x5598ab3ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1dbf4c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3ea170 0x5598ab3ea590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42612/0 (socket says 172.21.15.192:42612) 2024-09-10T05:12:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/1275502153 learned_addr learned my addr 172.21.15.192:0/1275502153 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/1275502153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ab3eabd0 con 0x5598ab3ea170 2024-09-10T05:12:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1dbf4c0640 1 --2- 172.21.15.192:0/1275502153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3ea170 0x5598ab3ea590 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1db006b010 tx=0x7f1db0061f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1ca9602640 1 -- 172.21.15.192:0/1275502153 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db0061420 con 0x5598ab3ea170 2024-09-10T05:12:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1ca9602640 1 -- 172.21.15.192:0/1275502153 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db005c040 con 0x5598ab3ea170 2024-09-10T05:12:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1ca9602640 1 -- 172.21.15.192:0/1275502153 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db006bb70 con 0x5598ab3ea170 2024-09-10T05:12:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1dc3740800 1 -- 172.21.15.192:0/1275502153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598ab3eb400 con 0x5598ab3ea170 2024-09-10T05:12:46.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.254+0000 7f1dc3740800 1 -- 172.21.15.192:0/1275502153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598ab3eb9a0 con 0x5598ab3ea170 2024-09-10T05:12:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.255+0000 7f1ca9602640 1 -- 172.21.15.192:0/1275502153 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1db006bd10 con 0x5598ab3ea170 2024-09-10T05:12:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.255+0000 7f1ca9602640 1 --2- 172.21.15.192:0/1275502153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1c9803c780 0x7f1c9803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.255+0000 7f1ca9602640 1 -- 172.21.15.192:0/1275502153 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1db0086070 con 0x5598ab3ea170 2024-09-10T05:12:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.255+0000 7f1dbecbf640 1 --2- 172.21.15.192:0/1275502153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1c9803c780 0x7f1c9803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.256+0000 7f1dc3740800 1 Processor -- start 2024-09-10T05:12:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.256+0000 7f1dc3740800 1 -- start start 2024-09-10T05:12:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.256+0000 7f1dbecbf640 1 --2- 172.21.15.192:0/1275502153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1c9803c780 0x7f1c9803ec40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5598ab3d8910 tx=0x7f1da800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.256+0000 7f1dc3740800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 0x5598ab3f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.256+0000 7f1dc3740800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5598ab3c4ed0 con 0x5598ab3f69a0 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.256+0000 7f1dbf4c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 0x5598ab3f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.256+0000 7f1dbf4c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 0x5598ab3f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42624/0 (socket says 172.21.15.192:42624) 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.256+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/1550419516 learned_addr learned my addr 172.21.15.192:0/1550419516 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.256+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/1550419516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ab3f7390 con 0x5598ab3f69a0 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.256+0000 7f1dbf4c0640 1 --2- 172.21.15.192:0/1550419516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 0x5598ab3f6da0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1db005cfd0 tx=0x7f1db0075910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc8c1c2173052fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.257+0000 7f1ca2ffd640 1 -- 172.21.15.192:0/1550419516 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db0080c40 con 0x5598ab3f69a0 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.257+0000 7f1ca2ffd640 1 -- 172.21.15.192:0/1550419516 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db0056400 con 0x5598ab3f69a0 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.257+0000 7f1ca2ffd640 1 -- 172.21.15.192:0/1550419516 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db0075590 con 0x5598ab3f69a0 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.257+0000 7f1dc3740800 1 -- 172.21.15.192:0/1550419516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 msgr2=0x5598ab3f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.257+0000 7f1dc3740800 1 --2- 172.21.15.192:0/1550419516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 0x5598ab3f6da0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1db005cfd0 tx=0x7f1db0075910 comp rx=0 tx=0).stop 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.257+0000 7f1dc3740800 1 -- 172.21.15.192:0/1550419516 shutdown_connections 2024-09-10T05:12:46.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.257+0000 7f1dc3740800 1 --2- 172.21.15.192:0/1550419516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 0x5598ab3f6da0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.257+0000 7f1dc3740800 1 -- 172.21.15.192:0/1550419516 >> 172.21.15.192:0/1550419516 conn(0x5598ab3f2da0 msgr2=0x5598ab3f0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.257+0000 7f1dc3740800 1 -- 172.21.15.192:0/1550419516 shutdown_connections 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.257+0000 7f1dc3740800 1 -- 172.21.15.192:0/1550419516 wait complete. 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.257+0000 7f1dc3740800 1 Processor -- start 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.257+0000 7f1dc3740800 1 -- start start 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.258+0000 7f1dc3740800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 0x5598ab3fdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.258+0000 7f1dc3740800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5598ab3f7800 con 0x5598ab3f69a0 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.258+0000 7f1dbf4c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 0x5598ab3fdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.258+0000 7f1dbf4c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 0x5598ab3fdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42632/0 (socket says 172.21.15.192:42632) 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.258+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 learned_addr learned my addr 172.21.15.192:0/2987183133 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.258+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ab3fe300 con 0x5598ab3f69a0 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.258+0000 7f1dbf4c0640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 0x5598ab3fdda0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1db00565b0 tx=0x7f1db0098f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.258+0000 7f1ca17fa640 1 -- 172.21.15.192:0/2987183133 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db00bb070 con 0x5598ab3f69a0 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.258+0000 7f1ca17fa640 1 -- 172.21.15.192:0/2987183133 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db0076e30 con 0x5598ab3f69a0 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.258+0000 7f1ca17fa640 1 -- 172.21.15.192:0/2987183133 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db0075590 con 0x5598ab3f69a0 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.258+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598ab3fe300 con 0x5598ab3f69a0 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.258+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598ab3fe300 con 0x5598ab3f69a0 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.259+0000 7f1ca17fa640 1 -- 172.21.15.192:0/2987183133 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f1db00be070 con 0x5598ab3f69a0 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.260+0000 7f1ca17fa640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1c8803c6e0 0x7f1c8803eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.260+0000 7f1ca17fa640 1 -- 172.21.15.192:0/2987183133 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1db00c1d50 con 0x5598ab3f69a0 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.260+0000 7f1dbecbf640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1c8803c6e0 0x7f1c8803eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.260+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.260+0000 7f1dc3740800 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5598ab409260 0x5598ab40b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.260+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40be70 con 0x5598ab409260 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.260+0000 7f1dbecbf640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1c8803c6e0 0x7f1c8803eba0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x5598ab3dc910 tx=0x7f1da8010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.260+0000 7f1dbfcc1640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5598ab409260 0x5598ab40b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dbfcc1640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5598ab409260 0x5598ab40b720 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1db80083e0 con 0x5598ab409260 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 20 realm 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40c280 con 0x5598ab409260 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1db80083e0 con 0x5598ab409260 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab409260 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1db80083e0 con 0x5598ab409260 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cef0 con 0x5598ab409260 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1db80083e0 con 0x5598ab409260 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5598ab40d8b0 0x5598ab40fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.261+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4102b0 con 0x5598ab40d8b0 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.262+0000 7f1dbf4c0640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5598ab40d8b0 0x5598ab40fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.262+0000 7f1dbf4c0640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5598ab40d8b0 0x5598ab40fca0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.262+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.262+0000 7f1dc3740800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.262+0000 7f1dc3740800 20 searching for the correct realm 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.262+0000 7f1dc3740800 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5598ab412260 0x5598ab414720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.262+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab414da0 con 0x5598ab412260 2024-09-10T05:12:46.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.263+0000 7f1dbecbf640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5598ab412260 0x5598ab414720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.263+0000 7f1dbecbf640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5598ab412260 0x5598ab414720 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.263+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.263+0000 7f1dbecbf640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1da800f070 0x7f1da802e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.263+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab414da0 con 0x7f1da800f070 2024-09-10T05:12:46.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.263+0000 7f1dbfcc1640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1da800f070 0x7f1da802e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.263+0000 7f1dbfcc1640 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1da800f070 0x7f1da802e910 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.264+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1db80083e0 con 0x7f1da800f070 2024-09-10T05:12:46.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.264+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab40d8b0 2024-09-10T05:12:46.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.264+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.264+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab409260 2024-09-10T05:12:46.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.264+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db80083e0 con 0x5598ab409260 2024-09-10T05:12:46.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.264+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab409260 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.264+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db8026040 con 0x5598ab409260 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.264+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab40d8b0 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.265+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.265+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab40d8b0 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.265+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.265+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x7f1da800f070 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.265+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db8026040 con 0x7f1da800f070 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.265+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab412260 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.265+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.265+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab409260 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.266+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db8026040 con 0x5598ab409260 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.266+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab40d8b0 2024-09-10T05:12:46.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.266+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.266+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab409260 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.266+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db8026040 con 0x5598ab409260 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.266+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x7f1da800f070 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.266+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1db8026040 con 0x7f1da800f070 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.266+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab412260 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.267+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.267+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab412260 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.267+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.267+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab40d8b0 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.267+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.267+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab412260 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.267+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.267+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab412260 2024-09-10T05:12:46.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.267+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.268+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab409260 2024-09-10T05:12:46.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.268+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db8026040 con 0x5598ab409260 2024-09-10T05:12:46.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.268+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab409260 2024-09-10T05:12:46.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.268+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1db8026040 con 0x5598ab409260 2024-09-10T05:12:46.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.268+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x7f1da800f070 2024-09-10T05:12:46.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.268+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db8026040 con 0x7f1da800f070 2024-09-10T05:12:46.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.268+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab412260 2024-09-10T05:12:46.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.268+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.268+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x7f1da800f070 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.269+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db8026040 con 0x7f1da800f070 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.269+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab409260 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.269+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.269+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab40d8b0 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.269+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.269+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab412260 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.269+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.269+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab40d8b0 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.270+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.270+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x7f1da800f070 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.270+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db8035040 con 0x7f1da800f070 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.270+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab412260 2024-09-10T05:12:46.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.270+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.270+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x7f1da800f070 2024-09-10T05:12:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.270+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db8035040 con 0x7f1da800f070 2024-09-10T05:12:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.270+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f1db803a040 con 0x5598ab409260 2024-09-10T05:12:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f1db803a040 con 0x7f1da800f070 2024-09-10T05:12:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db8035040 con 0x7f1da800f070 2024-09-10T05:12:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:46.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab409260 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x5598ab409260 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.271+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab40cb50 con 0x7f1da800f070 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1db8035040 con 0x7f1da800f070 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:46.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 20 zone default found 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 4 Realm: () 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 20 zonegroup default 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4107f0 con 0x5598ab40d8b0 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4166e0 con 0x5598ab412260 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.272+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab416ab0 con 0x5598ab412260 2024-09-10T05:12:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.273+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.273+0000 7f1dc3740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.273+0000 7f1dc3740800 20 started sync module instance, tier type = 2024-09-10T05:12:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.273+0000 7f1dc3740800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.273+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab415b70 con 0x7f1da800f070 2024-09-10T05:12:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.274+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x7f1da800f070 2024-09-10T05:12:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.274+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94114196578416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab415b70 con 0x7f1da800f070 2024-09-10T05:12:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.274+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4175e0 con 0x5598ab409260 2024-09-10T05:12:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.275+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94114196578416] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x7f1da800f070 2024-09-10T05:12:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.275+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.275+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94114196582608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab415b70 con 0x5598ab409260 2024-09-10T05:12:46.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.275+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4180a0 con 0x5598ab412260 2024-09-10T05:12:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.276+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.276+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94114196585328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab418940 con 0x5598ab412260 2024-09-10T05:12:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.276+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab419400 con 0x7f1da800f070 2024-09-10T05:12:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.276+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94114196582608] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.277+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94114196585328] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.277+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x7f1da800f070 2024-09-10T05:12:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.277+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94114196587664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4156c0 con 0x7f1da800f070 2024-09-10T05:12:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.277+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab419ca0 con 0x5598ab409260 2024-09-10T05:12:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.278+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94114196587664] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x7f1da800f070 2024-09-10T05:12:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.278+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.278+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94114196590288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab419c00 con 0x5598ab409260 2024-09-10T05:12:46.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.278+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab41a6b0 con 0x5598ab40d8b0 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.279+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94114196590288] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.280+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.280+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94114196592464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab419b70 con 0x5598ab40d8b0 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.280+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab41b440 con 0x5598ab40d8b0 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.281+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.281+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94114196598608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab41bce0 con 0x5598ab40d8b0 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.281+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab41c7a0 con 0x5598ab40d8b0 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.281+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94114196592464] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.281+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94114196598608] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.282+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.282+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94114196603504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab41b830 con 0x5598ab40d8b0 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.282+0000 7f1dc3740800 20 add_watcher() i=0 2024-09-10T05:12:46.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.282+0000 7f1dc3740800 20 add_watcher() i=1 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.282+0000 7f1dc3740800 20 add_watcher() i=2 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.282+0000 7f1dc3740800 20 add_watcher() i=3 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.282+0000 7f1dc3740800 20 add_watcher() i=4 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.282+0000 7f1dc3740800 20 add_watcher() i=5 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.282+0000 7f1dc3740800 20 add_watcher() i=6 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.283+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94114196603504] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.283+0000 7f1dc3740800 20 add_watcher() i=7 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.283+0000 7f1dc3740800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.283+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab41f8a0 con 0x5598ab409260 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.283+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.283+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94114196597408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab41cd20 con 0x5598ab409260 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.284+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94114196597408] v37'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.284+0000 7f1c75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.284+0000 7f1dc3740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.284+0000 7f1dc3740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.284+0000 7f1dc3740800 5 note: GC not initialized 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.284+0000 7f1c74fe1640 20 reqs_thread_entry: start 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 20 Filter name: none 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1bee7fc640 20 reqs_thread_entry: start 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4528b0 con 0x5598ab40d8b0 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-10T05:12:46.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T05:12:46.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-10T05:12:46.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab450f50 con 0x5598ab409260 2024-09-10T05:12:46.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-10T05:12:46.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T05:12:46.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-10T05:12:46.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-10T05:12:46.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.285+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab451820 con 0x5598ab40d8b0 2024-09-10T05:12:46.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v37'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1dc3740800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-10T05:12:46.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1dc3740800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T05:12:46.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1dc3740800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94114196820848 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab455d40 con 0x5598ab40d8b0 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== watch-notify(notify (1) cookie 94114196603504 notify 158913789972 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5598ab452200 con 0x5598ab40d8b0 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1ca2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789972 cookie 94114196603504 notifier 4735 bl.length()=556 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1ca2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1ca2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(65 notify.7 [notify cookie 94114196820848 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1ca2ffd640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f1c84003ea0 con 0x5598ab40d8b0 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== watch-notify(notify_complete (2) cookie 94114196820848 notify 158913789972 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598ab3eabd0 con 0x5598ab40d8b0 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.287+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab451820 con 0x5598ab409260 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.288+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v37'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.288+0000 7f1dc3740800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T05:12:46.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.288+0000 7f1dc3740800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T05:12:46.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.288+0000 7f1dc3740800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T05:12:46.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.288+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94114196820848 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598ab455e50 con 0x5598ab40d8b0 2024-09-10T05:12:46.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.289+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== watch-notify(notify (1) cookie 94114196592464 notify 158913789973 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5598ab3eabd0 con 0x5598ab40d8b0 2024-09-10T05:12:46.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.289+0000 7f1ca27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789973 cookie 94114196592464 notifier 4735 bl.length()=177 2024-09-10T05:12:46.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.289+0000 7f1ca27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T05:12:46.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.289+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(68 notify.5 [notify cookie 94114196820848 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.289+0000 7f1ca27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T05:12:46.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.289+0000 7f1ca27fc640 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f1bf4003400 con 0x5598ab40d8b0 2024-09-10T05:12:46.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.289+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.289+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== watch-notify(notify_complete (2) cookie 94114196820848 notify 158913789973 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598ab3cd150 con 0x5598ab40d8b0 2024-09-10T05:12:46.302 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-10T05:12:46.286609Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:12:46.286600Z","tags":[],"group_ids":[]} 2024-09-10T05:12:46.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.290+0000 7f1c75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:46.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.290+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94114196597408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4506a0 con 0x5598ab409260 2024-09-10T05:12:46.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.291+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94114196597408] v37'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.291+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94114196578416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4506a0 con 0x7f1da800f070 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.293+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94114196578416] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x7f1da800f070 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.293+0000 7f1dc3740800 20 remove_watcher() i=0 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.293+0000 7f1dc3740800 2 removed watcher, disabling cache 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.293+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94114196582608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4506a0 con 0x5598ab409260 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.294+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94114196582608] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.294+0000 7f1dc3740800 20 remove_watcher() i=1 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.294+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94114196585328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4506a0 con 0x5598ab412260 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.296+0000 7f1dbecbf640 1 -- 172.21.15.192:0/2987183133 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94114196585328] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da8037040 con 0x5598ab412260 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.296+0000 7f1dc3740800 20 remove_watcher() i=2 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.296+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94114196587664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4170d0 con 0x7f1da800f070 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.297+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94114196587664] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x7f1da800f070 2024-09-10T05:12:46.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.297+0000 7f1dc3740800 20 remove_watcher() i=3 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.297+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94114196590288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab417b70 con 0x5598ab409260 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.298+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94114196590288] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db8035040 con 0x5598ab409260 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.298+0000 7f1dc3740800 20 remove_watcher() i=4 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.298+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94114196592464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab418490 con 0x5598ab40d8b0 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.299+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94114196592464] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.299+0000 7f1dc3740800 20 remove_watcher() i=5 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.299+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94114196598608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab4170d0 con 0x5598ab40d8b0 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.300+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94114196598608] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.300+0000 7f1dc3740800 20 remove_watcher() i=6 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.300+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94114196603504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598ab417b70 con 0x5598ab40d8b0 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.300+0000 7f1dbf4c0640 1 -- 172.21.15.192:0/2987183133 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94114196603504] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db00bd030 con 0x5598ab40d8b0 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 20 remove_watcher() i=7 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5598ab40d8b0 msgr2=0x5598ab40fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5598ab40d8b0 0x5598ab40fca0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5598ab409260 msgr2=0x5598ab40b720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5598ab409260 0x5598ab40b720 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1da800f070 msgr2=0x7f1da802e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f1da800f070 0x7f1da802e910 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5598ab412260 msgr2=0x5598ab414720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5598ab412260 0x5598ab414720 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1c8803c6e0 msgr2=0x7f1c8803eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1c8803c6e0 0x7f1c8803eba0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x5598ab3dc910 tx=0x7f1da8010000 comp rx=0 tx=0).stop 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 msgr2=0x5598ab3fdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/2987183133 reap_dead start 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 0x5598ab3fdda0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1db00565b0 tx=0x7f1db0098f00 comp rx=0 tx=0).stop 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 shutdown_connections 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 --2- 172.21.15.192:0/2987183133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3f69a0 0x5598ab3fdda0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 >> 172.21.15.192:0/2987183133 conn(0x5598ab3f2da0 msgr2=0x5598ab3f0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 shutdown_connections 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/2987183133 wait complete. 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/1275502153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1c9803c780 msgr2=0x7f1c9803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 --2- 172.21.15.192:0/1275502153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1c9803c780 0x7f1c9803ec40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5598ab3d8910 tx=0x7f1da800f000 comp rx=0 tx=0).stop 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/1275502153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3ea170 msgr2=0x5598ab3ea590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 --2- 172.21.15.192:0/1275502153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3ea170 0x5598ab3ea590 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1db006b010 tx=0x7f1db0061f70 comp rx=0 tx=0).stop 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/1275502153 shutdown_connections 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 --2- 172.21.15.192:0/1275502153 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1c9803c780 0x7f1c9803ec40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 --2- 172.21.15.192:0/1275502153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab3ea170 0x5598ab3ea590 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/1275502153 >> 172.21.15.192:0/1275502153 conn(0x5598ab3de520 msgr2=0x5598ab3de900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/1275502153 shutdown_connections 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.301+0000 7f1dc3740800 1 -- 172.21.15.192:0/1275502153 wait complete. 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5598ab3d5940 msgr2=0x5598ab3d7de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5598ab3d5940 0x5598ab3d7de0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5598ab2d8060 msgr2=0x5598ab3d35b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5598ab2d8060 0x5598ab3d35b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5598ab3d99d0 msgr2=0x5598ab3dbdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5598ab3d99d0 0x5598ab3dbdc0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ca403c730 msgr2=0x7f1ca403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f1ca403c730 0x7f1ca403ebf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1da8001e30 tx=0x7f1da8001390 comp rx=0 tx=0).stop 2024-09-10T05:12:46.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 msgr2=0x5598ab3cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 --2- 172.21.15.192:0/3444471516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5598ab2d56d0 0x5598ab3cbf60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1db0005fd0 tx=0x7f1db0003330 comp rx=0 tx=0).stop 2024-09-10T05:12:46.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dbfcc1640 1 -- 172.21.15.192:0/3444471516 reap_dead start 2024-09-10T05:12:46.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 shutdown_connections 2024-09-10T05:12:46.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 >> 172.21.15.192:0/3444471516 conn(0x5598ab2cf230 msgr2=0x5598ab3c5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 shutdown_connections 2024-09-10T05:12:46.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.302+0000 7f1dc3740800 1 -- 172.21.15.192:0/3444471516 wait complete. 2024-09-10T05:12:46.312 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-10T05:12:46.286609Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:12:46.286600Z', 'tags': [], 'group_ids': []} 2024-09-10T05:12:46.325 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:46.330 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-10T05:12:46.331 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-10T05:12:46.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-10T05:12:46.331 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-10T05:12:46.377 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:46.377 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:46.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.377+0000 7f58b9b3e800 1 Processor -- start 2024-09-10T05:12:46.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.377+0000 7f58b9b3e800 1 -- start start 2024-09-10T05:12:46.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.377+0000 7f58b9b3e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562d08e28210 0x562d08e2a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.377+0000 7f58b9b3e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d08ccde40 con 0x562d08e246a0 2024-09-10T05:12:46.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.377+0000 7f58b9b3e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x562d08c98680 con 0x562d08e28210 2024-09-10T05:12:46.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.377+0000 7f58affff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562d08e28210 0x562d08e2a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.377+0000 7f58b5886640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x562d08e246a0 0x562d08e26a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:34258/0 (socket says 172.21.15.192:34258) 2024-09-10T05:12:46.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.377+0000 7f58affff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562d08e28210 0x562d08e2a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42642/0 (socket says 172.21.15.192:42642) 2024-09-10T05:12:46.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.377+0000 7f58b5886640 1 -- 172.21.15.192:0/3946009046 learned_addr learned my addr 172.21.15.192:0/3946009046 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:46.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.377+0000 7f58affff640 1 -- 172.21.15.192:0/3946009046 >> v1:172.21.15.139:6789/0 conn(0x562d08e246a0 legacy=0x562d08e26a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.377+0000 7f58affff640 1 -- 172.21.15.192:0/3946009046 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d08cb46b0 con 0x562d08e28210 2024-09-10T05:12:46.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.379+0000 7f58affff640 1 --2- 172.21.15.192:0/3946009046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e28210 0x562d08e2a6d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f58a000a470 tx=0x7f58a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e362af913e2082 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.379+0000 7f58b5085640 1 -- 172.21.15.192:0/3946009046 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a0053570 con 0x562d08e28210 2024-09-10T05:12:46.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.379+0000 7f58b5085640 1 -- 172.21.15.192:0/3946009046 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a0058070 con 0x562d08e28210 2024-09-10T05:12:46.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.379+0000 7f58b5085640 1 -- 172.21.15.192:0/3946009046 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a0053880 con 0x562d08e28210 2024-09-10T05:12:46.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.380+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3946009046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e28210 msgr2=0x562d08e2a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.380+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/3946009046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e28210 0x562d08e2a6d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f58a000a470 tx=0x7f58a0045a20 comp rx=0 tx=0).stop 2024-09-10T05:12:46.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.380+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3946009046 shutdown_connections 2024-09-10T05:12:46.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.380+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/3946009046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e28210 0x562d08e2a6d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.380+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3946009046 >> 172.21.15.192:0/3946009046 conn(0x562d08e1e200 msgr2=0x562d08e20640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.380+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3946009046 shutdown_connections 2024-09-10T05:12:46.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.380+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3946009046 wait complete. 2024-09-10T05:12:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.394+0000 7f58b9b3e800 1 Processor -- start 2024-09-10T05:12:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.394+0000 7f58b9b3e800 1 -- start start 2024-09-10T05:12:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.394+0000 7f58b9b3e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 0x562d08f13650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.394+0000 7f58b9b3e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562d08cbcdd0 con 0x562d08e246a0 2024-09-10T05:12:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.394+0000 7f58b5886640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 0x562d08f13650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.394+0000 7f58b5886640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 0x562d08f13650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42658/0 (socket says 172.21.15.192:42658) 2024-09-10T05:12:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.394+0000 7f58b5886640 1 -- 172.21.15.192:0/543884289 learned_addr learned my addr 172.21.15.192:0/543884289 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.395+0000 7f58b5886640 1 -- 172.21.15.192:0/543884289 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d08cd5e10 con 0x562d08e246a0 2024-09-10T05:12:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.395+0000 7f58b5886640 1 --2- 172.21.15.192:0/543884289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 0x562d08f13650 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f58a8001df0 tx=0x7f58a800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4020a18f3cb583 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.395+0000 7f57a3e07640 1 -- 172.21.15.192:0/543884289 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a8012020 con 0x562d08e246a0 2024-09-10T05:12:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.395+0000 7f57a3e07640 1 -- 172.21.15.192:0/543884289 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a800e470 con 0x562d08e246a0 2024-09-10T05:12:46.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.395+0000 7f57a3e07640 1 -- 172.21.15.192:0/543884289 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a800e7f0 con 0x562d08e246a0 2024-09-10T05:12:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b9b3e800 1 -- 172.21.15.192:0/543884289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 msgr2=0x562d08f13650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/543884289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 0x562d08f13650 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f58a8001df0 tx=0x7f58a800b6c0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b9b3e800 1 -- 172.21.15.192:0/543884289 shutdown_connections 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/543884289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 0x562d08f13650 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b9b3e800 1 -- 172.21.15.192:0/543884289 >> 172.21.15.192:0/543884289 conn(0x562d08e1e200 msgr2=0x562d08f0efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b9b3e800 1 -- 172.21.15.192:0/543884289 shutdown_connections 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b9b3e800 1 -- 172.21.15.192:0/543884289 wait complete. 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b9b3e800 1 Processor -- start 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b9b3e800 1 -- start start 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b9b3e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 0x562d08f1afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b9b3e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562d08e2b050 con 0x562d08e246a0 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b5886640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 0x562d08f1afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b5886640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 0x562d08f1afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42666/0 (socket says 172.21.15.192:42666) 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.396+0000 7f58b5886640 1 -- 172.21.15.192:0/3588565968 learned_addr learned my addr 172.21.15.192:0/3588565968 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.397+0000 7f58b5886640 1 -- 172.21.15.192:0/3588565968 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d08f1b500 con 0x562d08e246a0 2024-09-10T05:12:46.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.397+0000 7f58b5886640 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 0x562d08f1afa0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x562d08f145e0 tx=0x7f58a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.397+0000 7f57a2604640 1 -- 172.21.15.192:0/3588565968 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a8012030 con 0x562d08e246a0 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.397+0000 7f57a2604640 1 -- 172.21.15.192:0/3588565968 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a801a6d0 con 0x562d08e246a0 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.397+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d08f1b790 con 0x562d08e246a0 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.397+0000 7f57a2604640 1 -- 172.21.15.192:0/3588565968 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a801a9d0 con 0x562d08e246a0 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.397+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d08f1c190 con 0x562d08e246a0 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.398+0000 7f57a2604640 1 -- 172.21.15.192:0/3588565968 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f58a8015020 con 0x562d08e246a0 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.398+0000 7f57a2604640 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f579c03c730 0x7f579c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.398+0000 7f57a2604640 1 -- 172.21.15.192:0/3588565968 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f58a8020030 con 0x562d08e246a0 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.398+0000 7f58affff640 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f579c03c730 0x7f579c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.398+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562d08e28210 0x562d08f225f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.398+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f22b30 con 0x562d08e28210 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.398+0000 7f58b6087640 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562d08e28210 0x562d08f225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.399+0000 7f58affff640 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f579c03c730 0x7f579c03ebf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f58a0057000 tx=0x7f58a0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.399+0000 7f58b6087640 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562d08e28210 0x562d08f225f0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.399+0000 7f58b6087640 1 -- 172.21.15.192:0/3588565968 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08e28210 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.399+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f22ed0 con 0x562d08e28210 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.399+0000 7f58b6087640 1 -- 172.21.15.192:0/3588565968 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08e28210 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.399+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562d08f24a10 0x562d08f26e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.399+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f27610 con 0x562d08f24a10 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.400+0000 7f58b5886640 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562d08f24a10 0x562d08f26e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.400+0000 7f58b5886640 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562d08f24a10 0x562d08f26e80 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.400+0000 7f58b5886640 1 -- 172.21.15.192:0/3588565968 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f58a801ad50 con 0x562d08f24a10 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.400+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f23720 con 0x562d08e28210 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.400+0000 7f58b6087640 1 -- 172.21.15.192:0/3588565968 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08e28210 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.401+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562d08f28a70 0x562d08f2ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.401+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f2b550 con 0x562d08f28a70 2024-09-10T05:12:46.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.401+0000 7f58affff640 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562d08f28a70 0x562d08f2ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.401+0000 7f58affff640 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562d08f28a70 0x562d08f2ae60 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.401+0000 7f58affff640 1 -- 172.21.15.192:0/3588565968 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f28a70 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.401+0000 7f58b9b3e800 1 Processor -- start 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.402+0000 7f58b9b3e800 1 -- start start 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.402+0000 7f58b9b3e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f391b0 0x562d08f395d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.402+0000 7f58b9b3e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562d08d1aa00 con 0x562d08f391b0 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.402+0000 7f58b5886640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f391b0 0x562d08f395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.402+0000 7f58b5886640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f391b0 0x562d08f395d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42672/0 (socket says 172.21.15.192:42672) 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.402+0000 7f58b5886640 1 -- 172.21.15.192:0/337397082 learned_addr learned my addr 172.21.15.192:0/337397082 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.402+0000 7f58b5886640 1 -- 172.21.15.192:0/337397082 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d08f39c10 con 0x562d08f391b0 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.403+0000 7f58b5886640 1 --2- 172.21.15.192:0/337397082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f391b0 0x562d08f395d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f58a8052050 tx=0x7f58a80184f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.403+0000 7f579b7fe640 1 -- 172.21.15.192:0/337397082 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a8022af0 con 0x562d08f391b0 2024-09-10T05:12:46.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.403+0000 7f579b7fe640 1 -- 172.21.15.192:0/337397082 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a8022c90 con 0x562d08f391b0 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.403+0000 7f58b9b3e800 1 -- 172.21.15.192:0/337397082 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d08f3a440 con 0x562d08f391b0 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.403+0000 7f579b7fe640 1 -- 172.21.15.192:0/337397082 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a8016570 con 0x562d08f391b0 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.403+0000 7f58b9b3e800 1 -- 172.21.15.192:0/337397082 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d08f3a9e0 con 0x562d08f391b0 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.403+0000 7f579b7fe640 1 -- 172.21.15.192:0/337397082 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f58a8016710 con 0x562d08f391b0 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.404+0000 7f579b7fe640 1 --2- 172.21.15.192:0/337397082 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f579003c780 0x7f579003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.404+0000 7f579b7fe640 1 -- 172.21.15.192:0/337397082 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f58a80411c0 con 0x562d08f391b0 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.404+0000 7f58affff640 1 --2- 172.21.15.192:0/337397082 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f579003c780 0x7f579003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.404+0000 7f58b9b3e800 1 Processor -- start 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.404+0000 7f58b9b3e800 1 -- start start 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.404+0000 7f58affff640 1 --2- 172.21.15.192:0/337397082 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f579003c780 0x7f579003ec40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x562d08f279b0 tx=0x7f58a0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.404+0000 7f58b9b3e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 0x562d08f45e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.404+0000 7f58b9b3e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562d08f13ea0 con 0x562d08f45a70 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.404+0000 7f58b5886640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 0x562d08f45e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.404+0000 7f58b5886640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 0x562d08f45e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42684/0 (socket says 172.21.15.192:42684) 2024-09-10T05:12:46.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.404+0000 7f58b5886640 1 -- 172.21.15.192:0/777588888 learned_addr learned my addr 172.21.15.192:0/777588888 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.405+0000 7f58b5886640 1 -- 172.21.15.192:0/777588888 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d08f46460 con 0x562d08f45a70 2024-09-10T05:12:46.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.405+0000 7f58b5886640 1 --2- 172.21.15.192:0/777588888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 0x562d08f45e70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f58a80477b0 tx=0x7f58a804aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20218e0bf5639614 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.405+0000 7f57997fa640 1 -- 172.21.15.192:0/777588888 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a8024cb0 con 0x562d08f45a70 2024-09-10T05:12:46.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.405+0000 7f57997fa640 1 -- 172.21.15.192:0/777588888 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a80475c0 con 0x562d08f45a70 2024-09-10T05:12:46.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.405+0000 7f57997fa640 1 -- 172.21.15.192:0/777588888 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a803e1b0 con 0x562d08f45a70 2024-09-10T05:12:46.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.405+0000 7f58b9b3e800 1 -- 172.21.15.192:0/777588888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 msgr2=0x562d08f45e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.405+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/777588888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 0x562d08f45e70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f58a80477b0 tx=0x7f58a804aec0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.405+0000 7f58b9b3e800 1 -- 172.21.15.192:0/777588888 shutdown_connections 2024-09-10T05:12:46.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.405+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/777588888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 0x562d08f45e70 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.405+0000 7f58b9b3e800 1 -- 172.21.15.192:0/777588888 >> 172.21.15.192:0/777588888 conn(0x562d08f41e70 msgr2=0x562d08f400b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.405+0000 7f58b9b3e800 1 -- 172.21.15.192:0/777588888 shutdown_connections 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.405+0000 7f58b9b3e800 1 -- 172.21.15.192:0/777588888 wait complete. 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.406+0000 7f58b9b3e800 1 Processor -- start 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.406+0000 7f58b9b3e800 1 -- start start 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.406+0000 7f58b9b3e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 0x562d08f4ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.406+0000 7f58b9b3e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562d08f468d0 con 0x562d08f45a70 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.406+0000 7f58b5886640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 0x562d08f4ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.406+0000 7f58b5886640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 0x562d08f4ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42688/0 (socket says 172.21.15.192:42688) 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.406+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 learned_addr learned my addr 172.21.15.192:0/1543795230 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.406+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d08f4d390 con 0x562d08f45a70 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.407+0000 7f58b5886640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 0x562d08f4ce30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f58a801b1b0 tx=0x7f58a803f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.407+0000 7f57877fe640 1 -- 172.21.15.192:0/1543795230 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a806b020 con 0x562d08f45a70 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.407+0000 7f57877fe640 1 -- 172.21.15.192:0/1543795230 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a800d850 con 0x562d08f45a70 2024-09-10T05:12:46.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.407+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d08f4d390 con 0x562d08f45a70 2024-09-10T05:12:46.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.407+0000 7f57877fe640 1 -- 172.21.15.192:0/1543795230 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a8062040 con 0x562d08f45a70 2024-09-10T05:12:46.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.407+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d08f4d390 con 0x562d08f45a70 2024-09-10T05:12:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.407+0000 7f57877fe640 1 -- 172.21.15.192:0/1543795230 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f58a806e020 con 0x562d08f45a70 2024-09-10T05:12:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.408+0000 7f57877fe640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f578003c780 0x7f578003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.408+0000 7f57877fe640 1 -- 172.21.15.192:0/1543795230 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f58a8059070 con 0x562d08f45a70 2024-09-10T05:12:46.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.408+0000 7f58affff640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f578003c780 0x7f578003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.408+0000 7f58affff640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f578003c780 0x7f578003ec40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f58a0045a60 tx=0x7f58a0053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.408+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.408+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562d08f583e0 0x562d08f5a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.408+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5aff0 con 0x562d08f583e0 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.408+0000 7f58b6087640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562d08f583e0 0x562d08f5a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b6087640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562d08f583e0 0x562d08f5a8a0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b9b3e800 20 realm 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5b400 con 0x562d08f583e0 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b9b3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5bcd0 con 0x562d08f583e0 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.409+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f583e0 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.410+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.410+0000 7f58b9b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.410+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.410+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562d08f5cdd0 0x562d08f5f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.410+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5f810 con 0x562d08f5cdd0 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.410+0000 7f58b5886640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562d08f5cdd0 0x562d08f5f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.410+0000 7f58b5886640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562d08f5cdd0 0x562d08f5f1c0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.410+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.410+0000 7f58b9b3e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.410+0000 7f58b9b3e800 20 searching for the correct realm 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.410+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562d08f61810 0x562d08f63cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.410+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f64350 con 0x562d08f61810 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.411+0000 7f58affff640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562d08f61810 0x562d08f63cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.411+0000 7f58affff640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562d08f61810 0x562d08f63cd0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.411+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.411+0000 7f58affff640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f58a005f040 0x7f58a0080480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.411+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f64350 con 0x7f58a005f040 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.411+0000 7f58b6087640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f58a005f040 0x7f58a0080480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.411+0000 7f58b6087640 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f58a005f040 0x7f58a0080480 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.412+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.412+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f5cdd0 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.412+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.412+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f583e0 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.412+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.412+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f583e0 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.412+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.413+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f5cdd0 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.413+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.413+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f5cdd0 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.413+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.413+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x7f58a005f040 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.413+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.413+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f61810 2024-09-10T05:12:46.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.413+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.413+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f583e0 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.414+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.414+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f5cdd0 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.414+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.414+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f583e0 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.414+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.414+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x7f58a005f040 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.414+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.414+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f61810 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.415+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.415+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f61810 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.415+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.415+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f5cdd0 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.415+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.415+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f61810 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.415+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.415+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f61810 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.415+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.415+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f583e0 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.416+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.416+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f583e0 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.416+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.416+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x7f58a005f040 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.416+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.416+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f61810 2024-09-10T05:12:46.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.416+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.416+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x7f58a005f040 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.417+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.417+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f583e0 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.417+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.417+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f5cdd0 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.417+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.417+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f61810 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.418+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.418+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f5cdd0 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.418+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.418+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x7f58a005f040 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.418+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.418+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f61810 2024-09-10T05:12:46.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.418+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.418+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x7f58a005f040 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x562d08f583e0 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5c070 con 0x7f58a005f040 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b9b3e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b9b3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b9b3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b9b3e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b9b3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b9b3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:46.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5fc20 con 0x562d08f583e0 2024-09-10T05:12:46.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.419+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5fc20 con 0x562d08f583e0 2024-09-10T05:12:46.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:46.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f5fc20 con 0x7f58a005f040 2024-09-10T05:12:46.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:46.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 20 zone default found 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 4 Realm: () 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 20 zonegroup default 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f60d70 con 0x562d08f5cdd0 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.420+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f661c0 con 0x562d08f61810 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.421+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.421+0000 7f58b9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.421+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.421+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f66560 con 0x562d08f61810 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.421+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.421+0000 7f58b9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.421+0000 7f58b9b3e800 20 started sync module instance, tier type = 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.421+0000 7f58b9b3e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.421+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f65660 con 0x7f58a005f040 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.422+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.422+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94751423880064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f65660 con 0x7f58a005f040 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.422+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f66e10 con 0x562d08f583e0 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.423+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94751423880064] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.423+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.423+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94751423883520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f65660 con 0x562d08f583e0 2024-09-10T05:12:46.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.423+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f678a0 con 0x562d08f61810 2024-09-10T05:12:46.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.424+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94751423883520] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.424+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.424+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94751423877552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f655d0 con 0x562d08f61810 2024-09-10T05:12:46.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.424+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f68760 con 0x7f58a005f040 2024-09-10T05:12:46.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.425+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94751423877552] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.425+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.426+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94751423890096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f68b80 con 0x7f58a005f040 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.426+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f69540 con 0x562d08f583e0 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.427+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94751423890096] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.427+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.427+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94751423894128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f68b80 con 0x562d08f583e0 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.427+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f69f50 con 0x562d08f5cdd0 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.428+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.428+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94751423896224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f6a7f0 con 0x562d08f5cdd0 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.428+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f6b290 con 0x562d08f5cdd0 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.428+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94751423894128] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.429+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94751423896224] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.429+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.429+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94751423901024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f6a2f0 con 0x562d08f5cdd0 2024-09-10T05:12:46.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.429+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f6bca0 con 0x562d08f5cdd0 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.430+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94751423901024] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.430+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.430+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94751423891152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f6bca0 con 0x562d08f5cdd0 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.430+0000 7f58b9b3e800 20 add_watcher() i=0 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.430+0000 7f58b9b3e800 20 add_watcher() i=1 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.430+0000 7f58b9b3e800 20 add_watcher() i=2 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.430+0000 7f58b9b3e800 20 add_watcher() i=3 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.430+0000 7f58b9b3e800 20 add_watcher() i=4 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.430+0000 7f58b9b3e800 20 add_watcher() i=5 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.430+0000 7f58b9b3e800 20 add_watcher() i=6 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.431+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94751423891152] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.431+0000 7f58b9b3e800 20 add_watcher() i=7 2024-09-10T05:12:46.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.431+0000 7f58b9b3e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.431+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08f6eed0 con 0x562d08f583e0 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.431+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.431+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94751423916176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f6bca0 con 0x562d08f583e0 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.432+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94751423916176] v37'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.433+0000 7f57677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.433+0000 7f58b9b3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.433+0000 7f58b9b3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.433+0000 7f58b9b3e800 5 note: GC not initialized 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.433+0000 7f57667fc640 20 reqs_thread_entry: start 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.433+0000 7f58b9b3e800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.433+0000 7f58b9b3e800 20 Filter name: none 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.433+0000 7f56d7fff640 20 reqs_thread_entry: start 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.433+0000 7f58b9b3e800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-10T05:12:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.433+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.433+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fa1fd0 con 0x562d08f5cdd0 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.434+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.434+0000 7f58b9b3e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.434+0000 7f58b9b3e800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.434+0000 7f58b9b3e800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.434+0000 7f58b9b3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.434+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08fa6140 con 0x7f58a005f040 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.435+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v37'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.435+0000 7f58b9b3e800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.435+0000 7f58b9b3e800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.435+0000 7f58b9b3e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.435+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94751424138096 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fa6d90 con 0x562d08f5cdd0 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.435+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== watch-notify(notify (1) cookie 94751423896224 notify 158913789975 ret 0) ==== 424+0+0 (crc 0 0 0) 0x562d08f3a440 con 0x562d08f5cdd0 2024-09-10T05:12:46.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.435+0000 7f57997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789975 cookie 94751423896224 notifier 4742 bl.length()=382 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.435+0000 7f57997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.435+0000 7f57997fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.435+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(64 notify.5 [notify cookie 94751424138096 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.435+0000 7f57997fa640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5778003ea0 con 0x562d08f5cdd0 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.436+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.436+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== watch-notify(notify_complete (2) cookie 94751424138096 notify 158913789975 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d08f39c10 con 0x562d08f5cdd0 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.436+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fa6d10 con 0x562d08f583e0 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.436+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.436+0000 7f58b9b3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 : miss 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.436+0000 7f58b9b3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.436+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 8.16 8:6f119919:root::.bucket.meta.myfoo6%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fa43a0 con 0x562d08f61810 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.437+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(67 .bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.437+0000 7f58b9b3e800 20 rados_obj.operate() r=0 bl.length=388 2024-09-10T05:12:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.437+0000 7f58b9b3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 info.flags=0x17 2024-09-10T05:12:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.437+0000 7f58b9b3e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 to cache LRU end 2024-09-10T05:12:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.437+0000 7f58b9b3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.437+0000 7f58b9b3e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:12:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.437+0000 7f58b9b3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 2024-09-10T05:12:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.437+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 8.16 8:6f119919:root::.bucket.meta.myfoo6%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08fae290 con 0x562d08f61810 2024-09-10T05:12:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(68 .bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v37'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f58b9b3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 info.flags=0x17 2024-09-10T05:12:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f58b9b3e800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 to cache LRU end 2024-09-10T05:12:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f58b9b3e800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T05:12:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f58b9b3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9, ofs0, ns] 2024-09-10T05:12:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94751424137760 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fabbd0 con 0x562d08f5cdd0 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== watch-notify(notify (1) cookie 94751423901024 notify 158913789976 ret 0) ==== 798+0+0 (crc 0 0 0) 0x562d08f39c10 con 0x562d08f5cdd0 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f57997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789976 cookie 94751423901024 notifier 4742 bl.length()=756 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f57997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 info.flags=0x17 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f57997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 to cache LRU end 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f57997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f57997fa640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5778003ea0 con 0x562d08f5cdd0 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(69 notify.6 [notify cookie 94751424137760 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.438+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(70 notify.6 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.439+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== watch-notify(notify_complete (2) cookie 94751424137760 notify 158913789976 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d08f1c190 con 0x562d08f5cdd0 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.439+0000 7f58b9b3e800 20 handle_bi_update(): bucket=:myfoo6[92aa256a-2802-419e-96e0-ba675846cbc3.4238.9]): orig_sources= new_sources= 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.439+0000 7f58b9b3e800 20 handle_bi_update(): bucket=:myfoo6[92aa256a-2802-419e-96e0-ba675846cbc3.4238.9]): potential sources added=[] removed=[] 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.439+0000 7f58b9b3e800 20 handle_bi_update(): bucket=:myfoo6[92aa256a-2802-419e-96e0-ba675846cbc3.4238.9]): orig_dests= new_dests= 2024-09-10T05:12:46.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.439+0000 7f58b9b3e800 20 handle_bi_update(): bucket=:myfoo6[92aa256a-2802-419e-96e0-ba675846cbc3.4238.9]): potential dests added=[] removed=[] 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.439+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08faa540 con 0x562d08f583e0 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.439+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(71 bud.buckets [call] v37'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.439+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08fa71c0 con 0x562d08f583e0 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.440+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(72 bud.buckets [call] v37'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.440+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08faa540 con 0x562d08f583e0 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.441+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v37'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.441+0000 7f58b9b3e800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.441+0000 7f58b9b3e800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.441+0000 7f58b9b3e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.441+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94751424137760 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08faa540 con 0x7f58a005f040 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.442+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== watch-notify(notify (1) cookie 94751423890096 notify 158913789982 ret 0) ==== 358+0+0 (crc 0 0 0) 0x562d08fab550 con 0x7f58a005f040 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.442+0000 7f5798ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789982 cookie 94751423890096 notifier 4742 bl.length()=316 2024-09-10T05:12:46.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.442+0000 7f5798ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-10T05:12:46.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.442+0000 7f5798ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T05:12:46.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.442+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(74 notify.3 [notify cookie 94751424137760 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.442+0000 7f5798ff9640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f56e0003400 con 0x7f58a005f040 2024-09-10T05:12:46.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.442+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.442+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== watch-notify(notify_complete (2) cookie 94751424137760 notify 158913789982 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f58b0018a90 con 0x7f58a005f040 2024-09-10T05:12:46.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.442+0000 7f58b9b3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 : hit (requested=0x17, cached=0x17) 2024-09-10T05:12:46.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.442+0000 7f58b9b3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 2024-09-10T05:12:46.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.442+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:76 8.16 8:6f119919:root::.bucket.meta.myfoo6%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08fab0a0 con 0x562d08f61810 2024-09-10T05:12:46.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.443+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(76 .bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v37'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.443+0000 7f58b9b3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 info.flags=0x17 2024-09-10T05:12:46.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.443+0000 7f58b9b3e800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 to cache LRU end 2024-09-10T05:12:46.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.443+0000 7f58b9b3e800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.443+0000 7f58b9b3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9, ofs0, ns] 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.443+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94751424137760 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08faafc0 con 0x562d08f5cdd0 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== watch-notify(notify (1) cookie 94751423901024 notify 158913789977 ret 0) ==== 798+0+0 (crc 0 0 0) 0x562d08f1c190 con 0x562d08f5cdd0 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f5798ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789977 cookie 94751423901024 notifier 4742 bl.length()=756 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f5798ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 info.flags=0x17 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f5798ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 to cache LRU end 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f5798ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f5798ff9640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f56e00034d0 con 0x562d08f5cdd0 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(77 notify.6 [notify cookie 94751424137760 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== watch-notify(notify_complete (2) cookie 94751424137760 notify 158913789977 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d08f1b790 con 0x562d08f5cdd0 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f58b9b3e800 20 handle_bi_update(): bucket=:myfoo6[92aa256a-2802-419e-96e0-ba675846cbc3.4238.9]): orig_sources= new_sources= 2024-09-10T05:12:46.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f58b9b3e800 20 handle_bi_update(): bucket=:myfoo6[92aa256a-2802-419e-96e0-ba675846cbc3.4238.9]): potential sources added=[] removed=[] 2024-09-10T05:12:46.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f58b9b3e800 20 handle_bi_update(): bucket=:myfoo6[92aa256a-2802-419e-96e0-ba675846cbc3.4238.9]): orig_dests= new_dests= 2024-09-10T05:12:46.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f58b9b3e800 20 handle_bi_update(): bucket=:myfoo6[92aa256a-2802-419e-96e0-ba675846cbc3.4238.9]): potential dests added=[] removed=[] 2024-09-10T05:12:46.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:79 4.22 4:45474770:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08faac10 con 0x562d08f583e0 2024-09-10T05:12:46.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(79 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.444+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:80 4.3e 4:7fffe048:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08faac10 con 0x7f58a005f040 2024-09-10T05:12:46.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.445+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(80 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.445+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:81 4.34 4:2e60e3b1:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08faac10 con 0x7f58a005f040 2024-09-10T05:12:46.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.445+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(81 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.445+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:82 4.c 4:3051bcaa:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08faac10 con 0x562d08f583e0 2024-09-10T05:12:46.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.445+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(82 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.3 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.445+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:83 4.3b 4:dfd9e8de:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08faabd0 con 0x562d08f61810 2024-09-10T05:12:46.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.446+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(83 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.4 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.446+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:84 4.37 4:eee95a93:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08faabd0 con 0x562d08f5cdd0 2024-09-10T05:12:46.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.446+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(84 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.446+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:85 4.32 4:4d3b415a:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fab040 con 0x562d08f583e0 2024-09-10T05:12:46.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.446+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(85 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.6 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.446+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:86 4.3 4:c0f5b21c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fab040 con 0x562d08f583e0 2024-09-10T05:12:46.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.447+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(86 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.447+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 4.39 4:9c18df45:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fab040 con 0x562d08f61810 2024-09-10T05:12:46.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.447+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(87 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.447+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 4.7 4:e06fa05c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fab040 con 0x562d08f5cdd0 2024-09-10T05:12:46.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.447+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 30 ==== osd_op_reply(88 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9 [call out=381b] v0'0 uv5 ondisk = 0) ==== 194+0+381 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 10 cls_bucket_list_unordered: got thirteen 2024-09-10T05:12:46.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:89 4.e 4:727021bc:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fab040 con 0x7f58a005f040 2024-09-10T05:12:46.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(89 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.10 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 20 get_obj_state: octx=0x7f58b000ab40 obj=myfoo6:thirteen state=0x562d08fab908 s->prefetch_data=0 2024-09-10T05:12:46.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:90 3.34s0 3:2e8a457d:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fab040 con 0x562d08f583e0 2024-09-10T05:12:46.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(90 92aa256a-2802-419e-96e0-ba675846cbc3.4238.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 10 manifest: total_size = 8 2024-09-10T05:12:46.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 20 get_obj_state: setting s->obj_tag to 92aa256a-2802-419e-96e0-ba675846cbc3.4238.6333545952499578851 2024-09-10T05:12:46.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-10T05:12:46.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-10T05:12:46.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 20 get_obj_state: octx=0x7f58b000ab40 obj=myfoo6:thirteen state=0x562d08fab908 s->prefetch_data=0 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 : hit (requested=0x17, cached=0x17) 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 20 bucket index object: :.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.448+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:91 4.7 4:e06fa05c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08fa4b10 con 0x562d08f5cdd0 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.449+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 31 ==== osd_op_reply(91 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9 [stat,call,call] v37'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.449+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:92 3.34s0 3:2e8a457d:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08faf940 con 0x562d08f583e0 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.451+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(92 92aa256a-2802-419e-96e0-ba675846cbc3.4238.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v37'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.451+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:93 4.7 4:e06fa05c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08fb13e0 con 0x562d08f5cdd0 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:1 objects processed in :myfoo6[92aa256a-2802-419e-96e0-ba675846cbc3.4238.9]). Next marker thirteen 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.451+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08fb13e0 con 0x7f58a005f040 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.453+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v37'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.453+0000 7f58b9b3e800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.453+0000 7f58b9b3e800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.453+0000 7f58b9b3e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.453+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94751424165664 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fb13e0 con 0x562d08f5cdd0 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.453+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 32 ==== osd_op_reply(93 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9 [stat,call,call] v37'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.453+0000 7f57997fa640 20 handle_completion(): completion ok for obj=thirteen 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.454+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 33 ==== watch-notify(notify (1) cookie 94751423896224 notify 158913789978 ret 0) ==== 598+0+0 (crc 0 0 0) 0x562d08f1b790 con 0x562d08f5cdd0 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.454+0000 7f5798ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789978 cookie 94751423896224 notifier 4742 bl.length()=556 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.454+0000 7f5798ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.454+0000 7f5798ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.454+0000 7f5798ff9640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f56e0003560 con 0x562d08f5cdd0 2024-09-10T05:12:46.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.454+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 34 ==== osd_op_reply(95 notify.5 [notify cookie 94751424165664 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.454+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 35 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.454+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 36 ==== watch-notify(notify_complete (2) cookie 94751424165664 notify 158913789978 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d08f1b500 con 0x562d08f5cdd0 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.454+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08fabbd0 con 0x562d08f583e0 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.455+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v37'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.455+0000 7f58b9b3e800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.455+0000 7f58b9b3e800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.455+0000 7f58b9b3e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.455+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94751424165664 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fa2b50 con 0x562d08f5cdd0 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.455+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 37 ==== watch-notify(notify (1) cookie 94751423896224 notify 158913789979 ret 0) ==== 219+0+0 (crc 0 0 0) 0x562d08f1b500 con 0x562d08f5cdd0 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.455+0000 7f57997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789979 cookie 94751423896224 notifier 4742 bl.length()=177 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.455+0000 7f57997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.455+0000 7f57997fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.455+0000 7f57997fa640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5778003ea0 con 0x562d08f5cdd0 2024-09-10T05:12:46.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.456+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 38 ==== osd_op_reply(98 notify.5 [notify cookie 94751424165664 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.456+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 39 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.456+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 40 ==== watch-notify(notify_complete (2) cookie 94751424165664 notify 158913789979 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d08cd5e10 con 0x562d08f5cdd0 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.456+0000 7f58b9b3e800 10 removing user index: bar 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.456+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08fabbd0 con 0x562d08f5cdd0 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.457+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 41 ==== osd_op_reply(100 bar [delete] v37'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.457+0000 7f58b9b3e800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.457+0000 7f58b9b3e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.457+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94751424165664 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562d08fa2b50 con 0x562d08f5cdd0 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.457+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 42 ==== watch-notify(notify (1) cookie 94751423891152 notify 158913789980 ret 0) ==== 194+0+0 (crc 0 0 0) 0x562d08cd5e10 con 0x562d08f5cdd0 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.457+0000 7f5798ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789980 cookie 94751423891152 notifier 4742 bl.length()=152 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.457+0000 7f5798ff9640 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f56e0003560 con 0x562d08f5cdd0 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.457+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 43 ==== osd_op_reply(101 notify.7 [notify cookie 94751424165664 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.457+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 44 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.457+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 45 ==== watch-notify(notify_complete (2) cookie 94751424165664 notify 158913789980 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d08ccde40 con 0x562d08f5cdd0 2024-09-10T05:12:46.469 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-10T05:12:46.286609Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:12:46.286600Z","tags":[],"group_ids":[]} 2024-09-10T05:12:46.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.458+0000 7f57677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.458+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94751423916176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f9fe50 con 0x562d08f583e0 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.459+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94751423916176] v37'221 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.459+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94751423880064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f9fe50 con 0x7f58a005f040 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.460+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94751423880064] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.460+0000 7f58b9b3e800 20 remove_watcher() i=0 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.460+0000 7f58b9b3e800 2 removed watcher, disabling cache 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.460+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94751423883520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f9fe50 con 0x562d08f583e0 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.461+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94751423883520] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.461+0000 7f58b9b3e800 20 remove_watcher() i=1 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.461+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94751423877552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f9fe50 con 0x562d08f61810 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.462+0000 7f58affff640 1 -- 172.21.15.192:0/1543795230 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94751423877552] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a0051070 con 0x562d08f61810 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.462+0000 7f58b9b3e800 20 remove_watcher() i=2 2024-09-10T05:12:46.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.462+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94751423890096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f9fe50 con 0x7f58a005f040 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.463+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.2 v2:172.21.15.192:6801/2435677948 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94751423890096] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x7f58a005f040 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.463+0000 7f58b9b3e800 20 remove_watcher() i=3 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.463+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94751423894128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f9fe50 con 0x562d08f583e0 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.465+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 <== osd.1 v2:172.21.15.192:6800/3487349558 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94751423894128] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58b000a4d0 con 0x562d08f583e0 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.465+0000 7f58b9b3e800 20 remove_watcher() i=4 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.465+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94751423896224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f9fe50 con 0x562d08f5cdd0 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.466+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 46 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94751423896224] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.466+0000 7f58b9b3e800 20 remove_watcher() i=5 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.466+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94751423901024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f9fe50 con 0x562d08f5cdd0 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.467+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 47 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94751423901024] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.467+0000 7f58b9b3e800 20 remove_watcher() i=6 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.467+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94751423891152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562d08f9fe50 con 0x562d08f5cdd0 2024-09-10T05:12:46.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.468+0000 7f58b5886640 1 -- 172.21.15.192:0/1543795230 <== osd.0 v2:172.21.15.139:6800/2915567440 48 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94751423891152] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a8065040 con 0x562d08f5cdd0 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.468+0000 7f58b9b3e800 20 remove_watcher() i=7 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562d08f5cdd0 msgr2=0x562d08f5f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562d08f5cdd0 0x562d08f5f1c0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562d08f583e0 msgr2=0x562d08f5a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562d08f583e0 0x562d08f5a8a0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f58a005f040 msgr2=0x7f58a0080480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f58a005f040 0x7f58a0080480 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562d08f61810 msgr2=0x562d08f63cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562d08f61810 0x562d08f63cd0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f578003c780 msgr2=0x7f578003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f578003c780 0x7f578003ec40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f58a0045a60 tx=0x7f58a0053000 comp rx=0 tx=0).stop 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 msgr2=0x562d08f4ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b6087640 1 -- 172.21.15.192:0/1543795230 reap_dead start 2024-09-10T05:12:46.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 0x562d08f4ce30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f58a801b1b0 tx=0x7f58a803f470 comp rx=0 tx=0).stop 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 shutdown_connections 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/1543795230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f45a70 0x562d08f4ce30 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 >> 172.21.15.192:0/1543795230 conn(0x562d08f41e70 msgr2=0x562d08f40080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 shutdown_connections 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/1543795230 wait complete. 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/337397082 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f579003c780 msgr2=0x7f579003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/337397082 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f579003c780 0x7f579003ec40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x562d08f279b0 tx=0x7f58a0005a00 comp rx=0 tx=0).stop 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/337397082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f391b0 msgr2=0x562d08f395d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/337397082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f391b0 0x562d08f395d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f58a8052050 tx=0x7f58a80184f0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/337397082 shutdown_connections 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/337397082 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f579003c780 0x7f579003ec40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/337397082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08f391b0 0x562d08f395d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/337397082 >> 172.21.15.192:0/337397082 conn(0x562d08f2d560 msgr2=0x562d08f2d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/337397082 shutdown_connections 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.469+0000 7f58b9b3e800 1 -- 172.21.15.192:0/337397082 wait complete. 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562d08f24a10 msgr2=0x562d08f26e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562d08f24a10 0x562d08f26e80 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562d08e28210 msgr2=0x562d08f225f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562d08e28210 0x562d08f225f0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562d08f28a70 msgr2=0x562d08f2ae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562d08f28a70 0x562d08f2ae60 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f579c03c730 msgr2=0x7f579c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f579c03c730 0x7f579c03ebf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f58a0057000 tx=0x7f58a0052000 comp rx=0 tx=0).stop 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 msgr2=0x562d08f1afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 --2- 172.21.15.192:0/3588565968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d08e246a0 0x562d08f1afa0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x562d08f145e0 tx=0x7f58a8000bc0 comp rx=0 tx=0).stop 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b6087640 1 -- 172.21.15.192:0/3588565968 reap_dead start 2024-09-10T05:12:46.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 shutdown_connections 2024-09-10T05:12:46.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 >> 172.21.15.192:0/3588565968 conn(0x562d08e1e200 msgr2=0x562d08f14930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:46.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 shutdown_connections 2024-09-10T05:12:46.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:46.470+0000 7f58b9b3e800 1 -- 172.21.15.192:0/3588565968 wait complete. 2024-09-10T05:12:46.480 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-10T05:12:46.286609Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:12:46.286600Z', 'tags': [], 'group_ids': []} 2024-09-10T05:12:51.488 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:51.488 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-10T05:12:51.488 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-10T05:12:51.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-10T05:12:51.488 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-10T05:12:51.548 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:51.548 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:51.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.548+0000 7f36f8926800 1 Processor -- start 2024-09-10T05:12:51.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.548+0000 7f36f8926800 1 -- start start 2024-09-10T05:12:51.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.548+0000 7f36f8926800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5638a6b166d0 0x5638a6b18ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.548+0000 7f36f8926800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5638a69bfe40 con 0x5638a6b19060 2024-09-10T05:12:51.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.548+0000 7f36f8926800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5638a698a680 con 0x5638a6b166d0 2024-09-10T05:12:51.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.549+0000 7f36f45d9640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5638a6b166d0 0x5638a6b18ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.549+0000 7f36f3dd8640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5638a6b19060 0x5638a6b1b520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:34266/0 (socket says 172.21.15.192:34266) 2024-09-10T05:12:51.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.549+0000 7f36f3dd8640 1 -- 172.21.15.192:0/729972471 learned_addr learned my addr 172.21.15.192:0/729972471 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:51.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.549+0000 7f36f45d9640 1 -- 172.21.15.192:0/729972471 >> v1:172.21.15.139:6789/0 conn(0x5638a6b19060 legacy=0x5638a6b1b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.549+0000 7f36f45d9640 1 -- 172.21.15.192:0/729972471 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a69a66b0 con 0x5638a6b166d0 2024-09-10T05:12:51.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.551+0000 7f36f45d9640 1 --2- 172.21.15.192:0/729972471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6b18ac0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f36e4005fd0 tx=0x7f36e4045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ab55eff281b0b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.551+0000 7f36f35d7640 1 -- 172.21.15.192:0/729972471 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e4058530 con 0x5638a6b166d0 2024-09-10T05:12:51.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.551+0000 7f36f35d7640 1 -- 172.21.15.192:0/729972471 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e40586d0 con 0x5638a6b166d0 2024-09-10T05:12:51.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.551+0000 7f36f35d7640 1 -- 172.21.15.192:0/729972471 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e40589d0 con 0x5638a6b166d0 2024-09-10T05:12:51.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.552+0000 7f36f8926800 1 -- 172.21.15.192:0/729972471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 msgr2=0x5638a6b18ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.552+0000 7f36f8926800 1 --2- 172.21.15.192:0/729972471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6b18ac0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f36e4005fd0 tx=0x7f36e4045c30 comp rx=0 tx=0).stop 2024-09-10T05:12:51.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.552+0000 7f36f8926800 1 -- 172.21.15.192:0/729972471 shutdown_connections 2024-09-10T05:12:51.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.552+0000 7f36f8926800 1 --2- 172.21.15.192:0/729972471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6b18ac0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.552+0000 7f36f8926800 1 -- 172.21.15.192:0/729972471 >> 172.21.15.192:0/729972471 conn(0x5638a6b10230 msgr2=0x5638a6b12670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.552+0000 7f36f8926800 1 -- 172.21.15.192:0/729972471 shutdown_connections 2024-09-10T05:12:51.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.552+0000 7f36f8926800 1 -- 172.21.15.192:0/729972471 wait complete. 2024-09-10T05:12:51.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.567+0000 7f36f8926800 1 Processor -- start 2024-09-10T05:12:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.567+0000 7f36f8926800 1 -- start start 2024-09-10T05:12:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.568+0000 7f36f8926800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6b15e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.568+0000 7f36f8926800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5638a69aedd0 con 0x5638a6b166d0 2024-09-10T05:12:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.568+0000 7f36f45d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6b15e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.568+0000 7f36f45d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6b15e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42708/0 (socket says 172.21.15.192:42708) 2024-09-10T05:12:51.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.568+0000 7f36f45d9640 1 -- 172.21.15.192:0/3360779793 learned_addr learned my addr 172.21.15.192:0/3360779793 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.568+0000 7f36f45d9640 1 -- 172.21.15.192:0/3360779793 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a69c7e10 con 0x5638a6b166d0 2024-09-10T05:12:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.568+0000 7f36f45d9640 1 --2- 172.21.15.192:0/3360779793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6b15e60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f36e4025a60 tx=0x7f36e4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794cd87162fa69fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.569+0000 7f35e260c640 1 -- 172.21.15.192:0/3360779793 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e40589b0 con 0x5638a6b166d0 2024-09-10T05:12:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.569+0000 7f35e260c640 1 -- 172.21.15.192:0/3360779793 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e4068070 con 0x5638a6b166d0 2024-09-10T05:12:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.569+0000 7f35e260c640 1 -- 172.21.15.192:0/3360779793 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e4058c80 con 0x5638a6b166d0 2024-09-10T05:12:51.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.569+0000 7f36f8926800 1 -- 172.21.15.192:0/3360779793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 msgr2=0x5638a6b15e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.569+0000 7f36f8926800 1 --2- 172.21.15.192:0/3360779793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6b15e60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f36e4025a60 tx=0x7f36e4051000 comp rx=0 tx=0).stop 2024-09-10T05:12:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.569+0000 7f36f8926800 1 -- 172.21.15.192:0/3360779793 shutdown_connections 2024-09-10T05:12:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.569+0000 7f36f8926800 1 --2- 172.21.15.192:0/3360779793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6b15e60 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.569+0000 7f36f8926800 1 -- 172.21.15.192:0/3360779793 >> 172.21.15.192:0/3360779793 conn(0x5638a6b10230 msgr2=0x5638a6c010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.569+0000 7f36f8926800 1 -- 172.21.15.192:0/3360779793 shutdown_connections 2024-09-10T05:12:51.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.569+0000 7f36f8926800 1 -- 172.21.15.192:0/3360779793 wait complete. 2024-09-10T05:12:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.570+0000 7f36f8926800 1 Processor -- start 2024-09-10T05:12:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.570+0000 7f36f8926800 1 -- start start 2024-09-10T05:12:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.570+0000 7f36f8926800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6c0f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.570+0000 7f36f8926800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5638a6b1d080 con 0x5638a6b166d0 2024-09-10T05:12:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.570+0000 7f36f45d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6c0f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.570+0000 7f36f45d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6c0f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42712/0 (socket says 172.21.15.192:42712) 2024-09-10T05:12:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.570+0000 7f36f45d9640 1 -- 172.21.15.192:0/2634182729 learned_addr learned my addr 172.21.15.192:0/2634182729 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.571+0000 7f36f45d9640 1 -- 172.21.15.192:0/2634182729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a6c0f760 con 0x5638a6b166d0 2024-09-10T05:12:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.571+0000 7f36f45d9640 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6c0f200 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f36e4025a60 tx=0x7f36e4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.571+0000 7f35e0e09640 1 -- 172.21.15.192:0/2634182729 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e4063650 con 0x5638a6b166d0 2024-09-10T05:12:51.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.571+0000 7f35e0e09640 1 -- 172.21.15.192:0/2634182729 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e40637f0 con 0x5638a6b166d0 2024-09-10T05:12:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.571+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638a6c0f9f0 con 0x5638a6b166d0 2024-09-10T05:12:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.571+0000 7f35e0e09640 1 -- 172.21.15.192:0/2634182729 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e4063af0 con 0x5638a6b166d0 2024-09-10T05:12:51.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.571+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a6c10600 con 0x5638a6b166d0 2024-09-10T05:12:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.572+0000 7f35e0e09640 1 -- 172.21.15.192:0/2634182729 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f36e4063c90 con 0x5638a6b166d0 2024-09-10T05:12:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.572+0000 7f35e0e09640 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35dc03c730 0x7f35dc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.572+0000 7f35e0e09640 1 -- 172.21.15.192:0/2634182729 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f36e4097da0 con 0x5638a6b166d0 2024-09-10T05:12:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.572+0000 7f36f3dd8640 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35dc03c730 0x7f35dc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.572+0000 7f36f8926800 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5638a6b19060 0x5638a6c16850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.572+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c16d90 con 0x5638a6b19060 2024-09-10T05:12:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.573+0000 7f36f4dda640 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5638a6b19060 0x5638a6c16850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.573+0000 7f36f3dd8640 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35dc03c730 0x7f35dc03ebf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f36e8001d70 tx=0x7f36e80012d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.573+0000 7f36f4dda640 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5638a6b19060 0x5638a6c16850 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.573+0000 7f36f4dda640 1 -- 172.21.15.192:0/2634182729 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36ec0083e0 con 0x5638a6b19060 2024-09-10T05:12:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.573+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c17130 con 0x5638a6b19060 2024-09-10T05:12:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.573+0000 7f36f4dda640 1 -- 172.21.15.192:0/2634182729 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36ec0083e0 con 0x5638a6b19060 2024-09-10T05:12:51.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.573+0000 7f36f8926800 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5638a6c18c70 0x5638a6c1b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.573+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c1b870 con 0x5638a6c18c70 2024-09-10T05:12:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.574+0000 7f36f45d9640 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5638a6c18c70 0x5638a6c1b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.574+0000 7f36f45d9640 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5638a6c18c70 0x5638a6c1b0e0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.575+0000 7f36f45d9640 1 -- 172.21.15.192:0/2634182729 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c18c70 2024-09-10T05:12:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.575+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c17980 con 0x5638a6b19060 2024-09-10T05:12:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.575+0000 7f36f4dda640 1 -- 172.21.15.192:0/2634182729 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36ec0083e0 con 0x5638a6b19060 2024-09-10T05:12:51.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.575+0000 7f36f8926800 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5638a6c1ccd0 0x5638a6c1f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.575+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c1f830 con 0x5638a6c1ccd0 2024-09-10T05:12:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.575+0000 7f36f3dd8640 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5638a6c1ccd0 0x5638a6c1f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.575+0000 7f36f3dd8640 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5638a6c1ccd0 0x5638a6c1f0c0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.576+0000 7f36f3dd8640 1 -- 172.21.15.192:0/2634182729 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c1ccd0 2024-09-10T05:12:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.576+0000 7f36f8926800 1 Processor -- start 2024-09-10T05:12:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.576+0000 7f36f8926800 1 -- start start 2024-09-10T05:12:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.576+0000 7f36f8926800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c2d470 0x5638a6c2d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.576+0000 7f36f8926800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5638a6a0ca00 con 0x5638a6c2d470 2024-09-10T05:12:51.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.576+0000 7f36f45d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c2d470 0x5638a6c2d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.576+0000 7f36f45d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c2d470 0x5638a6c2d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42726/0 (socket says 172.21.15.192:42726) 2024-09-10T05:12:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.576+0000 7f36f45d9640 1 -- 172.21.15.192:0/1653298500 learned_addr learned my addr 172.21.15.192:0/1653298500 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.577+0000 7f36f45d9640 1 -- 172.21.15.192:0/1653298500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a6c2ded0 con 0x5638a6c2d470 2024-09-10T05:12:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.577+0000 7f36f45d9640 1 --2- 172.21.15.192:0/1653298500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c2d470 0x5638a6c2d890 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f36e404ecf0 tx=0x7f36e4073d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.577+0000 7f35d9ffb640 1 -- 172.21.15.192:0/1653298500 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e4073e60 con 0x5638a6c2d470 2024-09-10T05:12:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.577+0000 7f35d9ffb640 1 -- 172.21.15.192:0/1653298500 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e404e8d0 con 0x5638a6c2d470 2024-09-10T05:12:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.577+0000 7f36f8926800 1 -- 172.21.15.192:0/1653298500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638a6c2e700 con 0x5638a6c2d470 2024-09-10T05:12:51.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.577+0000 7f35d9ffb640 1 -- 172.21.15.192:0/1653298500 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e404faa0 con 0x5638a6c2d470 2024-09-10T05:12:51.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.577+0000 7f36f8926800 1 -- 172.21.15.192:0/1653298500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a6c2eca0 con 0x5638a6c2d470 2024-09-10T05:12:51.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.578+0000 7f35d9ffb640 1 -- 172.21.15.192:0/1653298500 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f36e4073590 con 0x5638a6c2d470 2024-09-10T05:12:51.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.578+0000 7f35d9ffb640 1 --2- 172.21.15.192:0/1653298500 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35cc03c730 0x7f35cc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.578+0000 7f35d9ffb640 1 -- 172.21.15.192:0/1653298500 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f36e408c050 con 0x5638a6c2d470 2024-09-10T05:12:51.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.578+0000 7f36f3dd8640 1 --2- 172.21.15.192:0/1653298500 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35cc03c730 0x7f35cc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.578+0000 7f36f8926800 1 Processor -- start 2024-09-10T05:12:51.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.578+0000 7f36f8926800 1 -- start start 2024-09-10T05:12:51.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.579+0000 7f36f3dd8640 1 --2- 172.21.15.192:0/1653298500 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35cc03c730 0x7f35cc03ebf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f36e800bf40 tx=0x7f36e800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.579+0000 7f36f8926800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 0x5638a6c3a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.579+0000 7f36f8926800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5638a6b14700 con 0x5638a6c39d70 2024-09-10T05:12:51.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.579+0000 7f36f45d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 0x5638a6c3a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.579+0000 7f36f45d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 0x5638a6c3a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42738/0 (socket says 172.21.15.192:42738) 2024-09-10T05:12:51.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.579+0000 7f36f45d9640 1 -- 172.21.15.192:0/3146936711 learned_addr learned my addr 172.21.15.192:0/3146936711 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.579+0000 7f36f45d9640 1 -- 172.21.15.192:0/3146936711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a6c3a740 con 0x5638a6c39d70 2024-09-10T05:12:51.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.579+0000 7f36f45d9640 1 --2- 172.21.15.192:0/3146936711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 0x5638a6c3a150 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f36e4065040 tx=0x7f36e407af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242ee0a5f2828a66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.579+0000 7f35d37fe640 1 -- 172.21.15.192:0/3146936711 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e40ae020 con 0x5638a6c39d70 2024-09-10T05:12:51.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.579+0000 7f35d37fe640 1 -- 172.21.15.192:0/3146936711 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e4086740 con 0x5638a6c39d70 2024-09-10T05:12:51.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.579+0000 7f35d37fe640 1 -- 172.21.15.192:0/3146936711 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e4068390 con 0x5638a6c39d70 2024-09-10T05:12:51.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.580+0000 7f36f8926800 1 -- 172.21.15.192:0/3146936711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 msgr2=0x5638a6c3a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.580+0000 7f36f8926800 1 --2- 172.21.15.192:0/3146936711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 0x5638a6c3a150 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f36e4065040 tx=0x7f36e407af60 comp rx=0 tx=0).stop 2024-09-10T05:12:51.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.580+0000 7f36f8926800 1 -- 172.21.15.192:0/3146936711 shutdown_connections 2024-09-10T05:12:51.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.580+0000 7f36f8926800 1 --2- 172.21.15.192:0/3146936711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 0x5638a6c3a150 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.580+0000 7f36f8926800 1 -- 172.21.15.192:0/3146936711 >> 172.21.15.192:0/3146936711 conn(0x5638a6c36170 msgr2=0x5638a6c343b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.580+0000 7f36f8926800 1 -- 172.21.15.192:0/3146936711 shutdown_connections 2024-09-10T05:12:51.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.580+0000 7f36f8926800 1 -- 172.21.15.192:0/3146936711 wait complete. 2024-09-10T05:12:51.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.580+0000 7f36f8926800 1 Processor -- start 2024-09-10T05:12:51.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.580+0000 7f36f8926800 1 -- start start 2024-09-10T05:12:51.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.581+0000 7f36f8926800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 0x5638a6c411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.581+0000 7f36f8926800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5638a6c3abd0 con 0x5638a6c39d70 2024-09-10T05:12:51.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.581+0000 7f36f45d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 0x5638a6c411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.581+0000 7f36f45d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 0x5638a6c411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42740/0 (socket says 172.21.15.192:42740) 2024-09-10T05:12:51.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.581+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 learned_addr learned my addr 172.21.15.192:0/4099334182 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.581+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a6c41700 con 0x5638a6c39d70 2024-09-10T05:12:51.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.581+0000 7f36f45d9640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 0x5638a6c411a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f36e404f9c0 tx=0x7f36e4065f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.581+0000 7f35d1ffb640 1 -- 172.21.15.192:0/4099334182 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e406c8b0 con 0x5638a6c39d70 2024-09-10T05:12:51.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.581+0000 7f35d1ffb640 1 -- 172.21.15.192:0/4099334182 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e406ca50 con 0x5638a6c39d70 2024-09-10T05:12:51.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.581+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638a6c41700 con 0x5638a6c39d70 2024-09-10T05:12:51.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.582+0000 7f35d1ffb640 1 -- 172.21.15.192:0/4099334182 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e409e800 con 0x5638a6c39d70 2024-09-10T05:12:51.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.582+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a6c41700 con 0x5638a6c39d70 2024-09-10T05:12:51.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.582+0000 7f35d1ffb640 1 -- 172.21.15.192:0/4099334182 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f36e40c5060 con 0x5638a6c39d70 2024-09-10T05:12:51.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.583+0000 7f35d1ffb640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35c403c7d0 0x7f35c403ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.583+0000 7f35d1ffb640 1 -- 172.21.15.192:0/4099334182 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f36e40a5040 con 0x5638a6c39d70 2024-09-10T05:12:51.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.583+0000 7f36f3dd8640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35c403c7d0 0x7f35c403ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.583+0000 7f36f3dd8640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35c403c7d0 0x7f35c403ec90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f36e800c010 tx=0x7f36e8010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.583+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.583+0000 7f36f8926800 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5638a6c4c5f0 0x5638a6c4eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.583+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4f200 con 0x5638a6c4c5f0 2024-09-10T05:12:51.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.583+0000 7f36f4dda640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5638a6c4c5f0 0x5638a6c4eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f4dda640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5638a6c4c5f0 0x5638a6c4eab0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36ec0083e0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f8926800 20 realm 2024-09-10T05:12:51.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4f610 con 0x5638a6c4c5f0 2024-09-10T05:12:51.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36ec0083e0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f8926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:51.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36ec0083e0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.584+0000 7f36f8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.585+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.585+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c50280 con 0x5638a6c4c5f0 2024-09-10T05:12:51.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.585+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36ec0083e0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.585+0000 7f36f8926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:51.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.585+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.585+0000 7f36f8926800 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5638a6c50c40 0x5638a6c53030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.585+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c53680 con 0x5638a6c50c40 2024-09-10T05:12:51.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.585+0000 7f36f45d9640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5638a6c50c40 0x5638a6c53030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.586+0000 7f36f45d9640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5638a6c50c40 0x5638a6c53030 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.586+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.586+0000 7f36f8926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:51.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.586+0000 7f36f8926800 20 searching for the correct realm 2024-09-10T05:12:51.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.586+0000 7f36f8926800 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5638a6c55610 0x5638a6c57ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.586+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c58150 con 0x5638a6c55610 2024-09-10T05:12:51.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.586+0000 7f36f3dd8640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5638a6c55610 0x5638a6c57ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.586+0000 7f36f3dd8640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5638a6c55610 0x5638a6c57ad0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.587+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.587+0000 7f36f3dd8640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f36e8037040 0x7f36e8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.587+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c58150 con 0x7f36e8037040 2024-09-10T05:12:51.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.587+0000 7f36f4dda640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f36e8037040 0x7f36e8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.587+0000 7f36f4dda640 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f36e8037040 0x7f36e8036410 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.587+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f36ec0083e0 con 0x7f36e8037040 2024-09-10T05:12:51.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.587+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c50c40 2024-09-10T05:12:51.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.588+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.588+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.588+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec0083e0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.588+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.588+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec026040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.588+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c50c40 2024-09-10T05:12:51.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.589+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.589+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c50c40 2024-09-10T05:12:51.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.589+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.589+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x7f36e8037040 2024-09-10T05:12:51.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.589+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec026040 con 0x7f36e8037040 2024-09-10T05:12:51.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.589+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c55610 2024-09-10T05:12:51.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.589+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.589+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.590+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec026040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.590+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c50c40 2024-09-10T05:12:51.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.590+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.590+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.590+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec026040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.590+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x7f36e8037040 2024-09-10T05:12:51.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.590+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f36ec026040 con 0x7f36e8037040 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.590+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c55610 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.591+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.591+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c55610 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.591+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.591+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c50c40 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.591+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.591+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c55610 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.592+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.592+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c55610 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.592+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.592+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.592+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec026040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.592+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.592+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f36ec026040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.592+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x7f36e8037040 2024-09-10T05:12:51.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.593+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec026040 con 0x7f36e8037040 2024-09-10T05:12:51.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.593+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c55610 2024-09-10T05:12:51.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.593+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.593+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x7f36e8037040 2024-09-10T05:12:51.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.593+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec026040 con 0x7f36e8037040 2024-09-10T05:12:51.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.593+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.593+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.593+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c50c40 2024-09-10T05:12:51.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.594+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.594+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c55610 2024-09-10T05:12:51.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.594+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.594+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c50c40 2024-09-10T05:12:51.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.594+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.594+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x7f36e8037040 2024-09-10T05:12:51.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.594+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec035040 con 0x7f36e8037040 2024-09-10T05:12:51.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.594+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c55610 2024-09-10T05:12:51.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x7f36e8037040 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec035040 con 0x7f36e8037040 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f36ec03a040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f36ec03a040 con 0x7f36e8037040 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36ec035040 con 0x7f36e8037040 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f8926800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f8926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f8926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f8926800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f8926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f8926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.595+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c4fee0 con 0x7f36e8037040 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f36ec035040 con 0x7f36e8037040 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 20 zone default found 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 4 Realm: () 2024-09-10T05:12:51.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 20 zonegroup default 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.596+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c54b40 con 0x5638a6c50c40 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c59a90 con 0x5638a6c55610 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c59e30 con 0x5638a6c55610 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f8926800 20 started sync module instance, tier type = 2024-09-10T05:12:51.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f8926800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:51.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.597+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c58f20 con 0x7f36e8037040 2024-09-10T05:12:51.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.598+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x7f36e8037040 2024-09-10T05:12:51.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.598+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94801316123728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c58f20 con 0x7f36e8037040 2024-09-10T05:12:51.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.598+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5a970 con 0x5638a6c4c5f0 2024-09-10T05:12:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.599+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94801316123728] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x7f36e8037040 2024-09-10T05:12:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.600+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.600+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94801316127824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c58f20 con 0x5638a6c4c5f0 2024-09-10T05:12:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.600+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5b3e0 con 0x5638a6c55610 2024-09-10T05:12:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.601+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94801316127824] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.601+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.601+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94801316121200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c58e90 con 0x5638a6c55610 2024-09-10T05:12:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.601+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5c2a0 con 0x7f36e8037040 2024-09-10T05:12:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.602+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x7f36e8037040 2024-09-10T05:12:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.602+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94801316134864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5c9c0 con 0x7f36e8037040 2024-09-10T05:12:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.602+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5d4e0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.602+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94801316121200] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.603+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.603+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94801316134864] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x7f36e8037040 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.603+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94801316138928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5d4a0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.604+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5c490 con 0x5638a6c50c40 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.605+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.605+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94801316138928] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.605+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94801316132816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5def0 con 0x5638a6c50c40 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.605+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5e760 con 0x5638a6c50c40 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.606+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94801316132816] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.606+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.606+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94801316141632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5efb0 con 0x5638a6c50c40 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.606+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5f970 con 0x5638a6c50c40 2024-09-10T05:12:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.608+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94801316141632] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.608+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.608+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94801316146400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5f970 con 0x5638a6c50c40 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.608+0000 7f36f8926800 20 add_watcher() i=0 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.608+0000 7f36f8926800 20 add_watcher() i=1 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.608+0000 7f36f8926800 20 add_watcher() i=2 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.608+0000 7f36f8926800 20 add_watcher() i=3 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.608+0000 7f36f8926800 20 add_watcher() i=4 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.608+0000 7f36f8926800 20 add_watcher() i=5 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.608+0000 7f36f8926800 20 add_watcher() i=6 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.609+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94801316146400] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.609+0000 7f36f8926800 20 add_watcher() i=7 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.609+0000 7f36f8926800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.610+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c62d70 con 0x5638a6c4c5f0 2024-09-10T05:12:51.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.610+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.610+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94801316148880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c602c0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.611+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94801316148880] v37'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.611+0000 7f35aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.611+0000 7f36f8926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.611+0000 7f36f8926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.611+0000 7f36f8926800 5 note: GC not initialized 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.611+0000 7f35a97e2640 20 reqs_thread_entry: start 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.611+0000 7f36f8926800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.611+0000 7f36f8926800 20 Filter name: none 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f351affd640 20 reqs_thread_entry: start 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c95e70 con 0x5638a6c50c40 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c94510 con 0x5638a6c50c40 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-10T05:12:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.612+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c94de0 con 0x5638a6c50c40 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.613+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v37'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.613+0000 7f36f8926800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.613+0000 7f36f8926800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.613+0000 7f36f8926800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.613+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94801316366640 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c99300 con 0x5638a6c50c40 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.614+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== watch-notify(notify (1) cookie 94801316132816 notify 158913789981 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5638a6c957c0 con 0x5638a6c50c40 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.614+0000 7f35d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789981 cookie 94801316132816 notifier 4749 bl.length()=556 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.614+0000 7f35d37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.614+0000 7f35d37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.614+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(65 notify.5 [notify cookie 94801316366640 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.614+0000 7f35d37fe640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f35b8003ea0 con 0x5638a6c50c40 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.614+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.614+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== watch-notify(notify_complete (2) cookie 94801316366640 notify 158913789981 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5638a6c2ded0 con 0x5638a6c50c40 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.614+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c94d90 con 0x5638a6c50c40 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.615+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v37'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.615+0000 7f36f8926800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.615+0000 7f36f8926800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.615+0000 7f36f8926800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.615+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94801316366560 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c94d80 con 0x5638a6c55610 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.616+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== watch-notify(notify (1) cookie 94801316121200 notify 158913789960 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f36e8041040 con 0x5638a6c55610 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.616+0000 7f35d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789960 cookie 94801316121200 notifier 4749 bl.length()=177 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.616+0000 7f35d37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.616+0000 7f35d37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.616+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(68 notify.2 [notify cookie 94801316366560 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.616+0000 7f35d37fe640 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f35b8003ea0 con 0x5638a6c55610 2024-09-10T05:12:51.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.616+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.616+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== watch-notify(notify_complete (2) cookie 94801316366560 notify 158913789960 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5638a69bfe40 con 0x5638a6c55610 2024-09-10T05:12:51.639 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-10T05:12:51.613532Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:12:51.613519Z","tags":[],"group_ids":[]} 2024-09-10T05:12:51.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.617+0000 7f35aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:51.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.617+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94801316148880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c93c80 con 0x5638a6c4c5f0 2024-09-10T05:12:51.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.618+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94801316148880] v37'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.618+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94801316123728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c93c80 con 0x7f36e8037040 2024-09-10T05:12:51.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.619+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94801316123728] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x7f36e8037040 2024-09-10T05:12:51.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.619+0000 7f36f8926800 20 remove_watcher() i=0 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.619+0000 7f36f8926800 2 removed watcher, disabling cache 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.619+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94801316127824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c93c80 con 0x5638a6c4c5f0 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.620+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94801316127824] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.620+0000 7f36f8926800 20 remove_watcher() i=1 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.620+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94801316121200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c93c80 con 0x5638a6c55610 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.621+0000 7f36f3dd8640 1 -- 172.21.15.192:0/4099334182 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94801316121200] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e8009050 con 0x5638a6c55610 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.622+0000 7f36f8926800 20 remove_watcher() i=2 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.622+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94801316134864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c58a70 con 0x7f36e8037040 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.623+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94801316134864] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x7f36e8037040 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.623+0000 7f36f8926800 20 remove_watcher() i=3 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.623+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94801316138928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5bfd0 con 0x5638a6c4c5f0 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.624+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94801316138928] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36ec035040 con 0x5638a6c4c5f0 2024-09-10T05:12:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.624+0000 7f36f8926800 20 remove_watcher() i=4 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.624+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94801316132816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c58a70 con 0x5638a6c50c40 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.625+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94801316132816] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.625+0000 7f36f8926800 20 remove_watcher() i=5 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.625+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94801316141632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5cfb0 con 0x5638a6c50c40 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.626+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94801316141632] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.626+0000 7f36f8926800 20 remove_watcher() i=6 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.626+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94801316146400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5638a6c5b7d0 con 0x5638a6c50c40 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f45d9640 1 -- 172.21.15.192:0/4099334182 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94801316146400] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36e40743e0 con 0x5638a6c50c40 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 20 remove_watcher() i=7 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5638a6c50c40 msgr2=0x5638a6c53030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5638a6c50c40 0x5638a6c53030 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5638a6c4c5f0 msgr2=0x5638a6c4eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5638a6c4c5f0 0x5638a6c4eab0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f36e8037040 msgr2=0x7f36e8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f36e8037040 0x7f36e8036410 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5638a6c55610 msgr2=0x5638a6c57ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5638a6c55610 0x5638a6c57ad0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35c403c7d0 msgr2=0x7f35c403ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35c403c7d0 0x7f35c403ec90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f36e800c010 tx=0x7f36e8010000 comp rx=0 tx=0).stop 2024-09-10T05:12:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 msgr2=0x5638a6c411a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 0x5638a6c411a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f36e404f9c0 tx=0x7f36e4065f10 comp rx=0 tx=0).stop 2024-09-10T05:12:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f4dda640 1 -- 172.21.15.192:0/4099334182 reap_dead start 2024-09-10T05:12:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 shutdown_connections 2024-09-10T05:12:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 --2- 172.21.15.192:0/4099334182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c39d70 0x5638a6c411a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 >> 172.21.15.192:0/4099334182 conn(0x5638a6c36170 msgr2=0x5638a6c34380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 shutdown_connections 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.627+0000 7f36f8926800 1 -- 172.21.15.192:0/4099334182 wait complete. 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/1653298500 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35cc03c730 msgr2=0x7f35cc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 --2- 172.21.15.192:0/1653298500 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35cc03c730 0x7f35cc03ebf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f36e800bf40 tx=0x7f36e800f000 comp rx=0 tx=0).stop 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/1653298500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c2d470 msgr2=0x5638a6c2d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 --2- 172.21.15.192:0/1653298500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c2d470 0x5638a6c2d890 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f36e404ecf0 tx=0x7f36e4073d30 comp rx=0 tx=0).stop 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/1653298500 shutdown_connections 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 --2- 172.21.15.192:0/1653298500 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35cc03c730 0x7f35cc03ebf0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 --2- 172.21.15.192:0/1653298500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6c2d470 0x5638a6c2d890 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/1653298500 >> 172.21.15.192:0/1653298500 conn(0x5638a6c21820 msgr2=0x5638a6c21c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/1653298500 shutdown_connections 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/1653298500 wait complete. 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5638a6c18c70 msgr2=0x5638a6c1b0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5638a6c18c70 0x5638a6c1b0e0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5638a6b19060 msgr2=0x5638a6c16850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5638a6b19060 0x5638a6c16850 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5638a6c1ccd0 msgr2=0x5638a6c1f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5638a6c1ccd0 0x5638a6c1f0c0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35dc03c730 msgr2=0x7f35dc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f35dc03c730 0x7f35dc03ebf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f36e8001d70 tx=0x7f36e80012d0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 msgr2=0x5638a6c0f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 --2- 172.21.15.192:0/2634182729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638a6b166d0 0x5638a6c0f200 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f36e4025a60 tx=0x7f36e4003330 comp rx=0 tx=0).stop 2024-09-10T05:12:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f4dda640 1 -- 172.21.15.192:0/2634182729 reap_dead start 2024-09-10T05:12:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 shutdown_connections 2024-09-10T05:12:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 >> 172.21.15.192:0/2634182729 conn(0x5638a6b10230 msgr2=0x5638a6c00c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 shutdown_connections 2024-09-10T05:12:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.628+0000 7f36f8926800 1 -- 172.21.15.192:0/2634182729 wait complete. 2024-09-10T05:12:51.650 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-10T05:12:51.613532Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:12:51.613519Z', 'tags': [], 'group_ids': []} 2024-09-10T05:12:51.664 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:51.669 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-10T05:12:51.669 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-10T05:12:51.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-10T05:12:51.669 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-10T05:12:51.715 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:51.716 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:51.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.715+0000 7f410ac0e800 1 Processor -- start 2024-09-10T05:12:51.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.715+0000 7f410ac0e800 1 -- start start 2024-09-10T05:12:51.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.715+0000 7f410ac0e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55ee8e10d2d0 0x55ee8e112e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.715+0000 7f410ac0e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ee8dfb5e40 con 0x55ee8e10c000 2024-09-10T05:12:51.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.715+0000 7f410ac0e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55ee8df80680 con 0x55ee8e10d2d0 2024-09-10T05:12:51.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.716+0000 7f4105a58640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55ee8e10d2d0 0x55ee8e112e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.716+0000 7f4106259640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55ee8e10c000 0x55ee8e10cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:34272/0 (socket says 172.21.15.192:34272) 2024-09-10T05:12:51.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.716+0000 7f4106259640 1 -- 172.21.15.192:0/2827643117 learned_addr learned my addr 172.21.15.192:0/2827643117 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:12:51.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.716+0000 7f4105a58640 1 -- 172.21.15.192:0/2827643117 >> v1:172.21.15.139:6789/0 conn(0x55ee8e10c000 legacy=0x55ee8e10cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.716+0000 7f4105a58640 1 -- 172.21.15.192:0/2827643117 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8df9c6b0 con 0x55ee8e10d2d0 2024-09-10T05:12:51.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.718+0000 7f4105a58640 1 --2- 172.21.15.192:0/2827643117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10d2d0 0x55ee8e112e70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00a470 tx=0x7f40fc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c592f743517d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.718+0000 7f4105257640 1 -- 172.21.15.192:0/2827643117 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40fc053570 con 0x55ee8e10d2d0 2024-09-10T05:12:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.718+0000 7f4105257640 1 -- 172.21.15.192:0/2827643117 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40fc058070 con 0x55ee8e10d2d0 2024-09-10T05:12:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.718+0000 7f4105257640 1 -- 172.21.15.192:0/2827643117 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40fc053880 con 0x55ee8e10d2d0 2024-09-10T05:12:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.718+0000 7f410ac0e800 1 -- 172.21.15.192:0/2827643117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10d2d0 msgr2=0x55ee8e112e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.718+0000 7f410ac0e800 1 --2- 172.21.15.192:0/2827643117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10d2d0 0x55ee8e112e70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00a470 tx=0x7f40fc045a20 comp rx=0 tx=0).stop 2024-09-10T05:12:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.719+0000 7f410ac0e800 1 -- 172.21.15.192:0/2827643117 shutdown_connections 2024-09-10T05:12:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.719+0000 7f410ac0e800 1 --2- 172.21.15.192:0/2827643117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10d2d0 0x55ee8e112e70 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.719+0000 7f410ac0e800 1 -- 172.21.15.192:0/2827643117 >> 172.21.15.192:0/2827643117 conn(0x55ee8e1073d0 msgr2=0x55ee8e109830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.719+0000 7f410ac0e800 1 -- 172.21.15.192:0/2827643117 shutdown_connections 2024-09-10T05:12:51.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.719+0000 7f410ac0e800 1 -- 172.21.15.192:0/2827643117 wait complete. 2024-09-10T05:12:51.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.732+0000 7f410ac0e800 1 Processor -- start 2024-09-10T05:12:51.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.733+0000 7f410ac0e800 1 -- start start 2024-09-10T05:12:51.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.733+0000 7f410ac0e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 0x55ee8e0816c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.733+0000 7f410ac0e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee8dfa4dd0 con 0x55ee8e10c000 2024-09-10T05:12:51.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.733+0000 7f4106259640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 0x55ee8e0816c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.733+0000 7f4106259640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 0x55ee8e0816c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42748/0 (socket says 172.21.15.192:42748) 2024-09-10T05:12:51.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.733+0000 7f4106259640 1 -- 172.21.15.192:0/299086941 learned_addr learned my addr 172.21.15.192:0/299086941 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.733+0000 7f4106259640 1 -- 172.21.15.192:0/299086941 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8dfbde10 con 0x55ee8e10c000 2024-09-10T05:12:51.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.733+0000 7f4106259640 1 --2- 172.21.15.192:0/299086941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 0x55ee8e0816c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f40f8001e40 tx=0x7f40f8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9d41d07e25866e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.734+0000 7f3ff4608640 1 -- 172.21.15.192:0/299086941 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f8012020 con 0x55ee8e10c000 2024-09-10T05:12:51.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.734+0000 7f3ff4608640 1 -- 172.21.15.192:0/299086941 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f800e5a0 con 0x55ee8e10c000 2024-09-10T05:12:51.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.734+0000 7f3ff4608640 1 -- 172.21.15.192:0/299086941 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f800e8a0 con 0x55ee8e10c000 2024-09-10T05:12:51.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.734+0000 7f410ac0e800 1 -- 172.21.15.192:0/299086941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 msgr2=0x55ee8e0816c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.734+0000 7f410ac0e800 1 --2- 172.21.15.192:0/299086941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 0x55ee8e0816c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f40f8001e40 tx=0x7f40f8001e70 comp rx=0 tx=0).stop 2024-09-10T05:12:51.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.734+0000 7f410ac0e800 1 -- 172.21.15.192:0/299086941 shutdown_connections 2024-09-10T05:12:51.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.734+0000 7f410ac0e800 1 --2- 172.21.15.192:0/299086941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 0x55ee8e0816c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.734+0000 7f410ac0e800 1 -- 172.21.15.192:0/299086941 >> 172.21.15.192:0/299086941 conn(0x55ee8e1073d0 msgr2=0x55ee8e1f6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.734+0000 7f410ac0e800 1 -- 172.21.15.192:0/299086941 shutdown_connections 2024-09-10T05:12:51.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.734+0000 7f410ac0e800 1 -- 172.21.15.192:0/299086941 wait complete. 2024-09-10T05:12:51.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.735+0000 7f410ac0e800 1 Processor -- start 2024-09-10T05:12:51.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.735+0000 7f410ac0e800 1 -- start start 2024-09-10T05:12:51.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.735+0000 7f410ac0e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 0x55ee8e2051a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.735+0000 7f410ac0e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee8e10d9c0 con 0x55ee8e10c000 2024-09-10T05:12:51.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.735+0000 7f4106259640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 0x55ee8e2051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.735+0000 7f4106259640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 0x55ee8e2051a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42750/0 (socket says 172.21.15.192:42750) 2024-09-10T05:12:51.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.735+0000 7f4106259640 1 -- 172.21.15.192:0/1804224246 learned_addr learned my addr 172.21.15.192:0/1804224246 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.735+0000 7f4106259640 1 -- 172.21.15.192:0/1804224246 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8e205700 con 0x55ee8e10c000 2024-09-10T05:12:51.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.736+0000 7f4106259640 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 0x55ee8e2051a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f40f800c010 tx=0x7f40f8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.736+0000 7f3ff2e05640 1 -- 172.21.15.192:0/1804224246 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f8012030 con 0x55ee8e10c000 2024-09-10T05:12:51.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.736+0000 7f3ff2e05640 1 -- 172.21.15.192:0/1804224246 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f80014a0 con 0x55ee8e10c000 2024-09-10T05:12:51.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.736+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee8e205990 con 0x55ee8e10c000 2024-09-10T05:12:51.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.736+0000 7f3ff2e05640 1 -- 172.21.15.192:0/1804224246 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f801a7a0 con 0x55ee8e10c000 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.736+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee8e206390 con 0x55ee8e10c000 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.737+0000 7f3ff2e05640 1 -- 172.21.15.192:0/1804224246 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f40f8015020 con 0x55ee8e10c000 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.737+0000 7f3ff2e05640 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fec03c780 0x7f3fec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.737+0000 7f3ff2e05640 1 -- 172.21.15.192:0/1804224246 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f40f8020030 con 0x55ee8e10c000 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.737+0000 7f4105a58640 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fec03c780 0x7f3fec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.737+0000 7f410ac0e800 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee8e10d2d0 0x55ee8e20c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.737+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e206f20 con 0x55ee8e10d2d0 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.738+0000 7f4106a5a640 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee8e10d2d0 0x55ee8e20c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.738+0000 7f4105a58640 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fec03c780 0x7f3fec03ec40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f40fc057000 tx=0x7f40fc052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.738+0000 7f4106a5a640 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee8e10d2d0 0x55ee8e20c7f0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.738+0000 7f4106a5a640 1 -- 172.21.15.192:0/1804224246 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e10d2d0 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.738+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e206820 con 0x55ee8e10d2d0 2024-09-10T05:12:51.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.738+0000 7f4106a5a640 1 -- 172.21.15.192:0/1804224246 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e10d2d0 2024-09-10T05:12:51.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.738+0000 7f410ac0e800 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee8e20ec60 0x55ee8e211050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.738+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e211720 con 0x55ee8e20ec60 2024-09-10T05:12:51.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.739+0000 7f4106259640 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee8e20ec60 0x55ee8e211050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.739+0000 7f4106259640 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee8e20ec60 0x55ee8e211050 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.739+0000 7f4106259640 1 -- 172.21.15.192:0/1804224246 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40f80187b0 con 0x55ee8e20ec60 2024-09-10T05:12:51.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.739+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e20db00 con 0x55ee8e10d2d0 2024-09-10T05:12:51.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.740+0000 7f4106a5a640 1 -- 172.21.15.192:0/1804224246 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e10d2d0 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.740+0000 7f410ac0e800 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ee8e212b60 0x55ee8e214f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.740+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e215690 con 0x55ee8e212b60 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.740+0000 7f4105a58640 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ee8e212b60 0x55ee8e214f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.740+0000 7f4105a58640 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ee8e212b60 0x55ee8e214f50 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.740+0000 7f4105a58640 1 -- 172.21.15.192:0/1804224246 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40fc051070 con 0x55ee8e212b60 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.740+0000 7f410ac0e800 1 Processor -- start 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.741+0000 7f410ac0e800 1 -- start start 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.741+0000 7f410ac0e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e2232f0 0x55ee8e223710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.741+0000 7f410ac0e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee8e002a00 con 0x55ee8e2232f0 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.741+0000 7f4106259640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e2232f0 0x55ee8e223710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.741+0000 7f4106259640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e2232f0 0x55ee8e223710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42752/0 (socket says 172.21.15.192:42752) 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.741+0000 7f4106259640 1 -- 172.21.15.192:0/36229302 learned_addr learned my addr 172.21.15.192:0/36229302 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.741+0000 7f4106259640 1 -- 172.21.15.192:0/36229302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8e223d50 con 0x55ee8e2232f0 2024-09-10T05:12:51.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.741+0000 7f4106259640 1 --2- 172.21.15.192:0/36229302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e2232f0 0x55ee8e223710 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f40f8001250 tx=0x7f40f801ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.741+0000 7f3febfff640 1 -- 172.21.15.192:0/36229302 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f8018430 con 0x55ee8e2232f0 2024-09-10T05:12:51.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.741+0000 7f3febfff640 1 -- 172.21.15.192:0/36229302 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f8045040 con 0x55ee8e2232f0 2024-09-10T05:12:51.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.742+0000 7f410ac0e800 1 -- 172.21.15.192:0/36229302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee8e224580 con 0x55ee8e2232f0 2024-09-10T05:12:51.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.742+0000 7f3febfff640 1 -- 172.21.15.192:0/36229302 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f80164e0 con 0x55ee8e2232f0 2024-09-10T05:12:51.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.742+0000 7f410ac0e800 1 -- 172.21.15.192:0/36229302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee8e224b20 con 0x55ee8e2232f0 2024-09-10T05:12:51.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.742+0000 7f3febfff640 1 -- 172.21.15.192:0/36229302 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f40f8053040 con 0x55ee8e2232f0 2024-09-10T05:12:51.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.743+0000 7f3febfff640 1 --2- 172.21.15.192:0/36229302 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fe003c6e0 0x7f3fe003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.743+0000 7f3febfff640 1 -- 172.21.15.192:0/36229302 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f40f8025030 con 0x55ee8e2232f0 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.743+0000 7f4105a58640 1 --2- 172.21.15.192:0/36229302 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fe003c6e0 0x7f3fe003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.743+0000 7f410ac0e800 1 Processor -- start 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.743+0000 7f410ac0e800 1 -- start start 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.743+0000 7f4105a58640 1 --2- 172.21.15.192:0/36229302 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fe003c6e0 0x7f3fe003eba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55ee8e20ce00 tx=0x7f40fc005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.743+0000 7f410ac0e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 0x55ee8e22ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.743+0000 7f410ac0e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee8e07ff60 con 0x55ee8e22fbd0 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.743+0000 7f4106259640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 0x55ee8e22ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.743+0000 7f4106259640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 0x55ee8e22ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42762/0 (socket says 172.21.15.192:42762) 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.743+0000 7f4106259640 1 -- 172.21.15.192:0/1835149215 learned_addr learned my addr 172.21.15.192:0/1835149215 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.744+0000 7f4106259640 1 -- 172.21.15.192:0/1835149215 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8e2305c0 con 0x55ee8e22fbd0 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.744+0000 7f4106259640 1 --2- 172.21.15.192:0/1835149215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 0x55ee8e22ffd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f40f80185f0 tx=0x7f40f80366e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1551f2e91933627 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.744+0000 7f3fe9ffb640 1 -- 172.21.15.192:0/1835149215 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f8024cf0 con 0x55ee8e22fbd0 2024-09-10T05:12:51.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.744+0000 7f3fe9ffb640 1 -- 172.21.15.192:0/1835149215 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f8050a60 con 0x55ee8e22fbd0 2024-09-10T05:12:51.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.744+0000 7f3fe9ffb640 1 -- 172.21.15.192:0/1835149215 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f8024420 con 0x55ee8e22fbd0 2024-09-10T05:12:51.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.744+0000 7f410ac0e800 1 -- 172.21.15.192:0/1835149215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 msgr2=0x55ee8e22ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.744+0000 7f410ac0e800 1 --2- 172.21.15.192:0/1835149215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 0x55ee8e22ffd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f40f80185f0 tx=0x7f40f80366e0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.744+0000 7f410ac0e800 1 -- 172.21.15.192:0/1835149215 shutdown_connections 2024-09-10T05:12:51.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.744+0000 7f410ac0e800 1 --2- 172.21.15.192:0/1835149215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 0x55ee8e22ffd0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.744+0000 7f410ac0e800 1 -- 172.21.15.192:0/1835149215 >> 172.21.15.192:0/1835149215 conn(0x55ee8e22bfd0 msgr2=0x55ee8e22a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.744+0000 7f410ac0e800 1 -- 172.21.15.192:0/1835149215 shutdown_connections 2024-09-10T05:12:51.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.744+0000 7f410ac0e800 1 -- 172.21.15.192:0/1835149215 wait complete. 2024-09-10T05:12:51.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.745+0000 7f410ac0e800 1 Processor -- start 2024-09-10T05:12:51.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.745+0000 7f410ac0e800 1 -- start start 2024-09-10T05:12:51.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.745+0000 7f410ac0e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 0x55ee8e236fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.745+0000 7f410ac0e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee8e230a30 con 0x55ee8e22fbd0 2024-09-10T05:12:51.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.745+0000 7f4106259640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 0x55ee8e236fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.745+0000 7f4106259640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 0x55ee8e236fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42766/0 (socket says 172.21.15.192:42766) 2024-09-10T05:12:51.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.745+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 learned_addr learned my addr 172.21.15.192:0/639011235 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.745+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8e237540 con 0x55ee8e22fbd0 2024-09-10T05:12:51.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.745+0000 7f4106259640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 0x55ee8e236fe0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f40f8050d20 tx=0x7f40f802af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.746+0000 7f3fd7fff640 1 -- 172.21.15.192:0/639011235 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f806e070 con 0x55ee8e22fbd0 2024-09-10T05:12:51.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.746+0000 7f3fd7fff640 1 -- 172.21.15.192:0/639011235 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f804ba50 con 0x55ee8e22fbd0 2024-09-10T05:12:51.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.746+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee8e237540 con 0x55ee8e22fbd0 2024-09-10T05:12:51.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.746+0000 7f3fd7fff640 1 -- 172.21.15.192:0/639011235 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f8024b10 con 0x55ee8e22fbd0 2024-09-10T05:12:51.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.746+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee8e237540 con 0x55ee8e22fbd0 2024-09-10T05:12:51.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.747+0000 7f3fd7fff640 1 -- 172.21.15.192:0/639011235 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f40f8071070 con 0x55ee8e22fbd0 2024-09-10T05:12:51.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.747+0000 7f3fd7fff640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fd003c730 0x7f3fd003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.747+0000 7f3fd7fff640 1 -- 172.21.15.192:0/639011235 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f40f8065040 con 0x55ee8e22fbd0 2024-09-10T05:12:51.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.747+0000 7f4105a58640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fd003c730 0x7f3fd003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f410ac0e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f410ac0e800 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee8e242590 0x55ee8e244a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f4105a58640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fd003c730 0x7f3fd003ebf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40fc000c00 tx=0x7f40fc053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e2451a0 con 0x55ee8e242590 2024-09-10T05:12:51.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f4106a5a640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee8e242590 0x55ee8e244a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f4106a5a640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee8e242590 0x55ee8e244a50 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f410ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f410ac0e800 20 realm 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f410ac0e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e2455b0 con 0x55ee8e242590 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f410ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f410ac0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f410ac0e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.748+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e245e80 con 0x55ee8e242590 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.749+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.749+0000 7f410ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.749+0000 7f410ac0e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.749+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e242590 2024-09-10T05:12:51.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.749+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.749+0000 7f410ac0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:51.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.749+0000 7f410ac0e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.749+0000 7f410ac0e800 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee8e246f80 0x55ee8e249370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.749+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e249930 con 0x55ee8e246f80 2024-09-10T05:12:51.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.749+0000 7f4106259640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee8e246f80 0x55ee8e249370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.750+0000 7f4106259640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee8e246f80 0x55ee8e249370 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.750+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.750+0000 7f410ac0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:51.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.750+0000 7f410ac0e800 20 searching for the correct realm 2024-09-10T05:12:51.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.750+0000 7f410ac0e800 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ee8e24b8e0 0x55ee8e24dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.750+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e24e470 con 0x55ee8e24b8e0 2024-09-10T05:12:51.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.750+0000 7f4105a58640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ee8e24b8e0 0x55ee8e24dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.750+0000 7f4105a58640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ee8e24b8e0 0x55ee8e24dda0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.751+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.751+0000 7f4105a58640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f40fc05f040 0x7f40fc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.751+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e24e470 con 0x7f40fc05f040 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.751+0000 7f4106a5a640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f40fc05f040 0x7f40fc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.751+0000 7f4106a5a640 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f40fc05f040 0x7f40fc06b410 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.751+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.751+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e246f80 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.752+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.752+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e242590 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.752+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.752+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e242590 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.752+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.752+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e246f80 2024-09-10T05:12:51.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.752+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.752+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e246f80 2024-09-10T05:12:51.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.753+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.753+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x7f40fc05f040 2024-09-10T05:12:51.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.753+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.753+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e24b8e0 2024-09-10T05:12:51.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.753+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.753+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e242590 2024-09-10T05:12:51.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.753+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.753+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e246f80 2024-09-10T05:12:51.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.754+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.754+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e242590 2024-09-10T05:12:51.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.754+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.754+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x7f40fc05f040 2024-09-10T05:12:51.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.754+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.754+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e24b8e0 2024-09-10T05:12:51.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.754+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.754+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e24b8e0 2024-09-10T05:12:51.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.754+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.754+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e246f80 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.755+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.755+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e24b8e0 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.755+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.755+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e24b8e0 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.755+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.755+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e242590 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.755+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.755+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e242590 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.756+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.756+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x7f40fc05f040 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.756+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.756+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e24b8e0 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.756+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.756+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x7f40fc05f040 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.756+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.756+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e242590 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.756+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.756+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e246f80 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.757+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.757+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e24b8e0 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.757+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.757+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e246f80 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.757+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.757+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x7f40fc05f040 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.758+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.758+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e24b8e0 2024-09-10T05:12:51.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.758+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.758+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x7f40fc05f040 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.758+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.758+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x55ee8e242590 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.758+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.758+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e246220 con 0x7f40fc05f040 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:51.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e24a1f0 con 0x55ee8e242590 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e24a1f0 con 0x55ee8e242590 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e24a1f0 con 0x7f40fc05f040 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 zone default found 2024-09-10T05:12:51.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 4 Realm: () 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 zonegroup default 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.759+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e24a1e0 con 0x55ee8e246f80 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f410ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f410ac0e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e2502e0 con 0x55ee8e24b8e0 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f410ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f410ac0e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e250680 con 0x55ee8e24b8e0 2024-09-10T05:12:51.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f410ac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f410ac0e800 20 started sync module instance, tier type = 2024-09-10T05:12:51.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f410ac0e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:51.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.760+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e24f780 con 0x7f40fc05f040 2024-09-10T05:12:51.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.761+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.761+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94483075365792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e24f780 con 0x7f40fc05f040 2024-09-10T05:12:51.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.761+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e250f50 con 0x55ee8e242590 2024-09-10T05:12:51.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.762+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94483075365792] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.762+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.762+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94483075369504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e24f780 con 0x55ee8e242590 2024-09-10T05:12:51.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.762+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e2519f0 con 0x55ee8e24b8e0 2024-09-10T05:12:51.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.763+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94483075369504] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.764+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.764+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94483075363536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e24f6f0 con 0x55ee8e24b8e0 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.764+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e2528b0 con 0x7f40fc05f040 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.765+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.765+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94483075376608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e253010 con 0x7f40fc05f040 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.765+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e253b10 con 0x55ee8e242590 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.765+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94483075363536] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.766+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94483075376608] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.766+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.766+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94483075380736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e253ad0 con 0x55ee8e242590 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.766+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e2543e0 con 0x55ee8e246f80 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.767+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94483075380736] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.767+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.767+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94483075383088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e253ad0 con 0x55ee8e246f80 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.767+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e254da0 con 0x55ee8e246f80 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.768+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94483075383088] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.768+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.768+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94483075374560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e255640 con 0x55ee8e246f80 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.768+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e255ef0 con 0x55ee8e246f80 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.769+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(58 notify.7 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.769+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94483075374560] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.769+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94483075392144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e256b60 con 0x55ee8e246f80 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.769+0000 7f410ac0e800 20 add_watcher() i=0 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.769+0000 7f410ac0e800 20 add_watcher() i=1 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.769+0000 7f410ac0e800 20 add_watcher() i=2 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.769+0000 7f410ac0e800 20 add_watcher() i=3 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.769+0000 7f410ac0e800 20 add_watcher() i=4 2024-09-10T05:12:51.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.769+0000 7f410ac0e800 20 add_watcher() i=5 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.769+0000 7f410ac0e800 20 add_watcher() i=6 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.770+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94483075392144] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.770+0000 7f410ac0e800 20 add_watcher() i=7 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.770+0000 7f410ac0e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.770+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e259b90 con 0x55ee8e242590 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.770+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.771+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94483075393200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e256fb0 con 0x55ee8e242590 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.772+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94483075393200] v37'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.772+0000 7f3fbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.772+0000 7f410ac0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.772+0000 7f410ac0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.772+0000 7f410ac0e800 5 note: GC not initialized 2024-09-10T05:12:51.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.772+0000 7f3f377fe640 20 reqs_thread_entry: start 2024-09-10T05:12:51.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.772+0000 7f410ac0e800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:51.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.772+0000 7f410ac0e800 20 Filter name: none 2024-09-10T05:12:51.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.772+0000 7f3f357fa640 20 reqs_thread_entry: start 2024-09-10T05:12:51.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.772+0000 7f410ac0e800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T05:12:51.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.772+0000 7f410ac0e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.772+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e28cb30 con 0x7f40fc05f040 2024-09-10T05:12:51.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.773+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.773+0000 7f410ac0e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:12:51.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.773+0000 7f410ac0e800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-10T05:12:51.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.773+0000 7f410ac0e800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:12:51.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.773+0000 7f410ac0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:51.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.773+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e290cc0 con 0x55ee8e246f80 2024-09-10T05:12:51.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.774+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v37'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.793 INFO:teuthology.orchestra.run.smithi192.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-10T05:12:51.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.775+0000 7f3fbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:51.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.775+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94483075393200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e28a9d0 con 0x55ee8e242590 2024-09-10T05:12:51.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.776+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94483075393200] v37'225 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.776+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94483075365792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e28a9d0 con 0x7f40fc05f040 2024-09-10T05:12:51.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.777+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94483075365792] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.777+0000 7f410ac0e800 20 remove_watcher() i=0 2024-09-10T05:12:51.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.777+0000 7f410ac0e800 2 removed watcher, disabling cache 2024-09-10T05:12:51.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.777+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94483075369504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e28a9d0 con 0x55ee8e242590 2024-09-10T05:12:51.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.778+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94483075369504] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.778+0000 7f410ac0e800 20 remove_watcher() i=1 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.778+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94483075363536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e28a9d0 con 0x55ee8e24b8e0 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.779+0000 7f4105a58640 1 -- 172.21.15.192:0/639011235 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94483075363536] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc07c040 con 0x55ee8e24b8e0 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.779+0000 7f410ac0e800 20 remove_watcher() i=2 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.779+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94483075376608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e28a9d0 con 0x7f40fc05f040 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.780+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94483075376608] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x7f40fc05f040 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.780+0000 7f410ac0e800 20 remove_watcher() i=3 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.780+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94483075380736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e28a9d0 con 0x55ee8e242590 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.781+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94483075380736] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f410000a4d0 con 0x55ee8e242590 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.781+0000 7f410ac0e800 20 remove_watcher() i=4 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.781+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94483075383088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e28a9d0 con 0x55ee8e246f80 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.782+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94483075383088] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.782+0000 7f410ac0e800 20 remove_watcher() i=5 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.782+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94483075374560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e28a9d0 con 0x55ee8e246f80 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.783+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94483075374560] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.783+0000 7f410ac0e800 20 remove_watcher() i=6 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.783+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94483075392144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee8e28a9d0 con 0x55ee8e246f80 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.784+0000 7f4106259640 1 -- 172.21.15.192:0/639011235 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94483075392144] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8070030 con 0x55ee8e246f80 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.784+0000 7f410ac0e800 20 remove_watcher() i=7 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.784+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee8e246f80 msgr2=0x55ee8e249370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.784+0000 7f410ac0e800 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee8e246f80 0x55ee8e249370 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.784+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee8e242590 msgr2=0x55ee8e244a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.784+0000 7f410ac0e800 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee8e242590 0x55ee8e244a50 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.784+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f40fc05f040 msgr2=0x7f40fc06b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.784+0000 7f410ac0e800 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f40fc05f040 0x7f40fc06b410 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.784+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ee8e24b8e0 msgr2=0x55ee8e24dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.784+0000 7f410ac0e800 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55ee8e24b8e0 0x55ee8e24dda0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.784+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fd003c730 msgr2=0x7f3fd003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.784+0000 7f410ac0e800 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fd003c730 0x7f3fd003ebf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40fc000c00 tx=0x7f40fc053000 comp rx=0 tx=0).stop 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f4106a5a640 1 -- 172.21.15.192:0/639011235 reap_dead start 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 msgr2=0x55ee8e236fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 0x55ee8e236fe0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f40f8050d20 tx=0x7f40f802af60 comp rx=0 tx=0).stop 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 shutdown_connections 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 --2- 172.21.15.192:0/639011235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e22fbd0 0x55ee8e236fe0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 >> 172.21.15.192:0/639011235 conn(0x55ee8e22bfd0 msgr2=0x55ee8e22a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 shutdown_connections 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/639011235 wait complete. 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/36229302 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fe003c6e0 msgr2=0x7f3fe003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 --2- 172.21.15.192:0/36229302 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fe003c6e0 0x7f3fe003eba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55ee8e20ce00 tx=0x7f40fc005a00 comp rx=0 tx=0).stop 2024-09-10T05:12:51.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/36229302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e2232f0 msgr2=0x55ee8e223710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 --2- 172.21.15.192:0/36229302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e2232f0 0x55ee8e223710 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f40f8001250 tx=0x7f40f801ae90 comp rx=0 tx=0).stop 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/36229302 shutdown_connections 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 --2- 172.21.15.192:0/36229302 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fe003c6e0 0x7f3fe003eba0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 --2- 172.21.15.192:0/36229302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e2232f0 0x55ee8e223710 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/36229302 >> 172.21.15.192:0/36229302 conn(0x55ee8e2176a0 msgr2=0x55ee8e217a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/36229302 shutdown_connections 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/36229302 wait complete. 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee8e20ec60 msgr2=0x55ee8e211050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55ee8e20ec60 0x55ee8e211050 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee8e10d2d0 msgr2=0x55ee8e20c7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55ee8e10d2d0 0x55ee8e20c7f0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ee8e212b60 msgr2=0x55ee8e214f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.785+0000 7f410ac0e800 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55ee8e212b60 0x55ee8e214f50 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.786+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fec03c780 msgr2=0x7f3fec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.786+0000 7f410ac0e800 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3fec03c780 0x7f3fec03ec40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f40fc057000 tx=0x7f40fc052000 comp rx=0 tx=0).stop 2024-09-10T05:12:51.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.786+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 msgr2=0x55ee8e2051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.786+0000 7f410ac0e800 1 --2- 172.21.15.192:0/1804224246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee8e10c000 0x55ee8e2051a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f40f800c010 tx=0x7f40f8000ed0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.786+0000 7f4106a5a640 1 -- 172.21.15.192:0/1804224246 reap_dead start 2024-09-10T05:12:51.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.786+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 shutdown_connections 2024-09-10T05:12:51.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.786+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 >> 172.21.15.192:0/1804224246 conn(0x55ee8e1073d0 msgr2=0x55ee8e1f6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.786+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 shutdown_connections 2024-09-10T05:12:51.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.786+0000 7f410ac0e800 1 -- 172.21.15.192:0/1804224246 wait complete. 2024-09-10T05:12:51.799 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-10T05:12:51.803 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:51.804 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-10T05:12:51.808 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-10T05:12:51.808 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-10T05:12:51.808 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-10T05:12:51.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-10T05:12:51.809 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-10T05:12:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:51.854 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.854+0000 7f9b1880f800 1 Processor -- start 2024-09-10T05:12:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.854+0000 7f9b1880f800 1 -- start start 2024-09-10T05:12:51.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.854+0000 7f9b1880f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56519fe266a0 0x56519fe28a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.854+0000 7f9b1880f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56519fccfe40 con 0x56519fe29030 2024-09-10T05:12:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.854+0000 7f9b1880f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x56519fc9a680 con 0x56519fe266a0 2024-09-10T05:12:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.854+0000 7f9b162f9640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56519fe266a0 0x56519fe28a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.854+0000 7f9b162f9640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56519fe266a0 0x56519fe28a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42778/0 (socket says 172.21.15.192:42778) 2024-09-10T05:12:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.854+0000 7f9b0ffff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x56519fe29030 0x56519fe2b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:34286/0 (socket says 172.21.15.192:34286) 2024-09-10T05:12:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.854+0000 7f9b162f9640 1 -- 172.21.15.192:0/3765615373 learned_addr learned my addr 172.21.15.192:0/3765615373 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.855+0000 7f9b162f9640 1 -- 172.21.15.192:0/3765615373 >> v1:172.21.15.139:6789/0 conn(0x56519fe29030 legacy=0x56519fe2b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.855+0000 7f9b162f9640 1 -- 172.21.15.192:0/3765615373 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519fcb66b0 con 0x56519fe266a0 2024-09-10T05:12:51.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.855+0000 7f9b15af8640 1 -- 172.21.15.192:0/3765615373 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2342613801 0 0) 0x56519fccfe40 con 0x56519fe29030 2024-09-10T05:12:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.856+0000 7f9b162f9640 1 --2- 172.21.15.192:0/3765615373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519fe28a90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800a520 tx=0x7f9b08045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f499ca4366fd6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.857+0000 7f9b15af8640 1 -- 172.21.15.192:0/3765615373 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b08055070 con 0x56519fe266a0 2024-09-10T05:12:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.857+0000 7f9b15af8640 1 -- 172.21.15.192:0/3765615373 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b080515b0 con 0x56519fe266a0 2024-09-10T05:12:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.857+0000 7f9b15af8640 1 -- 172.21.15.192:0/3765615373 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b080518d0 con 0x56519fe266a0 2024-09-10T05:12:51.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.857+0000 7f9b1880f800 1 -- 172.21.15.192:0/3765615373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 msgr2=0x56519fe28a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.857+0000 7f9b1880f800 1 --2- 172.21.15.192:0/3765615373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519fe28a90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800a520 tx=0x7f9b08045ba0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.857+0000 7f9b1880f800 1 -- 172.21.15.192:0/3765615373 shutdown_connections 2024-09-10T05:12:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.857+0000 7f9b1880f800 1 --2- 172.21.15.192:0/3765615373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519fe28a90 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.857+0000 7f9b1880f800 1 -- 172.21.15.192:0/3765615373 >> 172.21.15.192:0/3765615373 conn(0x56519fe20200 msgr2=0x56519fe22640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.857+0000 7f9b1880f800 1 -- 172.21.15.192:0/3765615373 shutdown_connections 2024-09-10T05:12:51.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.857+0000 7f9b1880f800 1 -- 172.21.15.192:0/3765615373 wait complete. 2024-09-10T05:12:51.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.871+0000 7f9b1880f800 1 Processor -- start 2024-09-10T05:12:51.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.871+0000 7f9b1880f800 1 -- start start 2024-09-10T05:12:51.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.871+0000 7f9b1880f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519fe25e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.871+0000 7f9b1880f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56519fcbedd0 con 0x56519fe266a0 2024-09-10T05:12:51.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.871+0000 7f9b162f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519fe25e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.871+0000 7f9b162f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519fe25e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42788/0 (socket says 172.21.15.192:42788) 2024-09-10T05:12:51.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.871+0000 7f9b162f9640 1 -- 172.21.15.192:0/3483609337 learned_addr learned my addr 172.21.15.192:0/3483609337 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.872+0000 7f9b162f9640 1 -- 172.21.15.192:0/3483609337 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519fcd7e10 con 0x56519fe266a0 2024-09-10T05:12:51.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.872+0000 7f9b162f9640 1 --2- 172.21.15.192:0/3483609337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519fe25e30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9b08045be0 tx=0x7f9b08051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9eaa14d4e85858 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.872+0000 7f9a04608640 1 -- 172.21.15.192:0/3483609337 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b08051ac0 con 0x56519fe266a0 2024-09-10T05:12:51.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.872+0000 7f9a04608640 1 -- 172.21.15.192:0/3483609337 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b08051c60 con 0x56519fe266a0 2024-09-10T05:12:51.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.872+0000 7f9a04608640 1 -- 172.21.15.192:0/3483609337 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b08066460 con 0x56519fe266a0 2024-09-10T05:12:51.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b1880f800 1 -- 172.21.15.192:0/3483609337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 msgr2=0x56519fe25e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b1880f800 1 --2- 172.21.15.192:0/3483609337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519fe25e30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9b08045be0 tx=0x7f9b08051000 comp rx=0 tx=0).stop 2024-09-10T05:12:51.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b1880f800 1 -- 172.21.15.192:0/3483609337 shutdown_connections 2024-09-10T05:12:51.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b1880f800 1 --2- 172.21.15.192:0/3483609337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519fe25e30 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b1880f800 1 -- 172.21.15.192:0/3483609337 >> 172.21.15.192:0/3483609337 conn(0x56519fe20200 msgr2=0x56519ff10dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b1880f800 1 -- 172.21.15.192:0/3483609337 shutdown_connections 2024-09-10T05:12:51.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b1880f800 1 -- 172.21.15.192:0/3483609337 wait complete. 2024-09-10T05:12:51.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b1880f800 1 Processor -- start 2024-09-10T05:12:51.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b1880f800 1 -- start start 2024-09-10T05:12:51.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b1880f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519ff1ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b1880f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56519fe2d050 con 0x56519fe266a0 2024-09-10T05:12:51.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b162f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519ff1ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.873+0000 7f9b162f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519ff1ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42796/0 (socket says 172.21.15.192:42796) 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.874+0000 7f9b162f9640 1 -- 172.21.15.192:0/1947846226 learned_addr learned my addr 172.21.15.192:0/1947846226 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.874+0000 7f9b162f9640 1 -- 172.21.15.192:0/1947846226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519ff1f4c0 con 0x56519fe266a0 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.874+0000 7f9b162f9640 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519ff1ef60 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9b08045be0 tx=0x7f9b08003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.874+0000 7f9a02e05640 1 -- 172.21.15.192:0/1947846226 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0805a600 con 0x56519fe266a0 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.874+0000 7f9a02e05640 1 -- 172.21.15.192:0/1947846226 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0805a7a0 con 0x56519fe266a0 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.874+0000 7f9a02e05640 1 -- 172.21.15.192:0/1947846226 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0805aa80 con 0x56519fe266a0 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.874+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56519ff1f750 con 0x56519fe266a0 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.874+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519ff20150 con 0x56519fe266a0 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.875+0000 7f9a02e05640 1 -- 172.21.15.192:0/1947846226 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9b08058070 con 0x56519fe266a0 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.875+0000 7f9a02e05640 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99fc03c730 0x7f99fc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.875+0000 7f9a02e05640 1 -- 172.21.15.192:0/1947846226 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9b08062070 con 0x56519fe266a0 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.875+0000 7f9b0ffff640 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99fc03c730 0x7f99fc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.875+0000 7f9b1880f800 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56519fe29030 0x56519ff265b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.875+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff26af0 con 0x56519fe29030 2024-09-10T05:12:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.876+0000 7f9b16afa640 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56519fe29030 0x56519ff265b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.876+0000 7f9b0ffff640 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99fc03c730 0x7f99fc03ebf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9b00000c00 tx=0x7f9b000013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.876+0000 7f9b16afa640 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56519fe29030 0x56519ff265b0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.876+0000 7f9b16afa640 1 -- 172.21.15.192:0/1947846226 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519fe29030 2024-09-10T05:12:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.876+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff26e90 con 0x56519fe29030 2024-09-10T05:12:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.876+0000 7f9b16afa640 1 -- 172.21.15.192:0/1947846226 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519fe29030 2024-09-10T05:12:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.876+0000 7f9b1880f800 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56519ff28950 0x56519ff2adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.876+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff2b580 con 0x56519ff28950 2024-09-10T05:12:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.877+0000 7f9b162f9640 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56519ff28950 0x56519ff2adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.877+0000 7f9b162f9640 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56519ff28950 0x56519ff2adf0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.877+0000 7f9b162f9640 1 -- 172.21.15.192:0/1947846226 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9b08057030 con 0x56519ff28950 2024-09-10T05:12:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.877+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff276e0 con 0x56519fe29030 2024-09-10T05:12:51.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.878+0000 7f9b16afa640 1 -- 172.21.15.192:0/1947846226 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519fe29030 2024-09-10T05:12:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.878+0000 7f9b1880f800 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56519ff2c9e0 0x56519ff2edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.878+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff2f510 con 0x56519ff2c9e0 2024-09-10T05:12:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.878+0000 7f9b0ffff640 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56519ff2c9e0 0x56519ff2edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.878+0000 7f9b0ffff640 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56519ff2c9e0 0x56519ff2edd0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.878+0000 7f9b0ffff640 1 -- 172.21.15.192:0/1947846226 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9b0000f670 con 0x56519ff2c9e0 2024-09-10T05:12:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.879+0000 7f9b1880f800 1 Processor -- start 2024-09-10T05:12:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.879+0000 7f9b1880f800 1 -- start start 2024-09-10T05:12:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.879+0000 7f9b1880f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff3d0d0 0x56519ff3d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.879+0000 7f9b1880f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56519fd1ca00 con 0x56519ff3d0d0 2024-09-10T05:12:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.879+0000 7f9b162f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff3d0d0 0x56519ff3d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.879+0000 7f9b162f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff3d0d0 0x56519ff3d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42800/0 (socket says 172.21.15.192:42800) 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.879+0000 7f9b162f9640 1 -- 172.21.15.192:0/3970761005 learned_addr learned my addr 172.21.15.192:0/3970761005 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.879+0000 7f9b162f9640 1 -- 172.21.15.192:0/3970761005 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519ff3db30 con 0x56519ff3d0d0 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.879+0000 7f9b162f9640 1 --2- 172.21.15.192:0/3970761005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff3d0d0 0x56519ff3d4f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9b08065b40 tx=0x7f9b08095f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.880+0000 7f99fbfff640 1 -- 172.21.15.192:0/3970761005 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b08094070 con 0x56519ff3d0d0 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.880+0000 7f99fbfff640 1 -- 172.21.15.192:0/3970761005 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0807a520 con 0x56519ff3d0d0 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.880+0000 7f99fbfff640 1 -- 172.21.15.192:0/3970761005 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0807a800 con 0x56519ff3d0d0 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.880+0000 7f9b1880f800 1 -- 172.21.15.192:0/3970761005 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56519ff3e360 con 0x56519ff3d0d0 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.880+0000 7f9b1880f800 1 -- 172.21.15.192:0/3970761005 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519ff3e360 con 0x56519ff3d0d0 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.880+0000 7f99fbfff640 1 -- 172.21.15.192:0/3970761005 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9b0804f070 con 0x56519ff3d0d0 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.881+0000 7f99fbfff640 1 --2- 172.21.15.192:0/3970761005 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99f003c730 0x7f99f003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.881+0000 7f99fbfff640 1 -- 172.21.15.192:0/3970761005 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9b0808c070 con 0x56519ff3d0d0 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.881+0000 7f9b0ffff640 1 --2- 172.21.15.192:0/3970761005 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99f003c730 0x7f99f003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.881+0000 7f9b1880f800 1 Processor -- start 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.881+0000 7f9b1880f800 1 -- start start 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.881+0000 7f9b0ffff640 1 --2- 172.21.15.192:0/3970761005 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99f003c730 0x7f99f003ebf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x56519ff21060 tx=0x7f9b00006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.881+0000 7f9b1880f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 0x56519ff49b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.881+0000 7f9b1880f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56519fe246d0 con 0x56519ff49780 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.881+0000 7f9b162f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 0x56519ff49b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.881+0000 7f9b162f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 0x56519ff49b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42806/0 (socket says 172.21.15.192:42806) 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.881+0000 7f9b162f9640 1 -- 172.21.15.192:0/972410206 learned_addr learned my addr 172.21.15.192:0/972410206 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.882+0000 7f9b162f9640 1 -- 172.21.15.192:0/972410206 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519ff4a150 con 0x56519ff49780 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.882+0000 7f9b162f9640 1 --2- 172.21.15.192:0/972410206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 0x56519ff49b60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9b08071ff0 tx=0x7f9b0808e550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3752f4c7713d9437 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.882+0000 7f99f9ffb640 1 -- 172.21.15.192:0/972410206 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b08052070 con 0x56519ff49780 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.882+0000 7f99f9ffb640 1 -- 172.21.15.192:0/972410206 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b08085670 con 0x56519ff49780 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.882+0000 7f99f9ffb640 1 -- 172.21.15.192:0/972410206 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b08095260 con 0x56519ff49780 2024-09-10T05:12:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.882+0000 7f9b1880f800 1 -- 172.21.15.192:0/972410206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 msgr2=0x56519ff49b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.882+0000 7f9b1880f800 1 --2- 172.21.15.192:0/972410206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 0x56519ff49b60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9b08071ff0 tx=0x7f9b0808e550 comp rx=0 tx=0).stop 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.882+0000 7f9b1880f800 1 -- 172.21.15.192:0/972410206 shutdown_connections 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.882+0000 7f9b1880f800 1 --2- 172.21.15.192:0/972410206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 0x56519ff49b60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.882+0000 7f9b1880f800 1 -- 172.21.15.192:0/972410206 >> 172.21.15.192:0/972410206 conn(0x56519ff45b80 msgr2=0x56519ff43dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.882+0000 7f9b1880f800 1 -- 172.21.15.192:0/972410206 shutdown_connections 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.882+0000 7f9b1880f800 1 -- 172.21.15.192:0/972410206 wait complete. 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.883+0000 7f9b1880f800 1 Processor -- start 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.883+0000 7f9b1880f800 1 -- start start 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.883+0000 7f9b1880f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 0x56519ff50c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.883+0000 7f9b1880f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56519ff4a5e0 con 0x56519ff49780 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.883+0000 7f9b162f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 0x56519ff50c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.883+0000 7f9b162f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 0x56519ff50c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42820/0 (socket says 172.21.15.192:42820) 2024-09-10T05:12:51.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.883+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 learned_addr learned my addr 172.21.15.192:0/2694583705 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:51.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.883+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519ff511c0 con 0x56519ff49780 2024-09-10T05:12:51.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.883+0000 7f9b162f9640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 0x56519ff50c60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9b08052f60 tx=0x7f9b08052ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.884+0000 7f99e7fff640 1 -- 172.21.15.192:0/2694583705 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b08071e10 con 0x56519ff49780 2024-09-10T05:12:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.884+0000 7f99e7fff640 1 -- 172.21.15.192:0/2694583705 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b080af040 con 0x56519ff49780 2024-09-10T05:12:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.884+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56519ff511c0 con 0x56519ff49780 2024-09-10T05:12:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.884+0000 7f99e7fff640 1 -- 172.21.15.192:0/2694583705 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b08085820 con 0x56519ff49780 2024-09-10T05:12:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.884+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519ff511c0 con 0x56519ff49780 2024-09-10T05:12:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.884+0000 7f99e7fff640 1 -- 172.21.15.192:0/2694583705 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9b080717b0 con 0x56519ff49780 2024-09-10T05:12:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.885+0000 7f99e7fff640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99e003c6e0 0x7f99e003eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.885+0000 7f99e7fff640 1 -- 172.21.15.192:0/2694583705 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9b080aad40 con 0x56519ff49780 2024-09-10T05:12:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.885+0000 7f9b0ffff640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99e003c6e0 0x7f99e003eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.885+0000 7f9b0ffff640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99e003c6e0 0x7f99e003eba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000ffd0 tx=0x7f9b00023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.885+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.885+0000 7f9b1880f800 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56519ff5c150 0x56519ff5e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.885+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5ed60 con 0x56519ff5c150 2024-09-10T05:12:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.885+0000 7f9b16afa640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56519ff5c150 0x56519ff5e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b16afa640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56519ff5c150 0x56519ff5e610 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b1880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b1880f800 20 realm 2024-09-10T05:12:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5f170 con 0x56519ff5c150 2024-09-10T05:12:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b1880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b1880f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fa40 con 0x56519ff5c150 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b1880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.886+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff5c150 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.887+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.887+0000 7f9b1880f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.887+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.887+0000 7f9b1880f800 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56519ff60b40 0x56519ff62f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.887+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff634f0 con 0x56519ff60b40 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.887+0000 7f9b162f9640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56519ff60b40 0x56519ff62f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.887+0000 7f9b162f9640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56519ff60b40 0x56519ff62f30 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.888+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.888+0000 7f9b1880f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.888+0000 7f9b1880f800 20 searching for the correct realm 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.888+0000 7f9b1880f800 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56519ff654a0 0x56519ff67960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.888+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff68030 con 0x56519ff654a0 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.888+0000 7f9b0ffff640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56519ff654a0 0x56519ff67960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.888+0000 7f9b0ffff640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56519ff654a0 0x56519ff67960 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.888+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.888+0000 7f9b0ffff640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f9b0002e910 0x7f9b0003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.888+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff68030 con 0x7f9b0002e910 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.888+0000 7f9b16afa640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f9b0002e910 0x7f9b0003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.889+0000 7f9b16afa640 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f9b0002e910 0x7f9b0003a3c0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.889+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.889+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff60b40 2024-09-10T05:12:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.889+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.889+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff5c150 2024-09-10T05:12:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.889+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.889+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff5c150 2024-09-10T05:12:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.890+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.890+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff60b40 2024-09-10T05:12:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.890+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.890+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff60b40 2024-09-10T05:12:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.890+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.890+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x7f9b0002e910 2024-09-10T05:12:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.890+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.890+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff654a0 2024-09-10T05:12:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.891+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.891+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff5c150 2024-09-10T05:12:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.891+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.891+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff60b40 2024-09-10T05:12:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.891+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.891+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff5c150 2024-09-10T05:12:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.891+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.891+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x7f9b0002e910 2024-09-10T05:12:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.892+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.892+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff654a0 2024-09-10T05:12:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.892+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.892+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff654a0 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.892+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.892+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff60b40 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.892+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.892+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff654a0 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.893+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.893+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff654a0 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.893+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.893+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff5c150 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.893+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.893+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff5c150 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.893+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.893+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x7f9b0002e910 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.894+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.894+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff654a0 2024-09-10T05:12:51.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.894+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.894+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x7f9b0002e910 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.894+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.894+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff5c150 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.894+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.894+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff60b40 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.895+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.895+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff654a0 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.895+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.895+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff60b40 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.895+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.895+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x7f9b0002e910 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.895+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.895+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff654a0 2024-09-10T05:12:51.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x7f9b0002e910 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x56519ff5c150 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56519ff5fde0 con 0x7f9b0002e910 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b1880f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b1880f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b1880f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b1880f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b1880f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b1880f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:51.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff63db0 con 0x56519ff5c150 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b1880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.896+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff63db0 con 0x56519ff5c150 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff63db0 con 0x7f9b0002e910 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 20 zone default found 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 4 Realm: () 2024-09-10T05:12:51.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 20 zonegroup default 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff64650 con 0x56519ff60b40 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.897+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff69ea0 con 0x56519ff654a0 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.898+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.898+0000 7f9b1880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.898+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.898+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6a240 con 0x56519ff654a0 2024-09-10T05:12:51.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.898+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.898+0000 7f9b1880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.898+0000 7f9b1880f800 20 started sync module instance, tier type = 2024-09-10T05:12:51.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.898+0000 7f9b1880f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:51.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.898+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff69340 con 0x7f9b0002e910 2024-09-10T05:12:51.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.899+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.899+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94908576077888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff69340 con 0x7f9b0002e910 2024-09-10T05:12:51.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.899+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6ac00 con 0x56519ff5c150 2024-09-10T05:12:51.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.900+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94908576077888] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.900+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.900+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94908576082224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff69340 con 0x56519ff5c150 2024-09-10T05:12:51.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.900+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6b6a0 con 0x56519ff654a0 2024-09-10T05:12:51.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.901+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.901+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94908576084368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6bf40 con 0x56519ff654a0 2024-09-10T05:12:51.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.901+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6ca00 con 0x7f9b0002e910 2024-09-10T05:12:51.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.902+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94908576082224] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.902+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94908576084368] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.902+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.902+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94908576086672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff68e90 con 0x7f9b0002e910 2024-09-10T05:12:51.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.902+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6d2e0 con 0x56519ff5c150 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.903+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94908576086672] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.904+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.904+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94908576089296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6d220 con 0x56519ff5c150 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.904+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6dcf0 con 0x56519ff60b40 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.905+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94908576089296] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.905+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.905+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94908576091504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6d190 con 0x56519ff60b40 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.905+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6ea60 con 0x56519ff60b40 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.906+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94908576091504] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.906+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.906+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94908576096400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6f2b0 con 0x56519ff60b40 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.906+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6fc70 con 0x56519ff60b40 2024-09-10T05:12:51.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.907+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94908576096400] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.907+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.907+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94908576100320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff6fc70 con 0x56519ff60b40 2024-09-10T05:12:51.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.907+0000 7f9b1880f800 20 add_watcher() i=0 2024-09-10T05:12:51.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.907+0000 7f9b1880f800 20 add_watcher() i=1 2024-09-10T05:12:51.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.907+0000 7f9b1880f800 20 add_watcher() i=2 2024-09-10T05:12:51.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.907+0000 7f9b1880f800 20 add_watcher() i=3 2024-09-10T05:12:51.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.907+0000 7f9b1880f800 20 add_watcher() i=4 2024-09-10T05:12:51.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.907+0000 7f9b1880f800 20 add_watcher() i=5 2024-09-10T05:12:51.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.907+0000 7f9b1880f800 20 add_watcher() i=6 2024-09-10T05:12:51.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.908+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94908576100320] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.908+0000 7f9b1880f800 20 add_watcher() i=7 2024-09-10T05:12:51.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.908+0000 7f9b1880f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:51.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.908+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ff72fa0 con 0x56519ff5c150 2024-09-10T05:12:51.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.908+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.908+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94908576102704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff70200 con 0x56519ff5c150 2024-09-10T05:12:51.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.910+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94908576102704] v37'226 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.910+0000 7f99ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:51.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.910+0000 7f9b1880f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:51.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.910+0000 7f9b1880f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:51.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.910+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7b880 con 0x56519ff5c150 2024-09-10T05:12:51.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.911+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.911+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7bed0 con 0x56519ff60b40 2024-09-10T05:12:51.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.912+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.912+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7beb0 con 0x56519ff654a0 2024-09-10T05:12:51.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.913+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.913+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7c9b0 con 0x56519ff5c150 2024-09-10T05:12:51.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.914+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'227 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.914+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff796b0 con 0x7f9b0002e910 2024-09-10T05:12:51.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.915+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'74 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.915+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff796b0 con 0x56519ff654a0 2024-09-10T05:12:51.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.916+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'57 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.916+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7db90 con 0x56519ff5c150 2024-09-10T05:12:51.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.917+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.917+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7db90 con 0x56519ff60b40 2024-09-10T05:12:51.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.918+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.918+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7db90 con 0x7f9b0002e910 2024-09-10T05:12:51.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.919+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.919+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7db90 con 0x56519ff654a0 2024-09-10T05:12:51.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.920+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.920+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e200 con 0x7f9b0002e910 2024-09-10T05:12:51.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.921+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'75 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.921+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e1c0 con 0x56519ff60b40 2024-09-10T05:12:51.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.922+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.922+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e190 con 0x7f9b0002e910 2024-09-10T05:12:51.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.923+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.923+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e190 con 0x56519ff60b40 2024-09-10T05:12:51.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.925+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'63 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.925+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e1d0 con 0x56519ff5c150 2024-09-10T05:12:51.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.925+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'228 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.925+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e260 con 0x56519ff654a0 2024-09-10T05:12:51.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.927+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'71 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.927+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e8e0 con 0x7f9b0002e910 2024-09-10T05:12:51.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.928+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'76 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.928+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff654a0 2024-09-10T05:12:51.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.929+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.929+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff5c150 2024-09-10T05:12:51.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.930+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.930+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff5c150 2024-09-10T05:12:51.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.931+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'229 uv174 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.931+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff654a0 2024-09-10T05:12:51.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.932+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'72 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.932+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x7f9b0002e910 2024-09-10T05:12:51.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.933+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.933+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff654a0 2024-09-10T05:12:51.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.934+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.934+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff654a0 2024-09-10T05:12:51.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.935+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'44 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.935+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff654a0 2024-09-10T05:12:51.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.935+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.935+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff654a0 2024-09-10T05:12:51.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.936+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'58 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.936+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff60b40 2024-09-10T05:12:51.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.938+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.938+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff654a0 2024-09-10T05:12:51.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.939+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.939+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff60b40 2024-09-10T05:12:51.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.940+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.940+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff654a0 2024-09-10T05:12:51.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.941+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'73 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.941+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x56519ff60b40 2024-09-10T05:12:51.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.942+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'64 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.942+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff7e710 con 0x7f9b0002e910 2024-09-10T05:12:51.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.943+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.943+0000 7f99477fe640 20 reqs_thread_entry: start 2024-09-10T05:12:51.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.943+0000 7f9b1880f800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:51.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.943+0000 7f9b1880f800 20 Filter name: none 2024-09-10T05:12:51.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f99457fa640 20 reqs_thread_entry: start 2024-09-10T05:12:51.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b1880f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-10T05:12:51.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffa9610 con 0x7f9b0002e910 2024-09-10T05:12:51.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b1880f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:12:51.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b1880f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-10T05:12:51.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b1880f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-10T05:12:51.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b1880f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:51.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffabb10 con 0x56519ff5c150 2024-09-10T05:12:51.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b1880f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 : miss 2024-09-10T05:12:51.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.944+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:96 8.16 8:6f119919:root::.bucket.meta.myfoo6%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffabf20 con 0x56519ff654a0 2024-09-10T05:12:51.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.945+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(96 .bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.945+0000 7f9b1880f800 20 rados_obj.operate() r=0 bl.length=388 2024-09-10T05:12:51.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.945+0000 7f9b1880f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 info.flags=0x17 2024-09-10T05:12:51.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.945+0000 7f9b1880f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 to cache LRU end 2024-09-10T05:12:51.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.945+0000 7f9b1880f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:51.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.945+0000 7f9b1880f800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-10T05:12:51.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.945+0000 7f9b1880f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 2024-09-10T05:12:51.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.945+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:97 4.22 4:45474770:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a0029120 con 0x56519ff5c150 2024-09-10T05:12:51.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.945+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(97 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.945+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:98 4.3e 4:7fffe048:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a0029120 con 0x7f9b0002e910 2024-09-10T05:12:51.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.945+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(98 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.946+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:99 4.34 4:2e60e3b1:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a0029160 con 0x7f9b0002e910 2024-09-10T05:12:51.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.946+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(99 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.946+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:100 4.c 4:3051bcaa:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a0029160 con 0x56519ff5c150 2024-09-10T05:12:51.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.946+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(100 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.3 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.946+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:101 4.3b 4:dfd9e8de:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a0029160 con 0x56519ff654a0 2024-09-10T05:12:51.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.946+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(101 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.4 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.946+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:102 4.37 4:eee95a93:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a0029700 con 0x56519ff60b40 2024-09-10T05:12:51.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.947+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(102 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.947+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:103 4.32 4:4d3b415a:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a0029700 con 0x56519ff5c150 2024-09-10T05:12:51.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.947+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(103 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.6 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.947+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:104 4.3 4:c0f5b21c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a0029700 con 0x56519ff5c150 2024-09-10T05:12:51.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.948+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(104 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.948+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:105 4.39 4:9c18df45:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a0029700 con 0x56519ff654a0 2024-09-10T05:12:51.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.948+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 28 ==== osd_op_reply(105 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.948+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:106 4.7 4:e06fa05c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a0029700 con 0x56519ff60b40 2024-09-10T05:12:51.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(106 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9 [call out=349b] v0'0 uv7 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b1880f800 10 cls_bucket_list_unordered: got thirteen 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:107 4.e 4:727021bc:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a00296b0 con 0x7f9b0002e910 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 24 ==== osd_op_reply(107 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.10 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b1880f800 20 get_obj_state: octx=0x7f9b1000ab20 obj=myfoo6:thirteen state=0x5651a0027498 s->prefetch_data=0 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:108 3.34s0 3:2e8a457d:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a00284a0 con 0x56519ff5c150 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(108 92aa256a-2802-419e-96e0-ba675846cbc3.4238.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b1880f800 10 manifest: total_size = 8 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b1880f800 20 get_obj_state: setting s->obj_tag to _cP7KyZzj_HLfcmw1YXsAlti0nbMfDfu 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b1880f800 20 get_obj_state: octx=0x7f9b1000ab20 obj=myfoo6:thirteen state=0x5651a0027498 s->prefetch_data=0 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b1880f800 20 prepare_atomic_modification: state is not atomic. state=0x5651a0027498 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b1880f800 20 bucket index object: :.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.949+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:109 4.7 4:e06fa05c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5651a00284a0 con 0x56519ff60b40 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.950+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(109 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9 [stat,call,call] v37'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.951+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:110 3.34s0 3:2e8a457d:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5651a00284a0 con 0x56519ff5c150 2024-09-10T05:12:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(110 92aa256a-2802-419e-96e0-ba675846cbc3.4238.9_thirteen [call] v37'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:111 4.7 4:e06fa05c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffb09d0 con 0x56519ff60b40 2024-09-10T05:12:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b1880f800 20 list_objects_ordered: starting attempt 1 2024-09-10T05:12:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b1880f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T05:12:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:112 4.22 4:45474770:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffb09d0 con 0x56519ff5c150 2024-09-10T05:12:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:113 4.3e 4:7fffe048:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651a0028570 con 0x7f9b0002e910 2024-09-10T05:12:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:114 4.34 4:2e60e3b1:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffb09d0 con 0x7f9b0002e910 2024-09-10T05:12:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:115 4.c 4:3051bcaa:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffb9bb0 con 0x56519ff5c150 2024-09-10T05:12:51.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:116 4.3b 4:dfd9e8de:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc520 con 0x56519ff654a0 2024-09-10T05:12:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:117 4.37 4:eee95a93:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbeec0 con 0x56519ff60b40 2024-09-10T05:12:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 34 ==== osd_op_reply(112 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 25 ==== osd_op_reply(114 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.952+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 29 ==== osd_op_reply(116 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.4 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:118 4.32 4:4d3b415a:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc520 con 0x56519ff5c150 2024-09-10T05:12:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:119 4.3 4:c0f5b21c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffb9d20 con 0x56519ff5c150 2024-09-10T05:12:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:120 4.39 4:9c18df45:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbf8e0 con 0x56519ff654a0 2024-09-10T05:12:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:121 4.7 4:e06fa05c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffc23e0 con 0x56519ff60b40 2024-09-10T05:12:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:122 4.e 4:727021bc:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffc5110 con 0x7f9b0002e910 2024-09-10T05:12:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(117 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 35 ==== osd_op_reply(115 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.3 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 26 ==== osd_op_reply(113 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 36 ==== osd_op_reply(118 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.6 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 30 ==== osd_op_reply(120 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 37 ==== osd_op_reply(119 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(111 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9 [stat,call,call] v37'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f99f9ffb640 20 handle_completion(): completion ok for obj=thirteen 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 27 ==== osd_op_reply(122 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.10 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(121 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b1880f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b1880f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b1880f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b1880f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.953+0000 7f9b1880f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[92aa256a-2802-419e-96e0-ba675846cbc3.4238.9])"; uploads.size()=0; is_truncated=0 2024-09-10T05:12:51.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:123 4.22 4:45474770:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffc5110 con 0x56519ff5c150 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:124 4.3e 4:7fffe048:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc520 con 0x7f9b0002e910 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:125 4.34 4:2e60e3b1:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffb9560 con 0x7f9b0002e910 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:126 4.c 4:3051bcaa:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffc5110 con 0x56519ff5c150 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:127 4.3b 4:dfd9e8de:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc520 con 0x56519ff654a0 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:128 4.37 4:eee95a93:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffc5110 con 0x56519ff60b40 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:129 4.32 4:4d3b415a:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc520 con 0x56519ff5c150 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 38 ==== osd_op_reply(123 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(128 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 28 ==== osd_op_reply(124 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 31 ==== osd_op_reply(127 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.4 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 29 ==== osd_op_reply(125 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:130 4.3 4:c0f5b21c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffc5110 con 0x56519ff5c150 2024-09-10T05:12:51.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:131 4.39 4:9c18df45:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc4e0 con 0x56519ff654a0 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:132 4.7 4:e06fa05c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffc5110 con 0x56519ff60b40 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 39 ==== osd_op_reply(126 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.3 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:133 4.e 4:727021bc:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffc5110 con 0x7f9b0002e910 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 40 ==== osd_op_reply(129 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.6 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 32 ==== osd_op_reply(131 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 30 ==== osd_op_reply(132 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 41 ==== osd_op_reply(130 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.954+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 30 ==== osd_op_reply(133 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.10 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.955+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffc5110 con 0x56519ff5c150 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.955+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 42 ==== osd_op_reply(134 bud.buckets [call] v37'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.956+0000 7f9b1880f800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.956+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.956+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc4e0 con 0x56519ff5c150 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.956+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 43 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.956+0000 7f9b1880f800 20 rados_obj.operate() r=0 bl.length=166 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.956+0000 7f9b1880f800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.956+0000 7f9b1880f800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.956+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc4e0 con 0x56519ff5c150 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.957+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 44 ==== osd_op_reply(136 myfoo6 [call,call,delete] v37'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x56519ff5c150 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.957+0000 7f9b1880f800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.957+0000 7f9b1880f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.957+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94908576404832 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc4e0 con 0x7f9b0002e910 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.957+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 31 ==== watch-notify(notify (1) cookie 94908576086672 notify 158913789985 ret 0) ==== 192+0+0 (crc 0 0 0) 0x56519ff793d0 con 0x7f9b0002e910 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.957+0000 7f99f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789985 cookie 94908576086672 notifier 4763 bl.length()=150 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.957+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 32 ==== osd_op_reply(137 notify.3 [notify cookie 94908576404832 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.957+0000 7f99f9ffb640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f99dc003d60 con 0x7f9b0002e910 2024-09-10T05:12:51.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.957+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 33 ==== watch-notify(notify_complete (2) cookie 94908576404832 notify 158913789985 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56519ff79a50 con 0x7f9b0002e910 2024-09-10T05:12:51.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.957+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 34 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1000a4d0 con 0x7f9b0002e910 2024-09-10T05:12:51.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.958+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:139 8.16 8:6f119919:root::.bucket.meta.myfoo6%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc4e0 con 0x56519ff654a0 2024-09-10T05:12:51.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.959+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 33 ==== osd_op_reply(139 .bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 [call,call,delete] v37'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.959+0000 7f9b1880f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 from cache 2024-09-10T05:12:51.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.959+0000 7f9b1880f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:92aa256a-2802-419e-96e0-ba675846cbc3.4238.9, ofs0, ns] 2024-09-10T05:12:51.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.959+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94908576404832 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc4e0 con 0x56519ff60b40 2024-09-10T05:12:51.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.959+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 31 ==== watch-notify(notify (1) cookie 94908576096400 notify 158913789982 ret 0) ==== 249+0+0 (crc 0 0 0) 0x56519ff7d6e0 con 0x56519ff60b40 2024-09-10T05:12:51.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.959+0000 7f99f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789982 cookie 94908576096400 notifier 4763 bl.length()=207 2024-09-10T05:12:51.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.959+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 32 ==== osd_op_reply(140 notify.6 [notify cookie 94908576404832 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.959+0000 7f99f97fa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f994c003320 con 0x56519ff60b40 2024-09-10T05:12:51.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.959+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 33 ==== watch-notify(notify_complete (2) cookie 94908576404832 notify 158913789982 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9b080d7040 con 0x56519ff60b40 2024-09-10T05:12:51.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.959+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 34 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.960+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:142 4.22 4:45474770:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc4e0 con 0x56519ff5c150 2024-09-10T05:12:51.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.960+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:143 4.3e 4:7fffe048:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffb9c10 con 0x7f9b0002e910 2024-09-10T05:12:51.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.960+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:144 4.34 4:2e60e3b1:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5651a0027250 con 0x7f9b0002e910 2024-09-10T05:12:51.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.960+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:145 4.c 4:3051bcaa:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffaa5e0 con 0x56519ff5c150 2024-09-10T05:12:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.960+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:146 4.3b 4:dfd9e8de:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffaaeb0 con 0x56519ff654a0 2024-09-10T05:12:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.960+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:147 4.37 4:eee95a93:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffba6a0 con 0x56519ff60b40 2024-09-10T05:12:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.960+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:148 4.32 4:4d3b415a:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc4e0 con 0x56519ff5c150 2024-09-10T05:12:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.960+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:149 4.3 4:c0f5b21c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbb430 con 0x56519ff5c150 2024-09-10T05:12:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.960+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:150 4.39 4:9c18df45:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffaaeb0 con 0x56519ff654a0 2024-09-10T05:12:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.960+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:151 4.7 4:e06fa05c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffaa5e0 con 0x56519ff60b40 2024-09-10T05:12:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.960+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:152 4.e 4:727021bc:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffba6a0 con 0x7f9b0002e910 2024-09-10T05:12:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.961+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 34 ==== osd_op_reply(146 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.4 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.961+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 45 ==== osd_op_reply(142 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.0 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x56519ff5c150 2024-09-10T05:12:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.962+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 46 ==== osd_op_reply(145 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.3 [delete] v37'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x56519ff5c150 2024-09-10T05:12:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.962+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 35 ==== osd_op_reply(150 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.8 [delete] v37'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.962+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 47 ==== osd_op_reply(148 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.6 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x56519ff5c150 2024-09-10T05:12:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.962+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 48 ==== osd_op_reply(149 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.7 [delete] v37'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x56519ff5c150 2024-09-10T05:12:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.962+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 35 ==== osd_op_reply(144 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.2 [delete] v37'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x7f9b0002e910 2024-09-10T05:12:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.962+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 36 ==== osd_op_reply(143 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.1 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x7f9b0002e910 2024-09-10T05:12:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.962+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 35 ==== osd_op_reply(147 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.5 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.962+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 36 ==== osd_op_reply(151 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.9 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.962+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 37 ==== osd_op_reply(152 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.9.10 [delete] v37'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x7f9b0002e910 2024-09-10T05:12:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.962+0000 7f9b1880f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 : miss 2024-09-10T05:12:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.962+0000 7f9b1880f800 20 rados->read ofs=0 len=0 2024-09-10T05:12:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.962+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:153 6.d 6:b6256b4c:::pubsub..bucket.myfoo6%2f92aa256a-2802-419e-96e0-ba675846cbc3.4238.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffb9c10 con 0x56519ff5c150 2024-09-10T05:12:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.963+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 49 ==== osd_op_reply(153 pubsub..bucket.myfoo6/92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x56519ff5c150 2024-09-10T05:12:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.963+0000 7f9b1880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:51.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.963+0000 7f9b1880f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 info.flags=0x0 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.963+0000 7f9b1880f800 10 adding default.rgw.log++pubsub..bucket.myfoo6/92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 to cache LRU end 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.963+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:154 6.d 6:b6256b4c:::pubsub..bucket.myfoo6%2f92aa256a-2802-419e-96e0-ba675846cbc3.4238.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffaaeb0 con 0x56519ff5c150 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.964+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 50 ==== osd_op_reply(154 pubsub..bucket.myfoo6/92aa256a-2802-419e-96e0-ba675846cbc3.4238.9 [delete] v37'35 uv29 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x56519ff5c150 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.964+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbb430 con 0x56519ff5c150 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.965+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 51 ==== osd_op_reply(155 bud.buckets [call] v37'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x56519ff5c150 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.965+0000 7f9b1880f800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.965+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc4e0 con 0x56519ff5c150 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.966+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 52 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v37'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x56519ff5c150 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.966+0000 7f9b1880f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.966+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94908576406544 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc480 con 0x56519ff60b40 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.966+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 37 ==== watch-notify(notify (1) cookie 94908576091504 notify 158913789983 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7f9b080d7040 con 0x56519ff60b40 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.966+0000 7f99f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789983 cookie 94908576091504 notifier 4763 bl.length()=170 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.966+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 38 ==== osd_op_reply(157 notify.5 [notify cookie 94908576406544 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.966+0000 7f99f9ffb640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f99dc003d60 con 0x56519ff60b40 2024-09-10T05:12:51.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.966+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 39 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.966+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 40 ==== watch-notify(notify_complete (2) cookie 94908576406544 notify 158913789983 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56519ff20150 con 0x56519ff60b40 2024-09-10T05:12:51.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.966+0000 7f9b1880f800 10 removing email index: 2024-09-10T05:12:51.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.966+0000 7f9b1880f800 10 removing user buckets index 2024-09-10T05:12:51.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.966+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc480 con 0x56519ff5c150 2024-09-10T05:12:51.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.967+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 53 ==== osd_op_reply(159 bud.buckets [delete] v37'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x56519ff5c150 2024-09-10T05:12:51.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.967+0000 7f9b1880f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-10T05:12:51.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.967+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94908576416896 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffb9c10 con 0x56519ff60b40 2024-09-10T05:12:51.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.968+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 41 ==== watch-notify(notify (1) cookie 94908576096400 notify 158913789984 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56519ff20150 con 0x56519ff60b40 2024-09-10T05:12:51.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.968+0000 7f99f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789984 cookie 94908576096400 notifier 4763 bl.length()=160 2024-09-10T05:12:51.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.968+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 42 ==== osd_op_reply(160 notify.6 [notify cookie 94908576416896 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.968+0000 7f99f97fa640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f994c0032c0 con 0x56519ff60b40 2024-09-10T05:12:51.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.968+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 43 ==== watch-notify(notify_complete (2) cookie 94908576416896 notify 158913789984 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56519ff1f750 con 0x56519ff60b40 2024-09-10T05:12:51.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.968+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 44 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.968+0000 7f9b1880f800 10 removing user index: bud 2024-09-10T05:12:51.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.968+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ffbc480 con 0x7f9b0002e910 2024-09-10T05:12:51.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.969+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 38 ==== osd_op_reply(162 bud [call,call,delete] v37'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x7f9b0002e910 2024-09-10T05:12:51.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.969+0000 7f9b1880f800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-10T05:12:51.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.969+0000 7f9b1880f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-10T05:12:51.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.969+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94908576416896 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519ffb9c10 con 0x56519ff60b40 2024-09-10T05:12:51.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.969+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 45 ==== watch-notify(notify (1) cookie 94908576091504 notify 158913789985 ret 0) ==== 194+0+0 (crc 0 0 0) 0x56519ff1f750 con 0x56519ff60b40 2024-09-10T05:12:51.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.969+0000 7f99f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789985 cookie 94908576091504 notifier 4763 bl.length()=152 2024-09-10T05:12:51.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.969+0000 7f99f9ffb640 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f99dc003d60 con 0x56519ff60b40 2024-09-10T05:12:51.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.969+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 46 ==== osd_op_reply(163 notify.5 [notify cookie 94908576416896 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.970+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 47 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.970+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 48 ==== watch-notify(notify_complete (2) cookie 94908576416896 notify 158913789985 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56519ff1f4c0 con 0x56519ff60b40 2024-09-10T05:12:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.971+0000 7f99ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:51.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.971+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94908576102704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff78300 con 0x56519ff5c150 2024-09-10T05:12:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.972+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 54 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94908576102704] v37'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x56519ff5c150 2024-09-10T05:12:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.972+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94908576077888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff78300 con 0x7f9b0002e910 2024-09-10T05:12:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.973+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 39 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94908576077888] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x7f9b0002e910 2024-09-10T05:12:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.973+0000 7f9b1880f800 20 remove_watcher() i=0 2024-09-10T05:12:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.973+0000 7f9b1880f800 2 removed watcher, disabling cache 2024-09-10T05:12:51.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.973+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94908576082224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff78300 con 0x56519ff5c150 2024-09-10T05:12:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.974+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 55 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94908576082224] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x56519ff5c150 2024-09-10T05:12:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.974+0000 7f9b1880f800 20 remove_watcher() i=1 2024-09-10T05:12:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.974+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94908576084368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff78300 con 0x56519ff654a0 2024-09-10T05:12:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.975+0000 7f9b0ffff640 1 -- 172.21.15.192:0/2694583705 <== osd.3 v2:172.21.15.192:6816/1620624472 36 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94908576084368] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b00037040 con 0x56519ff654a0 2024-09-10T05:12:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.975+0000 7f9b1880f800 20 remove_watcher() i=2 2024-09-10T05:12:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.975+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94908576086672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff78300 con 0x7f9b0002e910 2024-09-10T05:12:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.976+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.2 v2:172.21.15.192:6801/2435677948 40 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94908576086672] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x7f9b0002e910 2024-09-10T05:12:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.976+0000 7f9b1880f800 20 remove_watcher() i=3 2024-09-10T05:12:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.976+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94908576089296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff78300 con 0x56519ff5c150 2024-09-10T05:12:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.977+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 <== osd.1 v2:172.21.15.192:6800/3487349558 56 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94908576089296] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10068040 con 0x56519ff5c150 2024-09-10T05:12:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.977+0000 7f9b1880f800 20 remove_watcher() i=4 2024-09-10T05:12:51.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.977+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94908576091504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff78300 con 0x56519ff60b40 2024-09-10T05:12:51.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.978+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 49 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94908576091504] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.978+0000 7f9b1880f800 20 remove_watcher() i=5 2024-09-10T05:12:51.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.978+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94908576096400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff78300 con 0x56519ff60b40 2024-09-10T05:12:51.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.979+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 50 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94908576096400] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.979+0000 7f9b1880f800 20 remove_watcher() i=6 2024-09-10T05:12:51.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.979+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94908576100320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56519ff78300 con 0x56519ff60b40 2024-09-10T05:12:51.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b162f9640 1 -- 172.21.15.192:0/2694583705 <== osd.0 v2:172.21.15.139:6800/2915567440 51 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94908576100320] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b080bb020 con 0x56519ff60b40 2024-09-10T05:12:51.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 20 remove_watcher() i=7 2024-09-10T05:12:51.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56519ff60b40 msgr2=0x56519ff62f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56519ff60b40 0x56519ff62f30 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56519ff5c150 msgr2=0x56519ff5e610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56519ff5c150 0x56519ff5e610 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f9b0002e910 msgr2=0x7f9b0003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f9b0002e910 0x7f9b0003a3c0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56519ff654a0 msgr2=0x56519ff67960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56519ff654a0 0x56519ff67960 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99e003c6e0 msgr2=0x7f99e003eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99e003c6e0 0x7f99e003eba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000ffd0 tx=0x7f9b00023040 comp rx=0 tx=0).stop 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 msgr2=0x56519ff50c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b16afa640 1 -- 172.21.15.192:0/2694583705 reap_dead start 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 0x56519ff50c60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9b08052f60 tx=0x7f9b08052ef0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 shutdown_connections 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 --2- 172.21.15.192:0/2694583705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff49780 0x56519ff50c60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 >> 172.21.15.192:0/2694583705 conn(0x56519ff45b80 msgr2=0x56519ff43d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 shutdown_connections 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.980+0000 7f9b1880f800 1 -- 172.21.15.192:0/2694583705 wait complete. 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/3970761005 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99f003c730 msgr2=0x7f99f003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 --2- 172.21.15.192:0/3970761005 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99f003c730 0x7f99f003ebf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x56519ff21060 tx=0x7f9b00006000 comp rx=0 tx=0).stop 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/3970761005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff3d0d0 msgr2=0x56519ff3d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 --2- 172.21.15.192:0/3970761005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff3d0d0 0x56519ff3d4f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9b08065b40 tx=0x7f9b08095f60 comp rx=0 tx=0).stop 2024-09-10T05:12:51.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/3970761005 shutdown_connections 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 --2- 172.21.15.192:0/3970761005 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99f003c730 0x7f99f003ebf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 --2- 172.21.15.192:0/3970761005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519ff3d0d0 0x56519ff3d4f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/3970761005 >> 172.21.15.192:0/3970761005 conn(0x56519ff31480 msgr2=0x56519ff31860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/3970761005 shutdown_connections 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/3970761005 wait complete. 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56519ff28950 msgr2=0x56519ff2adf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56519ff28950 0x56519ff2adf0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56519fe29030 msgr2=0x56519ff265b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56519fe29030 0x56519ff265b0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56519ff2c9e0 msgr2=0x56519ff2edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x56519ff2c9e0 0x56519ff2edd0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99fc03c730 msgr2=0x7f99fc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f99fc03c730 0x7f99fc03ebf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9b00000c00 tx=0x7f9b000013b0 comp rx=0 tx=0).stop 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 msgr2=0x56519ff1ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:51.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 --2- 172.21.15.192:0/1947846226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56519fe266a0 0x56519ff1ef60 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9b08045be0 tx=0x7f9b08003020 comp rx=0 tx=0).stop 2024-09-10T05:12:51.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b16afa640 1 -- 172.21.15.192:0/1947846226 reap_dead start 2024-09-10T05:12:51.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 shutdown_connections 2024-09-10T05:12:51.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 >> 172.21.15.192:0/1947846226 conn(0x56519fe20200 msgr2=0x56519ff10910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:51.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 shutdown_connections 2024-09-10T05:12:51.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:51.981+0000 7f9b1880f800 1 -- 172.21.15.192:0/1947846226 wait complete. 2024-09-10T05:12:51.991 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-10T05:12:51.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-10T05:12:51.991 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-10T05:12:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:12:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:12:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.036+0000 7f5f47d3e800 1 Processor -- start 2024-09-10T05:12:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.036+0000 7f5f47d3e800 1 -- start start 2024-09-10T05:12:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.036+0000 7f5f47d3e800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c012e17720 0x55c012e19b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.036+0000 7f5f47d3e800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c012cc0e40 con 0x55c012e1a050 2024-09-10T05:12:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.036+0000 7f5f47d3e800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55c012c8b680 con 0x55c012e17720 2024-09-10T05:12:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.037+0000 7f5f43ac0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c012e17720 0x55c012e19b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.037+0000 7f5f43ac0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55c012e17720 0x55c012e19b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42826/0 (socket says 172.21.15.192:42826) 2024-09-10T05:12:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.037+0000 7f5f43ac0640 1 -- 172.21.15.192:0/678763758 learned_addr learned my addr 172.21.15.192:0/678763758 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:52.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.037+0000 7f5f432bf640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55c012e1a050 0x55c012e1c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:34290/0 (socket says 172.21.15.192:34290) 2024-09-10T05:12:52.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.037+0000 7f5f43ac0640 1 -- 172.21.15.192:0/678763758 >> v1:172.21.15.139:6789/0 conn(0x55c012e1a050 legacy=0x55c012e1c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.037+0000 7f5f42abe640 1 -- 172.21.15.192:0/678763758 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213095587 0 0) 0x55c012cc0e40 con 0x55c012e1a050 2024-09-10T05:12:52.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.037+0000 7f5f43ac0640 1 -- 172.21.15.192:0/678763758 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c012ca76b0 con 0x55c012e17720 2024-09-10T05:12:52.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.039+0000 7f5f43ac0640 1 --2- 172.21.15.192:0/678763758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e17720 0x55c012e19b10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400a520 tx=0x7f5f34045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e753902aa4a4f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.039+0000 7f5f42abe640 1 -- 172.21.15.192:0/678763758 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f34055070 con 0x55c012e17720 2024-09-10T05:12:52.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.039+0000 7f5f42abe640 1 -- 172.21.15.192:0/678763758 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f340515b0 con 0x55c012e17720 2024-09-10T05:12:52.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.039+0000 7f5f42abe640 1 -- 172.21.15.192:0/678763758 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f340518d0 con 0x55c012e17720 2024-09-10T05:12:52.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.039+0000 7f5f47d3e800 1 -- 172.21.15.192:0/678763758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e17720 msgr2=0x55c012e19b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.039+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/678763758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e17720 0x55c012e19b10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400a520 tx=0x7f5f34045ba0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.039+0000 7f5f47d3e800 1 -- 172.21.15.192:0/678763758 shutdown_connections 2024-09-10T05:12:52.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.039+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/678763758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e17720 0x55c012e19b10 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.039+0000 7f5f47d3e800 1 -- 172.21.15.192:0/678763758 >> 172.21.15.192:0/678763758 conn(0x55c012e11200 msgr2=0x55c012e13640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:52.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.039+0000 7f5f47d3e800 1 -- 172.21.15.192:0/678763758 shutdown_connections 2024-09-10T05:12:52.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.039+0000 7f5f47d3e800 1 -- 172.21.15.192:0/678763758 wait complete. 2024-09-10T05:12:52.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.053+0000 7f5f47d3e800 1 Processor -- start 2024-09-10T05:12:52.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.053+0000 7f5f47d3e800 1 -- start start 2024-09-10T05:12:52.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.053+0000 7f5f47d3e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e17720 0x55c012f06490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.053+0000 7f5f47d3e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c012cafdd0 con 0x55c012e17720 2024-09-10T05:12:52.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.054+0000 7f5f43ac0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e17720 0x55c012f06490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.054+0000 7f5f43ac0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e17720 0x55c012f06490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42830/0 (socket says 172.21.15.192:42830) 2024-09-10T05:12:52.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.054+0000 7f5f43ac0640 1 -- 172.21.15.192:0/601026891 learned_addr learned my addr 172.21.15.192:0/601026891 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.054+0000 7f5f43ac0640 1 -- 172.21.15.192:0/601026891 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c012cc8e10 con 0x55c012e17720 2024-09-10T05:12:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.054+0000 7f5f43ac0640 1 --2- 172.21.15.192:0/601026891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e17720 0x55c012f06490 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5f34025da0 tx=0x7f5f34051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d707537ee7db8cc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.054+0000 7f5e31e0b640 1 -- 172.21.15.192:0/601026891 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f34051950 con 0x55c012e17720 2024-09-10T05:12:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.054+0000 7f5e31e0b640 1 -- 172.21.15.192:0/601026891 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f34051af0 con 0x55c012e17720 2024-09-10T05:12:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.054+0000 7f5e31e0b640 1 -- 172.21.15.192:0/601026891 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f34051dd0 con 0x55c012e17720 2024-09-10T05:12:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.055+0000 7f5f47d3e800 1 -- 172.21.15.192:0/601026891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e17720 msgr2=0x55c012f06490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.055+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/601026891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e17720 0x55c012f06490 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5f34025da0 tx=0x7f5f34051000 comp rx=0 tx=0).stop 2024-09-10T05:12:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.055+0000 7f5f47d3e800 1 -- 172.21.15.192:0/601026891 shutdown_connections 2024-09-10T05:12:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.055+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/601026891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e17720 0x55c012f06490 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.055+0000 7f5f47d3e800 1 -- 172.21.15.192:0/601026891 >> 172.21.15.192:0/601026891 conn(0x55c012e11200 msgr2=0x55c012f01e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.055+0000 7f5f47d3e800 1 -- 172.21.15.192:0/601026891 shutdown_connections 2024-09-10T05:12:52.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.055+0000 7f5f47d3e800 1 -- 172.21.15.192:0/601026891 wait complete. 2024-09-10T05:12:52.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.055+0000 7f5f47d3e800 1 Processor -- start 2024-09-10T05:12:52.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.056+0000 7f5f47d3e800 1 -- start start 2024-09-10T05:12:52.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.056+0000 7f5f47d3e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e1a050 0x55c012e16e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.056+0000 7f5f47d3e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c012e1e050 con 0x55c012e1a050 2024-09-10T05:12:52.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.056+0000 7f5f43ac0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e1a050 0x55c012e16e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.056+0000 7f5f43ac0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e1a050 0x55c012e16e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42842/0 (socket says 172.21.15.192:42842) 2024-09-10T05:12:52.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.056+0000 7f5f43ac0640 1 -- 172.21.15.192:0/141478157 learned_addr learned my addr 172.21.15.192:0/141478157 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:52.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.056+0000 7f5f43ac0640 1 -- 172.21.15.192:0/141478157 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c012e173a0 con 0x55c012e1a050 2024-09-10T05:12:52.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.056+0000 7f5f43ac0640 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e1a050 0x55c012e16e40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5f34025da0 tx=0x7f5f34002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.056+0000 7f5e2bfff640 1 -- 172.21.15.192:0/141478157 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f34073070 con 0x55c012e1a050 2024-09-10T05:12:52.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.056+0000 7f5e2bfff640 1 -- 172.21.15.192:0/141478157 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3405a580 con 0x55c012e1a050 2024-09-10T05:12:52.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.056+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c012e15750 con 0x55c012e1a050 2024-09-10T05:12:52.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.056+0000 7f5e2bfff640 1 -- 172.21.15.192:0/141478157 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3405a880 con 0x55c012e1a050 2024-09-10T05:12:52.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.057+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c012e15d70 con 0x55c012e1a050 2024-09-10T05:12:52.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.057+0000 7f5e2bfff640 1 -- 172.21.15.192:0/141478157 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5f34076070 con 0x55c012e1a050 2024-09-10T05:12:52.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.057+0000 7f5e2bfff640 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e2c03c780 0x7f5e2c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.058+0000 7f5e2bfff640 1 -- 172.21.15.192:0/141478157 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5f3406b040 con 0x55c012e1a050 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.058+0000 7f5f432bf640 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e2c03c780 0x7f5e2c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.058+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c012f15380 0x55c012f17770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.058+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f17cb0 con 0x55c012f15380 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.058+0000 7f5f442c1640 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c012f15380 0x55c012f17770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.058+0000 7f5f432bf640 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e2c03c780 0x7f5e2c03ec40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5f38000c00 tx=0x7f5f380013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.058+0000 7f5f442c1640 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c012f15380 0x55c012f17770 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.058+0000 7f5f442c1640 1 -- 172.21.15.192:0/141478157 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f15380 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.058+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012e16250 con 0x55c012f15380 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.059+0000 7f5f442c1640 1 -- 172.21.15.192:0/141478157 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f15380 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.059+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c012f19fc0 0x55c012f1c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.059+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f1ca80 con 0x55c012f19fc0 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.059+0000 7f5f43ac0640 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c012f19fc0 0x55c012f1c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.059+0000 7f5f43ac0640 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c012f19fc0 0x55c012f1c3b0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.059+0000 7f5f43ac0640 1 -- 172.21.15.192:0/141478157 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f34075030 con 0x55c012f19fc0 2024-09-10T05:12:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.059+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f18e60 con 0x55c012f15380 2024-09-10T05:12:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.060+0000 7f5f442c1640 1 -- 172.21.15.192:0/141478157 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f15380 2024-09-10T05:12:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.060+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c012f1dec0 0x55c012f202b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.060+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f209f0 con 0x55c012f1dec0 2024-09-10T05:12:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.060+0000 7f5f432bf640 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c012f1dec0 0x55c012f202b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.060+0000 7f5f432bf640 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c012f1dec0 0x55c012f202b0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.060+0000 7f5f432bf640 1 -- 172.21.15.192:0/141478157 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f3800f670 con 0x55c012f1dec0 2024-09-10T05:12:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.061+0000 7f5f47d3e800 1 Processor -- start 2024-09-10T05:12:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.061+0000 7f5f47d3e800 1 -- start start 2024-09-10T05:12:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.061+0000 7f5f47d3e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f2e650 0x55c012f2ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.061+0000 7f5f47d3e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c012d0da00 con 0x55c012f2e650 2024-09-10T05:12:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.061+0000 7f5f43ac0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f2e650 0x55c012f2ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.061+0000 7f5f43ac0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f2e650 0x55c012f2ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42854/0 (socket says 172.21.15.192:42854) 2024-09-10T05:12:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.061+0000 7f5f43ac0640 1 -- 172.21.15.192:0/1771824314 learned_addr learned my addr 172.21.15.192:0/1771824314 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:52.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.061+0000 7f5f43ac0640 1 -- 172.21.15.192:0/1771824314 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c012f2f0b0 con 0x55c012f2e650 2024-09-10T05:12:52.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.061+0000 7f5f43ac0640 1 --2- 172.21.15.192:0/1771824314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f2e650 0x55c012f2ea70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5f34077bd0 tx=0x7f5f3405adf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.062+0000 7f5e297fa640 1 -- 172.21.15.192:0/1771824314 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f34086070 con 0x55c012f2e650 2024-09-10T05:12:52.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.062+0000 7f5e297fa640 1 -- 172.21.15.192:0/1771824314 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3408ed60 con 0x55c012f2e650 2024-09-10T05:12:52.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.062+0000 7f5f47d3e800 1 -- 172.21.15.192:0/1771824314 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c012f2f8e0 con 0x55c012f2e650 2024-09-10T05:12:52.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.062+0000 7f5e297fa640 1 -- 172.21.15.192:0/1771824314 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3406d770 con 0x55c012f2e650 2024-09-10T05:12:52.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.062+0000 7f5f47d3e800 1 -- 172.21.15.192:0/1771824314 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c012f2fe80 con 0x55c012f2e650 2024-09-10T05:12:52.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.062+0000 7f5e297fa640 1 -- 172.21.15.192:0/1771824314 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5f34058070 con 0x55c012f2e650 2024-09-10T05:12:52.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.063+0000 7f5e297fa640 1 --2- 172.21.15.192:0/1771824314 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e1c03c730 0x7f5e1c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.063+0000 7f5e297fa640 1 -- 172.21.15.192:0/1771824314 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5f34062070 con 0x55c012f2e650 2024-09-10T05:12:52.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.063+0000 7f5f432bf640 1 --2- 172.21.15.192:0/1771824314 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e1c03c730 0x7f5e1c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.063+0000 7f5f47d3e800 1 Processor -- start 2024-09-10T05:12:52.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.063+0000 7f5f47d3e800 1 -- start start 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.063+0000 7f5f432bf640 1 --2- 172.21.15.192:0/1771824314 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e1c03c730 0x7f5e1c03ebf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55c012f18160 tx=0x7f5f38006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.063+0000 7f5f47d3e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 0x55c012f3b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.063+0000 7f5f47d3e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c012f06c20 con 0x55c012f3af30 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.063+0000 7f5f43ac0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 0x55c012f3b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.063+0000 7f5f43ac0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 0x55c012f3b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42868/0 (socket says 172.21.15.192:42868) 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.063+0000 7f5f43ac0640 1 -- 172.21.15.192:0/159964377 learned_addr learned my addr 172.21.15.192:0/159964377 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.064+0000 7f5f43ac0640 1 -- 172.21.15.192:0/159964377 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c012f3b900 con 0x55c012f3af30 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.064+0000 7f5f43ac0640 1 --2- 172.21.15.192:0/159964377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 0x55c012f3b310 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5f3406d680 tx=0x7f5f3406f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c08c0b1b5243ede server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.064+0000 7f5e22ffd640 1 -- 172.21.15.192:0/159964377 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f340a6020 con 0x55c012f3af30 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.064+0000 7f5e22ffd640 1 -- 172.21.15.192:0/159964377 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f34078440 con 0x55c012f3af30 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.064+0000 7f5e22ffd640 1 -- 172.21.15.192:0/159964377 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3407c1b0 con 0x55c012f3af30 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.064+0000 7f5f47d3e800 1 -- 172.21.15.192:0/159964377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 msgr2=0x55c012f3b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.064+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/159964377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 0x55c012f3b310 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5f3406d680 tx=0x7f5f3406f400 comp rx=0 tx=0).stop 2024-09-10T05:12:52.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.064+0000 7f5f47d3e800 1 -- 172.21.15.192:0/159964377 shutdown_connections 2024-09-10T05:12:52.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.064+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/159964377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 0x55c012f3b310 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.064+0000 7f5f47d3e800 1 -- 172.21.15.192:0/159964377 >> 172.21.15.192:0/159964377 conn(0x55c012f37330 msgr2=0x55c012f35570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:52.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.064+0000 7f5f47d3e800 1 -- 172.21.15.192:0/159964377 shutdown_connections 2024-09-10T05:12:52.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.064+0000 7f5f47d3e800 1 -- 172.21.15.192:0/159964377 wait complete. 2024-09-10T05:12:52.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.065+0000 7f5f47d3e800 1 Processor -- start 2024-09-10T05:12:52.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.065+0000 7f5f47d3e800 1 -- start start 2024-09-10T05:12:52.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.065+0000 7f5f47d3e800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 0x55c012f422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.065+0000 7f5f47d3e800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c012f3bd90 con 0x55c012f3af30 2024-09-10T05:12:52.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.065+0000 7f5f43ac0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 0x55c012f422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.065+0000 7f5f43ac0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 0x55c012f422b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:42874/0 (socket says 172.21.15.192:42874) 2024-09-10T05:12:52.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.065+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 learned_addr learned my addr 172.21.15.192:0/2242699321 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.065+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c012f42810 con 0x55c012f3af30 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.065+0000 7f5f43ac0640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 0x55c012f422b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5f34091f90 tx=0x7f5f34076b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.066+0000 7f5e217fa640 1 -- 172.21.15.192:0/2242699321 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f340ba070 con 0x55c012f3af30 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.066+0000 7f5e217fa640 1 -- 172.21.15.192:0/2242699321 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3408e100 con 0x55c012f3af30 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.066+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c012f42810 con 0x55c012f3af30 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.066+0000 7f5e217fa640 1 -- 172.21.15.192:0/2242699321 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3408e400 con 0x55c012f3af30 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.066+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c012f42810 con 0x55c012f3af30 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.066+0000 7f5e217fa640 1 -- 172.21.15.192:0/2242699321 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5f340bd070 con 0x55c012f3af30 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.067+0000 7f5e217fa640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e0c03c730 0x7f5e0c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.067+0000 7f5e217fa640 1 -- 172.21.15.192:0/2242699321 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5f340b2050 con 0x55c012f3af30 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.067+0000 7f5f432bf640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e0c03c730 0x7f5e0c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.067+0000 7f5f432bf640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e0c03c730 0x7f5e0c03ebf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800ffd0 tx=0x7f5f38023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.067+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.067+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c012f4d8c0 0x55c012f4fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.067+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f504d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.067+0000 7f5f442c1640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c012f4d8c0 0x55c012f4fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f442c1640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c012f4d8c0 0x55c012f4fd80 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 20 realm 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f508e0 con 0x55c012f4d8c0 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:12:52.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f511b0 con 0x55c012f4d8c0 2024-09-10T05:12:52.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:52.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f4d8c0 2024-09-10T05:12:52.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:52.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.068+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c012f522b0 0x55c012f546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.069+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f54c60 con 0x55c012f522b0 2024-09-10T05:12:52.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.069+0000 7f5f43ac0640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c012f522b0 0x55c012f546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.069+0000 7f5f43ac0640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c012f522b0 0x55c012f546a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.069+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.069+0000 7f5f47d3e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.069+0000 7f5f47d3e800 20 searching for the correct realm 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.069+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c012f56c10 0x55c012f590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.069+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f597a0 con 0x55c012f56c10 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.069+0000 7f5f432bf640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c012f56c10 0x55c012f590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.070+0000 7f5f432bf640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c012f56c10 0x55c012f590d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.070+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.070+0000 7f5f432bf640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5f3802e910 0x7f5f3803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.070+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f597a0 con 0x7f5f3802e910 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.070+0000 7f5f442c1640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5f3802e910 0x7f5f3803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.070+0000 7f5f442c1640 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5f3802e910 0x7f5f3803a3c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:12:52.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.071+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.071+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f522b0 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.071+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.071+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f4d8c0 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.071+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.071+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f4d8c0 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.071+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.071+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f522b0 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.072+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.072+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f522b0 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.072+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.072+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x7f5f3802e910 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.072+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.072+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f56c10 2024-09-10T05:12:52.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.072+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.072+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f4d8c0 2024-09-10T05:12:52.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.073+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.073+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f522b0 2024-09-10T05:12:52.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.073+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.073+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f4d8c0 2024-09-10T05:12:52.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.073+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.073+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x7f5f3802e910 2024-09-10T05:12:52.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.073+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.073+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f56c10 2024-09-10T05:12:52.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.074+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.074+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f56c10 2024-09-10T05:12:52.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.074+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.074+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f522b0 2024-09-10T05:12:52.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.074+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.074+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f56c10 2024-09-10T05:12:52.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.074+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.074+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f56c10 2024-09-10T05:12:52.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.075+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.075+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f4d8c0 2024-09-10T05:12:52.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.075+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.075+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f4d8c0 2024-09-10T05:12:52.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.075+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.075+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x7f5f3802e910 2024-09-10T05:12:52.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.075+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.075+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f56c10 2024-09-10T05:12:52.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.075+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.075+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x7f5f3802e910 2024-09-10T05:12:52.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.076+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.076+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f4d8c0 2024-09-10T05:12:52.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.076+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.076+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f522b0 2024-09-10T05:12:52.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.076+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.076+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f56c10 2024-09-10T05:12:52.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.076+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.076+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f522b0 2024-09-10T05:12:52.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.077+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.077+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x7f5f3802e910 2024-09-10T05:12:52.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.077+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.077+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f56c10 2024-09-10T05:12:52.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.077+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.077+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x7f5f3802e910 2024-09-10T05:12:52.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.077+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.077+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x55c012f4d8c0 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c012f51550 con 0x7f5f3802e910 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f55520 con 0x55c012f4d8c0 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f55520 con 0x55c012f4d8c0 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.078+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f55520 con 0x7f5f3802e910 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 20 zone default found 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 4 Realm: () 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:12:52.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:12:52.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 20 zonegroup default 2024-09-10T05:12:52.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f55dc0 con 0x55c012f522b0 2024-09-10T05:12:52.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:52.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5b610 con 0x55c012f56c10 2024-09-10T05:12:52.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:52.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5b9b0 con 0x55c012f56c10 2024-09-10T05:12:52.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.079+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.080+0000 7f5f47d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.080+0000 7f5f47d3e800 20 started sync module instance, tier type = 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.080+0000 7f5f47d3e800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.080+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5aab0 con 0x7f5f3802e910 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.081+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.081+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94283440173024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5aab0 con 0x7f5f3802e910 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.081+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5c370 con 0x55c012f4d8c0 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.082+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94283440173024] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.082+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.082+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94283440170976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5c370 con 0x55c012f4d8c0 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.082+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5cd30 con 0x55c012f56c10 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.083+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94283440170976] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.083+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.083+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94283440176832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5c2e0 con 0x55c012f56c10 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.083+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5dc20 con 0x7f5f3802e910 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.084+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94283440176832] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.084+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.084+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94283440183152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5e040 con 0x7f5f3802e910 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.084+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5ea00 con 0x55c012f4d8c0 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.085+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.085+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94283440183152] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.085+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94283440186704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5ee20 con 0x55c012f4d8c0 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.085+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5f410 con 0x55c012f522b0 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.086+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94283440186704] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.087+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.087+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94283440187760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5ed90 con 0x55c012f522b0 2024-09-10T05:12:52.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.087+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f601c0 con 0x55c012f522b0 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.088+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.088+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94283440195040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f60eb0 con 0x55c012f522b0 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.088+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f618d0 con 0x55c012f522b0 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.088+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94283440187760] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.089+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94283440195040] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.089+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.089+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94283440198592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f60a40 con 0x55c012f522b0 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.089+0000 7f5f47d3e800 20 add_watcher() i=0 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.089+0000 7f5f47d3e800 20 add_watcher() i=1 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.089+0000 7f5f47d3e800 20 add_watcher() i=2 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.089+0000 7f5f47d3e800 20 add_watcher() i=3 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.089+0000 7f5f47d3e800 20 add_watcher() i=4 2024-09-10T05:12:52.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.089+0000 7f5f47d3e800 20 add_watcher() i=5 2024-09-10T05:12:52.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.089+0000 7f5f47d3e800 20 add_watcher() i=6 2024-09-10T05:12:52.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.090+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94283440198592] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.090+0000 7f5f47d3e800 20 add_watcher() i=7 2024-09-10T05:12:52.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.090+0000 7f5f47d3e800 2 all 8 watchers are set, enabling cache 2024-09-10T05:12:52.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.090+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f649d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.090+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.090+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94283440191488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f61e50 con 0x55c012f4d8c0 2024-09-10T05:12:52.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.091+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94283440191488] v37'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.091+0000 7f5df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:52.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.091+0000 7f5f47d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:12:52.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.091+0000 7f5f47d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:12:52.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.091+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6d110 con 0x55c012f4d8c0 2024-09-10T05:12:52.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.092+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'57 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.092+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6d110 con 0x55c012f522b0 2024-09-10T05:12:52.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.094+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.094+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6d110 con 0x55c012f56c10 2024-09-10T05:12:52.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.095+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.095+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6e0b0 con 0x55c012f4d8c0 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.095+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'232 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.095+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6c8b0 con 0x7f5f3802e910 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.096+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'77 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.096+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6c8b0 con 0x55c012f56c10 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.097+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'59 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.097+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6f270 con 0x55c012f4d8c0 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.098+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.098+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6b770 con 0x55c012f522b0 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.099+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.099+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6b770 con 0x7f5f3802e910 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.100+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.100+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6b770 con 0x55c012f56c10 2024-09-10T05:12:52.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.101+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.101+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x7f5f3802e910 2024-09-10T05:12:52.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.102+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'78 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.102+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x55c012f522b0 2024-09-10T05:12:52.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.103+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.103+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x7f5f3802e910 2024-09-10T05:12:52.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.104+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.104+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x55c012f522b0 2024-09-10T05:12:52.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.106+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'65 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.106+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x55c012f4d8c0 2024-09-10T05:12:52.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.107+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'233 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.107+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x55c012f56c10 2024-09-10T05:12:52.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.108+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'74 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.108+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x7f5f3802e910 2024-09-10T05:12:52.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.109+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'79 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.109+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x55c012f56c10 2024-09-10T05:12:52.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.110+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.110+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x55c012f4d8c0 2024-09-10T05:12:52.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.111+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.111+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x55c012f4d8c0 2024-09-10T05:12:52.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.112+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'234 uv174 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.112+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x55c012f56c10 2024-09-10T05:12:52.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.113+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'75 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.113+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x7f5f3802e910 2024-09-10T05:12:52.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.114+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.114+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6fdd0 con 0x55c012f56c10 2024-09-10T05:12:52.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.115+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.115+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f70360 con 0x55c012f56c10 2024-09-10T05:12:52.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.116+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'45 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.116+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f70340 con 0x55c012f56c10 2024-09-10T05:12:52.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.117+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.117+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f70340 con 0x55c012f56c10 2024-09-10T05:12:52.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.118+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'60 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.118+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f70300 con 0x55c012f522b0 2024-09-10T05:12:52.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.119+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.119+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6b0f0 con 0x55c012f56c10 2024-09-10T05:12:52.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.120+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.120+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6b0f0 con 0x55c012f522b0 2024-09-10T05:12:52.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.121+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.121+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f702e0 con 0x55c012f56c10 2024-09-10T05:12:52.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.122+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'76 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.122+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f702e0 con 0x55c012f522b0 2024-09-10T05:12:52.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.124+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'66 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.124+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f702e0 con 0x7f5f3802e910 2024-09-10T05:12:52.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.125+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.125+0000 7f5df8fe1640 20 reqs_thread_entry: start 2024-09-10T05:12:52.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.125+0000 7f5f47d3e800 20 init_complete bucket index max shards: 11 2024-09-10T05:12:52.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.125+0000 7f5f47d3e800 20 Filter name: none 2024-09-10T05:12:52.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.125+0000 7f5d727fc640 20 reqs_thread_entry: start 2024-09-10T05:12:52.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.125+0000 7f5f47d3e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-10T05:12:52.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.125+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.125+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f9abb0 con 0x55c012f522b0 2024-09-10T05:12:52.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.126+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.126+0000 7f5f47d3e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-10T05:12:52.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.126+0000 7f5f47d3e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-10T05:12:52.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.126+0000 7f5f47d3e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-10T05:12:52.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.126+0000 7f5f47d3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:52.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.126+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f9d470 con 0x55c012f522b0 2024-09-10T05:12:52.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.126+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv7 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.126+0000 7f5f47d3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:92aa256a-2802-419e-96e0-ba675846cbc3.4238.10 : miss 2024-09-10T05:12:52.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.126+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.126+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:96 8.1f 8:fb20254c:root::.bucket.meta.myfoo7%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012f9d3d0 con 0x7f5f3802e910 2024-09-10T05:12:52.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.127+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(96 .bucket.meta.myfoo7:92aa256a-2802-419e-96e0-ba675846cbc3.4238.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.127+0000 7f5f47d3e800 20 rados_obj.operate() r=0 bl.length=390 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.127+0000 7f5f47d3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:92aa256a-2802-419e-96e0-ba675846cbc3.4238.10 info.flags=0x17 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.127+0000 7f5f47d3e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:92aa256a-2802-419e-96e0-ba675846cbc3.4238.10 to cache LRU end 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.127+0000 7f5f47d3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.127+0000 7f5f47d3e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.127+0000 7f5f47d3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:92aa256a-2802-419e-96e0-ba675846cbc3.4238.10 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.127+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:97 4.18 4:1a1048b4:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c01301a990 con 0x7f5f3802e910 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.127+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(97 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.127+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:98 4.4 4:224d2473:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c01301a990 con 0x55c012f522b0 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.127+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(98 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.127+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:99 4.5 4:a2438239:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c01301a990 con 0x55c012f56c10 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.128+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(99 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.128+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:100 4.f 4:f00b4acb:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c01301a9d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.128+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(100 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.3 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.128+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:101 4.3b 4:df93bf1e:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c01301a9d0 con 0x55c012f56c10 2024-09-10T05:12:52.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.128+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(101 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.4 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.128+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:102 4.d 4:b2ff4a3a:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c01301a9d0 con 0x55c012f56c10 2024-09-10T05:12:52.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.129+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 28 ==== osd_op_reply(102 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5 [call out=381b] v0'0 uv12 ondisk = 0) ==== 195+0+381 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.129+0000 7f5f47d3e800 10 cls_bucket_list_unordered: got fourteen 2024-09-10T05:12:52.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.129+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:103 4.2b 4:d6fb8c80:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c01301a9d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.129+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(103 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.6 [call out=89b] v0'0 uv14 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.129+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:104 4.5 4:a28abba8:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c01301a9d0 con 0x55c012f56c10 2024-09-10T05:12:52.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.129+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 29 ==== osd_op_reply(104 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.7 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.129+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:105 4.1b 4:d9e89e09:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c01301a9d0 con 0x7f5f3802e910 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.130+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(105 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.130+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:106 4.3 4:c121776e:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c01301a9d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.130+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(106 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.130+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:107 4.1f 4:fb228dc9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c01301a9d0 con 0x55c012f56c10 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.130+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 30 ==== osd_op_reply(107 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.130+0000 7f5f47d3e800 20 get_obj_state: octx=0x55c012efe4c0 obj=myfoo7:fourteen state=0x55c013018a18 s->prefetch_data=0 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.130+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:108 3.1bs0 3:d9a7e9f9:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c013019390 con 0x55c012f56c10 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.130+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 31 ==== osd_op_reply(108 92aa256a-2802-419e-96e0-ba675846cbc3.4238.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.131+0000 7f5f47d3e800 10 manifest: total_size = 8 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.131+0000 7f5f47d3e800 20 get_obj_state: setting s->obj_tag to 92aa256a-2802-419e-96e0-ba675846cbc3.4238.1444888530607495160 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.131+0000 7f5f47d3e800 20 get_obj_state: octx=0x55c012efe4c0 obj=myfoo7:fourteen state=0x55c013018a18 s->prefetch_data=0 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.131+0000 7f5f47d3e800 20 prepare_atomic_modification: state is not atomic. state=0x55c013018a18 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.131+0000 7f5f47d3e800 20 bucket index object: :.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5 2024-09-10T05:12:52.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.131+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:109 4.d 4:b2ff4a3a:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c013019d50 con 0x55c012f56c10 2024-09-10T05:12:52.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.132+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 32 ==== osd_op_reply(109 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5 [stat,call,call] v37'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.132+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:110 3.1bs0 3:d9a7e9f9:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c013019d50 con 0x55c012f56c10 2024-09-10T05:12:52.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.133+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 33 ==== osd_op_reply(110 92aa256a-2802-419e-96e0-ba675846cbc3.4238.10_fourteen [call] v37'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.133+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:111 4.d 4:b2ff4a3a:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012fa1fa0 con 0x55c012f56c10 2024-09-10T05:12:52.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.133+0000 7f5f47d3e800 20 list_objects_ordered: starting attempt 1 2024-09-10T05:12:52.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.133+0000 7f5f47d3e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T05:12:52.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.133+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:112 4.18 4:1a1048b4:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fa1fa0 con 0x7f5f3802e910 2024-09-10T05:12:52.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.133+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:113 4.4 4:224d2473:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fa1fa0 con 0x55c012f522b0 2024-09-10T05:12:52.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.133+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:114 4.5 4:a2438239:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fa1fa0 con 0x55c012f56c10 2024-09-10T05:12:52.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.133+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:115 4.f 4:f00b4acb:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012faab40 con 0x55c012f4d8c0 2024-09-10T05:12:52.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.133+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:116 4.3b 4:df93bf1e:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fad4a0 con 0x55c012f56c10 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(113 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:117 4.d 4:b2ff4a3a:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fafe00 con 0x55c012f56c10 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:118 4.2b 4:d6fb8c80:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb0360 con 0x55c012f4d8c0 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:119 4.5 4:a28abba8:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb2d40 con 0x55c012f56c10 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(115 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.3 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:120 4.1b 4:d9e89e09:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb3680 con 0x7f5f3802e910 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:121 4.3 4:c121776e:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb6430 con 0x55c012f4d8c0 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 24 ==== osd_op_reply(112 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 34 ==== osd_op_reply(116 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.4 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:122 4.1f 4:fb228dc9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb2d40 con 0x55c012f56c10 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 35 ==== osd_op_reply(114 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 36 ==== osd_op_reply(119 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.7 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.134+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(118 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.6 [call out=89b] v0'0 uv14 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(121 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 25 ==== osd_op_reply(120 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 37 ==== osd_op_reply(111 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5 [stat,call,call] v37'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5e22ffd640 20 handle_completion(): completion ok for obj=fourteen 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 38 ==== osd_op_reply(122 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 39 ==== osd_op_reply(117 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5 [call out=128b] v0'0 uv14 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f5f38037040 con 0x55c012f56c10 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[92aa256a-2802-419e-96e0-ba675846cbc3.4238.10])"; uploads.size()=0; is_truncated=0 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:123 4.18 4:1a1048b4:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb6490 con 0x7f5f3802e910 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:124 4.4 4:224d2473:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb36d0 con 0x55c012f522b0 2024-09-10T05:12:52.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:125 4.5 4:a2438239:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb2d40 con 0x55c012f56c10 2024-09-10T05:12:52.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:126 4.f 4:f00b4acb:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012facff0 con 0x55c012f4d8c0 2024-09-10T05:12:52.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:127 4.3b 4:df93bf1e:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb6490 con 0x55c012f56c10 2024-09-10T05:12:52.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:128 4.d 4:b2ff4a3a:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fafd90 con 0x55c012f56c10 2024-09-10T05:12:52.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:129 4.2b 4:d6fb8c80:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb36d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:130 4.5 4:a28abba8:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb6490 con 0x55c012f56c10 2024-09-10T05:12:52.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:131 4.1b 4:d9e89e09:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012facff0 con 0x7f5f3802e910 2024-09-10T05:12:52.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:132 4.3 4:c121776e:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb36d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(126 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.3 [call out=89b] v0'0 uv11 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:133 4.1f 4:fb228dc9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012faafd0 con 0x55c012f56c10 2024-09-10T05:12:52.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 34 ==== osd_op_reply(129 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.6 [call out=89b] v0'0 uv14 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(124 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 40 ==== osd_op_reply(125 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 26 ==== osd_op_reply(123 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 41 ==== osd_op_reply(127 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.4 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 42 ==== osd_op_reply(128 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5 [call out=128b] v0'0 uv14 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.135+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 43 ==== osd_op_reply(130 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.7 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.136+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 44 ==== osd_op_reply(133 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.136+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 27 ==== osd_op_reply(131 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.136+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 35 ==== osd_op_reply(132 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.9 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.136+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb5cd0 con 0x55c012f522b0 2024-09-10T05:12:52.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.137+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(134 fud.buckets [call] v37'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.137+0000 7f5f47d3e800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-10T05:12:52.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.137+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.137+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb5cd0 con 0x7f5f3802e910 2024-09-10T05:12:52.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.139+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 28 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv46 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.139+0000 7f5f47d3e800 20 rados_obj.operate() r=0 bl.length=168 2024-09-10T05:12:52.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.139+0000 7f5f47d3e800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-10T05:12:52.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.139+0000 7f5f47d3e800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-10T05:12:52.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.139+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012facff0 con 0x7f5f3802e910 2024-09-10T05:12:52.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.140+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 29 ==== osd_op_reply(136 myfoo7 [call,call,delete] v37'47 uv47 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.140+0000 7f5f47d3e800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.140+0000 7f5f47d3e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.140+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94283440533552 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012faafd0 con 0x7f5f3802e910 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.141+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 30 ==== watch-notify(notify (1) cookie 94283440183152 notify 158913789986 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55c012f9c940 con 0x7f5f3802e910 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.141+0000 7f5e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789986 cookie 94283440183152 notifier 4770 bl.length()=150 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.141+0000 7f5e22ffd640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5e08003d60 con 0x7f5f3802e910 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.141+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 31 ==== osd_op_reply(137 notify.3 [notify cookie 94283440533552 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.141+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 32 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.141+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 33 ==== watch-notify(notify_complete (2) cookie 94283440533552 notify 158913789986 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c012f6cc50 con 0x7f5f3802e910 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.141+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:139 8.1f 8:fb20254c:root::.bucket.meta.myfoo7%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012facff0 con 0x7f5f3802e910 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.142+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 34 ==== osd_op_reply(139 .bucket.meta.myfoo7:92aa256a-2802-419e-96e0-ba675846cbc3.4238.10 [call,call,delete] v37'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.142+0000 7f5f47d3e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:92aa256a-2802-419e-96e0-ba675846cbc3.4238.10 from cache 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.142+0000 7f5f47d3e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:92aa256a-2802-419e-96e0-ba675846cbc3.4238.10, ofs0, ns] 2024-09-10T05:12:52.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.142+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify cookie 94283440444224 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb5cd0 con 0x7f5f3802e910 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.142+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 35 ==== watch-notify(notify (1) cookie 94283440183152 notify 158913789987 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55c012f6cc50 con 0x7f5f3802e910 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.142+0000 7f5e227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789987 cookie 94283440183152 notifier 4770 bl.length()=208 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.142+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 36 ==== osd_op_reply(140 notify.3 [notify cookie 94283440444224 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.142+0000 7f5e227fc640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:141 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5d780032c0 con 0x7f5f3802e910 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.142+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 37 ==== osd_op_reply(141 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.142+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 38 ==== watch-notify(notify_complete (2) cookie 94283440444224 notify 158913789987 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c012f6c100 con 0x7f5f3802e910 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.143+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:142 4.18 4:1a1048b4:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb3030 con 0x7f5f3802e910 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.143+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:143 4.4 4:224d2473:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f9b790 con 0x55c012f522b0 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.143+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:144 4.5 4:a2438239:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f9bfe0 con 0x55c012f56c10 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.143+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:145 4.f 4:f00b4acb:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb38a0 con 0x55c012f4d8c0 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.143+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:146 4.3b 4:df93bf1e:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb41c0 con 0x55c012f56c10 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.143+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:147 4.d 4:b2ff4a3a:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb4ae0 con 0x55c012f56c10 2024-09-10T05:12:52.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.143+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:148 4.2b 4:d6fb8c80:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f9b790 con 0x55c012f4d8c0 2024-09-10T05:12:52.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.143+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:149 4.5 4:a28abba8:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb38a0 con 0x55c012f56c10 2024-09-10T05:12:52.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.143+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:150 4.1b 4:d9e89e09:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f9bfe0 con 0x7f5f3802e910 2024-09-10T05:12:52.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.143+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:151 4.3 4:c121776e:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f9b790 con 0x55c012f4d8c0 2024-09-10T05:12:52.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.143+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:152 4.1f 4:fb228dc9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb41c0 con 0x55c012f56c10 2024-09-10T05:12:52.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.144+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 45 ==== osd_op_reply(146 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.4 [delete] v37'11 uv11 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.144+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 39 ==== osd_op_reply(142 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.0 [delete] v37'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.144+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 40 ==== osd_op_reply(150 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.8 [delete] v37'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.144+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 36 ==== osd_op_reply(148 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.6 [delete] v37'15 uv15 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.144+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(143 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.1 [delete] v37'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.147+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 46 ==== osd_op_reply(152 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.10 [delete] v37'2 uv2 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.147+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 37 ==== osd_op_reply(145 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.3 [delete] v37'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.147+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 47 ==== osd_op_reply(144 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.2 [delete] v37'5 uv5 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.149+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 48 ==== osd_op_reply(147 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.5 [delete] v37'15 uv15 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.149+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 49 ==== osd_op_reply(149 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.7 [delete] v37'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.149+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 38 ==== osd_op_reply(151 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.10.9 [delete] v37'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.149+0000 7f5f47d3e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/92aa256a-2802-419e-96e0-ba675846cbc3.4238.10 : miss 2024-09-10T05:12:52.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.149+0000 7f5f47d3e800 20 rados->read ofs=0 len=0 2024-09-10T05:12:52.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.149+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:153 6.a 6:56f4c6d6:::pubsub..bucket.myfoo7%2f92aa256a-2802-419e-96e0-ba675846cbc3.4238.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb4ae0 con 0x7f5f3802e910 2024-09-10T05:12:52.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.150+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 41 ==== osd_op_reply(153 pubsub..bucket.myfoo7/92aa256a-2802-419e-96e0-ba675846cbc3.4238.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.150+0000 7f5f47d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:12:52.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.150+0000 7f5f47d3e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/92aa256a-2802-419e-96e0-ba675846cbc3.4238.10 info.flags=0x0 2024-09-10T05:12:52.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.150+0000 7f5f47d3e800 10 adding default.rgw.log++pubsub..bucket.myfoo7/92aa256a-2802-419e-96e0-ba675846cbc3.4238.10 to cache LRU end 2024-09-10T05:12:52.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.150+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:154 6.a 6:56f4c6d6:::pubsub..bucket.myfoo7%2f92aa256a-2802-419e-96e0-ba675846cbc3.4238.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb3030 con 0x7f5f3802e910 2024-09-10T05:12:52.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.152+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 42 ==== osd_op_reply(154 pubsub..bucket.myfoo7/92aa256a-2802-419e-96e0-ba675846cbc3.4238.10 [delete] v37'44 uv37 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.152+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb5640 con 0x55c012f522b0 2024-09-10T05:12:52.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.153+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 30 ==== osd_op_reply(155 fud.buckets [call] v37'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.153+0000 7f5f47d3e800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-10T05:12:52.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.153+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb3030 con 0x55c012f522b0 2024-09-10T05:12:52.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.154+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 31 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v37'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.154+0000 7f5f47d3e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-10T05:12:52.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.154+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94283440444176 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb3030 con 0x55c012f56c10 2024-09-10T05:12:52.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.154+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 50 ==== watch-notify(notify (1) cookie 94283440176832 notify 158913789961 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55c012f6fdd0 con 0x55c012f56c10 2024-09-10T05:12:52.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.154+0000 7f5e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789961 cookie 94283440176832 notifier 4770 bl.length()=170 2024-09-10T05:12:52.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.154+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 51 ==== osd_op_reply(157 notify.2 [notify cookie 94283440444176 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.154+0000 7f5e22ffd640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5e08003d60 con 0x55c012f56c10 2024-09-10T05:12:52.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.155+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 52 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.155+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 53 ==== watch-notify(notify_complete (2) cookie 94283440444176 notify 158913789961 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c012f6bed0 con 0x55c012f56c10 2024-09-10T05:12:52.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.155+0000 7f5f47d3e800 10 removing email index: 2024-09-10T05:12:52.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.155+0000 7f5f47d3e800 10 removing user buckets index 2024-09-10T05:12:52.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.155+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb3030 con 0x55c012f522b0 2024-09-10T05:12:52.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.156+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 32 ==== osd_op_reply(159 fud.buckets [delete] v37'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.156+0000 7f5f47d3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.156+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94283440444176 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb3030 con 0x55c012f522b0 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.156+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 33 ==== watch-notify(notify (1) cookie 94283440195040 notify 158913789986 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55c012f6b770 con 0x55c012f522b0 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.156+0000 7f5e227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789986 cookie 94283440195040 notifier 4770 bl.length()=160 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.156+0000 7f5e227fc640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5d780032a0 con 0x55c012f522b0 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.156+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 34 ==== osd_op_reply(160 notify.6 [notify cookie 94283440444176 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.156+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 35 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.156+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 36 ==== watch-notify(notify_complete (2) cookie 94283440444176 notify 158913789986 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c012f2f0b0 con 0x55c012f522b0 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.156+0000 7f5f47d3e800 10 removing user index: fud 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.156+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012facfd0 con 0x55c012f522b0 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.157+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 37 ==== osd_op_reply(162 fud [call,call,delete] v37'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.157+0000 7f5f47d3e800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-10T05:12:52.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.157+0000 7f5f47d3e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-10T05:12:52.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.157+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94283440444176 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c012fb5cd0 con 0x55c012f522b0 2024-09-10T05:12:52.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.158+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 38 ==== watch-notify(notify (1) cookie 94283440187760 notify 158913789987 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c012f2f0b0 con 0x55c012f522b0 2024-09-10T05:12:52.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.158+0000 7f5e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789987 cookie 94283440187760 notifier 4770 bl.length()=152 2024-09-10T05:12:52.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.158+0000 7f5e22ffd640 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5e08003d60 con 0x55c012f522b0 2024-09-10T05:12:52.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.158+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 39 ==== osd_op_reply(163 notify.5 [notify cookie 94283440444176 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.158+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 40 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.158+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 41 ==== watch-notify(notify_complete (2) cookie 94283440444176 notify 158913789987 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c012e15d70 con 0x55c012f522b0 2024-09-10T05:12:52.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.159+0000 7f5df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:12:52.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.159+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94283440191488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f6ab50 con 0x55c012f4d8c0 2024-09-10T05:12:52.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.160+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 39 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94283440191488] v37'235 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.160+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94283440173024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5f800 con 0x7f5f3802e910 2024-09-10T05:12:52.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.161+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 43 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94283440173024] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.161+0000 7f5f47d3e800 20 remove_watcher() i=0 2024-09-10T05:12:52.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.161+0000 7f5f47d3e800 2 removed watcher, disabling cache 2024-09-10T05:12:52.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.161+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94283440170976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5f800 con 0x55c012f4d8c0 2024-09-10T05:12:52.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.162+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 40 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94283440170976] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.162+0000 7f5f47d3e800 20 remove_watcher() i=1 2024-09-10T05:12:52.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.162+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94283440176832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5f800 con 0x55c012f56c10 2024-09-10T05:12:52.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.163+0000 7f5f432bf640 1 -- 172.21.15.192:0/2242699321 <== osd.3 v2:172.21.15.192:6816/1620624472 54 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94283440176832] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3805b040 con 0x55c012f56c10 2024-09-10T05:12:52.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.163+0000 7f5f47d3e800 20 remove_watcher() i=2 2024-09-10T05:12:52.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.163+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94283440183152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5bec0 con 0x7f5f3802e910 2024-09-10T05:12:52.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.164+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.2 v2:172.21.15.192:6801/2435677948 44 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94283440183152] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x7f5f3802e910 2024-09-10T05:12:52.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.164+0000 7f5f47d3e800 20 remove_watcher() i=3 2024-09-10T05:12:52.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.164+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94283440186704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5bec0 con 0x55c012f4d8c0 2024-09-10T05:12:52.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.165+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 <== osd.1 v2:172.21.15.192:6800/3487349558 41 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94283440186704] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c00a4d0 con 0x55c012f4d8c0 2024-09-10T05:12:52.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.165+0000 7f5f47d3e800 20 remove_watcher() i=4 2024-09-10T05:12:52.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.165+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94283440187760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5e550 con 0x55c012f522b0 2024-09-10T05:12:52.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.166+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 42 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94283440187760] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.166+0000 7f5f47d3e800 20 remove_watcher() i=5 2024-09-10T05:12:52.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.166+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94283440195040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5bec0 con 0x55c012f522b0 2024-09-10T05:12:52.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.167+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 43 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94283440195040] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.167+0000 7f5f47d3e800 20 remove_watcher() i=6 2024-09-10T05:12:52.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.167+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94283440198592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c012f5bec0 con 0x55c012f522b0 2024-09-10T05:12:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f43ac0640 1 -- 172.21.15.192:0/2242699321 <== osd.0 v2:172.21.15.139:6800/2915567440 44 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94283440198592] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f340bc030 con 0x55c012f522b0 2024-09-10T05:12:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 20 remove_watcher() i=7 2024-09-10T05:12:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c012f522b0 msgr2=0x55c012f546a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c012f522b0 0x55c012f546a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c012f4d8c0 msgr2=0x55c012f4fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c012f4d8c0 0x55c012f4fd80 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5f3802e910 msgr2=0x7f5f3803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f5f3802e910 0x7f5f3803a3c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c012f56c10 msgr2=0x55c012f590d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55c012f56c10 0x55c012f590d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e0c03c730 msgr2=0x7f5e0c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e0c03c730 0x7f5e0c03ebf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800ffd0 tx=0x7f5f38023040 comp rx=0 tx=0).stop 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 msgr2=0x55c012f422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f442c1640 1 -- 172.21.15.192:0/2242699321 reap_dead start 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 0x55c012f422b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5f34091f90 tx=0x7f5f34076b40 comp rx=0 tx=0).stop 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 shutdown_connections 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/2242699321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f3af30 0x55c012f422b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 >> 172.21.15.192:0/2242699321 conn(0x55c012f37330 msgr2=0x55c012f35540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 shutdown_connections 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.168+0000 7f5f47d3e800 1 -- 172.21.15.192:0/2242699321 wait complete. 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/1771824314 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e1c03c730 msgr2=0x7f5e1c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/1771824314 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e1c03c730 0x7f5e1c03ebf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55c012f18160 tx=0x7f5f38006000 comp rx=0 tx=0).stop 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/1771824314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f2e650 msgr2=0x55c012f2ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/1771824314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f2e650 0x55c012f2ea70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5f34077bd0 tx=0x7f5f3405adf0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/1771824314 shutdown_connections 2024-09-10T05:12:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/1771824314 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e1c03c730 0x7f5e1c03ebf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/1771824314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012f2e650 0x55c012f2ea70 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/1771824314 >> 172.21.15.192:0/1771824314 conn(0x55c012f22a00 msgr2=0x55c012f22de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/1771824314 shutdown_connections 2024-09-10T05:12:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/1771824314 wait complete. 2024-09-10T05:12:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c012f19fc0 msgr2=0x55c012f1c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55c012f19fc0 0x55c012f1c3b0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c012f15380 msgr2=0x55c012f17770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55c012f15380 0x55c012f17770 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c012f1dec0 msgr2=0x55c012f202b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55c012f1dec0 0x55c012f202b0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e2c03c780 msgr2=0x7f5e2c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5e2c03c780 0x7f5e2c03ec40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5f38000c00 tx=0x7f5f380013b0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e1a050 msgr2=0x55c012e16e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:12:52.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 --2- 172.21.15.192:0/141478157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c012e1a050 0x55c012e16e40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5f34025da0 tx=0x7f5f34002fb0 comp rx=0 tx=0).stop 2024-09-10T05:12:52.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f442c1640 1 -- 172.21.15.192:0/141478157 reap_dead start 2024-09-10T05:12:52.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 shutdown_connections 2024-09-10T05:12:52.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 >> 172.21.15.192:0/141478157 conn(0x55c012e11200 msgr2=0x55c012f00600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:12:52.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 shutdown_connections 2024-09-10T05:12:52.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:12:52.169+0000 7f5f47d3e800 1 -- 172.21.15.192:0/141478157 wait complete. 2024-09-10T05:13:32.180 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-10T05:13:32.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-10T05:13:32.181 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-10T05:13:32.234 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:32.234 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:32.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.234+0000 7f21fe017800 1 Processor -- start 2024-09-10T05:13:32.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.234+0000 7f21fe017800 1 -- start start 2024-09-10T05:13:32.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.234+0000 7f21fe017800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a30031c5f0 0x55a30031e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.234+0000 7f21fe017800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a3001c5e40 con 0x55a30031f010 2024-09-10T05:13:32.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.234+0000 7f21fe017800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55a300190680 con 0x55a30031c5f0 2024-09-10T05:13:32.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.234+0000 7f21f97e7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a30031c5f0 0x55a30031e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.234+0000 7f21f97e7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a30031c5f0 0x55a30031e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:36698/0 (socket says 172.21.15.192:36698) 2024-09-10T05:13:32.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.234+0000 7f21f97e7640 1 -- 172.21.15.192:0/4083987910 learned_addr learned my addr 172.21.15.192:0/4083987910 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.234+0000 7f21f8fe6640 1 --1- 172.21.15.192:0/4083987910 >> v1:172.21.15.139:6789/0 conn(0x55a30031f010 0x55a3003214d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:45630/0 (socket says 172.21.15.192:45630) 2024-09-10T05:13:32.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.235+0000 7f21f97e7640 1 -- 172.21.15.192:0/4083987910 >> v1:172.21.15.139:6789/0 conn(0x55a30031f010 legacy=0x55a3003214d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.235+0000 7f21f97e7640 1 -- 172.21.15.192:0/4083987910 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3001ac6b0 con 0x55a30031c5f0 2024-09-10T05:13:32.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.235+0000 7f21f3fff640 1 -- 172.21.15.192:0/4083987910 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2894043309 0 0) 0x55a3001c5e40 con 0x55a30031f010 2024-09-10T05:13:32.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.237+0000 7f21f97e7640 1 --2- 172.21.15.192:0/4083987910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30031e9e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f21ec005fd0 tx=0x7f21ec045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be7ae1b9f120cf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.237+0000 7f21f3fff640 1 -- 172.21.15.192:0/4083987910 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec04e600 con 0x55a30031c5f0 2024-09-10T05:13:32.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.237+0000 7f21f3fff640 1 -- 172.21.15.192:0/4083987910 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec04e7a0 con 0x55a30031c5f0 2024-09-10T05:13:32.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.237+0000 7f21f3fff640 1 -- 172.21.15.192:0/4083987910 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec04eaa0 con 0x55a30031c5f0 2024-09-10T05:13:32.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.237+0000 7f21fe017800 1 -- 172.21.15.192:0/4083987910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 msgr2=0x55a30031e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.237+0000 7f21fe017800 1 --2- 172.21.15.192:0/4083987910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30031e9e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f21ec005fd0 tx=0x7f21ec045cf0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.237+0000 7f21fe017800 1 -- 172.21.15.192:0/4083987910 shutdown_connections 2024-09-10T05:13:32.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.237+0000 7f21fe017800 1 --2- 172.21.15.192:0/4083987910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30031e9e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.237+0000 7f21fe017800 1 -- 172.21.15.192:0/4083987910 >> 172.21.15.192:0/4083987910 conn(0x55a3003161b0 msgr2=0x55a300318610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.237+0000 7f21fe017800 1 -- 172.21.15.192:0/4083987910 shutdown_connections 2024-09-10T05:13:32.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.237+0000 7f21fe017800 1 -- 172.21.15.192:0/4083987910 wait complete. 2024-09-10T05:13:32.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.253+0000 7f21fe017800 1 Processor -- start 2024-09-10T05:13:32.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.253+0000 7f21fe017800 1 -- start start 2024-09-10T05:13:32.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.253+0000 7f21fe017800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30040b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.253+0000 7f21fe017800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a3001b4dd0 con 0x55a30031c5f0 2024-09-10T05:13:32.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.254+0000 7f21f97e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30040b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.254+0000 7f21f97e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30040b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:36710/0 (socket says 172.21.15.192:36710) 2024-09-10T05:13:32.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.254+0000 7f21f97e7640 1 -- 172.21.15.192:0/653543348 learned_addr learned my addr 172.21.15.192:0/653543348 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.254+0000 7f21f97e7640 1 -- 172.21.15.192:0/653543348 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3001cde10 con 0x55a30031c5f0 2024-09-10T05:13:32.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.254+0000 7f21f97e7640 1 --2- 172.21.15.192:0/653543348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30040b4c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f21ec005fd0 tx=0x7f21ec050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e837ec63be24ff98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.254+0000 7f20e7606640 1 -- 172.21.15.192:0/653543348 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec04ea80 con 0x55a30031c5f0 2024-09-10T05:13:32.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.254+0000 7f20e7606640 1 -- 172.21.15.192:0/653543348 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec05c040 con 0x55a30031c5f0 2024-09-10T05:13:32.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.254+0000 7f20e7606640 1 -- 172.21.15.192:0/653543348 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec04ed50 con 0x55a30031c5f0 2024-09-10T05:13:32.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.255+0000 7f21fe017800 1 -- 172.21.15.192:0/653543348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 msgr2=0x55a30040b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.255+0000 7f21fe017800 1 --2- 172.21.15.192:0/653543348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30040b4c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f21ec005fd0 tx=0x7f21ec050000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.255+0000 7f21fe017800 1 -- 172.21.15.192:0/653543348 shutdown_connections 2024-09-10T05:13:32.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.255+0000 7f21fe017800 1 --2- 172.21.15.192:0/653543348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30040b4c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.255+0000 7f21fe017800 1 -- 172.21.15.192:0/653543348 >> 172.21.15.192:0/653543348 conn(0x55a3003161b0 msgr2=0x55a300406e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.255+0000 7f21fe017800 1 -- 172.21.15.192:0/653543348 shutdown_connections 2024-09-10T05:13:32.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.255+0000 7f21fe017800 1 -- 172.21.15.192:0/653543348 wait complete. 2024-09-10T05:13:32.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.256+0000 7f21fe017800 1 Processor -- start 2024-09-10T05:13:32.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.256+0000 7f21fe017800 1 -- start start 2024-09-10T05:13:32.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.256+0000 7f21fe017800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30031bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.256+0000 7f21fe017800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a300323030 con 0x55a30031c5f0 2024-09-10T05:13:32.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.256+0000 7f21f97e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30031bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.256+0000 7f21f97e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30031bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:36726/0 (socket says 172.21.15.192:36726) 2024-09-10T05:13:32.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.256+0000 7f21f97e7640 1 -- 172.21.15.192:0/3221931556 learned_addr learned my addr 172.21.15.192:0/3221931556 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.256+0000 7f21f97e7640 1 -- 172.21.15.192:0/3221931556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a30031c270 con 0x55a30031c5f0 2024-09-10T05:13:32.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.257+0000 7f21f97e7640 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30031bd10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00a190 tx=0x7f21ec003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.257+0000 7f20e5e03640 1 -- 172.21.15.192:0/3221931556 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec071070 con 0x55a30031c5f0 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.257+0000 7f20e5e03640 1 -- 172.21.15.192:0/3221931556 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec06d440 con 0x55a30031c5f0 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.257+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a30031a620 con 0x55a30031c5f0 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.257+0000 7f20e5e03640 1 -- 172.21.15.192:0/3221931556 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec06d740 con 0x55a30031c5f0 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.257+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a30031abe0 con 0x55a30031c5f0 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.258+0000 7f20e5e03640 1 -- 172.21.15.192:0/3221931556 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f21ec074070 con 0x55a30031c5f0 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.258+0000 7f20e5e03640 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20e003c730 0x7f20e003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.258+0000 7f20e5e03640 1 -- 172.21.15.192:0/3221931556 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f21ec066020 con 0x55a30031c5f0 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.258+0000 7f21f8fe6640 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20e003c730 0x7f20e003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.258+0000 7f21fe017800 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a30031f010 0x55a30041c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.258+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a30041c710 con 0x55a30031f010 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.258+0000 7f21f9fe8640 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a30031f010 0x55a30041c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.259+0000 7f21f8fe6640 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20e003c730 0x7f20e003ebf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f21e4000c00 tx=0x7f21e40013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.259+0000 7f21f9fe8640 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a30031f010 0x55a30041c1d0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.259+0000 7f21f9fe8640 1 -- 172.21.15.192:0/3221931556 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21f40083e0 con 0x55a30031f010 2024-09-10T05:13:32.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.259+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a30031b180 con 0x55a30031f010 2024-09-10T05:13:32.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.259+0000 7f21f9fe8640 1 -- 172.21.15.192:0/3221931556 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21f40083e0 con 0x55a30031f010 2024-09-10T05:13:32.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.259+0000 7f21fe017800 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a30041ea00 0x55a300420df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.259+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3004214e0 con 0x55a30041ea00 2024-09-10T05:13:32.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.260+0000 7f21f97e7640 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a30041ea00 0x55a300420df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.260+0000 7f21f97e7640 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a30041ea00 0x55a300420df0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.261+0000 7f21f97e7640 1 -- 172.21.15.192:0/3221931556 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f21ec07d070 con 0x55a30041ea00 2024-09-10T05:13:32.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.261+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a30041d870 con 0x55a30031f010 2024-09-10T05:13:32.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.261+0000 7f21f9fe8640 1 -- 172.21.15.192:0/3221931556 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21f40083e0 con 0x55a30031f010 2024-09-10T05:13:32.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.261+0000 7f21fe017800 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a300422940 0x55a300424d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.261+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a300425430 con 0x55a300422940 2024-09-10T05:13:32.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.261+0000 7f21f8fe6640 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a300422940 0x55a300424d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.261+0000 7f21f8fe6640 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a300422940 0x55a300424d30 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.262+0000 7f21f8fe6640 1 -- 172.21.15.192:0/3221931556 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f21e400f670 con 0x55a300422940 2024-09-10T05:13:32.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.262+0000 7f21fe017800 1 Processor -- start 2024-09-10T05:13:32.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.262+0000 7f21fe017800 1 -- start start 2024-09-10T05:13:32.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.262+0000 7f21fe017800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a300433090 0x55a3004334b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.262+0000 7f21fe017800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a300212a00 con 0x55a300433090 2024-09-10T05:13:32.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.263+0000 7f21f97e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a300433090 0x55a3004334b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.263+0000 7f21f97e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a300433090 0x55a3004334b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:36738/0 (socket says 172.21.15.192:36738) 2024-09-10T05:13:32.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.263+0000 7f21f97e7640 1 -- 172.21.15.192:0/2994581932 learned_addr learned my addr 172.21.15.192:0/2994581932 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.263+0000 7f21f97e7640 1 -- 172.21.15.192:0/2994581932 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a300433af0 con 0x55a300433090 2024-09-10T05:13:32.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.263+0000 7f21f97e7640 1 --2- 172.21.15.192:0/2994581932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a300433090 0x55a3004334b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f21ec056fd0 tx=0x7f21ec06cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.263+0000 7f20deffd640 1 -- 172.21.15.192:0/2994581932 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec07b040 con 0x55a300433090 2024-09-10T05:13:32.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.263+0000 7f20deffd640 1 -- 172.21.15.192:0/2994581932 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec0568e0 con 0x55a300433090 2024-09-10T05:13:32.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.263+0000 7f21fe017800 1 -- 172.21.15.192:0/2994581932 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a300434320 con 0x55a300433090 2024-09-10T05:13:32.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.263+0000 7f20deffd640 1 -- 172.21.15.192:0/2994581932 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec056be0 con 0x55a300433090 2024-09-10T05:13:32.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.263+0000 7f21fe017800 1 -- 172.21.15.192:0/2994581932 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3004348c0 con 0x55a300433090 2024-09-10T05:13:32.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.264+0000 7f20deffd640 1 -- 172.21.15.192:0/2994581932 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f21ec068030 con 0x55a300433090 2024-09-10T05:13:32.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.264+0000 7f20deffd640 1 --2- 172.21.15.192:0/2994581932 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20d403c730 0x7f20d403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.264+0000 7f20deffd640 1 -- 172.21.15.192:0/2994581932 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f21ec09d020 con 0x55a300433090 2024-09-10T05:13:32.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.265+0000 7f21f8fe6640 1 --2- 172.21.15.192:0/2994581932 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20d403c730 0x7f20d403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.265+0000 7f21fe017800 1 Processor -- start 2024-09-10T05:13:32.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.265+0000 7f21fe017800 1 -- start start 2024-09-10T05:13:32.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.265+0000 7f21f8fe6640 1 --2- 172.21.15.192:0/2994581932 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20d403c730 0x7f20d403ebf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55a30041cba0 tx=0x7f21e4006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.265+0000 7f21fe017800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 0x55a30043fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.265+0000 7f21fe017800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a30040bc50 con 0x55a30043f970 2024-09-10T05:13:32.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.265+0000 7f21f97e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 0x55a30043fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.265+0000 7f21f97e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 0x55a30043fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:36754/0 (socket says 172.21.15.192:36754) 2024-09-10T05:13:32.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.265+0000 7f21f97e7640 1 -- 172.21.15.192:0/2746734294 learned_addr learned my addr 172.21.15.192:0/2746734294 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.266+0000 7f21f97e7640 1 -- 172.21.15.192:0/2746734294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a300440320 con 0x55a30043f970 2024-09-10T05:13:32.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.266+0000 7f21f97e7640 1 --2- 172.21.15.192:0/2746734294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 0x55a30043fd50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f21ec08f9c0 tx=0x7f21ec080870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc52e7735cbe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.266+0000 7f20dcff9640 1 -- 172.21.15.192:0/2746734294 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec0ae070 con 0x55a30043f970 2024-09-10T05:13:32.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.266+0000 7f20dcff9640 1 -- 172.21.15.192:0/2746734294 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec080610 con 0x55a30043f970 2024-09-10T05:13:32.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.266+0000 7f20dcff9640 1 -- 172.21.15.192:0/2746734294 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec08f210 con 0x55a30043f970 2024-09-10T05:13:32.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.266+0000 7f21fe017800 1 -- 172.21.15.192:0/2746734294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 msgr2=0x55a30043fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.266+0000 7f21fe017800 1 --2- 172.21.15.192:0/2746734294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 0x55a30043fd50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f21ec08f9c0 tx=0x7f21ec080870 comp rx=0 tx=0).stop 2024-09-10T05:13:32.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.266+0000 7f21fe017800 1 -- 172.21.15.192:0/2746734294 shutdown_connections 2024-09-10T05:13:32.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.266+0000 7f21fe017800 1 --2- 172.21.15.192:0/2746734294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 0x55a30043fd50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.266+0000 7f21fe017800 1 -- 172.21.15.192:0/2746734294 >> 172.21.15.192:0/2746734294 conn(0x55a30043bd70 msgr2=0x55a300439fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.266+0000 7f21fe017800 1 -- 172.21.15.192:0/2746734294 shutdown_connections 2024-09-10T05:13:32.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.266+0000 7f21fe017800 1 -- 172.21.15.192:0/2746734294 wait complete. 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.267+0000 7f21fe017800 1 Processor -- start 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.267+0000 7f21fe017800 1 -- start start 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.267+0000 7f21fe017800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 0x55a300446dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.267+0000 7f21fe017800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a3004407d0 con 0x55a30043f970 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.267+0000 7f21f97e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 0x55a300446dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.267+0000 7f21f97e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 0x55a300446dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:36768/0 (socket says 172.21.15.192:36768) 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.267+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 learned_addr learned my addr 172.21.15.192:0/1404691687 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.268+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a300447320 con 0x55a30043f970 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.268+0000 7f21f97e7640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 0x55a300446dc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f21ec05c010 tx=0x7f21ec072f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.268+0000 7f20caffd640 1 -- 172.21.15.192:0/1404691687 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec0b8070 con 0x55a30043f970 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.268+0000 7f20caffd640 1 -- 172.21.15.192:0/1404691687 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec060ac0 con 0x55a30043f970 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.268+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a300447320 con 0x55a30043f970 2024-09-10T05:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.268+0000 7f20caffd640 1 -- 172.21.15.192:0/1404691687 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec0ae040 con 0x55a30043f970 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.268+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3004477c0 con 0x55a30043f970 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.269+0000 7f20caffd640 1 -- 172.21.15.192:0/1404691687 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f21ec0bb070 con 0x55a30043f970 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.269+0000 7f20caffd640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20c403c730 0x7f20c403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.269+0000 7f20caffd640 1 -- 172.21.15.192:0/1404691687 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f21ec0a6070 con 0x55a30043f970 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.269+0000 7f21f8fe6640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20c403c730 0x7f20c403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.270+0000 7f21f8fe6640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20c403c730 0x7f20c403ebf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f21e400ffd0 tx=0x7f21e4023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.270+0000 7f21fe017800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.270+0000 7f21fe017800 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a3004521f0 0x55a3004546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.270+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a300454e00 con 0x55a3004521f0 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.270+0000 7f21f9fe8640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a3004521f0 0x55a3004546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.270+0000 7f21f9fe8640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a3004521f0 0x55a3004546b0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21f40083e0 con 0x55a3004521f0 2024-09-10T05:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 20 realm 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a300455210 con 0x55a3004521f0 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21f40083e0 con 0x55a3004521f0 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a3004521f0 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21f40083e0 con 0x55a3004521f0 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a300455e80 con 0x55a3004521f0 2024-09-10T05:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21f40083e0 con 0x55a3004521f0 2024-09-10T05:13:32.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:32.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.271+0000 7f21fe017800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.272+0000 7f21fe017800 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a300456840 0x55a300458c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.272+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a300459240 con 0x55a300456840 2024-09-10T05:13:32.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.272+0000 7f21f97e7640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a300456840 0x55a300458c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.272+0000 7f21f97e7640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a300456840 0x55a300458c30 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.272+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.272+0000 7f21fe017800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:32.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.273+0000 7f21fe017800 20 searching for the correct realm 2024-09-10T05:13:32.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.273+0000 7f21fe017800 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a30045b1f0 0x55a30045d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.273+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a30045dd30 con 0x55a30045b1f0 2024-09-10T05:13:32.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.273+0000 7f21f8fe6640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a30045b1f0 0x55a30045d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.273+0000 7f21f8fe6640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a30045b1f0 0x55a30045d6b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.273+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.273+0000 7f21f8fe6640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f21e402e910 0x7f21e403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.273+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a30045dd30 con 0x7f21e402e910 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.273+0000 7f21f9fe8640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f21e402e910 0x7f21e403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.274+0000 7f21f9fe8640 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f21e402e910 0x7f21e403a3c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.274+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f21f40083e0 con 0x7f21e402e910 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.274+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a300456840 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.274+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.274+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a3004521f0 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.275+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f40083e0 con 0x55a3004521f0 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.275+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a3004521f0 2024-09-10T05:13:32.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.275+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4026040 con 0x55a3004521f0 2024-09-10T05:13:32.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.275+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a300456840 2024-09-10T05:13:32.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.275+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.275+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a300456840 2024-09-10T05:13:32.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.275+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.276+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x7f21e402e910 2024-09-10T05:13:32.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.276+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4026040 con 0x7f21e402e910 2024-09-10T05:13:32.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.276+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a30045b1f0 2024-09-10T05:13:32.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.276+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.276+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a3004521f0 2024-09-10T05:13:32.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.276+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4026040 con 0x55a3004521f0 2024-09-10T05:13:32.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.276+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a300456840 2024-09-10T05:13:32.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.277+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.277+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a3004521f0 2024-09-10T05:13:32.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.277+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4026040 con 0x55a3004521f0 2024-09-10T05:13:32.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.277+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x7f21e402e910 2024-09-10T05:13:32.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.277+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f21f4026040 con 0x7f21e402e910 2024-09-10T05:13:32.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.277+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a30045b1f0 2024-09-10T05:13:32.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.277+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.277+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a30045b1f0 2024-09-10T05:13:32.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.278+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.278+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a300456840 2024-09-10T05:13:32.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.278+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.278+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a30045b1f0 2024-09-10T05:13:32.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.278+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.278+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a30045b1f0 2024-09-10T05:13:32.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.278+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.278+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a3004521f0 2024-09-10T05:13:32.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.279+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4026040 con 0x55a3004521f0 2024-09-10T05:13:32.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.279+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a3004521f0 2024-09-10T05:13:32.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.279+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f21f4026040 con 0x55a3004521f0 2024-09-10T05:13:32.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.279+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x7f21e402e910 2024-09-10T05:13:32.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.279+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4026040 con 0x7f21e402e910 2024-09-10T05:13:32.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.279+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a30045b1f0 2024-09-10T05:13:32.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.279+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.279+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x7f21e402e910 2024-09-10T05:13:32.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.280+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4026040 con 0x7f21e402e910 2024-09-10T05:13:32.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.280+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a3004521f0 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.280+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.280+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a300456840 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.280+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.280+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a30045b1f0 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.281+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.281+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a300456840 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.281+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.281+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x7f21e402e910 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.281+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4035040 con 0x7f21e402e910 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.281+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a30045b1f0 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.281+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.281+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x7f21e402e910 2024-09-10T05:13:32.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4035040 con 0x7f21e402e910 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f21f403a040 con 0x55a3004521f0 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f21f403a040 con 0x7f21e402e910 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21f4035040 con 0x7f21e402e910 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21fe017800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21fe017800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21fe017800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21fe017800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21fe017800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21fe017800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21fe017800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a3004521f0 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21fe017800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21fe017800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.282+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x55a3004521f0 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21fe017800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21fe017800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a300455ae0 con 0x7f21e402e910 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f21f4035040 con 0x7f21e402e910 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21fe017800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21fe017800 20 zone default found 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21fe017800 4 Realm: () 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21fe017800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21fe017800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:32.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21fe017800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:32.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21fe017800 20 zonegroup default 2024-09-10T05:13:32.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21fe017800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.283+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a300459780 con 0x55a300456840 2024-09-10T05:13:32.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21fe017800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21fe017800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a30045f670 con 0x55a30045b1f0 2024-09-10T05:13:32.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21fe017800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21fe017800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a30045fa90 con 0x55a30045b1f0 2024-09-10T05:13:32.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21fe017800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21fe017800 20 started sync module instance, tier type = 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21fe017800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.284+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a30045eb00 con 0x7f21e402e910 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.285+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x7f21e402e910 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.285+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94158572613632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a30045eb00 con 0x7f21e402e910 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.285+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3004605a0 con 0x55a3004521f0 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.286+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94158572613632] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x7f21e402e910 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.287+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.287+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94158572617872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a30045eb00 con 0x55a3004521f0 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.287+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300461040 con 0x55a30045b1f0 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.288+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94158572617872] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.288+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.288+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94158572611152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a30045ea70 con 0x55a30045b1f0 2024-09-10T05:13:32.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.288+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300461f30 con 0x7f21e402e910 2024-09-10T05:13:32.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.289+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x7f21e402e910 2024-09-10T05:13:32.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.289+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94158572624992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3004626d0 con 0x7f21e402e910 2024-09-10T05:13:32.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.289+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3004631f0 con 0x55a3004521f0 2024-09-10T05:13:32.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.289+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94158572611152] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.290+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94158572624992] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x7f21e402e910 2024-09-10T05:13:32.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.290+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.290+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94158572629184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3004631b0 con 0x55a3004521f0 2024-09-10T05:13:32.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.290+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300463a90 con 0x55a300456840 2024-09-10T05:13:32.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.292+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94158572629184] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.292+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.292+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94158572631520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3004631b0 con 0x55a300456840 2024-09-10T05:13:32.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.292+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300464490 con 0x55a300456840 2024-09-10T05:13:32.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.293+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.293+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94158572634016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300464ca0 con 0x55a300456840 2024-09-10T05:13:32.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.293+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3004657c0 con 0x55a300456840 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.293+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94158572631520] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.294+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94158572634016] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.294+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.294+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94158572638864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300464710 con 0x55a300456840 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.294+0000 7f21fe017800 20 add_watcher() i=0 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.294+0000 7f21fe017800 20 add_watcher() i=1 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.294+0000 7f21fe017800 20 add_watcher() i=2 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.294+0000 7f21fe017800 20 add_watcher() i=3 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.294+0000 7f21fe017800 20 add_watcher() i=4 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.294+0000 7f21fe017800 20 add_watcher() i=5 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.294+0000 7f21fe017800 20 add_watcher() i=6 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.295+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94158572638864] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.295+0000 7f21fe017800 20 add_watcher() i=7 2024-09-10T05:13:32.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.295+0000 7f21fe017800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:32.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.295+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3004687b0 con 0x55a3004521f0 2024-09-10T05:13:32.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.295+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.296+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94158572622944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300465c70 con 0x55a3004521f0 2024-09-10T05:13:32.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.297+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94158572622944] v37'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.297+0000 7f20af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:32.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.297+0000 7f21fe017800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:32.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.297+0000 7f21fe017800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:32.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.297+0000 7f21fe017800 5 note: GC not initialized 2024-09-10T05:13:32.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.297+0000 7f20ae7e4640 20 reqs_thread_entry: start 2024-09-10T05:13:32.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.297+0000 7f21fe017800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:32.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.297+0000 7f21fe017800 20 Filter name: none 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.297+0000 7f201ffff640 20 reqs_thread_entry: start 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.297+0000 7f21fe017800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.297+0000 7f21fe017800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.297+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a30049b700 con 0x55a3004521f0 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.298+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.298+0000 7f21fe017800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.298+0000 7f21fe017800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.298+0000 7f21fe017800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.298+0000 7f21fe017800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.298+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a30049e030 con 0x55a300456840 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.299+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 usage.10 [call] v37'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.299+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a30049e030 con 0x55a300456840 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.300+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(64 usage.10 [call] v37'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.301+0000 7f20af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:32.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.301+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94158572622944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a30044d2d0 con 0x55a3004521f0 2024-09-10T05:13:32.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.302+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94158572622944] v37'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.302+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94158572613632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300461460 con 0x7f21e402e910 2024-09-10T05:13:32.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.303+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94158572613632] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x7f21e402e910 2024-09-10T05:13:32.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.303+0000 7f21fe017800 20 remove_watcher() i=0 2024-09-10T05:13:32.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.303+0000 7f21fe017800 2 removed watcher, disabling cache 2024-09-10T05:13:32.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.303+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94158572617872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300461460 con 0x55a3004521f0 2024-09-10T05:13:32.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.305+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94158572617872] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.305+0000 7f21fe017800 20 remove_watcher() i=1 2024-09-10T05:13:32.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.305+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94158572611152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300461460 con 0x55a30045b1f0 2024-09-10T05:13:32.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.306+0000 7f21f8fe6640 1 -- 172.21.15.192:0/1404691687 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94158572611152] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e4037040 con 0x55a30045b1f0 2024-09-10T05:13:32.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.306+0000 7f21fe017800 20 remove_watcher() i=2 2024-09-10T05:13:32.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.306+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94158572624992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a30045e650 con 0x7f21e402e910 2024-09-10T05:13:32.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.307+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94158572624992] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x7f21e402e910 2024-09-10T05:13:32.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.307+0000 7f21fe017800 20 remove_watcher() i=3 2024-09-10T05:13:32.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.307+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94158572629184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300461c60 con 0x55a3004521f0 2024-09-10T05:13:32.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.308+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94158572629184] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21f4035040 con 0x55a3004521f0 2024-09-10T05:13:32.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.308+0000 7f21fe017800 20 remove_watcher() i=4 2024-09-10T05:13:32.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.308+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94158572631520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a30045e650 con 0x55a300456840 2024-09-10T05:13:32.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.309+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94158572631520] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.309+0000 7f21fe017800 20 remove_watcher() i=5 2024-09-10T05:13:32.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.309+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94158572634016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300462cc0 con 0x55a300456840 2024-09-10T05:13:32.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.310+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94158572634016] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.310+0000 7f21fe017800 20 remove_watcher() i=6 2024-09-10T05:13:32.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.310+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94158572638864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a300461c60 con 0x55a300456840 2024-09-10T05:13:32.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.311+0000 7f21f97e7640 1 -- 172.21.15.192:0/1404691687 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94158572638864] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec0ba030 con 0x55a300456840 2024-09-10T05:13:32.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.311+0000 7f21fe017800 20 remove_watcher() i=7 2024-09-10T05:13:32.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.311+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a300456840 msgr2=0x55a300458c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.311+0000 7f21fe017800 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a300456840 0x55a300458c30 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.311+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a3004521f0 msgr2=0x55a3004546b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.311+0000 7f21fe017800 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a3004521f0 0x55a3004546b0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.311+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f21e402e910 msgr2=0x7f21e403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.311+0000 7f21fe017800 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f21e402e910 0x7f21e403a3c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.311+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a30045b1f0 msgr2=0x55a30045d6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.311+0000 7f21fe017800 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a30045b1f0 0x55a30045d6b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20c403c730 msgr2=0x7f20c403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20c403c730 0x7f20c403ebf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f21e400ffd0 tx=0x7f21e4023040 comp rx=0 tx=0).stop 2024-09-10T05:13:32.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 msgr2=0x55a300446dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 0x55a300446dc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f21ec05c010 tx=0x7f21ec072f40 comp rx=0 tx=0).stop 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21f9fe8640 1 -- 172.21.15.192:0/1404691687 reap_dead start 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 shutdown_connections 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 --2- 172.21.15.192:0/1404691687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30043f970 0x55a300446dc0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 >> 172.21.15.192:0/1404691687 conn(0x55a30043bd70 msgr2=0x55a300439f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 shutdown_connections 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/1404691687 wait complete. 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/2994581932 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20d403c730 msgr2=0x7f20d403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 --2- 172.21.15.192:0/2994581932 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20d403c730 0x7f20d403ebf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55a30041cba0 tx=0x7f21e4006000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/2994581932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a300433090 msgr2=0x55a3004334b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 --2- 172.21.15.192:0/2994581932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a300433090 0x55a3004334b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f21ec056fd0 tx=0x7f21ec06cf60 comp rx=0 tx=0).stop 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/2994581932 shutdown_connections 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 --2- 172.21.15.192:0/2994581932 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20d403c730 0x7f20d403ebf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 --2- 172.21.15.192:0/2994581932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a300433090 0x55a3004334b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/2994581932 >> 172.21.15.192:0/2994581932 conn(0x55a300427440 msgr2=0x55a300427820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/2994581932 shutdown_connections 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/2994581932 wait complete. 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a30041ea00 msgr2=0x55a300420df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a30041ea00 0x55a300420df0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a30031f010 msgr2=0x55a30041c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a30031f010 0x55a30041c1d0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a300422940 msgr2=0x55a300424d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.312+0000 7f21fe017800 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a300422940 0x55a300424d30 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.313+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20e003c730 msgr2=0x7f20e003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.313+0000 7f21fe017800 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f20e003c730 0x7f20e003ebf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f21e4000c00 tx=0x7f21e40013b0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.313+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 msgr2=0x55a30031bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.313+0000 7f21fe017800 1 --2- 172.21.15.192:0/3221931556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a30031c5f0 0x55a30031bd10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00a190 tx=0x7f21ec003330 comp rx=0 tx=0).stop 2024-09-10T05:13:32.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.313+0000 7f21f9fe8640 1 -- 172.21.15.192:0/3221931556 reap_dead start 2024-09-10T05:13:32.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.313+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 shutdown_connections 2024-09-10T05:13:32.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.313+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 >> 172.21.15.192:0/3221931556 conn(0x55a3003161b0 msgr2=0x55a300405630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.313+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 shutdown_connections 2024-09-10T05:13:32.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.313+0000 7f21fe017800 1 -- 172.21.15.192:0/3221931556 wait complete. 2024-09-10T05:13:32.322 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-10T05:13:32.322 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-10T05:13:32.323 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-10T05:13:32.368 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:32.368 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:32.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.368+0000 7faa08128800 1 Processor -- start 2024-09-10T05:13:32.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.368+0000 7faa08128800 1 -- start start 2024-09-10T05:13:32.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.368+0000 7faa08128800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x560850492200 0x5608504946c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.368+0000 7faa08128800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560850337e40 con 0x56085048e690 2024-09-10T05:13:32.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.368+0000 7faa08128800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x560850302680 con 0x560850492200 2024-09-10T05:13:32.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.368+0000 7fa9fb55c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x560850492200 0x5608504946c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.368+0000 7faa03d5d640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x56085048e690 0x560850490a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46470/0 (socket says 172.21.15.192:46470) 2024-09-10T05:13:32.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.368+0000 7faa03d5d640 1 -- 172.21.15.192:0/4167672287 learned_addr learned my addr 172.21.15.192:0/4167672287 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:32.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.368+0000 7faa0355c640 1 -- 172.21.15.192:0/4167672287 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092146925 0 0) 0x560850337e40 con 0x56085048e690 2024-09-10T05:13:32.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.368+0000 7faa0355c640 1 -- 172.21.15.192:0/4167672287 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9f0001e10 con 0x56085048e690 2024-09-10T05:13:32.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.369+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4167672287 >> v1:172.21.15.139:6789/0 conn(0x56085048e690 legacy=0x560850490a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.369+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4167672287 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56085031e6b0 con 0x560850492200 2024-09-10T05:13:32.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.370+0000 7fa9fb55c640 1 --2- 172.21.15.192:0/4167672287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560850492200 0x5608504946c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00a470 tx=0x7fa9ec045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6f64a24cb3a5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.370+0000 7faa0355c640 1 -- 172.21.15.192:0/4167672287 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec059070 con 0x560850492200 2024-09-10T05:13:32.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.370+0000 7faa0355c640 1 -- 172.21.15.192:0/4167672287 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec054570 con 0x560850492200 2024-09-10T05:13:32.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.370+0000 7faa0355c640 1 -- 172.21.15.192:0/4167672287 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec054870 con 0x560850492200 2024-09-10T05:13:32.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.371+0000 7faa08128800 1 -- 172.21.15.192:0/4167672287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560850492200 msgr2=0x5608504946c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.371+0000 7faa08128800 1 --2- 172.21.15.192:0/4167672287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560850492200 0x5608504946c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00a470 tx=0x7fa9ec045920 comp rx=0 tx=0).stop 2024-09-10T05:13:32.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.371+0000 7faa08128800 1 -- 172.21.15.192:0/4167672287 shutdown_connections 2024-09-10T05:13:32.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.371+0000 7faa08128800 1 --2- 172.21.15.192:0/4167672287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560850492200 0x5608504946c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.371+0000 7faa08128800 1 -- 172.21.15.192:0/4167672287 >> 172.21.15.192:0/4167672287 conn(0x5608504881f0 msgr2=0x56085048a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.371+0000 7faa08128800 1 -- 172.21.15.192:0/4167672287 shutdown_connections 2024-09-10T05:13:32.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.371+0000 7faa08128800 1 -- 172.21.15.192:0/4167672287 wait complete. 2024-09-10T05:13:32.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.385+0000 7faa08128800 1 Processor -- start 2024-09-10T05:13:32.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.385+0000 7faa08128800 1 -- start start 2024-09-10T05:13:32.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.385+0000 7faa08128800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 0x56085057d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.385+0000 7faa08128800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560850326dd0 con 0x56085048e690 2024-09-10T05:13:32.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.385+0000 7faa03d5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 0x56085057d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.385+0000 7faa03d5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 0x56085057d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33262/0 (socket says 172.21.15.192:33262) 2024-09-10T05:13:32.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.385+0000 7faa03d5d640 1 -- 172.21.15.192:0/2431511630 learned_addr learned my addr 172.21.15.192:0/2431511630 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.386+0000 7faa03d5d640 1 -- 172.21.15.192:0/2431511630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56085033fe10 con 0x56085048e690 2024-09-10T05:13:32.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.386+0000 7faa03d5d640 1 --2- 172.21.15.192:0/2431511630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 0x56085057d4b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4001e30 tx=0x7fa9f400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b668631427dde server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.386+0000 7fa8f1e0b640 1 -- 172.21.15.192:0/2431511630 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f4012020 con 0x56085048e690 2024-09-10T05:13:32.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.386+0000 7fa8f1e0b640 1 -- 172.21.15.192:0/2431511630 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f400e470 con 0x56085048e690 2024-09-10T05:13:32.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.386+0000 7fa8f1e0b640 1 -- 172.21.15.192:0/2431511630 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f400e790 con 0x56085048e690 2024-09-10T05:13:32.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa08128800 1 -- 172.21.15.192:0/2431511630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 msgr2=0x56085057d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa08128800 1 --2- 172.21.15.192:0/2431511630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 0x56085057d4b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4001e30 tx=0x7fa9f400b780 comp rx=0 tx=0).stop 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa08128800 1 -- 172.21.15.192:0/2431511630 shutdown_connections 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa08128800 1 --2- 172.21.15.192:0/2431511630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 0x56085057d4b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa08128800 1 -- 172.21.15.192:0/2431511630 >> 172.21.15.192:0/2431511630 conn(0x5608504881f0 msgr2=0x560850578e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa08128800 1 -- 172.21.15.192:0/2431511630 shutdown_connections 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa08128800 1 -- 172.21.15.192:0/2431511630 wait complete. 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa08128800 1 Processor -- start 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa08128800 1 -- start start 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa08128800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 0x560850584de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa08128800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560850495040 con 0x56085048e690 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa03d5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 0x560850584de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa03d5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 0x560850584de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33274/0 (socket says 172.21.15.192:33274) 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.387+0000 7faa03d5d640 1 -- 172.21.15.192:0/2689420164 learned_addr learned my addr 172.21.15.192:0/2689420164 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.388+0000 7faa03d5d640 1 -- 172.21.15.192:0/2689420164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560850585340 con 0x56085048e690 2024-09-10T05:13:32.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.388+0000 7faa03d5d640 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 0x560850584de0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4000c00 tx=0x7fa9f40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.388+0000 7fa8ebfff640 1 -- 172.21.15.192:0/2689420164 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f4012030 con 0x56085048e690 2024-09-10T05:13:32.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.388+0000 7fa8ebfff640 1 -- 172.21.15.192:0/2689420164 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f401a4d0 con 0x56085048e690 2024-09-10T05:13:32.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.388+0000 7fa8ebfff640 1 -- 172.21.15.192:0/2689420164 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f401a7f0 con 0x56085048e690 2024-09-10T05:13:32.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.388+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608505855d0 con 0x56085048e690 2024-09-10T05:13:32.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.388+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560850585fd0 con 0x56085048e690 2024-09-10T05:13:32.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.389+0000 7fa8ebfff640 1 -- 172.21.15.192:0/2689420164 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa9f4015020 con 0x56085048e690 2024-09-10T05:13:32.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.389+0000 7fa8ebfff640 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8ec03c780 0x7fa8ec03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.389+0000 7fa8ebfff640 1 -- 172.21.15.192:0/2689420164 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fa9f4020070 con 0x56085048e690 2024-09-10T05:13:32.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.389+0000 7fa9fb55c640 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8ec03c780 0x7fa8ec03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.389+0000 7faa08128800 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560850492200 0x56085058c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.389+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56085058c970 con 0x560850492200 2024-09-10T05:13:32.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.390+0000 7faa0455e640 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560850492200 0x56085058c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.390+0000 7fa9fb55c640 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8ec03c780 0x7fa8ec03ec40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x560850400ce0 tx=0x7fa9ec050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.390+0000 7faa0455e640 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560850492200 0x56085058c430 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.390+0000 7faa0455e640 1 -- 172.21.15.192:0/2689420164 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x560850492200 2024-09-10T05:13:32.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.390+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56085058cd10 con 0x560850492200 2024-09-10T05:13:32.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.390+0000 7faa0455e640 1 -- 172.21.15.192:0/2689420164 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x560850492200 2024-09-10T05:13:32.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.390+0000 7faa08128800 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56085058e7d0 0x560850590c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.390+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505913e0 con 0x56085058e7d0 2024-09-10T05:13:32.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.391+0000 7faa03d5d640 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56085058e7d0 0x560850590c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.391+0000 7faa03d5d640 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56085058e7d0 0x560850590c50 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.391+0000 7faa03d5d640 1 -- 172.21.15.192:0/2689420164 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa9f40247e0 con 0x56085058e7d0 2024-09-10T05:13:32.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.391+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56085058d560 con 0x560850492200 2024-09-10T05:13:32.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.392+0000 7faa0455e640 1 -- 172.21.15.192:0/2689420164 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x560850492200 2024-09-10T05:13:32.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.392+0000 7faa08128800 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560850592840 0x560850594c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.392+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560850595370 con 0x560850592840 2024-09-10T05:13:32.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.392+0000 7fa9fb55c640 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560850592840 0x560850594c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.392+0000 7fa9fb55c640 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560850592840 0x560850594c30 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.392+0000 7fa9fb55c640 1 -- 172.21.15.192:0/2689420164 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9ec061430 con 0x560850592840 2024-09-10T05:13:32.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.393+0000 7faa08128800 1 Processor -- start 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.393+0000 7faa08128800 1 -- start start 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.393+0000 7faa08128800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505a2fb0 0x5608505a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.393+0000 7faa08128800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560850384a00 con 0x5608505a2fb0 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.393+0000 7faa03d5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505a2fb0 0x5608505a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.393+0000 7faa03d5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505a2fb0 0x5608505a33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33278/0 (socket says 172.21.15.192:33278) 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.393+0000 7faa03d5d640 1 -- 172.21.15.192:0/331621884 learned_addr learned my addr 172.21.15.192:0/331621884 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.393+0000 7faa03d5d640 1 -- 172.21.15.192:0/331621884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608505a3a10 con 0x5608505a2fb0 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.394+0000 7faa03d5d640 1 --2- 172.21.15.192:0/331621884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505a2fb0 0x5608505a33d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40520a0 tx=0x7fa9f404b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.394+0000 7fa8e97fa640 1 -- 172.21.15.192:0/331621884 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f4016cc0 con 0x5608505a2fb0 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.394+0000 7fa8e97fa640 1 -- 172.21.15.192:0/331621884 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f401ac80 con 0x5608505a2fb0 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.394+0000 7fa8e97fa640 1 -- 172.21.15.192:0/331621884 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f402d610 con 0x5608505a2fb0 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.394+0000 7faa08128800 1 -- 172.21.15.192:0/331621884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608505a4240 con 0x5608505a2fb0 2024-09-10T05:13:32.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.394+0000 7faa08128800 1 -- 172.21.15.192:0/331621884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608505a47e0 con 0x5608505a2fb0 2024-09-10T05:13:32.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.394+0000 7fa8e97fa640 1 -- 172.21.15.192:0/331621884 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa9f402d9c0 con 0x5608505a2fb0 2024-09-10T05:13:32.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.395+0000 7fa8e97fa640 1 --2- 172.21.15.192:0/331621884 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8dc03c730 0x7fa8dc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.395+0000 7fa8e97fa640 1 -- 172.21.15.192:0/331621884 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fa9f4036d00 con 0x5608505a2fb0 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.395+0000 7fa9fb55c640 1 --2- 172.21.15.192:0/331621884 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8dc03c730 0x7fa8dc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.395+0000 7faa08128800 1 Processor -- start 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.395+0000 7faa08128800 1 -- start start 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.395+0000 7fa9fb55c640 1 --2- 172.21.15.192:0/331621884 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8dc03c730 0x7fa8dc03ebf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x560850586ec0 tx=0x7fa9ec005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.395+0000 7faa08128800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 0x5608505afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.395+0000 7faa08128800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56085057dd00 con 0x5608505af8f0 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.395+0000 7faa03d5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 0x5608505afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.395+0000 7faa03d5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 0x5608505afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33290/0 (socket says 172.21.15.192:33290) 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.395+0000 7faa03d5d640 1 -- 172.21.15.192:0/1516759185 learned_addr learned my addr 172.21.15.192:0/1516759185 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.396+0000 7faa03d5d640 1 -- 172.21.15.192:0/1516759185 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608505b02c0 con 0x5608505af8f0 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.396+0000 7faa03d5d640 1 --2- 172.21.15.192:0/1516759185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 0x5608505afcd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4001590 tx=0x7fa9f4017ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c442196e8e248e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.396+0000 7fa8e2ffd640 1 -- 172.21.15.192:0/1516759185 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f4048d00 con 0x5608505af8f0 2024-09-10T05:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.396+0000 7fa8e2ffd640 1 -- 172.21.15.192:0/1516759185 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f4064070 con 0x5608505af8f0 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.396+0000 7fa8e2ffd640 1 -- 172.21.15.192:0/1516759185 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f404f570 con 0x5608505af8f0 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa08128800 1 -- 172.21.15.192:0/1516759185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 msgr2=0x5608505afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa08128800 1 --2- 172.21.15.192:0/1516759185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 0x5608505afcd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4001590 tx=0x7fa9f4017ed0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa08128800 1 -- 172.21.15.192:0/1516759185 shutdown_connections 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa08128800 1 --2- 172.21.15.192:0/1516759185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 0x5608505afcd0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa08128800 1 -- 172.21.15.192:0/1516759185 >> 172.21.15.192:0/1516759185 conn(0x5608505abcf0 msgr2=0x5608505a9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa08128800 1 -- 172.21.15.192:0/1516759185 shutdown_connections 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa08128800 1 -- 172.21.15.192:0/1516759185 wait complete. 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa08128800 1 Processor -- start 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa08128800 1 -- start start 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa08128800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 0x5608505b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa08128800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5608505b0750 con 0x5608505af8f0 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa03d5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 0x5608505b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa03d5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 0x5608505b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33300/0 (socket says 172.21.15.192:33300) 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.397+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 learned_addr learned my addr 172.21.15.192:0/4120152873 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.398+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608505b7230 con 0x5608505af8f0 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.398+0000 7faa03d5d640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 0x5608505b6cd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4001590 tx=0x7fa9f4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.398+0000 7fa8e17fa640 1 -- 172.21.15.192:0/4120152873 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f4050050 con 0x5608505af8f0 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.398+0000 7fa8e17fa640 1 -- 172.21.15.192:0/4120152873 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f40501f0 con 0x5608505af8f0 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.398+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608505b7230 con 0x5608505af8f0 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.398+0000 7fa8e17fa640 1 -- 172.21.15.192:0/4120152873 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f40478f0 con 0x5608505af8f0 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.398+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608505b7230 con 0x5608505af8f0 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.399+0000 7fa8e17fa640 1 -- 172.21.15.192:0/4120152873 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa9f4079060 con 0x5608505af8f0 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.399+0000 7fa8e17fa640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8cc03c730 0x7fa8cc03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.399+0000 7fa8e17fa640 1 -- 172.21.15.192:0/4120152873 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fa9f407cd10 con 0x5608505af8f0 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.399+0000 7fa9fb55c640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8cc03c730 0x7fa8cc03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.399+0000 7faa08128800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.399+0000 7faa08128800 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5608505c2150 0x5608505c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.399+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505c4d60 con 0x5608505c2150 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7faa0455e640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5608505c2150 0x5608505c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7fa9fb55c640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8cc03c730 0x7fa8cc03ebf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00a470 tx=0x7fa9ec051000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7faa0455e640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5608505c2150 0x5608505c4610 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7faa08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7faa08128800 20 realm 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7faa08128800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5170 con 0x5608505c2150 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7faa08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7faa08128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7faa08128800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.400+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5a40 con 0x5608505c2150 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.401+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.401+0000 7faa08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.401+0000 7faa08128800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.401+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c2150 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.401+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.401+0000 7faa08128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.401+0000 7faa08128800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.401+0000 7faa08128800 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5608505c68d0 0x5608505c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.401+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505c9400 con 0x5608505c68d0 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.401+0000 7faa03d5d640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5608505c68d0 0x5608505c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.402+0000 7faa03d5d640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5608505c68d0 0x5608505c8cc0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.402+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.402+0000 7faa08128800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.402+0000 7faa08128800 20 searching for the correct realm 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.402+0000 7faa08128800 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5608505cb4a0 0x5608505cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.402+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505ce030 con 0x5608505cb4a0 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.402+0000 7fa9fb55c640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5608505cb4a0 0x5608505cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.402+0000 7fa9fb55c640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5608505cb4a0 0x5608505cd960 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.403+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.403+0000 7fa9fb55c640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa9ec087040 0x7fa9ec078940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.403+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505ce030 con 0x7fa9ec087040 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.403+0000 7faa0455e640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa9ec087040 0x7fa9ec078940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.403+0000 7faa0455e640 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa9ec087040 0x7fa9ec078940 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.403+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.403+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c68d0 2024-09-10T05:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.404+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.404+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c2150 2024-09-10T05:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.404+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.404+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c2150 2024-09-10T05:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.404+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.404+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c68d0 2024-09-10T05:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.404+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.404+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c68d0 2024-09-10T05:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.405+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.405+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x7fa9ec087040 2024-09-10T05:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.405+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.405+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505cb4a0 2024-09-10T05:13:32.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.405+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.405+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c2150 2024-09-10T05:13:32.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.405+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.405+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c68d0 2024-09-10T05:13:32.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.406+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.406+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c2150 2024-09-10T05:13:32.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.406+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.406+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x7fa9ec087040 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.406+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.406+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505cb4a0 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.406+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.406+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505cb4a0 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.406+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.406+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c68d0 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.407+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.407+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505cb4a0 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.407+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.407+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505cb4a0 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.407+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.407+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c2150 2024-09-10T05:13:32.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.407+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.407+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c2150 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.408+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.408+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x7fa9ec087040 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.408+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.408+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505cb4a0 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.408+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.408+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x7fa9ec087040 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.408+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.408+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c2150 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.408+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.408+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c68d0 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.409+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.409+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505cb4a0 2024-09-10T05:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.409+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.409+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c68d0 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.409+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.409+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x7fa9ec087040 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.410+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.410+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505cb4a0 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.410+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.410+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x7fa9ec087040 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.410+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.410+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x5608505c2150 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.410+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.410+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5608505c5de0 con 0x7fa9ec087040 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505c9da0 con 0x5608505c2150 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505c9da0 con 0x5608505c2150 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505c9d70 con 0x7fa9ec087040 2024-09-10T05:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 zone default found 2024-09-10T05:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 4 Realm: () 2024-09-10T05:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 zonegroup default 2024-09-10T05:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.411+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505ca190 con 0x5608505c68d0 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7faa08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7faa08128800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505c9d90 con 0x5608505cb4a0 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7faa08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7faa08128800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505cfea0 con 0x5608505cb4a0 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7faa08128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7faa08128800 20 started sync module instance, tier type = 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7faa08128800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.412+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505cf340 con 0x7fa9ec087040 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.413+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.413+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94593707997296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505cf340 con 0x7fa9ec087040 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.413+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d0970 con 0x5608505c2150 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.414+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94593707997296] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.414+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.414+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94593708000336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505cf340 con 0x5608505c2150 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.414+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d1410 con 0x5608505cb4a0 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.416+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94593708000336] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.416+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.416+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94593707994768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505cf2b0 con 0x5608505cb4a0 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.416+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d22d0 con 0x7fa9ec087040 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.417+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94593707994768] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.417+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.417+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94593708006944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d26f0 con 0x7fa9ec087040 2024-09-10T05:13:32.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.417+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d30b0 con 0x5608505c2150 2024-09-10T05:13:32.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.418+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94593708006944] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.418+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.418+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94593708008480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d30b0 con 0x5608505c2150 2024-09-10T05:13:32.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.418+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d3a70 con 0x5608505c68d0 2024-09-10T05:13:32.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.419+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.419+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94593708012992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d42c0 con 0x5608505c68d0 2024-09-10T05:13:32.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.419+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d4d40 con 0x5608505c68d0 2024-09-10T05:13:32.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.419+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94593708008480] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.422+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94593708012992] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.422+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.422+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94593708017712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d5130 con 0x5608505c68d0 2024-09-10T05:13:32.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.422+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d5980 con 0x5608505c68d0 2024-09-10T05:13:32.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.423+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94593708017712] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.423+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.423+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94593708020944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d5da0 con 0x5608505c68d0 2024-09-10T05:13:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.423+0000 7faa08128800 20 add_watcher() i=0 2024-09-10T05:13:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.423+0000 7faa08128800 20 add_watcher() i=1 2024-09-10T05:13:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.423+0000 7faa08128800 20 add_watcher() i=2 2024-09-10T05:13:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.423+0000 7faa08128800 20 add_watcher() i=3 2024-09-10T05:13:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.423+0000 7faa08128800 20 add_watcher() i=4 2024-09-10T05:13:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.423+0000 7faa08128800 20 add_watcher() i=5 2024-09-10T05:13:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.423+0000 7faa08128800 20 add_watcher() i=6 2024-09-10T05:13:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.425+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94593708020944] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.425+0000 7faa08128800 20 add_watcher() i=7 2024-09-10T05:13:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.425+0000 7faa08128800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.425+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5608505d90d0 con 0x5608505c2150 2024-09-10T05:13:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.425+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.425+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94593708022368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d6330 con 0x5608505c2150 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.426+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94593708022368] v37'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.426+0000 7fa8b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.426+0000 7faa08128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.426+0000 7faa08128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.427+0000 7faa08128800 5 note: GC not initialized 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.427+0000 7fa8b8fe1640 20 reqs_thread_entry: start 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.427+0000 7faa08128800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.427+0000 7faa08128800 20 Filter name: none 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.427+0000 7fa8327fc640 20 reqs_thread_entry: start 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.427+0000 7faa08128800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.427+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56085060bd60 con 0x5608505c2150 2024-09-10T05:13:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.427+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.427+0000 7faa08128800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.427+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56085060d180 con 0x5608505c68d0 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.428+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.429+0000 7fa8b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.429+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94593708022368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505bf360 con 0x5608505c2150 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.430+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94593708022368] v37'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.430+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94593707997296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d5a60 con 0x7fa9ec087040 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.431+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94593707997296] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.431+0000 7faa08128800 20 remove_watcher() i=0 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.431+0000 7faa08128800 2 removed watcher, disabling cache 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.431+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94593708000336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d5a60 con 0x5608505c2150 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.432+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94593708000336] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.432+0000 7faa08128800 20 remove_watcher() i=1 2024-09-10T05:13:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.432+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94593707994768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d0450 con 0x5608505cb4a0 2024-09-10T05:13:32.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.433+0000 7fa9fb55c640 1 -- 172.21.15.192:0/4120152873 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94593707994768] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec075070 con 0x5608505cb4a0 2024-09-10T05:13:32.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.433+0000 7faa08128800 20 remove_watcher() i=2 2024-09-10T05:13:32.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.433+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94593708006944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d5a60 con 0x7fa9ec087040 2024-09-10T05:13:32.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.434+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94593708006944] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x7fa9ec087040 2024-09-10T05:13:32.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.434+0000 7faa08128800 20 remove_watcher() i=3 2024-09-10T05:13:32.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.434+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94593708008480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505cee90 con 0x5608505c2150 2024-09-10T05:13:32.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.435+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94593708008480] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc00a4d0 con 0x5608505c2150 2024-09-10T05:13:32.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.435+0000 7faa08128800 20 remove_watcher() i=4 2024-09-10T05:13:32.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.435+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94593708012992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d1e20 con 0x5608505c68d0 2024-09-10T05:13:32.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.436+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94593708012992] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.436+0000 7faa08128800 20 remove_watcher() i=5 2024-09-10T05:13:32.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.436+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94593708017712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505d2420 con 0x5608505c68d0 2024-09-10T05:13:32.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.437+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94593708017712] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.437+0000 7faa08128800 20 remove_watcher() i=6 2024-09-10T05:13:32.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.437+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94593708020944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5608505cee90 con 0x5608505c68d0 2024-09-10T05:13:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.438+0000 7faa03d5d640 1 -- 172.21.15.192:0/4120152873 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94593708020944] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f4084040 con 0x5608505c68d0 2024-09-10T05:13:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.438+0000 7faa08128800 20 remove_watcher() i=7 2024-09-10T05:13:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.438+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5608505c68d0 msgr2=0x5608505c8cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.438+0000 7faa08128800 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5608505c68d0 0x5608505c8cc0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.438+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5608505c2150 msgr2=0x5608505c4610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.438+0000 7faa08128800 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5608505c2150 0x5608505c4610 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.438+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa9ec087040 msgr2=0x7fa9ec078940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.438+0000 7faa08128800 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fa9ec087040 0x7fa9ec078940 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.438+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5608505cb4a0 msgr2=0x5608505cd960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.438+0000 7faa08128800 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5608505cb4a0 0x5608505cd960 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8cc03c730 msgr2=0x7fa8cc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8cc03c730 0x7fa8cc03ebf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00a470 tx=0x7fa9ec051000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 msgr2=0x5608505b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 --2- 172.21.15.192:0/4120152873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505af8f0 0x5608505b6cd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4001590 tx=0x7fa9f4021000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 reap_dead start 2024-09-10T05:13:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa0455e640 1 -- 172.21.15.192:0/4120152873 reap_dead start 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 shutdown_connections 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 >> 172.21.15.192:0/4120152873 conn(0x5608505abcf0 msgr2=0x5608505a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 shutdown_connections 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/4120152873 wait complete. 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/331621884 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8dc03c730 msgr2=0x7fa8dc03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 --2- 172.21.15.192:0/331621884 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8dc03c730 0x7fa8dc03ebf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x560850586ec0 tx=0x7fa9ec005a00 comp rx=0 tx=0).stop 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/331621884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505a2fb0 msgr2=0x5608505a33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 --2- 172.21.15.192:0/331621884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505a2fb0 0x5608505a33d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40520a0 tx=0x7fa9f404b310 comp rx=0 tx=0).stop 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/331621884 shutdown_connections 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 --2- 172.21.15.192:0/331621884 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8dc03c730 0x7fa8dc03ebf0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 --2- 172.21.15.192:0/331621884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608505a2fb0 0x5608505a33d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/331621884 >> 172.21.15.192:0/331621884 conn(0x560850597360 msgr2=0x560850597740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/331621884 shutdown_connections 2024-09-10T05:13:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/331621884 wait complete. 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56085058e7d0 msgr2=0x560850590c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56085058e7d0 0x560850590c50 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560850492200 msgr2=0x56085058c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560850492200 0x56085058c430 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560850592840 msgr2=0x560850594c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.439+0000 7faa08128800 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560850592840 0x560850594c30 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.440+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8ec03c780 msgr2=0x7fa8ec03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.440+0000 7faa08128800 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa8ec03c780 0x7fa8ec03ec40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x560850400ce0 tx=0x7fa9ec050000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.440+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 msgr2=0x560850584de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.440+0000 7faa08128800 1 --2- 172.21.15.192:0/2689420164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56085048e690 0x560850584de0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4000c00 tx=0x7fa9f40040e0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.440+0000 7faa0455e640 1 -- 172.21.15.192:0/2689420164 reap_dead start 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.440+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 shutdown_connections 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.440+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 >> 172.21.15.192:0/2689420164 conn(0x5608504881f0 msgr2=0x56085057e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.440+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 shutdown_connections 2024-09-10T05:13:32.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.440+0000 7faa08128800 1 -- 172.21.15.192:0/2689420164 wait complete. 2024-09-10T05:13:32.449 INFO:teuthology.orchestra.run.smithi192.stdout:{"entries":[],"summary":[]} 2024-09-10T05:13:32.449 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-10T05:13:32.449 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-10T05:13:32.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-10T05:13:32.450 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-10T05:13:32.495 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:32.495 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:32.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.495+0000 7fe4bb944800 1 Processor -- start 2024-09-10T05:13:32.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.495+0000 7fe4bb944800 1 -- start start 2024-09-10T05:13:32.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.495+0000 7fe4bb944800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55fced0c4e00 0x55fced0c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.495+0000 7fe4bb944800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fcecf6fe40 con 0x55fced0c6040 2024-09-10T05:13:32.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.495+0000 7fe4bb944800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55fcecf3a680 con 0x55fced0c4e00 2024-09-10T05:13:32.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.496+0000 7fe4b76f4640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55fced0c4e00 0x55fced0c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.496+0000 7fe4aeef3640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55fced0c6040 0x55fced0cada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46478/0 (socket says 172.21.15.192:46478) 2024-09-10T05:13:32.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.496+0000 7fe4aeef3640 1 -- 172.21.15.192:0/518514837 learned_addr learned my addr 172.21.15.192:0/518514837 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:32.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.496+0000 7fe4b76f4640 1 -- 172.21.15.192:0/518514837 >> v1:172.21.15.139:6789/0 conn(0x55fced0c6040 legacy=0x55fced0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.496+0000 7fe4b76f4640 1 -- 172.21.15.192:0/518514837 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcecf566b0 con 0x55fced0c4e00 2024-09-10T05:13:32.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.498+0000 7fe4b76f4640 1 --2- 172.21.15.192:0/518514837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced0c5b00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800a470 tx=0x7fe4a8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda404a57fcd7c2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.498+0000 7fe4b6ef3640 1 -- 172.21.15.192:0/518514837 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8053570 con 0x55fced0c4e00 2024-09-10T05:13:32.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.498+0000 7fe4b6ef3640 1 -- 172.21.15.192:0/518514837 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a8058070 con 0x55fced0c4e00 2024-09-10T05:13:32.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.498+0000 7fe4b6ef3640 1 -- 172.21.15.192:0/518514837 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8053880 con 0x55fced0c4e00 2024-09-10T05:13:32.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.498+0000 7fe4bb944800 1 -- 172.21.15.192:0/518514837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 msgr2=0x55fced0c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.498+0000 7fe4bb944800 1 --2- 172.21.15.192:0/518514837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced0c5b00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800a470 tx=0x7fe4a8045a20 comp rx=0 tx=0).stop 2024-09-10T05:13:32.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.498+0000 7fe4bb944800 1 -- 172.21.15.192:0/518514837 shutdown_connections 2024-09-10T05:13:32.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.498+0000 7fe4bb944800 1 --2- 172.21.15.192:0/518514837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced0c5b00 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.498+0000 7fe4bb944800 1 -- 172.21.15.192:0/518514837 >> 172.21.15.192:0/518514837 conn(0x55fced0c01d0 msgr2=0x55fced0c2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.498+0000 7fe4bb944800 1 -- 172.21.15.192:0/518514837 shutdown_connections 2024-09-10T05:13:32.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.498+0000 7fe4bb944800 1 -- 172.21.15.192:0/518514837 wait complete. 2024-09-10T05:13:32.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.512+0000 7fe4bb944800 1 Processor -- start 2024-09-10T05:13:32.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.512+0000 7fe4bb944800 1 -- start start 2024-09-10T05:13:32.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.512+0000 7fe4bb944800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced038d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.512+0000 7fe4bb944800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fcecf5edd0 con 0x55fced0c4e00 2024-09-10T05:13:32.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.513+0000 7fe4b76f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.513+0000 7fe4b76f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced038d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33322/0 (socket says 172.21.15.192:33322) 2024-09-10T05:13:32.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.513+0000 7fe4b76f4640 1 -- 172.21.15.192:0/4071233068 learned_addr learned my addr 172.21.15.192:0/4071233068 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.513+0000 7fe4b76f4640 1 -- 172.21.15.192:0/4071233068 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcecf77e10 con 0x55fced0c4e00 2024-09-10T05:13:32.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.513+0000 7fe4b76f4640 1 --2- 172.21.15.192:0/4071233068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced038d00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8025c20 tx=0x7fe4a8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e1eb86f8d6f2ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.513+0000 7fe3a560a640 1 -- 172.21.15.192:0/4071233068 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8053a20 con 0x55fced0c4e00 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.513+0000 7fe3a560a640 1 -- 172.21.15.192:0/4071233068 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a8063070 con 0x55fced0c4e00 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.513+0000 7fe3a560a640 1 -- 172.21.15.192:0/4071233068 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8053cf0 con 0x55fced0c4e00 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.514+0000 7fe4bb944800 1 -- 172.21.15.192:0/4071233068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 msgr2=0x55fced038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.514+0000 7fe4bb944800 1 --2- 172.21.15.192:0/4071233068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced038d00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8025c20 tx=0x7fe4a8051000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.514+0000 7fe4bb944800 1 -- 172.21.15.192:0/4071233068 shutdown_connections 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.514+0000 7fe4bb944800 1 --2- 172.21.15.192:0/4071233068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced038d00 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.514+0000 7fe4bb944800 1 -- 172.21.15.192:0/4071233068 >> 172.21.15.192:0/4071233068 conn(0x55fced0c01d0 msgr2=0x55fced1afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.514+0000 7fe4bb944800 1 -- 172.21.15.192:0/4071233068 shutdown_connections 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.514+0000 7fe4bb944800 1 -- 172.21.15.192:0/4071233068 wait complete. 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.514+0000 7fe4bb944800 1 Processor -- start 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.515+0000 7fe4bb944800 1 -- start start 2024-09-10T05:13:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.515+0000 7fe4bb944800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced1bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.515+0000 7fe4bb944800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fced0c6730 con 0x55fced0c4e00 2024-09-10T05:13:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.515+0000 7fe4b76f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced1bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.515+0000 7fe4b76f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced1bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33330/0 (socket says 172.21.15.192:33330) 2024-09-10T05:13:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.515+0000 7fe4b76f4640 1 -- 172.21.15.192:0/3743351317 learned_addr learned my addr 172.21.15.192:0/3743351317 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.515+0000 7fe4b76f4640 1 -- 172.21.15.192:0/3743351317 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fced1bf690 con 0x55fced0c4e00 2024-09-10T05:13:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.515+0000 7fe4b76f4640 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced1bf130 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8025c20 tx=0x7fe4a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.516+0000 7fe3a3e07640 1 -- 172.21.15.192:0/3743351317 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8068660 con 0x55fced0c4e00 2024-09-10T05:13:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.516+0000 7fe3a3e07640 1 -- 172.21.15.192:0/3743351317 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a8068800 con 0x55fced0c4e00 2024-09-10T05:13:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.516+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fced1bf920 con 0x55fced0c4e00 2024-09-10T05:13:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.516+0000 7fe3a3e07640 1 -- 172.21.15.192:0/3743351317 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8068ae0 con 0x55fced0c4e00 2024-09-10T05:13:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.516+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fced1c0530 con 0x55fced0c4e00 2024-09-10T05:13:32.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.516+0000 7fe3a3e07640 1 -- 172.21.15.192:0/3743351317 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe4a8068c80 con 0x55fced0c4e00 2024-09-10T05:13:32.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.517+0000 7fe3a3e07640 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39c03c730 0x7fe39c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.517+0000 7fe3a3e07640 1 -- 172.21.15.192:0/3743351317 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe4a80983a0 con 0x55fced0c4e00 2024-09-10T05:13:32.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.517+0000 7fe4aeef3640 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39c03c730 0x7fe39c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.517+0000 7fe4bb944800 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fced0c6040 0x55fced1c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.517+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced1c6cc0 con 0x55fced0c6040 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.517+0000 7fe4b7ef5640 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fced0c6040 0x55fced1c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.517+0000 7fe4aeef3640 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39c03c730 0x7fe39c03ebf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0001d70 tx=0x7fe4a00012d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.517+0000 7fe4b7ef5640 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fced0c6040 0x55fced1c6780 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.518+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/3743351317 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced0c6040 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.518+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced1c7060 con 0x55fced0c6040 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.518+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/3743351317 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced0c6040 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.518+0000 7fe4bb944800 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fced1c8b20 0x55fced1cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.518+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced1cb750 con 0x55fced1c8b20 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.518+0000 7fe4b76f4640 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fced1c8b20 0x55fced1cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.518+0000 7fe4b76f4640 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fced1c8b20 0x55fced1cafc0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.519+0000 7fe4b76f4640 1 -- 172.21.15.192:0/3743351317 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4a8051070 con 0x55fced1c8b20 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.519+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced1c78b0 con 0x55fced0c6040 2024-09-10T05:13:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.519+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/3743351317 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced0c6040 2024-09-10T05:13:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.519+0000 7fe4bb944800 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55fced1ccbb0 0x55fced1cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.519+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced1cf6e0 con 0x55fced1ccbb0 2024-09-10T05:13:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.519+0000 7fe4aeef3640 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55fced1ccbb0 0x55fced1cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.519+0000 7fe4aeef3640 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55fced1ccbb0 0x55fced1cefa0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.520+0000 7fe4aeef3640 1 -- 172.21.15.192:0/3743351317 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced1ccbb0 2024-09-10T05:13:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.520+0000 7fe4bb944800 1 Processor -- start 2024-09-10T05:13:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.520+0000 7fe4bb944800 1 -- start start 2024-09-10T05:13:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.520+0000 7fe4bb944800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1dd320 0x55fced1dd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.520+0000 7fe4bb944800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fcecfbca00 con 0x55fced1dd320 2024-09-10T05:13:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.520+0000 7fe4b76f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1dd320 0x55fced1dd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.520+0000 7fe4b76f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1dd320 0x55fced1dd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33336/0 (socket says 172.21.15.192:33336) 2024-09-10T05:13:32.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.520+0000 7fe4b76f4640 1 -- 172.21.15.192:0/1367747659 learned_addr learned my addr 172.21.15.192:0/1367747659 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.521+0000 7fe4b76f4640 1 -- 172.21.15.192:0/1367747659 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fced1ddd80 con 0x55fced1dd320 2024-09-10T05:13:32.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.521+0000 7fe4b76f4640 1 --2- 172.21.15.192:0/1367747659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1dd320 0x55fced1dd740 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8096580 tx=0x7fe4a8074f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.521+0000 7fe3a1602640 1 -- 172.21.15.192:0/1367747659 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a808c070 con 0x55fced1dd320 2024-09-10T05:13:32.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.521+0000 7fe3a1602640 1 -- 172.21.15.192:0/1367747659 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a805ce40 con 0x55fced1dd320 2024-09-10T05:13:32.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.521+0000 7fe3a1602640 1 -- 172.21.15.192:0/1367747659 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a805ec30 con 0x55fced1dd320 2024-09-10T05:13:32.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.521+0000 7fe4bb944800 1 -- 172.21.15.192:0/1367747659 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fced1de5b0 con 0x55fced1dd320 2024-09-10T05:13:32.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.521+0000 7fe4bb944800 1 -- 172.21.15.192:0/1367747659 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fced1deb50 con 0x55fced1dd320 2024-09-10T05:13:32.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.522+0000 7fe3a1602640 1 -- 172.21.15.192:0/1367747659 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe4a808f070 con 0x55fced1dd320 2024-09-10T05:13:32.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.522+0000 7fe3a1602640 1 --2- 172.21.15.192:0/1367747659 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39003c780 0x7fe39003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.522+0000 7fe3a1602640 1 -- 172.21.15.192:0/1367747659 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe4a8054050 con 0x55fced1dd320 2024-09-10T05:13:32.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.522+0000 7fe4aeef3640 1 --2- 172.21.15.192:0/1367747659 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39003c780 0x7fe39003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.522+0000 7fe4bb944800 1 Processor -- start 2024-09-10T05:13:32.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.522+0000 7fe4aeef3640 1 --2- 172.21.15.192:0/1367747659 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39003c780 0x7fe39003ec40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000bf40 tx=0x7fe4a000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.522+0000 7fe4bb944800 1 -- start start 2024-09-10T05:13:32.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.523+0000 7fe4bb944800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 0x55fced1e9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.523+0000 7fe4bb944800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fced1ba650 con 0x55fced1e9bc0 2024-09-10T05:13:32.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.523+0000 7fe4b76f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 0x55fced1e9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.523+0000 7fe4b76f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 0x55fced1e9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33350/0 (socket says 172.21.15.192:33350) 2024-09-10T05:13:32.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.523+0000 7fe4b76f4640 1 -- 172.21.15.192:0/485583872 learned_addr learned my addr 172.21.15.192:0/485583872 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.523+0000 7fe4b76f4640 1 -- 172.21.15.192:0/485583872 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fced1ea590 con 0x55fced1e9bc0 2024-09-10T05:13:32.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.523+0000 7fe4b76f4640 1 --2- 172.21.15.192:0/485583872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 0x55fced1e9fa0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe4a805dfd0 tx=0x7fe4a8055920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7889c7a7590030ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.523+0000 7fe39affd640 1 -- 172.21.15.192:0/485583872 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8074960 con 0x55fced1e9bc0 2024-09-10T05:13:32.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.523+0000 7fe39affd640 1 -- 172.21.15.192:0/485583872 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a805e420 con 0x55fced1e9bc0 2024-09-10T05:13:32.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.523+0000 7fe39affd640 1 -- 172.21.15.192:0/485583872 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8093130 con 0x55fced1e9bc0 2024-09-10T05:13:32.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.524+0000 7fe4bb944800 1 -- 172.21.15.192:0/485583872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 msgr2=0x55fced1e9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.524+0000 7fe4bb944800 1 --2- 172.21.15.192:0/485583872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 0x55fced1e9fa0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe4a805dfd0 tx=0x7fe4a8055920 comp rx=0 tx=0).stop 2024-09-10T05:13:32.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.524+0000 7fe4bb944800 1 -- 172.21.15.192:0/485583872 shutdown_connections 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.524+0000 7fe4bb944800 1 --2- 172.21.15.192:0/485583872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 0x55fced1e9fa0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.524+0000 7fe4bb944800 1 -- 172.21.15.192:0/485583872 >> 172.21.15.192:0/485583872 conn(0x55fced1e5fc0 msgr2=0x55fced1e4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.524+0000 7fe4bb944800 1 -- 172.21.15.192:0/485583872 shutdown_connections 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.524+0000 7fe4bb944800 1 -- 172.21.15.192:0/485583872 wait complete. 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.524+0000 7fe4bb944800 1 Processor -- start 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.524+0000 7fe4bb944800 1 -- start start 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.524+0000 7fe4bb944800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 0x55fced1f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.524+0000 7fe4bb944800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fced1eaa20 con 0x55fced1e9bc0 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.525+0000 7fe4b76f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 0x55fced1f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.525+0000 7fe4b76f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 0x55fced1f0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33366/0 (socket says 172.21.15.192:33366) 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.525+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 learned_addr learned my addr 172.21.15.192:0/2646564401 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.525+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fced1f1500 con 0x55fced1e9bc0 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.525+0000 7fe4b76f4640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 0x55fced1f0fa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe4a808fbe0 tx=0x7fe4a808fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.525+0000 7fe3997fa640 1 -- 172.21.15.192:0/2646564401 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a80b8020 con 0x55fced1e9bc0 2024-09-10T05:13:32.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.525+0000 7fe3997fa640 1 -- 172.21.15.192:0/2646564401 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a8055070 con 0x55fced1e9bc0 2024-09-10T05:13:32.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.525+0000 7fe3997fa640 1 -- 172.21.15.192:0/2646564401 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8055220 con 0x55fced1e9bc0 2024-09-10T05:13:32.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.525+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fced1f1500 con 0x55fced1e9bc0 2024-09-10T05:13:32.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.525+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fced1f1500 con 0x55fced1e9bc0 2024-09-10T05:13:32.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.526+0000 7fe3997fa640 1 -- 172.21.15.192:0/2646564401 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe4a80bb020 con 0x55fced1e9bc0 2024-09-10T05:13:32.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.526+0000 7fe3997fa640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe38003c780 0x7fe38003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.526+0000 7fe3997fa640 1 -- 172.21.15.192:0/2646564401 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe4a80bed10 con 0x55fced1e9bc0 2024-09-10T05:13:32.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.526+0000 7fe4aeef3640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe38003c780 0x7fe38003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.527+0000 7fe4aeef3640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe38003c780 0x7fe38003ec40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c010 tx=0x7fe4a0010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.527+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.527+0000 7fe4bb944800 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fced1fc5c0 0x55fced1fea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.527+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced1ff1d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.527+0000 7fe4b7ef5640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fced1fc5c0 0x55fced1fea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.527+0000 7fe4b7ef5640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fced1fc5c0 0x55fced1fea80 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 20 realm 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced1ff5e0 con 0x55fced1fc5c0 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced1ffeb0 con 0x55fced1fc5c0 2024-09-10T05:13:32.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced1fc5c0 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fced200fb0 0x55fced2033a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced203960 con 0x55fced200fb0 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.528+0000 7fe4b76f4640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fced200fb0 0x55fced2033a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.529+0000 7fe4b76f4640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fced200fb0 0x55fced2033a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.529+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.529+0000 7fe4bb944800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.529+0000 7fe4bb944800 20 searching for the correct realm 2024-09-10T05:13:32.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.529+0000 7fe4bb944800 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55fced205910 0x55fced207dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.529+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced2084a0 con 0x55fced205910 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.529+0000 7fe4aeef3640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55fced205910 0x55fced207dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.529+0000 7fe4aeef3640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55fced205910 0x55fced207dd0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.530+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.530+0000 7fe4aeef3640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe4a0037040 0x7fe4a0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.530+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced2084a0 con 0x7fe4a0037040 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.530+0000 7fe4b7ef5640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe4a0037040 0x7fe4a0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.530+0000 7fe4b7ef5640 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe4a0037040 0x7fe4a0036410 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.530+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.530+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced200fb0 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.531+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.531+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced1fc5c0 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.531+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.531+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced1fc5c0 2024-09-10T05:13:32.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.531+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.531+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced200fb0 2024-09-10T05:13:32.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.531+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.531+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced200fb0 2024-09-10T05:13:32.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.532+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.532+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x7fe4a0037040 2024-09-10T05:13:32.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.532+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.532+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced205910 2024-09-10T05:13:32.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.532+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.532+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced1fc5c0 2024-09-10T05:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.532+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.532+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced200fb0 2024-09-10T05:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.533+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.533+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced1fc5c0 2024-09-10T05:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.533+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.533+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x7fe4a0037040 2024-09-10T05:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.533+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.533+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced205910 2024-09-10T05:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.533+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.533+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced205910 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.534+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.534+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced200fb0 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.534+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.534+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced205910 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.534+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.534+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced205910 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.534+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.535+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced1fc5c0 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.535+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.535+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced1fc5c0 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.535+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.535+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x7fe4a0037040 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.535+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.535+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced205910 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.535+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.536+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x7fe4a0037040 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.536+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.536+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced1fc5c0 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.536+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.536+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced200fb0 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.537+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.537+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced205910 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.537+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.537+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced200fb0 2024-09-10T05:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.537+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.537+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x7fe4a0037040 2024-09-10T05:13:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.537+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.537+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced205910 2024-09-10T05:13:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.537+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.537+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x7fe4a0037040 2024-09-10T05:13:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x55fced1fc5c0 2024-09-10T05:13:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fced200250 con 0x7fe4a0037040 2024-09-10T05:13:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4bb944800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4bb944800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4bb944800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4bb944800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4bb944800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4bb944800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced204220 con 0x55fced1fc5c0 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4bb944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.538+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced204220 con 0x55fced1fc5c0 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:32.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced204220 con 0x7fe4a0037040 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 20 zone default found 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 4 Realm: () 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 20 zonegroup default 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2041e0 con 0x55fced200fb0 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced20a310 con 0x55fced205910 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.539+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.540+0000 7fe4bb944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.540+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.540+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced20a6b0 con 0x55fced205910 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.540+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.540+0000 7fe4bb944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.540+0000 7fe4bb944800 20 started sync module instance, tier type = 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.540+0000 7fe4bb944800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.540+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced2097b0 con 0x7fe4a0037040 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.541+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.541+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94544798457088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced2097b0 con 0x7fe4a0037040 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.541+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced20b070 con 0x55fced1fc5c0 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.542+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94544798457088] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.542+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.542+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94544798461344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced2097b0 con 0x55fced1fc5c0 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.542+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced20bac0 con 0x55fced205910 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.544+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.544+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94544798463440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced20c360 con 0x55fced205910 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.544+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced20cde0 con 0x7fe4a0037040 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.544+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94544798461344] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.545+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94544798463440] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.545+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.545+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94544798465712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced209300 con 0x7fe4a0037040 2024-09-10T05:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.545+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced20d6b0 con 0x55fced1fc5c0 2024-09-10T05:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.546+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94544798465712] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.546+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.546+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94544798468336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced20d600 con 0x55fced1fc5c0 2024-09-10T05:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.546+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced20e0c0 con 0x55fced200fb0 2024-09-10T05:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.547+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94544798468336] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.547+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.547+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94544798470480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced20d570 con 0x55fced200fb0 2024-09-10T05:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.547+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced20ee30 con 0x55fced200fb0 2024-09-10T05:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.548+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94544798470480] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.549+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.549+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94544798475360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced20ee30 con 0x55fced200fb0 2024-09-10T05:13:32.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.549+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced20f850 con 0x55fced200fb0 2024-09-10T05:13:32.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.550+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94544798475360] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.550+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.550+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94544798479168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced20f810 con 0x55fced200fb0 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.550+0000 7fe4bb944800 20 add_watcher() i=0 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.550+0000 7fe4bb944800 20 add_watcher() i=1 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.550+0000 7fe4bb944800 20 add_watcher() i=2 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.550+0000 7fe4bb944800 20 add_watcher() i=3 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.550+0000 7fe4bb944800 20 add_watcher() i=4 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.550+0000 7fe4bb944800 20 add_watcher() i=5 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.550+0000 7fe4bb944800 20 add_watcher() i=6 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.551+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94544798479168] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.551+0000 7fe4bb944800 20 add_watcher() i=7 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.551+0000 7fe4bb944800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:32.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.551+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced212ca0 con 0x55fced1fc5c0 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.552+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.552+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94544798476416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced210160 con 0x55fced1fc5c0 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.553+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94544798476416] v37'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.553+0000 7fe36dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.553+0000 7fe4bb944800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.553+0000 7fe4bb944800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.553+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21b560 con 0x55fced1fc5c0 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.554+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'58 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.554+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21bbb0 con 0x55fced200fb0 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.555+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.555+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21bb90 con 0x55fced205910 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.556+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.556+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21c690 con 0x55fced1fc5c0 2024-09-10T05:13:32.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.557+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'241 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.557+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced2193d0 con 0x7fe4a0037040 2024-09-10T05:13:32.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.558+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'80 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.558+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced2193d0 con 0x55fced205910 2024-09-10T05:13:32.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.559+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'61 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.559+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21d870 con 0x55fced1fc5c0 2024-09-10T05:13:32.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.560+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.560+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218330 con 0x55fced200fb0 2024-09-10T05:13:32.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.561+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.561+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218330 con 0x7fe4a0037040 2024-09-10T05:13:32.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.562+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.562+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218330 con 0x55fced205910 2024-09-10T05:13:32.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.563+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.563+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218330 con 0x7fe4a0037040 2024-09-10T05:13:32.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.564+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'81 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.564+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218330 con 0x55fced200fb0 2024-09-10T05:13:32.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.565+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.565+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218330 con 0x7fe4a0037040 2024-09-10T05:13:32.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.566+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.566+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218330 con 0x55fced200fb0 2024-09-10T05:13:32.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.567+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'67 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.567+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218330 con 0x55fced1fc5c0 2024-09-10T05:13:32.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.568+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'242 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.568+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218330 con 0x55fced205910 2024-09-10T05:13:32.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.569+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'77 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.569+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218330 con 0x7fe4a0037040 2024-09-10T05:13:32.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.570+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'82 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.570+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218330 con 0x55fced205910 2024-09-10T05:13:32.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.571+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.571+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218430 con 0x55fced1fc5c0 2024-09-10T05:13:32.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.572+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.572+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced218430 con 0x55fced1fc5c0 2024-09-10T05:13:32.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.573+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'243 uv174 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.573+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21e3d0 con 0x55fced205910 2024-09-10T05:13:32.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.574+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'78 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.574+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21e3d0 con 0x7fe4a0037040 2024-09-10T05:13:32.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.575+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.575+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21e3d0 con 0x55fced205910 2024-09-10T05:13:32.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.576+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.576+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21e3d0 con 0x55fced205910 2024-09-10T05:13:32.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.577+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'46 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.577+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21e3d0 con 0x55fced205910 2024-09-10T05:13:32.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.578+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.578+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21e3d0 con 0x55fced205910 2024-09-10T05:13:32.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.579+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'62 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.579+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21e3d0 con 0x55fced200fb0 2024-09-10T05:13:32.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.580+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.580+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21e3d0 con 0x55fced205910 2024-09-10T05:13:32.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.581+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.581+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21e3d0 con 0x55fced200fb0 2024-09-10T05:13:32.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.582+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.582+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21e3d0 con 0x55fced205910 2024-09-10T05:13:32.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.583+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'79 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.583+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21e3d0 con 0x55fced200fb0 2024-09-10T05:13:32.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.584+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'68 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.584+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced21e3d0 con 0x7fe4a0037040 2024-09-10T05:13:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.586+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.586+0000 7fe36cfe1640 20 reqs_thread_entry: start 2024-09-10T05:13:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.586+0000 7fe4bb944800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.586+0000 7fe4bb944800 20 Filter name: none 2024-09-10T05:13:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.586+0000 7fe2e67fc640 20 reqs_thread_entry: start 2024-09-10T05:13:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.586+0000 7fe4bb944800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-10T05:13:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.586+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.586+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced248ec0 con 0x55fced1fc5c0 2024-09-10T05:13:32.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 20 rados_obj.operate() r=0 bl.length=391 2024-09-10T05:13:32.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-10T05:13:32.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-10T05:13:32.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:32.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced24b7f0 con 0x7fe4a0037040 2024-09-10T05:13:32.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv45 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.7 : miss 2024-09-10T05:13:32.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:96 8.f 8:f1166011:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced24b520 con 0x55fced205910 2024-09-10T05:13:32.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(96 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 20 rados_obj.operate() r=0 bl.length=387 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.7 info.flags=0x17 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.7 to cache LRU end 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.7 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.587+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:97 4.b 4:d13066de:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2c8a90 con 0x7fe4a0037040 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.588+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(97 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.0 [call out=89b] v0'0 uv15 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.588+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:98 4.3b 4:de3f8055:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2c8a90 con 0x55fced205910 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.588+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(98 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.1 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.588+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:99 4.11 4:882e591d:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2c8ad0 con 0x55fced200fb0 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.589+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(99 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.589+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:100 4.7 4:e24e187e:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2c8ad0 con 0x55fced200fb0 2024-09-10T05:13:32.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.589+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(100 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.589+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:101 4.c 4:329cfb20:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2c8ad0 con 0x55fced1fc5c0 2024-09-10T05:13:32.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.589+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(101 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4 [call out=429b] v0'0 uv5 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.589+0000 7fe4bb944800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-10T05:13:32.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.589+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:102 4.d 4:b2cbafe9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2c9170 con 0x55fced205910 2024-09-10T05:13:32.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.590+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 28 ==== osd_op_reply(102 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.590+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:103 4.33 4:cc5ba36d:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2c9170 con 0x55fced200fb0 2024-09-10T05:13:32.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.590+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(103 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.590+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:104 4.24 4:262b1e52:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2c9170 con 0x55fced200fb0 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.590+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(104 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.591+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:105 4.1a 4:58a8820f:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2c9170 con 0x7fe4a0037040 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.591+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(105 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.591+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:106 4.7 4:e14ebcd7:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2c9150 con 0x55fced200fb0 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.591+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(106 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.591+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:107 4.2b 4:d6a1771c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2c9150 con 0x55fced1fc5c0 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.592+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(107 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.10 [call out=89b] v0'0 uv13 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.592+0000 7fe4bb944800 20 get_obj_state: octx=0x7fe4b000ab20 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55fced2c6ce8 s->prefetch_data=0 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.592+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:108 3.es0 3:73bc284b:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2c7d70 con 0x7fe4a0037040 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.592+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 24 ==== osd_op_reply(108 92aa256a-2802-419e-96e0-ba675846cbc3.4238.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.592+0000 7fe4bb944800 10 manifest: total_size = 6 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.592+0000 7fe4bb944800 20 get_obj_state: setting s->obj_tag to 92aa256a-2802-419e-96e0-ba675846cbc3.4238.4149569340876399178 2024-09-10T05:13:32.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.592+0000 7fe4bb944800 20 get_obj_state: octx=0x7fe4b000ab20 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55fced2c6ce8 s->prefetch_data=0 2024-09-10T05:13:32.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.592+0000 7fe4bb944800 20 prepare_atomic_modification: state is not atomic. state=0x55fced2c6ce8 2024-09-10T05:13:32.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.592+0000 7fe4bb944800 20 bucket index object: :.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4 2024-09-10T05:13:32.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.592+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:109 4.c 4:329cfb20:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced24fc20 con 0x55fced1fc5c0 2024-09-10T05:13:32.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.593+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(109 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4 [stat,call,call] v37'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.593+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:110 3.es0 3:73bc284b:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced24dc00 con 0x7fe4a0037040 2024-09-10T05:13:32.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.594+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 25 ==== osd_op_reply(110 92aa256a-2802-419e-96e0-ba675846cbc3.4238.7_15f6f8dc036519d7fe15b39338f6e5db [call] v37'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.594+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:111 4.c 4:329cfb20:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced24dc00 con 0x55fced1fc5c0 2024-09-10T05:13:32.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.594+0000 7fe4bb944800 20 list_objects_ordered: starting attempt 1 2024-09-10T05:13:32.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.594+0000 7fe4bb944800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-10T05:13:32.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.595+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:112 4.b 4:d13066de:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced24dc00 con 0x7fe4a0037040 2024-09-10T05:13:32.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.595+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:113 4.3b 4:de3f8055:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2546f0 con 0x55fced205910 2024-09-10T05:13:32.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.595+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:114 4.11 4:882e591d:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced24dc00 con 0x55fced200fb0 2024-09-10T05:13:32.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.595+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 26 ==== osd_op_reply(112 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.0 [call out=89b] v0'0 uv15 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.595+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 29 ==== osd_op_reply(113 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.1 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.595+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:115 4.7 4:e24e187e:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced24dc00 con 0x55fced200fb0 2024-09-10T05:13:32.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.595+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:116 4.c 4:329cfb20:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced257070 con 0x55fced1fc5c0 2024-09-10T05:13:32.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.595+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:117 4.d 4:b2cbafe9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced259af0 con 0x55fced205910 2024-09-10T05:13:32.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.595+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:118 4.33 4:cc5ba36d:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced257070 con 0x55fced200fb0 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.595+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:119 4.24 4:262b1e52:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced25ef60 con 0x55fced200fb0 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.595+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:120 4.1a 4:58a8820f:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced25efa0 con 0x7fe4a0037040 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.595+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:121 4.7 4:e14ebcd7:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced263ec0 con 0x55fced200fb0 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:122 4.2b 4:d6a1771c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced266860 con 0x55fced1fc5c0 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(114 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(115 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(111 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4 [stat,call,call] v37'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 30 ==== osd_op_reply(118 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe39affd640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 31 ==== osd_op_reply(119 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 30 ==== osd_op_reply(117 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 32 ==== osd_op_reply(121 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 27 ==== osd_op_reply(120 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(116 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(122 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.10 [call out=89b] v0'0 uv13 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[92aa256a-2802-419e-96e0-ba675846cbc3.4238.7])"; uploads.size()=0; is_truncated=0 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:123 4.b 4:d13066de:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced266860 con 0x7fe4a0037040 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:124 4.3b 4:de3f8055:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2638d0 con 0x55fced205910 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:125 4.11 4:882e591d:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced200fb0 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:126 4.7 4:e24e187e:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced25a490 con 0x55fced200fb0 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:127 4.c 4:329cfb20:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2638d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:128 4.d 4:b2cbafe9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced205910 2024-09-10T05:13:32.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:129 4.33 4:cc5ba36d:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced200fb0 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:130 4.24 4:262b1e52:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced200fb0 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:131 4.1a 4:58a8820f:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2638d0 con 0x7fe4a0037040 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:132 4.7 4:e14ebcd7:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced200fb0 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 33 ==== osd_op_reply(126 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 34 ==== osd_op_reply(125 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.596+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 34 ==== osd_op_reply(127 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.597+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 31 ==== osd_op_reply(124 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.1 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.597+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 35 ==== osd_op_reply(129 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.597+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:133 4.2b 4:d6a1771c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced2638d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.597+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 32 ==== osd_op_reply(128 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.597+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 36 ==== osd_op_reply(130 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.597+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 28 ==== osd_op_reply(123 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.0 [call out=89b] v0'0 uv15 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.597+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 37 ==== osd_op_reply(132 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.597+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 29 ==== osd_op_reply(131 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.597+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 35 ==== osd_op_reply(133 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.10 [call out=89b] v0'0 uv13 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.597+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x7fe4a0037040 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.598+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 30 ==== osd_op_reply(134 foo.buckets [call] v37'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.598+0000 7fe4bb944800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.598+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.598+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x7fe4a0037040 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.598+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 31 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.598+0000 7fe4bb944800 20 rados_obj.operate() r=0 bl.length=165 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.598+0000 7fe4bb944800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.598+0000 7fe4bb944800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.598+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x7fe4a0037040 2024-09-10T05:13:32.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.599+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 32 ==== osd_op_reply(136 myfoo [call,call,delete] v37'49 uv49 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.599+0000 7fe4bb944800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-10T05:13:32.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.599+0000 7fe4bb944800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-10T05:13:32.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.599+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94544798836832 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced200fb0 2024-09-10T05:13:32.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.600+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 38 ==== watch-notify(notify (1) cookie 94544798475360 notify 158913789988 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55fced218950 con 0x55fced200fb0 2024-09-10T05:13:32.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.600+0000 7fe39a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789988 cookie 94544798475360 notifier 4791 bl.length()=149 2024-09-10T05:13:32.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.600+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 39 ==== osd_op_reply(137 notify.6 [notify cookie 94544798836832 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.600+0000 7fe39a7fc640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fe2ec0032c0 con 0x55fced200fb0 2024-09-10T05:13:32.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.600+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 40 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.600+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 41 ==== watch-notify(notify_complete (2) cookie 94544798836832 notify 158913789988 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fced1ddd80 con 0x55fced200fb0 2024-09-10T05:13:32.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.600+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:139 8.f 8:f1166011:root::.bucket.meta.myfoo%3a92aa256a-2802-419e-96e0-ba675846cbc3.4238.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced205910 2024-09-10T05:13:32.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.601+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 33 ==== osd_op_reply(139 .bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.7 [call,call,delete] v37'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.601+0000 7fe4bb944800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.7 from cache 2024-09-10T05:13:32.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.601+0000 7fe4bb944800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:92aa256a-2802-419e-96e0-ba675846cbc3.4238.7, ofs0, ns] 2024-09-10T05:13:32.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.601+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify cookie 94544798836832 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x7fe4a0037040 2024-09-10T05:13:32.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.601+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 33 ==== watch-notify(notify (1) cookie 94544798465712 notify 158913789988 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55fced217cb0 con 0x7fe4a0037040 2024-09-10T05:13:32.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.601+0000 7fe39affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789988 cookie 94544798465712 notifier 4791 bl.length()=206 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.601+0000 7fe39affd640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:141 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fe37c003d60 con 0x7fe4a0037040 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.601+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 34 ==== osd_op_reply(140 notify.3 [notify cookie 94544798836832 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 35 ==== osd_op_reply(141 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 36 ==== watch-notify(notify_complete (2) cookie 94544798836832 notify 158913789988 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fced219770 con 0x7fe4a0037040 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:142 4.b 4:d13066de:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x7fe4a0037040 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:143 4.3b 4:de3f8055:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced266860 con 0x55fced205910 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:144 4.11 4:882e591d:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced25a390 con 0x55fced200fb0 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:145 4.7 4:e24e187e:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced249e40 con 0x55fced200fb0 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:146 4.c 4:329cfb20:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced25c670 con 0x55fced1fc5c0 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:147 4.d 4:b2cbafe9:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced205910 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:148 4.33 4:cc5ba36d:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced25a390 con 0x55fced200fb0 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:149 4.24 4:262b1e52:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced249e40 con 0x55fced200fb0 2024-09-10T05:13:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:150 4.1a 4:58a8820f:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced25a390 con 0x7fe4a0037040 2024-09-10T05:13:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:151 4.7 4:e14ebcd7:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced249e40 con 0x55fced200fb0 2024-09-10T05:13:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.602+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:152 4.2b 4:d6a1771c:::.dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced1fc5c0 2024-09-10T05:13:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.603+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 34 ==== osd_op_reply(143 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.1 [delete] v37'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.603+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 37 ==== osd_op_reply(142 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.0 [delete] v37'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.604+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 42 ==== osd_op_reply(149 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.7 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.604+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 43 ==== osd_op_reply(145 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.3 [delete] v37'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.604+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 44 ==== osd_op_reply(148 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.6 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.604+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 35 ==== osd_op_reply(147 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.5 [delete] v37'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.604+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 45 ==== osd_op_reply(144 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.2 [delete] v37'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.604+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 46 ==== osd_op_reply(151 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.9 [delete] v37'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.604+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 36 ==== osd_op_reply(146 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.4 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.604+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 37 ==== osd_op_reply(152 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.10 [delete] v37'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.605+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 38 ==== osd_op_reply(150 .dir.92aa256a-2802-419e-96e0-ba675846cbc3.4238.7.8 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.605+0000 7fe4bb944800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/92aa256a-2802-419e-96e0-ba675846cbc3.4238.7 : miss 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.605+0000 7fe4bb944800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.605+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:153 6.13 6:cf1ed70f:::pubsub..bucket.myfoo%2f92aa256a-2802-419e-96e0-ba675846cbc3.4238.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced200fb0 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.605+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 47 ==== osd_op_reply(153 pubsub..bucket.myfoo/92aa256a-2802-419e-96e0-ba675846cbc3.4238.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.605+0000 7fe4bb944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.605+0000 7fe4bb944800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/92aa256a-2802-419e-96e0-ba675846cbc3.4238.7 info.flags=0x0 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.605+0000 7fe4bb944800 10 adding default.rgw.log++pubsub..bucket.myfoo/92aa256a-2802-419e-96e0-ba675846cbc3.4238.7 to cache LRU end 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.605+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:154 6.13 6:cf1ed70f:::pubsub..bucket.myfoo%2f92aa256a-2802-419e-96e0-ba675846cbc3.4238.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced200fb0 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.606+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 48 ==== osd_op_reply(154 pubsub..bucket.myfoo/92aa256a-2802-419e-96e0-ba675846cbc3.4238.7 [delete] v37'35 uv32 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.606+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x7fe4a0037040 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.607+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 39 ==== osd_op_reply(155 foo.buckets [call] v37'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.607+0000 7fe4bb944800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.607+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced200fb0 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.608+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 49 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v37'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.608+0000 7fe4bb944800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.608+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94544798720816 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x7fe4a0037040 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.608+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 40 ==== watch-notify(notify (1) cookie 94544798465712 notify 158913789989 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55fced219770 con 0x7fe4a0037040 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.608+0000 7fe39a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789989 cookie 94544798465712 notifier 4791 bl.length()=170 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.608+0000 7fe39a7fc640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fe2ec0032c0 con 0x7fe4a0037040 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.608+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 41 ==== osd_op_reply(157 notify.3 [notify cookie 94544798720816 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.608+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 42 ==== watch-notify(notify_complete (2) cookie 94544798720816 notify 158913789989 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fced218cc0 con 0x7fe4a0037040 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.608+0000 7fe4bb944800 10 removing email index: foo@foo.com 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.608+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 43 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.608+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced1fc5c0 2024-09-10T05:13:32.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.609+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 38 ==== osd_op_reply(159 foo@foo.com [delete] v37'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.609+0000 7fe4bb944800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.609+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94544798720816 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x7fe4a0037040 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.610+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 44 ==== watch-notify(notify (1) cookie 94544798465712 notify 158913789990 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55fced218cc0 con 0x7fe4a0037040 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.610+0000 7fe39affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789990 cookie 94544798465712 notifier 4791 bl.length()=162 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.610+0000 7fe39affd640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fe37c003d60 con 0x7fe4a0037040 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.610+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 45 ==== osd_op_reply(160 notify.3 [notify cookie 94544798720816 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.610+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 46 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.610+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 47 ==== watch-notify(notify_complete (2) cookie 94544798720816 notify 158913789990 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fced21b080 con 0x7fe4a0037040 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.610+0000 7fe4bb944800 10 removing user buckets index 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.610+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x7fe4a0037040 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.611+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 48 ==== osd_op_reply(162 foo.buckets [delete] v37'51 uv51 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.611+0000 7fe4bb944800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-10T05:13:32.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.611+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94544798720816 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced200fb0 2024-09-10T05:13:32.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.611+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 50 ==== watch-notify(notify (1) cookie 94544798470480 notify 158913789989 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55fced1ddd80 con 0x55fced200fb0 2024-09-10T05:13:32.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.611+0000 7fe39a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789989 cookie 94544798470480 notifier 4791 bl.length()=160 2024-09-10T05:13:32.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.611+0000 7fe39a7fc640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fe2ec0032c0 con 0x55fced200fb0 2024-09-10T05:13:32.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.611+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 51 ==== osd_op_reply(163 notify.5 [notify cookie 94544798720816 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.612+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 52 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.612+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 53 ==== watch-notify(notify_complete (2) cookie 94544798720816 notify 158913789989 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fced1c0530 con 0x55fced200fb0 2024-09-10T05:13:32.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.612+0000 7fe4bb944800 10 removing user index: foo 2024-09-10T05:13:32.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.612+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced1fc5c0 2024-09-10T05:13:32.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.613+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 39 ==== osd_op_reply(165 foo [call,call,delete] v37'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.613+0000 7fe4bb944800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-10T05:13:32.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.613+0000 7fe4bb944800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-10T05:13:32.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.613+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94544798743072 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced1fc5c0 2024-09-10T05:13:32.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.613+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 40 ==== watch-notify(notify (1) cookie 94544798468336 notify 158913789970 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55fced21b080 con 0x55fced1fc5c0 2024-09-10T05:13:32.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.613+0000 7fe39affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789970 cookie 94544798468336 notifier 4791 bl.length()=152 2024-09-10T05:13:32.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.613+0000 7fe39affd640 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fe37c003d60 con 0x55fced1fc5c0 2024-09-10T05:13:32.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.613+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 41 ==== osd_op_reply(166 notify.4 [notify cookie 94544798743072 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.613+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 42 ==== watch-notify(notify_complete (2) cookie 94544798743072 notify 158913789970 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fced21aeb0 con 0x55fced1fc5c0 2024-09-10T05:13:32.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.613+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 43 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.614+0000 7fe36dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.614+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94544798476416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced1fc5c0 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.615+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 44 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94544798476416] v37'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.615+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94544798457088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x7fe4a0037040 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.616+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 49 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94544798457088] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.616+0000 7fe4bb944800 20 remove_watcher() i=0 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.616+0000 7fe4bb944800 2 removed watcher, disabling cache 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.616+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94544798461344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced1fc5c0 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.617+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 45 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94544798461344] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.617+0000 7fe4bb944800 20 remove_watcher() i=1 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.617+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94544798463440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced205910 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.618+0000 7fe4aeef3640 1 -- 172.21.15.192:0/2646564401 <== osd.3 v2:172.21.15.192:6816/1620624472 36 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94544798463440] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a0009050 con 0x55fced205910 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.618+0000 7fe4bb944800 20 remove_watcher() i=2 2024-09-10T05:13:32.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.618+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94544798465712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x7fe4a0037040 2024-09-10T05:13:32.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.619+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.2 v2:172.21.15.192:6801/2435677948 50 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94544798465712] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x7fe4a0037040 2024-09-10T05:13:32.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.619+0000 7fe4bb944800 20 remove_watcher() i=3 2024-09-10T05:13:32.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.619+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94544798468336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced1fc5c0 2024-09-10T05:13:32.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.620+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 <== osd.1 v2:172.21.15.192:6800/3487349558 46 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94544798468336] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b000a4d0 con 0x55fced1fc5c0 2024-09-10T05:13:32.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.620+0000 7fe4bb944800 20 remove_watcher() i=4 2024-09-10T05:13:32.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.620+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94544798470480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced200fb0 2024-09-10T05:13:32.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.622+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 54 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94544798470480] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.622+0000 7fe4bb944800 20 remove_watcher() i=5 2024-09-10T05:13:32.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.622+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94544798475360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced200fb0 2024-09-10T05:13:32.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.622+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 55 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94544798475360] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.622+0000 7fe4bb944800 20 remove_watcher() i=6 2024-09-10T05:13:32.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.622+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94544798479168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fced264330 con 0x55fced200fb0 2024-09-10T05:13:32.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.623+0000 7fe4b76f4640 1 -- 172.21.15.192:0/2646564401 <== osd.0 v2:172.21.15.139:6800/2915567440 56 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94544798479168] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a808e030 con 0x55fced200fb0 2024-09-10T05:13:32.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.623+0000 7fe4bb944800 20 remove_watcher() i=7 2024-09-10T05:13:32.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fced200fb0 msgr2=0x55fced2033a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fced200fb0 0x55fced2033a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fced1fc5c0 msgr2=0x55fced1fea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fced1fc5c0 0x55fced1fea80 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe4a0037040 msgr2=0x7fe4a0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe4a0037040 0x7fe4a0036410 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55fced205910 msgr2=0x55fced207dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55fced205910 0x55fced207dd0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe38003c780 msgr2=0x7fe38003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe38003c780 0x7fe38003ec40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000c010 tx=0x7fe4a0010000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 msgr2=0x55fced1f0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 0x55fced1f0fa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe4a808fbe0 tx=0x7fe4a808fb70 comp rx=0 tx=0).stop 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/2646564401 reap_dead start 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 shutdown_connections 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 --2- 172.21.15.192:0/2646564401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1e9bc0 0x55fced1f0fa0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 >> 172.21.15.192:0/2646564401 conn(0x55fced1e5fc0 msgr2=0x55fced1e41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 shutdown_connections 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/2646564401 wait complete. 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/1367747659 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39003c780 msgr2=0x7fe39003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 --2- 172.21.15.192:0/1367747659 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39003c780 0x7fe39003ec40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000bf40 tx=0x7fe4a000f000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/1367747659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1dd320 msgr2=0x55fced1dd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 --2- 172.21.15.192:0/1367747659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1dd320 0x55fced1dd740 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8096580 tx=0x7fe4a8074f80 comp rx=0 tx=0).stop 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/1367747659 shutdown_connections 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 --2- 172.21.15.192:0/1367747659 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39003c780 0x7fe39003ec40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 --2- 172.21.15.192:0/1367747659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced1dd320 0x55fced1dd740 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/1367747659 >> 172.21.15.192:0/1367747659 conn(0x55fced1d16d0 msgr2=0x55fced1d1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/1367747659 shutdown_connections 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.624+0000 7fe4bb944800 1 -- 172.21.15.192:0/1367747659 wait complete. 2024-09-10T05:13:32.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fced1c8b20 msgr2=0x55fced1cafc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fced1c8b20 0x55fced1cafc0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fced0c6040 msgr2=0x55fced1c6780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fced0c6040 0x55fced1c6780 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55fced1ccbb0 msgr2=0x55fced1cefa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55fced1ccbb0 0x55fced1cefa0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39c03c730 msgr2=0x7fe39c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe39c03c730 0x7fe39c03ebf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0001d70 tx=0x7fe4a00012d0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 msgr2=0x55fced1bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 --2- 172.21.15.192:0/3743351317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fced0c4e00 0x55fced1bf130 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8025c20 tx=0x7fe4a8002fb0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4b7ef5640 1 -- 172.21.15.192:0/3743351317 reap_dead start 2024-09-10T05:13:32.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 shutdown_connections 2024-09-10T05:13:32.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 >> 172.21.15.192:0/3743351317 conn(0x55fced0c01d0 msgr2=0x55fced1ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 shutdown_connections 2024-09-10T05:13:32.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.625+0000 7fe4bb944800 1 -- 172.21.15.192:0/3743351317 wait complete. 2024-09-10T05:13:32.634 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-10T05:13:32.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-10T05:13:32.635 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-10T05:13:32.678 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:32.679 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:32.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.678+0000 7feef7946800 1 Processor -- start 2024-09-10T05:13:32.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.678+0000 7feef7946800 1 -- start start 2024-09-10T05:13:32.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.679+0000 7feef7946800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5607414ef480 0x5607414ef880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.679+0000 7feef7946800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56074139ae40 con 0x5607414efdc0 2024-09-10T05:13:32.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.679+0000 7feef7946800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x560741365680 con 0x5607414ef480 2024-09-10T05:13:32.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.679+0000 7feef5430640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5607414ef480 0x5607414ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.679+0000 7feeeffff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5607414efdc0 0x5607414f0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46480/0 (socket says 172.21.15.192:46480) 2024-09-10T05:13:32.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.679+0000 7feeeffff640 1 -- 172.21.15.192:0/3991211501 learned_addr learned my addr 172.21.15.192:0/3991211501 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:32.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.679+0000 7feef5430640 1 -- 172.21.15.192:0/3991211501 >> v1:172.21.15.139:6789/0 conn(0x5607414efdc0 legacy=0x5607414f0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.679+0000 7feef5430640 1 -- 172.21.15.192:0/3991211501 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607413816b0 con 0x5607414ef480 2024-09-10T05:13:32.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.681+0000 7feef5430640 1 --2- 172.21.15.192:0/3991211501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607414ef880 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7feee800a470 tx=0x7feee8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ee0c2f130df5de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.681+0000 7feef4c2f640 1 -- 172.21.15.192:0/3991211501 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee8053570 con 0x5607414ef480 2024-09-10T05:13:32.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.681+0000 7feef4c2f640 1 -- 172.21.15.192:0/3991211501 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee8058070 con 0x5607414ef480 2024-09-10T05:13:32.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.681+0000 7feef4c2f640 1 -- 172.21.15.192:0/3991211501 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee8053880 con 0x5607414ef480 2024-09-10T05:13:32.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.682+0000 7feef7946800 1 -- 172.21.15.192:0/3991211501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 msgr2=0x5607414ef880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.682+0000 7feef7946800 1 --2- 172.21.15.192:0/3991211501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607414ef880 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7feee800a470 tx=0x7feee8045a20 comp rx=0 tx=0).stop 2024-09-10T05:13:32.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.682+0000 7feef7946800 1 -- 172.21.15.192:0/3991211501 shutdown_connections 2024-09-10T05:13:32.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.682+0000 7feef7946800 1 --2- 172.21.15.192:0/3991211501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607414ef880 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.682+0000 7feef7946800 1 -- 172.21.15.192:0/3991211501 >> 172.21.15.192:0/3991211501 conn(0x5607414eb1b0 msgr2=0x5607414ed610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.682+0000 7feef7946800 1 -- 172.21.15.192:0/3991211501 shutdown_connections 2024-09-10T05:13:32.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.682+0000 7feef7946800 1 -- 172.21.15.192:0/3991211501 wait complete. 2024-09-10T05:13:32.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.695+0000 7feef7946800 1 Processor -- start 2024-09-10T05:13:32.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.695+0000 7feef7946800 1 -- start start 2024-09-10T05:13:32.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.696+0000 7feef7946800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607415e2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.696+0000 7feef7946800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560741389dd0 con 0x5607414ef480 2024-09-10T05:13:32.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.696+0000 7feef5430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607415e2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.696+0000 7feef5430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607415e2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33398/0 (socket says 172.21.15.192:33398) 2024-09-10T05:13:32.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.696+0000 7feef5430640 1 -- 172.21.15.192:0/202643682 learned_addr learned my addr 172.21.15.192:0/202643682 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.696+0000 7feef5430640 1 -- 172.21.15.192:0/202643682 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607413a2e10 con 0x5607414ef480 2024-09-10T05:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.696+0000 7feef5430640 1 --2- 172.21.15.192:0/202643682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607415e2870 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7feee8025c20 tx=0x7feee8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ef871cbd62a8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.697+0000 7fede3606640 1 -- 172.21.15.192:0/202643682 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee8053a20 con 0x5607414ef480 2024-09-10T05:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.697+0000 7fede3606640 1 -- 172.21.15.192:0/202643682 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee8063070 con 0x5607414ef480 2024-09-10T05:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.697+0000 7fede3606640 1 -- 172.21.15.192:0/202643682 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee8053cf0 con 0x5607414ef480 2024-09-10T05:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.697+0000 7feef7946800 1 -- 172.21.15.192:0/202643682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 msgr2=0x5607415e2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.697+0000 7feef7946800 1 --2- 172.21.15.192:0/202643682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607415e2870 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7feee8025c20 tx=0x7feee8051000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.697+0000 7feef7946800 1 -- 172.21.15.192:0/202643682 shutdown_connections 2024-09-10T05:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.697+0000 7feef7946800 1 --2- 172.21.15.192:0/202643682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607415e2870 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.697+0000 7feef7946800 1 -- 172.21.15.192:0/202643682 >> 172.21.15.192:0/202643682 conn(0x5607414eb1b0 msgr2=0x5607415de1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.697+0000 7feef7946800 1 -- 172.21.15.192:0/202643682 shutdown_connections 2024-09-10T05:13:32.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.697+0000 7feef7946800 1 -- 172.21.15.192:0/202643682 wait complete. 2024-09-10T05:13:32.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.698+0000 7feef7946800 1 Processor -- start 2024-09-10T05:13:32.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.698+0000 7feef7946800 1 -- start start 2024-09-10T05:13:32.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.698+0000 7feef7946800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607415ea160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.698+0000 7feef7946800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5607414f0d40 con 0x5607414ef480 2024-09-10T05:13:32.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.698+0000 7feef5430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607415ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.698+0000 7feef5430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607415ea160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33410/0 (socket says 172.21.15.192:33410) 2024-09-10T05:13:32.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.698+0000 7feef5430640 1 -- 172.21.15.192:0/2350991926 learned_addr learned my addr 172.21.15.192:0/2350991926 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.698+0000 7feef5430640 1 -- 172.21.15.192:0/2350991926 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607415ea6c0 con 0x5607414ef480 2024-09-10T05:13:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.698+0000 7feef5430640 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607415ea160 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7feee800a470 tx=0x7feee8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.699+0000 7fede1e03640 1 -- 172.21.15.192:0/2350991926 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee8068660 con 0x5607414ef480 2024-09-10T05:13:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.699+0000 7fede1e03640 1 -- 172.21.15.192:0/2350991926 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee8076070 con 0x5607414ef480 2024-09-10T05:13:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.699+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607415ea950 con 0x5607414ef480 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.699+0000 7fede1e03640 1 -- 172.21.15.192:0/2350991926 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee8068950 con 0x5607414ef480 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.699+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607415eb2d0 con 0x5607414ef480 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.699+0000 7fede1e03640 1 -- 172.21.15.192:0/2350991926 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7feee8070070 con 0x5607414ef480 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.700+0000 7fede1e03640 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feddc03c780 0x7feddc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.700+0000 7fede1e03640 1 -- 172.21.15.192:0/2350991926 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7feee80984a0 con 0x5607414ef480 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.700+0000 7feeeffff640 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feddc03c780 0x7feddc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.700+0000 7feef7946800 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5607414efdc0 0x5607415f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.700+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5607415f1cf0 con 0x5607414efdc0 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.700+0000 7feef5c31640 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5607414efdc0 0x5607415f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.700+0000 7feeeffff640 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feddc03c780 0x7feddc03ec40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feee0001d70 tx=0x7feee00012d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.700+0000 7feef5c31640 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5607414efdc0 0x5607415f17b0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.701+0000 7feef5c31640 1 -- 172.21.15.192:0/2350991926 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607414efdc0 2024-09-10T05:13:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.701+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5607415f2090 con 0x5607414efdc0 2024-09-10T05:13:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.701+0000 7feef5c31640 1 -- 172.21.15.192:0/2350991926 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feef000a4d0 con 0x5607414efdc0 2024-09-10T05:13:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.701+0000 7feef7946800 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5607415f3b90 0x5607415f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.701+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5607415f67a0 con 0x5607415f3b90 2024-09-10T05:13:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.701+0000 7feef5430640 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5607415f3b90 0x5607415f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.702+0000 7feef5430640 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5607415f3b90 0x5607415f6010 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.702+0000 7feef5430640 1 -- 172.21.15.192:0/2350991926 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feee8051070 con 0x5607415f3b90 2024-09-10T05:13:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.702+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5607415f28e0 con 0x5607414efdc0 2024-09-10T05:13:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.702+0000 7feef5c31640 1 -- 172.21.15.192:0/2350991926 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feef000a4d0 con 0x5607414efdc0 2024-09-10T05:13:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.702+0000 7feef7946800 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5607415f7c00 0x5607415f9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.702+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5607415fa760 con 0x5607415f7c00 2024-09-10T05:13:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.702+0000 7feeeffff640 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5607415f7c00 0x5607415f9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.703+0000 7feeeffff640 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5607415f7c00 0x5607415f9ff0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.703+0000 7feeeffff640 1 -- 172.21.15.192:0/2350991926 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feee0009050 con 0x5607415f7c00 2024-09-10T05:13:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.703+0000 7feef7946800 1 Processor -- start 2024-09-10T05:13:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.703+0000 7feef7946800 1 -- start start 2024-09-10T05:13:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.703+0000 7feef7946800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741608390 0x5607416087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.703+0000 7feef7946800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5607413e7a00 con 0x560741608390 2024-09-10T05:13:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.704+0000 7feef5430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741608390 0x5607416087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.704+0000 7feef5430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741608390 0x5607416087b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33414/0 (socket says 172.21.15.192:33414) 2024-09-10T05:13:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.704+0000 7feef5430640 1 -- 172.21.15.192:0/3031158504 learned_addr learned my addr 172.21.15.192:0/3031158504 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.704+0000 7feef5430640 1 -- 172.21.15.192:0/3031158504 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560741608df0 con 0x560741608390 2024-09-10T05:13:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.704+0000 7feef5430640 1 --2- 172.21.15.192:0/3031158504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741608390 0x5607416087b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7feee807a7b0 tx=0x7feee805c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.704+0000 7feddaffd640 1 -- 172.21.15.192:0/3031158504 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee80980b0 con 0x560741608390 2024-09-10T05:13:32.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.704+0000 7feddaffd640 1 -- 172.21.15.192:0/3031158504 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee8098250 con 0x560741608390 2024-09-10T05:13:32.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.704+0000 7feef7946800 1 -- 172.21.15.192:0/3031158504 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560741609620 con 0x560741608390 2024-09-10T05:13:32.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.704+0000 7feddaffd640 1 -- 172.21.15.192:0/3031158504 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee80952a0 con 0x560741608390 2024-09-10T05:13:32.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.704+0000 7feef7946800 1 -- 172.21.15.192:0/3031158504 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560741609bc0 con 0x560741608390 2024-09-10T05:13:32.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.705+0000 7feddaffd640 1 -- 172.21.15.192:0/3031158504 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7feee805c790 con 0x560741608390 2024-09-10T05:13:32.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.705+0000 7feddaffd640 1 --2- 172.21.15.192:0/3031158504 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fedcc03c780 0x7fedcc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.705+0000 7feddaffd640 1 -- 172.21.15.192:0/3031158504 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7feee806a0c0 con 0x560741608390 2024-09-10T05:13:32.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.705+0000 7feeeffff640 1 --2- 172.21.15.192:0/3031158504 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fedcc03c780 0x7fedcc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.705+0000 7feef7946800 1 Processor -- start 2024-09-10T05:13:32.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.706+0000 7feef7946800 1 -- start start 2024-09-10T05:13:32.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.706+0000 7feeeffff640 1 --2- 172.21.15.192:0/3031158504 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fedcc03c780 0x7fedcc03ec40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7feee000bf40 tx=0x7feee000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.706+0000 7feef7946800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 0x560741615010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.706+0000 7feef7946800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5607415e3060 con 0x560741614c30 2024-09-10T05:13:32.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.706+0000 7feef5430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 0x560741615010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.706+0000 7feef5430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 0x560741615010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33428/0 (socket says 172.21.15.192:33428) 2024-09-10T05:13:32.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.706+0000 7feef5430640 1 -- 172.21.15.192:0/3806025970 learned_addr learned my addr 172.21.15.192:0/3806025970 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.706+0000 7feef5430640 1 -- 172.21.15.192:0/3806025970 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607416155e0 con 0x560741614c30 2024-09-10T05:13:32.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.706+0000 7feef5430640 1 --2- 172.21.15.192:0/3806025970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 0x560741615010 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7feee807b750 tx=0x7feee805d450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c129b4cc2db441 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.706+0000 7fedd8ff9640 1 -- 172.21.15.192:0/3806025970 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee809d070 con 0x560741614c30 2024-09-10T05:13:32.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.706+0000 7fedd8ff9640 1 -- 172.21.15.192:0/3806025970 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee805ecf0 con 0x560741614c30 2024-09-10T05:13:32.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.706+0000 7fedd8ff9640 1 -- 172.21.15.192:0/3806025970 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee808a0d0 con 0x560741614c30 2024-09-10T05:13:32.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.707+0000 7feef7946800 1 -- 172.21.15.192:0/3806025970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 msgr2=0x560741615010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.707+0000 7feef7946800 1 --2- 172.21.15.192:0/3806025970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 0x560741615010 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7feee807b750 tx=0x7feee805d450 comp rx=0 tx=0).stop 2024-09-10T05:13:32.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.707+0000 7feef7946800 1 -- 172.21.15.192:0/3806025970 shutdown_connections 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.707+0000 7feef7946800 1 --2- 172.21.15.192:0/3806025970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 0x560741615010 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.707+0000 7feef7946800 1 -- 172.21.15.192:0/3806025970 >> 172.21.15.192:0/3806025970 conn(0x560741611030 msgr2=0x56074160f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.707+0000 7feef7946800 1 -- 172.21.15.192:0/3806025970 shutdown_connections 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.707+0000 7feef7946800 1 -- 172.21.15.192:0/3806025970 wait complete. 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.707+0000 7feef7946800 1 Processor -- start 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.707+0000 7feef7946800 1 -- start start 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.707+0000 7feef7946800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 0x56074161c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.707+0000 7feef7946800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560741615a90 con 0x560741614c30 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.708+0000 7feef5430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 0x56074161c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.708+0000 7feef5430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 0x56074161c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33430/0 (socket says 172.21.15.192:33430) 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.708+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 learned_addr learned my addr 172.21.15.192:0/22406921 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.708+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56074161c570 con 0x560741614c30 2024-09-10T05:13:32.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.708+0000 7feef5430640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 0x56074161c010 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7feee80a4040 tx=0x7feee805df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.708+0000 7fedcaffd640 1 -- 172.21.15.192:0/22406921 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee8098e30 con 0x560741614c30 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.708+0000 7fedcaffd640 1 -- 172.21.15.192:0/22406921 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee8096920 con 0x560741614c30 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.708+0000 7fedcaffd640 1 -- 172.21.15.192:0/22406921 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee805d970 con 0x560741614c30 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.708+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56074161c570 con 0x560741614c30 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.708+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56074161c570 con 0x560741614c30 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.709+0000 7fedcaffd640 1 -- 172.21.15.192:0/22406921 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7feee80b9020 con 0x560741614c30 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.710+0000 7fedcaffd640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fedc003c780 0x7fedc003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.710+0000 7feef7946800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.710+0000 7fedcaffd640 1 -- 172.21.15.192:0/22406921 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7feee804e140 con 0x560741614c30 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.710+0000 7feeeffff640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fedc003c780 0x7fedc003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.710+0000 7feef7946800 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5607416273d0 0x560741629860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.710+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560741629fb0 con 0x5607416273d0 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.710+0000 7feef5c31640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5607416273d0 0x560741629860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.710+0000 7feeeffff640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fedc003c780 0x7fedc003ec40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feee000c010 tx=0x7feee0010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.710+0000 7feef5c31640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5607416273d0 0x560741629860 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 20 realm 2024-09-10T05:13:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56074162a3c0 con 0x5607416273d0 2024-09-10T05:13:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56074162ac90 con 0x5607416273d0 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x5607416273d0 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56074162bb20 0x56074162df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56074162e650 con 0x56074162bb20 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.711+0000 7feef5430640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56074162bb20 0x56074162df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.712+0000 7feef5430640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56074162bb20 0x56074162df10 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.712+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.712+0000 7feef7946800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.712+0000 7feef7946800 20 searching for the correct realm 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.712+0000 7feef7946800 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560741630720 0x560741632be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.712+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5607416332b0 con 0x560741630720 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.712+0000 7feeeffff640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560741630720 0x560741632be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.713+0000 7feeeffff640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560741630720 0x560741632be0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.713+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.713+0000 7feeeffff640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7feee0037040 0x7feee0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.713+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5607416332b0 con 0x7feee0037040 2024-09-10T05:13:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.713+0000 7feef5c31640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7feee0037040 0x7feee0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.713+0000 7feef5c31640 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7feee0037040 0x7feee0036410 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.713+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.713+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x56074162bb20 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.714+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.714+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x5607416273d0 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.714+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.714+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x5607416273d0 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.714+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.714+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x56074162bb20 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.714+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.714+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x56074162bb20 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.715+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.715+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x7feee0037040 2024-09-10T05:13:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.715+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.715+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x560741630720 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.715+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.715+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x5607416273d0 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.715+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.715+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x56074162bb20 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.716+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.716+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x5607416273d0 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.716+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.716+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x7feee0037040 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.716+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.716+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x560741630720 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.716+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.716+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x560741630720 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.716+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.716+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x56074162bb20 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.717+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.717+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x560741630720 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.717+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.717+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x560741630720 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.717+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.717+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x5607416273d0 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.717+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.717+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x5607416273d0 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.718+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.718+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x7feee0037040 2024-09-10T05:13:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.718+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.718+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x560741630720 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.718+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.718+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x7feee0037040 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.718+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.718+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x5607416273d0 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.719+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.719+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x56074162bb20 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.719+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.719+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x560741630720 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.719+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.719+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x56074162bb20 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.719+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.719+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x7feee0037040 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.720+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.720+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x560741630720 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.720+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.720+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x7feee0037040 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.720+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.720+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x5607416273d0 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.720+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.720+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56074162b030 con 0x7feee0037040 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:32.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56074162f020 con 0x5607416273d0 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56074162f020 con 0x5607416273d0 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56074162efd0 con 0x7feee0037040 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 zone default found 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 4 Realm: () 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 zonegroup default 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.721+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56074162f410 con 0x56074162bb20 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feef7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feef7946800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56074162efd0 con 0x560741630720 2024-09-10T05:13:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feef7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feef7946800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560741635120 con 0x560741630720 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feef7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feef7946800 20 started sync module instance, tier type = 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feef7946800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.722+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416345c0 con 0x7feee0037040 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.723+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.723+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94589161786080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416345c0 con 0x7feee0037040 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.723+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560741635c80 con 0x5607416273d0 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.724+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94589161786080] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.725+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.725+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94589161789296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416345c0 con 0x5607416273d0 2024-09-10T05:13:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.725+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416366f0 con 0x560741630720 2024-09-10T05:13:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.726+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94589161789296] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.726+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.726+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94589161783568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560741634530 con 0x560741630720 2024-09-10T05:13:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.726+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416375b0 con 0x7feee0037040 2024-09-10T05:13:32.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.727+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94589161783568] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.727+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.727+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94589161795840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416379d0 con 0x7feee0037040 2024-09-10T05:13:32.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.727+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560741638390 con 0x5607416273d0 2024-09-10T05:13:32.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.728+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.728+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94589161799392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416387b0 con 0x5607416273d0 2024-09-10T05:13:32.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.728+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416391f0 con 0x56074162bb20 2024-09-10T05:13:32.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.728+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94589161795840] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.729+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.729+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94589161802944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416395e0 con 0x56074162bb20 2024-09-10T05:13:32.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.729+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560741639fe0 con 0x56074162bb20 2024-09-10T05:13:32.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.729+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94589161799392] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.730+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94589161802944] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.730+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.730+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94589161796896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560741639af0 con 0x56074162bb20 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.730+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56074163a4b0 con 0x56074162bb20 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.731+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94589161796896] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.731+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.731+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94589161800448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56074163a4b0 con 0x56074162bb20 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.731+0000 7feef7946800 20 add_watcher() i=0 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.731+0000 7feef7946800 20 add_watcher() i=1 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.731+0000 7feef7946800 20 add_watcher() i=2 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.731+0000 7feef7946800 20 add_watcher() i=3 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.731+0000 7feef7946800 20 add_watcher() i=4 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.731+0000 7feef7946800 20 add_watcher() i=5 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.731+0000 7feef7946800 20 add_watcher() i=6 2024-09-10T05:13:32.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.732+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94589161800448] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.732+0000 7feef7946800 20 add_watcher() i=7 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.732+0000 7feef7946800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.732+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56074163d8e0 con 0x5607416273d0 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.733+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.733+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94589161808336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56074163ae30 con 0x5607416273d0 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.734+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94589161808336] v37'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.734+0000 7fedab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.734+0000 7feef7946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.734+0000 7feef7946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.734+0000 7feef7946800 5 note: GC not initialized 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.734+0000 7fedaa7e4640 20 reqs_thread_entry: start 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.734+0000 7feef7946800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.734+0000 7feef7946800 20 Filter name: none 2024-09-10T05:13:32.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.735+0000 7fed1bfff640 20 reqs_thread_entry: start 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.735+0000 7feef7946800 20 rados->read ofs=0 len=0 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.735+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560741670400 con 0x5607416273d0 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.735+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.735+0000 7feef7946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:could not fetch user info: no user info saved 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.736+0000 7fedab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.736+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94589161808336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416703c0 con 0x5607416273d0 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.737+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94589161808336] v37'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.737+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94589161786080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416703c0 con 0x7feee0037040 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.738+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94589161786080] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.738+0000 7feef7946800 20 remove_watcher() i=0 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.738+0000 7feef7946800 2 removed watcher, disabling cache 2024-09-10T05:13:32.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.738+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94589161789296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416703c0 con 0x5607416273d0 2024-09-10T05:13:32.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.739+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94589161789296] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.739+0000 7feef7946800 20 remove_watcher() i=1 2024-09-10T05:13:32.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.739+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94589161783568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5607416703c0 con 0x560741630720 2024-09-10T05:13:32.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.740+0000 7feeeffff640 1 -- 172.21.15.192:0/22406921 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94589161783568] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee0009050 con 0x560741630720 2024-09-10T05:13:32.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.740+0000 7feef7946800 20 remove_watcher() i=2 2024-09-10T05:13:32.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.740+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94589161795840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560741634110 con 0x7feee0037040 2024-09-10T05:13:32.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.741+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94589161795840] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x7feee0037040 2024-09-10T05:13:32.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.741+0000 7feef7946800 20 remove_watcher() i=3 2024-09-10T05:13:32.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.741+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94589161799392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560741637100 con 0x5607416273d0 2024-09-10T05:13:32.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.743+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94589161799392] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x5607416273d0 2024-09-10T05:13:32.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.743+0000 7feef7946800 20 remove_watcher() i=4 2024-09-10T05:13:32.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.743+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94589161802944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560741634110 con 0x56074162bb20 2024-09-10T05:13:32.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.744+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94589161802944] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.744+0000 7feef7946800 20 remove_watcher() i=5 2024-09-10T05:13:32.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.744+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94589161796896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560741637ee0 con 0x56074162bb20 2024-09-10T05:13:32.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.745+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94589161796896] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.745+0000 7feef7946800 20 remove_watcher() i=6 2024-09-10T05:13:32.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.745+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94589161800448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560741634110 con 0x56074162bb20 2024-09-10T05:13:32.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef5430640 1 -- 172.21.15.192:0/22406921 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94589161800448] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee809f070 con 0x56074162bb20 2024-09-10T05:13:32.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 20 remove_watcher() i=7 2024-09-10T05:13:32.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56074162bb20 msgr2=0x56074162df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56074162bb20 0x56074162df10 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5607416273d0 msgr2=0x560741629860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5607416273d0 0x560741629860 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7feee0037040 msgr2=0x7feee0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7feee0037040 0x7feee0036410 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560741630720 msgr2=0x560741632be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560741630720 0x560741632be0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fedc003c780 msgr2=0x7fedc003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fedc003c780 0x7fedc003ec40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feee000c010 tx=0x7feee0010000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 msgr2=0x56074161c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef5c31640 1 -- 172.21.15.192:0/22406921 reap_dead start 2024-09-10T05:13:32.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 0x56074161c010 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7feee80a4040 tx=0x7feee805df30 comp rx=0 tx=0).stop 2024-09-10T05:13:32.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 shutdown_connections 2024-09-10T05:13:32.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 --2- 172.21.15.192:0/22406921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741614c30 0x56074161c010 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 >> 172.21.15.192:0/22406921 conn(0x560741611030 msgr2=0x56074160f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 shutdown_connections 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 -- 172.21.15.192:0/22406921 wait complete. 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 -- 172.21.15.192:0/3031158504 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fedcc03c780 msgr2=0x7fedcc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 --2- 172.21.15.192:0/3031158504 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fedcc03c780 0x7fedcc03ec40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7feee000bf40 tx=0x7feee000f000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 -- 172.21.15.192:0/3031158504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741608390 msgr2=0x5607416087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.746+0000 7feef7946800 1 --2- 172.21.15.192:0/3031158504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741608390 0x5607416087b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7feee807a7b0 tx=0x7feee805c4d0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/3031158504 shutdown_connections 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 --2- 172.21.15.192:0/3031158504 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fedcc03c780 0x7fedcc03ec40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 --2- 172.21.15.192:0/3031158504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560741608390 0x5607416087b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/3031158504 >> 172.21.15.192:0/3031158504 conn(0x5607415fc6f0 msgr2=0x5607415fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/3031158504 shutdown_connections 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/3031158504 wait complete. 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5607415f3b90 msgr2=0x5607415f6010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5607415f3b90 0x5607415f6010 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5607414efdc0 msgr2=0x5607415f17b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5607414efdc0 0x5607415f17b0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5607415f7c00 msgr2=0x5607415f9ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5607415f7c00 0x5607415f9ff0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feddc03c780 msgr2=0x7feddc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7feddc03c780 0x7feddc03ec40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feee0001d70 tx=0x7feee00012d0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 msgr2=0x5607415ea160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 --2- 172.21.15.192:0/2350991926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5607414ef480 0x5607415ea160 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7feee800a470 tx=0x7feee8002fb0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef5c31640 1 -- 172.21.15.192:0/2350991926 reap_dead start 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 shutdown_connections 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 >> 172.21.15.192:0/2350991926 conn(0x5607414eb1b0 msgr2=0x5607415dc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 shutdown_connections 2024-09-10T05:13:32.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.747+0000 7feef7946800 1 -- 172.21.15.192:0/2350991926 wait complete. 2024-09-10T05:13:32.756 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T05:13:32.756 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-10T05:13:32.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-10T05:13:32.757 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-10T05:13:32.801 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:32.801 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:32.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.801+0000 7f6c51342800 1 Processor -- start 2024-09-10T05:13:32.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.801+0000 7f6c51342800 1 -- start start 2024-09-10T05:13:32.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.801+0000 7f6c51342800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562ee1e6e580 0x562ee1e6e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.801+0000 7f6c51342800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562ee1d19e40 con 0x562ee1e6eec0 2024-09-10T05:13:32.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.801+0000 7f6c51342800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x562ee1ce4680 con 0x562ee1e6e580 2024-09-10T05:13:32.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.801+0000 7f6c4d0ed640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562ee1e6e580 0x562ee1e6e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.801+0000 7f6c47fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x562ee1e6eec0 0x562ee1e6f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46482/0 (socket says 172.21.15.192:46482) 2024-09-10T05:13:32.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.801+0000 7f6c47fff640 1 -- 172.21.15.192:0/4231627801 learned_addr learned my addr 172.21.15.192:0/4231627801 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:32.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.801+0000 7f6c4d0ed640 1 -- 172.21.15.192:0/4231627801 >> v1:172.21.15.139:6789/0 conn(0x562ee1e6eec0 legacy=0x562ee1e6f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.801+0000 7f6c4c8ec640 1 -- 172.21.15.192:0/4231627801 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1046726914 0 0) 0x562ee1d19e40 con 0x562ee1e6eec0 2024-09-10T05:13:32.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.801+0000 7f6c4d0ed640 1 -- 172.21.15.192:0/4231627801 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee1d006b0 con 0x562ee1e6e580 2024-09-10T05:13:32.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.803+0000 7f6c4d0ed640 1 --2- 172.21.15.192:0/4231627801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1e6e980 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000a470 tx=0x7f6c40045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808e7b059225af80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.803+0000 7f6c4c8ec640 1 -- 172.21.15.192:0/4231627801 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c40053570 con 0x562ee1e6e580 2024-09-10T05:13:32.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.803+0000 7f6c4c8ec640 1 -- 172.21.15.192:0/4231627801 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c40058070 con 0x562ee1e6e580 2024-09-10T05:13:32.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.803+0000 7f6c4c8ec640 1 -- 172.21.15.192:0/4231627801 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c40053880 con 0x562ee1e6e580 2024-09-10T05:13:32.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.804+0000 7f6c51342800 1 -- 172.21.15.192:0/4231627801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 msgr2=0x562ee1e6e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.804+0000 7f6c51342800 1 --2- 172.21.15.192:0/4231627801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1e6e980 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000a470 tx=0x7f6c40045a20 comp rx=0 tx=0).stop 2024-09-10T05:13:32.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.804+0000 7f6c51342800 1 -- 172.21.15.192:0/4231627801 shutdown_connections 2024-09-10T05:13:32.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.804+0000 7f6c51342800 1 --2- 172.21.15.192:0/4231627801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1e6e980 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.804+0000 7f6c51342800 1 -- 172.21.15.192:0/4231627801 >> 172.21.15.192:0/4231627801 conn(0x562ee1e6a2d0 msgr2=0x562ee1e6c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.804+0000 7f6c51342800 1 -- 172.21.15.192:0/4231627801 shutdown_connections 2024-09-10T05:13:32.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.804+0000 7f6c51342800 1 -- 172.21.15.192:0/4231627801 wait complete. 2024-09-10T05:13:32.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.818+0000 7f6c51342800 1 Processor -- start 2024-09-10T05:13:32.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.818+0000 7f6c51342800 1 -- start start 2024-09-10T05:13:32.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.818+0000 7f6c51342800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1f616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.818+0000 7f6c51342800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562ee1d08dd0 con 0x562ee1e6e580 2024-09-10T05:13:32.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.818+0000 7f6c4d0ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1f616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.818+0000 7f6c4d0ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1f616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33440/0 (socket says 172.21.15.192:33440) 2024-09-10T05:13:32.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.818+0000 7f6c4d0ed640 1 -- 172.21.15.192:0/3687764113 learned_addr learned my addr 172.21.15.192:0/3687764113 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.819+0000 7f6c4d0ed640 1 -- 172.21.15.192:0/3687764113 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee1d21e10 con 0x562ee1e6e580 2024-09-10T05:13:32.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.819+0000 7f6c4d0ed640 1 --2- 172.21.15.192:0/3687764113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1f616e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000a470 tx=0x7f6c40051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e71d657cd98c762 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.819+0000 7f6b3b606640 1 -- 172.21.15.192:0/3687764113 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c40053570 con 0x562ee1e6e580 2024-09-10T05:13:32.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.819+0000 7f6b3b606640 1 -- 172.21.15.192:0/3687764113 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c40063030 con 0x562ee1e6e580 2024-09-10T05:13:32.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.819+0000 7f6b3b606640 1 -- 172.21.15.192:0/3687764113 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c40053840 con 0x562ee1e6e580 2024-09-10T05:13:32.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.820+0000 7f6c51342800 1 -- 172.21.15.192:0/3687764113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 msgr2=0x562ee1f616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.820+0000 7f6c51342800 1 --2- 172.21.15.192:0/3687764113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1f616e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000a470 tx=0x7f6c40051000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.820+0000 7f6c51342800 1 -- 172.21.15.192:0/3687764113 shutdown_connections 2024-09-10T05:13:32.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.820+0000 7f6c51342800 1 --2- 172.21.15.192:0/3687764113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1f616e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.820+0000 7f6c51342800 1 -- 172.21.15.192:0/3687764113 >> 172.21.15.192:0/3687764113 conn(0x562ee1e6a2d0 msgr2=0x562ee1f5d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.820+0000 7f6c51342800 1 -- 172.21.15.192:0/3687764113 shutdown_connections 2024-09-10T05:13:32.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.820+0000 7f6c51342800 1 -- 172.21.15.192:0/3687764113 wait complete. 2024-09-10T05:13:32.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.820+0000 7f6c51342800 1 Processor -- start 2024-09-10T05:13:32.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.820+0000 7f6c51342800 1 -- start start 2024-09-10T05:13:32.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.820+0000 7f6c51342800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1f68fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.820+0000 7f6c51342800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562ee1e6fde0 con 0x562ee1e6e580 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.821+0000 7f6c4d0ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1f68fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.821+0000 7f6c4d0ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1f68fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33448/0 (socket says 172.21.15.192:33448) 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.821+0000 7f6c4d0ed640 1 -- 172.21.15.192:0/1059587053 learned_addr learned my addr 172.21.15.192:0/1059587053 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.821+0000 7f6c4d0ed640 1 -- 172.21.15.192:0/1059587053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee1f69520 con 0x562ee1e6e580 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.821+0000 7f6c4d0ed640 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1f68fc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000a470 tx=0x7f6c40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.821+0000 7f6b39e03640 1 -- 172.21.15.192:0/1059587053 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c40078070 con 0x562ee1e6e580 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.821+0000 7f6b39e03640 1 -- 172.21.15.192:0/1059587053 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c40068420 con 0x562ee1e6e580 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.821+0000 7f6b39e03640 1 -- 172.21.15.192:0/1059587053 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c40068700 con 0x562ee1e6e580 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.821+0000 7f6c51342800 1 -- 172.21.15.192:0/1059587053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ee1f697b0 con 0x562ee1e6e580 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.821+0000 7f6c51342800 1 -- 172.21.15.192:0/1059587053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ee1f6a3c0 con 0x562ee1e6e580 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.822+0000 7f6c51342800 1 Processor -- start 2024-09-10T05:13:32.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.822+0000 7f6c51342800 1 -- start start 2024-09-10T05:13:32.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.822+0000 7f6b39e03640 1 -- 172.21.15.192:0/1059587053 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6c4007b070 con 0x562ee1e6e580 2024-09-10T05:13:32.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.822+0000 7f6c51342800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 0x562ee1f78860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.822+0000 7f6c51342800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562ee1d66a00 con 0x562ee1f76470 2024-09-10T05:13:32.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.822+0000 7f6b39e03640 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6b3403c780 0x7f6b3403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.822+0000 7f6b39e03640 1 -- 172.21.15.192:0/1059587053 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6c400978e0 con 0x562ee1e6e580 2024-09-10T05:13:32.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.822+0000 7f6c4d8ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 0x562ee1f78860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.822+0000 7f6c4d8ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 0x562ee1f78860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33456/0 (socket says 172.21.15.192:33456) 2024-09-10T05:13:32.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.822+0000 7f6c4d8ee640 1 -- 172.21.15.192:0/2189783777 learned_addr learned my addr 172.21.15.192:0/2189783777 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.822+0000 7f6c4d0ed640 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6b3403c780 0x7f6b3403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6c4d8ee640 1 -- 172.21.15.192:0/2189783777 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee1f78e30 con 0x562ee1f76470 2024-09-10T05:13:32.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6c4d0ed640 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6b3403c780 0x7f6b3403ec40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6c40068a10 tx=0x7f6c40068960 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6c4d8ee640 1 --2- 172.21.15.192:0/2189783777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 0x562ee1f78860 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800a3e0 tx=0x7f6c4800a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e5f2fafdd26e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6b337fe640 1 -- 172.21.15.192:0/2189783777 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c48015070 con 0x562ee1f76470 2024-09-10T05:13:32.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6b337fe640 1 -- 172.21.15.192:0/2189783777 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c48001670 con 0x562ee1f76470 2024-09-10T05:13:32.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6b337fe640 1 -- 172.21.15.192:0/2189783777 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c48001990 con 0x562ee1f76470 2024-09-10T05:13:32.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6c51342800 1 -- 172.21.15.192:0/2189783777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 msgr2=0x562ee1f78860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6c51342800 1 --2- 172.21.15.192:0/2189783777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 0x562ee1f78860 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800a3e0 tx=0x7f6c4800a8a0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6c51342800 1 -- 172.21.15.192:0/2189783777 shutdown_connections 2024-09-10T05:13:32.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6c51342800 1 --2- 172.21.15.192:0/2189783777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 0x562ee1f78860 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6c51342800 1 -- 172.21.15.192:0/2189783777 >> 172.21.15.192:0/2189783777 conn(0x562ee1e6eec0 msgr2=0x562ee1f70d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6c51342800 1 -- 172.21.15.192:0/2189783777 shutdown_connections 2024-09-10T05:13:32.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.823+0000 7f6c51342800 1 -- 172.21.15.192:0/2189783777 wait complete. 2024-09-10T05:13:32.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.824+0000 7f6c51342800 1 Processor -- start 2024-09-10T05:13:32.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.824+0000 7f6c51342800 1 -- start start 2024-09-10T05:13:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.824+0000 7f6c51342800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 0x562ee1f7d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.824+0000 7f6c51342800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562ee1f79120 con 0x562ee1f76470 2024-09-10T05:13:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.824+0000 7f6c4d8ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 0x562ee1f7d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.824+0000 7f6c4d8ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 0x562ee1f7d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33468/0 (socket says 172.21.15.192:33468) 2024-09-10T05:13:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.824+0000 7f6c4d8ee640 1 -- 172.21.15.192:0/2026224478 learned_addr learned my addr 172.21.15.192:0/2026224478 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.824+0000 7f6c4d8ee640 1 -- 172.21.15.192:0/2026224478 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee1f7d8c0 con 0x562ee1f76470 2024-09-10T05:13:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.824+0000 7f6c4d8ee640 1 --2- 172.21.15.192:0/2026224478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 0x562ee1f7d360 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6c48013040 tx=0x7f6c48003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.825+0000 7f6b31ffb640 1 -- 172.21.15.192:0/2026224478 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c48020020 con 0x562ee1f76470 2024-09-10T05:13:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.825+0000 7f6b31ffb640 1 -- 172.21.15.192:0/2026224478 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c48010780 con 0x562ee1f76470 2024-09-10T05:13:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.825+0000 7f6b31ffb640 1 -- 172.21.15.192:0/2026224478 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c48015040 con 0x562ee1f76470 2024-09-10T05:13:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.825+0000 7f6c51342800 1 -- 172.21.15.192:0/2026224478 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ee1f7db50 con 0x562ee1f76470 2024-09-10T05:13:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.825+0000 7f6c51342800 1 -- 172.21.15.192:0/2026224478 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ee1f7e4d0 con 0x562ee1f76470 2024-09-10T05:13:32.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.825+0000 7f6b31ffb640 1 -- 172.21.15.192:0/2026224478 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6c48023020 con 0x562ee1f76470 2024-09-10T05:13:32.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.826+0000 7f6b31ffb640 1 --2- 172.21.15.192:0/2026224478 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6b2803c780 0x7f6b2803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.826+0000 7f6b31ffb640 1 -- 172.21.15.192:0/2026224478 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6c480532c0 con 0x562ee1f76470 2024-09-10T05:13:32.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.826+0000 7f6c47fff640 1 --2- 172.21.15.192:0/2026224478 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6b2803c780 0x7f6b2803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.826+0000 7f6c51342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:32.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.826+0000 7f6c51342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:32.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.826+0000 7f6c47fff640 1 --2- 172.21.15.192:0/2026224478 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6b2803c780 0x7f6b2803ec40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c38000c00 tx=0x7f6c38001330 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.826+0000 7f6c51342800 1 Processor -- start 2024-09-10T05:13:32.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.826+0000 7f6c51342800 1 -- start start 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.826+0000 7f6c51342800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f971b0 0x562ee1f975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.826+0000 7f6c51342800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562ee1f61ed0 con 0x562ee1f971b0 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.827+0000 7f6c4d0ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f971b0 0x562ee1f975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.827+0000 7f6c4d0ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f971b0 0x562ee1f975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33484/0 (socket says 172.21.15.192:33484) 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.827+0000 7f6c4d0ed640 1 -- 172.21.15.192:0/2731249277 learned_addr learned my addr 172.21.15.192:0/2731249277 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.827+0000 7f6c4d0ed640 1 -- 172.21.15.192:0/2731249277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee1f97c10 con 0x562ee1f971b0 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.827+0000 7f6c4d0ed640 1 --2- 172.21.15.192:0/2731249277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f971b0 0x562ee1f975d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6c40095c90 tx=0x7f6c40068e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.827+0000 7f6b11fe3640 1 -- 172.21.15.192:0/2731249277 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c4009c070 con 0x562ee1f971b0 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.827+0000 7f6b11fe3640 1 -- 172.21.15.192:0/2731249277 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c40097c60 con 0x562ee1f971b0 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.827+0000 7f6b11fe3640 1 -- 172.21.15.192:0/2731249277 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c4007c5c0 con 0x562ee1f971b0 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.827+0000 7f6c51342800 1 -- 172.21.15.192:0/2731249277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ee1f98440 con 0x562ee1f971b0 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.827+0000 7f6c51342800 1 -- 172.21.15.192:0/2731249277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ee1f989e0 con 0x562ee1f971b0 2024-09-10T05:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.828+0000 7f6b11fe3640 1 -- 172.21.15.192:0/2731249277 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6c4009f070 con 0x562ee1f971b0 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.828+0000 7f6b11fe3640 1 --2- 172.21.15.192:0/2731249277 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6a9003c780 0x7f6a9003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.828+0000 7f6b11fe3640 1 -- 172.21.15.192:0/2731249277 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6c40092030 con 0x562ee1f971b0 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.828+0000 7f6c47fff640 1 --2- 172.21.15.192:0/2731249277 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6a9003c780 0x7f6a9003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.829+0000 7f6a8b7fe640 20 reqs_thread_entry: start 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.829+0000 7f6c47fff640 1 --2- 172.21.15.192:0/2731249277 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6a9003c780 0x7f6a9003ec40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6c38000f60 tx=0x7f6c38006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.829+0000 7f6c51342800 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562ee1fa4b20 0x562ee1fa6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.829+0000 7f6c51342800 1 -- 172.21.15.192:0/1059587053 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ee1fa7660 con 0x562ee1fa4b20 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.829+0000 7f6c4d8ee640 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562ee1fa4b20 0x562ee1fa6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.829+0000 7f6c4d8ee640 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562ee1fa4b20 0x562ee1fa6f90 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.829+0000 7f6c4d8ee640 1 -- 172.21.15.192:0/1059587053 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c4800e070 con 0x562ee1fa4b20 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.829+0000 7f6c51342800 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562ee1fa9430 0x562ee1fab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.829+0000 7f6c51342800 1 -- 172.21.15.192:0/1059587053 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:2 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ee1fabf20 con 0x562ee1fa9430 2024-09-10T05:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.830+0000 7f6c4d0ed640 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562ee1fa9430 0x562ee1fab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.830+0000 7f6c4d0ed640 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562ee1fa9430 0x562ee1fab820 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.830+0000 7f6c4d0ed640 1 -- 172.21.15.192:0/1059587053 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(2 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c4009e030 con 0x562ee1fa9430 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 -- 172.21.15.192:0/2026224478 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6b2803c780 msgr2=0x7f6b2803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 --2- 172.21.15.192:0/2026224478 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6b2803c780 0x7f6b2803ec40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c38000c00 tx=0x7f6c38001330 comp rx=0 tx=0).stop 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 -- 172.21.15.192:0/2026224478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 msgr2=0x562ee1f7d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 --2- 172.21.15.192:0/2026224478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 0x562ee1f7d360 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6c48013040 tx=0x7f6c48003370 comp rx=0 tx=0).stop 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 -- 172.21.15.192:0/2026224478 shutdown_connections 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 --2- 172.21.15.192:0/2026224478 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6b2803c780 0x7f6b2803ec40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 --2- 172.21.15.192:0/2026224478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f76470 0x562ee1f7d360 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 -- 172.21.15.192:0/2026224478 >> 172.21.15.192:0/2026224478 conn(0x562ee1e6eec0 msgr2=0x562ee1f70d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 -- 172.21.15.192:0/2026224478 shutdown_connections 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 -- 172.21.15.192:0/2026224478 wait complete. 2024-09-10T05:13:32.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 -- 172.21.15.192:0/2731249277 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6a9003c780 msgr2=0x7f6a9003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 --2- 172.21.15.192:0/2731249277 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6a9003c780 0x7f6a9003ec40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6c38000f60 tx=0x7f6c38006000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 -- 172.21.15.192:0/2731249277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f971b0 msgr2=0x562ee1f975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.831+0000 7f6c51342800 1 --2- 172.21.15.192:0/2731249277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f971b0 0x562ee1f975d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6c40095c90 tx=0x7f6c40068e00 comp rx=0 tx=0).stop 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 -- 172.21.15.192:0/2731249277 shutdown_connections 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 --2- 172.21.15.192:0/2731249277 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6a9003c780 0x7f6a9003ec40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 --2- 172.21.15.192:0/2731249277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1f971b0 0x562ee1f975d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 -- 172.21.15.192:0/2731249277 >> 172.21.15.192:0/2731249277 conn(0x562ee1f8c730 msgr2=0x562ee1f8cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 -- 172.21.15.192:0/2731249277 shutdown_connections 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 -- 172.21.15.192:0/2731249277 wait complete. 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 -- 172.21.15.192:0/1059587053 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562ee1fa9430 msgr2=0x562ee1fab820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562ee1fa9430 0x562ee1fab820 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 -- 172.21.15.192:0/1059587053 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562ee1fa4b20 msgr2=0x562ee1fa6f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562ee1fa4b20 0x562ee1fa6f90 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 -- 172.21.15.192:0/1059587053 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6b3403c780 msgr2=0x7f6b3403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6b3403c780 0x7f6b3403ec40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6c40068a10 tx=0x7f6c40068960 comp rx=0 tx=0).stop 2024-09-10T05:13:32.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 -- 172.21.15.192:0/1059587053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 msgr2=0x562ee1f68fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1f68fc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000a470 tx=0x7f6c40002fb0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 -- 172.21.15.192:0/1059587053 shutdown_connections 2024-09-10T05:13:32.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562ee1fa9430 0x562ee1fab820 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562ee1fa4b20 0x562ee1fa6f90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6b3403c780 0x7f6b3403ec40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 --2- 172.21.15.192:0/1059587053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562ee1e6e580 0x562ee1f68fc0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 -- 172.21.15.192:0/1059587053 >> 172.21.15.192:0/1059587053 conn(0x562ee1e6a2d0 msgr2=0x562ee1f5b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 -- 172.21.15.192:0/1059587053 shutdown_connections 2024-09-10T05:13:32.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.832+0000 7f6c51342800 1 -- 172.21.15.192:0/1059587053 wait complete. 2024-09-10T05:13:32.843 INFO:teuthology.orchestra.run.smithi192.stdout:{"id":"92aa256a-2802-419e-96e0-ba675846cbc3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T05:13:32.844 DEBUG:tasks.util.rgw: json result: {'id': '92aa256a-2802-419e-96e0-ba675846cbc3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T05:13:32.844 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-10T05:13:32.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-10T05:13:32.844 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-10T05:13:32.925 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:32.925 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:32.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.925+0000 7fe9cd70c800 1 Processor -- start 2024-09-10T05:13:32.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.925+0000 7fe9cd70c800 1 -- start start 2024-09-10T05:13:32.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.926+0000 7fe9cd70c800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562170480440 0x562170486da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.926+0000 7fe9cd70c800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56217032ae40 con 0x562170481650 2024-09-10T05:13:32.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.926+0000 7fe9cd70c800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5621702f5680 con 0x562170480440 2024-09-10T05:13:32.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.926+0000 7fe9ca9f5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562170480440 0x562170486da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.926+0000 7fe9cb1f6640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x562170481650 0x56217047fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46488/0 (socket says 172.21.15.192:46488) 2024-09-10T05:13:32.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.926+0000 7fe9ca9f5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562170480440 0x562170486da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33488/0 (socket says 172.21.15.192:33488) 2024-09-10T05:13:32.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.926+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/4180003185 learned_addr learned my addr 172.21.15.192:0/4180003185 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:32.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.926+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/4180003185 >> v1:172.21.15.139:6789/0 conn(0x562170481650 legacy=0x56217047fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.926+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/4180003185 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621703116b0 con 0x562170480440 2024-09-10T05:13:32.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.926+0000 7fe9ca1f4640 1 -- 172.21.15.192:0/4180003185 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834018658 0 0) 0x56217032ae40 con 0x562170481650 2024-09-10T05:13:32.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.928+0000 7fe9ca9f5640 1 --2- 172.21.15.192:0/4180003185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x562170486da0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000a470 tx=0x7fe9c0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d17c2a1f1a6e8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.928+0000 7fe9ca1f4640 1 -- 172.21.15.192:0/4180003185 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c0053570 con 0x562170480440 2024-09-10T05:13:32.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.928+0000 7fe9ca1f4640 1 -- 172.21.15.192:0/4180003185 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c0058070 con 0x562170480440 2024-09-10T05:13:32.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.928+0000 7fe9ca1f4640 1 -- 172.21.15.192:0/4180003185 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c0053880 con 0x562170480440 2024-09-10T05:13:32.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.928+0000 7fe9cd70c800 1 -- 172.21.15.192:0/4180003185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 msgr2=0x562170486da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.928+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/4180003185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x562170486da0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000a470 tx=0x7fe9c0045a20 comp rx=0 tx=0).stop 2024-09-10T05:13:32.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.929+0000 7fe9cd70c800 1 -- 172.21.15.192:0/4180003185 shutdown_connections 2024-09-10T05:13:32.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.929+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/4180003185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x562170486da0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.929+0000 7fe9cd70c800 1 -- 172.21.15.192:0/4180003185 >> 172.21.15.192:0/4180003185 conn(0x56217047a910 msgr2=0x56217047cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.929+0000 7fe9cd70c800 1 -- 172.21.15.192:0/4180003185 shutdown_connections 2024-09-10T05:13:32.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.929+0000 7fe9cd70c800 1 -- 172.21.15.192:0/4180003185 wait complete. 2024-09-10T05:13:32.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.942+0000 7fe9cd70c800 1 Processor -- start 2024-09-10T05:13:32.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.942+0000 7fe9cd70c800 1 -- start start 2024-09-10T05:13:32.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.942+0000 7fe9cd70c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x56217056f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.942+0000 7fe9cd70c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562170319dd0 con 0x562170480440 2024-09-10T05:13:32.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.943+0000 7fe9cb1f6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x56217056f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.943+0000 7fe9cb1f6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x56217056f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33500/0 (socket says 172.21.15.192:33500) 2024-09-10T05:13:32.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.943+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/2252966447 learned_addr learned my addr 172.21.15.192:0/2252966447 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.943+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/2252966447 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562170332e10 con 0x562170480440 2024-09-10T05:13:32.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.943+0000 7fe9cb1f6640 1 --2- 172.21.15.192:0/2252966447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x56217056f5c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc001dc0 tx=0x7fe9bc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65976c8cda52f690 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.943+0000 7fe8b960a640 1 -- 172.21.15.192:0/2252966447 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9bc012020 con 0x562170480440 2024-09-10T05:13:32.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.943+0000 7fe8b960a640 1 -- 172.21.15.192:0/2252966447 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9bc00e5a0 con 0x562170480440 2024-09-10T05:13:32.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.943+0000 7fe8b960a640 1 -- 172.21.15.192:0/2252966447 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9bc00e8c0 con 0x562170480440 2024-09-10T05:13:32.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.944+0000 7fe9cd70c800 1 -- 172.21.15.192:0/2252966447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 msgr2=0x56217056f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.944+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/2252966447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x56217056f5c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc001dc0 tx=0x7fe9bc00b6c0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.944+0000 7fe9cd70c800 1 -- 172.21.15.192:0/2252966447 shutdown_connections 2024-09-10T05:13:32.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.944+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/2252966447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x56217056f5c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.944+0000 7fe9cd70c800 1 -- 172.21.15.192:0/2252966447 >> 172.21.15.192:0/2252966447 conn(0x56217047a910 msgr2=0x56217056af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.944+0000 7fe9cd70c800 1 -- 172.21.15.192:0/2252966447 shutdown_connections 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.944+0000 7fe9cd70c800 1 -- 172.21.15.192:0/2252966447 wait complete. 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.944+0000 7fe9cd70c800 1 Processor -- start 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.945+0000 7fe9cd70c800 1 -- start start 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.945+0000 7fe9cd70c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x56217047f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.945+0000 7fe9cd70c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5621704872e0 con 0x562170480440 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.945+0000 7fe9cb1f6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x56217047f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.945+0000 7fe9cb1f6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x56217047f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33508/0 (socket says 172.21.15.192:33508) 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.945+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 learned_addr learned my addr 172.21.15.192:0/3893856618 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.945+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217047fa20 con 0x562170480440 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.945+0000 7fe9cb1f6640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x56217047f4e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc000fb0 tx=0x7fe9bc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.945+0000 7fe8b7e07640 1 -- 172.21.15.192:0/3893856618 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9bc012030 con 0x562170480440 2024-09-10T05:13:32.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.945+0000 7fe8b7e07640 1 -- 172.21.15.192:0/3893856618 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9bc01a7a0 con 0x562170480440 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.945+0000 7fe8b7e07640 1 -- 172.21.15.192:0/3893856618 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9bc01ab00 con 0x562170480440 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.945+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56217057cff0 con 0x562170480440 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.946+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56217057d450 con 0x562170480440 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.946+0000 7fe9cd70c800 1 Processor -- start 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.946+0000 7fe9cd70c800 1 -- start start 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.946+0000 7fe9cd70c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 0x562170589ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.946+0000 7fe9cd70c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562170377a00 con 0x5621705876f0 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.946+0000 7fe8b7e07640 1 -- 172.21.15.192:0/3893856618 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe9bc015020 con 0x562170480440 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.947+0000 7fe9cb9f7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 0x562170589ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.947+0000 7fe9cb9f7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 0x562170589ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33520/0 (socket says 172.21.15.192:33520) 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.947+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3012342170 learned_addr learned my addr 172.21.15.192:0/3012342170 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.947+0000 7fe8b7e07640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe8b003c780 0x7fe8b003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.947+0000 7fe8b7e07640 1 -- 172.21.15.192:0/3893856618 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe9bc020030 con 0x562170480440 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.947+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3012342170 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217058a0b0 con 0x5621705876f0 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.947+0000 7fe9cb1f6640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe8b003c780 0x7fe8b003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.947+0000 7fe9cb9f7640 1 --2- 172.21.15.192:0/3012342170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 0x562170589ae0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400a3e0 tx=0x7fe9c400a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc79a21df94b346 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.947+0000 7fe8b5e03640 1 -- 172.21.15.192:0/3012342170 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c4015070 con 0x5621705876f0 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.947+0000 7fe8b5e03640 1 -- 172.21.15.192:0/3012342170 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c4001670 con 0x5621705876f0 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.947+0000 7fe8b5e03640 1 -- 172.21.15.192:0/3012342170 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c4001990 con 0x5621705876f0 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3012342170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 msgr2=0x562170589ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cb1f6640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe8b003c780 0x7fe8b003ec40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00c010 tx=0x7fe9bc00bee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/3012342170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 0x562170589ae0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400a3e0 tx=0x7fe9c400a8a0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3012342170 shutdown_connections 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/3012342170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 0x562170589ae0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3012342170 >> 172.21.15.192:0/3012342170 conn(0x562170481650 msgr2=0x562170582010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3012342170 shutdown_connections 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3012342170 wait complete. 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cd70c800 1 Processor -- start 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cd70c800 1 -- start start 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cd70c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 0x56217058e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cd70c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56217058a400 con 0x5621705876f0 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cb9f7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 0x56217058e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cb9f7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 0x56217058e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33526/0 (socket says 172.21.15.192:33526) 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/1889126294 learned_addr learned my addr 172.21.15.192:0/1889126294 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.948+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/1889126294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217058eb90 con 0x5621705876f0 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.949+0000 7fe9cb9f7640 1 --2- 172.21.15.192:0/1889126294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 0x56217058e630 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4013040 tx=0x7fe9c4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.949+0000 7fe8a7fff640 1 -- 172.21.15.192:0/1889126294 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c4020020 con 0x5621705876f0 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.949+0000 7fe8a7fff640 1 -- 172.21.15.192:0/1889126294 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c4010780 con 0x5621705876f0 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.949+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1889126294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56217058ee20 con 0x5621705876f0 2024-09-10T05:13:32.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.949+0000 7fe8a7fff640 1 -- 172.21.15.192:0/1889126294 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c4015040 con 0x5621705876f0 2024-09-10T05:13:32.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.949+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1889126294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56217058f7a0 con 0x5621705876f0 2024-09-10T05:13:32.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.950+0000 7fe8a7fff640 1 -- 172.21.15.192:0/1889126294 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe9c4023020 con 0x5621705876f0 2024-09-10T05:13:32.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.950+0000 7fe8a7fff640 1 --2- 172.21.15.192:0/1889126294 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe8ac03c780 0x7fe8ac03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.950+0000 7fe8a7fff640 1 -- 172.21.15.192:0/1889126294 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe9c40532c0 con 0x5621705876f0 2024-09-10T05:13:32.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.950+0000 7fe9ca9f5640 1 --2- 172.21.15.192:0/1889126294 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe8ac03c780 0x7fe8ac03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.950+0000 7fe9cd70c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:32.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.950+0000 7fe9cd70c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:32.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.950+0000 7fe9cd70c800 1 Processor -- start 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.950+0000 7fe9ca9f5640 1 --2- 172.21.15.192:0/1889126294 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe8ac03c780 0x7fe8ac03ec40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0057000 tx=0x7fe9c0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.951+0000 7fe9cd70c800 1 -- start start 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.951+0000 7fe9cd70c800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705a84c0 0x5621705a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.951+0000 7fe9cd70c800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56217056fe10 con 0x5621705a84c0 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.951+0000 7fe9cb1f6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705a84c0 0x5621705a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.951+0000 7fe9cb1f6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705a84c0 0x5621705a88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33538/0 (socket says 172.21.15.192:33538) 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.951+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/1574793841 learned_addr learned my addr 172.21.15.192:0/1574793841 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.951+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/1574793841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621705a8f20 con 0x5621705a84c0 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.951+0000 7fe9cb1f6640 1 --2- 172.21.15.192:0/1574793841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705a84c0 0x5621705a88e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0011b0 tx=0x7fe9bc0249e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.951+0000 7fe84bfff640 1 -- 172.21.15.192:0/1574793841 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9bc008d30 con 0x5621705a84c0 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.951+0000 7fe84bfff640 1 -- 172.21.15.192:0/1574793841 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9bc045070 con 0x5621705a84c0 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.951+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1574793841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621705a9750 con 0x5621705a84c0 2024-09-10T05:13:32.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.952+0000 7fe84bfff640 1 -- 172.21.15.192:0/1574793841 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9bc006410 con 0x5621705a84c0 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.952+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1574793841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621705a9cf0 con 0x5621705a84c0 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.952+0000 7fe84bfff640 1 -- 172.21.15.192:0/1574793841 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe9bc00c360 con 0x5621705a84c0 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.952+0000 7fe84bfff640 1 --2- 172.21.15.192:0/1574793841 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe80403c780 0x7fe80403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.952+0000 7fe84bfff640 1 -- 172.21.15.192:0/1574793841 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe9bc04bd80 con 0x5621705a84c0 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.952+0000 7fe9ca9f5640 1 --2- 172.21.15.192:0/1574793841 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe80403c780 0x7fe80403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.953+0000 7fe849ffb640 20 reqs_thread_entry: start 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.953+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5621705b5f70 0x5621705b8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.953+0000 7fe9ca9f5640 1 --2- 172.21.15.192:0/1574793841 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe80403c780 0x7fe80403ec40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0045a60 tx=0x7fe9c0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.953+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621705b8a80 con 0x5621705b5f70 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.953+0000 7fe9cb9f7640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5621705b5f70 0x5621705b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.953+0000 7fe9cb9f7640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5621705b5f70 0x5621705b8400 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.953+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.953+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621705b9330 con 0x5621705b5f70 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.954+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.954+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5621705bac40 0x5621705bd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.954+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621705bd820 con 0x5621705bac40 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.954+0000 7fe9cb1f6640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5621705bac40 0x5621705bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.954+0000 7fe9cb1f6640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5621705bac40 0x5621705bd090 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.954+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe9bc05c040 con 0x5621705bac40 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.955+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621705ca960 con 0x5621705b5f70 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.955+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:NOTICE: set zone's realm_id= 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.955+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5621705c1d20 0x5621705c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.955+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705c1d20 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.955+0000 7fe9ca9f5640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5621705c1d20 0x5621705c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.955+0000 7fe9ca9f5640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5621705c1d20 0x5621705c4c50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.956+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(5 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0051070 con 0x5621705c1d20 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.956+0000 7fe9ca9f5640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe9c0078040 0x7fe9c0078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.956+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x7fe9c0078040 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.956+0000 7fe9cb9f7640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe9c0078040 0x7fe9c0078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.956+0000 7fe9cb9f7640 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe9c0078040 0x7fe9c0078930 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.956+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe9c400e070 con 0x7fe9c0078040 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.956+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705bac40 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.956+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9bc05c040 con 0x5621705bac40 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.957+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705b5f70 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.957+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.957+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705b5f70 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.957+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.957+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705bac40 2024-09-10T05:13:32.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.957+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9bc05c040 con 0x5621705bac40 2024-09-10T05:13:32.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.957+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705bac40 2024-09-10T05:13:32.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.957+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9bc05c040 con 0x5621705bac40 2024-09-10T05:13:32.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.957+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x7fe9c0078040 2024-09-10T05:13:32.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.958+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c400e070 con 0x7fe9c0078040 2024-09-10T05:13:32.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.958+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705c1d20 2024-09-10T05:13:32.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.958+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0051070 con 0x5621705c1d20 2024-09-10T05:13:32.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.958+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705b5f70 2024-09-10T05:13:32.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.958+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.958+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705bac40 2024-09-10T05:13:32.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.958+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9bc05c040 con 0x5621705bac40 2024-09-10T05:13:32.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.958+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705b5f70 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.959+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.959+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x7fe9c0078040 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.959+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(17 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe9c400e070 con 0x7fe9c0078040 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.959+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705c1d20 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.959+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0051070 con 0x5621705c1d20 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.959+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705c1d20 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.959+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0051070 con 0x5621705c1d20 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.959+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705bac40 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.960+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9bc05c040 con 0x5621705bac40 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.960+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705c1d20 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.960+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0051070 con 0x5621705c1d20 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.960+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705c1d20 2024-09-10T05:13:32.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.960+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0051070 con 0x5621705c1d20 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.960+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705b5f70 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.960+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.960+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705b5f70 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.960+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.960+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x7fe9c0078040 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.961+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(25 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c400e070 con 0x7fe9c0078040 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.961+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705c1d20 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.961+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0051070 con 0x5621705c1d20 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.961+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x7fe9c0078040 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.961+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c400e070 con 0x7fe9c0078040 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.961+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705b5f70 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.961+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.961+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705bac40 2024-09-10T05:13:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.962+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9bc05c040 con 0x5621705bac40 2024-09-10T05:13:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.962+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705c1d20 2024-09-10T05:13:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.962+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0051070 con 0x5621705c1d20 2024-09-10T05:13:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.962+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705bac40 2024-09-10T05:13:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.962+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe9bc05c040 con 0x5621705bac40 2024-09-10T05:13:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.962+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x7fe9c0078040 2024-09-10T05:13:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.962+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c400e070 con 0x7fe9c0078040 2024-09-10T05:13:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.962+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705c1d20 2024-09-10T05:13:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.963+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c0051070 con 0x5621705c1d20 2024-09-10T05:13:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.963+0000 7fe9ca9f5640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x7fe9c0078040 2024-09-10T05:13:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.963+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c400e070 con 0x7fe9c0078040 2024-09-10T05:13:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.963+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x5621705b5f70 2024-09-10T05:13:32.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.963+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(35 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.963+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621705c47d0 con 0x7fe9c0078040 2024-09-10T05:13:32.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.963+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(36 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c400e070 con 0x7fe9c0078040 2024-09-10T05:13:32.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.963+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621705c8830 con 0x5621705b5f70 2024-09-10T05:13:32.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.963+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.963+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:38 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621705c71b0 con 0x5621705bac40 2024-09-10T05:13:32.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.964+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(38 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe9bc05c040 con 0x5621705bac40 2024-09-10T05:13:32.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.964+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:39 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621705c4060 con 0x5621705bac40 2024-09-10T05:13:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.966+0000 7fe9cb1f6640 1 -- 172.21.15.192:0/3893856618 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(39 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [create,call,writefull 0~1155] v37'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fe9bc05c040 con 0x5621705bac40 2024-09-10T05:13:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.966+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621705c5e00 con 0x5621705b5f70 2024-09-10T05:13:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.967+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v37'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.967+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621705ca200 con 0x5621705b5f70 2024-09-10T05:13:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.968+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v37'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fe9c400e070 con 0x5621705b5f70 2024-09-10T05:13:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.968+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1889126294 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe8ac03c780 msgr2=0x7fe8ac03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.968+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/1889126294 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe8ac03c780 0x7fe8ac03ec40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0057000 tx=0x7fe9c0052000 comp rx=0 tx=0).stop 2024-09-10T05:13:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.968+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1889126294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 msgr2=0x56217058e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.968+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/1889126294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 0x56217058e630 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4013040 tx=0x7fe9c4003370 comp rx=0 tx=0).stop 2024-09-10T05:13:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1889126294 shutdown_connections 2024-09-10T05:13:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/1889126294 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe8ac03c780 0x7fe8ac03ec40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/1889126294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705876f0 0x56217058e630 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1889126294 >> 172.21.15.192:0/1889126294 conn(0x562170481650 msgr2=0x562170581fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1889126294 shutdown_connections 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1889126294 wait complete. 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1574793841 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe80403c780 msgr2=0x7fe80403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/1574793841 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe80403c780 0x7fe80403ec40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0045a60 tx=0x7fe9c0005a00 comp rx=0 tx=0).stop 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1574793841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705a84c0 msgr2=0x5621705a88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/1574793841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705a84c0 0x5621705a88e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0011b0 tx=0x7fe9bc0249e0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1574793841 shutdown_connections 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/1574793841 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe80403c780 0x7fe80403ec40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/1574793841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621705a84c0 0x5621705a88e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1574793841 >> 172.21.15.192:0/1574793841 conn(0x56217059da20 msgr2=0x56217059de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1574793841 shutdown_connections 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/1574793841 wait complete. 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5621705bac40 msgr2=0x5621705bd090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5621705bac40 0x5621705bd090 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5621705b5f70 msgr2=0x5621705b8400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5621705b5f70 0x5621705b8400 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe9c0078040 msgr2=0x7fe9c0078930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe9c0078040 0x7fe9c0078930 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5621705c1d20 msgr2=0x5621705c4c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5621705c1d20 0x5621705c4c50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe8b003c780 msgr2=0x7fe8b003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe8b003c780 0x7fe8b003ec40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00c010 tx=0x7fe9bc00bee0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 msgr2=0x56217047f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:32.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cb9f7640 1 -- 172.21.15.192:0/3893856618 reap_dead start 2024-09-10T05:13:32.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.969+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x56217047f4e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc000fb0 tx=0x7fe9bc000ed0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.970+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 shutdown_connections 2024-09-10T05:13:32.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.970+0000 7fe9cd70c800 1 --2- 172.21.15.192:0/3893856618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562170480440 0x56217047f4e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:32.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.970+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 >> 172.21.15.192:0/3893856618 conn(0x56217047a910 msgr2=0x5621705708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:32.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.970+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 shutdown_connections 2024-09-10T05:13:32.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:32.970+0000 7fe9cd70c800 1 -- 172.21.15.192:0/3893856618 wait complete. 2024-09-10T05:13:32.981 INFO:teuthology.orchestra.run.smithi192.stdout:{"id":"92aa256a-2802-419e-96e0-ba675846cbc3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-10T05:13:32.981 DEBUG:tasks.util.rgw: json result: {'id': '92aa256a-2802-419e-96e0-ba675846cbc3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-10T05:13:32.981 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-10T05:13:32.981 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-10T05:13:32.982 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-10T05:13:33.063 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:33.063 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:33.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.063+0000 7fb011e13800 1 Processor -- start 2024-09-10T05:13:33.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.063+0000 7fb011e13800 1 -- start start 2024-09-10T05:13:33.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.063+0000 7fb011e13800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55fa175d1670 0x55fa175d3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.063+0000 7fb011e13800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa1747ae40 con 0x55fa175d4000 2024-09-10T05:13:33.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.063+0000 7fb011e13800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55fa17445680 con 0x55fa175d1670 2024-09-10T05:13:33.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.063+0000 7fb00d522640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55fa175d1670 0x55fa175d3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.063+0000 7fb004d21640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55fa175d4000 0x55fa175d64c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46494/0 (socket says 172.21.15.192:46494) 2024-09-10T05:13:33.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.063+0000 7fb004d21640 1 -- 172.21.15.192:0/2779540967 learned_addr learned my addr 172.21.15.192:0/2779540967 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:33.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.063+0000 7fb00d522640 1 -- 172.21.15.192:0/2779540967 >> v1:172.21.15.139:6789/0 conn(0x55fa175d4000 legacy=0x55fa175d64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.063+0000 7fb00d522640 1 -- 172.21.15.192:0/2779540967 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa174616b0 con 0x55fa175d1670 2024-09-10T05:13:33.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.063+0000 7fb00cd21640 1 -- 172.21.15.192:0/2779540967 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3409744323 0 0) 0x55fa1747ae40 con 0x55fa175d4000 2024-09-10T05:13:33.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.065+0000 7fb00d522640 1 --2- 172.21.15.192:0/2779540967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa175d3a60 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb00000a470 tx=0x7fb000045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56eabdaf3f17530 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.065+0000 7fb00cd21640 1 -- 172.21.15.192:0/2779540967 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb000053570 con 0x55fa175d1670 2024-09-10T05:13:33.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.065+0000 7fb00cd21640 1 -- 172.21.15.192:0/2779540967 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb000058070 con 0x55fa175d1670 2024-09-10T05:13:33.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.065+0000 7fb00cd21640 1 -- 172.21.15.192:0/2779540967 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb000053880 con 0x55fa175d1670 2024-09-10T05:13:33.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.066+0000 7fb011e13800 1 -- 172.21.15.192:0/2779540967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 msgr2=0x55fa175d3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.066+0000 7fb011e13800 1 --2- 172.21.15.192:0/2779540967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa175d3a60 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb00000a470 tx=0x7fb000045a20 comp rx=0 tx=0).stop 2024-09-10T05:13:33.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.066+0000 7fb011e13800 1 -- 172.21.15.192:0/2779540967 shutdown_connections 2024-09-10T05:13:33.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.066+0000 7fb011e13800 1 --2- 172.21.15.192:0/2779540967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa175d3a60 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.066+0000 7fb011e13800 1 -- 172.21.15.192:0/2779540967 >> 172.21.15.192:0/2779540967 conn(0x55fa175cb1b0 msgr2=0x55fa175cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.066+0000 7fb011e13800 1 -- 172.21.15.192:0/2779540967 shutdown_connections 2024-09-10T05:13:33.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.066+0000 7fb011e13800 1 -- 172.21.15.192:0/2779540967 wait complete. 2024-09-10T05:13:33.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.080+0000 7fb011e13800 1 Processor -- start 2024-09-10T05:13:33.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.080+0000 7fb011e13800 1 -- start start 2024-09-10T05:13:33.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.080+0000 7fb011e13800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa176c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.080+0000 7fb011e13800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fa17469dd0 con 0x55fa175d1670 2024-09-10T05:13:33.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.080+0000 7fb00d522640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa176c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.080+0000 7fb00d522640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa176c04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33556/0 (socket says 172.21.15.192:33556) 2024-09-10T05:13:33.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.080+0000 7fb00d522640 1 -- 172.21.15.192:0/839016046 learned_addr learned my addr 172.21.15.192:0/839016046 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.080+0000 7fb00d522640 1 -- 172.21.15.192:0/839016046 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa17482e10 con 0x55fa175d1670 2024-09-10T05:13:33.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.081+0000 7fb00d522640 1 --2- 172.21.15.192:0/839016046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa176c04c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb000025c20 tx=0x7fb000051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c453dc17a9f3344 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.081+0000 7faefb606640 1 -- 172.21.15.192:0/839016046 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb000053a20 con 0x55fa175d1670 2024-09-10T05:13:33.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.081+0000 7faefb606640 1 -- 172.21.15.192:0/839016046 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb000063070 con 0x55fa175d1670 2024-09-10T05:13:33.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.081+0000 7faefb606640 1 -- 172.21.15.192:0/839016046 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb000053d30 con 0x55fa175d1670 2024-09-10T05:13:33.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.081+0000 7fb011e13800 1 -- 172.21.15.192:0/839016046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 msgr2=0x55fa176c04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.081+0000 7fb011e13800 1 --2- 172.21.15.192:0/839016046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa176c04c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb000025c20 tx=0x7fb000051000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.082+0000 7fb011e13800 1 -- 172.21.15.192:0/839016046 shutdown_connections 2024-09-10T05:13:33.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.082+0000 7fb011e13800 1 --2- 172.21.15.192:0/839016046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa176c04c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.082+0000 7fb011e13800 1 -- 172.21.15.192:0/839016046 >> 172.21.15.192:0/839016046 conn(0x55fa175cb1b0 msgr2=0x55fa176bbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.082+0000 7fb011e13800 1 -- 172.21.15.192:0/839016046 shutdown_connections 2024-09-10T05:13:33.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.082+0000 7fb011e13800 1 -- 172.21.15.192:0/839016046 wait complete. 2024-09-10T05:13:33.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.082+0000 7fb011e13800 1 Processor -- start 2024-09-10T05:13:33.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.082+0000 7fb011e13800 1 -- start start 2024-09-10T05:13:33.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.082+0000 7fb011e13800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa176c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.082+0000 7fb011e13800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fa175d8020 con 0x55fa175d1670 2024-09-10T05:13:33.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.082+0000 7fb00d522640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa176c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.082+0000 7fb00d522640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa176c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33570/0 (socket says 172.21.15.192:33570) 2024-09-10T05:13:33.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.082+0000 7fb00d522640 1 -- 172.21.15.192:0/399771937 learned_addr learned my addr 172.21.15.192:0/399771937 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.083+0000 7fb00d522640 1 -- 172.21.15.192:0/399771937 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa176c82f0 con 0x55fa175d1670 2024-09-10T05:13:33.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.083+0000 7fb00d522640 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa176c7d90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb000025c20 tx=0x7fb000002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.083+0000 7faef9e03640 1 -- 172.21.15.192:0/399771937 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb000078070 con 0x55fa175d1670 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.083+0000 7faef9e03640 1 -- 172.21.15.192:0/399771937 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb000073470 con 0x55fa175d1670 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.083+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa176c8580 con 0x55fa175d1670 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.083+0000 7faef9e03640 1 -- 172.21.15.192:0/399771937 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb000073750 con 0x55fa175d1670 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.083+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa176c9190 con 0x55fa175d1670 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7fb011e13800 1 Processor -- start 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7fb011e13800 1 -- start start 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7fb011e13800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 0x55fa176d7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7fb011e13800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fa174c7a00 con 0x55fa176d5280 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7faef9e03640 1 -- 172.21.15.192:0/399771937 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb00007b070 con 0x55fa175d1670 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7fb00dd23640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 0x55fa176d7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7fb00dd23640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 0x55fa176d7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33576/0 (socket says 172.21.15.192:33576) 2024-09-10T05:13:33.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7fb00dd23640 1 -- 172.21.15.192:0/3614092608 learned_addr learned my addr 172.21.15.192:0/3614092608 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7faef9e03640 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faef403c780 0x7faef403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7faef9e03640 1 -- 172.21.15.192:0/399771937 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fb000097b90 con 0x55fa175d1670 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7fb00d522640 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faef403c780 0x7faef403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7fb00dd23640 1 -- 172.21.15.192:0/3614092608 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa176d7c40 con 0x55fa176d5280 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.084+0000 7fb00dd23640 1 --2- 172.21.15.192:0/3614092608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 0x55fa176d7670 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb00800a3e0 tx=0x7fb00800a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f93a98cd072dddc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7fb00d522640 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faef403c780 0x7faef403ec40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb00005f590 tx=0x7fb00005f420 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7faef37fe640 1 -- 172.21.15.192:0/3614092608 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb008015070 con 0x55fa176d5280 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7faef37fe640 1 -- 172.21.15.192:0/3614092608 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb008001670 con 0x55fa176d5280 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7faef37fe640 1 -- 172.21.15.192:0/3614092608 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb008001990 con 0x55fa176d5280 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7fb011e13800 1 -- 172.21.15.192:0/3614092608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 msgr2=0x55fa176d7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7fb011e13800 1 --2- 172.21.15.192:0/3614092608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 0x55fa176d7670 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb00800a3e0 tx=0x7fb00800a8a0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7fb011e13800 1 -- 172.21.15.192:0/3614092608 shutdown_connections 2024-09-10T05:13:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7fb011e13800 1 --2- 172.21.15.192:0/3614092608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 0x55fa176d7670 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7fb011e13800 1 -- 172.21.15.192:0/3614092608 >> 172.21.15.192:0/3614092608 conn(0x55fa175d4000 msgr2=0x55fa176cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7fb011e13800 1 -- 172.21.15.192:0/3614092608 shutdown_connections 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7fb011e13800 1 -- 172.21.15.192:0/3614092608 wait complete. 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7fb011e13800 1 Processor -- start 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.085+0000 7fb011e13800 1 -- start start 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.086+0000 7fb011e13800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 0x55fa176dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.086+0000 7fb011e13800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fa176d7f30 con 0x55fa176d5280 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.086+0000 7fb00dd23640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 0x55fa176dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.086+0000 7fb00dd23640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 0x55fa176dc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33586/0 (socket says 172.21.15.192:33586) 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.086+0000 7fb00dd23640 1 -- 172.21.15.192:0/2833171764 learned_addr learned my addr 172.21.15.192:0/2833171764 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.086+0000 7fb00dd23640 1 -- 172.21.15.192:0/2833171764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa176dc600 con 0x55fa176d5280 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.086+0000 7fb00dd23640 1 --2- 172.21.15.192:0/2833171764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 0x55fa176dc0a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55fa176d0580 tx=0x7fb008003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.086+0000 7faef1ffb640 1 -- 172.21.15.192:0/2833171764 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb008020020 con 0x55fa176d5280 2024-09-10T05:13:33.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.086+0000 7faef1ffb640 1 -- 172.21.15.192:0/2833171764 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb008010780 con 0x55fa176d5280 2024-09-10T05:13:33.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.086+0000 7faef1ffb640 1 -- 172.21.15.192:0/2833171764 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb008015040 con 0x55fa176d5280 2024-09-10T05:13:33.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.086+0000 7fb011e13800 1 -- 172.21.15.192:0/2833171764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa176dc890 con 0x55fa176d5280 2024-09-10T05:13:33.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.086+0000 7fb011e13800 1 -- 172.21.15.192:0/2833171764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa176dd210 con 0x55fa176d5280 2024-09-10T05:13:33.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.087+0000 7faef1ffb640 1 -- 172.21.15.192:0/2833171764 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb008023020 con 0x55fa176d5280 2024-09-10T05:13:33.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.087+0000 7faef1ffb640 1 --2- 172.21.15.192:0/2833171764 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faee403c730 0x7faee403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.088+0000 7faef1ffb640 1 -- 172.21.15.192:0/2833171764 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fb008053490 con 0x55fa176d5280 2024-09-10T05:13:33.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.088+0000 7fb004d21640 1 --2- 172.21.15.192:0/2833171764 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faee403c730 0x7faee403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.088+0000 7fb011e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:33.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.088+0000 7fb011e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:33.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.088+0000 7fb004d21640 1 --2- 172.21.15.192:0/2833171764 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faee403c730 0x7faee403ebf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faff8000c00 tx=0x7faff8001330 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.088+0000 7fb011e13800 1 Processor -- start 2024-09-10T05:13:33.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.088+0000 7fb011e13800 1 -- start start 2024-09-10T05:13:33.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.088+0000 7fb011e13800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d0e10 0x55fa175cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.088+0000 7fb011e13800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fa176c0cb0 con 0x55fa175d0e10 2024-09-10T05:13:33.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.089+0000 7fb00d522640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d0e10 0x55fa175cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.089+0000 7fb00d522640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d0e10 0x55fa175cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33592/0 (socket says 172.21.15.192:33592) 2024-09-10T05:13:33.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.089+0000 7fb00d522640 1 -- 172.21.15.192:0/2924230512 learned_addr learned my addr 172.21.15.192:0/2924230512 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.089+0000 7fb00d522640 1 -- 172.21.15.192:0/2924230512 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa175d1330 con 0x55fa175d0e10 2024-09-10T05:13:33.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.089+0000 7fb00d522640 1 --2- 172.21.15.192:0/2924230512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d0e10 0x55fa175cf680 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb00007c570 tx=0x7fb000068ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.089+0000 7faed27dc640 1 -- 172.21.15.192:0/2924230512 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb00009c070 con 0x55fa175d0e10 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.089+0000 7faed27dc640 1 -- 172.21.15.192:0/2924230512 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00007cd10 con 0x55fa175d0e10 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.089+0000 7fb011e13800 1 -- 172.21.15.192:0/2924230512 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa175cfbc0 con 0x55fa175d0e10 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.089+0000 7faed27dc640 1 -- 172.21.15.192:0/2924230512 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb000068470 con 0x55fa175d0e10 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.089+0000 7fb011e13800 1 -- 172.21.15.192:0/2924230512 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa175d0110 con 0x55fa175d0e10 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.090+0000 7faed27dc640 1 -- 172.21.15.192:0/2924230512 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb00009f070 con 0x55fa175d0e10 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.090+0000 7faed27dc640 1 --2- 172.21.15.192:0/2924230512 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fae5003c780 0x7fae5003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.090+0000 7faed27dc640 1 -- 172.21.15.192:0/2924230512 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fb000092030 con 0x55fa175d0e10 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.090+0000 7fb004d21640 1 --2- 172.21.15.192:0/2924230512 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fae5003c780 0x7fae5003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.091+0000 7fb004d21640 1 --2- 172.21.15.192:0/2924230512 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fae5003c780 0x7fae5003ec40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faff8000f60 tx=0x7faff8006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.091+0000 7fae43fff640 20 reqs_thread_entry: start 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.091+0000 7fb011e13800 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fa17705a30 0x55fa17707ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.091+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa17708540 con 0x55fa17705a30 2024-09-10T05:13:33.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.091+0000 7fb00dd23640 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fa17705a30 0x55fa17707ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.091+0000 7fb00dd23640 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fa17705a30 0x55fa17707ec0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.091+0000 7fb00dd23640 1 -- 172.21.15.192:0/399771937 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb00800e070 con 0x55fa17705a30 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.091+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa17708df0 con 0x55fa17705a30 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.092+0000 7fb00dd23640 1 -- 172.21.15.192:0/399771937 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb00800e070 con 0x55fa17705a30 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.092+0000 7fb011e13800 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fa1770a6b0 0x55fa1770cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.092+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa1770d2d0 con 0x55fa1770a6b0 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.092+0000 7fb00d522640 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fa1770a6b0 0x55fa1770cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.092+0000 7fb00d522640 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fa1770a6b0 0x55fa1770cb40 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.093+0000 7fb00d522640 1 -- 172.21.15.192:0/399771937 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fb00009e030 con 0x55fa1770a6b0 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.093+0000 7fb011e13800 1 -- 172.21.15.192:0/2833171764 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faee403c730 msgr2=0x7faee403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.093+0000 7fb011e13800 1 --2- 172.21.15.192:0/2833171764 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faee403c730 0x7faee403ebf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faff8000c00 tx=0x7faff8001330 comp rx=0 tx=0).stop 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.093+0000 7fb011e13800 1 -- 172.21.15.192:0/2833171764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 msgr2=0x55fa176dc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.093+0000 7fb011e13800 1 --2- 172.21.15.192:0/2833171764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 0x55fa176dc0a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55fa176d0580 tx=0x7fb008003370 comp rx=0 tx=0).stop 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.093+0000 7fb011e13800 1 -- 172.21.15.192:0/2833171764 shutdown_connections 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.093+0000 7fb011e13800 1 --2- 172.21.15.192:0/2833171764 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faee403c730 0x7faee403ebf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.093+0000 7fb011e13800 1 --2- 172.21.15.192:0/2833171764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa176d5280 0x55fa176dc0a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.093+0000 7fb011e13800 1 -- 172.21.15.192:0/2833171764 >> 172.21.15.192:0/2833171764 conn(0x55fa175d4000 msgr2=0x55fa176cfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/2833171764 shutdown_connections 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/2833171764 wait complete. 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/2924230512 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fae5003c780 msgr2=0x7fae5003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 --2- 172.21.15.192:0/2924230512 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fae5003c780 0x7fae5003ec40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faff8000f60 tx=0x7faff8006000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/2924230512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d0e10 msgr2=0x55fa175cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 --2- 172.21.15.192:0/2924230512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d0e10 0x55fa175cf680 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb00007c570 tx=0x7fb000068ea0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/2924230512 shutdown_connections 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 --2- 172.21.15.192:0/2924230512 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fae5003c780 0x7fae5003ec40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 --2- 172.21.15.192:0/2924230512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d0e10 0x55fa175cf680 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/2924230512 >> 172.21.15.192:0/2924230512 conn(0x55fa176eb470 msgr2=0x55fa176eb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/2924230512 shutdown_connections 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/2924230512 wait complete. 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fa1770a6b0 msgr2=0x55fa1770cb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fa1770a6b0 0x55fa1770cb40 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fa17705a30 msgr2=0x55fa17707ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fa17705a30 0x55fa17707ec0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faef403c780 msgr2=0x7faef403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faef403c780 0x7faef403ec40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb00005f590 tx=0x7fb00005f420 comp rx=0 tx=0).stop 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 msgr2=0x55fa176c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa176c7d90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb000025c20 tx=0x7fb000002fb0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 shutdown_connections 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55fa1770a6b0 0x55fa1770cb40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55fa17705a30 0x55fa17707ec0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7faef403c780 0x7faef403ec40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 --2- 172.21.15.192:0/399771937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fa175d1670 0x55fa176c7d90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 >> 172.21.15.192:0/399771937 conn(0x55fa175cb1b0 msgr2=0x55fa176c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 shutdown_connections 2024-09-10T05:13:33.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.094+0000 7fb011e13800 1 -- 172.21.15.192:0/399771937 wait complete. 2024-09-10T05:13:33.104 INFO:teuthology.orchestra.run.smithi192.stdout:{"id":"92aa256a-2802-419e-96e0-ba675846cbc3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-10T05:13:33.104 DEBUG:tasks.util.rgw: json result: {'id': '92aa256a-2802-419e-96e0-ba675846cbc3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-10T05:13:33.104 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T05:13:33.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-10T05:13:33.105 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-10T05:13:33.191 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:33.191 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:33.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.191+0000 7f3d9c926800 1 Processor -- start 2024-09-10T05:13:33.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.191+0000 7f3d9c926800 1 -- start start 2024-09-10T05:13:33.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.191+0000 7f3d9c926800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5557783fb340 0x5557783fd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.191+0000 7f3d9c926800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5557782a0e40 con 0x5557783f7740 2024-09-10T05:13:33.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.191+0000 7f3d9c926800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55577826b680 con 0x5557783fb340 2024-09-10T05:13:33.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.192+0000 7f3d97d08640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5557783fb340 0x5557783fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.192+0000 7f3d98509640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x5557783f7740 0x5557783f9b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46496/0 (socket says 172.21.15.192:46496) 2024-09-10T05:13:33.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.192+0000 7f3d98509640 1 -- 172.21.15.192:0/2752960854 learned_addr learned my addr 172.21.15.192:0/2752960854 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:33.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.192+0000 7f3d97d08640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5557783fb340 0x5557783fd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33608/0 (socket says 172.21.15.192:33608) 2024-09-10T05:13:33.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.192+0000 7f3d97d08640 1 -- 172.21.15.192:0/2752960854 >> v1:172.21.15.139:6789/0 conn(0x5557783f7740 legacy=0x5557783f9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.192+0000 7f3d97507640 1 -- 172.21.15.192:0/2752960854 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 955473374 0 0) 0x5557782a0e40 con 0x5557783f7740 2024-09-10T05:13:33.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.192+0000 7f3d97d08640 1 -- 172.21.15.192:0/2752960854 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557782876b0 con 0x5557783fb340 2024-09-10T05:13:33.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.194+0000 7f3d97d08640 1 --2- 172.21.15.192:0/2752960854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783fb340 0x5557783fd800 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00a470 tx=0x7f3d8c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669c701236934cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.194+0000 7f3d97507640 1 -- 172.21.15.192:0/2752960854 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8c053570 con 0x5557783fb340 2024-09-10T05:13:33.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.194+0000 7f3d97507640 1 -- 172.21.15.192:0/2752960854 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8c058070 con 0x5557783fb340 2024-09-10T05:13:33.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.194+0000 7f3d97507640 1 -- 172.21.15.192:0/2752960854 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8c053880 con 0x5557783fb340 2024-09-10T05:13:33.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.194+0000 7f3d9c926800 1 -- 172.21.15.192:0/2752960854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783fb340 msgr2=0x5557783fd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.194+0000 7f3d9c926800 1 --2- 172.21.15.192:0/2752960854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783fb340 0x5557783fd800 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00a470 tx=0x7f3d8c045a20 comp rx=0 tx=0).stop 2024-09-10T05:13:33.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.194+0000 7f3d9c926800 1 -- 172.21.15.192:0/2752960854 shutdown_connections 2024-09-10T05:13:33.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.194+0000 7f3d9c926800 1 --2- 172.21.15.192:0/2752960854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783fb340 0x5557783fd800 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.194+0000 7f3d9c926800 1 -- 172.21.15.192:0/2752960854 >> 172.21.15.192:0/2752960854 conn(0x5557783f1320 msgr2=0x5557783f3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.194+0000 7f3d9c926800 1 -- 172.21.15.192:0/2752960854 shutdown_connections 2024-09-10T05:13:33.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.194+0000 7f3d9c926800 1 -- 172.21.15.192:0/2752960854 wait complete. 2024-09-10T05:13:33.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.208+0000 7f3d9c926800 1 Processor -- start 2024-09-10T05:13:33.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.208+0000 7f3d9c926800 1 -- start start 2024-09-10T05:13:33.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.208+0000 7f3d9c926800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 0x5557784e65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.208+0000 7f3d9c926800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55577828fdd0 con 0x5557783f7740 2024-09-10T05:13:33.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.208+0000 7f3d98509640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 0x5557784e65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.208+0000 7f3d98509640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 0x5557784e65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33616/0 (socket says 172.21.15.192:33616) 2024-09-10T05:13:33.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.208+0000 7f3d98509640 1 -- 172.21.15.192:0/1739822242 learned_addr learned my addr 172.21.15.192:0/1739822242 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.209+0000 7f3d98509640 1 -- 172.21.15.192:0/1739822242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557782a8e10 con 0x5557783f7740 2024-09-10T05:13:33.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.209+0000 7f3d98509640 1 --2- 172.21.15.192:0/1739822242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 0x5557784e65a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3d88001ea0 tx=0x7f3d8800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b1eb7b78f1b3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.209+0000 7f3c8660c640 1 -- 172.21.15.192:0/1739822242 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d88008070 con 0x5557783f7740 2024-09-10T05:13:33.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.209+0000 7f3c8660c640 1 -- 172.21.15.192:0/1739822242 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8800d500 con 0x5557783f7740 2024-09-10T05:13:33.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.209+0000 7f3c8660c640 1 -- 172.21.15.192:0/1739822242 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8800d880 con 0x5557783f7740 2024-09-10T05:13:33.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.210+0000 7f3d9c926800 1 -- 172.21.15.192:0/1739822242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 msgr2=0x5557784e65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.210+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1739822242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 0x5557784e65a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3d88001ea0 tx=0x7f3d8800b6a0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.210+0000 7f3d9c926800 1 -- 172.21.15.192:0/1739822242 shutdown_connections 2024-09-10T05:13:33.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.210+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1739822242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 0x5557784e65a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.210+0000 7f3d9c926800 1 -- 172.21.15.192:0/1739822242 >> 172.21.15.192:0/1739822242 conn(0x5557783f1320 msgr2=0x5557784e1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.210+0000 7f3d9c926800 1 -- 172.21.15.192:0/1739822242 shutdown_connections 2024-09-10T05:13:33.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.210+0000 7f3d9c926800 1 -- 172.21.15.192:0/1739822242 wait complete. 2024-09-10T05:13:33.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.210+0000 7f3d9c926800 1 Processor -- start 2024-09-10T05:13:33.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.210+0000 7f3d9c926800 1 -- start start 2024-09-10T05:13:33.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.210+0000 7f3d9c926800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 0x5557784edec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.210+0000 7f3d9c926800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5557783fe180 con 0x5557783f7740 2024-09-10T05:13:33.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.210+0000 7f3d98509640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 0x5557784edec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.211+0000 7f3d98509640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 0x5557784edec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33620/0 (socket says 172.21.15.192:33620) 2024-09-10T05:13:33.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.211+0000 7f3d98509640 1 -- 172.21.15.192:0/1992966130 learned_addr learned my addr 172.21.15.192:0/1992966130 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.211+0000 7f3d98509640 1 -- 172.21.15.192:0/1992966130 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557784ee420 con 0x5557783f7740 2024-09-10T05:13:33.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.211+0000 7f3d98509640 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 0x5557784edec0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3d880012f0 tx=0x7f3d88000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.211+0000 7f3c84e09640 1 -- 172.21.15.192:0/1992966130 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8800f9d0 con 0x5557783f7740 2024-09-10T05:13:33.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.211+0000 7f3c84e09640 1 -- 172.21.15.192:0/1992966130 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8800fb70 con 0x5557783f7740 2024-09-10T05:13:33.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.211+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557784ee6b0 con 0x5557783f7740 2024-09-10T05:13:33.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.211+0000 7f3c84e09640 1 -- 172.21.15.192:0/1992966130 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8800fe50 con 0x5557783f7740 2024-09-10T05:13:33.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.211+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557784ef0b0 con 0x5557783f7740 2024-09-10T05:13:33.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.212+0000 7f3d9c926800 1 Processor -- start 2024-09-10T05:13:33.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.212+0000 7f3d9c926800 1 -- start start 2024-09-10T05:13:33.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.212+0000 7f3c84e09640 1 -- 172.21.15.192:0/1992966130 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3d88017040 con 0x5557783f7740 2024-09-10T05:13:33.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.212+0000 7f3d9c926800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 0x5557784fd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.212+0000 7f3d9c926800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5557782eda00 con 0x5557784fb3b0 2024-09-10T05:13:33.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.212+0000 7f3c84e09640 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c8003c920 0x7f3c8003ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.212+0000 7f3c84e09640 1 -- 172.21.15.192:0/1992966130 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f3d88015020 con 0x5557783f7740 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.212+0000 7f3d98509640 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c8003c920 0x7f3c8003ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.212+0000 7f3d98d0a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 0x5557784fd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.212+0000 7f3d98d0a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 0x5557784fd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33624/0 (socket says 172.21.15.192:33624) 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.212+0000 7f3d98d0a640 1 -- 172.21.15.192:0/1302988819 learned_addr learned my addr 172.21.15.192:0/1302988819 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.213+0000 7f3d98d0a640 1 -- 172.21.15.192:0/1302988819 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557784fdd70 con 0x5557784fb3b0 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.213+0000 7f3d98509640 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c8003c920 0x7f3c8003ede0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3d880014d0 tx=0x7f3d88001460 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.213+0000 7f3d98d0a640 1 --2- 172.21.15.192:0/1302988819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 0x5557784fd7a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000a3e0 tx=0x7f3d9000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f518ab42794fbd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.213+0000 7f3c7e7fc640 1 -- 172.21.15.192:0/1302988819 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d90015070 con 0x5557784fb3b0 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.213+0000 7f3c7e7fc640 1 -- 172.21.15.192:0/1302988819 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d90001670 con 0x5557784fb3b0 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.213+0000 7f3c7e7fc640 1 -- 172.21.15.192:0/1302988819 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d90001990 con 0x5557784fb3b0 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.213+0000 7f3d9c926800 1 -- 172.21.15.192:0/1302988819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 msgr2=0x5557784fd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.213+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1302988819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 0x5557784fd7a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000a3e0 tx=0x7f3d9000a8a0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.213+0000 7f3d9c926800 1 -- 172.21.15.192:0/1302988819 shutdown_connections 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.213+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1302988819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 0x5557784fd7a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.213+0000 7f3d9c926800 1 -- 172.21.15.192:0/1302988819 >> 172.21.15.192:0/1302988819 conn(0x5557783fb340 msgr2=0x5557784f5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.214+0000 7f3d9c926800 1 -- 172.21.15.192:0/1302988819 shutdown_connections 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.214+0000 7f3d9c926800 1 -- 172.21.15.192:0/1302988819 wait complete. 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.214+0000 7f3d9c926800 1 Processor -- start 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.214+0000 7f3d9c926800 1 -- start start 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.214+0000 7f3d9c926800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 0x555778502330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.214+0000 7f3d9c926800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5557784fe0c0 con 0x5557784fb3b0 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.214+0000 7f3d98d0a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 0x555778502330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.214+0000 7f3d98d0a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 0x555778502330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33626/0 (socket says 172.21.15.192:33626) 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.214+0000 7f3d98d0a640 1 -- 172.21.15.192:0/1757814855 learned_addr learned my addr 172.21.15.192:0/1757814855 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.214+0000 7f3d98d0a640 1 -- 172.21.15.192:0/1757814855 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555778502890 con 0x5557784fb3b0 2024-09-10T05:13:33.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.215+0000 7f3d98d0a640 1 --2- 172.21.15.192:0/1757814855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 0x555778502330 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3d90013040 tx=0x7f3d90003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.215+0000 7f3c7cff9640 1 -- 172.21.15.192:0/1757814855 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d90020020 con 0x5557784fb3b0 2024-09-10T05:13:33.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.215+0000 7f3c7cff9640 1 -- 172.21.15.192:0/1757814855 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d90010780 con 0x5557784fb3b0 2024-09-10T05:13:33.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.215+0000 7f3c7cff9640 1 -- 172.21.15.192:0/1757814855 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d90015040 con 0x5557784fb3b0 2024-09-10T05:13:33.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.215+0000 7f3d9c926800 1 -- 172.21.15.192:0/1757814855 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555778502b20 con 0x5557784fb3b0 2024-09-10T05:13:33.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.215+0000 7f3d9c926800 1 -- 172.21.15.192:0/1757814855 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557785034a0 con 0x5557784fb3b0 2024-09-10T05:13:33.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.216+0000 7f3c7cff9640 1 -- 172.21.15.192:0/1757814855 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3d90023020 con 0x5557784fb3b0 2024-09-10T05:13:33.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.216+0000 7f3c7cff9640 1 --2- 172.21.15.192:0/1757814855 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c7003c780 0x7f3c7003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.216+0000 7f3c7cff9640 1 -- 172.21.15.192:0/1757814855 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f3d900532c0 con 0x5557784fb3b0 2024-09-10T05:13:33.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.216+0000 7f3d97d08640 1 --2- 172.21.15.192:0/1757814855 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c7003c780 0x7f3c7003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.216+0000 7f3d9c926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:33.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.216+0000 7f3d9c926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.216+0000 7f3d97d08640 1 --2- 172.21.15.192:0/1757814855 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c7003c780 0x7f3c7003ec40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c057000 tx=0x7f3d8c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.217+0000 7f3d9c926800 1 Processor -- start 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.217+0000 7f3d9c926800 1 -- start start 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.217+0000 7f3d9c926800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55577851e3d0 0x55577851e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.217+0000 7f3d9c926800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5557784e6df0 con 0x55577851e3d0 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.217+0000 7f3d98509640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55577851e3d0 0x55577851e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.217+0000 7f3d98509640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55577851e3d0 0x55577851e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33638/0 (socket says 172.21.15.192:33638) 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.217+0000 7f3d98509640 1 -- 172.21.15.192:0/1154080870 learned_addr learned my addr 172.21.15.192:0/1154080870 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.217+0000 7f3d98509640 1 -- 172.21.15.192:0/1154080870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577851ee30 con 0x55577851e3d0 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.217+0000 7f3d98509640 1 --2- 172.21.15.192:0/1154080870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55577851e3d0 0x55577851e7f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3d88019b50 tx=0x7f3d8801a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.218+0000 7f3c5cfe1640 1 -- 172.21.15.192:0/1154080870 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8803ea00 con 0x55577851e3d0 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.218+0000 7f3c5cfe1640 1 -- 172.21.15.192:0/1154080870 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8803eba0 con 0x55577851e3d0 2024-09-10T05:13:33.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.218+0000 7f3d9c926800 1 -- 172.21.15.192:0/1154080870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55577851f660 con 0x55577851e3d0 2024-09-10T05:13:33.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.218+0000 7f3c5cfe1640 1 -- 172.21.15.192:0/1154080870 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d8803e040 con 0x55577851e3d0 2024-09-10T05:13:33.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.218+0000 7f3d9c926800 1 -- 172.21.15.192:0/1154080870 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55577851fc00 con 0x55577851e3d0 2024-09-10T05:13:33.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.218+0000 7f3c5cfe1640 1 -- 172.21.15.192:0/1154080870 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3d8803e1e0 con 0x55577851e3d0 2024-09-10T05:13:33.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.219+0000 7f3c5cfe1640 1 --2- 172.21.15.192:0/1154080870 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3bd003c780 0x7f3bd003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.219+0000 7f3c5cfe1640 1 -- 172.21.15.192:0/1154080870 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f3d8804ad10 con 0x55577851e3d0 2024-09-10T05:13:33.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.219+0000 7f3d97d08640 1 --2- 172.21.15.192:0/1154080870 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3bd003c780 0x7f3bd003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.219+0000 7f3d97d08640 1 --2- 172.21.15.192:0/1154080870 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3bd003c780 0x7f3bd003ec40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c045a60 tx=0x7f3d8c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.219+0000 7f3bfe7fc640 20 reqs_thread_entry: start 2024-09-10T05:13:33.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.219+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55577852bf40 0x55577852e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.219+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55577852eab0 con 0x55577852bf40 2024-09-10T05:13:33.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.219+0000 7f3d98d0a640 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55577852bf40 0x55577852e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.219+0000 7f3d98d0a640 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55577852bf40 0x55577852e3e0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.220+0000 7f3d98d0a640 1 -- 172.21.15.192:0/1992966130 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d9000e070 con 0x55577852bf40 2024-09-10T05:13:33.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.220+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555778530880 0x555778532c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.220+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:2 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555778533360 con 0x555778530880 2024-09-10T05:13:33.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.220+0000 7f3d98509640 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555778530880 0x555778532c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.220+0000 7f3d98509640 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555778530880 0x555778532c70 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.221+0000 7f3d98509640 1 -- 172.21.15.192:0/1992966130 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(2 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f3d88050070 con 0x555778530880 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.221+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55577852ff50 con 0x555778530880 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.222+0000 7f3d98509640 1 -- 172.21.15.192:0/1992966130 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [stat,call,call,writefull 0~993] v37'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f3d88050070 con 0x555778530880 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1757814855 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c7003c780 msgr2=0x7f3c7003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1757814855 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c7003c780 0x7f3c7003ec40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c057000 tx=0x7f3d8c052000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1757814855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 msgr2=0x555778502330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1757814855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 0x555778502330 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3d90013040 tx=0x7f3d90003370 comp rx=0 tx=0).stop 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1757814855 shutdown_connections 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1757814855 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c7003c780 0x7f3c7003ec40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1757814855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557784fb3b0 0x555778502330 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1757814855 >> 172.21.15.192:0/1757814855 conn(0x5557783fb340 msgr2=0x5557784f5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1757814855 shutdown_connections 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1757814855 wait complete. 2024-09-10T05:13:33.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1154080870 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3bd003c780 msgr2=0x7f3bd003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1154080870 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3bd003c780 0x7f3bd003ec40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c045a60 tx=0x7f3d8c005a00 comp rx=0 tx=0).stop 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1154080870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55577851e3d0 msgr2=0x55577851e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1154080870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55577851e3d0 0x55577851e7f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3d88019b50 tx=0x7f3d8801a3c0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1154080870 shutdown_connections 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1154080870 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3bd003c780 0x7f3bd003ec40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1154080870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55577851e3d0 0x55577851e7f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1154080870 >> 172.21.15.192:0/1154080870 conn(0x5557783f5660 msgr2=0x5557783f5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1154080870 shutdown_connections 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1154080870 wait complete. 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555778530880 msgr2=0x555778532c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555778530880 0x555778532c70 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55577852bf40 msgr2=0x55577852e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55577852bf40 0x55577852e3e0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c8003c920 msgr2=0x7f3c8003ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.223+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c8003c920 0x7f3c8003ede0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3d880014d0 tx=0x7f3d88001460 comp rx=0 tx=0).stop 2024-09-10T05:13:33.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.224+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 msgr2=0x5557784edec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.224+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 0x5557784edec0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3d880012f0 tx=0x7f3d88000ed0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.224+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 shutdown_connections 2024-09-10T05:13:33.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.224+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555778530880 0x555778532c70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.224+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55577852bf40 0x55577852e3e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.224+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3c8003c920 0x7f3c8003ede0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.224+0000 7f3d9c926800 1 --2- 172.21.15.192:0/1992966130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557783f7740 0x5557784edec0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.224+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 >> 172.21.15.192:0/1992966130 conn(0x5557783f1320 msgr2=0x5557784e7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.224+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 shutdown_connections 2024-09-10T05:13:33.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.224+0000 7f3d9c926800 1 -- 172.21.15.192:0/1992966130 wait complete. 2024-09-10T05:13:33.233 INFO:teuthology.orchestra.run.smithi192.stdout:{"id":"92aa256a-2802-419e-96e0-ba675846cbc3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-10T05:13:33.233 DEBUG:tasks.util.rgw: json result: {'id': '92aa256a-2802-419e-96e0-ba675846cbc3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-10T05:13:33.233 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-10T05:13:33.233 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-10T05:13:33.233 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-10T05:13:33.275 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:33.276 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:33.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.275+0000 7f0800142800 1 Processor -- start 2024-09-10T05:13:33.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.275+0000 7f0800142800 1 -- start start 2024-09-10T05:13:33.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.276+0000 7f0800142800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55e8c1713680 0x55e8c1715a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.276+0000 7f0800142800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e8c15bce40 con 0x55e8c1716010 2024-09-10T05:13:33.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.276+0000 7f0800142800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55e8c1587680 con 0x55e8c1713680 2024-09-10T05:13:33.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.276+0000 7f07fbeed640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55e8c1713680 0x55e8c1715a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.276+0000 7f07fbeed640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55e8c1713680 0x55e8c1715a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33642/0 (socket says 172.21.15.192:33642) 2024-09-10T05:13:33.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.276+0000 7f07fbeed640 1 -- 172.21.15.192:0/2536397072 learned_addr learned my addr 172.21.15.192:0/2536397072 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.276+0000 7f07fbeed640 1 -- 172.21.15.192:0/2536397072 >> v1:172.21.15.139:6789/0 conn(0x55e8c1716010 legacy=0x55e8c17184d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.276+0000 7f07fbeed640 1 -- 172.21.15.192:0/2536397072 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c15a36b0 con 0x55e8c1713680 2024-09-10T05:13:33.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.278+0000 7f07fbeed640 1 --2- 172.21.15.192:0/2536397072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c1715a70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f07ec005fd0 tx=0x7f07ec045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ef04653e59f98c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.278+0000 7f07faeeb640 1 -- 172.21.15.192:0/2536397072 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ec04e600 con 0x55e8c1713680 2024-09-10T05:13:33.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.278+0000 7f07faeeb640 1 -- 172.21.15.192:0/2536397072 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ec04e7a0 con 0x55e8c1713680 2024-09-10T05:13:33.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.278+0000 7f07faeeb640 1 -- 172.21.15.192:0/2536397072 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ec04eaa0 con 0x55e8c1713680 2024-09-10T05:13:33.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.279+0000 7f0800142800 1 -- 172.21.15.192:0/2536397072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 msgr2=0x55e8c1715a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.279+0000 7f0800142800 1 --2- 172.21.15.192:0/2536397072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c1715a70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f07ec005fd0 tx=0x7f07ec045cf0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.279+0000 7f0800142800 1 -- 172.21.15.192:0/2536397072 shutdown_connections 2024-09-10T05:13:33.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.279+0000 7f0800142800 1 --2- 172.21.15.192:0/2536397072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c1715a70 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.279+0000 7f0800142800 1 -- 172.21.15.192:0/2536397072 >> 172.21.15.192:0/2536397072 conn(0x55e8c170d1e0 msgr2=0x55e8c170f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.279+0000 7f0800142800 1 -- 172.21.15.192:0/2536397072 shutdown_connections 2024-09-10T05:13:33.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.279+0000 7f0800142800 1 -- 172.21.15.192:0/2536397072 wait complete. 2024-09-10T05:13:33.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.292+0000 7f0800142800 1 Processor -- start 2024-09-10T05:13:33.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.292+0000 7f0800142800 1 -- start start 2024-09-10T05:13:33.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.292+0000 7f0800142800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c1712df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.292+0000 7f0800142800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e8c15abdd0 con 0x55e8c1713680 2024-09-10T05:13:33.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.293+0000 7f07fbeed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c1712df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.293+0000 7f07fbeed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c1712df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33644/0 (socket says 172.21.15.192:33644) 2024-09-10T05:13:33.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.293+0000 7f07fbeed640 1 -- 172.21.15.192:0/3154694418 learned_addr learned my addr 172.21.15.192:0/3154694418 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.293+0000 7f07fbeed640 1 -- 172.21.15.192:0/3154694418 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c15c4e10 con 0x55e8c1713680 2024-09-10T05:13:33.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.293+0000 7f07fbeed640 1 --2- 172.21.15.192:0/3154694418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c1712df0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f07ec005fd0 tx=0x7f07ec050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7890a3e0df127f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.293+0000 7f06e9e0b640 1 -- 172.21.15.192:0/3154694418 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ec04eb40 con 0x55e8c1713680 2024-09-10T05:13:33.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.293+0000 7f06e9e0b640 1 -- 172.21.15.192:0/3154694418 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ec066070 con 0x55e8c1713680 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.293+0000 7f06e9e0b640 1 -- 172.21.15.192:0/3154694418 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ec04ee50 con 0x55e8c1713680 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.294+0000 7f0800142800 1 -- 172.21.15.192:0/3154694418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 msgr2=0x55e8c1712df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.294+0000 7f0800142800 1 --2- 172.21.15.192:0/3154694418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c1712df0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f07ec005fd0 tx=0x7f07ec050000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.294+0000 7f0800142800 1 -- 172.21.15.192:0/3154694418 shutdown_connections 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.294+0000 7f0800142800 1 --2- 172.21.15.192:0/3154694418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c1712df0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.294+0000 7f0800142800 1 -- 172.21.15.192:0/3154694418 >> 172.21.15.192:0/3154694418 conn(0x55e8c170d1e0 msgr2=0x55e8c17fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.294+0000 7f0800142800 1 -- 172.21.15.192:0/3154694418 shutdown_connections 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.294+0000 7f0800142800 1 -- 172.21.15.192:0/3154694418 wait complete. 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.294+0000 7f0800142800 1 Processor -- start 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.294+0000 7f0800142800 1 -- start start 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.295+0000 7f0800142800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c180c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.295+0000 7f0800142800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e8c171a030 con 0x55e8c1713680 2024-09-10T05:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.295+0000 7f07fbeed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c180c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.295+0000 7f07fbeed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c180c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33658/0 (socket says 172.21.15.192:33658) 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.295+0000 7f07fbeed640 1 -- 172.21.15.192:0/3877674709 learned_addr learned my addr 172.21.15.192:0/3877674709 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.295+0000 7f07fbeed640 1 -- 172.21.15.192:0/3877674709 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c180c610 con 0x55e8c1713680 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.295+0000 7f07fbeed640 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c180c0b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f07ec063040 tx=0x7f07ec003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.295+0000 7f06e3fff640 1 -- 172.21.15.192:0/3877674709 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ec06d550 con 0x55e8c1713680 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.295+0000 7f06e3fff640 1 -- 172.21.15.192:0/3877674709 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ec071030 con 0x55e8c1713680 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.295+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8c180c8a0 con 0x55e8c1713680 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.295+0000 7f06e3fff640 1 -- 172.21.15.192:0/3877674709 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ec06d820 con 0x55e8c1713680 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.295+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8c180d2a0 con 0x55e8c1713680 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.296+0000 7f0800142800 1 Processor -- start 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.296+0000 7f0800142800 1 -- start start 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.296+0000 7f0800142800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 0x55e8c181b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.296+0000 7f0800142800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e8c1609a00 con 0x55e8c18195c0 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.296+0000 7f06e3fff640 1 -- 172.21.15.192:0/3877674709 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f07ec06d9c0 con 0x55e8c1713680 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.296+0000 7f06e3fff640 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f06e403c780 0x7f06e403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.296+0000 7f07fc6ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 0x55e8c181b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.296+0000 7f07fc6ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 0x55e8c181b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33674/0 (socket says 172.21.15.192:33674) 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.296+0000 7f07fc6ee640 1 -- 172.21.15.192:0/3424507878 learned_addr learned my addr 172.21.15.192:0/3424507878 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.296+0000 7f06e3fff640 1 -- 172.21.15.192:0/3877674709 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f07ec0982b0 con 0x55e8c1713680 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.296+0000 7f07fbeed640 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f06e403c780 0x7f06e403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f07fc6ee640 1 -- 172.21.15.192:0/3424507878 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c181bf80 con 0x55e8c18195c0 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f07fc6ee640 1 --2- 172.21.15.192:0/3424507878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 0x55e8c181b9b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f07f400a430 tx=0x7f07f400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324eeb7ced51c009 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f07fbeed640 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f06e403c780 0x7f06e403ec40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07ec06bb00 tx=0x7f07ec046130 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f06e1ffb640 1 -- 172.21.15.192:0/3424507878 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f4008840 con 0x55e8c18195c0 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f06e1ffb640 1 -- 172.21.15.192:0/3424507878 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f4008a00 con 0x55e8c18195c0 2024-09-10T05:13:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f06e1ffb640 1 -- 172.21.15.192:0/3424507878 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f4008d20 con 0x55e8c18195c0 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f0800142800 1 -- 172.21.15.192:0/3424507878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 msgr2=0x55e8c181b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f0800142800 1 --2- 172.21.15.192:0/3424507878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 0x55e8c181b9b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f07f400a430 tx=0x7f07f400a8f0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f0800142800 1 -- 172.21.15.192:0/3424507878 shutdown_connections 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f0800142800 1 --2- 172.21.15.192:0/3424507878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 0x55e8c181b9b0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f0800142800 1 -- 172.21.15.192:0/3424507878 >> 172.21.15.192:0/3424507878 conn(0x55e8c1716010 msgr2=0x55e8c1813ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f0800142800 1 -- 172.21.15.192:0/3424507878 shutdown_connections 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.297+0000 7f0800142800 1 -- 172.21.15.192:0/3424507878 wait complete. 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.298+0000 7f0800142800 1 Processor -- start 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.298+0000 7f0800142800 1 -- start start 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.298+0000 7f0800142800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 0x55e8c18204c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.298+0000 7f0800142800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e8c181c270 con 0x55e8c18195c0 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.298+0000 7f07fc6ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 0x55e8c18204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.298+0000 7f07fc6ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 0x55e8c18204c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33676/0 (socket says 172.21.15.192:33676) 2024-09-10T05:13:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.298+0000 7f07fc6ee640 1 -- 172.21.15.192:0/3158469484 learned_addr learned my addr 172.21.15.192:0/3158469484 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.298+0000 7f07fc6ee640 1 -- 172.21.15.192:0/3158469484 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c1820a20 con 0x55e8c18195c0 2024-09-10T05:13:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.298+0000 7f07fc6ee640 1 --2- 172.21.15.192:0/3158469484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 0x55e8c18204c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f07f400adf0 tx=0x7f07f4002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.299+0000 7f06dbfff640 1 -- 172.21.15.192:0/3158469484 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f4022030 con 0x55e8c18195c0 2024-09-10T05:13:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.299+0000 7f06dbfff640 1 -- 172.21.15.192:0/3158469484 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f4019040 con 0x55e8c18195c0 2024-09-10T05:13:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.299+0000 7f0800142800 1 -- 172.21.15.192:0/3158469484 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8c1820cb0 con 0x55e8c18195c0 2024-09-10T05:13:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.299+0000 7f06dbfff640 1 -- 172.21.15.192:0/3158469484 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07f4013970 con 0x55e8c18195c0 2024-09-10T05:13:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.299+0000 7f0800142800 1 -- 172.21.15.192:0/3158469484 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8c1821630 con 0x55e8c18195c0 2024-09-10T05:13:33.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.300+0000 7f06dbfff640 1 -- 172.21.15.192:0/3158469484 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f07f4025070 con 0x55e8c18195c0 2024-09-10T05:13:33.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.300+0000 7f06dbfff640 1 --2- 172.21.15.192:0/3158469484 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f06d403c730 0x7f06d403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.300+0000 7f06dbfff640 1 -- 172.21.15.192:0/3158469484 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f07f4023070 con 0x55e8c18195c0 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.300+0000 7f07fb6ec640 1 --2- 172.21.15.192:0/3158469484 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f06d403c730 0x7f06d403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.300+0000 7f0800142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.300+0000 7f0800142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.300+0000 7f07fb6ec640 1 --2- 172.21.15.192:0/3158469484 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f06d403c730 0x7f06d403ebf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f07e4001dd0 tx=0x7f07e4001350 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.300+0000 7f0800142800 1 Processor -- start 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.301+0000 7f0800142800 1 -- start start 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.301+0000 7f0800142800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c183a350 0x55e8c183a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.301+0000 7f0800142800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e8c1711690 con 0x55e8c183a350 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.301+0000 7f07fbeed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c183a350 0x55e8c183a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.301+0000 7f07fbeed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c183a350 0x55e8c183a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33690/0 (socket says 172.21.15.192:33690) 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.301+0000 7f07fbeed640 1 -- 172.21.15.192:0/3842582258 learned_addr learned my addr 172.21.15.192:0/3842582258 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.301+0000 7f07fbeed640 1 -- 172.21.15.192:0/3842582258 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c183adb0 con 0x55e8c183a350 2024-09-10T05:13:33.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.301+0000 7f07fbeed640 1 --2- 172.21.15.192:0/3842582258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c183a350 0x55e8c183a770 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0965a0 tx=0x7f07ec0566b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.301+0000 7f0673fff640 1 -- 172.21.15.192:0/3842582258 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ec074dd0 con 0x55e8c183a350 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.301+0000 7f0673fff640 1 -- 172.21.15.192:0/3842582258 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ec05c040 con 0x55e8c183a350 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.301+0000 7f0800142800 1 -- 172.21.15.192:0/3842582258 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8c183b5e0 con 0x55e8c183a350 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.301+0000 7f0673fff640 1 -- 172.21.15.192:0/3842582258 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07ec061e00 con 0x55e8c183a350 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.302+0000 7f0800142800 1 -- 172.21.15.192:0/3842582258 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8c183bb80 con 0x55e8c183a350 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.302+0000 7f0673fff640 1 -- 172.21.15.192:0/3842582258 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f07ec06dcb0 con 0x55e8c183a350 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.302+0000 7f0673fff640 1 --2- 172.21.15.192:0/3842582258 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f063403c730 0x7f063403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.302+0000 7f0673fff640 1 -- 172.21.15.192:0/3842582258 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f07ec094d10 con 0x55e8c183a350 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.303+0000 7f07fb6ec640 1 --2- 172.21.15.192:0/3842582258 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f063403c730 0x7f063403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.303+0000 7f0671ffb640 20 reqs_thread_entry: start 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.303+0000 7f07fb6ec640 1 --2- 172.21.15.192:0/3842582258 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f063403c730 0x7f063403ebf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f07e400ba40 tx=0x7f07e4006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.303+0000 7f0800142800 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e8c1847c70 0x55e8c184a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.303+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e8c184a6e0 con 0x55e8c1847c70 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.303+0000 7f07fc6ee640 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e8c1847c70 0x55e8c184a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.303+0000 7f07fc6ee640 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e8c1847c70 0x55e8c184a060 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.303+0000 7f07fc6ee640 1 -- 172.21.15.192:0/3877674709 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07f403dd70 con 0x55e8c1847c70 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.304+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e8c184afc0 con 0x55e8c1847c70 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.304+0000 7f07fc6ee640 1 -- 172.21.15.192:0/3877674709 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07f403dd70 con 0x55e8c1847c70 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.304+0000 7f0800142800 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e8c184c8d0 0x55e8c184ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.304+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:3 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e8c184f4a0 con 0x55e8c184c8d0 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.304+0000 7f07fbeed640 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e8c184c8d0 0x55e8c184ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.304+0000 7f07fbeed640 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e8c184c8d0 0x55e8c184ed40 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.304+0000 7f07fbeed640 1 -- 172.21.15.192:0/3877674709 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(3 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f07ec07d070 con 0x55e8c184c8d0 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.305+0000 7f0800142800 1 -- 172.21.15.192:0/3158469484 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f06d403c730 msgr2=0x7f06d403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.305+0000 7f0800142800 1 --2- 172.21.15.192:0/3158469484 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f06d403c730 0x7f06d403ebf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f07e4001dd0 tx=0x7f07e4001350 comp rx=0 tx=0).stop 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.305+0000 7f0800142800 1 -- 172.21.15.192:0/3158469484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 msgr2=0x55e8c18204c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.305+0000 7f0800142800 1 --2- 172.21.15.192:0/3158469484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 0x55e8c18204c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f07f400adf0 tx=0x7f07f4002ff0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.305+0000 7f0800142800 1 -- 172.21.15.192:0/3158469484 shutdown_connections 2024-09-10T05:13:33.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.305+0000 7f0800142800 1 --2- 172.21.15.192:0/3158469484 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f06d403c730 0x7f06d403ebf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.305+0000 7f0800142800 1 --2- 172.21.15.192:0/3158469484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c18195c0 0x55e8c18204c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.305+0000 7f0800142800 1 -- 172.21.15.192:0/3158469484 >> 172.21.15.192:0/3158469484 conn(0x55e8c1716010 msgr2=0x55e8c1813eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.305+0000 7f0800142800 1 -- 172.21.15.192:0/3158469484 shutdown_connections 2024-09-10T05:13:33.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.305+0000 7f0800142800 1 -- 172.21.15.192:0/3158469484 wait complete. 2024-09-10T05:13:33.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3842582258 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f063403c730 msgr2=0x7f063403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 --2- 172.21.15.192:0/3842582258 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f063403c730 0x7f063403ebf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f07e400ba40 tx=0x7f07e4006000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3842582258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c183a350 msgr2=0x55e8c183a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 --2- 172.21.15.192:0/3842582258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c183a350 0x55e8c183a770 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0965a0 tx=0x7f07ec0566b0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3842582258 shutdown_connections 2024-09-10T05:13:33.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 --2- 172.21.15.192:0/3842582258 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f063403c730 0x7f063403ebf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 --2- 172.21.15.192:0/3842582258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c183a350 0x55e8c183a770 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3842582258 >> 172.21.15.192:0/3842582258 conn(0x55e8c182f890 msgr2=0x55e8c182fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3842582258 shutdown_connections 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3842582258 wait complete. 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e8c1847c70 msgr2=0x55e8c184a060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e8c1847c70 0x55e8c184a060 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e8c184c8d0 msgr2=0x55e8c184ed40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e8c184c8d0 0x55e8c184ed40 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f06e403c780 msgr2=0x7f06e403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f06e403c780 0x7f06e403ec40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07ec06bb00 tx=0x7f07ec046130 comp rx=0 tx=0).stop 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 msgr2=0x55e8c180c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c180c0b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f07ec063040 tx=0x7f07ec003330 comp rx=0 tx=0).stop 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 shutdown_connections 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55e8c184c8d0 0x55e8c184ed40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55e8c1847c70 0x55e8c184a060 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f06e403c780 0x7f06e403ec40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 --2- 172.21.15.192:0/3877674709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8c1713680 0x55e8c180c0b0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 >> 172.21.15.192:0/3877674709 conn(0x55e8c170d1e0 msgr2=0x55e8c17fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 shutdown_connections 2024-09-10T05:13:33.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.306+0000 7f0800142800 1 -- 172.21.15.192:0/3877674709 wait complete. 2024-09-10T05:13:33.316 INFO:teuthology.orchestra.run.smithi192.stdout:{"id":"236edb0a-22f9-4c79-a204-203688ed4bab","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"92aa256a-2802-419e-96e0-ba675846cbc3","zones":[{"id":"92aa256a-2802-419e-96e0-ba675846cbc3","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-10T05:13:33.316 DEBUG:tasks.util.rgw: json result: {'id': '236edb0a-22f9-4c79-a204-203688ed4bab', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '92aa256a-2802-419e-96e0-ba675846cbc3', 'zones': [{'id': '92aa256a-2802-419e-96e0-ba675846cbc3', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-10T05:13:33.319 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-10T05:13:33.337 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-10T05:13:33.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-10T05:13:33.337 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-10T05:13:33.410 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:33.410 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:33.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.410+0000 7f71c8a0f800 1 Processor -- start 2024-09-10T05:13:33.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.410+0000 7f71c8a0f800 1 -- start start 2024-09-10T05:13:33.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.410+0000 7f71c8a0f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x555e023f9010 0x555e02401b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.410+0000 7f71c8a0f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e022a2e40 con 0x555e023f74f0 2024-09-10T05:13:33.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.410+0000 7f71c8a0f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x555e0226d680 con 0x555e023f9010 2024-09-10T05:13:33.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.410+0000 7f71c5cf8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x555e023f9010 0x555e02401b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.410+0000 7f71c64f9640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x555e023f74f0 0x555e023f78f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46504/0 (socket says 172.21.15.192:46504) 2024-09-10T05:13:33.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.410+0000 7f71c64f9640 1 -- 172.21.15.192:0/3045153749 learned_addr learned my addr 172.21.15.192:0/3045153749 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:33.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.411+0000 7f71c5cf8640 1 -- 172.21.15.192:0/3045153749 >> v1:172.21.15.139:6789/0 conn(0x555e023f74f0 legacy=0x555e023f78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.411+0000 7f71c54f7640 1 -- 172.21.15.192:0/3045153749 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 284246962 0 0) 0x555e022a2e40 con 0x555e023f74f0 2024-09-10T05:13:33.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.411+0000 7f71c5cf8640 1 -- 172.21.15.192:0/3045153749 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e022896b0 con 0x555e023f9010 2024-09-10T05:13:33.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.413+0000 7f71c5cf8640 1 --2- 172.21.15.192:0/3045153749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f9010 0x555e02401b30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f71b000a470 tx=0x7f71b0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ca2cdbf5694b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.413+0000 7f71c54f7640 1 -- 172.21.15.192:0/3045153749 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b0053570 con 0x555e023f9010 2024-09-10T05:13:33.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.413+0000 7f71c54f7640 1 -- 172.21.15.192:0/3045153749 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b0058070 con 0x555e023f9010 2024-09-10T05:13:33.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.413+0000 7f71c54f7640 1 -- 172.21.15.192:0/3045153749 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b0053880 con 0x555e023f9010 2024-09-10T05:13:33.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.413+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3045153749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f9010 msgr2=0x555e02401b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.413+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/3045153749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f9010 0x555e02401b30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f71b000a470 tx=0x7f71b0045a20 comp rx=0 tx=0).stop 2024-09-10T05:13:33.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.413+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3045153749 shutdown_connections 2024-09-10T05:13:33.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.413+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/3045153749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f9010 0x555e02401b30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.413+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3045153749 >> 172.21.15.192:0/3045153749 conn(0x555e023f3220 msgr2=0x555e023f5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.413+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3045153749 shutdown_connections 2024-09-10T05:13:33.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.413+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3045153749 wait complete. 2024-09-10T05:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.427+0000 7f71c8a0f800 1 Processor -- start 2024-09-10T05:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.427+0000 7f71c8a0f800 1 -- start start 2024-09-10T05:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.427+0000 7f71c8a0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 0x555e024ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.427+0000 7f71c8a0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555e02291dd0 con 0x555e023f74f0 2024-09-10T05:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.427+0000 7f71c64f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 0x555e024ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.427+0000 7f71c64f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 0x555e024ea8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33706/0 (socket says 172.21.15.192:33706) 2024-09-10T05:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.427+0000 7f71c64f9640 1 -- 172.21.15.192:0/2818526147 learned_addr learned my addr 172.21.15.192:0/2818526147 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.428+0000 7f71c64f9640 1 -- 172.21.15.192:0/2818526147 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e022aae10 con 0x555e023f74f0 2024-09-10T05:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.428+0000 7f71c64f9640 1 --2- 172.21.15.192:0/2818526147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 0x555e024ea8a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f71b8006fa0 tx=0x7f71b8001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3077b39743bc622 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.428+0000 7f70b4608640 1 -- 172.21.15.192:0/2818526147 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8003450 con 0x555e023f74f0 2024-09-10T05:13:33.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.428+0000 7f70b4608640 1 -- 172.21.15.192:0/2818526147 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b8003610 con 0x555e023f74f0 2024-09-10T05:13:33.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.428+0000 7f70b4608640 1 -- 172.21.15.192:0/2818526147 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8003970 con 0x555e023f74f0 2024-09-10T05:13:33.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c8a0f800 1 -- 172.21.15.192:0/2818526147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 msgr2=0x555e024ea8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/2818526147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 0x555e024ea8a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f71b8006fa0 tx=0x7f71b8001b00 comp rx=0 tx=0).stop 2024-09-10T05:13:33.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c8a0f800 1 -- 172.21.15.192:0/2818526147 shutdown_connections 2024-09-10T05:13:33.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/2818526147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 0x555e024ea8a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c8a0f800 1 -- 172.21.15.192:0/2818526147 >> 172.21.15.192:0/2818526147 conn(0x555e023f3220 msgr2=0x555e024e6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c8a0f800 1 -- 172.21.15.192:0/2818526147 shutdown_connections 2024-09-10T05:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c8a0f800 1 -- 172.21.15.192:0/2818526147 wait complete. 2024-09-10T05:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c8a0f800 1 Processor -- start 2024-09-10T05:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c8a0f800 1 -- start start 2024-09-10T05:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c8a0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 0x555e024f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c8a0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555e02402340 con 0x555e023f74f0 2024-09-10T05:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c64f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 0x555e024f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c64f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 0x555e024f21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33716/0 (socket says 172.21.15.192:33716) 2024-09-10T05:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.429+0000 7f71c64f9640 1 -- 172.21.15.192:0/1805144862 learned_addr learned my addr 172.21.15.192:0/1805144862 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.430+0000 7f71c64f9640 1 -- 172.21.15.192:0/1805144862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e024f2750 con 0x555e023f74f0 2024-09-10T05:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.430+0000 7f71c64f9640 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 0x555e024f21f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f71b8001330 tx=0x7f71b8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.430+0000 7f70b2e05640 1 -- 172.21.15.192:0/1805144862 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8014a10 con 0x555e023f74f0 2024-09-10T05:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.430+0000 7f70b2e05640 1 -- 172.21.15.192:0/1805144862 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b8014bb0 con 0x555e023f74f0 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.430+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e024f29e0 con 0x555e023f74f0 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.430+0000 7f70b2e05640 1 -- 172.21.15.192:0/1805144862 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b801e3f0 con 0x555e023f74f0 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.430+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e024f33e0 con 0x555e023f74f0 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.431+0000 7f70b2e05640 1 -- 172.21.15.192:0/1805144862 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f71b8010070 con 0x555e023f74f0 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.431+0000 7f70b2e05640 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f70ac03c780 0x7f70ac03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.431+0000 7f70b2e05640 1 -- 172.21.15.192:0/1805144862 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f71b8018070 con 0x555e023f74f0 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.431+0000 7f71c5cf8640 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f70ac03c780 0x7f70ac03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.431+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x555e023f9010 0x555e024f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.431+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e024f9d80 con 0x555e023f9010 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.431+0000 7f71c6cfa640 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x555e023f9010 0x555e024f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.431+0000 7f71c5cf8640 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f70ac03c780 0x7f70ac03ec40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f71b0057000 tx=0x7f71b0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.432+0000 7f71c6cfa640 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x555e023f9010 0x555e024f9840 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.432+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1805144862 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71c000a560 con 0x555e023f9010 2024-09-10T05:13:33.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.432+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e024fa120 con 0x555e023f9010 2024-09-10T05:13:33.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.432+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1805144862 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71c000a560 con 0x555e023f9010 2024-09-10T05:13:33.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.432+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555e024fbbe0 0x555e024fe050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.432+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e024fe7e0 con 0x555e024fbbe0 2024-09-10T05:13:33.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.432+0000 7f71c64f9640 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555e024fbbe0 0x555e024fe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.433+0000 7f71c64f9640 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555e024fbbe0 0x555e024fe050 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.433+0000 7f71c64f9640 1 -- 172.21.15.192:0/1805144862 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f71b801b070 con 0x555e024fbbe0 2024-09-10T05:13:33.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.433+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e024fa970 con 0x555e023f9010 2024-09-10T05:13:33.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.433+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1805144862 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71c000a560 con 0x555e023f9010 2024-09-10T05:13:33.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.433+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x555e024ffc40 0x555e02502030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.433+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e025027a0 con 0x555e024ffc40 2024-09-10T05:13:33.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.434+0000 7f71c5cf8640 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x555e024ffc40 0x555e02502030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.434+0000 7f71c5cf8640 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x555e024ffc40 0x555e02502030 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.434+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1805144862 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f71b0051070 con 0x555e024ffc40 2024-09-10T05:13:33.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.434+0000 7f71c8a0f800 1 Processor -- start 2024-09-10T05:13:33.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f71c8a0f800 1 -- start start 2024-09-10T05:13:33.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f71c8a0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e025103e0 0x555e02510800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f71c8a0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555e022efa00 con 0x555e025103e0 2024-09-10T05:13:33.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f71c64f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e025103e0 0x555e02510800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f71c64f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e025103e0 0x555e02510800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33720/0 (socket says 172.21.15.192:33720) 2024-09-10T05:13:33.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f71c64f9640 1 -- 172.21.15.192:0/3706855203 learned_addr learned my addr 172.21.15.192:0/3706855203 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f71c64f9640 1 -- 172.21.15.192:0/3706855203 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e02510e40 con 0x555e025103e0 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f71c64f9640 1 --2- 172.21.15.192:0/3706855203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e025103e0 0x555e02510800 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f71b8014ff0 tx=0x7f71b8028ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f70abfff640 1 -- 172.21.15.192:0/3706855203 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8036020 con 0x555e025103e0 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f70abfff640 1 -- 172.21.15.192:0/3706855203 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b801d510 con 0x555e025103e0 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3706855203 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e02511670 con 0x555e025103e0 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f70abfff640 1 -- 172.21.15.192:0/3706855203 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8053040 con 0x555e025103e0 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.435+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3706855203 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e02511c10 con 0x555e025103e0 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.436+0000 7f70abfff640 1 -- 172.21.15.192:0/3706855203 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f71b8039020 con 0x555e025103e0 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.436+0000 7f70abfff640 1 --2- 172.21.15.192:0/3706855203 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f70a003c780 0x7f70a003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.436+0000 7f70abfff640 1 -- 172.21.15.192:0/3706855203 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f71b803cd10 con 0x555e025103e0 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.436+0000 7f71c5cf8640 1 --2- 172.21.15.192:0/3706855203 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f70a003c780 0x7f70a003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f71c8a0f800 1 Processor -- start 2024-09-10T05:13:33.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f71c8a0f800 1 -- start start 2024-09-10T05:13:33.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f71c5cf8640 1 --2- 172.21.15.192:0/3706855203 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f70a003c780 0x7f70a003ec40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x555e024feb80 tx=0x7f71b0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f71c8a0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 0x555e0251d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f71c8a0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555e024eb0f0 con 0x555e0251ce20 2024-09-10T05:13:33.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f71c64f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 0x555e0251d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f71c64f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 0x555e0251d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33722/0 (socket says 172.21.15.192:33722) 2024-09-10T05:13:33.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f71c64f9640 1 -- 172.21.15.192:0/1940176632 learned_addr learned my addr 172.21.15.192:0/1940176632 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f71c64f9640 1 -- 172.21.15.192:0/1940176632 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e0251d810 con 0x555e0251ce20 2024-09-10T05:13:33.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f71c64f9640 1 --2- 172.21.15.192:0/1940176632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 0x555e0251d220 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f71b8010b80 tx=0x7f71b80124f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157702c71ad2fa31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f70a9ffb640 1 -- 172.21.15.192:0/1940176632 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8053ab0 con 0x555e0251ce20 2024-09-10T05:13:33.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f70a9ffb640 1 -- 172.21.15.192:0/1940176632 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b8053e50 con 0x555e0251ce20 2024-09-10T05:13:33.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.437+0000 7f70a9ffb640 1 -- 172.21.15.192:0/1940176632 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b8026450 con 0x555e0251ce20 2024-09-10T05:13:33.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.438+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1940176632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 msgr2=0x555e0251d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.438+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1940176632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 0x555e0251d220 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f71b8010b80 tx=0x7f71b80124f0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.438+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1940176632 shutdown_connections 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.438+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1940176632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 0x555e0251d220 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.438+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1940176632 >> 172.21.15.192:0/1940176632 conn(0x555e02519220 msgr2=0x555e02517460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.438+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1940176632 shutdown_connections 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.438+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1940176632 wait complete. 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.438+0000 7f71c8a0f800 1 Processor -- start 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.438+0000 7f71c8a0f800 1 -- start start 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.439+0000 7f71c8a0f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 0x555e02524220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.439+0000 7f71c8a0f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555e0251dc80 con 0x555e0251ce20 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.439+0000 7f71c64f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 0x555e02524220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.439+0000 7f71c64f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 0x555e02524220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33732/0 (socket says 172.21.15.192:33732) 2024-09-10T05:13:33.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.439+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 learned_addr learned my addr 172.21.15.192:0/1248936109 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.439+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e02524780 con 0x555e0251ce20 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.439+0000 7f71c64f9640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 0x555e02524220 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f71b8010b80 tx=0x7f71b8015f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.439+0000 7f7097fff640 1 -- 172.21.15.192:0/1248936109 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b806e020 con 0x555e0251ce20 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.439+0000 7f7097fff640 1 -- 172.21.15.192:0/1248936109 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b8026b60 con 0x555e0251ce20 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.439+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e02524780 con 0x555e0251ce20 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.439+0000 7f7097fff640 1 -- 172.21.15.192:0/1248936109 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71b80498e0 con 0x555e0251ce20 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.439+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e02524780 con 0x555e0251ce20 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.440+0000 7f7097fff640 1 -- 172.21.15.192:0/1248936109 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f71b8071020 con 0x555e0251ce20 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.440+0000 7f7097fff640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f709003c780 0x7f709003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.440+0000 7f7097fff640 1 -- 172.21.15.192:0/1248936109 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f71b8064030 con 0x555e0251ce20 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.440+0000 7f71c5cf8640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f709003c780 0x7f709003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.441+0000 7f71c5cf8640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f709003c780 0x7f709003ec40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f71b0000c00 tx=0x7f71b0053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.441+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.441+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x555e0252f840 0x555e02531d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.441+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e02532450 con 0x555e0252f840 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.441+0000 7f71c6cfa640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x555e0252f840 0x555e02531d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.441+0000 7f71c6cfa640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x555e0252f840 0x555e02531d00 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71c000a560 con 0x555e0252f840 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 20 realm 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e02532860 con 0x555e0252f840 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71c000a560 con 0x555e0252f840 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:33.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e0252f840 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71c000a560 con 0x555e0252f840 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e025334d0 con 0x555e0252f840 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71c000a560 con 0x555e0252f840 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555e02533e90 0x555e02536280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.442+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e02536890 con 0x555e02533e90 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.443+0000 7f71c64f9640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555e02533e90 0x555e02536280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.443+0000 7f71c64f9640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555e02533e90 0x555e02536280 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.443+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.443+0000 7f71c8a0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.443+0000 7f71c8a0f800 20 searching for the correct realm 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.443+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x555e02538840 0x555e0253ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.443+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e0253b380 con 0x555e02538840 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.444+0000 7f71c5cf8640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x555e02538840 0x555e0253ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.444+0000 7f71c5cf8640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x555e02538840 0x555e0253ad00 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.444+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.444+0000 7f71c5cf8640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f71b005f040 0x7f71b006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.444+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e0253b380 con 0x7f71b005f040 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.444+0000 7f71c6cfa640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f71b005f040 0x7f71b006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.444+0000 7f71c6cfa640 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f71b005f040 0x7f71b006b410 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.445+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f71c000a560 con 0x7f71b005f040 2024-09-10T05:13:33.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.445+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02533e90 2024-09-10T05:13:33.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.445+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.445+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e0252f840 2024-09-10T05:13:33.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.445+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c000a560 con 0x555e0252f840 2024-09-10T05:13:33.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.445+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e0252f840 2024-09-10T05:13:33.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.445+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c0026040 con 0x555e0252f840 2024-09-10T05:13:33.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.445+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02533e90 2024-09-10T05:13:33.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.446+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.446+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02533e90 2024-09-10T05:13:33.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.446+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.446+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x7f71b005f040 2024-09-10T05:13:33.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.446+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c0026040 con 0x7f71b005f040 2024-09-10T05:13:33.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.446+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02538840 2024-09-10T05:13:33.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.446+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.446+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e0252f840 2024-09-10T05:13:33.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.447+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c0026040 con 0x555e0252f840 2024-09-10T05:13:33.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.447+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02533e90 2024-09-10T05:13:33.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.447+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.447+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e0252f840 2024-09-10T05:13:33.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.447+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c0026040 con 0x555e0252f840 2024-09-10T05:13:33.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.447+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x7f71b005f040 2024-09-10T05:13:33.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.447+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f71c0026040 con 0x7f71b005f040 2024-09-10T05:13:33.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.447+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02538840 2024-09-10T05:13:33.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.448+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.448+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02538840 2024-09-10T05:13:33.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.448+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.448+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02533e90 2024-09-10T05:13:33.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.448+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.448+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02538840 2024-09-10T05:13:33.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.448+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.448+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02538840 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.448+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.448+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e0252f840 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.449+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c0026040 con 0x555e0252f840 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.449+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e0252f840 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.449+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f71c0026040 con 0x555e0252f840 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.449+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x7f71b005f040 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.449+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c0026040 con 0x7f71b005f040 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.449+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02538840 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.449+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.449+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x7f71b005f040 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.450+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c0026040 con 0x7f71b005f040 2024-09-10T05:13:33.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.450+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e0252f840 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.450+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.450+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02533e90 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.450+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.450+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02538840 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.451+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.451+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02533e90 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.451+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.451+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x7f71b005f040 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.451+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c0035040 con 0x7f71b005f040 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.451+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e02538840 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.451+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.451+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x7f71b005f040 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c0035040 con 0x7f71b005f040 2024-09-10T05:13:33.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f71c003a040 con 0x555e0252f840 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f71c003a040 con 0x7f71b005f040 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71c0035040 con 0x7f71b005f040 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c8a0f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c8a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c8a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c8a0f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c8a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c8a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e0252f840 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.452+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x555e0252f840 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e02533130 con 0x7f71b005f040 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f71c0035040 con 0x7f71b005f040 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 20 zone default found 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 4 Realm: () 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:33.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 20 zonegroup default 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e02536dd0 con 0x555e02533e90 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.453+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e0253ccc0 con 0x555e02538840 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.454+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.454+0000 7f71c8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.454+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.454+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e0253d060 con 0x555e02538840 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.454+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.454+0000 7f71c8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.454+0000 7f71c8a0f800 20 started sync module instance, tier type = 2024-09-10T05:13:33.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.454+0000 7f71c8a0f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:33.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.454+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e0253c150 con 0x7f71b005f040 2024-09-10T05:13:33.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.455+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x7f71b005f040 2024-09-10T05:13:33.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.455+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93862254331472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e0253c150 con 0x7f71b005f040 2024-09-10T05:13:33.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.455+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e0253dbc0 con 0x555e0252f840 2024-09-10T05:13:33.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.456+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93862254331472] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x7f71b005f040 2024-09-10T05:13:33.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.456+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.456+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93862254335632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e0253c150 con 0x555e0252f840 2024-09-10T05:13:33.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.456+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e0253e640 con 0x555e02538840 2024-09-10T05:13:33.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.457+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93862254335632] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.458+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.458+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93862254328992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e0253c0c0 con 0x555e02538840 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.458+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e0253f530 con 0x7f71b005f040 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.459+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x7f71b005f040 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.459+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93862254342784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e0253fcf0 con 0x7f71b005f040 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.459+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02540810 con 0x555e0252f840 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.459+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93862254328992] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.460+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.460+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93862254346976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e025407d0 con 0x555e0252f840 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.460+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93862254342784] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x7f71b005f040 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.460+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02540d70 con 0x555e02533e90 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.461+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93862254346976] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.461+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.461+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93862254340704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02541110 con 0x555e02533e90 2024-09-10T05:13:33.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.461+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02541ad0 con 0x555e02533e90 2024-09-10T05:13:33.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.462+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93862254340704] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.462+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.462+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93862254351904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02541ef0 con 0x555e02533e90 2024-09-10T05:13:33.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.462+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e025428b0 con 0x555e02533e90 2024-09-10T05:13:33.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.463+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93862254351904] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.463+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.463+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93862254353440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e025428b0 con 0x555e02533e90 2024-09-10T05:13:33.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.463+0000 7f71c8a0f800 20 add_watcher() i=0 2024-09-10T05:13:33.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.463+0000 7f71c8a0f800 20 add_watcher() i=1 2024-09-10T05:13:33.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.463+0000 7f71c8a0f800 20 add_watcher() i=2 2024-09-10T05:13:33.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.463+0000 7f71c8a0f800 20 add_watcher() i=3 2024-09-10T05:13:33.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.463+0000 7f71c8a0f800 20 add_watcher() i=4 2024-09-10T05:13:33.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.463+0000 7f71c8a0f800 20 add_watcher() i=5 2024-09-10T05:13:33.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.463+0000 7f71c8a0f800 20 add_watcher() i=6 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.464+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93862254353440] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.464+0000 7f71c8a0f800 20 add_watcher() i=7 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.464+0000 7f71c8a0f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.464+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e02545c10 con 0x555e0252f840 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.465+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.465+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93862254355824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02542e40 con 0x555e0252f840 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.466+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93862254355824] v37'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.466+0000 7f707cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.466+0000 7f71c8a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.466+0000 7f71c8a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.466+0000 7f71c8a0f800 5 note: GC not initialized 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.466+0000 7f6ff77fe640 20 reqs_thread_entry: start 2024-09-10T05:13:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.466+0000 7f71c8a0f800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.466+0000 7f71c8a0f800 20 Filter name: none 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.466+0000 7f6ff57fa640 20 reqs_thread_entry: start 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.466+0000 7f71c8a0f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.466+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.466+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e02578db0 con 0x555e02533e90 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c8a0f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c8a0f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c8a0f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c8a0f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e02577450 con 0x555e0252f840 2024-09-10T05:13:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c8a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c8a0f800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c8a0f800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c8a0f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c8a0f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.467+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02577e10 con 0x555e02533e90 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.469+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v37'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.469+0000 7f71c8a0f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.469+0000 7f71c8a0f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.469+0000 7f71c8a0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.469+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93862254573680 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e0257c6f0 con 0x555e0252f840 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.469+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== watch-notify(notify (1) cookie 93862254346976 notify 158913789971 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f71c0010040 con 0x555e0252f840 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.469+0000 7f70a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789971 cookie 93862254346976 notifier 4840 bl.length()=649 2024-09-10T05:13:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.469+0000 7f70a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.469+0000 7f70a9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.469+0000 7f70a9ffb640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f708c003ea0 con 0x555e0252f840 2024-09-10T05:13:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.469+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.4 [notify cookie 93862254573680 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.469+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.470+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== watch-notify(notify_complete (2) cookie 93862254573680 notify 158913789971 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f71c000b2b0 con 0x555e0252f840 2024-09-10T05:13:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.470+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02577870 con 0x555e0252f840 2024-09-10T05:13:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v37'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f71c8a0f800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-10T05:13:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f71c8a0f800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T05:13:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f71c8a0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-10T05:13:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93862254573680 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555e0257c6f0 con 0x555e02538840 2024-09-10T05:13:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== watch-notify(notify (1) cookie 93862254328992 notify 158913789962 ret 0) ==== 219+0+0 (crc 0 0 0) 0x555e022896b0 con 0x555e02538840 2024-09-10T05:13:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f70a97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789962 cookie 93862254328992 notifier 4840 bl.length()=177 2024-09-10T05:13:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(68 notify.2 [notify cookie 93862254573680 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f70a97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-10T05:13:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f70a97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-10T05:13:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f70a97fa640 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f6ffc003400 con 0x555e02538840 2024-09-10T05:13:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== watch-notify(notify_complete (2) cookie 93862254573680 notify 158913789962 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f71b0075c70 con 0x555e02538840 2024-09-10T05:13:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.471+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.483 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:13:33.468641Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:13:33.468623Z","tags":[],"group_ids":[]} 2024-09-10T05:13:33.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.472+0000 7f707cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:33.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.472+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93862254355824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02576bc0 con 0x555e0252f840 2024-09-10T05:13:33.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.473+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93862254355824] v37'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.473+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93862254331472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02576bc0 con 0x7f71b005f040 2024-09-10T05:13:33.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.474+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93862254331472] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x7f71b005f040 2024-09-10T05:13:33.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.474+0000 7f71c8a0f800 20 remove_watcher() i=0 2024-09-10T05:13:33.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.474+0000 7f71c8a0f800 2 removed watcher, disabling cache 2024-09-10T05:13:33.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.474+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93862254335632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02576bc0 con 0x555e0252f840 2024-09-10T05:13:33.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.475+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93862254335632] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.475+0000 7f71c8a0f800 20 remove_watcher() i=1 2024-09-10T05:13:33.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.475+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93862254328992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02576bc0 con 0x555e02538840 2024-09-10T05:13:33.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.477+0000 7f71c5cf8640 1 -- 172.21.15.192:0/1248936109 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93862254328992] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b007c040 con 0x555e02538840 2024-09-10T05:13:33.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.477+0000 7f71c8a0f800 20 remove_watcher() i=2 2024-09-10T05:13:33.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.477+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93862254342784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02576bc0 con 0x7f71b005f040 2024-09-10T05:13:33.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.477+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93862254342784] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x7f71b005f040 2024-09-10T05:13:33.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.477+0000 7f71c8a0f800 20 remove_watcher() i=3 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.477+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93862254346976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02576bc0 con 0x555e0252f840 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.479+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93862254346976] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71c0035040 con 0x555e0252f840 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.479+0000 7f71c8a0f800 20 remove_watcher() i=4 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.479+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93862254340704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02576bc0 con 0x555e02533e90 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.480+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93862254340704] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.480+0000 7f71c8a0f800 20 remove_watcher() i=5 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.480+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93862254351904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02576bc0 con 0x555e02533e90 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.481+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93862254351904] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.481+0000 7f71c8a0f800 20 remove_watcher() i=6 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.481+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93862254353440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555e02576bc0 con 0x555e02533e90 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c64f9640 1 -- 172.21.15.192:0/1248936109 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93862254353440] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71b8067070 con 0x555e02533e90 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 20 remove_watcher() i=7 2024-09-10T05:13:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555e02533e90 msgr2=0x555e02536280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555e02533e90 0x555e02536280 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x555e0252f840 msgr2=0x555e02531d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x555e0252f840 0x555e02531d00 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f71b005f040 msgr2=0x7f71b006b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f71b005f040 0x7f71b006b410 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x555e02538840 msgr2=0x555e0253ad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x555e02538840 0x555e0253ad00 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f709003c780 msgr2=0x7f709003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f709003c780 0x7f709003ec40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f71b0000c00 tx=0x7f71b0053000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 msgr2=0x555e02524220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1248936109 reap_dead start 2024-09-10T05:13:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 0x555e02524220 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f71b8010b80 tx=0x7f71b8015f90 comp rx=0 tx=0).stop 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 shutdown_connections 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1248936109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e0251ce20 0x555e02524220 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 >> 172.21.15.192:0/1248936109 conn(0x555e02519220 msgr2=0x555e02517430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.482+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 shutdown_connections 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1248936109 wait complete. 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3706855203 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f70a003c780 msgr2=0x7f70a003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/3706855203 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f70a003c780 0x7f70a003ec40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x555e024feb80 tx=0x7f71b0005a00 comp rx=0 tx=0).stop 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3706855203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e025103e0 msgr2=0x555e02510800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/3706855203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e025103e0 0x555e02510800 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f71b8014ff0 tx=0x7f71b8028ea0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3706855203 shutdown_connections 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/3706855203 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f70a003c780 0x7f70a003ec40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/3706855203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e025103e0 0x555e02510800 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3706855203 >> 172.21.15.192:0/3706855203 conn(0x555e02504790 msgr2=0x555e02504b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3706855203 shutdown_connections 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/3706855203 wait complete. 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555e024fbbe0 msgr2=0x555e024fe050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x555e024fbbe0 0x555e024fe050 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x555e023f9010 msgr2=0x555e024f9840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x555e023f9010 0x555e024f9840 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x555e024ffc40 msgr2=0x555e02502030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x555e024ffc40 0x555e02502030 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f70ac03c780 msgr2=0x7f70ac03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f70ac03c780 0x7f70ac03ec40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f71b0057000 tx=0x7f71b0052000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 msgr2=0x555e024f21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 --2- 172.21.15.192:0/1805144862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555e023f74f0 0x555e024f21f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f71b8001330 tx=0x7f71b8001250 comp rx=0 tx=0).stop 2024-09-10T05:13:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c6cfa640 1 -- 172.21.15.192:0/1805144862 reap_dead start 2024-09-10T05:13:33.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 shutdown_connections 2024-09-10T05:13:33.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 >> 172.21.15.192:0/1805144862 conn(0x555e023f3220 msgr2=0x555e024ebb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.483+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 shutdown_connections 2024-09-10T05:13:33.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.484+0000 7f71c8a0f800 1 -- 172.21.15.192:0/1805144862 wait complete. 2024-09-10T05:13:33.495 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:33.495 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:33.495 ERROR:root:0 2024-09-10T05:13:33.496 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:33.502 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000000d80c9bace75508e-0066dfd57d-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:13:33.502 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-10T05:13:33.513 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:33.513 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-10T05:13:33.524 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-10T05:13:33.524 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-10T05:13:33.538 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-10T05:13:33.539 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-10T05:13:33.546 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-10T05:13:33.547 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:33.550 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:33.551 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-10T05:13:33.554 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:33.555 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:13:33.555 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:13:33.555 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-10T05:13:33.601 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:33.601 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:33.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.601+0000 7f440793d800 1 Processor -- start 2024-09-10T05:13:33.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.601+0000 7f440793d800 1 -- start start 2024-09-10T05:13:33.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.601+0000 7f440793d800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x556edb6af760 0x556edb6afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.601+0000 7f440793d800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556edb5e5e40 con 0x556edb6b00a0 2024-09-10T05:13:33.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.601+0000 7f440793d800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x556edb5b0680 con 0x556edb6af760 2024-09-10T05:13:33.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.602+0000 7f440362a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x556edb6af760 0x556edb6afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.602+0000 7f43fbfff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x556edb6b00a0 0x556edb743a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46510/0 (socket says 172.21.15.192:46510) 2024-09-10T05:13:33.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.602+0000 7f440362a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x556edb6af760 0x556edb6afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33738/0 (socket says 172.21.15.192:33738) 2024-09-10T05:13:33.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.602+0000 7f43fbfff640 1 -- 172.21.15.192:0/249873518 learned_addr learned my addr 172.21.15.192:0/249873518 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:33.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.602+0000 7f440362a640 1 -- 172.21.15.192:0/249873518 >> v1:172.21.15.139:6789/0 conn(0x556edb6b00a0 legacy=0x556edb743a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.602+0000 7f440362a640 1 -- 172.21.15.192:0/249873518 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556edb5cc6b0 con 0x556edb6af760 2024-09-10T05:13:33.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.602+0000 7f4402e29640 1 -- 172.21.15.192:0/249873518 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 55655023 0 0) 0x556edb5e5e40 con 0x556edb6b00a0 2024-09-10T05:13:33.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.604+0000 7f440362a640 1 --2- 172.21.15.192:0/249873518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb6afb60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f43f400a470 tx=0x7f43f4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b3ecb0ee2351d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.604+0000 7f4402e29640 1 -- 172.21.15.192:0/249873518 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4053570 con 0x556edb6af760 2024-09-10T05:13:33.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.604+0000 7f4402e29640 1 -- 172.21.15.192:0/249873518 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f4058070 con 0x556edb6af760 2024-09-10T05:13:33.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.604+0000 7f4402e29640 1 -- 172.21.15.192:0/249873518 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4053880 con 0x556edb6af760 2024-09-10T05:13:33.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.604+0000 7f440793d800 1 -- 172.21.15.192:0/249873518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 msgr2=0x556edb6afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.604+0000 7f440793d800 1 --2- 172.21.15.192:0/249873518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb6afb60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f43f400a470 tx=0x7f43f4045a20 comp rx=0 tx=0).stop 2024-09-10T05:13:33.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.604+0000 7f440793d800 1 -- 172.21.15.192:0/249873518 shutdown_connections 2024-09-10T05:13:33.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.604+0000 7f440793d800 1 --2- 172.21.15.192:0/249873518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb6afb60 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.604+0000 7f440793d800 1 -- 172.21.15.192:0/249873518 >> 172.21.15.192:0/249873518 conn(0x556edb7372f0 msgr2=0x556edb739750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.604+0000 7f440793d800 1 -- 172.21.15.192:0/249873518 shutdown_connections 2024-09-10T05:13:33.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.604+0000 7f440793d800 1 -- 172.21.15.192:0/249873518 wait complete. 2024-09-10T05:13:33.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.618+0000 7f440793d800 1 Processor -- start 2024-09-10T05:13:33.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.618+0000 7f440793d800 1 -- start start 2024-09-10T05:13:33.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.618+0000 7f440793d800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb82d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.618+0000 7f440793d800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556edb5d4dd0 con 0x556edb6af760 2024-09-10T05:13:33.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.618+0000 7f440362a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb82d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.619+0000 7f440362a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb82d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33742/0 (socket says 172.21.15.192:33742) 2024-09-10T05:13:33.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.619+0000 7f440362a640 1 -- 172.21.15.192:0/1213727255 learned_addr learned my addr 172.21.15.192:0/1213727255 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.619+0000 7f440362a640 1 -- 172.21.15.192:0/1213727255 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556edb5ede10 con 0x556edb6af760 2024-09-10T05:13:33.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.619+0000 7f440362a640 1 --2- 172.21.15.192:0/1213727255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb82d6f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f43f4025c20 tx=0x7f43f4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c190c1e10aed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.619+0000 7f42f160a640 1 -- 172.21.15.192:0/1213727255 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4053a20 con 0x556edb6af760 2024-09-10T05:13:33.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.619+0000 7f42f160a640 1 -- 172.21.15.192:0/1213727255 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f4063070 con 0x556edb6af760 2024-09-10T05:13:33.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.619+0000 7f42f160a640 1 -- 172.21.15.192:0/1213727255 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4053d30 con 0x556edb6af760 2024-09-10T05:13:33.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.620+0000 7f440793d800 1 -- 172.21.15.192:0/1213727255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 msgr2=0x556edb82d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.620+0000 7f440793d800 1 --2- 172.21.15.192:0/1213727255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb82d6f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f43f4025c20 tx=0x7f43f4051000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.620+0000 7f440793d800 1 -- 172.21.15.192:0/1213727255 shutdown_connections 2024-09-10T05:13:33.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.620+0000 7f440793d800 1 --2- 172.21.15.192:0/1213727255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb82d6f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.620+0000 7f440793d800 1 -- 172.21.15.192:0/1213727255 >> 172.21.15.192:0/1213727255 conn(0x556edb7372f0 msgr2=0x556edb829070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.620+0000 7f440793d800 1 -- 172.21.15.192:0/1213727255 shutdown_connections 2024-09-10T05:13:33.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.620+0000 7f440793d800 1 -- 172.21.15.192:0/1213727255 wait complete. 2024-09-10T05:13:33.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.620+0000 7f440793d800 1 Processor -- start 2024-09-10T05:13:33.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.620+0000 7f440793d800 1 -- start start 2024-09-10T05:13:33.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.620+0000 7f440793d800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb834fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.620+0000 7f440793d800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556edb745340 con 0x556edb6af760 2024-09-10T05:13:33.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.621+0000 7f440362a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb834fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.621+0000 7f440362a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb834fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33748/0 (socket says 172.21.15.192:33748) 2024-09-10T05:13:33.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.621+0000 7f440362a640 1 -- 172.21.15.192:0/1606960019 learned_addr learned my addr 172.21.15.192:0/1606960019 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.621+0000 7f440362a640 1 -- 172.21.15.192:0/1606960019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556edb835520 con 0x556edb6af760 2024-09-10T05:13:33.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.621+0000 7f440362a640 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb834fc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f43f4025c20 tx=0x7f43f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.621+0000 7f42efe07640 1 -- 172.21.15.192:0/1606960019 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4078070 con 0x556edb6af760 2024-09-10T05:13:33.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.621+0000 7f42efe07640 1 -- 172.21.15.192:0/1606960019 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f4073470 con 0x556edb6af760 2024-09-10T05:13:33.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.621+0000 7f42efe07640 1 -- 172.21.15.192:0/1606960019 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4073750 con 0x556edb6af760 2024-09-10T05:13:33.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.621+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556edb8357b0 con 0x556edb6af760 2024-09-10T05:13:33.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.621+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556edb8363c0 con 0x556edb6af760 2024-09-10T05:13:33.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.622+0000 7f42efe07640 1 -- 172.21.15.192:0/1606960019 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f43f407b070 con 0x556edb6af760 2024-09-10T05:13:33.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.622+0000 7f42efe07640 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42e803c780 0x7f42e803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.622+0000 7f42efe07640 1 -- 172.21.15.192:0/1606960019 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f43f4097c50 con 0x556edb6af760 2024-09-10T05:13:33.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.622+0000 7f43fbfff640 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42e803c780 0x7f42e803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.622+0000 7f440793d800 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556edb6b00a0 0x556edb83c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.622+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb836d80 con 0x556edb6b00a0 2024-09-10T05:13:33.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.623+0000 7f4403e2b640 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556edb6b00a0 0x556edb83c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.623+0000 7f43fbfff640 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42e803c780 0x7f42e803ec40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f43ec000c00 tx=0x7f43ec0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.623+0000 7f4403e2b640 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556edb6b00a0 0x556edb83c610 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.623+0000 7f4403e2b640 1 -- 172.21.15.192:0/1606960019 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb6b00a0 2024-09-10T05:13:33.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.623+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb836730 con 0x556edb6b00a0 2024-09-10T05:13:33.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.623+0000 7f4403e2b640 1 -- 172.21.15.192:0/1606960019 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb6b00a0 2024-09-10T05:13:33.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.623+0000 7f440793d800 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556edb83ea80 0x556edb840e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.623+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb841540 con 0x556edb83ea80 2024-09-10T05:13:33.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.624+0000 7f440362a640 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556edb83ea80 0x556edb840e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.624+0000 7f440362a640 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556edb83ea80 0x556edb840e70 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.624+0000 7f440362a640 1 -- 172.21.15.192:0/1606960019 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f43f407a030 con 0x556edb83ea80 2024-09-10T05:13:33.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.624+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb83d920 con 0x556edb6b00a0 2024-09-10T05:13:33.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.625+0000 7f4403e2b640 1 -- 172.21.15.192:0/1606960019 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb6b00a0 2024-09-10T05:13:33.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.625+0000 7f440793d800 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556edb842980 0x556edb844d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.625+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb8454b0 con 0x556edb842980 2024-09-10T05:13:33.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.625+0000 7f43fbfff640 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556edb842980 0x556edb844d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.625+0000 7f43fbfff640 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556edb842980 0x556edb844d70 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.625+0000 7f43fbfff640 1 -- 172.21.15.192:0/1606960019 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f43ec00f670 con 0x556edb842980 2024-09-10T05:13:33.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.626+0000 7f440793d800 1 Processor -- start 2024-09-10T05:13:33.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.626+0000 7f440793d800 1 -- start start 2024-09-10T05:13:33.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.626+0000 7f440793d800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb853110 0x556edb853530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.626+0000 7f440793d800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556edb632a00 con 0x556edb853110 2024-09-10T05:13:33.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.626+0000 7f440362a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb853110 0x556edb853530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.626+0000 7f440362a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb853110 0x556edb853530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33756/0 (socket says 172.21.15.192:33756) 2024-09-10T05:13:33.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.626+0000 7f440362a640 1 -- 172.21.15.192:0/714161171 learned_addr learned my addr 172.21.15.192:0/714161171 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.626+0000 7f440362a640 1 -- 172.21.15.192:0/714161171 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556edb853b70 con 0x556edb853110 2024-09-10T05:13:33.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.627+0000 7f440362a640 1 --2- 172.21.15.192:0/714161171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb853110 0x556edb853530 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f43f4095f00 tx=0x7f43f405de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.627+0000 7f42ed602640 1 -- 172.21.15.192:0/714161171 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f407c6a0 con 0x556edb853110 2024-09-10T05:13:33.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.627+0000 7f42ed602640 1 -- 172.21.15.192:0/714161171 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f407c840 con 0x556edb853110 2024-09-10T05:13:33.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.627+0000 7f440793d800 1 -- 172.21.15.192:0/714161171 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556edb8543a0 con 0x556edb853110 2024-09-10T05:13:33.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.627+0000 7f42ed602640 1 -- 172.21.15.192:0/714161171 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f40685e0 con 0x556edb853110 2024-09-10T05:13:33.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.627+0000 7f440793d800 1 -- 172.21.15.192:0/714161171 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556edb854940 con 0x556edb853110 2024-09-10T05:13:33.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.627+0000 7f42ed602640 1 -- 172.21.15.192:0/714161171 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f43f4068780 con 0x556edb853110 2024-09-10T05:13:33.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.628+0000 7f42ed602640 1 --2- 172.21.15.192:0/714161171 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42dc03c780 0x7f42dc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.628+0000 7f42ed602640 1 -- 172.21.15.192:0/714161171 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f43f408f070 con 0x556edb853110 2024-09-10T05:13:33.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.628+0000 7f43fbfff640 1 --2- 172.21.15.192:0/714161171 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42dc03c780 0x7f42dc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.628+0000 7f440793d800 1 Processor -- start 2024-09-10T05:13:33.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.628+0000 7f440793d800 1 -- start start 2024-09-10T05:13:33.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.628+0000 7f43fbfff640 1 --2- 172.21.15.192:0/714161171 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42dc03c780 0x7f42dc03ec40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x556edb83cc20 tx=0x7f43ec006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.628+0000 7f440793d800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 0x556edb85fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.628+0000 7f440793d800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556edb82dee0 con 0x556edb85f990 2024-09-10T05:13:33.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.628+0000 7f440362a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 0x556edb85fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.628+0000 7f440362a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 0x556edb85fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33762/0 (socket says 172.21.15.192:33762) 2024-09-10T05:13:33.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.628+0000 7f440362a640 1 -- 172.21.15.192:0/2483745237 learned_addr learned my addr 172.21.15.192:0/2483745237 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.629+0000 7f440362a640 1 -- 172.21.15.192:0/2483745237 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556edb860360 con 0x556edb85f990 2024-09-10T05:13:33.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.629+0000 7f440362a640 1 --2- 172.21.15.192:0/2483745237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 0x556edb85fd70 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f43f407ca90 tx=0x7f43f40523c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d286e61ee2c3ca66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.629+0000 7f42e6ffd640 1 -- 172.21.15.192:0/2483745237 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4092e30 con 0x556edb85f990 2024-09-10T05:13:33.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.629+0000 7f42e6ffd640 1 -- 172.21.15.192:0/2483745237 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f407d440 con 0x556edb85f990 2024-09-10T05:13:33.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.629+0000 7f42e6ffd640 1 -- 172.21.15.192:0/2483745237 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f40923c0 con 0x556edb85f990 2024-09-10T05:13:33.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.629+0000 7f440793d800 1 -- 172.21.15.192:0/2483745237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 msgr2=0x556edb85fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.629+0000 7f440793d800 1 --2- 172.21.15.192:0/2483745237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 0x556edb85fd70 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f43f407ca90 tx=0x7f43f40523c0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.629+0000 7f440793d800 1 -- 172.21.15.192:0/2483745237 shutdown_connections 2024-09-10T05:13:33.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.629+0000 7f440793d800 1 --2- 172.21.15.192:0/2483745237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 0x556edb85fd70 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.629+0000 7f440793d800 1 -- 172.21.15.192:0/2483745237 >> 172.21.15.192:0/2483745237 conn(0x556edb85bd90 msgr2=0x556edb859fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.629+0000 7f440793d800 1 -- 172.21.15.192:0/2483745237 shutdown_connections 2024-09-10T05:13:33.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.629+0000 7f440793d800 1 -- 172.21.15.192:0/2483745237 wait complete. 2024-09-10T05:13:33.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.630+0000 7f440793d800 1 Processor -- start 2024-09-10T05:13:33.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.630+0000 7f440793d800 1 -- start start 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.630+0000 7f440793d800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 0x556edb866e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.630+0000 7f440793d800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556edb8607f0 con 0x556edb85f990 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.630+0000 7f440362a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 0x556edb866e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.630+0000 7f440362a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 0x556edb866e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33774/0 (socket says 172.21.15.192:33774) 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.630+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 learned_addr learned my addr 172.21.15.192:0/3692993981 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.630+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556edb867390 con 0x556edb85f990 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.631+0000 7f440362a640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 0x556edb866e30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f43f404e010 tx=0x7f43f405ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.631+0000 7f42e57fa640 1 -- 172.21.15.192:0/3692993981 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4092e30 con 0x556edb85f990 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.631+0000 7f42e57fa640 1 -- 172.21.15.192:0/3692993981 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f405c870 con 0x556edb85f990 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.631+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556edb867390 con 0x556edb85f990 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.631+0000 7f42e57fa640 1 -- 172.21.15.192:0/3692993981 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f4052b10 con 0x556edb85f990 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.631+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556edb867390 con 0x556edb85f990 2024-09-10T05:13:33.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.631+0000 7f42e57fa640 1 -- 172.21.15.192:0/3692993981 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f43f40bd030 con 0x556edb85f990 2024-09-10T05:13:33.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.632+0000 7f42e57fa640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42cc03c780 0x7f42cc03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.632+0000 7f42e57fa640 1 -- 172.21.15.192:0/3692993981 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f43f40bb070 con 0x556edb85f990 2024-09-10T05:13:33.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.632+0000 7f43fbfff640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42cc03c780 0x7f42cc03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.632+0000 7f43fbfff640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42cc03c780 0x7f42cc03ec40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00ffd0 tx=0x7f43ec023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.632+0000 7f440793d800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.632+0000 7f440793d800 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556edb8722e0 0x556edb8747a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.632+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb874ef0 con 0x556edb8722e0 2024-09-10T05:13:33.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.632+0000 7f4403e2b640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556edb8722e0 0x556edb8747a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f4403e2b640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556edb8722e0 0x556edb8747a0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f440793d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f440793d800 20 realm 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f440793d800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb875300 con 0x556edb8722e0 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f440793d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f440793d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f440793d800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb875bd0 con 0x556edb8722e0 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f440793d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f440793d800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.633+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb8722e0 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.634+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.634+0000 7f440793d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:33.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.634+0000 7f440793d800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.634+0000 7f440793d800 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556edb876cd0 0x556edb8790c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.634+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb879680 con 0x556edb876cd0 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.634+0000 7f440362a640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556edb876cd0 0x556edb8790c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.634+0000 7f440362a640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556edb876cd0 0x556edb8790c0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.635+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.635+0000 7f440793d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.635+0000 7f440793d800 20 searching for the correct realm 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.635+0000 7f440793d800 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556edb87b630 0x556edb87daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.635+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb87e1c0 con 0x556edb87b630 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.635+0000 7f43fbfff640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556edb87b630 0x556edb87daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.635+0000 7f43fbfff640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556edb87b630 0x556edb87daf0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.635+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.635+0000 7f43fbfff640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f43ec02e910 0x7f43ec03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.635+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb87e1c0 con 0x7f43ec02e910 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.635+0000 7f4403e2b640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f43ec02e910 0x7f43ec03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.636+0000 7f4403e2b640 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f43ec02e910 0x7f43ec03a3c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.636+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.636+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb876cd0 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.636+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.636+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb8722e0 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.637+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.637+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb8722e0 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.637+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.637+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb876cd0 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.637+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.637+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb876cd0 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.637+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.637+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x7f43ec02e910 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.637+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.637+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb87b630 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.638+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.638+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb8722e0 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.638+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.638+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb876cd0 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.638+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.638+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb8722e0 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.638+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.638+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x7f43ec02e910 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.639+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.639+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb87b630 2024-09-10T05:13:33.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.639+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.639+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb87b630 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.639+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.639+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb876cd0 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.639+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.639+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb87b630 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.640+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.640+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb87b630 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.640+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.640+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb8722e0 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.640+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.640+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb8722e0 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.640+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.640+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x7f43ec02e910 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.641+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.641+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb87b630 2024-09-10T05:13:33.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.641+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.641+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x7f43ec02e910 2024-09-10T05:13:33.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.641+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.641+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb8722e0 2024-09-10T05:13:33.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.641+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.641+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb876cd0 2024-09-10T05:13:33.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.642+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.642+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb87b630 2024-09-10T05:13:33.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.642+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.642+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb876cd0 2024-09-10T05:13:33.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.642+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.642+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x7f43ec02e910 2024-09-10T05:13:33.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.642+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.642+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb87b630 2024-09-10T05:13:33.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x7f43ec02e910 2024-09-10T05:13:33.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x556edb8722e0 2024-09-10T05:13:33.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556edb875f70 con 0x7f43ec02e910 2024-09-10T05:13:33.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f440793d800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:33.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f440793d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:33.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f440793d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:33.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f440793d800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f440793d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f440793d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f440793d800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.643+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb879f40 con 0x556edb8722e0 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb879f40 con 0x556edb8722e0 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb879f40 con 0x7f43ec02e910 2024-09-10T05:13:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 20 zone default found 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 4 Realm: () 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 20 zonegroup default 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.644+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb87a7e0 con 0x556edb876cd0 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f440793d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f440793d800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb880030 con 0x556edb87b630 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f440793d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f440793d800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb8803d0 con 0x556edb87b630 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f440793d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f440793d800 20 started sync module instance, tier type = 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f440793d800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.645+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb87f4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.646+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.646+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93934617882928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb87fbb0 con 0x7f43ec02e910 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.646+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb880dd0 con 0x556edb8722e0 2024-09-10T05:13:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.647+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93934617882928] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.648+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.648+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93934617888992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb87fb70 con 0x556edb8722e0 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.648+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb881820 con 0x556edb87b630 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.649+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93934617888992] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.649+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.649+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93934617884352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb87fae0 con 0x556edb87b630 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.649+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb8826e0 con 0x7f43ec02e910 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.650+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93934617884352] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.650+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.650+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93934617895472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb882b00 con 0x7f43ec02e910 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.650+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb8834c0 con 0x556edb8722e0 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.651+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.651+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93934617899024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb8838e0 con 0x556edb8722e0 2024-09-10T05:13:33.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.652+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb884360 con 0x556edb876cd0 2024-09-10T05:13:33.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.652+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93934617895472] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.653+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.653+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93934617902672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb884320 con 0x556edb876cd0 2024-09-10T05:13:33.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.653+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93934617899024] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.653+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb884db0 con 0x556edb876cd0 2024-09-10T05:13:33.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.654+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.654+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93934617905344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb884db0 con 0x556edb876cd0 2024-09-10T05:13:33.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.654+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb885810 con 0x556edb876cd0 2024-09-10T05:13:33.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.654+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93934617902672] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.654+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93934617905344] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.655+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.655+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93934617900080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb8852f0 con 0x556edb876cd0 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.655+0000 7f440793d800 20 add_watcher() i=0 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.655+0000 7f440793d800 20 add_watcher() i=1 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.655+0000 7f440793d800 20 add_watcher() i=2 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.655+0000 7f440793d800 20 add_watcher() i=3 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.655+0000 7f440793d800 20 add_watcher() i=4 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.655+0000 7f440793d800 20 add_watcher() i=5 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.655+0000 7f440793d800 20 add_watcher() i=6 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.656+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93934617900080] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.656+0000 7f440793d800 20 add_watcher() i=7 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.656+0000 7f440793d800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.656+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb888840 con 0x556edb8722e0 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.656+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.656+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93934617896528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb885cc0 con 0x556edb8722e0 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.657+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93934617896528] v37'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.657+0000 7f42b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.657+0000 7f440793d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.657+0000 7f440793d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.657+0000 7f440793d800 5 note: GC not initialized 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.657+0000 7f42b8fe1640 20 reqs_thread_entry: start 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.657+0000 7f440793d800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.658+0000 7f440793d800 20 Filter name: none 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.658+0000 7f42327fc640 20 reqs_thread_entry: start 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.658+0000 7f440793d800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.658+0000 7f440793d800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.658+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb8bb7b0 con 0x556edb876cd0 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.658+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.658+0000 7f440793d800 20 rados_obj.operate() r=0 bl.length=473 2024-09-10T05:13:33.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.658+0000 7f440793d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:13:33.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.658+0000 7f440793d800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:33.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.658+0000 7f440793d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:33.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.659+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb8c1f10 con 0x556edb876cd0 2024-09-10T05:13:33.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v37'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f440793d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:33.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f440793d800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:33.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f440793d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:13:33.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93934618155280 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556edb8bd5d0 con 0x556edb8722e0 2024-09-10T05:13:33.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== watch-notify(notify (1) cookie 93934617899024 notify 158913789973 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f43fc018a70 con 0x556edb8722e0 2024-09-10T05:13:33.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f42e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789973 cookie 93934617899024 notifier 4847 bl.length()=636 2024-09-10T05:13:33.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f42e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:33.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f42e6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:33.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 notify.4 [notify cookie 93934618155280 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f42e6ffd640 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f42c8003ea0 con 0x556edb8722e0 2024-09-10T05:13:33.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.660+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== watch-notify(notify_complete (2) cookie 93934618155280 notify 158913789973 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f43fc018d10 con 0x556edb8722e0 2024-09-10T05:13:33.670 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:13:33.468641Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:13:33.468623Z","tags":[],"group_ids":[]} 2024-09-10T05:13:33.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.661+0000 7f42b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:33.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.661+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93934617896528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb8b95e0 con 0x556edb8722e0 2024-09-10T05:13:33.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.662+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93934617896528] v37'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.662+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93934617882928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb8b95e0 con 0x7f43ec02e910 2024-09-10T05:13:33.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.663+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93934617882928] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.663+0000 7f440793d800 20 remove_watcher() i=0 2024-09-10T05:13:33.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.663+0000 7f440793d800 2 removed watcher, disabling cache 2024-09-10T05:13:33.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.663+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93934617888992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb8b95e0 con 0x556edb8722e0 2024-09-10T05:13:33.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.664+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93934617888992] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.664+0000 7f440793d800 20 remove_watcher() i=1 2024-09-10T05:13:33.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.664+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93934617884352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb8b95e0 con 0x556edb87b630 2024-09-10T05:13:33.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.665+0000 7f43fbfff640 1 -- 172.21.15.192:0/3692993981 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93934617884352] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43ec037040 con 0x556edb87b630 2024-09-10T05:13:33.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.665+0000 7f440793d800 20 remove_watcher() i=2 2024-09-10T05:13:33.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.665+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93934617895472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb87f130 con 0x7f43ec02e910 2024-09-10T05:13:33.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.666+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93934617895472] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x7f43ec02e910 2024-09-10T05:13:33.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.666+0000 7f440793d800 20 remove_watcher() i=3 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.666+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93934617899024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb8826e0 con 0x556edb8722e0 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.667+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93934617899024] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43fc00a4d0 con 0x556edb8722e0 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.667+0000 7f440793d800 20 remove_watcher() i=4 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.667+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93934617902672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb883010 con 0x556edb876cd0 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.668+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93934617902672] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.668+0000 7f440793d800 20 remove_watcher() i=5 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.668+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93934617905344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb883e50 con 0x556edb876cd0 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.669+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93934617905344] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.669+0000 7f440793d800 20 remove_watcher() i=6 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.669+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93934617900080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556edb883010 con 0x556edb876cd0 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.670+0000 7f440362a640 1 -- 172.21.15.192:0/3692993981 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93934617900080] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43f407a030 con 0x556edb876cd0 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.670+0000 7f440793d800 20 remove_watcher() i=7 2024-09-10T05:13:33.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.670+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556edb876cd0 msgr2=0x556edb8790c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.670+0000 7f440793d800 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556edb876cd0 0x556edb8790c0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.670+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556edb8722e0 msgr2=0x556edb8747a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.670+0000 7f440793d800 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556edb8722e0 0x556edb8747a0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.670+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f43ec02e910 msgr2=0x7f43ec03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.670+0000 7f440793d800 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f43ec02e910 0x7f43ec03a3c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.670+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556edb87b630 msgr2=0x556edb87daf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.670+0000 7f440793d800 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x556edb87b630 0x556edb87daf0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42cc03c780 msgr2=0x7f42cc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42cc03c780 0x7f42cc03ec40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00ffd0 tx=0x7f43ec023040 comp rx=0 tx=0).stop 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 msgr2=0x556edb866e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 --2- 172.21.15.192:0/3692993981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb85f990 0x556edb866e30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f43f404e010 tx=0x7f43f405ae90 comp rx=0 tx=0).stop 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 reap_dead start 2024-09-10T05:13:33.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f4403e2b640 1 -- 172.21.15.192:0/3692993981 reap_dead start 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 shutdown_connections 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 >> 172.21.15.192:0/3692993981 conn(0x556edb85bd90 msgr2=0x556edb859fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 shutdown_connections 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/3692993981 wait complete. 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/714161171 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42dc03c780 msgr2=0x7f42dc03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 --2- 172.21.15.192:0/714161171 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42dc03c780 0x7f42dc03ec40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x556edb83cc20 tx=0x7f43ec006000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/714161171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb853110 msgr2=0x556edb853530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 --2- 172.21.15.192:0/714161171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb853110 0x556edb853530 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f43f4095f00 tx=0x7f43f405de70 comp rx=0 tx=0).stop 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/714161171 shutdown_connections 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 --2- 172.21.15.192:0/714161171 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42dc03c780 0x7f42dc03ec40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 --2- 172.21.15.192:0/714161171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb853110 0x556edb853530 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/714161171 >> 172.21.15.192:0/714161171 conn(0x556edb8474c0 msgr2=0x556edb8478a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/714161171 shutdown_connections 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/714161171 wait complete. 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556edb83ea80 msgr2=0x556edb840e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x556edb83ea80 0x556edb840e70 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556edb6b00a0 msgr2=0x556edb83c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x556edb6b00a0 0x556edb83c610 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556edb842980 msgr2=0x556edb844d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.671+0000 7f440793d800 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x556edb842980 0x556edb844d70 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.672+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42e803c780 msgr2=0x7f42e803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.672+0000 7f440793d800 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f42e803c780 0x7f42e803ec40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f43ec000c00 tx=0x7f43ec0013b0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.672+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 msgr2=0x556edb834fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.672+0000 7f440793d800 1 --2- 172.21.15.192:0/1606960019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556edb6af760 0x556edb834fc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f43f4025c20 tx=0x7f43f4002fb0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.672+0000 7f4403e2b640 1 -- 172.21.15.192:0/1606960019 reap_dead start 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.672+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 shutdown_connections 2024-09-10T05:13:33.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.672+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 >> 172.21.15.192:0/1606960019 conn(0x556edb7372f0 msgr2=0x556edb82e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.672+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 shutdown_connections 2024-09-10T05:13:33.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.672+0000 7f440793d800 1 -- 172.21.15.192:0/1606960019 wait complete. 2024-09-10T05:13:33.681 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:33.682 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:33.682 ERROR:root:0 2024-09-10T05:13:33.682 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-10T05:13:33.682 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-10T05:13:33.682 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-10T05:13:33.735 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:33.735 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:33.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.735+0000 7faed4615800 1 Processor -- start 2024-09-10T05:13:33.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.735+0000 7faed4615800 1 -- start start 2024-09-10T05:13:33.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.735+0000 7faed4615800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55cf0c546500 0x55cf0c546900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.735+0000 7faed4615800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cf0c3f1e40 con 0x55cf0c546e40 2024-09-10T05:13:33.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.735+0000 7faed4615800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55cf0c3bc680 con 0x55cf0c546500 2024-09-10T05:13:33.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.735+0000 7faecfd92640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55cf0c546500 0x55cf0c546900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.735+0000 7faecfd92640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55cf0c546500 0x55cf0c546900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33788/0 (socket says 172.21.15.192:33788) 2024-09-10T05:13:33.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.735+0000 7faecfd92640 1 -- 172.21.15.192:0/3885551608 learned_addr learned my addr 172.21.15.192:0/3885551608 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.735+0000 7faecf591640 1 --1- 172.21.15.192:0/3885551608 >> v1:172.21.15.139:6789/0 conn(0x55cf0c546e40 0x55cf0c5472f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46522/0 (socket says 172.21.15.192:46522) 2024-09-10T05:13:33.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.736+0000 7faecfd92640 1 -- 172.21.15.192:0/3885551608 >> v1:172.21.15.139:6789/0 conn(0x55cf0c546e40 legacy=0x55cf0c5472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.736+0000 7faecfd92640 1 -- 172.21.15.192:0/3885551608 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0c3d86b0 con 0x55cf0c546500 2024-09-10T05:13:33.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.736+0000 7faeced90640 1 -- 172.21.15.192:0/3885551608 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2334189755 0 0) 0x55cf0c3f1e40 con 0x55cf0c546e40 2024-09-10T05:13:33.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.737+0000 7faecfd92640 1 --2- 172.21.15.192:0/3885551608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c546900 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7faec800a520 tx=0x7faec8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e7f9be49dd7459 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.737+0000 7faeced90640 1 -- 172.21.15.192:0/3885551608 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec8055070 con 0x55cf0c546500 2024-09-10T05:13:33.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.737+0000 7faeced90640 1 -- 172.21.15.192:0/3885551608 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec80515b0 con 0x55cf0c546500 2024-09-10T05:13:33.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.737+0000 7faeced90640 1 -- 172.21.15.192:0/3885551608 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec80518d0 con 0x55cf0c546500 2024-09-10T05:13:33.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.738+0000 7faed4615800 1 -- 172.21.15.192:0/3885551608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 msgr2=0x55cf0c546900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.738+0000 7faed4615800 1 --2- 172.21.15.192:0/3885551608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c546900 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7faec800a520 tx=0x7faec8045ba0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.738+0000 7faed4615800 1 -- 172.21.15.192:0/3885551608 shutdown_connections 2024-09-10T05:13:33.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.738+0000 7faed4615800 1 --2- 172.21.15.192:0/3885551608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c546900 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.738+0000 7faed4615800 1 -- 172.21.15.192:0/3885551608 >> 172.21.15.192:0/3885551608 conn(0x55cf0c542250 msgr2=0x55cf0c544690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.738+0000 7faed4615800 1 -- 172.21.15.192:0/3885551608 shutdown_connections 2024-09-10T05:13:33.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.738+0000 7faed4615800 1 -- 172.21.15.192:0/3885551608 wait complete. 2024-09-10T05:13:33.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.753+0000 7faed4615800 1 Processor -- start 2024-09-10T05:13:33.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.753+0000 7faed4615800 1 -- start start 2024-09-10T05:13:33.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.754+0000 7faed4615800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c639730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.754+0000 7faed4615800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cf0c3e0dd0 con 0x55cf0c546500 2024-09-10T05:13:33.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.754+0000 7faecfd92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c639730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.754+0000 7faecfd92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c639730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33794/0 (socket says 172.21.15.192:33794) 2024-09-10T05:13:33.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.754+0000 7faecfd92640 1 -- 172.21.15.192:0/2865150378 learned_addr learned my addr 172.21.15.192:0/2865150378 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.754+0000 7faecfd92640 1 -- 172.21.15.192:0/2865150378 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0c3f9e10 con 0x55cf0c546500 2024-09-10T05:13:33.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.754+0000 7faecfd92640 1 --2- 172.21.15.192:0/2865150378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c639730 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7faec8025da0 tx=0x7faec8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304e3d608006d43e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.755+0000 7fadbde0b640 1 -- 172.21.15.192:0/2865150378 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec8051950 con 0x55cf0c546500 2024-09-10T05:13:33.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.755+0000 7fadbde0b640 1 -- 172.21.15.192:0/2865150378 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec8051af0 con 0x55cf0c546500 2024-09-10T05:13:33.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.755+0000 7fadbde0b640 1 -- 172.21.15.192:0/2865150378 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec8051dd0 con 0x55cf0c546500 2024-09-10T05:13:33.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.755+0000 7faed4615800 1 -- 172.21.15.192:0/2865150378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 msgr2=0x55cf0c639730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.755+0000 7faed4615800 1 --2- 172.21.15.192:0/2865150378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c639730 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7faec8025da0 tx=0x7faec8051000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.755+0000 7faed4615800 1 -- 172.21.15.192:0/2865150378 shutdown_connections 2024-09-10T05:13:33.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.755+0000 7faed4615800 1 --2- 172.21.15.192:0/2865150378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c639730 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.755+0000 7faed4615800 1 -- 172.21.15.192:0/2865150378 >> 172.21.15.192:0/2865150378 conn(0x55cf0c542250 msgr2=0x55cf0c6350b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.755+0000 7faed4615800 1 -- 172.21.15.192:0/2865150378 shutdown_connections 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.755+0000 7faed4615800 1 -- 172.21.15.192:0/2865150378 wait complete. 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.756+0000 7faed4615800 1 Processor -- start 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.756+0000 7faed4615800 1 -- start start 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.756+0000 7faed4615800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c640ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.756+0000 7faed4615800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cf0c547dc0 con 0x55cf0c546500 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.756+0000 7faecfd92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c640ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.756+0000 7faecfd92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c640ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33810/0 (socket says 172.21.15.192:33810) 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.756+0000 7faecfd92640 1 -- 172.21.15.192:0/513453204 learned_addr learned my addr 172.21.15.192:0/513453204 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.756+0000 7faecfd92640 1 -- 172.21.15.192:0/513453204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0c641400 con 0x55cf0c546500 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.756+0000 7faecfd92640 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c640ea0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7faec8025da0 tx=0x7faec8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.757+0000 7fadb7fff640 1 -- 172.21.15.192:0/513453204 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec805a600 con 0x55cf0c546500 2024-09-10T05:13:33.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.757+0000 7fadb7fff640 1 -- 172.21.15.192:0/513453204 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec8073070 con 0x55cf0c546500 2024-09-10T05:13:33.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.757+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf0c641690 con 0x55cf0c546500 2024-09-10T05:13:33.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.757+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf0c6422a0 con 0x55cf0c546500 2024-09-10T05:13:33.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.757+0000 7fadb7fff640 1 -- 172.21.15.192:0/513453204 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec805a910 con 0x55cf0c546500 2024-09-10T05:13:33.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.757+0000 7fadb7fff640 1 -- 172.21.15.192:0/513453204 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faec8058070 con 0x55cf0c546500 2024-09-10T05:13:33.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.758+0000 7fadb7fff640 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fadb803c730 0x7fadb803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.758+0000 7fadb7fff640 1 -- 172.21.15.192:0/513453204 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7faec806b040 con 0x55cf0c546500 2024-09-10T05:13:33.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.758+0000 7faecf591640 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fadb803c730 0x7fadb803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.758+0000 7faed4615800 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cf0c546e40 0x55cf0c6484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.758+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c648a30 con 0x55cf0c546e40 2024-09-10T05:13:33.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.758+0000 7faed0593640 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cf0c546e40 0x55cf0c6484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.758+0000 7faecf591640 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fadb803c730 0x7fadb803ebf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7faeb8000c00 tx=0x7faeb80013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.758+0000 7faed0593640 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cf0c546e40 0x55cf0c6484f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.759+0000 7faed0593640 1 -- 172.21.15.192:0/513453204 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c546e40 2024-09-10T05:13:33.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.759+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c648dd0 con 0x55cf0c546e40 2024-09-10T05:13:33.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.759+0000 7faed0593640 1 -- 172.21.15.192:0/513453204 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c546e40 2024-09-10T05:13:33.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.759+0000 7faed4615800 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cf0c64a8d0 0x55cf0c64cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.759+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c64d500 con 0x55cf0c64a8d0 2024-09-10T05:13:33.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.759+0000 7faecfd92640 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cf0c64a8d0 0x55cf0c64cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.759+0000 7faecfd92640 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cf0c64a8d0 0x55cf0c64cd70 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.760+0000 7faecfd92640 1 -- 172.21.15.192:0/513453204 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c64a8d0 2024-09-10T05:13:33.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.760+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c649620 con 0x55cf0c546e40 2024-09-10T05:13:33.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.760+0000 7faed0593640 1 -- 172.21.15.192:0/513453204 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c546e40 2024-09-10T05:13:33.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.760+0000 7faed4615800 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55cf0c64e960 0x55cf0c650d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.760+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6514c0 con 0x55cf0c64e960 2024-09-10T05:13:33.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.760+0000 7faecf591640 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55cf0c64e960 0x55cf0c650d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.760+0000 7faecf591640 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55cf0c64e960 0x55cf0c650d50 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.761+0000 7faecf591640 1 -- 172.21.15.192:0/513453204 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faeb800f670 con 0x55cf0c64e960 2024-09-10T05:13:33.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.761+0000 7faed4615800 1 Processor -- start 2024-09-10T05:13:33.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.761+0000 7faed4615800 1 -- start start 2024-09-10T05:13:33.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.761+0000 7faed4615800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c65f120 0x55cf0c65f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.761+0000 7faed4615800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cf0c43ea00 con 0x55cf0c65f120 2024-09-10T05:13:33.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.762+0000 7faecfd92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c65f120 0x55cf0c65f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.762+0000 7faecfd92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c65f120 0x55cf0c65f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33822/0 (socket says 172.21.15.192:33822) 2024-09-10T05:13:33.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.762+0000 7faecfd92640 1 -- 172.21.15.192:0/235220050 learned_addr learned my addr 172.21.15.192:0/235220050 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.762+0000 7faecfd92640 1 -- 172.21.15.192:0/235220050 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0c65fb80 con 0x55cf0c65f120 2024-09-10T05:13:33.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.762+0000 7faecfd92640 1 --2- 172.21.15.192:0/235220050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c65f120 0x55cf0c65f540 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7faec8095c80 tx=0x7faec8064b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.762+0000 7fadb57fa640 1 -- 172.21.15.192:0/235220050 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec808ed00 con 0x55cf0c65f120 2024-09-10T05:13:33.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.762+0000 7fadb57fa640 1 -- 172.21.15.192:0/235220050 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec808eea0 con 0x55cf0c65f120 2024-09-10T05:13:33.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.762+0000 7faed4615800 1 -- 172.21.15.192:0/235220050 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf0c6603b0 con 0x55cf0c65f120 2024-09-10T05:13:33.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.762+0000 7fadb57fa640 1 -- 172.21.15.192:0/235220050 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec8097ac0 con 0x55cf0c65f120 2024-09-10T05:13:33.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.762+0000 7faed4615800 1 -- 172.21.15.192:0/235220050 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf0c660950 con 0x55cf0c65f120 2024-09-10T05:13:33.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.763+0000 7fadb57fa640 1 -- 172.21.15.192:0/235220050 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faec8078d10 con 0x55cf0c65f120 2024-09-10T05:13:33.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.763+0000 7fadb57fa640 1 --2- 172.21.15.192:0/235220050 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fada803c780 0x7fada803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.763+0000 7fadb57fa640 1 -- 172.21.15.192:0/235220050 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7faec8089070 con 0x55cf0c65f120 2024-09-10T05:13:33.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.763+0000 7faecf591640 1 --2- 172.21.15.192:0/235220050 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fada803c780 0x7fada803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.763+0000 7faed4615800 1 Processor -- start 2024-09-10T05:13:33.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.763+0000 7faed4615800 1 -- start start 2024-09-10T05:13:33.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.763+0000 7faecf591640 1 --2- 172.21.15.192:0/235220050 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fada803c780 0x7fada803ec40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55cf0c64d8a0 tx=0x7faeb8006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.764+0000 7faed4615800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 0x55cf0c66bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.764+0000 7faed4615800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cf0c639ec0 con 0x55cf0c66ba00 2024-09-10T05:13:33.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.764+0000 7faecfd92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 0x55cf0c66bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.764+0000 7faecfd92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 0x55cf0c66bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33832/0 (socket says 172.21.15.192:33832) 2024-09-10T05:13:33.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.764+0000 7faecfd92640 1 -- 172.21.15.192:0/286366715 learned_addr learned my addr 172.21.15.192:0/286366715 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.764+0000 7faecfd92640 1 -- 172.21.15.192:0/286366715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0c66c3d0 con 0x55cf0c66ba00 2024-09-10T05:13:33.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.764+0000 7faecfd92640 1 --2- 172.21.15.192:0/286366715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 0x55cf0c66bde0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7faec8064bd0 tx=0x7faec808c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0cdeceddc02776 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.764+0000 7fadaeffd640 1 -- 172.21.15.192:0/286366715 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec80948b0 con 0x55cf0c66ba00 2024-09-10T05:13:33.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.764+0000 7fadaeffd640 1 -- 172.21.15.192:0/286366715 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec808ce50 con 0x55cf0c66ba00 2024-09-10T05:13:33.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.764+0000 7fadaeffd640 1 -- 172.21.15.192:0/286366715 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec80818d0 con 0x55cf0c66ba00 2024-09-10T05:13:33.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.765+0000 7faed4615800 1 -- 172.21.15.192:0/286366715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 msgr2=0x55cf0c66bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.765+0000 7faed4615800 1 --2- 172.21.15.192:0/286366715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 0x55cf0c66bde0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7faec8064bd0 tx=0x7faec808c970 comp rx=0 tx=0).stop 2024-09-10T05:13:33.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.765+0000 7faed4615800 1 -- 172.21.15.192:0/286366715 shutdown_connections 2024-09-10T05:13:33.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.765+0000 7faed4615800 1 --2- 172.21.15.192:0/286366715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 0x55cf0c66bde0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.765+0000 7faed4615800 1 -- 172.21.15.192:0/286366715 >> 172.21.15.192:0/286366715 conn(0x55cf0c667e00 msgr2=0x55cf0c666040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.765+0000 7faed4615800 1 -- 172.21.15.192:0/286366715 shutdown_connections 2024-09-10T05:13:33.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.765+0000 7faed4615800 1 -- 172.21.15.192:0/286366715 wait complete. 2024-09-10T05:13:33.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.765+0000 7faed4615800 1 Processor -- start 2024-09-10T05:13:33.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.765+0000 7faed4615800 1 -- start start 2024-09-10T05:13:33.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.765+0000 7faed4615800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 0x55cf0c672e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.765+0000 7faed4615800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cf0c66c860 con 0x55cf0c66ba00 2024-09-10T05:13:33.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.766+0000 7faecfd92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 0x55cf0c672e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.766+0000 7faecfd92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 0x55cf0c672e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33848/0 (socket says 172.21.15.192:33848) 2024-09-10T05:13:33.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.766+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 learned_addr learned my addr 172.21.15.192:0/3097310539 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.766+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0c6733a0 con 0x55cf0c66ba00 2024-09-10T05:13:33.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.766+0000 7faecfd92640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 0x55cf0c672e40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7faec808ce00 tx=0x7faec8088f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.766+0000 7fadad7fa640 1 -- 172.21.15.192:0/3097310539 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec80948b0 con 0x55cf0c66ba00 2024-09-10T05:13:33.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.766+0000 7fadad7fa640 1 -- 172.21.15.192:0/3097310539 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec80507a0 con 0x55cf0c66ba00 2024-09-10T05:13:33.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.766+0000 7fadad7fa640 1 -- 172.21.15.192:0/3097310539 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec806e3f0 con 0x55cf0c66ba00 2024-09-10T05:13:33.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.766+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf0c6733a0 con 0x55cf0c66ba00 2024-09-10T05:13:33.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.767+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf0c6733a0 con 0x55cf0c66ba00 2024-09-10T05:13:33.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.767+0000 7fadad7fa640 1 -- 172.21.15.192:0/3097310539 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7faec80bc030 con 0x55cf0c66ba00 2024-09-10T05:13:33.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.768+0000 7fadad7fa640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fad9803c780 0x7fad9803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.768+0000 7fadad7fa640 1 -- 172.21.15.192:0/3097310539 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7faec80ba070 con 0x55cf0c66ba00 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.768+0000 7faecf591640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fad9803c780 0x7fad9803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.768+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.768+0000 7faecf591640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fad9803c780 0x7fad9803ec40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faeb800ffd0 tx=0x7faeb8023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.768+0000 7faed4615800 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cf0c67e380 0x55cf0c680840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.768+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c680f90 con 0x55cf0c67e380 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.768+0000 7faed0593640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cf0c67e380 0x55cf0c680840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed0593640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cf0c67e380 0x55cf0c680840 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 20 realm 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6813a0 con 0x55cf0c67e380 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c681c70 con 0x55cf0c67e380 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c67e380 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.769+0000 7faed4615800 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cf0c682d70 0x55cf0c685160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.770+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c685720 con 0x55cf0c682d70 2024-09-10T05:13:33.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.770+0000 7faecfd92640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cf0c682d70 0x55cf0c685160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.770+0000 7faecfd92640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cf0c682d70 0x55cf0c685160 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.770+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.770+0000 7faed4615800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:33.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.770+0000 7faed4615800 20 searching for the correct realm 2024-09-10T05:13:33.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.770+0000 7faed4615800 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55cf0c6876d0 0x55cf0c689b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.770+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68a260 con 0x55cf0c6876d0 2024-09-10T05:13:33.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.771+0000 7faecf591640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55cf0c6876d0 0x55cf0c689b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.771+0000 7faecf591640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55cf0c6876d0 0x55cf0c689b90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.771+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.771+0000 7faecf591640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7faeb802e910 0x7faeb803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.771+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68a260 con 0x7faeb802e910 2024-09-10T05:13:33.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.771+0000 7faed0593640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7faeb802e910 0x7faeb803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.771+0000 7faed0593640 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7faeb802e910 0x7faeb803a3c0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.772+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.772+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c682d70 2024-09-10T05:13:33.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.772+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.772+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c67e380 2024-09-10T05:13:33.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.772+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.772+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c67e380 2024-09-10T05:13:33.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.772+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.772+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c682d70 2024-09-10T05:13:33.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.773+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.773+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c682d70 2024-09-10T05:13:33.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.773+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.773+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x7faeb802e910 2024-09-10T05:13:33.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.773+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.773+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c6876d0 2024-09-10T05:13:33.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.773+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.773+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c67e380 2024-09-10T05:13:33.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.774+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.774+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c682d70 2024-09-10T05:13:33.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.774+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.774+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c67e380 2024-09-10T05:13:33.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.774+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.774+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x7faeb802e910 2024-09-10T05:13:33.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.774+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.774+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c6876d0 2024-09-10T05:13:33.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.775+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.775+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c6876d0 2024-09-10T05:13:33.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.775+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.775+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c682d70 2024-09-10T05:13:33.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.775+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.775+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c6876d0 2024-09-10T05:13:33.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.775+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.775+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c6876d0 2024-09-10T05:13:33.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.775+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.775+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c67e380 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.776+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.776+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c67e380 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.776+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.776+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x7faeb802e910 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.776+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.776+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c6876d0 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.776+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.776+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x7faeb802e910 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.777+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.777+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c67e380 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.777+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.777+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c682d70 2024-09-10T05:13:33.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.777+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.777+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c6876d0 2024-09-10T05:13:33.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.777+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.777+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c682d70 2024-09-10T05:13:33.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.778+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.778+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x7faeb802e910 2024-09-10T05:13:33.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.778+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.778+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c6876d0 2024-09-10T05:13:33.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.778+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.778+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x7faeb802e910 2024-09-10T05:13:33.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.778+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.778+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x55cf0c67e380 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c682010 con 0x7faeb802e910 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c685fe0 con 0x55cf0c67e380 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c685fe0 con 0x55cf0c67e380 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.779+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c685fe0 con 0x7faeb802e910 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 20 zone default found 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 4 Realm: () 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:33.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:33.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 20 zonegroup default 2024-09-10T05:13:33.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c686880 con 0x55cf0c682d70 2024-09-10T05:13:33.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68c0d0 con 0x55cf0c6876d0 2024-09-10T05:13:33.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.780+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.781+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68c470 con 0x55cf0c6876d0 2024-09-10T05:13:33.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.781+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.781+0000 7faed4615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.781+0000 7faed4615800 20 started sync module instance, tier type = 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.781+0000 7faed4615800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.781+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68b570 con 0x7faeb802e910 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.782+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.782+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94347754781328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68b570 con 0x7faeb802e910 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.782+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68ce30 con 0x55cf0c67e380 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.783+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94347754781328] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.783+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.783+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94347754785632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68b570 con 0x55cf0c67e380 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.783+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68d6d0 con 0x55cf0c6876d0 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.784+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94347754785632] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.785+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.785+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94347754778816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68df20 con 0x55cf0c6876d0 2024-09-10T05:13:33.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.785+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68e770 con 0x7faeb802e910 2024-09-10T05:13:33.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.786+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.786+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94347754792096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68ef30 con 0x7faeb802e910 2024-09-10T05:13:33.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.786+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68fa50 con 0x55cf0c67e380 2024-09-10T05:13:33.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.786+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94347754778816] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.787+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.787+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94347754796320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68fa10 con 0x55cf0c67e380 2024-09-10T05:13:33.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.787+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c690460 con 0x55cf0c682d70 2024-09-10T05:13:33.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.787+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94347754792096] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.788+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94347754796320] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.788+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.788+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94347754789488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c68e980 con 0x55cf0c682d70 2024-09-10T05:13:33.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.788+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c690d00 con 0x55cf0c682d70 2024-09-10T05:13:33.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.789+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.789+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94347754801744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c691500 con 0x55cf0c682d70 2024-09-10T05:13:33.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.789+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c692000 con 0x55cf0c682d70 2024-09-10T05:13:33.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.789+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94347754789488] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.790+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94347754801744] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.790+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.790+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94347754806000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c690f50 con 0x55cf0c682d70 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.790+0000 7faed4615800 20 add_watcher() i=0 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.790+0000 7faed4615800 20 add_watcher() i=1 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.790+0000 7faed4615800 20 add_watcher() i=2 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.790+0000 7faed4615800 20 add_watcher() i=3 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.790+0000 7faed4615800 20 add_watcher() i=4 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.790+0000 7faed4615800 20 add_watcher() i=5 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.790+0000 7faed4615800 20 add_watcher() i=6 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.791+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94347754806000] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.791+0000 7faed4615800 20 add_watcher() i=7 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.791+0000 7faed4615800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.791+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c694ff0 con 0x55cf0c67e380 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.791+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.791+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94347754799024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6924b0 con 0x55cf0c67e380 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.792+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94347754799024] v37'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.792+0000 7fad85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.792+0000 7faed4615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.792+0000 7faed4615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.792+0000 7faed4615800 5 note: GC not initialized 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.793+0000 7fad84fe1640 20 reqs_thread_entry: start 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.793+0000 7faed4615800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.793+0000 7faed4615800 20 Filter name: none 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.793+0000 7facfe7fc640 20 reqs_thread_entry: start 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.793+0000 7faed4615800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.793+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.793+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c8090 con 0x55cf0c682d70 2024-09-10T05:13:33.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.793+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.793+0000 7faed4615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.793+0000 7faed4615800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-10T05:13:33.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.793+0000 7faed4615800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T05:13:33.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.794+0000 7faed4615800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-10T05:13:33.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.794+0000 7faed4615800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.794+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c6730 con 0x55cf0c6876d0 2024-09-10T05:13:33.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.794+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.794+0000 7faed4615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.794+0000 7faed4615800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-10T05:13:33.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.794+0000 7faed4615800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T05:13:33.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.794+0000 7faed4615800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-10T05:13:33.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.794+0000 7faed4615800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.794+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c7150 con 0x55cf0c682d70 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.795+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v37'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.795+0000 7faed4615800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.795+0000 7faed4615800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.795+0000 7faed4615800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.795+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94347755023232 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6cba20 con 0x7faeb802e910 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.795+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== watch-notify(notify (1) cookie 94347754781328 notify 158913789993 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7faec0018b00 con 0x7faeb802e910 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.795+0000 7fadaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789993 cookie 94347754781328 notifier 4854 bl.length()=533 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.795+0000 7fadaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.795+0000 7fadaeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.795+0000 7fadaeffd640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fad94003ea0 con 0x7faeb802e910 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.795+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(65 notify.0 [notify cookie 94347755023232 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.796+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.796+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== watch-notify(notify_complete (2) cookie 94347755023232 notify 158913789993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7faec0018da0 con 0x7faeb802e910 2024-09-10T05:13:33.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.796+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c6b80 con 0x55cf0c6876d0 2024-09-10T05:13:33.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v37'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7faed4615800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-10T05:13:33.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7faed4615800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T05:13:33.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7faed4615800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-10T05:13:33.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94347755037968 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6cade0 con 0x55cf0c67e380 2024-09-10T05:13:33.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== watch-notify(notify (1) cookie 94347754785632 notify 158913789974 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7faec0018da0 con 0x55cf0c67e380 2024-09-10T05:13:33.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7fadae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789974 cookie 94347754785632 notifier 4854 bl.length()=176 2024-09-10T05:13:33.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7fadae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-10T05:13:33.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7fadae7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-10T05:13:33.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(68 notify.1 [notify cookie 94347755037968 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7fadae7fc640 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fad04003400 con 0x55cf0c67e380 2024-09-10T05:13:33.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.797+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== watch-notify(notify_complete (2) cookie 94347755037968 notify 158913789974 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7faec00266f0 con 0x55cf0c67e380 2024-09-10T05:13:33.811 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-10T05:13:33.794988Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:13:33.794976Z","tags":[],"group_ids":[]} 2024-09-10T05:13:33.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.798+0000 7fad85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:33.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.798+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94347754799024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c5ec0 con 0x55cf0c67e380 2024-09-10T05:13:33.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.799+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94347754799024] v37'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.799+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94347754781328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c5ec0 con 0x7faeb802e910 2024-09-10T05:13:33.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.800+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94347754781328] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.800+0000 7faed4615800 20 remove_watcher() i=0 2024-09-10T05:13:33.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.800+0000 7faed4615800 2 removed watcher, disabling cache 2024-09-10T05:13:33.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.800+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94347754785632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c5ec0 con 0x55cf0c67e380 2024-09-10T05:13:33.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.802+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94347754785632] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.802+0000 7faed4615800 20 remove_watcher() i=1 2024-09-10T05:13:33.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.802+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94347754778816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c5ec0 con 0x55cf0c6876d0 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.802+0000 7faecf591640 1 -- 172.21.15.192:0/3097310539 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94347754778816] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8037040 con 0x55cf0c6876d0 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.803+0000 7faed4615800 20 remove_watcher() i=2 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.803+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94347754792096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c5ec0 con 0x7faeb802e910 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.804+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94347754792096] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x7faeb802e910 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.804+0000 7faed4615800 20 remove_watcher() i=3 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.804+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94347754796320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c5ec0 con 0x55cf0c67e380 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.805+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94347754796320] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec000a4d0 con 0x55cf0c67e380 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.805+0000 7faed4615800 20 remove_watcher() i=4 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.805+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94347754789488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c5ec0 con 0x55cf0c682d70 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.805+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94347754789488] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.806+0000 7faed4615800 20 remove_watcher() i=5 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.806+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94347754801744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c5ec0 con 0x55cf0c682d70 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.806+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94347754801744] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.806+0000 7faed4615800 20 remove_watcher() i=6 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.806+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94347754806000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf0c6c5ec0 con 0x55cf0c682d70 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.807+0000 7faecfd92640 1 -- 172.21.15.192:0/3097310539 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94347754806000] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faec8091040 con 0x55cf0c682d70 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.807+0000 7faed4615800 20 remove_watcher() i=7 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cf0c682d70 msgr2=0x55cf0c685160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cf0c682d70 0x55cf0c685160 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cf0c67e380 msgr2=0x55cf0c680840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cf0c67e380 0x55cf0c680840 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7faeb802e910 msgr2=0x7faeb803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7faeb802e910 0x7faeb803a3c0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55cf0c6876d0 msgr2=0x55cf0c689b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55cf0c6876d0 0x55cf0c689b90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fad9803c780 msgr2=0x7fad9803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fad9803c780 0x7fad9803ec40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faeb800ffd0 tx=0x7faeb8023040 comp rx=0 tx=0).stop 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 msgr2=0x55cf0c672e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed0593640 1 -- 172.21.15.192:0/3097310539 reap_dead start 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 0x55cf0c672e40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7faec808ce00 tx=0x7faec8088f50 comp rx=0 tx=0).stop 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 shutdown_connections 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 --2- 172.21.15.192:0/3097310539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c66ba00 0x55cf0c672e40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 >> 172.21.15.192:0/3097310539 conn(0x55cf0c667e00 msgr2=0x55cf0c666010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 shutdown_connections 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/3097310539 wait complete. 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/235220050 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fada803c780 msgr2=0x7fada803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 --2- 172.21.15.192:0/235220050 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fada803c780 0x7fada803ec40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55cf0c64d8a0 tx=0x7faeb8006000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/235220050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c65f120 msgr2=0x55cf0c65f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 --2- 172.21.15.192:0/235220050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c65f120 0x55cf0c65f540 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7faec8095c80 tx=0x7faec8064b00 comp rx=0 tx=0).stop 2024-09-10T05:13:33.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/235220050 shutdown_connections 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 --2- 172.21.15.192:0/235220050 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fada803c780 0x7fada803ec40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 --2- 172.21.15.192:0/235220050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c65f120 0x55cf0c65f540 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/235220050 >> 172.21.15.192:0/235220050 conn(0x55cf0c6534d0 msgr2=0x55cf0c6538b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/235220050 shutdown_connections 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.808+0000 7faed4615800 1 -- 172.21.15.192:0/235220050 wait complete. 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cf0c64a8d0 msgr2=0x55cf0c64cd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cf0c64a8d0 0x55cf0c64cd70 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cf0c546e40 msgr2=0x55cf0c6484f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cf0c546e40 0x55cf0c6484f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55cf0c64e960 msgr2=0x55cf0c650d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55cf0c64e960 0x55cf0c650d50 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fadb803c730 msgr2=0x7fadb803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fadb803c730 0x7fadb803ebf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7faeb8000c00 tx=0x7faeb80013b0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 msgr2=0x55cf0c640ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 --2- 172.21.15.192:0/513453204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf0c546500 0x55cf0c640ea0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7faec8025da0 tx=0x7faec8002fb0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed0593640 1 -- 172.21.15.192:0/513453204 reap_dead start 2024-09-10T05:13:33.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 shutdown_connections 2024-09-10T05:13:33.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 >> 172.21.15.192:0/513453204 conn(0x55cf0c542250 msgr2=0x55cf0c6338a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 shutdown_connections 2024-09-10T05:13:33.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.809+0000 7faed4615800 1 -- 172.21.15.192:0/513453204 wait complete. 2024-09-10T05:13:33.822 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-10T05:13:33.794988Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.794976Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:33.822 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-10T05:13:33.794988Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.794976Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:33.822 ERROR:root:0 2024-09-10T05:13:33.823 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:33.827 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:33.827 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-10T05:13:33.827 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-10T05:13:33.828 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-10T05:13:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:33.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.872+0000 7f38f060f800 1 Processor -- start 2024-09-10T05:13:33.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.872+0000 7f38f060f800 1 -- start start 2024-09-10T05:13:33.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.872+0000 7f38f060f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x557870b20ff0 0x557870b21bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.872+0000 7f38f060f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578709cae40 con 0x557870b220f0 2024-09-10T05:13:33.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.872+0000 7f38f060f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x557870995680 con 0x557870b20ff0 2024-09-10T05:13:33.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.872+0000 7f38ebd48640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x557870b20ff0 0x557870b21bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.872+0000 7f38ebd48640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x557870b20ff0 0x557870b21bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33860/0 (socket says 172.21.15.192:33860) 2024-09-10T05:13:33.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.872+0000 7f38ebd48640 1 -- 172.21.15.192:0/239847460 learned_addr learned my addr 172.21.15.192:0/239847460 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.872+0000 7f38e3fff640 1 --1- 172.21.15.192:0/239847460 >> v1:172.21.15.139:6789/0 conn(0x557870b220f0 0x557870b26e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46530/0 (socket says 172.21.15.192:46530) 2024-09-10T05:13:33.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.873+0000 7f38ebd48640 1 -- 172.21.15.192:0/239847460 >> v1:172.21.15.139:6789/0 conn(0x557870b220f0 legacy=0x557870b26e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.873+0000 7f38ebd48640 1 -- 172.21.15.192:0/239847460 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578709b16b0 con 0x557870b20ff0 2024-09-10T05:13:33.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.873+0000 7f38eb547640 1 -- 172.21.15.192:0/239847460 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299834805 0 0) 0x5578709cae40 con 0x557870b220f0 2024-09-10T05:13:33.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.874+0000 7f38ebd48640 1 --2- 172.21.15.192:0/239847460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870b21bb0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00a520 tx=0x7f38dc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3020c68eaf15471 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.875+0000 7f38eb547640 1 -- 172.21.15.192:0/239847460 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38dc055070 con 0x557870b20ff0 2024-09-10T05:13:33.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.875+0000 7f38eb547640 1 -- 172.21.15.192:0/239847460 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38dc0515b0 con 0x557870b20ff0 2024-09-10T05:13:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.875+0000 7f38eb547640 1 -- 172.21.15.192:0/239847460 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38dc0518d0 con 0x557870b20ff0 2024-09-10T05:13:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.875+0000 7f38f060f800 1 -- 172.21.15.192:0/239847460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 msgr2=0x557870b21bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.875+0000 7f38f060f800 1 --2- 172.21.15.192:0/239847460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870b21bb0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00a520 tx=0x7f38dc045ba0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.875+0000 7f38f060f800 1 -- 172.21.15.192:0/239847460 shutdown_connections 2024-09-10T05:13:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.875+0000 7f38f060f800 1 --2- 172.21.15.192:0/239847460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870b21bb0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.875+0000 7f38f060f800 1 -- 172.21.15.192:0/239847460 >> 172.21.15.192:0/239847460 conn(0x557870b1c3c0 msgr2=0x557870b1e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.875+0000 7f38f060f800 1 -- 172.21.15.192:0/239847460 shutdown_connections 2024-09-10T05:13:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.875+0000 7f38f060f800 1 -- 172.21.15.192:0/239847460 wait complete. 2024-09-10T05:13:33.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.889+0000 7f38f060f800 1 Processor -- start 2024-09-10T05:13:33.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.889+0000 7f38f060f800 1 -- start start 2024-09-10T05:13:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.889+0000 7f38f060f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870c10420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.889+0000 7f38f060f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5578709b9dd0 con 0x557870b20ff0 2024-09-10T05:13:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.889+0000 7f38ebd48640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870c10420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.889+0000 7f38ebd48640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870c10420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33866/0 (socket says 172.21.15.192:33866) 2024-09-10T05:13:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.889+0000 7f38ebd48640 1 -- 172.21.15.192:0/1053367459 learned_addr learned my addr 172.21.15.192:0/1053367459 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.890+0000 7f38ebd48640 1 -- 172.21.15.192:0/1053367459 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578709d2e10 con 0x557870b20ff0 2024-09-10T05:13:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.890+0000 7f38ebd48640 1 --2- 172.21.15.192:0/1053367459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870c10420 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f38dc025da0 tx=0x7f38dc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06fc365b14e2e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.890+0000 7f37d9e0b640 1 -- 172.21.15.192:0/1053367459 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38dc051950 con 0x557870b20ff0 2024-09-10T05:13:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.890+0000 7f37d9e0b640 1 -- 172.21.15.192:0/1053367459 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38dc051af0 con 0x557870b20ff0 2024-09-10T05:13:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.890+0000 7f37d9e0b640 1 -- 172.21.15.192:0/1053367459 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38dc051dd0 con 0x557870b20ff0 2024-09-10T05:13:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38f060f800 1 -- 172.21.15.192:0/1053367459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 msgr2=0x557870c10420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38f060f800 1 --2- 172.21.15.192:0/1053367459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870c10420 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f38dc025da0 tx=0x7f38dc051000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38f060f800 1 -- 172.21.15.192:0/1053367459 shutdown_connections 2024-09-10T05:13:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38f060f800 1 --2- 172.21.15.192:0/1053367459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870c10420 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38f060f800 1 -- 172.21.15.192:0/1053367459 >> 172.21.15.192:0/1053367459 conn(0x557870b1c3c0 msgr2=0x557870c0bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38f060f800 1 -- 172.21.15.192:0/1053367459 shutdown_connections 2024-09-10T05:13:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38f060f800 1 -- 172.21.15.192:0/1053367459 wait complete. 2024-09-10T05:13:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38f060f800 1 Processor -- start 2024-09-10T05:13:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38f060f800 1 -- start start 2024-09-10T05:13:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38f060f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870a96660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38f060f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557870b227e0 con 0x557870b20ff0 2024-09-10T05:13:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38ebd48640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870a96660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38ebd48640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870a96660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33876/0 (socket says 172.21.15.192:33876) 2024-09-10T05:13:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.891+0000 7f38ebd48640 1 -- 172.21.15.192:0/1532930791 learned_addr learned my addr 172.21.15.192:0/1532930791 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.892+0000 7f38ebd48640 1 -- 172.21.15.192:0/1532930791 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557870a96bc0 con 0x557870b20ff0 2024-09-10T05:13:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.892+0000 7f38ebd48640 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870a96660 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f38dc025da0 tx=0x7f38dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.892+0000 7f37d3fff640 1 -- 172.21.15.192:0/1532930791 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38dc05a600 con 0x557870b20ff0 2024-09-10T05:13:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.892+0000 7f37d3fff640 1 -- 172.21.15.192:0/1532930791 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38dc073070 con 0x557870b20ff0 2024-09-10T05:13:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.892+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557870a94f70 con 0x557870b20ff0 2024-09-10T05:13:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.892+0000 7f37d3fff640 1 -- 172.21.15.192:0/1532930791 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38dc05a910 con 0x557870b20ff0 2024-09-10T05:13:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.892+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557870a95590 con 0x557870b20ff0 2024-09-10T05:13:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.893+0000 7f37d3fff640 1 -- 172.21.15.192:0/1532930791 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f38dc058070 con 0x557870b20ff0 2024-09-10T05:13:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.893+0000 7f37d3fff640 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37d403c780 0x7f37d403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.893+0000 7f37d3fff640 1 -- 172.21.15.192:0/1532930791 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f38dc06b040 con 0x557870b20ff0 2024-09-10T05:13:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.893+0000 7f38e3fff640 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37d403c780 0x7f37d403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.893+0000 7f38f060f800 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557870b220f0 0x557870c21130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.893+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c216b0 con 0x557870b220f0 2024-09-10T05:13:33.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.893+0000 7f38ec549640 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557870b220f0 0x557870c21130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.894+0000 7f38e3fff640 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37d403c780 0x7f37d403ec40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f38d4000c00 tx=0x7f38d40013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.894+0000 7f38ec549640 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557870b220f0 0x557870c21130 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.894+0000 7f38ec549640 1 -- 172.21.15.192:0/1532930791 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870b220f0 2024-09-10T05:13:33.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.894+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870a95a70 con 0x557870b220f0 2024-09-10T05:13:33.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.894+0000 7f38ec549640 1 -- 172.21.15.192:0/1532930791 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870b220f0 2024-09-10T05:13:33.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.894+0000 7f38f060f800 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557870c239e0 0x557870c25dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.894+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c264a0 con 0x557870c239e0 2024-09-10T05:13:33.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.895+0000 7f38ebd48640 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557870c239e0 0x557870c25dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.895+0000 7f38ebd48640 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557870c239e0 0x557870c25dd0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.895+0000 7f38ebd48640 1 -- 172.21.15.192:0/1532930791 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f38dc057030 con 0x557870c239e0 2024-09-10T05:13:33.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.895+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c22880 con 0x557870b220f0 2024-09-10T05:13:33.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.896+0000 7f38ec549640 1 -- 172.21.15.192:0/1532930791 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870b220f0 2024-09-10T05:13:33.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.896+0000 7f38f060f800 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x557870c278e0 0x557870c29cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.896+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c2a410 con 0x557870c278e0 2024-09-10T05:13:33.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.896+0000 7f38e3fff640 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x557870c278e0 0x557870c29cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.896+0000 7f38e3fff640 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x557870c278e0 0x557870c29cd0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.896+0000 7f38e3fff640 1 -- 172.21.15.192:0/1532930791 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f38d400f670 con 0x557870c278e0 2024-09-10T05:13:33.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.897+0000 7f38f060f800 1 Processor -- start 2024-09-10T05:13:33.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.897+0000 7f38f060f800 1 -- start start 2024-09-10T05:13:33.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.897+0000 7f38f060f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c38070 0x557870c38490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.897+0000 7f38f060f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557870a17a00 con 0x557870c38070 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.897+0000 7f38ebd48640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c38070 0x557870c38490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.897+0000 7f38ebd48640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c38070 0x557870c38490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33890/0 (socket says 172.21.15.192:33890) 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.897+0000 7f38ebd48640 1 -- 172.21.15.192:0/887711662 learned_addr learned my addr 172.21.15.192:0/887711662 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.897+0000 7f38ebd48640 1 -- 172.21.15.192:0/887711662 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557870c38ad0 con 0x557870c38070 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.897+0000 7f38ebd48640 1 --2- 172.21.15.192:0/887711662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c38070 0x557870c38490 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f38dc051580 tx=0x7f38dc050fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.898+0000 7f37d17fa640 1 -- 172.21.15.192:0/887711662 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38dc05acc0 con 0x557870c38070 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.898+0000 7f37d17fa640 1 -- 172.21.15.192:0/887711662 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38dc064570 con 0x557870c38070 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.898+0000 7f38f060f800 1 -- 172.21.15.192:0/887711662 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557870c39300 con 0x557870c38070 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.898+0000 7f37d17fa640 1 -- 172.21.15.192:0/887711662 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38dc05ae60 con 0x557870c38070 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.898+0000 7f38f060f800 1 -- 172.21.15.192:0/887711662 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557870c398a0 con 0x557870c38070 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.898+0000 7f37d17fa640 1 -- 172.21.15.192:0/887711662 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f38dc04f070 con 0x557870c38070 2024-09-10T05:13:33.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.899+0000 7f37d17fa640 1 --2- 172.21.15.192:0/887711662 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37c403c730 0x7f37c403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.899+0000 7f37d17fa640 1 -- 172.21.15.192:0/887711662 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f38dc088070 con 0x557870c38070 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.899+0000 7f38e3fff640 1 --2- 172.21.15.192:0/887711662 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37c403c730 0x7f37c403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.899+0000 7f38f060f800 1 Processor -- start 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.899+0000 7f38f060f800 1 -- start start 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.899+0000 7f38e3fff640 1 --2- 172.21.15.192:0/887711662 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37c403c730 0x7f37c403ebf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x557870c21b80 tx=0x7f38d4006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.899+0000 7f38f060f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 0x557870c44c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.899+0000 7f38f060f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557870c10bb0 con 0x557870c44890 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.899+0000 7f38ebd48640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 0x557870c44c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.899+0000 7f38ebd48640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 0x557870c44c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33904/0 (socket says 172.21.15.192:33904) 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.899+0000 7f38ebd48640 1 -- 172.21.15.192:0/3968907353 learned_addr learned my addr 172.21.15.192:0/3968907353 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.900+0000 7f38ebd48640 1 -- 172.21.15.192:0/3968907353 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557870c45260 con 0x557870c44890 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.900+0000 7f38ebd48640 1 --2- 172.21.15.192:0/3968907353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 0x557870c44c70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f38dc051ef0 tx=0x7f38dc06e3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b714f1e2a3f412f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.900+0000 7f37caffd640 1 -- 172.21.15.192:0/3968907353 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38dc08b410 con 0x557870c44890 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.900+0000 7f37caffd640 1 -- 172.21.15.192:0/3968907353 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38dc099d50 con 0x557870c44890 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.900+0000 7f37caffd640 1 -- 172.21.15.192:0/3968907353 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38dc0970b0 con 0x557870c44890 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.900+0000 7f38f060f800 1 -- 172.21.15.192:0/3968907353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 msgr2=0x557870c44c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.900+0000 7f38f060f800 1 --2- 172.21.15.192:0/3968907353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 0x557870c44c70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f38dc051ef0 tx=0x7f38dc06e3f0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.900+0000 7f38f060f800 1 -- 172.21.15.192:0/3968907353 shutdown_connections 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.900+0000 7f38f060f800 1 --2- 172.21.15.192:0/3968907353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 0x557870c44c70 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.900+0000 7f38f060f800 1 -- 172.21.15.192:0/3968907353 >> 172.21.15.192:0/3968907353 conn(0x557870c40c90 msgr2=0x557870c3eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.900+0000 7f38f060f800 1 -- 172.21.15.192:0/3968907353 shutdown_connections 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.900+0000 7f38f060f800 1 -- 172.21.15.192:0/3968907353 wait complete. 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.901+0000 7f38f060f800 1 Processor -- start 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.901+0000 7f38f060f800 1 -- start start 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.901+0000 7f38f060f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 0x557870c4bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.901+0000 7f38f060f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557870c456f0 con 0x557870c44890 2024-09-10T05:13:33.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.901+0000 7f38ebd48640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 0x557870c4bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.901+0000 7f38ebd48640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 0x557870c4bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33908/0 (socket says 172.21.15.192:33908) 2024-09-10T05:13:33.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.901+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 learned_addr learned my addr 172.21.15.192:0/1914957659 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:33.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.901+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557870c4c260 con 0x557870c44890 2024-09-10T05:13:33.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.902+0000 7f38ebd48640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 0x557870c4bd00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0948c0 tx=0x7f38dc07deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.902+0000 7f37c97fa640 1 -- 172.21.15.192:0/1914957659 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38dc08b410 con 0x557870c44890 2024-09-10T05:13:33.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.902+0000 7f37c97fa640 1 -- 172.21.15.192:0/1914957659 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38dc05ca60 con 0x557870c44890 2024-09-10T05:13:33.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.902+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557870c4c260 con 0x557870c44890 2024-09-10T05:13:33.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.902+0000 7f37c97fa640 1 -- 172.21.15.192:0/1914957659 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38dc05cc50 con 0x557870c44890 2024-09-10T05:13:33.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.902+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557870c4c260 con 0x557870c44890 2024-09-10T05:13:33.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.903+0000 7f37c97fa640 1 -- 172.21.15.192:0/1914957659 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f38dc0a8070 con 0x557870c44890 2024-09-10T05:13:33.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.903+0000 7f37c97fa640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37b403c780 0x7f37b403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.903+0000 7f37c97fa640 1 -- 172.21.15.192:0/1914957659 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f38dc0ae070 con 0x557870c44890 2024-09-10T05:13:33.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.903+0000 7f38e3fff640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37b403c780 0x7f37b403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.903+0000 7f38e3fff640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37b403c780 0x7f37b403ec40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f38d400ffd0 tx=0x7f38d4023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.903+0000 7f38f060f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.903+0000 7f38f060f800 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557870c57220 0x557870c596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.903+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c59e30 con 0x557870c57220 2024-09-10T05:13:33.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.904+0000 7f38ec549640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557870c57220 0x557870c596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.904+0000 7f38ec549640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557870c57220 0x557870c596e0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.904+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.904+0000 7f38f060f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.904+0000 7f38f060f800 20 realm 2024-09-10T05:13:33.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.904+0000 7f38f060f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.904+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c5a240 con 0x557870c57220 2024-09-10T05:13:33.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.904+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.904+0000 7f38f060f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.904+0000 7f38f060f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:33.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.904+0000 7f38f060f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.904+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c5ab10 con 0x557870c57220 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.905+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.905+0000 7f38f060f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.905+0000 7f38f060f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.905+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c57220 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.905+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.905+0000 7f38f060f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.905+0000 7f38f060f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.905+0000 7f38f060f800 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557870c5bc10 0x557870c5e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.905+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c5e5c0 con 0x557870c5bc10 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.905+0000 7f38ebd48640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557870c5bc10 0x557870c5e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.905+0000 7f38ebd48640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557870c5bc10 0x557870c5e000 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.906+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.906+0000 7f38f060f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:33.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.906+0000 7f38f060f800 20 searching for the correct realm 2024-09-10T05:13:33.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.906+0000 7f38f060f800 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x557870c60570 0x557870c62a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.906+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c63100 con 0x557870c60570 2024-09-10T05:13:33.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.906+0000 7f38e3fff640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x557870c60570 0x557870c62a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.906+0000 7f38e3fff640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x557870c60570 0x557870c62a30 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.906+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.906+0000 7f38e3fff640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f38d402e910 0x7f38d403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:33.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.906+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c63100 con 0x7f38d402e910 2024-09-10T05:13:33.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.906+0000 7f38ec549640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f38d402e910 0x7f38d403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:33.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.907+0000 7f38ec549640 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f38d402e910 0x7f38d403a3c0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:33.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.907+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.907+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c5bc10 2024-09-10T05:13:33.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.907+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.907+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c57220 2024-09-10T05:13:33.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.908+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.908+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c57220 2024-09-10T05:13:33.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.908+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.908+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c5bc10 2024-09-10T05:13:33.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.908+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.908+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c5bc10 2024-09-10T05:13:33.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.908+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.908+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x7f38d402e910 2024-09-10T05:13:33.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.909+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.909+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c60570 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.909+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.909+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c57220 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.909+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.909+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c5bc10 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.909+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.909+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c57220 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.910+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.910+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x7f38d402e910 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.910+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.910+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c60570 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.910+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.910+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c60570 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.910+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.910+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c5bc10 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.911+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.911+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c60570 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.911+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.911+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c60570 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.911+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.911+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c57220 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.911+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.911+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c57220 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.911+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.911+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x7f38d402e910 2024-09-10T05:13:33.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.912+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.912+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c60570 2024-09-10T05:13:33.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.912+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.912+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x7f38d402e910 2024-09-10T05:13:33.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.912+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.912+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c57220 2024-09-10T05:13:33.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.912+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.912+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c5bc10 2024-09-10T05:13:33.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.913+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.913+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c60570 2024-09-10T05:13:33.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.913+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.913+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c5bc10 2024-09-10T05:13:33.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.913+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.913+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x7f38d402e910 2024-09-10T05:13:33.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.913+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.913+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c60570 2024-09-10T05:13:33.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x7f38d402e910 2024-09-10T05:13:33.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x557870c57220 2024-09-10T05:13:33.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557870c5aeb0 con 0x7f38d402e910 2024-09-10T05:13:33.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38f060f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:33.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38f060f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38f060f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38f060f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38f060f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38f060f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38f060f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.914+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c5ee80 con 0x557870c57220 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c5ee80 con 0x557870c57220 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:33.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c5ee80 con 0x7f38d402e910 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 20 zone default found 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 4 Realm: () 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 20 zonegroup default 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c5ee70 con 0x557870c5bc10 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.915+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.916+0000 7f38f060f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.916+0000 7f38f060f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.916+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c64f70 con 0x557870c60570 2024-09-10T05:13:33.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.916+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.916+0000 7f38f060f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.916+0000 7f38f060f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.916+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c65310 con 0x557870c60570 2024-09-10T05:13:33.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.916+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.916+0000 7f38f060f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:33.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.916+0000 7f38f060f800 20 started sync module instance, tier type = 2024-09-10T05:13:33.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.916+0000 7f38f060f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:33.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.916+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c64410 con 0x7f38d402e910 2024-09-10T05:13:33.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.917+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.917+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93975776479584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c64410 con 0x7f38d402e910 2024-09-10T05:13:33.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.917+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c65d10 con 0x557870c57220 2024-09-10T05:13:33.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.918+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93975776479584] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.918+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.919+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93975776483360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c64410 con 0x557870c57220 2024-09-10T05:13:33.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.919+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c667b0 con 0x557870c60570 2024-09-10T05:13:33.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.920+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.920+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93975776486048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c67050 con 0x557870c60570 2024-09-10T05:13:33.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.920+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c67b00 con 0x7f38d402e910 2024-09-10T05:13:33.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.920+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93975776483360] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.921+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93975776486048] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.921+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.921+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93975776488352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c675e0 con 0x7f38d402e910 2024-09-10T05:13:33.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.921+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c683a0 con 0x557870c57220 2024-09-10T05:13:33.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.922+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93975776488352] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.922+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.922+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93975776477024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c68350 con 0x557870c57220 2024-09-10T05:13:33.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.922+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c68db0 con 0x557870c5bc10 2024-09-10T05:13:33.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.923+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.923+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93975776495872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c69650 con 0x557870c5bc10 2024-09-10T05:13:33.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.923+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6a0d0 con 0x557870c5bc10 2024-09-10T05:13:33.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.923+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93975776477024] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.924+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93975776495872] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.924+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.924+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93975776500672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6a4c0 con 0x557870c5bc10 2024-09-10T05:13:33.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.924+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6ad10 con 0x557870c5bc10 2024-09-10T05:13:33.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.925+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93975776500672] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.925+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.925+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93975776503904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6b130 con 0x557870c5bc10 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.925+0000 7f38f060f800 20 add_watcher() i=0 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.925+0000 7f38f060f800 20 add_watcher() i=1 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.925+0000 7f38f060f800 20 add_watcher() i=2 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.925+0000 7f38f060f800 20 add_watcher() i=3 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.925+0000 7f38f060f800 20 add_watcher() i=4 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.925+0000 7f38f060f800 20 add_watcher() i=5 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.925+0000 7f38f060f800 20 add_watcher() i=6 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.926+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93975776503904] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.926+0000 7f38f060f800 20 add_watcher() i=7 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.926+0000 7f38f060f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.926+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870c6e430 con 0x557870c57220 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.927+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.927+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93975776505328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6b6c0 con 0x557870c57220 2024-09-10T05:13:33.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.928+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93975776505328] v37'253 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.928+0000 7f37a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:33.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.928+0000 7f38f060f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:33.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.928+0000 7f38f060f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:33.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.928+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c76d90 con 0x557870c57220 2024-09-10T05:13:33.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.929+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.929+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c773c0 con 0x557870c5bc10 2024-09-10T05:13:33.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.930+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.930+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c773a0 con 0x557870c60570 2024-09-10T05:13:33.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.931+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.931+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c77ea0 con 0x557870c57220 2024-09-10T05:13:33.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.932+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'254 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.932+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c74ba0 con 0x7f38d402e910 2024-09-10T05:13:33.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.933+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'83 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.933+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c74b40 con 0x557870c60570 2024-09-10T05:13:33.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.934+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'63 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.934+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79080 con 0x557870c57220 2024-09-10T05:13:33.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.935+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.935+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c73b30 con 0x557870c5bc10 2024-09-10T05:13:33.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.936+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.936+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c73b30 con 0x7f38d402e910 2024-09-10T05:13:33.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.937+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.937+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c73b30 con 0x557870c60570 2024-09-10T05:13:33.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.940+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.940+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c73b30 con 0x7f38d402e910 2024-09-10T05:13:33.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.941+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'84 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.941+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c73b30 con 0x557870c5bc10 2024-09-10T05:13:33.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.942+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'36 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.942+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c73b30 con 0x7f38d402e910 2024-09-10T05:13:33.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.943+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.943+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c73b30 con 0x557870c5bc10 2024-09-10T05:13:33.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.944+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'69 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.944+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c73b30 con 0x557870c57220 2024-09-10T05:13:33.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.945+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'255 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.945+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79be0 con 0x557870c60570 2024-09-10T05:13:33.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.946+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'80 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.946+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79be0 con 0x7f38d402e910 2024-09-10T05:13:33.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.947+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'85 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.947+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79be0 con 0x557870c60570 2024-09-10T05:13:33.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.948+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.948+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79be0 con 0x557870c57220 2024-09-10T05:13:33.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.949+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.949+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79be0 con 0x557870c57220 2024-09-10T05:13:33.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.950+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'256 uv174 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.950+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79be0 con 0x557870c60570 2024-09-10T05:13:33.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.951+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'81 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.951+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79be0 con 0x7f38d402e910 2024-09-10T05:13:33.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.952+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.952+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79be0 con 0x557870c60570 2024-09-10T05:13:33.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.953+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.953+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79be0 con 0x557870c60570 2024-09-10T05:13:33.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.954+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'47 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.954+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79be0 con 0x557870c60570 2024-09-10T05:13:33.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.954+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.955+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c736b0 con 0x557870c60570 2024-09-10T05:13:33.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.955+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'64 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.955+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c73680 con 0x557870c5bc10 2024-09-10T05:13:33.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.956+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.956+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79be0 con 0x557870c60570 2024-09-10T05:13:33.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.958+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.958+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79db0 con 0x557870c5bc10 2024-09-10T05:13:33.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.959+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.959+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79db0 con 0x557870c60570 2024-09-10T05:13:33.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.960+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'82 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.960+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79db0 con 0x557870c5bc10 2024-09-10T05:13:33.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.961+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'70 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.961+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c79be0 con 0x7f38d402e910 2024-09-10T05:13:33.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.962+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.962+0000 7f37a0fe1640 20 reqs_thread_entry: start 2024-09-10T05:13:33.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.962+0000 7f38f060f800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:33.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.962+0000 7f38f060f800 20 Filter name: none 2024-09-10T05:13:33.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.962+0000 7f371a7fc640 20 reqs_thread_entry: start 2024-09-10T05:13:33.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.962+0000 7f38f060f800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-10T05:13:33.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.962+0000 7f38f060f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:33.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.962+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870ca4610 con 0x557870c5bc10 2024-09-10T05:13:33.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.966+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.966+0000 7f38f060f800 20 rados_obj.operate() r=0 bl.length=349 2024-09-10T05:13:33.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.966+0000 7f38f060f800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-10T05:13:33.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.966+0000 7f38f060f800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-10T05:13:33.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.966+0000 7f38f060f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:33.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.966+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870ca6f40 con 0x557870c5bc10 2024-09-10T05:13:33.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.966+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.966+0000 7f38f060f800 10 removing key index: system_akey 2024-09-10T05:13:33.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.966+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870ca4640 con 0x557870c60570 2024-09-10T05:13:33.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.967+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(96 system_akey [delete] v37'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.967+0000 7f38f060f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-10T05:13:33.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.967+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 93975776742000 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870ca7440 con 0x557870c57220 2024-09-10T05:13:33.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.967+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== watch-notify(notify (1) cookie 93975776483360 notify 158913789975 ret 0) ==== 203+0+0 (crc 0 0 0) 0x557870c734b0 con 0x557870c57220 2024-09-10T05:13:33.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.967+0000 7f37caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789975 cookie 93975776483360 notifier 4861 bl.length()=161 2024-09-10T05:13:33.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.967+0000 7f37caffd640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f37b0003d60 con 0x557870c57220 2024-09-10T05:13:33.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.967+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(97 notify.1 [notify cookie 93975776742000 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.968+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.968+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== watch-notify(notify_complete (2) cookie 93975776742000 notify 158913789975 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557870c74f40 con 0x557870c57220 2024-09-10T05:13:33.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.968+0000 7f38f060f800 10 removing email index: 2024-09-10T05:13:33.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.968+0000 7f38f060f800 10 removing user buckets index 2024-09-10T05:13:33.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.968+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870ca4a70 con 0x557870c5bc10 2024-09-10T05:13:33.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.969+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(99 system_user.buckets [delete] v37'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.969+0000 7f38f060f800 10 removing user index: system_user 2024-09-10T05:13:33.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.969+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870ca9460 con 0x557870c5bc10 2024-09-10T05:13:33.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.970+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(100 system_user [call,call,delete] v37'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.970+0000 7f38f060f800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-10T05:13:33.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.970+0000 7f38f060f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-10T05:13:33.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.970+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93975776743280 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557870ca6850 con 0x7f38d402e910 2024-09-10T05:13:33.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.970+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== watch-notify(notify (1) cookie 93975776479584 notify 158913789994 ret 0) ==== 202+0+0 (crc 0 0 0) 0x557870c74f40 con 0x7f38d402e910 2024-09-10T05:13:33.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.970+0000 7f37ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789994 cookie 93975776479584 notifier 4861 bl.length()=160 2024-09-10T05:13:33.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.970+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(101 notify.0 [notify cookie 93975776743280 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.970+0000 7f37ca7fc640 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f37200032c0 con 0x7f38d402e910 2024-09-10T05:13:33.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.971+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== watch-notify(notify_complete (2) cookie 93975776743280 notify 158913789994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557870c744c0 con 0x7f38d402e910 2024-09-10T05:13:33.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.971+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 24 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.971+0000 7f37a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:33.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.971+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93975776505328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6d0b0 con 0x557870c57220 2024-09-10T05:13:33.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.972+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93975776505328] v37'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.972+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93975776479584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6adf0 con 0x7f38d402e910 2024-09-10T05:13:33.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.973+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 25 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93975776479584] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.974+0000 7f38f060f800 20 remove_watcher() i=0 2024-09-10T05:13:33.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.974+0000 7f38f060f800 2 removed watcher, disabling cache 2024-09-10T05:13:33.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.974+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93975776483360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6adf0 con 0x557870c57220 2024-09-10T05:13:33.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.981+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93975776483360] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x557870c57220 2024-09-10T05:13:33.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.981+0000 7f38f060f800 20 remove_watcher() i=1 2024-09-10T05:13:33.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.981+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93975776486048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6adf0 con 0x557870c60570 2024-09-10T05:13:33.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.982+0000 7f38e3fff640 1 -- 172.21.15.192:0/1914957659 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93975776486048] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38d4037040 con 0x557870c60570 2024-09-10T05:13:33.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.982+0000 7f38f060f800 20 remove_watcher() i=2 2024-09-10T05:13:33.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.982+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93975776488352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6adf0 con 0x7f38d402e910 2024-09-10T05:13:33.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.983+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.2 v2:172.21.15.192:6801/2435677948 26 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93975776488352] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e400a4d0 con 0x7f38d402e910 2024-09-10T05:13:33.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.983+0000 7f38f060f800 20 remove_watcher() i=3 2024-09-10T05:13:33.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.983+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93975776477024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c66ba0 con 0x557870c57220 2024-09-10T05:13:33.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.984+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93975776477024] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38e404d040 con 0x557870c57220 2024-09-10T05:13:33.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.984+0000 7f38f060f800 20 remove_watcher() i=4 2024-09-10T05:13:33.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.984+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93975776495872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6adf0 con 0x557870c5bc10 2024-09-10T05:13:33.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.986+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93975776495872] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.986+0000 7f38f060f800 20 remove_watcher() i=5 2024-09-10T05:13:33.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.986+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93975776500672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6adf0 con 0x557870c5bc10 2024-09-10T05:13:33.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.987+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93975776500672] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.987+0000 7f38f060f800 20 remove_watcher() i=6 2024-09-10T05:13:33.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.987+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93975776503904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557870c6adf0 con 0x557870c5bc10 2024-09-10T05:13:33.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38ebd48640 1 -- 172.21.15.192:0/1914957659 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93975776503904] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38dc0c1020 con 0x557870c5bc10 2024-09-10T05:13:33.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 20 remove_watcher() i=7 2024-09-10T05:13:33.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557870c5bc10 msgr2=0x557870c5e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557870c5bc10 0x557870c5e000 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557870c57220 msgr2=0x557870c596e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557870c57220 0x557870c596e0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f38d402e910 msgr2=0x7f38d403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f38d402e910 0x7f38d403a3c0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x557870c60570 msgr2=0x557870c62a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x557870c60570 0x557870c62a30 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37b403c780 msgr2=0x7f37b403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37b403c780 0x7f37b403ec40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f38d400ffd0 tx=0x7f38d4023040 comp rx=0 tx=0).stop 2024-09-10T05:13:33.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 msgr2=0x557870c4bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 --2- 172.21.15.192:0/1914957659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c44890 0x557870c4bd00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0948c0 tx=0x7f38dc07deb0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 reap_dead start 2024-09-10T05:13:33.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38ec549640 1 -- 172.21.15.192:0/1914957659 reap_dead start 2024-09-10T05:13:33.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 shutdown_connections 2024-09-10T05:13:33.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 >> 172.21.15.192:0/1914957659 conn(0x557870c40c90 msgr2=0x557870c3eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 shutdown_connections 2024-09-10T05:13:33.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 -- 172.21.15.192:0/1914957659 wait complete. 2024-09-10T05:13:33.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.988+0000 7f38f060f800 1 -- 172.21.15.192:0/887711662 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37c403c730 msgr2=0x7f37c403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 --2- 172.21.15.192:0/887711662 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37c403c730 0x7f37c403ebf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x557870c21b80 tx=0x7f38d4006000 comp rx=0 tx=0).stop 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/887711662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c38070 msgr2=0x557870c38490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 --2- 172.21.15.192:0/887711662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c38070 0x557870c38490 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f38dc051580 tx=0x7f38dc050fe0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/887711662 shutdown_connections 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 --2- 172.21.15.192:0/887711662 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37c403c730 0x7f37c403ebf0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 --2- 172.21.15.192:0/887711662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870c38070 0x557870c38490 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/887711662 >> 172.21.15.192:0/887711662 conn(0x557870c2c420 msgr2=0x557870c2c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/887711662 shutdown_connections 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/887711662 wait complete. 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557870c239e0 msgr2=0x557870c25dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x557870c239e0 0x557870c25dd0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557870b220f0 msgr2=0x557870c21130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x557870b220f0 0x557870c21130 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x557870c278e0 msgr2=0x557870c29cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x557870c278e0 0x557870c29cd0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37d403c780 msgr2=0x7f37d403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f37d403c780 0x7f37d403ec40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f38d4000c00 tx=0x7f38d40013b0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 msgr2=0x557870a96660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:33.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 --2- 172.21.15.192:0/1532930791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557870b20ff0 0x557870a96660 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f38dc025da0 tx=0x7f38dc002fb0 comp rx=0 tx=0).stop 2024-09-10T05:13:33.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38ec549640 1 -- 172.21.15.192:0/1532930791 reap_dead start 2024-09-10T05:13:33.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 shutdown_connections 2024-09-10T05:13:33.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 >> 172.21.15.192:0/1532930791 conn(0x557870b1c3c0 msgr2=0x557870c0a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:33.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 shutdown_connections 2024-09-10T05:13:33.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:33.989+0000 7f38f060f800 1 -- 172.21.15.192:0/1532930791 wait complete. 2024-09-10T05:13:33.999 ERROR:root:None 2024-09-10T05:13:33.999 ERROR:root:0 2024-09-10T05:13:33.999 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-10T05:13:33.999 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-10T05:13:33.999 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-10T05:13:34.053 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:34.053 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:34.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.052+0000 7f56fe698800 1 Processor -- start 2024-09-10T05:13:34.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.053+0000 7f56fe698800 1 -- start start 2024-09-10T05:13:34.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.053+0000 7f56fe698800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55cb3a707320 0x55cb3a70cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.053+0000 7f56fe698800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cb3a5afe40 con 0x55cb3a706050 2024-09-10T05:13:34.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.053+0000 7f56fe698800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55cb3a57a680 con 0x55cb3a707320 2024-09-10T05:13:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.053+0000 7f56fb988640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55cb3a707320 0x55cb3a70cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.053+0000 7f56fc189640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55cb3a706050 0x55cb3a706c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46540/0 (socket says 172.21.15.192:46540) 2024-09-10T05:13:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.053+0000 7f56fb988640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55cb3a707320 0x55cb3a70cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33922/0 (socket says 172.21.15.192:33922) 2024-09-10T05:13:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.053+0000 7f56fc189640 1 -- 172.21.15.192:0/771718254 learned_addr learned my addr 172.21.15.192:0/771718254 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.053+0000 7f56fb988640 1 -- 172.21.15.192:0/771718254 >> v1:172.21.15.139:6789/0 conn(0x55cb3a706050 legacy=0x55cb3a706c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.053+0000 7f56fb988640 1 -- 172.21.15.192:0/771718254 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3a5966b0 con 0x55cb3a707320 2024-09-10T05:13:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.053+0000 7f56fb187640 1 -- 172.21.15.192:0/771718254 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3106437764 0 0) 0x55cb3a5afe40 con 0x55cb3a706050 2024-09-10T05:13:34.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.055+0000 7f56fb988640 1 --2- 172.21.15.192:0/771718254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a707320 0x55cb3a70cec0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f56e400a470 tx=0x7f56e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c281fd30bea6d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.055+0000 7f56fb187640 1 -- 172.21.15.192:0/771718254 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e4053570 con 0x55cb3a707320 2024-09-10T05:13:34.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.055+0000 7f56fb187640 1 -- 172.21.15.192:0/771718254 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e4058070 con 0x55cb3a707320 2024-09-10T05:13:34.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.055+0000 7f56fb187640 1 -- 172.21.15.192:0/771718254 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e4053880 con 0x55cb3a707320 2024-09-10T05:13:34.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.056+0000 7f56fe698800 1 -- 172.21.15.192:0/771718254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a707320 msgr2=0x55cb3a70cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.056+0000 7f56fe698800 1 --2- 172.21.15.192:0/771718254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a707320 0x55cb3a70cec0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f56e400a470 tx=0x7f56e4045a20 comp rx=0 tx=0).stop 2024-09-10T05:13:34.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.056+0000 7f56fe698800 1 -- 172.21.15.192:0/771718254 shutdown_connections 2024-09-10T05:13:34.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.056+0000 7f56fe698800 1 --2- 172.21.15.192:0/771718254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a707320 0x55cb3a70cec0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.056+0000 7f56fe698800 1 -- 172.21.15.192:0/771718254 >> 172.21.15.192:0/771718254 conn(0x55cb3a701420 msgr2=0x55cb3a703880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.056+0000 7f56fe698800 1 -- 172.21.15.192:0/771718254 shutdown_connections 2024-09-10T05:13:34.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.056+0000 7f56fe698800 1 -- 172.21.15.192:0/771718254 wait complete. 2024-09-10T05:13:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.070+0000 7f56fe698800 1 Processor -- start 2024-09-10T05:13:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.070+0000 7f56fe698800 1 -- start start 2024-09-10T05:13:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.070+0000 7f56fe698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 0x55cb3a67b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.070+0000 7f56fe698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cb3a59edd0 con 0x55cb3a706050 2024-09-10T05:13:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.070+0000 7f56fc189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 0x55cb3a67b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.070+0000 7f56fc189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 0x55cb3a67b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33938/0 (socket says 172.21.15.192:33938) 2024-09-10T05:13:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.070+0000 7f56fc189640 1 -- 172.21.15.192:0/433476377 learned_addr learned my addr 172.21.15.192:0/433476377 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.071+0000 7f56fc189640 1 -- 172.21.15.192:0/433476377 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3a5b7e10 con 0x55cb3a706050 2024-09-10T05:13:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.071+0000 7f56fc189640 1 --2- 172.21.15.192:0/433476377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 0x55cb3a67b730 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f56ec006fa0 tx=0x7f56ec001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca72731b15ff76f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.071+0000 7f55ea60c640 1 -- 172.21.15.192:0/433476377 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec003450 con 0x55cb3a706050 2024-09-10T05:13:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.071+0000 7f55ea60c640 1 -- 172.21.15.192:0/433476377 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ec003610 con 0x55cb3a706050 2024-09-10T05:13:34.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.071+0000 7f55ea60c640 1 -- 172.21.15.192:0/433476377 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec003970 con 0x55cb3a706050 2024-09-10T05:13:34.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fe698800 1 -- 172.21.15.192:0/433476377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 msgr2=0x55cb3a67b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fe698800 1 --2- 172.21.15.192:0/433476377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 0x55cb3a67b730 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f56ec006fa0 tx=0x7f56ec001b00 comp rx=0 tx=0).stop 2024-09-10T05:13:34.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fe698800 1 -- 172.21.15.192:0/433476377 shutdown_connections 2024-09-10T05:13:34.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fe698800 1 --2- 172.21.15.192:0/433476377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 0x55cb3a67b730 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fe698800 1 -- 172.21.15.192:0/433476377 >> 172.21.15.192:0/433476377 conn(0x55cb3a701420 msgr2=0x55cb3a7f0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fe698800 1 -- 172.21.15.192:0/433476377 shutdown_connections 2024-09-10T05:13:34.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fe698800 1 -- 172.21.15.192:0/433476377 wait complete. 2024-09-10T05:13:34.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fe698800 1 Processor -- start 2024-09-10T05:13:34.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fe698800 1 -- start start 2024-09-10T05:13:34.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fe698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 0x55cb3a7ff000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fe698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cb3a707a10 con 0x55cb3a706050 2024-09-10T05:13:34.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fc189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 0x55cb3a7ff000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fc189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 0x55cb3a7ff000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33952/0 (socket says 172.21.15.192:33952) 2024-09-10T05:13:34.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.072+0000 7f56fc189640 1 -- 172.21.15.192:0/1613652219 learned_addr learned my addr 172.21.15.192:0/1613652219 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.073+0000 7f56fc189640 1 -- 172.21.15.192:0/1613652219 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3a7ff560 con 0x55cb3a706050 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.073+0000 7f56fc189640 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 0x55cb3a7ff000 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f56ec001330 tx=0x7f56ec001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.073+0000 7f55e8e09640 1 -- 172.21.15.192:0/1613652219 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec014a10 con 0x55cb3a706050 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.073+0000 7f55e8e09640 1 -- 172.21.15.192:0/1613652219 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ec014bb0 con 0x55cb3a706050 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.073+0000 7f55e8e09640 1 -- 172.21.15.192:0/1613652219 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec01e3f0 con 0x55cb3a706050 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.073+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb3a7ff7f0 con 0x55cb3a706050 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.073+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb3a8001f0 con 0x55cb3a706050 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.074+0000 7f55e8e09640 1 -- 172.21.15.192:0/1613652219 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f56ec010070 con 0x55cb3a706050 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.074+0000 7f55e8e09640 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55e403c780 0x7f55e403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.074+0000 7f55e8e09640 1 -- 172.21.15.192:0/1613652219 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f56ec018070 con 0x55cb3a706050 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.074+0000 7f56fb988640 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55e403c780 0x7f55e403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.074+0000 7f56fe698800 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cb3a707320 0x55cb3a806650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.074+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a806b90 con 0x55cb3a707320 2024-09-10T05:13:34.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.074+0000 7f56fc98a640 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cb3a707320 0x55cb3a806650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.074+0000 7f56fb988640 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55e403c780 0x7f55e403ec40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f56e4057000 tx=0x7f56e4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.075+0000 7f56fc98a640 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cb3a707320 0x55cb3a806650 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.075+0000 7f56fc98a640 1 -- 172.21.15.192:0/1613652219 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56f40083e0 con 0x55cb3a707320 2024-09-10T05:13:34.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.075+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a806f30 con 0x55cb3a707320 2024-09-10T05:13:34.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.075+0000 7f56fc98a640 1 -- 172.21.15.192:0/1613652219 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56f40083e0 con 0x55cb3a707320 2024-09-10T05:13:34.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.075+0000 7f56fe698800 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cb3a8089f0 0x55cb3a80ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.075+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a80b600 con 0x55cb3a8089f0 2024-09-10T05:13:34.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.075+0000 7f56fc189640 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cb3a8089f0 0x55cb3a80ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.076+0000 7f56fc189640 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cb3a8089f0 0x55cb3a80ae70 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.076+0000 7f56fc189640 1 -- 172.21.15.192:0/1613652219 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f56ec01b070 con 0x55cb3a8089f0 2024-09-10T05:13:34.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.076+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a807780 con 0x55cb3a707320 2024-09-10T05:13:34.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.076+0000 7f56fc98a640 1 -- 172.21.15.192:0/1613652219 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56f40083e0 con 0x55cb3a707320 2024-09-10T05:13:34.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.076+0000 7f56fe698800 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55cb3a80ca60 0x55cb3a80ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.076+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a80f5c0 con 0x55cb3a80ca60 2024-09-10T05:13:34.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.076+0000 7f56fb988640 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55cb3a80ca60 0x55cb3a80ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.077+0000 7f56fb988640 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55cb3a80ca60 0x55cb3a80ee50 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.077+0000 7f56fb988640 1 -- 172.21.15.192:0/1613652219 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f56e4051070 con 0x55cb3a80ca60 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.077+0000 7f56fe698800 1 Processor -- start 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.077+0000 7f56fe698800 1 -- start start 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.077+0000 7f56fe698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a81d200 0x55cb3a81d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.077+0000 7f56fe698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cb3a5fca00 con 0x55cb3a81d200 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.078+0000 7f56fc189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a81d200 0x55cb3a81d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.078+0000 7f56fc189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a81d200 0x55cb3a81d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33956/0 (socket says 172.21.15.192:33956) 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.078+0000 7f56fc189640 1 -- 172.21.15.192:0/1248567088 learned_addr learned my addr 172.21.15.192:0/1248567088 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.078+0000 7f56fc189640 1 -- 172.21.15.192:0/1248567088 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3a81dc60 con 0x55cb3a81d200 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.078+0000 7f56fc189640 1 --2- 172.21.15.192:0/1248567088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a81d200 0x55cb3a81d620 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f56ec014ff0 tx=0x7f56ec028ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.078+0000 7f55e1ffb640 1 -- 172.21.15.192:0/1248567088 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec038070 con 0x55cb3a81d200 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.078+0000 7f55e1ffb640 1 -- 172.21.15.192:0/1248567088 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ec04af00 con 0x55cb3a81d200 2024-09-10T05:13:34.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.078+0000 7f56fe698800 1 -- 172.21.15.192:0/1248567088 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb3a81e490 con 0x55cb3a81d200 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.078+0000 7f55e1ffb640 1 -- 172.21.15.192:0/1248567088 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec04b0b0 con 0x55cb3a81d200 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.078+0000 7f56fe698800 1 -- 172.21.15.192:0/1248567088 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb3a81ea30 con 0x55cb3a81d200 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.079+0000 7f55e1ffb640 1 -- 172.21.15.192:0/1248567088 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f56ec03b070 con 0x55cb3a81d200 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.079+0000 7f55e1ffb640 1 --2- 172.21.15.192:0/1248567088 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55d403c780 0x7f55d403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.079+0000 7f55e1ffb640 1 -- 172.21.15.192:0/1248567088 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f56ec03ed50 con 0x55cb3a81d200 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.079+0000 7f56fb988640 1 --2- 172.21.15.192:0/1248567088 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55d403c780 0x7f55d403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f56fe698800 1 Processor -- start 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f56fe698800 1 -- start start 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f56fb988640 1 --2- 172.21.15.192:0/1248567088 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55d403c780 0x7f55d403ec40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55cb3a80b9a0 tx=0x7f56e4005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f56fe698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 0x55cb3a82a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f56fe698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cb3a679fd0 con 0x55cb3a829c40 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f56fc189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 0x55cb3a82a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f56fc189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 0x55cb3a82a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33958/0 (socket says 172.21.15.192:33958) 2024-09-10T05:13:34.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f56fc189640 1 -- 172.21.15.192:0/497958287 learned_addr learned my addr 172.21.15.192:0/497958287 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f56fc189640 1 -- 172.21.15.192:0/497958287 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3a82a630 con 0x55cb3a829c40 2024-09-10T05:13:34.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f56fc189640 1 --2- 172.21.15.192:0/497958287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 0x55cb3a82a040 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f56ec010670 tx=0x7f56ec0124c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785648d9f03a60b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f55db7fe640 1 -- 172.21.15.192:0/497958287 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec054e60 con 0x55cb3a829c40 2024-09-10T05:13:34.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f55db7fe640 1 -- 172.21.15.192:0/497958287 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ec052600 con 0x55cb3a829c40 2024-09-10T05:13:34.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.080+0000 7f55db7fe640 1 -- 172.21.15.192:0/497958287 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec01d770 con 0x55cb3a829c40 2024-09-10T05:13:34.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.081+0000 7f56fe698800 1 -- 172.21.15.192:0/497958287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 msgr2=0x55cb3a82a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.081+0000 7f56fe698800 1 --2- 172.21.15.192:0/497958287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 0x55cb3a82a040 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f56ec010670 tx=0x7f56ec0124c0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.081+0000 7f56fe698800 1 -- 172.21.15.192:0/497958287 shutdown_connections 2024-09-10T05:13:34.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.081+0000 7f56fe698800 1 --2- 172.21.15.192:0/497958287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 0x55cb3a82a040 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.081+0000 7f56fe698800 1 -- 172.21.15.192:0/497958287 >> 172.21.15.192:0/497958287 conn(0x55cb3a826040 msgr2=0x55cb3a824280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.081+0000 7f56fe698800 1 -- 172.21.15.192:0/497958287 shutdown_connections 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.081+0000 7f56fe698800 1 -- 172.21.15.192:0/497958287 wait complete. 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.081+0000 7f56fe698800 1 Processor -- start 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.081+0000 7f56fe698800 1 -- start start 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.081+0000 7f56fe698800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 0x55cb3a831010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.081+0000 7f56fe698800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cb3a82aaa0 con 0x55cb3a829c40 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.082+0000 7f56fc189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 0x55cb3a831010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.082+0000 7f56fc189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 0x55cb3a831010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33964/0 (socket says 172.21.15.192:33964) 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.082+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 learned_addr learned my addr 172.21.15.192:0/1286524333 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.082+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3a831570 con 0x55cb3a829c40 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.082+0000 7f56fc189640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 0x55cb3a831010 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f56ec028fd0 tx=0x7f56ec02eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.082+0000 7f55d9ffb640 1 -- 172.21.15.192:0/1286524333 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec04bb40 con 0x55cb3a829c40 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.082+0000 7f55d9ffb640 1 -- 172.21.15.192:0/1286524333 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ec053e50 con 0x55cb3a829c40 2024-09-10T05:13:34.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.082+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb3a831570 con 0x55cb3a829c40 2024-09-10T05:13:34.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.082+0000 7f55d9ffb640 1 -- 172.21.15.192:0/1286524333 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec04be10 con 0x55cb3a829c40 2024-09-10T05:13:34.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.082+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb3a831570 con 0x55cb3a829c40 2024-09-10T05:13:34.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.083+0000 7f55d9ffb640 1 -- 172.21.15.192:0/1286524333 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f56ec06e020 con 0x55cb3a829c40 2024-09-10T05:13:34.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.083+0000 7f55d9ffb640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55cc03c6e0 0x7f55cc03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.083+0000 7f55d9ffb640 1 -- 172.21.15.192:0/1286524333 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f56ec06c020 con 0x55cb3a829c40 2024-09-10T05:13:34.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.083+0000 7f56fb988640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55cc03c6e0 0x7f55cc03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.084+0000 7f56fb988640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55cc03c6e0 0x7f55cc03eba0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f56e4000c00 tx=0x7f56e4053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.084+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.084+0000 7f56fe698800 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cb3a83c5d0 0x55cb3a83ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.084+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a83f1e0 con 0x55cb3a83c5d0 2024-09-10T05:13:34.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.084+0000 7f56fc98a640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cb3a83c5d0 0x55cb3a83ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.084+0000 7f56fc98a640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cb3a83c5d0 0x55cb3a83ea90 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.084+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56f40083e0 con 0x55cb3a83c5d0 2024-09-10T05:13:34.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.084+0000 7f56fe698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.084+0000 7f56fe698800 20 realm 2024-09-10T05:13:34.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.084+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.084+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a83f5f0 con 0x55cb3a83c5d0 2024-09-10T05:13:34.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56f40083e0 con 0x55cb3a83c5d0 2024-09-10T05:13:34.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fe698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fe698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:34.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a83fec0 con 0x55cb3a83c5d0 2024-09-10T05:13:34.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56f40083e0 con 0x55cb3a83c5d0 2024-09-10T05:13:34.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fe698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a840260 con 0x55cb3a83c5d0 2024-09-10T05:13:34.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56f40083e0 con 0x55cb3a83c5d0 2024-09-10T05:13:34.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fe698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fe698800 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cb3a840c20 0x55cb3a843010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a840c20 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.085+0000 7f56fc189640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cb3a840c20 0x55cb3a843010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.086+0000 7f56fc189640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cb3a840c20 0x55cb3a843010 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.086+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.086+0000 7f56fe698800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.086+0000 7f56fe698800 20 searching for the correct realm 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.086+0000 7f56fe698800 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55cb3a8455d0 0x55cb3a847a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.086+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a848110 con 0x55cb3a8455d0 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.086+0000 7f56fb988640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55cb3a8455d0 0x55cb3a847a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.086+0000 7f56fb988640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55cb3a8455d0 0x55cb3a847a90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.087+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.087+0000 7f56fb988640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f56e405f040 0x7f56e406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.087+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a848110 con 0x7f56e405f040 2024-09-10T05:13:34.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.087+0000 7f56fc98a640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f56e405f040 0x7f56e406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.087+0000 7f56fc98a640 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f56e405f040 0x7f56e406b410 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.087+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f56f40083e0 con 0x7f56e405f040 2024-09-10T05:13:34.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.087+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a83fec0 con 0x55cb3a840c20 2024-09-10T05:13:34.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.087+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.087+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a83c5d0 2024-09-10T05:13:34.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.088+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f40083e0 con 0x55cb3a83c5d0 2024-09-10T05:13:34.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.088+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a83c5d0 2024-09-10T05:13:34.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.088+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f4026040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.088+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a840c20 2024-09-10T05:13:34.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.088+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.088+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a840c20 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.088+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.088+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x7f56e405f040 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.089+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f4026040 con 0x7f56e405f040 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.089+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a8455d0 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.089+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.089+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a83c5d0 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.089+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f4026040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.089+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a840c20 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.089+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.089+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a83c5d0 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.090+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f4026040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.090+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x7f56e405f040 2024-09-10T05:13:34.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.090+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f56f4026040 con 0x7f56e405f040 2024-09-10T05:13:34.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.090+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a8455d0 2024-09-10T05:13:34.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.090+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.090+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a8455d0 2024-09-10T05:13:34.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.090+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.090+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a840c20 2024-09-10T05:13:34.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.091+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.091+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a8455d0 2024-09-10T05:13:34.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.091+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.091+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a8455d0 2024-09-10T05:13:34.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.091+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.091+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a83c5d0 2024-09-10T05:13:34.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.091+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f4026040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.091+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a83c5d0 2024-09-10T05:13:34.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.091+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f56f4026040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.092+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x7f56e405f040 2024-09-10T05:13:34.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.092+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f4026040 con 0x7f56e405f040 2024-09-10T05:13:34.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.092+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a8455d0 2024-09-10T05:13:34.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.092+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.092+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x7f56e405f040 2024-09-10T05:13:34.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.092+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f4026040 con 0x7f56e405f040 2024-09-10T05:13:34.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.092+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a83c5d0 2024-09-10T05:13:34.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.092+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.092+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a840c20 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.093+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.093+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a8455d0 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.093+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.093+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a840c20 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.093+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.093+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x7f56e405f040 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.093+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f4035040 con 0x7f56e405f040 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a8455d0 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x7f56e405f040 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f4035040 con 0x7f56e405f040 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f56f403a040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f56f403a040 con 0x7f56e405f040 2024-09-10T05:13:34.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f4035040 con 0x7f56e405f040 2024-09-10T05:13:34.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fe698800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:34.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fe698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:34.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fe698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:34.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fe698800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:34.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fe698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:34.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fe698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:34.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.094+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a83fec0 con 0x55cb3a83c5d0 2024-09-10T05:13:34.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a83c5d0 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a83fec0 con 0x7f56e405f040 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f56f4035040 con 0x7f56e405f040 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 20 zone default found 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 4 Realm: () 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:34.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 20 zonegroup default 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.095+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a843620 con 0x55cb3a840c20 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fe698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a8496a0 con 0x55cb3a8455d0 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fe698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a849a40 con 0x55cb3a8455d0 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fe698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fe698800 20 started sync module instance, tier type = 2024-09-10T05:13:34.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fe698800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:34.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.096+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a848a40 con 0x7f56e405f040 2024-09-10T05:13:34.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.097+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x7f56e405f040 2024-09-10T05:13:34.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.097+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94331348488048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a848a40 con 0x7f56e405f040 2024-09-10T05:13:34.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.097+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84a550 con 0x55cb3a83c5d0 2024-09-10T05:13:34.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.098+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94331348488048] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x7f56e405f040 2024-09-10T05:13:34.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.098+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.098+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94331348492320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a848a40 con 0x55cb3a83c5d0 2024-09-10T05:13:34.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.098+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84aff0 con 0x55cb3a8455d0 2024-09-10T05:13:34.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.100+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94331348492320] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.100+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.100+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94331348485520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a8489b0 con 0x55cb3a8455d0 2024-09-10T05:13:34.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.100+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84beb0 con 0x7f56e405f040 2024-09-10T05:13:34.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.101+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94331348485520] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.101+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x7f56e405f040 2024-09-10T05:13:34.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.101+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94331348498944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84c2d0 con 0x7f56e405f040 2024-09-10T05:13:34.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.101+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84cc90 con 0x55cb3a83c5d0 2024-09-10T05:13:34.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.102+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.102+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94331348502496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84d0b0 con 0x55cb3a83c5d0 2024-09-10T05:13:34.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.102+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84db30 con 0x55cb3a840c20 2024-09-10T05:13:34.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.102+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94331348498944] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x7f56e405f040 2024-09-10T05:13:34.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.103+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94331348502496] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.103+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.103+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94331348506144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84cc00 con 0x55cb3a840c20 2024-09-10T05:13:34.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.103+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84e3d0 con 0x55cb3a840c20 2024-09-10T05:13:34.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.104+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94331348506144] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.104+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.104+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94331348500000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84cc00 con 0x55cb3a840c20 2024-09-10T05:13:34.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.104+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84ea10 con 0x55cb3a840c20 2024-09-10T05:13:34.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.105+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94331348500000] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.105+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.105+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94331348508368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84e9d0 con 0x55cb3a840c20 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.105+0000 7f56fe698800 20 add_watcher() i=0 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.105+0000 7f56fe698800 20 add_watcher() i=1 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.105+0000 7f56fe698800 20 add_watcher() i=2 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.105+0000 7f56fe698800 20 add_watcher() i=3 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.105+0000 7f56fe698800 20 add_watcher() i=4 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.105+0000 7f56fe698800 20 add_watcher() i=5 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.105+0000 7f56fe698800 20 add_watcher() i=6 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.106+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94331348508368] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.106+0000 7f56fe698800 20 add_watcher() i=7 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.106+0000 7f56fe698800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.106+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a851ec0 con 0x55cb3a83c5d0 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.107+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.107+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94331348510448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a84f380 con 0x55cb3a83c5d0 2024-09-10T05:13:34.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.108+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94331348510448] v37'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.108+0000 7f55b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.108+0000 7f56fe698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.108+0000 7f56fe698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.108+0000 7f56fe698800 5 note: GC not initialized 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.108+0000 7f55b17e2640 20 reqs_thread_entry: start 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.108+0000 7f56fe698800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.108+0000 7f56fe698800 20 Filter name: none 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.108+0000 7f5522ffd640 20 reqs_thread_entry: start 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.108+0000 7f56fe698800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.108+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.108+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a884fa0 con 0x55cb3a8455d0 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fe698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fe698800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fe698800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fe698800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fe698800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a883660 con 0x55cb3a8455d0 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fe698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fe698800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fe698800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fe698800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fe698800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.109+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a883f00 con 0x55cb3a8455d0 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.110+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v37'9 uv9 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.110+0000 7f56fe698800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.110+0000 7f56fe698800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.110+0000 7f56fe698800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.110+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94331348728400 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a8888e0 con 0x55cb3a8455d0 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.110+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== watch-notify(notify (1) cookie 94331348485520 notify 158913789963 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55cb3a8842a0 con 0x55cb3a8455d0 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.110+0000 7f55db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789963 cookie 94331348485520 notifier 4868 bl.length()=542 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.110+0000 7f55db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.110+0000 7f55db7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.110+0000 7f55db7fe640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f55c0003ea0 con 0x55cb3a8455d0 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.110+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(65 notify.2 [notify cookie 94331348728400 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.111+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.111+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== watch-notify(notify_complete (2) cookie 94331348728400 notify 158913789963 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cb3a8848f0 con 0x55cb3a8455d0 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.111+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a883a50 con 0x55cb3a8455d0 2024-09-10T05:13:34.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.112+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v37'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.112+0000 7f56fe698800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-10T05:13:34.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.112+0000 7f56fe698800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T05:13:34.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.112+0000 7f56fe698800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-10T05:13:34.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.112+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94331348728400 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a8888e0 con 0x55cb3a840c20 2024-09-10T05:13:34.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.112+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== watch-notify(notify (1) cookie 94331348506144 notify 158913789990 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55cb3a81ea30 con 0x55cb3a840c20 2024-09-10T05:13:34.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.112+0000 7f55daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789990 cookie 94331348506144 notifier 4868 bl.length()=175 2024-09-10T05:13:34.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.112+0000 7f55daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-10T05:13:34.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.112+0000 7f55daffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-10T05:13:34.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.112+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(68 notify.5 [notify cookie 94331348728400 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.112+0000 7f55daffd640 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5530003400 con 0x55cb3a840c20 2024-09-10T05:13:34.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.113+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.113+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== watch-notify(notify_complete (2) cookie 94331348728400 notify 158913789990 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cb3a81e490 con 0x55cb3a840c20 2024-09-10T05:13:34.127 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-10T05:13:34.110198Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:13:34.110183Z","tags":[],"group_ids":[]} 2024-09-10T05:13:34.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.114+0000 7f55b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.114+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94331348510448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a882e10 con 0x55cb3a83c5d0 2024-09-10T05:13:34.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.115+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94331348510448] v37'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.115+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94331348488048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a882e10 con 0x7f56e405f040 2024-09-10T05:13:34.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.116+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94331348488048] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x7f56e405f040 2024-09-10T05:13:34.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.116+0000 7f56fe698800 20 remove_watcher() i=0 2024-09-10T05:13:34.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.116+0000 7f56fe698800 2 removed watcher, disabling cache 2024-09-10T05:13:34.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.116+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94331348492320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a882e10 con 0x55cb3a83c5d0 2024-09-10T05:13:34.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.117+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94331348492320] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.117+0000 7f56fe698800 20 remove_watcher() i=1 2024-09-10T05:13:34.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.117+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94331348485520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a882e10 con 0x55cb3a8455d0 2024-09-10T05:13:34.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.118+0000 7f56fb988640 1 -- 172.21.15.192:0/1286524333 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94331348485520] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e407c040 con 0x55cb3a8455d0 2024-09-10T05:13:34.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.118+0000 7f56fe698800 20 remove_watcher() i=2 2024-09-10T05:13:34.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.118+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94331348498944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a882e10 con 0x7f56e405f040 2024-09-10T05:13:34.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.119+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94331348498944] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x7f56e405f040 2024-09-10T05:13:34.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.119+0000 7f56fe698800 20 remove_watcher() i=3 2024-09-10T05:13:34.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.119+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94331348502496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a882e10 con 0x55cb3a83c5d0 2024-09-10T05:13:34.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.120+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94331348502496] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f4035040 con 0x55cb3a83c5d0 2024-09-10T05:13:34.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.120+0000 7f56fe698800 20 remove_watcher() i=4 2024-09-10T05:13:34.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.120+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94331348506144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a882e10 con 0x55cb3a840c20 2024-09-10T05:13:34.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.121+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94331348506144] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.121+0000 7f56fe698800 20 remove_watcher() i=5 2024-09-10T05:13:34.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.121+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94331348500000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a882e10 con 0x55cb3a840c20 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.122+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94331348500000] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.122+0000 7f56fe698800 20 remove_watcher() i=6 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.122+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94331348508368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cb3a882e10 con 0x55cb3a840c20 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fc189640 1 -- 172.21.15.192:0/1286524333 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94331348508368] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec03a030 con 0x55cb3a840c20 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 20 remove_watcher() i=7 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cb3a840c20 msgr2=0x55cb3a843010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cb3a840c20 0x55cb3a843010 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cb3a83c5d0 msgr2=0x55cb3a83ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cb3a83c5d0 0x55cb3a83ea90 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f56e405f040 msgr2=0x7f56e406b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f56e405f040 0x7f56e406b410 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55cb3a8455d0 msgr2=0x55cb3a847a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55cb3a8455d0 0x55cb3a847a90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55cc03c6e0 msgr2=0x7f55cc03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55cc03c6e0 0x7f55cc03eba0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f56e4000c00 tx=0x7f56e4053000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 msgr2=0x55cb3a831010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fc98a640 1 -- 172.21.15.192:0/1286524333 reap_dead start 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 0x55cb3a831010 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f56ec028fd0 tx=0x7f56ec02eec0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 shutdown_connections 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 --2- 172.21.15.192:0/1286524333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a829c40 0x55cb3a831010 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 >> 172.21.15.192:0/1286524333 conn(0x55cb3a826040 msgr2=0x55cb3a824250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 shutdown_connections 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 -- 172.21.15.192:0/1286524333 wait complete. 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 -- 172.21.15.192:0/1248567088 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55d403c780 msgr2=0x7f55d403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.123+0000 7f56fe698800 1 --2- 172.21.15.192:0/1248567088 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55d403c780 0x7f55d403ec40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55cb3a80b9a0 tx=0x7f56e4005a00 comp rx=0 tx=0).stop 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1248567088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a81d200 msgr2=0x55cb3a81d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 --2- 172.21.15.192:0/1248567088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a81d200 0x55cb3a81d620 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f56ec014ff0 tx=0x7f56ec028ea0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1248567088 shutdown_connections 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 --2- 172.21.15.192:0/1248567088 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55d403c780 0x7f55d403ec40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 --2- 172.21.15.192:0/1248567088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a81d200 0x55cb3a81d620 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1248567088 >> 172.21.15.192:0/1248567088 conn(0x55cb3a8115b0 msgr2=0x55cb3a811990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1248567088 shutdown_connections 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1248567088 wait complete. 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cb3a8089f0 msgr2=0x55cb3a80ae70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55cb3a8089f0 0x55cb3a80ae70 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cb3a707320 msgr2=0x55cb3a806650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55cb3a707320 0x55cb3a806650 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55cb3a80ca60 msgr2=0x55cb3a80ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55cb3a80ca60 0x55cb3a80ee50 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55e403c780 msgr2=0x7f55e403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f55e403c780 0x7f55e403ec40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f56e4057000 tx=0x7f56e4052000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 msgr2=0x55cb3a7ff000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 --2- 172.21.15.192:0/1613652219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb3a706050 0x55cb3a7ff000 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f56ec001330 tx=0x7f56ec001250 comp rx=0 tx=0).stop 2024-09-10T05:13:34.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fc98a640 1 -- 172.21.15.192:0/1613652219 reap_dead start 2024-09-10T05:13:34.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 shutdown_connections 2024-09-10T05:13:34.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 >> 172.21.15.192:0/1613652219 conn(0x55cb3a701420 msgr2=0x55cb3a7f09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 shutdown_connections 2024-09-10T05:13:34.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.124+0000 7f56fe698800 1 -- 172.21.15.192:0/1613652219 wait complete. 2024-09-10T05:13:34.138 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-10T05:13:34.110198Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:34.110183Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:34.138 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-10T05:13:34.110198Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:34.110183Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:34.138 ERROR:root:0 2024-09-10T05:13:34.139 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:34.143 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:34.144 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-10T05:13:34.144 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-10T05:13:34.144 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-10T05:13:34.188 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:34.188 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:34.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.188+0000 7f967000f800 1 Processor -- start 2024-09-10T05:13:34.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.188+0000 7f967000f800 1 -- start start 2024-09-10T05:13:34.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.189+0000 7f967000f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b330b42df0 0x55b330b43af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.189+0000 7f967000f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b3309ede40 con 0x55b330b44030 2024-09-10T05:13:34.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.189+0000 7f967000f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55b3309b8680 con 0x55b330b42df0 2024-09-10T05:13:34.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.189+0000 7f966db00640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55b330b42df0 0x55b330b43af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.189+0000 7f966d2ff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55b330b44030 0x55b330b48d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46552/0 (socket says 172.21.15.192:46552) 2024-09-10T05:13:34.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.189+0000 7f966d2ff640 1 -- 172.21.15.192:0/77796633 learned_addr learned my addr 172.21.15.192:0/77796633 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:34.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.189+0000 7f966db00640 1 -- 172.21.15.192:0/77796633 >> v1:172.21.15.139:6789/0 conn(0x55b330b44030 legacy=0x55b330b48d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.189+0000 7f966cafe640 1 -- 172.21.15.192:0/77796633 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685521682 0 0) 0x55b3309ede40 con 0x55b330b44030 2024-09-10T05:13:34.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.189+0000 7f966db00640 1 -- 172.21.15.192:0/77796633 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3309d46b0 con 0x55b330b42df0 2024-09-10T05:13:34.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.191+0000 7f966db00640 1 --2- 172.21.15.192:0/77796633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330b43af0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f966000a470 tx=0x7f9660045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e24e7215905349 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.191+0000 7f966cafe640 1 -- 172.21.15.192:0/77796633 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9660053570 con 0x55b330b42df0 2024-09-10T05:13:34.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.191+0000 7f966cafe640 1 -- 172.21.15.192:0/77796633 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9660058070 con 0x55b330b42df0 2024-09-10T05:13:34.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.191+0000 7f966cafe640 1 -- 172.21.15.192:0/77796633 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9660053880 con 0x55b330b42df0 2024-09-10T05:13:34.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.192+0000 7f967000f800 1 -- 172.21.15.192:0/77796633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 msgr2=0x55b330b43af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.192+0000 7f967000f800 1 --2- 172.21.15.192:0/77796633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330b43af0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f966000a470 tx=0x7f9660045a20 comp rx=0 tx=0).stop 2024-09-10T05:13:34.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.192+0000 7f967000f800 1 -- 172.21.15.192:0/77796633 shutdown_connections 2024-09-10T05:13:34.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.192+0000 7f967000f800 1 --2- 172.21.15.192:0/77796633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330b43af0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.192+0000 7f967000f800 1 -- 172.21.15.192:0/77796633 >> 172.21.15.192:0/77796633 conn(0x55b330b3e1c0 msgr2=0x55b330b40620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.192+0000 7f967000f800 1 -- 172.21.15.192:0/77796633 shutdown_connections 2024-09-10T05:13:34.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.192+0000 7f967000f800 1 -- 172.21.15.192:0/77796633 wait complete. 2024-09-10T05:13:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.206+0000 7f967000f800 1 Processor -- start 2024-09-10T05:13:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.206+0000 7f967000f800 1 -- start start 2024-09-10T05:13:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.206+0000 7f967000f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330ab6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.206+0000 7f967000f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b3309dcdd0 con 0x55b330b42df0 2024-09-10T05:13:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.206+0000 7f966db00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330ab6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.206+0000 7f966db00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330ab6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33970/0 (socket says 172.21.15.192:33970) 2024-09-10T05:13:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.206+0000 7f966db00640 1 -- 172.21.15.192:0/2247932146 learned_addr learned my addr 172.21.15.192:0/2247932146 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.207+0000 7f966db00640 1 -- 172.21.15.192:0/2247932146 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3309f5e10 con 0x55b330b42df0 2024-09-10T05:13:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.207+0000 7f966db00640 1 --2- 172.21.15.192:0/2247932146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330ab6db0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f966000a470 tx=0x7f9660051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36116d418bf2d431 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.207+0000 7f955be07640 1 -- 172.21.15.192:0/2247932146 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9660053570 con 0x55b330b42df0 2024-09-10T05:13:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.207+0000 7f955be07640 1 -- 172.21.15.192:0/2247932146 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9660063030 con 0x55b330b42df0 2024-09-10T05:13:34.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.207+0000 7f955be07640 1 -- 172.21.15.192:0/2247932146 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9660053840 con 0x55b330b42df0 2024-09-10T05:13:34.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f967000f800 1 -- 172.21.15.192:0/2247932146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 msgr2=0x55b330ab6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f967000f800 1 --2- 172.21.15.192:0/2247932146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330ab6db0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f966000a470 tx=0x7f9660051000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f967000f800 1 -- 172.21.15.192:0/2247932146 shutdown_connections 2024-09-10T05:13:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f967000f800 1 --2- 172.21.15.192:0/2247932146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330ab6db0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f967000f800 1 -- 172.21.15.192:0/2247932146 >> 172.21.15.192:0/2247932146 conn(0x55b330b3e1c0 msgr2=0x55b330c2dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f967000f800 1 -- 172.21.15.192:0/2247932146 shutdown_connections 2024-09-10T05:13:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f967000f800 1 -- 172.21.15.192:0/2247932146 wait complete. 2024-09-10T05:13:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f967000f800 1 Processor -- start 2024-09-10T05:13:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f967000f800 1 -- start start 2024-09-10T05:13:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f967000f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330c3acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f967000f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b330b44720 con 0x55b330b42df0 2024-09-10T05:13:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f966db00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330c3acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f966db00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330c3acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33982/0 (socket says 172.21.15.192:33982) 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.208+0000 7f966db00640 1 -- 172.21.15.192:0/347173417 learned_addr learned my addr 172.21.15.192:0/347173417 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.209+0000 7f966db00640 1 -- 172.21.15.192:0/347173417 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b330c3b250 con 0x55b330b42df0 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.209+0000 7f966db00640 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330c3acf0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f966000a470 tx=0x7f9660002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.209+0000 7f955a604640 1 -- 172.21.15.192:0/347173417 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9660078070 con 0x55b330b42df0 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.209+0000 7f955a604640 1 -- 172.21.15.192:0/347173417 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9660068420 con 0x55b330b42df0 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.209+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b330c3b4e0 con 0x55b330b42df0 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.209+0000 7f955a604640 1 -- 172.21.15.192:0/347173417 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9660068700 con 0x55b330b42df0 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.209+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b330c3c0f0 con 0x55b330b42df0 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.210+0000 7f955a604640 1 -- 172.21.15.192:0/347173417 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f966007b070 con 0x55b330b42df0 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.210+0000 7f955a604640 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f955403c780 0x7f955403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.210+0000 7f955a604640 1 -- 172.21.15.192:0/347173417 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f96600979f0 con 0x55b330b42df0 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.210+0000 7f966d2ff640 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f955403c780 0x7f955403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.210+0000 7f967000f800 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b330b44030 0x55b330c42340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.210+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c3cab0 con 0x55b330b44030 2024-09-10T05:13:34.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.210+0000 7f966e301640 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b330b44030 0x55b330c42340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.210+0000 7f966d2ff640 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f955403c780 0x7f955403ec40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9664000c00 tx=0x7f96640013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.211+0000 7f966e301640 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b330b44030 0x55b330c42340 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.211+0000 7f966e301640 1 -- 172.21.15.192:0/347173417 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330b44030 2024-09-10T05:13:34.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.211+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c3c460 con 0x55b330b44030 2024-09-10T05:13:34.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.211+0000 7f966e301640 1 -- 172.21.15.192:0/347173417 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330b44030 2024-09-10T05:13:34.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.211+0000 7f967000f800 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b330c447d0 0x55b330c46bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.211+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c47290 con 0x55b330c447d0 2024-09-10T05:13:34.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.211+0000 7f966db00640 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b330c447d0 0x55b330c46bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.212+0000 7f966db00640 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b330c447d0 0x55b330c46bc0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.212+0000 7f966db00640 1 -- 172.21.15.192:0/347173417 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f966007a030 con 0x55b330c447d0 2024-09-10T05:13:34.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.212+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c435b0 con 0x55b330b44030 2024-09-10T05:13:34.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.212+0000 7f966e301640 1 -- 172.21.15.192:0/347173417 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330b44030 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.212+0000 7f967000f800 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b330c486d0 0x55b330c4aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.212+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c4b120 con 0x55b330c486d0 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.212+0000 7f966d2ff640 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b330c486d0 0x55b330c4aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.213+0000 7f966d2ff640 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b330c486d0 0x55b330c4aac0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.213+0000 7f966d2ff640 1 -- 172.21.15.192:0/347173417 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f966400f670 con 0x55b330c486d0 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.213+0000 7f967000f800 1 Processor -- start 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.213+0000 7f967000f800 1 -- start start 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.213+0000 7f967000f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c337e0 0x55b330c32050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.213+0000 7f967000f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b330a3aa00 con 0x55b330c337e0 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.214+0000 7f966db00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c337e0 0x55b330c32050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.214+0000 7f966db00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c337e0 0x55b330c32050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:33988/0 (socket says 172.21.15.192:33988) 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.214+0000 7f966db00640 1 -- 172.21.15.192:0/2311129834 learned_addr learned my addr 172.21.15.192:0/2311129834 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.214+0000 7f966db00640 1 -- 172.21.15.192:0/2311129834 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b330c33d00 con 0x55b330c337e0 2024-09-10T05:13:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.214+0000 7f966db00640 1 --2- 172.21.15.192:0/2311129834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c337e0 0x55b330c32050 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9660067bb0 tx=0x7f96600873a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.214+0000 7f95537fe640 1 -- 172.21.15.192:0/2311129834 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966007ccd0 con 0x55b330c337e0 2024-09-10T05:13:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.214+0000 7f95537fe640 1 -- 172.21.15.192:0/2311129834 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f966005e980 con 0x55b330c337e0 2024-09-10T05:13:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.214+0000 7f967000f800 1 -- 172.21.15.192:0/2311129834 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b330c32590 con 0x55b330c337e0 2024-09-10T05:13:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.214+0000 7f95537fe640 1 -- 172.21.15.192:0/2311129834 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966005ec60 con 0x55b330c337e0 2024-09-10T05:13:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.214+0000 7f967000f800 1 -- 172.21.15.192:0/2311129834 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b330c32ae0 con 0x55b330c337e0 2024-09-10T05:13:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.215+0000 7f95537fe640 1 -- 172.21.15.192:0/2311129834 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f966007c3b0 con 0x55b330c337e0 2024-09-10T05:13:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.215+0000 7f95537fe640 1 --2- 172.21.15.192:0/2311129834 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f954803c780 0x7f954803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.215+0000 7f95537fe640 1 -- 172.21.15.192:0/2311129834 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f966008e070 con 0x55b330c337e0 2024-09-10T05:13:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.215+0000 7f966d2ff640 1 --2- 172.21.15.192:0/2311129834 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f954803c780 0x7f954803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.215+0000 7f967000f800 1 Processor -- start 2024-09-10T05:13:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.216+0000 7f967000f800 1 -- start start 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.216+0000 7f966d2ff640 1 --2- 172.21.15.192:0/2311129834 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f954803c780 0x7f954803ec40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55b330c42970 tx=0x7f9664006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.216+0000 7f967000f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 0x55b330c67c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.216+0000 7f967000f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b330c36100 con 0x55b330c67870 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.216+0000 7f966db00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 0x55b330c67c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.216+0000 7f966db00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 0x55b330c67c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34004/0 (socket says 172.21.15.192:34004) 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.216+0000 7f966db00640 1 -- 172.21.15.192:0/778942858 learned_addr learned my addr 172.21.15.192:0/778942858 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.216+0000 7f966db00640 1 -- 172.21.15.192:0/778942858 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b330c68240 con 0x55b330c67870 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.216+0000 7f966db00640 1 --2- 172.21.15.192:0/778942858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 0x55b330c67c50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f966005f550 tx=0x7f9660095af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c6df2e03b46ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.216+0000 7f95517fa640 1 -- 172.21.15.192:0/778942858 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96600b0070 con 0x55b330c67870 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.216+0000 7f95517fa640 1 -- 172.21.15.192:0/778942858 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9660052930 con 0x55b330c67870 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.216+0000 7f95517fa640 1 -- 172.21.15.192:0/778942858 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f966009c040 con 0x55b330c67870 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.217+0000 7f967000f800 1 -- 172.21.15.192:0/778942858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 msgr2=0x55b330c67c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.217+0000 7f967000f800 1 --2- 172.21.15.192:0/778942858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 0x55b330c67c50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f966005f550 tx=0x7f9660095af0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.217+0000 7f967000f800 1 -- 172.21.15.192:0/778942858 shutdown_connections 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.217+0000 7f967000f800 1 --2- 172.21.15.192:0/778942858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 0x55b330c67c50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.217+0000 7f967000f800 1 -- 172.21.15.192:0/778942858 >> 172.21.15.192:0/778942858 conn(0x55b330c63c70 msgr2=0x55b330c61eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.217+0000 7f967000f800 1 -- 172.21.15.192:0/778942858 shutdown_connections 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.217+0000 7f967000f800 1 -- 172.21.15.192:0/778942858 wait complete. 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.217+0000 7f967000f800 1 Processor -- start 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.217+0000 7f967000f800 1 -- start start 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.217+0000 7f967000f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 0x55b330c6ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.217+0000 7f967000f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b330c686d0 con 0x55b330c67870 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.218+0000 7f966db00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 0x55b330c6ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.218+0000 7f966db00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 0x55b330c6ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34008/0 (socket says 172.21.15.192:34008) 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.218+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 learned_addr learned my addr 172.21.15.192:0/2937201074 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.218+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b330c6f2b0 con 0x55b330c67870 2024-09-10T05:13:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.218+0000 7f966db00640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 0x55b330c6ed50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f966005f010 tx=0x7f966008eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.218+0000 7f953f7fe640 1 -- 172.21.15.192:0/2937201074 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96600ba020 con 0x55b330c67870 2024-09-10T05:13:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.218+0000 7f953f7fe640 1 -- 172.21.15.192:0/2937201074 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9660007e10 con 0x55b330c67870 2024-09-10T05:13:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.218+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b330c6f2b0 con 0x55b330c67870 2024-09-10T05:13:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.218+0000 7f953f7fe640 1 -- 172.21.15.192:0/2937201074 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96600b0040 con 0x55b330c67870 2024-09-10T05:13:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.218+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b330c6f2b0 con 0x55b330c67870 2024-09-10T05:13:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.219+0000 7f953f7fe640 1 -- 172.21.15.192:0/2937201074 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f96600bd020 con 0x55b330c67870 2024-09-10T05:13:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.219+0000 7f953f7fe640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f953803c730 0x7f953803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.219+0000 7f953f7fe640 1 -- 172.21.15.192:0/2937201074 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f96600a8070 con 0x55b330c67870 2024-09-10T05:13:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.219+0000 7f966d2ff640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f953803c730 0x7f953803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.220+0000 7f966d2ff640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f953803c730 0x7f953803ebf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f966400ffd0 tx=0x7f9664023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.220+0000 7f967000f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.220+0000 7f967000f800 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b330c7a2b0 0x55b330c7c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.220+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7cec0 con 0x55b330c7a2b0 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.220+0000 7f966e301640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b330c7a2b0 0x55b330c7c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.220+0000 7f966e301640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b330c7a2b0 0x55b330c7c770 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.220+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.220+0000 7f967000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.220+0000 7f967000f800 20 realm 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.220+0000 7f967000f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.220+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7d2d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f967000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f967000f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f967000f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7dba0 con 0x55b330c7a2b0 2024-09-10T05:13:34.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f967000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f967000f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7a2b0 2024-09-10T05:13:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f967000f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f967000f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f967000f800 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b330c7eca0 0x55b330c81090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c81650 con 0x55b330c7eca0 2024-09-10T05:13:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.221+0000 7f966db00640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b330c7eca0 0x55b330c81090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.222+0000 7f966db00640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b330c7eca0 0x55b330c81090 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.222+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.222+0000 7f967000f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.222+0000 7f967000f800 20 searching for the correct realm 2024-09-10T05:13:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.222+0000 7f967000f800 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b330c83600 0x55b330c85ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.222+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c86190 con 0x55b330c83600 2024-09-10T05:13:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.222+0000 7f966d2ff640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b330c83600 0x55b330c85ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.222+0000 7f966d2ff640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b330c83600 0x55b330c85ac0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.223+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.223+0000 7f966d2ff640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f966402e910 0x7f966403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.223+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c86190 con 0x7f966402e910 2024-09-10T05:13:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.223+0000 7f966e301640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f966402e910 0x7f966403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.223+0000 7f966e301640 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f966402e910 0x7f966403a3c0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.223+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.223+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7eca0 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.223+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.224+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7a2b0 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.224+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.224+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7a2b0 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.224+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.224+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7eca0 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.224+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.224+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7eca0 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.224+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.224+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x7f966402e910 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.225+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.225+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c83600 2024-09-10T05:13:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.225+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.225+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7a2b0 2024-09-10T05:13:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.225+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.225+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7eca0 2024-09-10T05:13:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.226+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.226+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7a2b0 2024-09-10T05:13:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.226+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.226+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x7f966402e910 2024-09-10T05:13:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.226+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.226+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c83600 2024-09-10T05:13:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.226+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.226+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c83600 2024-09-10T05:13:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.226+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.226+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7eca0 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.227+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.227+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c83600 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.227+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.227+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c83600 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.227+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.227+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7a2b0 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.227+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.227+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7a2b0 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.227+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.227+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x7f966402e910 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.228+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.228+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c83600 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.228+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.228+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x7f966402e910 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.228+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.228+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7a2b0 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.228+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.228+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7eca0 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.229+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.229+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c83600 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.229+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.229+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7eca0 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.229+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.229+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x7f966402e910 2024-09-10T05:13:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.229+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.229+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c83600 2024-09-10T05:13:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x7f966402e910 2024-09-10T05:13:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x55b330c7a2b0 2024-09-10T05:13:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b330c7df40 con 0x7f966402e910 2024-09-10T05:13:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f967000f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f967000f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f967000f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f967000f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:34.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f967000f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:34.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f967000f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:34.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f967000f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c81f10 con 0x55b330c7a2b0 2024-09-10T05:13:34.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f967000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f967000f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.230+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c81f10 con 0x55b330c7a2b0 2024-09-10T05:13:34.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c81f10 con 0x7f966402e910 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 20 zone default found 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 4 Realm: () 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 20 zonegroup default 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c827b0 con 0x55b330c7eca0 2024-09-10T05:13:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.231+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c88000 con 0x55b330c83600 2024-09-10T05:13:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.232+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.232+0000 7f967000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.232+0000 7f967000f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.232+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c883a0 con 0x55b330c83600 2024-09-10T05:13:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.232+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.232+0000 7f967000f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.232+0000 7f967000f800 20 started sync module instance, tier type = 2024-09-10T05:13:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.232+0000 7f967000f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.232+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c874a0 con 0x7f966402e910 2024-09-10T05:13:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.233+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.233+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94228105951648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c874a0 con 0x7f966402e910 2024-09-10T05:13:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.233+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c88da0 con 0x55b330c7a2b0 2024-09-10T05:13:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.234+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94228105951648] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.234+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.234+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94228105955504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c874a0 con 0x55b330c7a2b0 2024-09-10T05:13:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.234+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c89820 con 0x55b330c83600 2024-09-10T05:13:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.236+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.236+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94228105958192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8a0f0 con 0x55b330c83600 2024-09-10T05:13:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.236+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8ab90 con 0x7f966402e910 2024-09-10T05:13:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.236+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94228105955504] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.237+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94228105958192] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.237+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.237+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94228105960512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c86ff0 con 0x7f966402e910 2024-09-10T05:13:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.237+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8b470 con 0x55b330c7a2b0 2024-09-10T05:13:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.238+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.238+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94228105965360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8b8a0 con 0x55b330c7a2b0 2024-09-10T05:13:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.238+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8c3b0 con 0x55b330c7eca0 2024-09-10T05:13:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.238+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94228105960512] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.239+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.239+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94228105965360] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.239+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94228105969248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8b350 con 0x55b330c7eca0 2024-09-10T05:13:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.239+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8cc50 con 0x55b330c7eca0 2024-09-10T05:13:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.240+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94228105969248] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.241+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.241+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94228105963104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8cc00 con 0x55b330c7eca0 2024-09-10T05:13:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.241+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8d6c0 con 0x55b330c7eca0 2024-09-10T05:13:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.242+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94228105963104] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.242+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.242+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94228105974160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8cc00 con 0x55b330c7eca0 2024-09-10T05:13:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.242+0000 7f967000f800 20 add_watcher() i=0 2024-09-10T05:13:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.242+0000 7f967000f800 20 add_watcher() i=1 2024-09-10T05:13:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.242+0000 7f967000f800 20 add_watcher() i=2 2024-09-10T05:13:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.242+0000 7f967000f800 20 add_watcher() i=3 2024-09-10T05:13:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.242+0000 7f967000f800 20 add_watcher() i=4 2024-09-10T05:13:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.242+0000 7f967000f800 20 add_watcher() i=5 2024-09-10T05:13:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.242+0000 7f967000f800 20 add_watcher() i=6 2024-09-10T05:13:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.243+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94228105974160] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.243+0000 7f967000f800 20 add_watcher() i=7 2024-09-10T05:13:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.243+0000 7f967000f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.243+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330c90b40 con 0x55b330c7a2b0 2024-09-10T05:13:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.243+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.243+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94228105972000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8e060 con 0x55b330c7a2b0 2024-09-10T05:13:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.244+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94228105972000] v37'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.244+0000 7f951f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.244+0000 7f967000f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.244+0000 7f967000f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.244+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c993a0 con 0x55b330c7a2b0 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.246+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'60 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.246+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c99a50 con 0x55b330c7eca0 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.247+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.247+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c99a50 con 0x55b330c83600 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.248+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.248+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c9a360 con 0x55b330c7a2b0 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.249+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'261 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.249+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c97270 con 0x7f966402e910 2024-09-10T05:13:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.250+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'86 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.250+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c97270 con 0x55b330c83600 2024-09-10T05:13:34.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.251+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'65 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.251+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c9b520 con 0x55b330c7a2b0 2024-09-10T05:13:34.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.252+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.252+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c96170 con 0x55b330c7eca0 2024-09-10T05:13:34.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.253+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.253+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x7f966402e910 2024-09-10T05:13:34.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.254+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.254+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c96400 con 0x55b330c83600 2024-09-10T05:13:34.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.255+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.255+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c9c080 con 0x7f966402e910 2024-09-10T05:13:34.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.256+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'87 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.256+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c9c080 con 0x55b330c7eca0 2024-09-10T05:13:34.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.257+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'37 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.257+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c9c080 con 0x7f966402e910 2024-09-10T05:13:34.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.258+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.258+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c9c080 con 0x55b330c7eca0 2024-09-10T05:13:34.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.259+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'71 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.259+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c9c080 con 0x55b330c7a2b0 2024-09-10T05:13:34.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.260+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'262 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.260+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c9c080 con 0x55b330c83600 2024-09-10T05:13:34.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.261+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'83 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.261+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x7f966402e910 2024-09-10T05:13:34.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.263+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'88 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.263+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x55b330c83600 2024-09-10T05:13:34.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.264+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.264+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x55b330c7a2b0 2024-09-10T05:13:34.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.266+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.266+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x55b330c7a2b0 2024-09-10T05:13:34.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.267+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'263 uv174 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.267+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x55b330c83600 2024-09-10T05:13:34.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.268+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'84 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.268+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x7f966402e910 2024-09-10T05:13:34.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.269+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.269+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x55b330c83600 2024-09-10T05:13:34.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.270+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.270+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x55b330c83600 2024-09-10T05:13:34.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.271+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'48 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.271+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x55b330c83600 2024-09-10T05:13:34.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.272+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.272+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x55b330c83600 2024-09-10T05:13:34.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.273+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'66 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.273+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x55b330c7eca0 2024-09-10T05:13:34.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.274+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.274+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x55b330c83600 2024-09-10T05:13:34.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.275+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.275+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c967c0 con 0x55b330c7eca0 2024-09-10T05:13:34.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.276+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.276+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c95b50 con 0x55b330c83600 2024-09-10T05:13:34.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.277+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'85 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.277+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c95b50 con 0x55b330c7eca0 2024-09-10T05:13:34.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.278+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'72 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.278+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c95b50 con 0x7f966402e910 2024-09-10T05:13:34.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.279+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.279+0000 7f951e7fc640 20 reqs_thread_entry: start 2024-09-10T05:13:34.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.280+0000 7f967000f800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:34.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.280+0000 7f967000f800 20 Filter name: none 2024-09-10T05:13:34.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.280+0000 7f948ffff640 20 reqs_thread_entry: start 2024-09-10T05:13:34.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.280+0000 7f967000f800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-10T05:13:34.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.280+0000 7f967000f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.280+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330cc6e80 con 0x55b330c83600 2024-09-10T05:13:34.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.280+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.280+0000 7f967000f800 20 rados_obj.operate() r=0 bl.length=363 2024-09-10T05:13:34.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.280+0000 7f967000f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-10T05:13:34.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.280+0000 7f967000f800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-10T05:13:34.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.280+0000 7f967000f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:34.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.280+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330cc9740 con 0x55b330c83600 2024-09-10T05:13:34.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.281+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.281+0000 7f967000f800 10 removing key index: true_admin_akey 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.281+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330cc7720 con 0x55b330c83600 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.281+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 28 ==== osd_op_reply(96 true_admin_akey [delete] v37'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.282+0000 7f967000f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.282+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94228106215712 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330cc9d00 con 0x55b330c7eca0 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.282+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== watch-notify(notify (1) cookie 94228105969248 notify 158913789991 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55b330c96990 con 0x55b330c7eca0 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.282+0000 7f95517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789991 cookie 94228105969248 notifier 4875 bl.length()=165 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.282+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(97 notify.5 [notify cookie 94228106215712 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.282+0000 7f95517fa640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f9530003d60 con 0x55b330c7eca0 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.282+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.282+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== watch-notify(notify_complete (2) cookie 94228106215712 notify 158913789991 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b330c33d00 con 0x55b330c7eca0 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.282+0000 7f967000f800 10 removing email index: 2024-09-10T05:13:34.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.282+0000 7f967000f800 10 removing user buckets index 2024-09-10T05:13:34.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.282+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330cc9c60 con 0x55b330c83600 2024-09-10T05:13:34.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.283+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 29 ==== osd_op_reply(99 a_user.buckets [delete] v37'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.283+0000 7f967000f800 10 removing user index: a_user 2024-09-10T05:13:34.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.283+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330cc9100 con 0x55b330c83600 2024-09-10T05:13:34.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.284+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 30 ==== osd_op_reply(100 a_user [call,call,delete] v37'10 uv10 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.284+0000 7f967000f800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-10T05:13:34.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.284+0000 7f967000f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-10T05:13:34.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.284+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94228106221392 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b330cc8520 con 0x55b330c83600 2024-09-10T05:13:34.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.284+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 31 ==== watch-notify(notify (1) cookie 94228105958192 notify 158913789964 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55b330c967c0 con 0x55b330c83600 2024-09-10T05:13:34.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.284+0000 7f95517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789964 cookie 94228105958192 notifier 4875 bl.length()=155 2024-09-10T05:13:34.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.284+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 32 ==== osd_op_reply(101 notify.2 [notify cookie 94228106221392 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.284+0000 7f95517fa640 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f9530003d60 con 0x55b330c83600 2024-09-10T05:13:34.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.285+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 33 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.285+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 34 ==== watch-notify(notify_complete (2) cookie 94228106221392 notify 158913789964 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b330c96e10 con 0x55b330c83600 2024-09-10T05:13:34.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.285+0000 7f951f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.286+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94228105972000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c9b070 con 0x55b330c7a2b0 2024-09-10T05:13:34.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.286+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94228105972000] v37'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.287+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94228105951648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8c8f0 con 0x7f966402e910 2024-09-10T05:13:34.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.287+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94228105951648] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.287+0000 7f967000f800 20 remove_watcher() i=0 2024-09-10T05:13:34.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.287+0000 7f967000f800 2 removed watcher, disabling cache 2024-09-10T05:13:34.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.287+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94228105955504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c879a0 con 0x55b330c7a2b0 2024-09-10T05:13:34.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.289+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94228105955504] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.289+0000 7f967000f800 20 remove_watcher() i=1 2024-09-10T05:13:34.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.289+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94228105958192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c888b0 con 0x55b330c83600 2024-09-10T05:13:34.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.290+0000 7f966d2ff640 1 -- 172.21.15.192:0/2937201074 <== osd.3 v2:172.21.15.192:6816/1620624472 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94228105958192] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9664037040 con 0x55b330c83600 2024-09-10T05:13:34.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.290+0000 7f967000f800 20 remove_watcher() i=2 2024-09-10T05:13:34.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.290+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94228105960512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c888b0 con 0x7f966402e910 2024-09-10T05:13:34.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.291+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94228105960512] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x7f966402e910 2024-09-10T05:13:34.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.291+0000 7f967000f800 20 remove_watcher() i=3 2024-09-10T05:13:34.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.291+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94228105965360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c888b0 con 0x55b330c7a2b0 2024-09-10T05:13:34.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.292+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94228105965360] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966800a4d0 con 0x55b330c7a2b0 2024-09-10T05:13:34.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.292+0000 7f967000f800 20 remove_watcher() i=4 2024-09-10T05:13:34.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.292+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94228105969248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8af30 con 0x55b330c7eca0 2024-09-10T05:13:34.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.293+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94228105969248] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.293+0000 7f967000f800 20 remove_watcher() i=5 2024-09-10T05:13:34.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.293+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94228105963104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c888b0 con 0x55b330c7eca0 2024-09-10T05:13:34.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.294+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94228105963104] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.294+0000 7f967000f800 20 remove_watcher() i=6 2024-09-10T05:13:34.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.294+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94228105974160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b330c8be60 con 0x55b330c7eca0 2024-09-10T05:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f966db00640 1 -- 172.21.15.192:0/2937201074 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94228105974160] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f966007a030 con 0x55b330c7eca0 2024-09-10T05:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 20 remove_watcher() i=7 2024-09-10T05:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b330c7eca0 msgr2=0x55b330c81090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b330c7eca0 0x55b330c81090 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b330c7a2b0 msgr2=0x55b330c7c770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b330c7a2b0 0x55b330c7c770 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f966402e910 msgr2=0x7f966403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f966402e910 0x7f966403a3c0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b330c83600 msgr2=0x55b330c85ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55b330c83600 0x55b330c85ac0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f953803c730 msgr2=0x7f953803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f953803c730 0x7f953803ebf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f966400ffd0 tx=0x7f9664023040 comp rx=0 tx=0).stop 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 msgr2=0x55b330c6ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f966e301640 1 -- 172.21.15.192:0/2937201074 reap_dead start 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 0x55b330c6ed50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f966005f010 tx=0x7f966008eed0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 shutdown_connections 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 --2- 172.21.15.192:0/2937201074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c67870 0x55b330c6ed50 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 >> 172.21.15.192:0/2937201074 conn(0x55b330c63c70 msgr2=0x55b330c61e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 shutdown_connections 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2937201074 wait complete. 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2311129834 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f954803c780 msgr2=0x7f954803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 --2- 172.21.15.192:0/2311129834 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f954803c780 0x7f954803ec40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55b330c42970 tx=0x7f9664006000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2311129834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c337e0 msgr2=0x55b330c32050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 --2- 172.21.15.192:0/2311129834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c337e0 0x55b330c32050 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9660067bb0 tx=0x7f96600873a0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 -- 172.21.15.192:0/2311129834 shutdown_connections 2024-09-10T05:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 --2- 172.21.15.192:0/2311129834 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f954803c780 0x7f954803ec40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.295+0000 7f967000f800 1 --2- 172.21.15.192:0/2311129834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330c337e0 0x55b330c32050 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 -- 172.21.15.192:0/2311129834 >> 172.21.15.192:0/2311129834 conn(0x55b330c4d130 msgr2=0x55b330c4d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 -- 172.21.15.192:0/2311129834 shutdown_connections 2024-09-10T05:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 -- 172.21.15.192:0/2311129834 wait complete. 2024-09-10T05:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b330c447d0 msgr2=0x55b330c46bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55b330c447d0 0x55b330c46bc0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b330b44030 msgr2=0x55b330c42340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55b330b44030 0x55b330c42340 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b330c486d0 msgr2=0x55b330c4aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55b330c486d0 0x55b330c4aac0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f955403c780 msgr2=0x7f955403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f955403c780 0x7f955403ec40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9664000c00 tx=0x7f96640013b0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 msgr2=0x55b330c3acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 --2- 172.21.15.192:0/347173417 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b330b42df0 0x55b330c3acf0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f966000a470 tx=0x7f9660002fb0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f966e301640 1 -- 172.21.15.192:0/347173417 reap_dead start 2024-09-10T05:13:34.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 shutdown_connections 2024-09-10T05:13:34.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 >> 172.21.15.192:0/347173417 conn(0x55b330b3e1c0 msgr2=0x55b330c2c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 shutdown_connections 2024-09-10T05:13:34.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.296+0000 7f967000f800 1 -- 172.21.15.192:0/347173417 wait complete. 2024-09-10T05:13:34.305 ERROR:root:None 2024-09-10T05:13:34.305 ERROR:root:0 2024-09-10T05:13:34.306 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-10T05:13:34.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-10T05:13:34.306 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-10T05:13:34.353 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:34.353 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:34.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.352+0000 7f6a8040f800 1 Processor -- start 2024-09-10T05:13:34.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.352+0000 7f6a8040f800 1 -- start start 2024-09-10T05:13:34.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.353+0000 7f6a8040f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562fe6bbe990 0x562fe6bc4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.353+0000 7f6a8040f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562fe6a68e40 con 0x562fe6bbd580 2024-09-10T05:13:34.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.353+0000 7f6a8040f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x562fe6a33680 con 0x562fe6bbe990 2024-09-10T05:13:34.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.353+0000 7f6a73fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x562fe6bbe990 0x562fe6bc4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.353+0000 7f6a7bb92640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x562fe6bbd580 0x562fe6bbe280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46558/0 (socket says 172.21.15.192:46558) 2024-09-10T05:13:34.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.353+0000 7f6a7bb92640 1 -- 172.21.15.192:0/3043229482 learned_addr learned my addr 172.21.15.192:0/3043229482 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:34.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.353+0000 7f6a73fff640 1 -- 172.21.15.192:0/3043229482 >> v1:172.21.15.139:6789/0 conn(0x562fe6bbd580 legacy=0x562fe6bbe280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.353+0000 7f6a73fff640 1 -- 172.21.15.192:0/3043229482 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe6a4f6b0 con 0x562fe6bbe990 2024-09-10T05:13:34.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.353+0000 7f6a7b391640 1 -- 172.21.15.192:0/3043229482 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425620727 0 0) 0x562fe6a68e40 con 0x562fe6bbd580 2024-09-10T05:13:34.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.355+0000 7f6a73fff640 1 --2- 172.21.15.192:0/3043229482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbe990 0x562fe6bc4530 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400a470 tx=0x7f6a64045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b6065a6ddf2f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.355+0000 7f6a7b391640 1 -- 172.21.15.192:0/3043229482 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64053570 con 0x562fe6bbe990 2024-09-10T05:13:34.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.355+0000 7f6a7b391640 1 -- 172.21.15.192:0/3043229482 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a64058070 con 0x562fe6bbe990 2024-09-10T05:13:34.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.355+0000 7f6a7b391640 1 -- 172.21.15.192:0/3043229482 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a64053880 con 0x562fe6bbe990 2024-09-10T05:13:34.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.356+0000 7f6a8040f800 1 -- 172.21.15.192:0/3043229482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbe990 msgr2=0x562fe6bc4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.356+0000 7f6a8040f800 1 --2- 172.21.15.192:0/3043229482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbe990 0x562fe6bc4530 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400a470 tx=0x7f6a64045a20 comp rx=0 tx=0).stop 2024-09-10T05:13:34.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.356+0000 7f6a8040f800 1 -- 172.21.15.192:0/3043229482 shutdown_connections 2024-09-10T05:13:34.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.356+0000 7f6a8040f800 1 --2- 172.21.15.192:0/3043229482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbe990 0x562fe6bc4530 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.356+0000 7f6a8040f800 1 -- 172.21.15.192:0/3043229482 >> 172.21.15.192:0/3043229482 conn(0x562fe6bb8930 msgr2=0x562fe6bbadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.356+0000 7f6a8040f800 1 -- 172.21.15.192:0/3043229482 shutdown_connections 2024-09-10T05:13:34.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.356+0000 7f6a8040f800 1 -- 172.21.15.192:0/3043229482 wait complete. 2024-09-10T05:13:34.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.369+0000 7f6a8040f800 1 Processor -- start 2024-09-10T05:13:34.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.370+0000 7f6a8040f800 1 -- start start 2024-09-10T05:13:34.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.370+0000 7f6a8040f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbd580 0x562fe6cad440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.370+0000 7f6a8040f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562fe6a57dd0 con 0x562fe6bbd580 2024-09-10T05:13:34.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.370+0000 7f6a7bb92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbd580 0x562fe6cad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.370+0000 7f6a7bb92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbd580 0x562fe6cad440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34022/0 (socket says 172.21.15.192:34022) 2024-09-10T05:13:34.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.370+0000 7f6a7bb92640 1 -- 172.21.15.192:0/2036620950 learned_addr learned my addr 172.21.15.192:0/2036620950 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.370+0000 7f6a7bb92640 1 -- 172.21.15.192:0/2036620950 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe6a70e10 con 0x562fe6bbd580 2024-09-10T05:13:34.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.370+0000 7f6a7bb92640 1 --2- 172.21.15.192:0/2036620950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbd580 0x562fe6cad440 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c001ea0 tx=0x7f6a6c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c669dc0706348b09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.370+0000 7f6969e0b640 1 -- 172.21.15.192:0/2036620950 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c008070 con 0x562fe6bbd580 2024-09-10T05:13:34.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.370+0000 7f6969e0b640 1 -- 172.21.15.192:0/2036620950 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6c00d500 con 0x562fe6bbd580 2024-09-10T05:13:34.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.370+0000 7f6969e0b640 1 -- 172.21.15.192:0/2036620950 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c00d880 con 0x562fe6bbd580 2024-09-10T05:13:34.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.371+0000 7f6a8040f800 1 -- 172.21.15.192:0/2036620950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbd580 msgr2=0x562fe6cad440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.371+0000 7f6a8040f800 1 --2- 172.21.15.192:0/2036620950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbd580 0x562fe6cad440 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c001ea0 tx=0x7f6a6c00b6a0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.371+0000 7f6a8040f800 1 -- 172.21.15.192:0/2036620950 shutdown_connections 2024-09-10T05:13:34.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.371+0000 7f6a8040f800 1 --2- 172.21.15.192:0/2036620950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbd580 0x562fe6cad440 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.371+0000 7f6a8040f800 1 -- 172.21.15.192:0/2036620950 >> 172.21.15.192:0/2036620950 conn(0x562fe6bb8930 msgr2=0x562fe6ca8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.371+0000 7f6a8040f800 1 -- 172.21.15.192:0/2036620950 shutdown_connections 2024-09-10T05:13:34.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.371+0000 7f6a8040f800 1 -- 172.21.15.192:0/2036620950 wait complete. 2024-09-10T05:13:34.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.372+0000 7f6a8040f800 1 Processor -- start 2024-09-10T05:13:34.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.372+0000 7f6a8040f800 1 -- start start 2024-09-10T05:13:34.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.372+0000 7f6a8040f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbe990 0x562fe6cb0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.372+0000 7f6a8040f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562fe6bbf080 con 0x562fe6bbe990 2024-09-10T05:13:34.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.372+0000 7f6a7bb92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbe990 0x562fe6cb0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.372+0000 7f6a7bb92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbe990 0x562fe6cb0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34034/0 (socket says 172.21.15.192:34034) 2024-09-10T05:13:34.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.372+0000 7f6a7bb92640 1 -- 172.21.15.192:0/3822144711 learned_addr learned my addr 172.21.15.192:0/3822144711 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.372+0000 7f6a7bb92640 1 -- 172.21.15.192:0/3822144711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe6cb1440 con 0x562fe6bbe990 2024-09-10T05:13:34.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.372+0000 7f6a7bb92640 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbe990 0x562fe6cb0ee0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0012f0 tx=0x7f6a6c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.372+0000 7f6963fff640 1 -- 172.21.15.192:0/3822144711 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c00de50 con 0x562fe6bbe990 2024-09-10T05:13:34.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.373+0000 7f6963fff640 1 -- 172.21.15.192:0/3822144711 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6c00f930 con 0x562fe6bbe990 2024-09-10T05:13:34.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.373+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fe6caf7f0 con 0x562fe6bbe990 2024-09-10T05:13:34.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.373+0000 7f6963fff640 1 -- 172.21.15.192:0/3822144711 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c00fc30 con 0x562fe6bbe990 2024-09-10T05:13:34.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.373+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fe6cafdb0 con 0x562fe6bbe990 2024-09-10T05:13:34.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.373+0000 7f6963fff640 1 -- 172.21.15.192:0/3822144711 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6a6c017040 con 0x562fe6bbe990 2024-09-10T05:13:34.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.374+0000 7f6963fff640 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f696403c920 0x7f696403ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.374+0000 7f6963fff640 1 -- 172.21.15.192:0/3822144711 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6a6c015020 con 0x562fe6bbe990 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.374+0000 7f6a73fff640 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f696403c920 0x7f696403ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.374+0000 7f6a8040f800 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562fe6cbd5d0 0x562fe6cbf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.374+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cbff00 con 0x562fe6cbd5d0 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.374+0000 7f6a7c393640 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562fe6cbd5d0 0x562fe6cbf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.374+0000 7f6a73fff640 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f696403c920 0x7f696403ede0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6a64057000 tx=0x7f6a64052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.374+0000 7f6a7c393640 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562fe6cbd5d0 0x562fe6cbf9c0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.374+0000 7f6a7c393640 1 -- 172.21.15.192:0/3822144711 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cbd5d0 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.375+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cb0290 con 0x562fe6cbd5d0 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.375+0000 7f6a7c393640 1 -- 172.21.15.192:0/3822144711 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cbd5d0 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.375+0000 7f6a8040f800 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562fe6cc21d0 0x562fe6cc45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.375+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cc4c90 con 0x562fe6cc21d0 2024-09-10T05:13:34.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.375+0000 7f6a7bb92640 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562fe6cc21d0 0x562fe6cc45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.375+0000 7f6a7bb92640 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562fe6cc21d0 0x562fe6cc45c0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.376+0000 7f6a7bb92640 1 -- 172.21.15.192:0/3822144711 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6a6c02d070 con 0x562fe6cc21d0 2024-09-10T05:13:34.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.376+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cc1070 con 0x562fe6cbd5d0 2024-09-10T05:13:34.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.376+0000 7f6a7c393640 1 -- 172.21.15.192:0/3822144711 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cbd5d0 2024-09-10T05:13:34.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.376+0000 7f6a8040f800 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562fe6cc60d0 0x562fe6cc84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.376+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cc8c00 con 0x562fe6cc60d0 2024-09-10T05:13:34.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.376+0000 7f6a73fff640 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562fe6cc60d0 0x562fe6cc84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.376+0000 7f6a73fff640 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562fe6cc60d0 0x562fe6cc84c0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.377+0000 7f6a73fff640 1 -- 172.21.15.192:0/3822144711 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6a64051070 con 0x562fe6cc60d0 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.377+0000 7f6a8040f800 1 Processor -- start 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.377+0000 7f6a8040f800 1 -- start start 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.377+0000 7f6a8040f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6cd6860 0x562fe6cd6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.377+0000 7f6a8040f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562fe6ab5a00 con 0x562fe6cd6860 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.377+0000 7f6a7bb92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6cd6860 0x562fe6cd6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.377+0000 7f6a7bb92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6cd6860 0x562fe6cd6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34042/0 (socket says 172.21.15.192:34042) 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.377+0000 7f6a7bb92640 1 -- 172.21.15.192:0/1688683616 learned_addr learned my addr 172.21.15.192:0/1688683616 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.378+0000 7f6a7bb92640 1 -- 172.21.15.192:0/1688683616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe6cd72c0 con 0x562fe6cd6860 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.378+0000 7f6a7bb92640 1 --2- 172.21.15.192:0/1688683616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6cd6860 0x562fe6cd6c80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c010 tx=0x7f6a6c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.378+0000 7f69617fa640 1 -- 172.21.15.192:0/1688683616 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c044140 con 0x562fe6cd6860 2024-09-10T05:13:34.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.378+0000 7f69617fa640 1 -- 172.21.15.192:0/1688683616 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6c048020 con 0x562fe6cd6860 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.378+0000 7f6a8040f800 1 -- 172.21.15.192:0/1688683616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fe6cd7af0 con 0x562fe6cd6860 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.378+0000 7f69617fa640 1 -- 172.21.15.192:0/1688683616 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c019ac0 con 0x562fe6cd6860 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.378+0000 7f6a8040f800 1 -- 172.21.15.192:0/1688683616 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fe6cd8090 con 0x562fe6cd6860 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.379+0000 7f69617fa640 1 -- 172.21.15.192:0/1688683616 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6a6c010070 con 0x562fe6cd6860 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.379+0000 7f69617fa640 1 --2- 172.21.15.192:0/1688683616 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f695403c780 0x7f695403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.379+0000 7f69617fa640 1 -- 172.21.15.192:0/1688683616 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6a6c049030 con 0x562fe6cd6860 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.379+0000 7f6a73fff640 1 --2- 172.21.15.192:0/1688683616 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f695403c780 0x7f695403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.379+0000 7f6a8040f800 1 Processor -- start 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.379+0000 7f6a8040f800 1 -- start start 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.379+0000 7f6a73fff640 1 --2- 172.21.15.192:0/1688683616 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f695403c780 0x7f695403ec40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x562fe6cc0370 tx=0x7f6a64005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.379+0000 7f6a8040f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 0x562fe6ce36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.379+0000 7f6a8040f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562fe6cadc90 con 0x562fe6ce32a0 2024-09-10T05:13:34.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.379+0000 7f6a7bb92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 0x562fe6ce36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.380+0000 7f6a7bb92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 0x562fe6ce36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34050/0 (socket says 172.21.15.192:34050) 2024-09-10T05:13:34.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.380+0000 7f6a7bb92640 1 -- 172.21.15.192:0/423270204 learned_addr learned my addr 172.21.15.192:0/423270204 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.380+0000 7f6a7bb92640 1 -- 172.21.15.192:0/423270204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe6ce3c90 con 0x562fe6ce32a0 2024-09-10T05:13:34.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.380+0000 7f6a7bb92640 1 --2- 172.21.15.192:0/423270204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 0x562fe6ce36a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c019c80 tx=0x7f6a6c0265f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e93a0fb6255ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.380+0000 7f695affd640 1 -- 172.21.15.192:0/423270204 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c03e030 con 0x562fe6ce32a0 2024-09-10T05:13:34.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.380+0000 7f695affd640 1 -- 172.21.15.192:0/423270204 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6c01a8e0 con 0x562fe6ce32a0 2024-09-10T05:13:34.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.380+0000 7f695affd640 1 -- 172.21.15.192:0/423270204 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c019470 con 0x562fe6ce32a0 2024-09-10T05:13:34.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.380+0000 7f6a8040f800 1 -- 172.21.15.192:0/423270204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 msgr2=0x562fe6ce36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.380+0000 7f6a8040f800 1 --2- 172.21.15.192:0/423270204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 0x562fe6ce36a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c019c80 tx=0x7f6a6c0265f0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.380+0000 7f6a8040f800 1 -- 172.21.15.192:0/423270204 shutdown_connections 2024-09-10T05:13:34.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.380+0000 7f6a8040f800 1 --2- 172.21.15.192:0/423270204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 0x562fe6ce36a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.380+0000 7f6a8040f800 1 -- 172.21.15.192:0/423270204 >> 172.21.15.192:0/423270204 conn(0x562fe6cdf6a0 msgr2=0x562fe6cdd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.381+0000 7f6a8040f800 1 -- 172.21.15.192:0/423270204 shutdown_connections 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.381+0000 7f6a8040f800 1 -- 172.21.15.192:0/423270204 wait complete. 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.381+0000 7f6a8040f800 1 Processor -- start 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.381+0000 7f6a8040f800 1 -- start start 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.381+0000 7f6a8040f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 0x562fe6cea670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.381+0000 7f6a8040f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562fe6ce4100 con 0x562fe6ce32a0 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.381+0000 7f6a7bb92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 0x562fe6cea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.381+0000 7f6a7bb92640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 0x562fe6cea670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34064/0 (socket says 172.21.15.192:34064) 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.381+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 learned_addr learned my addr 172.21.15.192:0/720149006 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.381+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe6ceabd0 con 0x562fe6ce32a0 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.382+0000 7f6a7bb92640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 0x562fe6cea670 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c019c80 tx=0x7f6a6c052370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.382+0000 7f69597fa640 1 -- 172.21.15.192:0/720149006 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c066070 con 0x562fe6ce32a0 2024-09-10T05:13:34.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.382+0000 7f69597fa640 1 -- 172.21.15.192:0/720149006 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6c026d90 con 0x562fe6ce32a0 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.382+0000 7f69597fa640 1 -- 172.21.15.192:0/720149006 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a6c009860 con 0x562fe6ce32a0 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.382+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fe6ceabd0 con 0x562fe6ce32a0 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.382+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fe6ceabd0 con 0x562fe6ce32a0 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.382+0000 7f69597fa640 1 -- 172.21.15.192:0/720149006 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6a6c069070 con 0x562fe6ce32a0 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.383+0000 7f69597fa640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f694403c730 0x7f694403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.383+0000 7f69597fa640 1 -- 172.21.15.192:0/720149006 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6a6c05d040 con 0x562fe6ce32a0 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.383+0000 7f6a73fff640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f694403c730 0x7f694403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.383+0000 7f6a73fff640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f694403c730 0x7f694403ebf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6a64000c00 tx=0x7f6a64053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.383+0000 7f6a8040f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.383+0000 7f6a8040f800 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562fe6cf5ca0 0x562fe6cf8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.383+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf88b0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.383+0000 7f6a7c393640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562fe6cf5ca0 0x562fe6cf8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a7c393640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562fe6cf5ca0 0x562fe6cf8160 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a8040f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a8040f800 20 realm 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a8040f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf8cc0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a8040f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a8040f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a8040f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9590 con 0x562fe6cf5ca0 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a8040f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a8040f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.384+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cf5ca0 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.385+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.385+0000 7f6a8040f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.385+0000 7f6a8040f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.385+0000 7f6a8040f800 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562fe6cfa690 0x562fe6cfca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.385+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cfd040 con 0x562fe6cfa690 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.385+0000 7f6a7bb92640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562fe6cfa690 0x562fe6cfca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.385+0000 7f6a7bb92640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562fe6cfa690 0x562fe6cfca80 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.385+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.385+0000 7f6a8040f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.385+0000 7f6a8040f800 20 searching for the correct realm 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.386+0000 7f6a8040f800 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562fe6cfeff0 0x562fe6d014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.386+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d01b80 con 0x562fe6cfeff0 2024-09-10T05:13:34.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.386+0000 7f6a73fff640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562fe6cfeff0 0x562fe6d014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.386+0000 7f6a73fff640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562fe6cfeff0 0x562fe6d014b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.386+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.386+0000 7f6a73fff640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6a6405f040 0x7f6a6406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.386+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d01b80 con 0x7f6a6405f040 2024-09-10T05:13:34.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.386+0000 7f6a7c393640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6a6405f040 0x7f6a6406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.387+0000 7f6a7c393640 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6a6405f040 0x7f6a6406b410 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.387+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.387+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfa690 2024-09-10T05:13:34.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.387+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.387+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cf5ca0 2024-09-10T05:13:34.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.387+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.387+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cf5ca0 2024-09-10T05:13:34.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.388+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.388+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfa690 2024-09-10T05:13:34.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.388+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.388+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfa690 2024-09-10T05:13:34.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.388+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.388+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x7f6a6405f040 2024-09-10T05:13:34.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.388+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.388+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfeff0 2024-09-10T05:13:34.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.389+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.389+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cf5ca0 2024-09-10T05:13:34.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.389+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.389+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfa690 2024-09-10T05:13:34.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.389+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.389+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cf5ca0 2024-09-10T05:13:34.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.389+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.389+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x7f6a6405f040 2024-09-10T05:13:34.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.390+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.390+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfeff0 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.390+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.390+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfeff0 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.390+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.390+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfa690 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.390+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.390+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfeff0 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.390+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.390+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfeff0 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.391+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.391+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cf5ca0 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.391+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.391+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cf5ca0 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.391+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.391+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x7f6a6405f040 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.391+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.391+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfeff0 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.392+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.392+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x7f6a6405f040 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.392+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.392+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cf5ca0 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.392+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.392+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfa690 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.392+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.392+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfeff0 2024-09-10T05:13:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.393+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.393+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfa690 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.393+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.393+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x7f6a6405f040 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.393+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.393+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cfeff0 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.393+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.393+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x7f6a6405f040 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x562fe6cf5ca0 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cf9930 con 0x7f6a6405f040 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a8040f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a8040f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a8040f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a8040f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a8040f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a8040f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a8040f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cfd900 con 0x562fe6cf5ca0 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a8040f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a8040f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.394+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cfd900 con 0x562fe6cf5ca0 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cfd900 con 0x7f6a6405f040 2024-09-10T05:13:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 20 zone default found 2024-09-10T05:13:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 4 Realm: () 2024-09-10T05:13:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 20 zonegroup default 2024-09-10T05:13:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6cfe1a0 con 0x562fe6cfa690 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.395+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d039f0 con 0x562fe6cfeff0 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.396+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.396+0000 7f6a8040f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.396+0000 7f6a8040f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.396+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d03d90 con 0x562fe6cfeff0 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.396+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.396+0000 7f6a8040f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.396+0000 7f6a8040f800 20 started sync module instance, tier type = 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.396+0000 7f6a8040f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:34.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.396+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d02e90 con 0x7f6a6405f040 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.397+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.397+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94763735856064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d02e90 con 0x7f6a6405f040 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.397+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d04750 con 0x562fe6cf5ca0 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.398+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94763735856064] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.398+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.398+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94763735860352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d02e90 con 0x562fe6cf5ca0 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.398+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d051a0 con 0x562fe6cfeff0 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.399+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94763735860352] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.400+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.400+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94763735853536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d02e00 con 0x562fe6cfeff0 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.400+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d06060 con 0x7f6a6405f040 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.401+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94763735853536] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.401+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.401+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94763735866288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d06480 con 0x7f6a6405f040 2024-09-10T05:13:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.401+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d06e40 con 0x562fe6cf5ca0 2024-09-10T05:13:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.402+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.402+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94763735869840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d07260 con 0x562fe6cf5ca0 2024-09-10T05:13:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.402+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d07cc0 con 0x562fe6cfa690 2024-09-10T05:13:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.402+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94763735866288] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.403+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.403+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94763735867344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d080b0 con 0x562fe6cfa690 2024-09-10T05:13:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.403+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d08ab0 con 0x562fe6cfa690 2024-09-10T05:13:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.403+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94763735869840] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.404+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94763735867344] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.404+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.404+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94763735870896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d08ed0 con 0x562fe6cfa690 2024-09-10T05:13:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.404+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d09720 con 0x562fe6cfa690 2024-09-10T05:13:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.405+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94763735870896] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.406+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.406+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94763735880304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d09b40 con 0x562fe6cfa690 2024-09-10T05:13:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.406+0000 7f6a8040f800 20 add_watcher() i=0 2024-09-10T05:13:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.406+0000 7f6a8040f800 20 add_watcher() i=1 2024-09-10T05:13:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.406+0000 7f6a8040f800 20 add_watcher() i=2 2024-09-10T05:13:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.406+0000 7f6a8040f800 20 add_watcher() i=3 2024-09-10T05:13:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.406+0000 7f6a8040f800 20 add_watcher() i=4 2024-09-10T05:13:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.406+0000 7f6a8040f800 20 add_watcher() i=5 2024-09-10T05:13:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.406+0000 7f6a8040f800 20 add_watcher() i=6 2024-09-10T05:13:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.407+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94763735880304] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.407+0000 7f6a8040f800 20 add_watcher() i=7 2024-09-10T05:13:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.407+0000 7f6a8040f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.407+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d0cea0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.408+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.408+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94763735894176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d09cb0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.409+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94763735894176] v37'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.409+0000 7f6931fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.409+0000 7f6a8040f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.409+0000 7f6a8040f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.409+0000 7f6a8040f800 5 note: GC not initialized 2024-09-10T05:13:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.409+0000 7f6930fe1640 20 reqs_thread_entry: start 2024-09-10T05:13:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.409+0000 7f6a8040f800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.409+0000 7f6a8040f800 20 Filter name: none 2024-09-10T05:13:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.409+0000 7f68aa7fc640 20 reqs_thread_entry: start 2024-09-10T05:13:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.410+0000 7f6a8040f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.410+0000 7f6a8040f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.410+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d3ffc0 con 0x562fe6cfa690 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.410+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.410+0000 7f6a8040f800 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.410+0000 7f6a8040f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.410+0000 7f6a8040f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.410+0000 7f6a8040f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.410+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d46440 con 0x562fe6cfa690 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.411+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v37'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.411+0000 7f6a8040f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.411+0000 7f6a8040f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.411+0000 7f6a8040f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:13:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.411+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94763736129024 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d41aa0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.412+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== watch-notify(notify (1) cookie 94763735869840 notify 158913789976 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f6a74026410 con 0x562fe6cf5ca0 2024-09-10T05:13:34.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.412+0000 7f695affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789976 cookie 94763735869840 notifier 4882 bl.length()=666 2024-09-10T05:13:34.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.412+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 notify.4 [notify cookie 94763736129024 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.412+0000 7f695affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:34.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.412+0000 7f695affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.412+0000 7f695affd640 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f6940003ea0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.412+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.412+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== watch-notify(notify_complete (2) cookie 94763736129024 notify 158913789976 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6a74005040 con 0x562fe6cf5ca0 2024-09-10T05:13:34.423 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:13:33.468641Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:13:33.468623Z","tags":[],"group_ids":[]} 2024-09-10T05:13:34.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.413+0000 7f6931fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.413+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94763735894176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d3de50 con 0x562fe6cf5ca0 2024-09-10T05:13:34.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.414+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94763735894176] v37'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.414+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94763735856064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d3de50 con 0x7f6a6405f040 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.415+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94763735856064] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.415+0000 7f6a8040f800 20 remove_watcher() i=0 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.415+0000 7f6a8040f800 2 removed watcher, disabling cache 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.415+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94763735860352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d3de50 con 0x562fe6cf5ca0 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.416+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94763735860352] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.416+0000 7f6a8040f800 20 remove_watcher() i=1 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.416+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94763735853536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d3de50 con 0x562fe6cfeff0 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.417+0000 7f6a73fff640 1 -- 172.21.15.192:0/720149006 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94763735853536] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6407c040 con 0x562fe6cfeff0 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.417+0000 7f6a8040f800 20 remove_watcher() i=2 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.417+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94763735866288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d3de50 con 0x7f6a6405f040 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.418+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94763735866288] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x7f6a6405f040 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.418+0000 7f6a8040f800 20 remove_watcher() i=3 2024-09-10T05:13:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.418+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94763735869840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d3de50 con 0x562fe6cf5ca0 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.419+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94763735869840] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a7400a4d0 con 0x562fe6cf5ca0 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.419+0000 7f6a8040f800 20 remove_watcher() i=4 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.419+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94763735867344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d3de50 con 0x562fe6cfa690 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.420+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94763735867344] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.420+0000 7f6a8040f800 20 remove_watcher() i=5 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.420+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94763735870896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d3de50 con 0x562fe6cfa690 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.421+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94763735870896] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.421+0000 7f6a8040f800 20 remove_watcher() i=6 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.421+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94763735880304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562fe6d3de50 con 0x562fe6cfa690 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a7bb92640 1 -- 172.21.15.192:0/720149006 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94763735880304] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c068030 con 0x562fe6cfa690 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 20 remove_watcher() i=7 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562fe6cfa690 msgr2=0x562fe6cfca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562fe6cfa690 0x562fe6cfca80 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562fe6cf5ca0 msgr2=0x562fe6cf8160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562fe6cf5ca0 0x562fe6cf8160 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6a6405f040 msgr2=0x7f6a6406b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6a6405f040 0x7f6a6406b410 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562fe6cfeff0 msgr2=0x562fe6d014b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x562fe6cfeff0 0x562fe6d014b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f694403c730 msgr2=0x7f694403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f694403c730 0x7f694403ebf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6a64000c00 tx=0x7f6a64053000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 msgr2=0x562fe6cea670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 --2- 172.21.15.192:0/720149006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6ce32a0 0x562fe6cea670 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c019c80 tx=0x7f6a6c052370 comp rx=0 tx=0).stop 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 reap_dead start 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a7c393640 1 -- 172.21.15.192:0/720149006 reap_dead start 2024-09-10T05:13:34.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 shutdown_connections 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 >> 172.21.15.192:0/720149006 conn(0x562fe6cdf6a0 msgr2=0x562fe6cdd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 shutdown_connections 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 -- 172.21.15.192:0/720149006 wait complete. 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 -- 172.21.15.192:0/1688683616 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f695403c780 msgr2=0x7f695403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 --2- 172.21.15.192:0/1688683616 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f695403c780 0x7f695403ec40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x562fe6cc0370 tx=0x7f6a64005a00 comp rx=0 tx=0).stop 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 -- 172.21.15.192:0/1688683616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6cd6860 msgr2=0x562fe6cd6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.422+0000 7f6a8040f800 1 --2- 172.21.15.192:0/1688683616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6cd6860 0x562fe6cd6c80 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c010 tx=0x7f6a6c00ed80 comp rx=0 tx=0).stop 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/1688683616 shutdown_connections 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 --2- 172.21.15.192:0/1688683616 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f695403c780 0x7f695403ec40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 --2- 172.21.15.192:0/1688683616 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6cd6860 0x562fe6cd6c80 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/1688683616 >> 172.21.15.192:0/1688683616 conn(0x562fe6ccac10 msgr2=0x562fe6ccaff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/1688683616 shutdown_connections 2024-09-10T05:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/1688683616 wait complete. 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562fe6cc21d0 msgr2=0x562fe6cc45c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x562fe6cc21d0 0x562fe6cc45c0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562fe6cbd5d0 msgr2=0x562fe6cbf9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x562fe6cbd5d0 0x562fe6cbf9c0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562fe6cc60d0 msgr2=0x562fe6cc84c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x562fe6cc60d0 0x562fe6cc84c0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f696403c920 msgr2=0x7f696403ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f696403c920 0x7f696403ede0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6a64057000 tx=0x7f6a64052000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbe990 msgr2=0x562fe6cb0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 --2- 172.21.15.192:0/3822144711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562fe6bbe990 0x562fe6cb0ee0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0012f0 tx=0x7f6a6c000ed0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a7c393640 1 -- 172.21.15.192:0/3822144711 reap_dead start 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 shutdown_connections 2024-09-10T05:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 >> 172.21.15.192:0/3822144711 conn(0x562fe6bb8930 msgr2=0x562fe6b22120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 shutdown_connections 2024-09-10T05:13:34.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.423+0000 7f6a8040f800 1 -- 172.21.15.192:0/3822144711 wait complete. 2024-09-10T05:13:34.435 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:34.435 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:34.435 ERROR:root:0 2024-09-10T05:13:34.435 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:34.440 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:34.440 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-10T05:13:34.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-10T05:13:34.440 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-10T05:13:34.486 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:34.486 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:34.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.486+0000 7f6043298800 1 Processor -- start 2024-09-10T05:13:34.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.486+0000 7f6043298800 1 -- start start 2024-09-10T05:13:34.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.487+0000 7f6043298800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x560f5361e790 0x560f536266d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.487+0000 7f6043298800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560f534c9e40 con 0x560f5361e240 2024-09-10T05:13:34.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.487+0000 7f6043298800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x560f53494680 con 0x560f5361e790 2024-09-10T05:13:34.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.487+0000 7f6040581640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x560f5361e790 0x560f536266d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.487+0000 7f6040581640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x560f5361e790 0x560f536266d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34068/0 (socket says 172.21.15.192:34068) 2024-09-10T05:13:34.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.487+0000 7f6040581640 1 -- 172.21.15.192:0/2318003503 learned_addr learned my addr 172.21.15.192:0/2318003503 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.487+0000 7f6040d82640 1 --1- 172.21.15.192:0/2318003503 >> v1:172.21.15.139:6789/0 conn(0x560f5361e240 0x560f53622ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46574/0 (socket says 172.21.15.192:46574) 2024-09-10T05:13:34.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.487+0000 7f6040581640 1 -- 172.21.15.192:0/2318003503 >> v1:172.21.15.139:6789/0 conn(0x560f5361e240 legacy=0x560f53622ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.487+0000 7f603fd80640 1 -- 172.21.15.192:0/2318003503 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471291349 0 0) 0x560f534c9e40 con 0x560f5361e240 2024-09-10T05:13:34.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.487+0000 7f6040581640 1 -- 172.21.15.192:0/2318003503 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f534b06b0 con 0x560f5361e790 2024-09-10T05:13:34.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.489+0000 7f6040581640 1 --2- 172.21.15.192:0/2318003503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e790 0x560f536266d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f603400a520 tx=0x7f6034045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a632303bbc67f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.489+0000 7f603fd80640 1 -- 172.21.15.192:0/2318003503 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6034055070 con 0x560f5361e790 2024-09-10T05:13:34.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.489+0000 7f603fd80640 1 -- 172.21.15.192:0/2318003503 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60340515b0 con 0x560f5361e790 2024-09-10T05:13:34.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.489+0000 7f603fd80640 1 -- 172.21.15.192:0/2318003503 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60340518d0 con 0x560f5361e790 2024-09-10T05:13:34.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.490+0000 7f6043298800 1 -- 172.21.15.192:0/2318003503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e790 msgr2=0x560f536266d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.490+0000 7f6043298800 1 --2- 172.21.15.192:0/2318003503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e790 0x560f536266d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f603400a520 tx=0x7f6034045ba0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.490+0000 7f6043298800 1 -- 172.21.15.192:0/2318003503 shutdown_connections 2024-09-10T05:13:34.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.490+0000 7f6043298800 1 --2- 172.21.15.192:0/2318003503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e790 0x560f536266d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.490+0000 7f6043298800 1 -- 172.21.15.192:0/2318003503 >> 172.21.15.192:0/2318003503 conn(0x560f53619930 msgr2=0x560f5361bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.490+0000 7f6043298800 1 -- 172.21.15.192:0/2318003503 shutdown_connections 2024-09-10T05:13:34.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.490+0000 7f6043298800 1 -- 172.21.15.192:0/2318003503 wait complete. 2024-09-10T05:13:34.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.503+0000 7f6043298800 1 Processor -- start 2024-09-10T05:13:34.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.503+0000 7f6043298800 1 -- start start 2024-09-10T05:13:34.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.504+0000 7f6043298800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 0x560f5370f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.504+0000 7f6043298800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560f534b8dd0 con 0x560f5361e240 2024-09-10T05:13:34.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.504+0000 7f6040d82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 0x560f5370f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.504+0000 7f6040d82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 0x560f5370f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34078/0 (socket says 172.21.15.192:34078) 2024-09-10T05:13:34.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.504+0000 7f6040d82640 1 -- 172.21.15.192:0/2480464224 learned_addr learned my addr 172.21.15.192:0/2480464224 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.504+0000 7f6040d82640 1 -- 172.21.15.192:0/2480464224 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f534d1e10 con 0x560f5361e240 2024-09-10T05:13:34.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.504+0000 7f6040d82640 1 --2- 172.21.15.192:0/2480464224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 0x560f5370f560 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6030006f70 tx=0x7f6030001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a2cfcb7966f856 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.504+0000 7f5f2ee0d640 1 -- 172.21.15.192:0/2480464224 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6030003450 con 0x560f5361e240 2024-09-10T05:13:34.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.505+0000 7f5f2ee0d640 1 -- 172.21.15.192:0/2480464224 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6030003610 con 0x560f5361e240 2024-09-10T05:13:34.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.505+0000 7f5f2ee0d640 1 -- 172.21.15.192:0/2480464224 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60300039b0 con 0x560f5361e240 2024-09-10T05:13:34.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.505+0000 7f6043298800 1 -- 172.21.15.192:0/2480464224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 msgr2=0x560f5370f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.505+0000 7f6043298800 1 --2- 172.21.15.192:0/2480464224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 0x560f5370f560 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6030006f70 tx=0x7f6030001b00 comp rx=0 tx=0).stop 2024-09-10T05:13:34.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.505+0000 7f6043298800 1 -- 172.21.15.192:0/2480464224 shutdown_connections 2024-09-10T05:13:34.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.505+0000 7f6043298800 1 --2- 172.21.15.192:0/2480464224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 0x560f5370f560 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.505+0000 7f6043298800 1 -- 172.21.15.192:0/2480464224 >> 172.21.15.192:0/2480464224 conn(0x560f53619930 msgr2=0x560f5370aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.505+0000 7f6043298800 1 -- 172.21.15.192:0/2480464224 shutdown_connections 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.505+0000 7f6043298800 1 -- 172.21.15.192:0/2480464224 wait complete. 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.506+0000 7f6043298800 1 Processor -- start 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.506+0000 7f6043298800 1 -- start start 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.506+0000 7f6043298800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 0x560f536205c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.506+0000 7f6043298800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560f53627050 con 0x560f5361e240 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.506+0000 7f6040d82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 0x560f536205c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.506+0000 7f6040d82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 0x560f536205c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34084/0 (socket says 172.21.15.192:34084) 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.506+0000 7f6040d82640 1 -- 172.21.15.192:0/1840639443 learned_addr learned my addr 172.21.15.192:0/1840639443 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.506+0000 7f6040d82640 1 -- 172.21.15.192:0/1840639443 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f53620b20 con 0x560f5361e240 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.506+0000 7f6040d82640 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 0x560f536205c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6030001330 tx=0x7f6030001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.507+0000 7f5f2d60a640 1 -- 172.21.15.192:0/1840639443 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6030014a10 con 0x560f5361e240 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.507+0000 7f5f2d60a640 1 -- 172.21.15.192:0/1840639443 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6030014bb0 con 0x560f5361e240 2024-09-10T05:13:34.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.507+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f5361eed0 con 0x560f5361e240 2024-09-10T05:13:34.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.507+0000 7f5f2d60a640 1 -- 172.21.15.192:0/1840639443 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f603001e3f0 con 0x560f5361e240 2024-09-10T05:13:34.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.507+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f5361f490 con 0x560f5361e240 2024-09-10T05:13:34.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.507+0000 7f5f2d60a640 1 -- 172.21.15.192:0/1840639443 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6030010070 con 0x560f5361e240 2024-09-10T05:13:34.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.508+0000 7f5f2d60a640 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f2803c780 0x7f5f2803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.508+0000 7f5f2d60a640 1 -- 172.21.15.192:0/1840639443 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6030018070 con 0x560f5361e240 2024-09-10T05:13:34.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.508+0000 7f6040581640 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f2803c780 0x7f5f2803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.508+0000 7f6043298800 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f5361e790 0x560f537203a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.508+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f537208e0 con 0x560f5361e790 2024-09-10T05:13:34.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.508+0000 7f6041583640 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f5361e790 0x560f537203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.508+0000 7f6040581640 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f2803c780 0x7f5f2803ec40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6034057000 tx=0x7f6034052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.508+0000 7f6041583640 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f5361e790 0x560f537203a0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.509+0000 7f6041583640 1 -- 172.21.15.192:0/1840639443 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60380083e0 con 0x560f5361e790 2024-09-10T05:13:34.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.509+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f5361f950 con 0x560f5361e790 2024-09-10T05:13:34.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.509+0000 7f6041583640 1 -- 172.21.15.192:0/1840639443 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f60380083e0 con 0x560f5361e790 2024-09-10T05:13:34.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.509+0000 7f6043298800 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f53722bb0 0x560f53724fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.509+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f53725640 con 0x560f53722bb0 2024-09-10T05:13:34.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.509+0000 7f6040d82640 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f53722bb0 0x560f53724fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.509+0000 7f6040d82640 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f53722bb0 0x560f53724fa0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.510+0000 7f6040d82640 1 -- 172.21.15.192:0/1840639443 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f603001b070 con 0x560f53722bb0 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.510+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f53721a50 con 0x560f5361e790 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.510+0000 7f6041583640 1 -- 172.21.15.192:0/1840639443 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f60380083e0 con 0x560f5361e790 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.510+0000 7f6043298800 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560f53726aa0 0x560f53728e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.510+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f537295d0 con 0x560f53726aa0 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.510+0000 7f6040581640 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560f53726aa0 0x560f53728e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.510+0000 7f6040581640 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560f53726aa0 0x560f53728e90 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.511+0000 7f6040581640 1 -- 172.21.15.192:0/1840639443 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6034057030 con 0x560f53726aa0 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.511+0000 7f6043298800 1 Processor -- start 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.511+0000 7f6043298800 1 -- start start 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.511+0000 7f6043298800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53737230 0x560f53737650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.511+0000 7f6043298800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560f53516a00 con 0x560f53737230 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.511+0000 7f6040d82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53737230 0x560f53737650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.511+0000 7f6040d82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53737230 0x560f53737650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34088/0 (socket says 172.21.15.192:34088) 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.511+0000 7f6040d82640 1 -- 172.21.15.192:0/1706018963 learned_addr learned my addr 172.21.15.192:0/1706018963 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.512+0000 7f6040d82640 1 -- 172.21.15.192:0/1706018963 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f53737c90 con 0x560f53737230 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.512+0000 7f6040d82640 1 --2- 172.21.15.192:0/1706018963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53737230 0x560f53737650 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6030010f90 tx=0x7f6030010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.512+0000 7f5f267fc640 1 -- 172.21.15.192:0/1706018963 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6030028ce0 con 0x560f53737230 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.512+0000 7f5f267fc640 1 -- 172.21.15.192:0/1706018963 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6030039020 con 0x560f53737230 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.512+0000 7f5f267fc640 1 -- 172.21.15.192:0/1706018963 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f603004b000 con 0x560f53737230 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.512+0000 7f6043298800 1 -- 172.21.15.192:0/1706018963 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f537384c0 con 0x560f53737230 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.512+0000 7f6043298800 1 -- 172.21.15.192:0/1706018963 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f53738a60 con 0x560f53737230 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.513+0000 7f5f267fc640 1 -- 172.21.15.192:0/1706018963 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f603004b1a0 con 0x560f53737230 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.513+0000 7f5f267fc640 1 --2- 172.21.15.192:0/1706018963 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f1803c920 0x7f5f1803ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.513+0000 7f5f267fc640 1 -- 172.21.15.192:0/1706018963 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f603003a030 con 0x560f53737230 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.513+0000 7f6040581640 1 --2- 172.21.15.192:0/1706018963 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f1803c920 0x7f5f1803ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.513+0000 7f6043298800 1 Processor -- start 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.513+0000 7f6043298800 1 -- start start 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.513+0000 7f6040581640 1 --2- 172.21.15.192:0/1706018963 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f1803c920 0x7f5f1803ede0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x560f53721df0 tx=0x7f6034005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.513+0000 7f6043298800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 0x560f537440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.513+0000 7f6043298800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560f5370fdb0 con 0x560f53743cd0 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.513+0000 7f6040d82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 0x560f537440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.514+0000 7f6040d82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 0x560f537440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34104/0 (socket says 172.21.15.192:34104) 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.514+0000 7f6040d82640 1 -- 172.21.15.192:0/1497313274 learned_addr learned my addr 172.21.15.192:0/1497313274 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.514+0000 7f6040d82640 1 -- 172.21.15.192:0/1497313274 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f537446c0 con 0x560f53743cd0 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.514+0000 7f6040d82640 1 --2- 172.21.15.192:0/1497313274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 0x560f537440d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f603004dfe0 tx=0x7f60300117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb949969239a6f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.514+0000 7f5f17fff640 1 -- 172.21.15.192:0/1497313274 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6030038070 con 0x560f53743cd0 2024-09-10T05:13:34.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.514+0000 7f5f17fff640 1 -- 172.21.15.192:0/1497313274 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6030047990 con 0x560f53743cd0 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.514+0000 7f5f17fff640 1 -- 172.21.15.192:0/1497313274 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60300150c0 con 0x560f53743cd0 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.514+0000 7f6043298800 1 -- 172.21.15.192:0/1497313274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 msgr2=0x560f537440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.514+0000 7f6043298800 1 --2- 172.21.15.192:0/1497313274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 0x560f537440d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f603004dfe0 tx=0x7f60300117b0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.515+0000 7f6043298800 1 -- 172.21.15.192:0/1497313274 shutdown_connections 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.515+0000 7f6043298800 1 --2- 172.21.15.192:0/1497313274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 0x560f537440d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.515+0000 7f6043298800 1 -- 172.21.15.192:0/1497313274 >> 172.21.15.192:0/1497313274 conn(0x560f537400d0 msgr2=0x560f5373e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.515+0000 7f6043298800 1 -- 172.21.15.192:0/1497313274 shutdown_connections 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.515+0000 7f6043298800 1 -- 172.21.15.192:0/1497313274 wait complete. 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.515+0000 7f6043298800 1 Processor -- start 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.515+0000 7f6043298800 1 -- start start 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.515+0000 7f6043298800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 0x560f5374b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.515+0000 7f6043298800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560f53744b30 con 0x560f53743cd0 2024-09-10T05:13:34.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.515+0000 7f6040d82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 0x560f5374b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.515+0000 7f6040d82640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 0x560f5374b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34110/0 (socket says 172.21.15.192:34110) 2024-09-10T05:13:34.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.515+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 learned_addr learned my addr 172.21.15.192:0/1999841302 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.516+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f5374b690 con 0x560f53743cd0 2024-09-10T05:13:34.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.516+0000 7f6040d82640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 0x560f5374b130 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f603004dfe0 tx=0x7f6030038e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.516+0000 7f5f167fc640 1 -- 172.21.15.192:0/1999841302 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6030047e20 con 0x560f53743cd0 2024-09-10T05:13:34.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.516+0000 7f5f167fc640 1 -- 172.21.15.192:0/1999841302 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f603006d070 con 0x560f53743cd0 2024-09-10T05:13:34.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.516+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f5374b690 con 0x560f53743cd0 2024-09-10T05:13:34.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.516+0000 7f5f167fc640 1 -- 172.21.15.192:0/1999841302 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6030048b90 con 0x560f53743cd0 2024-09-10T05:13:34.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.516+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f5374b690 con 0x560f53743cd0 2024-09-10T05:13:34.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.517+0000 7f5f167fc640 1 -- 172.21.15.192:0/1999841302 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6030064040 con 0x560f53743cd0 2024-09-10T05:13:34.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.517+0000 7f5f167fc640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f0c03c780 0x7f5f0c03ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.517+0000 7f5f167fc640 1 -- 172.21.15.192:0/1999841302 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6030062020 con 0x560f53743cd0 2024-09-10T05:13:34.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.518+0000 7f6040581640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f0c03c780 0x7f5f0c03ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.518+0000 7f6040581640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f0c03c780 0x7f5f0c03ec40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6034000c00 tx=0x7f6034053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.518+0000 7f6043298800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.518+0000 7f6043298800 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f53756670 0x560f53758b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.518+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f53759280 con 0x560f53756670 2024-09-10T05:13:34.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.518+0000 7f6041583640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f53756670 0x560f53758b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.518+0000 7f6041583640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f53756670 0x560f53758b30 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60380083e0 con 0x560f53756670 2024-09-10T05:13:34.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 20 realm 2024-09-10T05:13:34.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f53759690 con 0x560f53756670 2024-09-10T05:13:34.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60380083e0 con 0x560f53756670 2024-09-10T05:13:34.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:34.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f53756670 2024-09-10T05:13:34.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60380083e0 con 0x560f53756670 2024-09-10T05:13:34.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f5375a300 con 0x560f53756670 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f60380083e0 con 0x560f53756670 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f5375acc0 0x560f5375d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.519+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f5375d700 con 0x560f5375acc0 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.520+0000 7f6040d82640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f5375acc0 0x560f5375d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.520+0000 7f6040d82640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f5375acc0 0x560f5375d0b0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.520+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.520+0000 7f6043298800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.520+0000 7f6043298800 20 searching for the correct realm 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.520+0000 7f6043298800 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560f5375f690 0x560f53761b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.520+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f537621d0 con 0x560f5375f690 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.520+0000 7f6040581640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560f5375f690 0x560f53761b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.520+0000 7f6040581640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560f5375f690 0x560f53761b50 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.521+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.521+0000 7f6040581640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6034069040 0x7f603406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.521+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f537621d0 con 0x7f6034069040 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.521+0000 7f6041583640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6034069040 0x7f603406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.521+0000 7f6041583640 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6034069040 0x7f603406a940 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.521+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f60380083e0 con 0x7f6034069040 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.521+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375acc0 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.522+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.522+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f53756670 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.522+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60380083e0 con 0x560f53756670 2024-09-10T05:13:34.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.522+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f53756670 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.522+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6038026040 con 0x560f53756670 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.522+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375acc0 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.522+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.522+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375acc0 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.523+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.523+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x7f6034069040 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.523+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6038026040 con 0x7f6034069040 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.523+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375f690 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.523+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.523+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f53756670 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.523+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6038026040 con 0x560f53756670 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.523+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375acc0 2024-09-10T05:13:34.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.524+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.524+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f53756670 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.524+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6038026040 con 0x560f53756670 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.524+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x7f6034069040 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.524+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6038026040 con 0x7f6034069040 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.524+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375f690 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.524+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.524+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375f690 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.525+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.525+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375acc0 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.525+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.525+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375f690 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.525+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.525+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375f690 2024-09-10T05:13:34.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.525+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.525+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f53756670 2024-09-10T05:13:34.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.525+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6038026040 con 0x560f53756670 2024-09-10T05:13:34.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.526+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f53756670 2024-09-10T05:13:34.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.526+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6038026040 con 0x560f53756670 2024-09-10T05:13:34.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.526+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x7f6034069040 2024-09-10T05:13:34.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.526+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6038026040 con 0x7f6034069040 2024-09-10T05:13:34.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.526+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375f690 2024-09-10T05:13:34.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.526+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.526+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x7f6034069040 2024-09-10T05:13:34.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.526+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6038026040 con 0x7f6034069040 2024-09-10T05:13:34.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.526+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f53756670 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.527+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.527+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375acc0 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.527+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.527+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375f690 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.527+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.527+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375acc0 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.528+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.528+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x7f6034069040 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.528+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6038035040 con 0x7f6034069040 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.528+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f5375f690 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.528+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.528+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x7f6034069040 2024-09-10T05:13:34.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.528+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6038035040 con 0x7f6034069040 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.528+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f603803a040 con 0x560f53756670 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.528+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.528+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f603803a040 con 0x7f6034069040 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6038035040 con 0x7f6034069040 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f53756670 2024-09-10T05:13:34.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x560f53756670 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f53759f60 con 0x7f6034069040 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6038035040 con 0x7f6034069040 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 zone default found 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 4 Realm: () 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:34.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 zonegroup default 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.529+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f5375ebf0 con 0x560f5375acc0 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6043298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6043298800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f53763b10 con 0x560f5375f690 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6043298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6043298800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f53763eb0 con 0x560f5375f690 2024-09-10T05:13:34.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6043298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6043298800 20 started sync module instance, tier type = 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6043298800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.530+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53762fa0 con 0x7f6034069040 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.531+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x7f6034069040 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.531+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94623824753856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53762fa0 con 0x7f6034069040 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.531+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53764920 con 0x560f53756670 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.532+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94623824753856] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x7f6034069040 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.533+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.533+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94623824757776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53762fa0 con 0x560f53756670 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.533+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f537653e0 con 0x560f5375f690 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.534+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94623824757776] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.534+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.534+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94623824751344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53762f10 con 0x560f5375f690 2024-09-10T05:13:34.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.534+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f537662a0 con 0x7f6034069040 2024-09-10T05:13:34.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.535+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94623824751344] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.535+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x7f6034069040 2024-09-10T05:13:34.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.535+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94623824764400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53766210 con 0x7f6034069040 2024-09-10T05:13:34.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.535+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53767060 con 0x560f53756670 2024-09-10T05:13:34.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.536+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94623824764400] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x7f6034069040 2024-09-10T05:13:34.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.536+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.536+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94623824766464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53767060 con 0x560f53756670 2024-09-10T05:13:34.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.536+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53767a70 con 0x560f5375acc0 2024-09-10T05:13:34.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.537+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.537+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94623824766464] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.537+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94623824770496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f537679e0 con 0x560f5375acc0 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.537+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53766a20 con 0x560f5375acc0 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.538+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94623824770496] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.538+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.538+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94623824767520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53768530 con 0x560f5375acc0 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.538+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53768ef0 con 0x560f5375acc0 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.539+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94623824767520] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.539+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.539+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94623824772704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53768ef0 con 0x560f5375acc0 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.539+0000 7f6043298800 20 add_watcher() i=0 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.539+0000 7f6043298800 20 add_watcher() i=1 2024-09-10T05:13:34.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.539+0000 7f6043298800 20 add_watcher() i=2 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.539+0000 7f6043298800 20 add_watcher() i=3 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.539+0000 7f6043298800 20 add_watcher() i=4 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.539+0000 7f6043298800 20 add_watcher() i=5 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.539+0000 7f6043298800 20 add_watcher() i=6 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.540+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94623824772704] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.540+0000 7f6043298800 20 add_watcher() i=7 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.540+0000 7f6043298800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.540+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f5376c2f0 con 0x560f53756670 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.541+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.541+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94623824776208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53769810 con 0x560f53756670 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.542+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94623824776208] v37'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.542+0000 7f5ef6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.542+0000 7f6043298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.542+0000 7f6043298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.542+0000 7f6043298800 5 note: GC not initialized 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.542+0000 7f5ef5fe3640 20 reqs_thread_entry: start 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.542+0000 7f6043298800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.542+0000 7f6043298800 20 Filter name: none 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.542+0000 7f5e677fe640 20 reqs_thread_entry: start 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.542+0000 7f6043298800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.542+0000 7f6043298800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.542+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f5379f3a0 con 0x560f5375acc0 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.543+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.543+0000 7f6043298800 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.543+0000 7f6043298800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:13:34.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.543+0000 7f6043298800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.543+0000 7f6043298800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.543+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f537a5900 con 0x560f5375acc0 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.544+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v37'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.545+0000 7f6043298800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.545+0000 7f6043298800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.545+0000 7f6043298800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.545+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94623825023680 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f537a0f20 con 0x560f53756670 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.545+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== watch-notify(notify (1) cookie 94623824766464 notify 158913789977 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f6038010040 con 0x560f53756670 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.545+0000 7f5f17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789977 cookie 94623824766464 notifier 4889 bl.length()=666 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.545+0000 7f5f17fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.545+0000 7f5f17fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.545+0000 7f5f17fff640 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5f04003ea0 con 0x560f53756670 2024-09-10T05:13:34.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.545+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 notify.4 [notify cookie 94623825023680 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.545+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.545+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== watch-notify(notify_complete (2) cookie 94623825023680 notify 158913789977 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f603800ad80 con 0x560f53756670 2024-09-10T05:13:34.557 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:13:33.468641Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:13:33.468623Z","tags":[],"group_ids":[]} 2024-09-10T05:13:34.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.546+0000 7f5ef6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.546+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94623824776208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f5379d230 con 0x560f53756670 2024-09-10T05:13:34.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.547+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94623824776208] v37'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.547+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94623824753856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f5379d230 con 0x7f6034069040 2024-09-10T05:13:34.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.548+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94623824753856] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x7f6034069040 2024-09-10T05:13:34.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.548+0000 7f6043298800 20 remove_watcher() i=0 2024-09-10T05:13:34.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.548+0000 7f6043298800 2 removed watcher, disabling cache 2024-09-10T05:13:34.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.548+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94623824757776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f5379d230 con 0x560f53756670 2024-09-10T05:13:34.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.549+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94623824757776] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.549+0000 7f6043298800 20 remove_watcher() i=1 2024-09-10T05:13:34.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.549+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94623824751344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f5379d230 con 0x560f5375f690 2024-09-10T05:13:34.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.550+0000 7f6040581640 1 -- 172.21.15.192:0/1999841302 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94623824751344] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6034057030 con 0x560f5375f690 2024-09-10T05:13:34.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.550+0000 7f6043298800 20 remove_watcher() i=2 2024-09-10T05:13:34.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.550+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94623824764400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53762af0 con 0x7f6034069040 2024-09-10T05:13:34.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.551+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94623824764400] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x7f6034069040 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.551+0000 7f6043298800 20 remove_watcher() i=3 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.551+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94623824766464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53762af0 con 0x560f53756670 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.552+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94623824766464] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6038035040 con 0x560f53756670 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.552+0000 7f6043298800 20 remove_watcher() i=4 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.552+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94623824770496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53766600 con 0x560f5375acc0 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.553+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94623824770496] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.553+0000 7f6043298800 20 remove_watcher() i=5 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.553+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94623824767520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f53762af0 con 0x560f5375acc0 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.554+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94623824767520] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.554+0000 7f6043298800 20 remove_watcher() i=6 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.554+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94623824772704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f537675c0 con 0x560f5375acc0 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6040d82640 1 -- 172.21.15.192:0/1999841302 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94623824772704] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f603001b070 con 0x560f5375acc0 2024-09-10T05:13:34.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 20 remove_watcher() i=7 2024-09-10T05:13:34.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f5375acc0 msgr2=0x560f5375d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f5375acc0 0x560f5375d0b0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f53756670 msgr2=0x560f53758b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f53756670 0x560f53758b30 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6034069040 msgr2=0x7f603406a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f6034069040 0x7f603406a940 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560f5375f690 msgr2=0x560f53761b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x560f5375f690 0x560f53761b50 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f0c03c780 msgr2=0x7f5f0c03ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f0c03c780 0x7f5f0c03ec40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6034000c00 tx=0x7f6034053000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 msgr2=0x560f5374b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 --2- 172.21.15.192:0/1999841302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53743cd0 0x560f5374b130 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f603004dfe0 tx=0x7f6030038e80 comp rx=0 tx=0).stop 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 reap_dead start 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6041583640 1 -- 172.21.15.192:0/1999841302 reap_dead start 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 shutdown_connections 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 >> 172.21.15.192:0/1999841302 conn(0x560f537400d0 msgr2=0x560f5373e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 shutdown_connections 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.555+0000 7f6043298800 1 -- 172.21.15.192:0/1999841302 wait complete. 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1706018963 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f1803c920 msgr2=0x7f5f1803ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 --2- 172.21.15.192:0/1706018963 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f1803c920 0x7f5f1803ede0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x560f53721df0 tx=0x7f6034005ac0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1706018963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53737230 msgr2=0x560f53737650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 --2- 172.21.15.192:0/1706018963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53737230 0x560f53737650 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6030010f90 tx=0x7f6030010ab0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1706018963 shutdown_connections 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 --2- 172.21.15.192:0/1706018963 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f1803c920 0x7f5f1803ede0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 --2- 172.21.15.192:0/1706018963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f53737230 0x560f53737650 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1706018963 >> 172.21.15.192:0/1706018963 conn(0x560f5372b5e0 msgr2=0x560f5372b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1706018963 shutdown_connections 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1706018963 wait complete. 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f53722bb0 msgr2=0x560f53724fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x560f53722bb0 0x560f53724fa0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f5361e790 msgr2=0x560f537203a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x560f5361e790 0x560f537203a0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560f53726aa0 msgr2=0x560f53728e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x560f53726aa0 0x560f53728e90 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f2803c780 msgr2=0x7f5f2803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5f2803c780 0x7f5f2803ec40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6034057000 tx=0x7f6034052000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 msgr2=0x560f536205c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 --2- 172.21.15.192:0/1840639443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f5361e240 0x560f536205c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6030001330 tx=0x7f6030001250 comp rx=0 tx=0).stop 2024-09-10T05:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6041583640 1 -- 172.21.15.192:0/1840639443 reap_dead start 2024-09-10T05:13:34.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 shutdown_connections 2024-09-10T05:13:34.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 >> 172.21.15.192:0/1840639443 conn(0x560f53619930 msgr2=0x560f53710840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 shutdown_connections 2024-09-10T05:13:34.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.556+0000 7f6043298800 1 -- 172.21.15.192:0/1840639443 wait complete. 2024-09-10T05:13:34.569 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:34.569 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:34.569 ERROR:root:0 2024-09-10T05:13:34.569 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:34.573 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:34.573 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:13:34.574 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:13:34.574 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T05:13:34.620 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:34.620 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:34.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.620+0000 7fe6eb40f800 1 Processor -- start 2024-09-10T05:13:34.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.620+0000 7fe6eb40f800 1 -- start start 2024-09-10T05:13:34.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.620+0000 7fe6eb40f800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55f088fca6a0 0x55f088fcca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.620+0000 7fe6eb40f800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f088e73e40 con 0x55f088fcd030 2024-09-10T05:13:34.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.620+0000 7fe6eb40f800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55f088e3e680 con 0x55f088fca6a0 2024-09-10T05:13:34.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.621+0000 7fe6e8f00640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55f088fca6a0 0x55f088fcca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.621+0000 7fe6e8f00640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55f088fca6a0 0x55f088fcca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34120/0 (socket says 172.21.15.192:34120) 2024-09-10T05:13:34.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.621+0000 7fe6e86ff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55f088fcd030 0x55f088fcf4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46586/0 (socket says 172.21.15.192:46586) 2024-09-10T05:13:34.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.621+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2054451363 learned_addr learned my addr 172.21.15.192:0/2054451363 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.621+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2054451363 >> v1:172.21.15.139:6789/0 conn(0x55f088fcd030 legacy=0x55f088fcf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.621+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2054451363 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f088e5a6b0 con 0x55f088fca6a0 2024-09-10T05:13:34.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.621+0000 7fe6e7efe640 1 -- 172.21.15.192:0/2054451363 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793645590 0 0) 0x55f088e73e40 con 0x55f088fcd030 2024-09-10T05:13:34.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.623+0000 7fe6e8f00640 1 --2- 172.21.15.192:0/2054451363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f088fcca90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8005fd0 tx=0x7fe6d8045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bbd5693283c49d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.623+0000 7fe6e7efe640 1 -- 172.21.15.192:0/2054451363 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6d804e600 con 0x55f088fca6a0 2024-09-10T05:13:34.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.623+0000 7fe6e7efe640 1 -- 172.21.15.192:0/2054451363 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d804e7a0 con 0x55f088fca6a0 2024-09-10T05:13:34.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.623+0000 7fe6e7efe640 1 -- 172.21.15.192:0/2054451363 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6d804eaa0 con 0x55f088fca6a0 2024-09-10T05:13:34.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.623+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2054451363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 msgr2=0x55f088fcca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.623+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2054451363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f088fcca90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8005fd0 tx=0x7fe6d8045cf0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.623+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2054451363 shutdown_connections 2024-09-10T05:13:34.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.623+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2054451363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f088fcca90 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.623+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2054451363 >> 172.21.15.192:0/2054451363 conn(0x55f088fc4200 msgr2=0x55f088fc6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.624+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2054451363 shutdown_connections 2024-09-10T05:13:34.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.624+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2054451363 wait complete. 2024-09-10T05:13:34.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.637+0000 7fe6eb40f800 1 Processor -- start 2024-09-10T05:13:34.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.638+0000 7fe6eb40f800 1 -- start start 2024-09-10T05:13:34.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.638+0000 7fe6eb40f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f0890b94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.638+0000 7fe6eb40f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f088e62dd0 con 0x55f088fca6a0 2024-09-10T05:13:34.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.638+0000 7fe6e8f00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f0890b94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.638+0000 7fe6e8f00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f0890b94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34122/0 (socket says 172.21.15.192:34122) 2024-09-10T05:13:34.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.638+0000 7fe6e8f00640 1 -- 172.21.15.192:0/829298378 learned_addr learned my addr 172.21.15.192:0/829298378 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.638+0000 7fe6e8f00640 1 -- 172.21.15.192:0/829298378 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f088e7be10 con 0x55f088fca6a0 2024-09-10T05:13:34.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.639+0000 7fe6e8f00640 1 --2- 172.21.15.192:0/829298378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f0890b94e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8005fd0 tx=0x7fe6d8050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32511d8c0dbf8ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.639+0000 7fe5d6e0d640 1 -- 172.21.15.192:0/829298378 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6d804ea80 con 0x55f088fca6a0 2024-09-10T05:13:34.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.639+0000 7fe5d6e0d640 1 -- 172.21.15.192:0/829298378 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d805c040 con 0x55f088fca6a0 2024-09-10T05:13:34.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.639+0000 7fe5d6e0d640 1 -- 172.21.15.192:0/829298378 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6d804ed50 con 0x55f088fca6a0 2024-09-10T05:13:34.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.639+0000 7fe6eb40f800 1 -- 172.21.15.192:0/829298378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 msgr2=0x55f0890b94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.639+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/829298378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f0890b94e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8005fd0 tx=0x7fe6d8050000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.639+0000 7fe6eb40f800 1 -- 172.21.15.192:0/829298378 shutdown_connections 2024-09-10T05:13:34.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.639+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/829298378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f0890b94e0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.639+0000 7fe6eb40f800 1 -- 172.21.15.192:0/829298378 >> 172.21.15.192:0/829298378 conn(0x55f088fc4200 msgr2=0x55f0890b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.640+0000 7fe6eb40f800 1 -- 172.21.15.192:0/829298378 shutdown_connections 2024-09-10T05:13:34.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.640+0000 7fe6eb40f800 1 -- 172.21.15.192:0/829298378 wait complete. 2024-09-10T05:13:34.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.640+0000 7fe6eb40f800 1 Processor -- start 2024-09-10T05:13:34.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.640+0000 7fe6eb40f800 1 -- start start 2024-09-10T05:13:34.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.640+0000 7fe6eb40f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f0890c0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.640+0000 7fe6eb40f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f088fd1050 con 0x55f088fca6a0 2024-09-10T05:13:34.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.640+0000 7fe6e8f00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f0890c0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.640+0000 7fe6e8f00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f0890c0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34136/0 (socket says 172.21.15.192:34136) 2024-09-10T05:13:34.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.640+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2608412245 learned_addr learned my addr 172.21.15.192:0/2608412245 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.641+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2608412245 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0890c1230 con 0x55f088fca6a0 2024-09-10T05:13:34.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.641+0000 7fe6e8f00640 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f0890c0cd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800a190 tx=0x7fe6d8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.641+0000 7fe5d560a640 1 -- 172.21.15.192:0/2608412245 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6d8071070 con 0x55f088fca6a0 2024-09-10T05:13:34.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.641+0000 7fe5d560a640 1 -- 172.21.15.192:0/2608412245 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d806d440 con 0x55f088fca6a0 2024-09-10T05:13:34.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.641+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0890c14c0 con 0x55f088fca6a0 2024-09-10T05:13:34.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.641+0000 7fe5d560a640 1 -- 172.21.15.192:0/2608412245 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6d806d740 con 0x55f088fca6a0 2024-09-10T05:13:34.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.641+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0890c1ec0 con 0x55f088fca6a0 2024-09-10T05:13:34.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.642+0000 7fe5d560a640 1 -- 172.21.15.192:0/2608412245 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe6d8074070 con 0x55f088fca6a0 2024-09-10T05:13:34.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.642+0000 7fe5d560a640 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5d003c730 0x7fe5d003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.642+0000 7fe5d560a640 1 -- 172.21.15.192:0/2608412245 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe6d8066020 con 0x55f088fca6a0 2024-09-10T05:13:34.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.642+0000 7fe6e86ff640 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5d003c730 0x7fe5d003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.642+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f088fcd030 0x55f0890c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.642+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f0890c8860 con 0x55f088fcd030 2024-09-10T05:13:34.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.642+0000 7fe6e9701640 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f088fcd030 0x55f0890c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.643+0000 7fe6e86ff640 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5d003c730 0x7fe5d003ebf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc000c00 tx=0x7fe6dc0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.643+0000 7fe6e9701640 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f088fcd030 0x55f0890c8320 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.643+0000 7fe6e9701640 1 -- 172.21.15.192:0/2608412245 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6e00083e0 con 0x55f088fcd030 2024-09-10T05:13:34.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.643+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f0890c8c00 con 0x55f088fcd030 2024-09-10T05:13:34.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.643+0000 7fe6e9701640 1 -- 172.21.15.192:0/2608412245 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6e00083e0 con 0x55f088fcd030 2024-09-10T05:13:34.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.643+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f0890ca680 0x55f0890ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.643+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f0890cd280 con 0x55f0890ca680 2024-09-10T05:13:34.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.644+0000 7fe6e8f00640 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f0890ca680 0x55f0890ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.644+0000 7fe6e8f00640 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f0890ca680 0x55f0890ccaf0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.644+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2608412245 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe6d807d070 con 0x55f0890ca680 2024-09-10T05:13:34.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.644+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f0890c9450 con 0x55f088fcd030 2024-09-10T05:13:34.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.644+0000 7fe6e9701640 1 -- 172.21.15.192:0/2608412245 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6e00083e0 con 0x55f088fcd030 2024-09-10T05:13:34.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.644+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55f0890ce6e0 0x55f0890d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.644+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f0890d1240 con 0x55f0890ce6e0 2024-09-10T05:13:34.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.645+0000 7fe6e86ff640 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55f0890ce6e0 0x55f0890d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.645+0000 7fe6e86ff640 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55f0890ce6e0 0x55f0890d0ad0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.645+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2608412245 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe6dc00f670 con 0x55f0890ce6e0 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.645+0000 7fe6eb40f800 1 Processor -- start 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.646+0000 7fe6eb40f800 1 -- start start 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.646+0000 7fe6eb40f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fc9e60 0x55f088fc86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.646+0000 7fe6eb40f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f088ec0a00 con 0x55f088fc9e60 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.646+0000 7fe6e8f00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fc9e60 0x55f088fc86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.646+0000 7fe6e8f00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fc9e60 0x55f088fc86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34142/0 (socket says 172.21.15.192:34142) 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.646+0000 7fe6e8f00640 1 -- 172.21.15.192:0/1098347033 learned_addr learned my addr 172.21.15.192:0/1098347033 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.646+0000 7fe6e8f00640 1 -- 172.21.15.192:0/1098347033 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f088fca380 con 0x55f088fc9e60 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.646+0000 7fe6e8f00640 1 --2- 172.21.15.192:0/1098347033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fc9e60 0x55f088fc86d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8056fd0 tx=0x7fe6d80966e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.646+0000 7fe5ce7fc640 1 -- 172.21.15.192:0/1098347033 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6d807b040 con 0x55f088fc9e60 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.646+0000 7fe5ce7fc640 1 -- 172.21.15.192:0/1098347033 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d8004940 con 0x55f088fc9e60 2024-09-10T05:13:34.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.646+0000 7fe6eb40f800 1 -- 172.21.15.192:0/1098347033 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f088fc8c10 con 0x55f088fc9e60 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.646+0000 7fe5ce7fc640 1 -- 172.21.15.192:0/1098347033 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6d806bc30 con 0x55f088fc9e60 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.647+0000 7fe6eb40f800 1 -- 172.21.15.192:0/1098347033 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f088fc91b0 con 0x55f088fc9e60 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.647+0000 7fe5ce7fc640 1 -- 172.21.15.192:0/1098347033 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe6d8068030 con 0x55f088fc9e60 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.647+0000 7fe5ce7fc640 1 --2- 172.21.15.192:0/1098347033 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5c003c730 0x7fe5c003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.647+0000 7fe5ce7fc640 1 -- 172.21.15.192:0/1098347033 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe6d8087030 con 0x55f088fc9e60 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.647+0000 7fe6e86ff640 1 --2- 172.21.15.192:0/1098347033 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5c003c730 0x7fe5c003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.648+0000 7fe6eb40f800 1 Processor -- start 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.648+0000 7fe6eb40f800 1 -- start start 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.648+0000 7fe6e86ff640 1 --2- 172.21.15.192:0/1098347033 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5c003c730 0x7fe5c003ebf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55f0890cd620 tx=0x7fe6dc006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.648+0000 7fe6eb40f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 0x55f0890edd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.648+0000 7fe6eb40f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f0890b9c70 con 0x55f0890ed9a0 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.648+0000 7fe6e8f00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 0x55f0890edd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.648+0000 7fe6e8f00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 0x55f0890edd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34154/0 (socket says 172.21.15.192:34154) 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.648+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2664411208 learned_addr learned my addr 172.21.15.192:0/2664411208 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.648+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2664411208 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0890ee370 con 0x55f0890ed9a0 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.648+0000 7fe6e8f00640 1 --2- 172.21.15.192:0/2664411208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 0x55f0890edd80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe6d806b4a0 tx=0x7fe6d80052c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06f57a6da0d41fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.649+0000 7fe5bffff640 1 -- 172.21.15.192:0/2664411208 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6d80ab070 con 0x55f0890ed9a0 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.649+0000 7fe5bffff640 1 -- 172.21.15.192:0/2664411208 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d8080440 con 0x55f0890ed9a0 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.649+0000 7fe5bffff640 1 -- 172.21.15.192:0/2664411208 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6d80a2040 con 0x55f0890ed9a0 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.649+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2664411208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 msgr2=0x55f0890edd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.649+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2664411208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 0x55f0890edd80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe6d806b4a0 tx=0x7fe6d80052c0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.649+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2664411208 shutdown_connections 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.649+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2664411208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 0x55f0890edd80 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.649+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2664411208 >> 172.21.15.192:0/2664411208 conn(0x55f0890e9da0 msgr2=0x55f0890e7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.649+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2664411208 shutdown_connections 2024-09-10T05:13:34.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.649+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2664411208 wait complete. 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.649+0000 7fe6eb40f800 1 Processor -- start 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.649+0000 7fe6eb40f800 1 -- start start 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.650+0000 7fe6eb40f800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 0x55f0890f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.650+0000 7fe6eb40f800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f0890ee800 con 0x55f0890ed9a0 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.650+0000 7fe6e8f00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 0x55f0890f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.650+0000 7fe6e8f00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 0x55f0890f4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34170/0 (socket says 172.21.15.192:34170) 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.650+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 learned_addr learned my addr 172.21.15.192:0/2606258798 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.650+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0890f53e0 con 0x55f0890ed9a0 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.650+0000 7fe6e8f00640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 0x55f0890f4e80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe6d806b750 tx=0x7fe6d8078eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.651+0000 7fe5be7fc640 1 -- 172.21.15.192:0/2606258798 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6d80b4020 con 0x55f0890ed9a0 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.651+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0890f53e0 con 0x55f0890ed9a0 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.651+0000 7fe5be7fc640 1 -- 172.21.15.192:0/2606258798 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d8076580 con 0x55f0890ed9a0 2024-09-10T05:13:34.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.651+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0890f53e0 con 0x55f0890ed9a0 2024-09-10T05:13:34.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.651+0000 7fe5be7fc640 1 -- 172.21.15.192:0/2606258798 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6d80ab040 con 0x55f0890ed9a0 2024-09-10T05:13:34.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.651+0000 7fe5be7fc640 1 -- 172.21.15.192:0/2606258798 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe6d80b7020 con 0x55f0890ed9a0 2024-09-10T05:13:34.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.652+0000 7fe5be7fc640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5b403c6e0 0x7fe5b403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.652+0000 7fe5be7fc640 1 -- 172.21.15.192:0/2606258798 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe6d80bad10 con 0x55f0890ed9a0 2024-09-10T05:13:34.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.652+0000 7fe6e86ff640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5b403c6e0 0x7fe5b403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.652+0000 7fe6e86ff640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5b403c6e0 0x7fe5b403eba0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00ffd0 tx=0x7fe6dc023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.652+0000 7fe6eb40f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.652+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f089100400 0x55f0891028c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.652+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f089103010 con 0x55f089100400 2024-09-10T05:13:34.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.652+0000 7fe6e9701640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f089100400 0x55f0891028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6e9701640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f089100400 0x55f0891028c0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6e00083e0 con 0x55f089100400 2024-09-10T05:13:34.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6eb40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6eb40f800 20 realm 2024-09-10T05:13:34.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6eb40f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f089103420 con 0x55f089100400 2024-09-10T05:13:34.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6e00083e0 con 0x55f089100400 2024-09-10T05:13:34.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6eb40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6eb40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6eb40f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089100400 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6e00083e0 con 0x55f089100400 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6eb40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6eb40f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.653+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f089104090 con 0x55f089100400 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.654+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6e00083e0 con 0x55f089100400 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.654+0000 7fe6eb40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.654+0000 7fe6eb40f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.654+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f089104a50 0x55f089106e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.654+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f089107450 con 0x55f089104a50 2024-09-10T05:13:34.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.654+0000 7fe6e8f00640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f089104a50 0x55f089106e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.654+0000 7fe6e8f00640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f089104a50 0x55f089106e40 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.654+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.654+0000 7fe6eb40f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:34.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.655+0000 7fe6eb40f800 20 searching for the correct realm 2024-09-10T05:13:34.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.655+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55f089109400 0x55f08910b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.655+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f08910bf40 con 0x55f089109400 2024-09-10T05:13:34.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.655+0000 7fe6e86ff640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55f089109400 0x55f08910b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.655+0000 7fe6e86ff640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55f089109400 0x55f08910b8c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.655+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.655+0000 7fe6e86ff640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe6dc02e910 0x7fe6dc03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.655+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f08910bf40 con 0x7fe6dc02e910 2024-09-10T05:13:34.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.655+0000 7fe6e9701640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe6dc02e910 0x7fe6dc03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.656+0000 7fe6e9701640 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe6dc02e910 0x7fe6dc03a3c0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.656+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe6e00083e0 con 0x7fe6dc02e910 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.656+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089104a50 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.656+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.656+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089100400 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.656+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6e00083e0 con 0x55f089100400 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.656+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089100400 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.657+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6e0026040 con 0x55f089100400 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.657+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089104a50 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.657+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.657+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089104a50 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.657+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.657+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x7fe6dc02e910 2024-09-10T05:13:34.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.657+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6e0026040 con 0x7fe6dc02e910 2024-09-10T05:13:34.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.657+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089109400 2024-09-10T05:13:34.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.657+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.657+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089100400 2024-09-10T05:13:34.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.658+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6e0026040 con 0x55f089100400 2024-09-10T05:13:34.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.658+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089104a50 2024-09-10T05:13:34.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.658+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.658+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089100400 2024-09-10T05:13:34.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.658+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6e0026040 con 0x55f089100400 2024-09-10T05:13:34.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.658+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x7fe6dc02e910 2024-09-10T05:13:34.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.658+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe6e0026040 con 0x7fe6dc02e910 2024-09-10T05:13:34.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.658+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089109400 2024-09-10T05:13:34.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.659+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.659+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089109400 2024-09-10T05:13:34.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.659+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.659+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089104a50 2024-09-10T05:13:34.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.659+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.659+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089109400 2024-09-10T05:13:34.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.659+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.659+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089109400 2024-09-10T05:13:34.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.659+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.659+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089100400 2024-09-10T05:13:34.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.660+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6e0026040 con 0x55f089100400 2024-09-10T05:13:34.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.660+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089100400 2024-09-10T05:13:34.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.660+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe6e0026040 con 0x55f089100400 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.660+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x7fe6dc02e910 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.660+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6e0026040 con 0x7fe6dc02e910 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.660+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089109400 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.660+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.660+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x7fe6dc02e910 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.661+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6e0026040 con 0x7fe6dc02e910 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.661+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089100400 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.661+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.661+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089104a50 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.661+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.661+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089109400 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.662+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.662+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089104a50 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.662+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.662+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x7fe6dc02e910 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.662+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6e0035040 con 0x7fe6dc02e910 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.662+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089109400 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.662+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.662+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x7fe6dc02e910 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6e0035040 con 0x7fe6dc02e910 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe6e003a040 con 0x55f089100400 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe6e003a040 con 0x7fe6dc02e910 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6e0035040 con 0x7fe6dc02e910 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6eb40f800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:34.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6eb40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6eb40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6eb40f800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6eb40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6eb40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6eb40f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089100400 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6eb40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6eb40f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x55f089100400 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.663+0000 7fe6eb40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f089103cf0 con 0x7fe6dc02e910 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe6e0035040 con 0x7fe6dc02e910 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 20 zone default found 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 4 Realm: () 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 20 zonegroup default 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f089107990 con 0x55f089104a50 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f08910d880 con 0x55f089109400 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.664+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f08910dc70 con 0x55f089109400 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.665+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.665+0000 7fe6eb40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.665+0000 7fe6eb40f800 20 started sync module instance, tier type = 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.665+0000 7fe6eb40f800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.665+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f08910cd10 con 0x7fe6dc02e910 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.666+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x7fe6dc02e910 2024-09-10T05:13:34.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.666+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491580092976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f08910cd10 con 0x7fe6dc02e910 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.666+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f08910e760 con 0x55f089100400 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.667+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94491580092976] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x7fe6dc02e910 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.667+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.667+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94491580097136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f08910cd10 con 0x55f089100400 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.667+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f08910f230 con 0x55f089109400 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.668+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94491580097136] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.668+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.668+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94491580090464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f08910cc80 con 0x55f089109400 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.668+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f08910ffc0 con 0x7fe6dc02e910 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.669+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94491580090464] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.669+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x7fe6dc02e910 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.669+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94491580102176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f0891103e0 con 0x7fe6dc02e910 2024-09-10T05:13:34.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.669+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f089110de0 con 0x55f089100400 2024-09-10T05:13:34.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.670+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.670+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491580106992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f089110d10 con 0x55f089100400 2024-09-10T05:13:34.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.670+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f089111d10 con 0x55f089104a50 2024-09-10T05:13:34.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.670+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94491580102176] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x7fe6dc02e910 2024-09-10T05:13:34.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.671+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.671+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94491580103232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f0891120b0 con 0x55f089104a50 2024-09-10T05:13:34.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.671+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f089112ae0 con 0x55f089104a50 2024-09-10T05:13:34.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.671+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94491580106992] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.672+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94491580103232] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.673+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.673+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94491580114416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f089112f00 con 0x55f089104a50 2024-09-10T05:13:34.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.673+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f089113750 con 0x55f089104a50 2024-09-10T05:13:34.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.673+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94491580114416] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.674+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.674+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94491580116608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f089113750 con 0x55f089104a50 2024-09-10T05:13:34.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.674+0000 7fe6eb40f800 20 add_watcher() i=0 2024-09-10T05:13:34.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.674+0000 7fe6eb40f800 20 add_watcher() i=1 2024-09-10T05:13:34.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.674+0000 7fe6eb40f800 20 add_watcher() i=2 2024-09-10T05:13:34.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.674+0000 7fe6eb40f800 20 add_watcher() i=3 2024-09-10T05:13:34.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.674+0000 7fe6eb40f800 20 add_watcher() i=4 2024-09-10T05:13:34.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.674+0000 7fe6eb40f800 20 add_watcher() i=5 2024-09-10T05:13:34.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.674+0000 7fe6eb40f800 20 add_watcher() i=6 2024-09-10T05:13:34.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.675+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94491580116608] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.675+0000 7fe6eb40f800 20 add_watcher() i=7 2024-09-10T05:13:34.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.675+0000 7fe6eb40f800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.675+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f089116b50 con 0x55f089100400 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.675+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.675+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94491580118128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f089114070 con 0x55f089100400 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.676+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94491580118128] v37'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.676+0000 7fe59efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.676+0000 7fe6eb40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.676+0000 7fe6eb40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.676+0000 7fe6eb40f800 5 note: GC not initialized 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.676+0000 7fe59dfe3640 20 reqs_thread_entry: start 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.677+0000 7fe6eb40f800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.677+0000 7fe6eb40f800 20 Filter name: none 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.677+0000 7fe50f7fe640 20 reqs_thread_entry: start 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.677+0000 7fe6eb40f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:13:34.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.677+0000 7fe6eb40f800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.677+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f089149b30 con 0x55f089104a50 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.678+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.678+0000 7fe6eb40f800 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.678+0000 7fe6eb40f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.678+0000 7fe6eb40f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.678+0000 7fe6eb40f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.678+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f089150080 con 0x55f089104a50 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.679+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v37'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.679+0000 7fe6eb40f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.679+0000 7fe6eb40f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.679+0000 7fe6eb40f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.679+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94491580365440 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f08914b6e0 con 0x55f089100400 2024-09-10T05:13:34.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.679+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== watch-notify(notify (1) cookie 94491580106992 notify 158913789978 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7fe6e0010040 con 0x55f089100400 2024-09-10T05:13:34.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.679+0000 7fe5bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789978 cookie 94491580106992 notifier 4896 bl.length()=679 2024-09-10T05:13:34.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.679+0000 7fe5bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:34.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.679+0000 7fe5bffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.679+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 notify.4 [notify cookie 94491580365440 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.679+0000 7fe5bffff640 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fe5ac003ea0 con 0x55f089100400 2024-09-10T05:13:34.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.679+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.680+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== watch-notify(notify_complete (2) cookie 94491580365440 notify 158913789978 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe6e000adb0 con 0x55f089100400 2024-09-10T05:13:34.692 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:13:33.468641Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:13:33.468623Z","tags":[],"group_ids":[]} 2024-09-10T05:13:34.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.680+0000 7fe59efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.680+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94491580118128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f0891479c0 con 0x55f089100400 2024-09-10T05:13:34.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.682+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94491580118128] v37'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.682+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94491580092976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f0891479c0 con 0x7fe6dc02e910 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.683+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94491580092976] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x7fe6dc02e910 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.683+0000 7fe6eb40f800 20 remove_watcher() i=0 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.683+0000 7fe6eb40f800 2 removed watcher, disabling cache 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.683+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94491580097136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f0891479c0 con 0x55f089100400 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.684+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94491580097136] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.684+0000 7fe6eb40f800 20 remove_watcher() i=1 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.684+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94491580090464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f0891479c0 con 0x55f089109400 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.685+0000 7fe6e86ff640 1 -- 172.21.15.192:0/2606258798 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94491580090464] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6dc037040 con 0x55f089109400 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.685+0000 7fe6eb40f800 20 remove_watcher() i=2 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.685+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94491580102176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f08910e270 con 0x7fe6dc02e910 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.686+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94491580102176] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x7fe6dc02e910 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.686+0000 7fe6eb40f800 20 remove_watcher() i=3 2024-09-10T05:13:34.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.686+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94491580106992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f08910c860 con 0x55f089100400 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.687+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94491580106992] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6e0035040 con 0x55f089100400 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.687+0000 7fe6eb40f800 20 remove_watcher() i=4 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.687+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94491580103232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f08910f620 con 0x55f089104a50 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.688+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94491580103232] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.688+0000 7fe6eb40f800 20 remove_watcher() i=5 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.688+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94491580114416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f08910e270 con 0x55f089104a50 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.689+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94491580114416] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.689+0000 7fe6eb40f800 20 remove_watcher() i=6 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.689+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94491580116608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f0891108f0 con 0x55f089104a50 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6e8f00640 1 -- 172.21.15.192:0/2606258798 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94491580116608] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6d80ae040 con 0x55f089104a50 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 20 remove_watcher() i=7 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f089104a50 msgr2=0x55f089106e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f089104a50 0x55f089106e40 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f089100400 msgr2=0x55f0891028c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f089100400 0x55f0891028c0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe6dc02e910 msgr2=0x7fe6dc03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7fe6dc02e910 0x7fe6dc03a3c0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55f089109400 msgr2=0x55f08910b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55f089109400 0x55f08910b8c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5b403c6e0 msgr2=0x7fe5b403eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5b403c6e0 0x7fe5b403eba0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00ffd0 tx=0x7fe6dc023040 comp rx=0 tx=0).stop 2024-09-10T05:13:34.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 msgr2=0x55f0890f4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6e9701640 1 -- 172.21.15.192:0/2606258798 reap_dead start 2024-09-10T05:13:34.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 0x55f0890f4e80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe6d806b750 tx=0x7fe6d8078eb0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 shutdown_connections 2024-09-10T05:13:34.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2606258798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f0890ed9a0 0x55f0890f4e80 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 >> 172.21.15.192:0/2606258798 conn(0x55f0890e9da0 msgr2=0x55f0890e7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 shutdown_connections 2024-09-10T05:13:34.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2606258798 wait complete. 2024-09-10T05:13:34.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 -- 172.21.15.192:0/1098347033 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5c003c730 msgr2=0x7fe5c003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/1098347033 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5c003c730 0x7fe5c003ebf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55f0890cd620 tx=0x7fe6dc006000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 -- 172.21.15.192:0/1098347033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fc9e60 msgr2=0x55f088fc86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.690+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/1098347033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fc9e60 0x55f088fc86d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8056fd0 tx=0x7fe6d80966e0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/1098347033 shutdown_connections 2024-09-10T05:13:34.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/1098347033 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5c003c730 0x7fe5c003ebf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/1098347033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fc9e60 0x55f088fc86d0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/1098347033 >> 172.21.15.192:0/1098347033 conn(0x55f0890d3230 msgr2=0x55f0890d3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/1098347033 shutdown_connections 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/1098347033 wait complete. 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f0890ca680 msgr2=0x55f0890ccaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55f0890ca680 0x55f0890ccaf0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f088fcd030 msgr2=0x55f0890c8320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55f088fcd030 0x55f0890c8320 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55f0890ce6e0 msgr2=0x55f0890d0ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55f0890ce6e0 0x55f0890d0ad0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5d003c730 msgr2=0x7fe5d003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe5d003c730 0x7fe5d003ebf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc000c00 tx=0x7fe6dc0013b0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 msgr2=0x55f0890c0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 --2- 172.21.15.192:0/2608412245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f088fca6a0 0x55f0890c0cd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800a190 tx=0x7fe6d8003330 comp rx=0 tx=0).stop 2024-09-10T05:13:34.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6e9701640 1 -- 172.21.15.192:0/2608412245 reap_dead start 2024-09-10T05:13:34.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 shutdown_connections 2024-09-10T05:13:34.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 >> 172.21.15.192:0/2608412245 conn(0x55f088fc4200 msgr2=0x55f0890b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 shutdown_connections 2024-09-10T05:13:34.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.691+0000 7fe6eb40f800 1 -- 172.21.15.192:0/2608412245 wait complete. 2024-09-10T05:13:34.704 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:34.704 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:34.704 ERROR:root:0 2024-09-10T05:13:34.704 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:34.708 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:34.709 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-10T05:13:34.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-10T05:13:34.709 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-10T05:13:34.755 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:34.755 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:34.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.755+0000 7f869f924800 1 Processor -- start 2024-09-10T05:13:34.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.755+0000 7f869f924800 1 -- start start 2024-09-10T05:13:34.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.755+0000 7f869f924800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a0167a6210 0x55a0167a86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.755+0000 7f869f924800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a01664be40 con 0x55a0167a2610 2024-09-10T05:13:34.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.755+0000 7f869f924800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55a016616680 con 0x55a0167a6210 2024-09-10T05:13:34.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.756+0000 7f869ad55640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55a0167a6210 0x55a0167a86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.756+0000 7f869b556640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55a0167a2610 0x55a0167a4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46592/0 (socket says 172.21.15.192:46592) 2024-09-10T05:13:34.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.756+0000 7f869b556640 1 -- 172.21.15.192:0/1653066356 learned_addr learned my addr 172.21.15.192:0/1653066356 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:34.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.756+0000 7f869ad55640 1 -- 172.21.15.192:0/1653066356 >> v1:172.21.15.139:6789/0 conn(0x55a0167a2610 legacy=0x55a0167a4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.756+0000 7f869ad55640 1 -- 172.21.15.192:0/1653066356 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0166326b0 con 0x55a0167a6210 2024-09-10T05:13:34.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.758+0000 7f869ad55640 1 --2- 172.21.15.192:0/1653066356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a6210 0x55a0167a86d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f868400a470 tx=0x7f8684045880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d97c4fe37c93f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.758+0000 7f869a554640 1 -- 172.21.15.192:0/1653066356 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8684059070 con 0x55a0167a6210 2024-09-10T05:13:34.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.758+0000 7f869a554640 1 -- 172.21.15.192:0/1653066356 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8684054570 con 0x55a0167a6210 2024-09-10T05:13:34.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.758+0000 7f869a554640 1 -- 172.21.15.192:0/1653066356 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8684054870 con 0x55a0167a6210 2024-09-10T05:13:34.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.758+0000 7f869f924800 1 -- 172.21.15.192:0/1653066356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a6210 msgr2=0x55a0167a86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.758+0000 7f869f924800 1 --2- 172.21.15.192:0/1653066356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a6210 0x55a0167a86d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f868400a470 tx=0x7f8684045880 comp rx=0 tx=0).stop 2024-09-10T05:13:34.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.758+0000 7f869f924800 1 -- 172.21.15.192:0/1653066356 shutdown_connections 2024-09-10T05:13:34.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.758+0000 7f869f924800 1 --2- 172.21.15.192:0/1653066356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a6210 0x55a0167a86d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.758+0000 7f869f924800 1 -- 172.21.15.192:0/1653066356 >> 172.21.15.192:0/1653066356 conn(0x55a01679c1d0 msgr2=0x55a01679e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.758+0000 7f869f924800 1 -- 172.21.15.192:0/1653066356 shutdown_connections 2024-09-10T05:13:34.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.758+0000 7f869f924800 1 -- 172.21.15.192:0/1653066356 wait complete. 2024-09-10T05:13:34.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.772+0000 7f869f924800 1 Processor -- start 2024-09-10T05:13:34.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.772+0000 7f869f924800 1 -- start start 2024-09-10T05:13:34.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.772+0000 7f869f924800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 0x55a016891750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.772+0000 7f869f924800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a01663add0 con 0x55a0167a2610 2024-09-10T05:13:34.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.773+0000 7f869b556640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 0x55a016891750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.773+0000 7f869b556640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 0x55a016891750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34178/0 (socket says 172.21.15.192:34178) 2024-09-10T05:13:34.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.773+0000 7f869b556640 1 -- 172.21.15.192:0/3606885565 learned_addr learned my addr 172.21.15.192:0/3606885565 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.773+0000 7f869b556640 1 -- 172.21.15.192:0/3606885565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a016653e10 con 0x55a0167a2610 2024-09-10T05:13:34.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.773+0000 7f869b556640 1 --2- 172.21.15.192:0/3606885565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 0x55a016891750 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f868c0065f0 tx=0x7f868c006ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75190c542a8e4ca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.773+0000 7f858960a640 1 -- 172.21.15.192:0/3606885565 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f868c003450 con 0x55a0167a2610 2024-09-10T05:13:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.773+0000 7f858960a640 1 -- 172.21.15.192:0/3606885565 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f868c0035f0 con 0x55a0167a2610 2024-09-10T05:13:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.773+0000 7f858960a640 1 -- 172.21.15.192:0/3606885565 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f868c0038f0 con 0x55a0167a2610 2024-09-10T05:13:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.774+0000 7f869f924800 1 -- 172.21.15.192:0/3606885565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 msgr2=0x55a016891750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.774+0000 7f869f924800 1 --2- 172.21.15.192:0/3606885565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 0x55a016891750 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f868c0065f0 tx=0x7f868c006ab0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.774+0000 7f869f924800 1 -- 172.21.15.192:0/3606885565 shutdown_connections 2024-09-10T05:13:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.774+0000 7f869f924800 1 --2- 172.21.15.192:0/3606885565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 0x55a016891750 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.774+0000 7f869f924800 1 -- 172.21.15.192:0/3606885565 >> 172.21.15.192:0/3606885565 conn(0x55a01679c1d0 msgr2=0x55a01688d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.774+0000 7f869f924800 1 -- 172.21.15.192:0/3606885565 shutdown_connections 2024-09-10T05:13:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.774+0000 7f869f924800 1 -- 172.21.15.192:0/3606885565 wait complete. 2024-09-10T05:13:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.774+0000 7f869f924800 1 Processor -- start 2024-09-10T05:13:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.774+0000 7f869f924800 1 -- start start 2024-09-10T05:13:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.775+0000 7f869f924800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 0x55a0167a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.775+0000 7f869f924800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a0167a9050 con 0x55a0167a2610 2024-09-10T05:13:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.775+0000 7f869b556640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 0x55a0167a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.775+0000 7f869b556640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 0x55a0167a1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34182/0 (socket says 172.21.15.192:34182) 2024-09-10T05:13:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.775+0000 7f869b556640 1 -- 172.21.15.192:0/800483787 learned_addr learned my addr 172.21.15.192:0/800483787 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.775+0000 7f869b556640 1 -- 172.21.15.192:0/800483787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0167a2290 con 0x55a0167a2610 2024-09-10T05:13:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.775+0000 7f869b556640 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 0x55a0167a1d30 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f868c000f80 tx=0x7f868c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.775+0000 7f8587e07640 1 -- 172.21.15.192:0/800483787 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f868c022020 con 0x55a0167a2610 2024-09-10T05:13:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.775+0000 7f8587e07640 1 -- 172.21.15.192:0/800483787 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f868c001ab0 con 0x55a0167a2610 2024-09-10T05:13:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.775+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0167a0640 con 0x55a0167a2610 2024-09-10T05:13:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.775+0000 7f8587e07640 1 -- 172.21.15.192:0/800483787 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f868c014b80 con 0x55a0167a2610 2024-09-10T05:13:34.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.775+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0167a0c00 con 0x55a0167a2610 2024-09-10T05:13:34.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.776+0000 7f8587e07640 1 -- 172.21.15.192:0/800483787 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f868c025020 con 0x55a0167a2610 2024-09-10T05:13:34.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.776+0000 7f8587e07640 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f858003c730 0x7f858003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.776+0000 7f8587e07640 1 -- 172.21.15.192:0/800483787 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f868c018030 con 0x55a0167a2610 2024-09-10T05:13:34.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.776+0000 7f869ad55640 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f858003c730 0x7f858003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.777+0000 7f869f924800 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a0167a6210 0x55a0168a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.777+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168a2b00 con 0x55a0167a6210 2024-09-10T05:13:34.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.777+0000 7f869bd57640 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a0167a6210 0x55a0168a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.777+0000 7f869ad55640 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f858003c730 0x7f858003ebf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8684056000 tx=0x7f8684050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.777+0000 7f869bd57640 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a0167a6210 0x55a0168a25c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.777+0000 7f869bd57640 1 -- 172.21.15.192:0/800483787 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0167a6210 2024-09-10T05:13:34.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.777+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0167a1100 con 0x55a0167a6210 2024-09-10T05:13:34.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.778+0000 7f869bd57640 1 -- 172.21.15.192:0/800483787 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f86940083e0 con 0x55a0167a6210 2024-09-10T05:13:34.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.778+0000 7f869f924800 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a0168a4e50 0x55a0168a7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.778+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168a7910 con 0x55a0168a4e50 2024-09-10T05:13:34.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.778+0000 7f869b556640 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a0168a4e50 0x55a0168a7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.778+0000 7f869b556640 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a0168a4e50 0x55a0168a7240 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.779+0000 7f869b556640 1 -- 172.21.15.192:0/800483787 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168a4e50 2024-09-10T05:13:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.779+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168a3cf0 con 0x55a0167a6210 2024-09-10T05:13:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.779+0000 7f869bd57640 1 -- 172.21.15.192:0/800483787 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f86940083e0 con 0x55a0167a6210 2024-09-10T05:13:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.779+0000 7f869f924800 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a0168a8d50 0x55a0168ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.779+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168ab8b0 con 0x55a0168a8d50 2024-09-10T05:13:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.779+0000 7f869ad55640 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a0168a8d50 0x55a0168ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.779+0000 7f869ad55640 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a0168a8d50 0x55a0168ab140 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.780+0000 7f869ad55640 1 -- 172.21.15.192:0/800483787 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f868405c040 con 0x55a0168a8d50 2024-09-10T05:13:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.780+0000 7f869f924800 1 Processor -- start 2024-09-10T05:13:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.780+0000 7f869f924800 1 -- start start 2024-09-10T05:13:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.780+0000 7f869f924800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168b94d0 0x55a0168b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.780+0000 7f869f924800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a016698a00 con 0x55a0168b94d0 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.780+0000 7f869b556640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168b94d0 0x55a0168b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.780+0000 7f869b556640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168b94d0 0x55a0168b98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34198/0 (socket says 172.21.15.192:34198) 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.780+0000 7f869b556640 1 -- 172.21.15.192:0/4291351281 learned_addr learned my addr 172.21.15.192:0/4291351281 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.781+0000 7f869b556640 1 -- 172.21.15.192:0/4291351281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0168b9f30 con 0x55a0168b94d0 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.781+0000 7f869b556640 1 --2- 172.21.15.192:0/4291351281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168b94d0 0x55a0168b98f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f868c0108f0 tx=0x7f868c010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.781+0000 7f8585602640 1 -- 172.21.15.192:0/4291351281 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f868c01e3f0 con 0x55a0168b94d0 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.781+0000 7f8585602640 1 -- 172.21.15.192:0/4291351281 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f868c01e590 con 0x55a0168b94d0 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.781+0000 7f869f924800 1 -- 172.21.15.192:0/4291351281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0168ba760 con 0x55a0168b94d0 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.781+0000 7f8585602640 1 -- 172.21.15.192:0/4291351281 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f868c01e870 con 0x55a0168b94d0 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.781+0000 7f869f924800 1 -- 172.21.15.192:0/4291351281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0168bad00 con 0x55a0168b94d0 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.782+0000 7f8585602640 1 -- 172.21.15.192:0/4291351281 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f868c037030 con 0x55a0168b94d0 2024-09-10T05:13:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.782+0000 7f8585602640 1 --2- 172.21.15.192:0/4291351281 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f857403c730 0x7f857403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.782+0000 7f8585602640 1 -- 172.21.15.192:0/4291351281 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f868c035070 con 0x55a0168b94d0 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.782+0000 7f869ad55640 1 --2- 172.21.15.192:0/4291351281 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f857403c730 0x7f857403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.782+0000 7f869f924800 1 Processor -- start 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.782+0000 7f869f924800 1 -- start start 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.782+0000 7f869ad55640 1 --2- 172.21.15.192:0/4291351281 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f857403c730 0x7f857403ebf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8684057040 tx=0x7f8684005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.782+0000 7f869f924800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 0x55a0168c6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.782+0000 7f869f924800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a016891fa0 con 0x55a0168c5fb0 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.782+0000 7f869b556640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 0x55a0168c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.783+0000 7f869b556640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 0x55a0168c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34208/0 (socket says 172.21.15.192:34208) 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.783+0000 7f869b556640 1 -- 172.21.15.192:0/664973219 learned_addr learned my addr 172.21.15.192:0/664973219 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.783+0000 7f869b556640 1 -- 172.21.15.192:0/664973219 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0168c6980 con 0x55a0168c5fb0 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.783+0000 7f869b556640 1 --2- 172.21.15.192:0/664973219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 0x55a0168c6390 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f868c014fd0 tx=0x7f868c04bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e645aa1a36379a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.783+0000 7f857effd640 1 -- 172.21.15.192:0/664973219 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f868c04c040 con 0x55a0168c5fb0 2024-09-10T05:13:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.783+0000 7f857effd640 1 -- 172.21.15.192:0/664973219 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f868c058070 con 0x55a0168c5fb0 2024-09-10T05:13:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.783+0000 7f857effd640 1 -- 172.21.15.192:0/664973219 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f868c0127f0 con 0x55a0168c5fb0 2024-09-10T05:13:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.783+0000 7f869f924800 1 -- 172.21.15.192:0/664973219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 msgr2=0x55a0168c6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.783+0000 7f869f924800 1 --2- 172.21.15.192:0/664973219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 0x55a0168c6390 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f868c014fd0 tx=0x7f868c04bf70 comp rx=0 tx=0).stop 2024-09-10T05:13:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.783+0000 7f869f924800 1 -- 172.21.15.192:0/664973219 shutdown_connections 2024-09-10T05:13:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.783+0000 7f869f924800 1 --2- 172.21.15.192:0/664973219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 0x55a0168c6390 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.784+0000 7f869f924800 1 -- 172.21.15.192:0/664973219 >> 172.21.15.192:0/664973219 conn(0x55a0168c23b0 msgr2=0x55a0168c05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.784+0000 7f869f924800 1 -- 172.21.15.192:0/664973219 shutdown_connections 2024-09-10T05:13:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.784+0000 7f869f924800 1 -- 172.21.15.192:0/664973219 wait complete. 2024-09-10T05:13:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.784+0000 7f869f924800 1 Processor -- start 2024-09-10T05:13:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.784+0000 7f869f924800 1 -- start start 2024-09-10T05:13:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.784+0000 7f869f924800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 0x55a0168cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.784+0000 7f869f924800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a0168c6e10 con 0x55a0168c5fb0 2024-09-10T05:13:34.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.784+0000 7f869b556640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 0x55a0168cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.784+0000 7f869b556640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 0x55a0168cd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34212/0 (socket says 172.21.15.192:34212) 2024-09-10T05:13:34.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.784+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 learned_addr learned my addr 172.21.15.192:0/1846688758 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.785+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0168cd910 con 0x55a0168c5fb0 2024-09-10T05:13:34.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.785+0000 7f869b556640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 0x55a0168cd3b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f868c014fd0 tx=0x7f868c004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.785+0000 7f857d7fa640 1 -- 172.21.15.192:0/1846688758 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f868c039410 con 0x55a0168c5fb0 2024-09-10T05:13:34.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.785+0000 7f857d7fa640 1 -- 172.21.15.192:0/1846688758 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f868c06f070 con 0x55a0168c5fb0 2024-09-10T05:13:34.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.785+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0168cd910 con 0x55a0168c5fb0 2024-09-10T05:13:34.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.785+0000 7f857d7fa640 1 -- 172.21.15.192:0/1846688758 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f868c04e500 con 0x55a0168c5fb0 2024-09-10T05:13:34.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.785+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0168cd910 con 0x55a0168c5fb0 2024-09-10T05:13:34.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.786+0000 7f857d7fa640 1 -- 172.21.15.192:0/1846688758 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f868c066040 con 0x55a0168c5fb0 2024-09-10T05:13:34.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.786+0000 7f857d7fa640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f856403c780 0x7f856403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.786+0000 7f857d7fa640 1 -- 172.21.15.192:0/1846688758 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f868c064020 con 0x55a0168c5fb0 2024-09-10T05:13:34.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.786+0000 7f869ad55640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f856403c780 0x7f856403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.787+0000 7f869ad55640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f856403c780 0x7f856403ec40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8684054fd0 tx=0x7f8684051000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.787+0000 7f869f924800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.787+0000 7f869f924800 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a0168d8920 0x55a0168dade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.787+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168db530 con 0x55a0168d8920 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.787+0000 7f869bd57640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a0168d8920 0x55a0168dade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.787+0000 7f869bd57640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a0168d8920 0x55a0168dade0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.787+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.787+0000 7f869f924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.787+0000 7f869f924800 20 realm 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.787+0000 7f869f924800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.787+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168db940 con 0x55a0168d8920 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869f924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869f924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869f924800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x55a0168d8920 2024-09-10T05:13:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869f924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869f924800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc5b0 con 0x55a0168d8920 2024-09-10T05:13:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869f924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869f924800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869f924800 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a0168dcf70 0x55a0168df360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168df9b0 con 0x55a0168dcf70 2024-09-10T05:13:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.788+0000 7f869b556640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a0168dcf70 0x55a0168df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.789+0000 7f869b556640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a0168dcf70 0x55a0168df360 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.789+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.789+0000 7f869f924800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.789+0000 7f869f924800 20 searching for the correct realm 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.789+0000 7f869f924800 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a0168e1940 0x55a0168e3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.789+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e4480 con 0x55a0168e1940 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.789+0000 7f869ad55640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a0168e1940 0x55a0168e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.789+0000 7f869ad55640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a0168e1940 0x55a0168e3e00 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.789+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.790+0000 7f869ad55640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f8684077040 0x7f8684084920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.790+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e4480 con 0x7f8684077040 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.790+0000 7f869bd57640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f8684077040 0x7f8684084920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.790+0000 7f869bd57640 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f8684077040 0x7f8684084920 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.790+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.790+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x55a0168dcf70 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.790+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.790+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x55a0168d8920 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.791+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.791+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x55a0168d8920 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.791+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.791+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x55a0168dcf70 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.791+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.791+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x55a0168dcf70 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.791+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.791+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x7f8684077040 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.792+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.792+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x55a0168e1940 2024-09-10T05:13:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.792+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.792+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x55a0168d8920 2024-09-10T05:13:34.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.792+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.792+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x55a0168dcf70 2024-09-10T05:13:34.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.792+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.792+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x55a0168d8920 2024-09-10T05:13:34.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.793+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.793+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x7f8684077040 2024-09-10T05:13:34.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.793+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.793+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dc210 con 0x55a0168e1940 2024-09-10T05:13:34.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.793+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.793+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168e1940 2024-09-10T05:13:34.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.793+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.793+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168dcf70 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.794+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.794+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168e1940 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.794+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.794+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168e1940 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.794+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.794+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168d8920 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.794+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.794+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168d8920 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.795+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.795+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x7f8684077040 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.795+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.795+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168e1940 2024-09-10T05:13:34.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.795+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.795+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x7f8684077040 2024-09-10T05:13:34.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.795+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.795+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168d8920 2024-09-10T05:13:34.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.796+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.796+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168dcf70 2024-09-10T05:13:34.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.796+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.796+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168e1940 2024-09-10T05:13:34.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.796+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.796+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168dcf70 2024-09-10T05:13:34.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.796+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.796+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x7f8684077040 2024-09-10T05:13:34.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.797+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.797+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168e1940 2024-09-10T05:13:34.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.797+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.797+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x7f8684077040 2024-09-10T05:13:34.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.797+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.797+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x55a0168d8920 2024-09-10T05:13:34.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.797+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.797+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f8684091040 con 0x7f8684077040 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dfd50 con 0x55a0168d8920 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dfd50 con 0x55a0168d8920 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168dfd50 con 0x7f8684077040 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 zone default found 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 4 Realm: () 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 zonegroup default 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.798+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e01f0 con 0x55a0168dcf70 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869f924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869f924800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e62f0 con 0x55a0168e1940 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869f924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869f924800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e6690 con 0x55a0168e1940 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869f924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869f924800 20 started sync module instance, tier type = 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869f924800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.799+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e5790 con 0x7f8684077040 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.800+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.800+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94146061556912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e5790 con 0x7f8684077040 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.800+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e7050 con 0x55a0168d8920 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.801+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94146061556912] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.801+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.801+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94146061554880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e7050 con 0x55a0168d8920 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.801+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e7050 con 0x55a0168e1940 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.803+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.803+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94146061554880] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.803+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94146061560736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e7cb0 con 0x55a0168e1940 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.803+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e87b0 con 0x7f8684077040 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.804+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94146061560736] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.804+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.804+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94146061566624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e8bd0 con 0x7f8684077040 2024-09-10T05:13:34.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.804+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e95f0 con 0x55a0168d8920 2024-09-10T05:13:34.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.805+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94146061566624] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.805+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.805+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94146061570272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e95b0 con 0x55a0168d8920 2024-09-10T05:13:34.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.805+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168ea030 con 0x55a0168dcf70 2024-09-10T05:13:34.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.806+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.806+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94146061572992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168ea8d0 con 0x55a0168dcf70 2024-09-10T05:13:34.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.806+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168eb3c0 con 0x55a0168dcf70 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.806+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94146061570272] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.807+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94146061572992] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.807+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.807+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94146061575200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e77a0 con 0x55a0168dcf70 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.807+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168ebc60 con 0x55a0168dcf70 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.808+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94146061575200] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.808+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.808+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94146061580048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168ebc20 con 0x55a0168dcf70 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.808+0000 7f869f924800 20 add_watcher() i=0 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.808+0000 7f869f924800 20 add_watcher() i=1 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.808+0000 7f869f924800 20 add_watcher() i=2 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.808+0000 7f869f924800 20 add_watcher() i=3 2024-09-10T05:13:34.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.808+0000 7f869f924800 20 add_watcher() i=4 2024-09-10T05:13:34.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.808+0000 7f869f924800 20 add_watcher() i=5 2024-09-10T05:13:34.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.808+0000 7f869f924800 20 add_watcher() i=6 2024-09-10T05:13:34.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.810+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94146061580048] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.810+0000 7f869f924800 20 add_watcher() i=7 2024-09-10T05:13:34.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.810+0000 7f869f924800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:34.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.810+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0168ef0b0 con 0x55a0168d8920 2024-09-10T05:13:34.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.811+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.811+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94146061577872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168ec600 con 0x55a0168d8920 2024-09-10T05:13:34.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.812+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94146061577872] v37'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.812+0000 7f8551fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.812+0000 7f869f924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:34.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.812+0000 7f869f924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.812+0000 7f869f924800 5 note: GC not initialized 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.812+0000 7f8550fe1640 20 reqs_thread_entry: start 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.812+0000 7f869f924800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.812+0000 7f869f924800 20 Filter name: none 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.812+0000 7f84ca7fc640 20 reqs_thread_entry: start 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.812+0000 7f869f924800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.812+0000 7f869f924800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.812+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0169221a0 con 0x55a0168dcf70 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.813+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.813+0000 7f869f924800 20 rados_obj.operate() r=0 bl.length=503 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.813+0000 7f869f924800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.813+0000 7f869f924800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.813+0000 7f869f924800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:34.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.813+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0169289c0 con 0x55a0168dcf70 2024-09-10T05:13:34.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.814+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v37'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.814+0000 7f869f924800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:34.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.814+0000 7f869f924800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.814+0000 7f869f924800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:13:34.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.814+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94146061829088 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a0169240e0 con 0x55a0168d8920 2024-09-10T05:13:34.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.815+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== watch-notify(notify (1) cookie 94146061570272 notify 158913789979 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f8694010040 con 0x55a0168d8920 2024-09-10T05:13:34.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.815+0000 7f857effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789979 cookie 94146061570272 notifier 4903 bl.length()=636 2024-09-10T05:13:34.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.815+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 notify.4 [notify cookie 94146061829088 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.815+0000 7f857effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:34.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.815+0000 7f857effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.815+0000 7f857effd640 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f8560003ea0 con 0x55a0168d8920 2024-09-10T05:13:34.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.815+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.815+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== watch-notify(notify_complete (2) cookie 94146061829088 notify 158913789979 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8694029420 con 0x55a0168d8920 2024-09-10T05:13:34.827 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:13:33.468641Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:13:33.468623Z","tags":[],"group_ids":[]} 2024-09-10T05:13:34.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.816+0000 7f8551fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.816+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94146061577872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a016920000 con 0x55a0168d8920 2024-09-10T05:13:34.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.817+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94146061577872] v37'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.817+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94146061556912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a016920000 con 0x7f8684077040 2024-09-10T05:13:34.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.818+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94146061556912] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.818+0000 7f869f924800 20 remove_watcher() i=0 2024-09-10T05:13:34.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.818+0000 7f869f924800 2 removed watcher, disabling cache 2024-09-10T05:13:34.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.818+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94146061554880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a016920000 con 0x55a0168d8920 2024-09-10T05:13:34.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.819+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94146061554880] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.819+0000 7f869f924800 20 remove_watcher() i=1 2024-09-10T05:13:34.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.819+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94146061560736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a016920000 con 0x55a0168e1940 2024-09-10T05:13:34.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.820+0000 7f869ad55640 1 -- 172.21.15.192:0/1846688758 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94146061560736] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684082070 con 0x55a0168e1940 2024-09-10T05:13:34.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.820+0000 7f869f924800 20 remove_watcher() i=2 2024-09-10T05:13:34.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.820+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94146061566624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e6ba0 con 0x7f8684077040 2024-09-10T05:13:34.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.821+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94146061566624] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x7f8684077040 2024-09-10T05:13:34.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.821+0000 7f869f924800 20 remove_watcher() i=3 2024-09-10T05:13:34.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.821+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94146061570272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e82a0 con 0x55a0168d8920 2024-09-10T05:13:34.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.822+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94146061570272] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86940083e0 con 0x55a0168d8920 2024-09-10T05:13:34.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.822+0000 7f869f924800 20 remove_watcher() i=4 2024-09-10T05:13:34.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.822+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94146061572992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e90e0 con 0x55a0168dcf70 2024-09-10T05:13:34.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.823+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94146061572992] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.823+0000 7f869f924800 20 remove_watcher() i=5 2024-09-10T05:13:34.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.823+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94146061575200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168e82a0 con 0x55a0168dcf70 2024-09-10T05:13:34.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.824+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94146061575200] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.824+0000 7f869f924800 20 remove_watcher() i=6 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.824+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94146061580048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a0168ea420 con 0x55a0168dcf70 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.825+0000 7f869b556640 1 -- 172.21.15.192:0/1846688758 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94146061580048] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f868c01b070 con 0x55a0168dcf70 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.825+0000 7f869f924800 20 remove_watcher() i=7 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.825+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a0168dcf70 msgr2=0x55a0168df360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.825+0000 7f869f924800 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a0168dcf70 0x55a0168df360 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.825+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a0168d8920 msgr2=0x55a0168dade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.825+0000 7f869f924800 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a0168d8920 0x55a0168dade0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.825+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f8684077040 msgr2=0x7f8684084920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.825+0000 7f869f924800 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f8684077040 0x7f8684084920 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.825+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a0168e1940 msgr2=0x55a0168e3e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.825+0000 7f869f924800 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55a0168e1940 0x55a0168e3e00 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f856403c780 msgr2=0x7f856403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f856403c780 0x7f856403ec40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8684054fd0 tx=0x7f8684051000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 msgr2=0x55a0168cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 0x55a0168cd3b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f868c014fd0 tx=0x7f868c004e70 comp rx=0 tx=0).stop 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869bd57640 1 -- 172.21.15.192:0/1846688758 reap_dead start 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 shutdown_connections 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 --2- 172.21.15.192:0/1846688758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168c5fb0 0x55a0168cd3b0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 >> 172.21.15.192:0/1846688758 conn(0x55a0168c23b0 msgr2=0x55a0168c05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 shutdown_connections 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/1846688758 wait complete. 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/4291351281 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f857403c730 msgr2=0x7f857403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 --2- 172.21.15.192:0/4291351281 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f857403c730 0x7f857403ebf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8684057040 tx=0x7f8684005a00 comp rx=0 tx=0).stop 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/4291351281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168b94d0 msgr2=0x55a0168b98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 --2- 172.21.15.192:0/4291351281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168b94d0 0x55a0168b98f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f868c0108f0 tx=0x7f868c010f60 comp rx=0 tx=0).stop 2024-09-10T05:13:34.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/4291351281 shutdown_connections 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 --2- 172.21.15.192:0/4291351281 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f857403c730 0x7f857403ebf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 --2- 172.21.15.192:0/4291351281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0168b94d0 0x55a0168b98f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/4291351281 >> 172.21.15.192:0/4291351281 conn(0x55a0168ad880 msgr2=0x55a0168adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/4291351281 shutdown_connections 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/4291351281 wait complete. 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a0168a4e50 msgr2=0x55a0168a7240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55a0168a4e50 0x55a0168a7240 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a0167a6210 msgr2=0x55a0168a25c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55a0167a6210 0x55a0168a25c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a0168a8d50 msgr2=0x55a0168ab140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55a0168a8d50 0x55a0168ab140 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f858003c730 msgr2=0x7f858003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f858003c730 0x7f858003ebf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8684056000 tx=0x7f8684050000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 msgr2=0x55a0167a1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869f924800 1 --2- 172.21.15.192:0/800483787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a0167a2610 0x55a0167a1d30 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f868c000f80 tx=0x7f868c001250 comp rx=0 tx=0).stop 2024-09-10T05:13:34.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.826+0000 7f869bd57640 1 -- 172.21.15.192:0/800483787 reap_dead start 2024-09-10T05:13:34.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.827+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 shutdown_connections 2024-09-10T05:13:34.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.827+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 >> 172.21.15.192:0/800483787 conn(0x55a01679c1d0 msgr2=0x55a016892a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.827+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 shutdown_connections 2024-09-10T05:13:34.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.827+0000 7f869f924800 1 -- 172.21.15.192:0/800483787 wait complete. 2024-09-10T05:13:34.838 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:34.838 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:34.838 ERROR:root:0 2024-09-10T05:13:34.838 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T05:13:34.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T05:13:34.838 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-10T05:13:34.885 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:34.885 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:34.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.885+0000 7f8724546800 1 Processor -- start 2024-09-10T05:13:34.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.885+0000 7f8724546800 1 -- start start 2024-09-10T05:13:34.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.885+0000 7f8724546800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55abb7fce4b0 0x55abb7fce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.885+0000 7f8724546800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55abb7e79e40 con 0x55abb7fcedf0 2024-09-10T05:13:34.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.885+0000 7f8724546800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55abb7e44680 con 0x55abb7fce4b0 2024-09-10T05:13:34.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.886+0000 7f8722037640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55abb7fce4b0 0x55abb7fce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.886+0000 7f8721836640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55abb7fcedf0 0x55abb7fcf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46594/0 (socket says 172.21.15.192:46594) 2024-09-10T05:13:34.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.886+0000 7f8721836640 1 -- 172.21.15.192:0/2577447802 learned_addr learned my addr 172.21.15.192:0/2577447802 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:34.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.886+0000 7f8722037640 1 -- 172.21.15.192:0/2577447802 >> v1:172.21.15.139:6789/0 conn(0x55abb7fcedf0 legacy=0x55abb7fcf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.886+0000 7f8721035640 1 -- 172.21.15.192:0/2577447802 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1023595201 0 0) 0x55abb7e79e40 con 0x55abb7fcedf0 2024-09-10T05:13:34.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.886+0000 7f8722037640 1 -- 172.21.15.192:0/2577447802 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb7e606b0 con 0x55abb7fce4b0 2024-09-10T05:13:34.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.888+0000 7f8722037640 1 --2- 172.21.15.192:0/2577447802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb7fce8b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8714005fd0 tx=0x7f8714045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb8c776717ca006 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.888+0000 7f8721035640 1 -- 172.21.15.192:0/2577447802 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8714058530 con 0x55abb7fce4b0 2024-09-10T05:13:34.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.888+0000 7f8721035640 1 -- 172.21.15.192:0/2577447802 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87140586d0 con 0x55abb7fce4b0 2024-09-10T05:13:34.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.888+0000 7f8721035640 1 -- 172.21.15.192:0/2577447802 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87140589d0 con 0x55abb7fce4b0 2024-09-10T05:13:34.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.889+0000 7f8724546800 1 -- 172.21.15.192:0/2577447802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 msgr2=0x55abb7fce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.889+0000 7f8724546800 1 --2- 172.21.15.192:0/2577447802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb7fce8b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8714005fd0 tx=0x7f8714045c30 comp rx=0 tx=0).stop 2024-09-10T05:13:34.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.889+0000 7f8724546800 1 -- 172.21.15.192:0/2577447802 shutdown_connections 2024-09-10T05:13:34.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.889+0000 7f8724546800 1 --2- 172.21.15.192:0/2577447802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb7fce8b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.889+0000 7f8724546800 1 -- 172.21.15.192:0/2577447802 >> 172.21.15.192:0/2577447802 conn(0x55abb7fca200 msgr2=0x55abb7fcc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.889+0000 7f8724546800 1 -- 172.21.15.192:0/2577447802 shutdown_connections 2024-09-10T05:13:34.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.889+0000 7f8724546800 1 -- 172.21.15.192:0/2577447802 wait complete. 2024-09-10T05:13:34.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.903+0000 7f8724546800 1 Processor -- start 2024-09-10T05:13:34.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.903+0000 7f8724546800 1 -- start start 2024-09-10T05:13:34.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.903+0000 7f8724546800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb80c1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.903+0000 7f8724546800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55abb7e68dd0 con 0x55abb7fce4b0 2024-09-10T05:13:34.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.903+0000 7f8722037640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb80c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.903+0000 7f8722037640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb80c1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34228/0 (socket says 172.21.15.192:34228) 2024-09-10T05:13:34.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.903+0000 7f8722037640 1 -- 172.21.15.192:0/1249519712 learned_addr learned my addr 172.21.15.192:0/1249519712 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.903+0000 7f8722037640 1 -- 172.21.15.192:0/1249519712 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb7e81e10 con 0x55abb7fce4b0 2024-09-10T05:13:34.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.904+0000 7f8722037640 1 --2- 172.21.15.192:0/1249519712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb80c1720 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8714025a60 tx=0x7f8714051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8b4a8c916c8360 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.904+0000 7f8610608640 1 -- 172.21.15.192:0/1249519712 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8714068070 con 0x55abb7fce4b0 2024-09-10T05:13:34.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.904+0000 7f8610608640 1 -- 172.21.15.192:0/1249519712 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8714058880 con 0x55abb7fce4b0 2024-09-10T05:13:34.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.904+0000 7f8610608640 1 -- 172.21.15.192:0/1249519712 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8714058ba0 con 0x55abb7fce4b0 2024-09-10T05:13:34.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.904+0000 7f8724546800 1 -- 172.21.15.192:0/1249519712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 msgr2=0x55abb80c1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.904+0000 7f8724546800 1 --2- 172.21.15.192:0/1249519712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb80c1720 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8714025a60 tx=0x7f8714051000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.904+0000 7f8724546800 1 -- 172.21.15.192:0/1249519712 shutdown_connections 2024-09-10T05:13:34.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.904+0000 7f8724546800 1 --2- 172.21.15.192:0/1249519712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb80c1720 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.904+0000 7f8724546800 1 -- 172.21.15.192:0/1249519712 >> 172.21.15.192:0/1249519712 conn(0x55abb7fca200 msgr2=0x55abb80bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.905+0000 7f8724546800 1 -- 172.21.15.192:0/1249519712 shutdown_connections 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.905+0000 7f8724546800 1 -- 172.21.15.192:0/1249519712 wait complete. 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.905+0000 7f8724546800 1 Processor -- start 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.905+0000 7f8724546800 1 -- start start 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.905+0000 7f8724546800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb80c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.905+0000 7f8724546800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55abb7fcfd70 con 0x55abb7fce4b0 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.905+0000 7f8722037640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb80c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.905+0000 7f8722037640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb80c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34244/0 (socket says 172.21.15.192:34244) 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.905+0000 7f8722037640 1 -- 172.21.15.192:0/3426413216 learned_addr learned my addr 172.21.15.192:0/3426413216 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.905+0000 7f8722037640 1 -- 172.21.15.192:0/3426413216 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb80c9550 con 0x55abb7fce4b0 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.906+0000 7f8722037640 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb80c8ff0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8714025a60 tx=0x7f8714003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.906+0000 7f860ee05640 1 -- 172.21.15.192:0/3426413216 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8714068040 con 0x55abb7fce4b0 2024-09-10T05:13:34.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.906+0000 7f860ee05640 1 -- 172.21.15.192:0/3426413216 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8714071070 con 0x55abb7fce4b0 2024-09-10T05:13:34.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.906+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abb80c97e0 con 0x55abb7fce4b0 2024-09-10T05:13:34.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.906+0000 7f860ee05640 1 -- 172.21.15.192:0/3426413216 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87140637b0 con 0x55abb7fce4b0 2024-09-10T05:13:34.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.906+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb80ca160 con 0x55abb7fce4b0 2024-09-10T05:13:34.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.907+0000 7f860ee05640 1 -- 172.21.15.192:0/3426413216 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8714063950 con 0x55abb7fce4b0 2024-09-10T05:13:34.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.907+0000 7f860ee05640 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f860803c780 0x7f860803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.907+0000 7f860ee05640 1 -- 172.21.15.192:0/3426413216 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f8714097520 con 0x55abb7fce4b0 2024-09-10T05:13:34.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.907+0000 7f8721836640 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f860803c780 0x7f860803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.907+0000 7f8724546800 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55abb7fcedf0 0x55abb80d0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.907+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb80cadb0 con 0x55abb7fcedf0 2024-09-10T05:13:34.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.908+0000 7f8722838640 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55abb7fcedf0 0x55abb80d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.908+0000 7f8721836640 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f860803c780 0x7f860803ec40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8718000c00 tx=0x7f87180013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.908+0000 7f8722838640 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55abb7fcedf0 0x55abb80d0640 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.908+0000 7f8722838640 1 -- 172.21.15.192:0/3426413216 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f871c0083e0 con 0x55abb7fcedf0 2024-09-10T05:13:34.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.908+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb80ca640 con 0x55abb7fcedf0 2024-09-10T05:13:34.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.908+0000 7f8722838640 1 -- 172.21.15.192:0/3426413216 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f871c0083e0 con 0x55abb7fcedf0 2024-09-10T05:13:34.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.908+0000 7f8724546800 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55abb80d2af0 0x55abb80d4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.908+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb80d55b0 con 0x55abb80d2af0 2024-09-10T05:13:34.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.909+0000 7f8722037640 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55abb80d2af0 0x55abb80d4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.909+0000 7f8722037640 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55abb80d2af0 0x55abb80d4ee0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.909+0000 7f8722037640 1 -- 172.21.15.192:0/3426413216 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f87140769d0 con 0x55abb80d2af0 2024-09-10T05:13:34.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.909+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb80d1990 con 0x55abb7fcedf0 2024-09-10T05:13:34.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.909+0000 7f8722838640 1 -- 172.21.15.192:0/3426413216 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f871c0083e0 con 0x55abb7fcedf0 2024-09-10T05:13:34.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.909+0000 7f8724546800 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55abb80d69f0 0x55abb80d8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.910+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb80d9570 con 0x55abb80d69f0 2024-09-10T05:13:34.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.910+0000 7f8721836640 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55abb80d69f0 0x55abb80d8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.910+0000 7f8721836640 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55abb80d69f0 0x55abb80d8de0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.910+0000 7f8721836640 1 -- 172.21.15.192:0/3426413216 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f871800f670 con 0x55abb80d69f0 2024-09-10T05:13:34.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.911+0000 7f8724546800 1 Processor -- start 2024-09-10T05:13:34.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.911+0000 7f8724546800 1 -- start start 2024-09-10T05:13:34.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.911+0000 7f8724546800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80e7170 0x55abb80e7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.911+0000 7f8724546800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55abb7ec6a00 con 0x55abb80e7170 2024-09-10T05:13:34.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.911+0000 7f8722037640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80e7170 0x55abb80e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.911+0000 7f8722037640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80e7170 0x55abb80e7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34254/0 (socket says 172.21.15.192:34254) 2024-09-10T05:13:34.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.911+0000 7f8722037640 1 -- 172.21.15.192:0/2156411610 learned_addr learned my addr 172.21.15.192:0/2156411610 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.911+0000 7f8722037640 1 -- 172.21.15.192:0/2156411610 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb80e7bd0 con 0x55abb80e7170 2024-09-10T05:13:34.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.912+0000 7f8722037640 1 --2- 172.21.15.192:0/2156411610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80e7170 0x55abb80e7590 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8714095800 tx=0x7f871406e390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.912+0000 7f8607fff640 1 -- 172.21.15.192:0/2156411610 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87140972c0 con 0x55abb80e7170 2024-09-10T05:13:34.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.912+0000 7f8607fff640 1 -- 172.21.15.192:0/2156411610 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8714086070 con 0x55abb80e7170 2024-09-10T05:13:34.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.912+0000 7f8724546800 1 -- 172.21.15.192:0/2156411610 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abb80e8400 con 0x55abb80e7170 2024-09-10T05:13:34.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.912+0000 7f8607fff640 1 -- 172.21.15.192:0/2156411610 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8714095d20 con 0x55abb80e7170 2024-09-10T05:13:34.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.912+0000 7f8724546800 1 -- 172.21.15.192:0/2156411610 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb80e89a0 con 0x55abb80e7170 2024-09-10T05:13:34.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.912+0000 7f8607fff640 1 -- 172.21.15.192:0/2156411610 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8714088020 con 0x55abb80e7170 2024-09-10T05:13:34.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.913+0000 7f8607fff640 1 --2- 172.21.15.192:0/2156411610 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f85fc03c6e0 0x7f85fc03eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.913+0000 7f8607fff640 1 -- 172.21.15.192:0/2156411610 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f8714001250 con 0x55abb80e7170 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.913+0000 7f8721836640 1 --2- 172.21.15.192:0/2156411610 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f85fc03c6e0 0x7f85fc03eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.913+0000 7f8724546800 1 Processor -- start 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.913+0000 7f8724546800 1 -- start start 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.913+0000 7f8721836640 1 --2- 172.21.15.192:0/2156411610 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f85fc03c6e0 0x7f85fc03eba0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55abb80d0ce0 tx=0x7f8718006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.913+0000 7f8724546800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 0x55abb80f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.913+0000 7f8724546800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55abb80c1eb0 con 0x55abb80f3a30 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.913+0000 7f8722037640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 0x55abb80f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.913+0000 7f8722037640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 0x55abb80f3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34262/0 (socket says 172.21.15.192:34262) 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.913+0000 7f8722037640 1 -- 172.21.15.192:0/2249492977 learned_addr learned my addr 172.21.15.192:0/2249492977 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.914+0000 7f8722037640 1 -- 172.21.15.192:0/2249492977 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb80f4400 con 0x55abb80f3a30 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.914+0000 7f8722037640 1 --2- 172.21.15.192:0/2249492977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 0x55abb80f3e10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8714046130 tx=0x7f871408e7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7b6c70ee2f01cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.914+0000 7f8605ffb640 1 -- 172.21.15.192:0/2249492977 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87140a6070 con 0x55abb80f3a30 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.914+0000 7f8605ffb640 1 -- 172.21.15.192:0/2249492977 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8714082450 con 0x55abb80f3a30 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.914+0000 7f8605ffb640 1 -- 172.21.15.192:0/2249492977 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8714065760 con 0x55abb80f3a30 2024-09-10T05:13:34.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.914+0000 7f8724546800 1 -- 172.21.15.192:0/2249492977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 msgr2=0x55abb80f3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.914+0000 7f8724546800 1 --2- 172.21.15.192:0/2249492977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 0x55abb80f3e10 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8714046130 tx=0x7f871408e7a0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.914+0000 7f8724546800 1 -- 172.21.15.192:0/2249492977 shutdown_connections 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.914+0000 7f8724546800 1 --2- 172.21.15.192:0/2249492977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 0x55abb80f3e10 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.914+0000 7f8724546800 1 -- 172.21.15.192:0/2249492977 >> 172.21.15.192:0/2249492977 conn(0x55abb80efe30 msgr2=0x55abb80ee070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.914+0000 7f8724546800 1 -- 172.21.15.192:0/2249492977 shutdown_connections 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.914+0000 7f8724546800 1 -- 172.21.15.192:0/2249492977 wait complete. 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.915+0000 7f8724546800 1 Processor -- start 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.915+0000 7f8724546800 1 -- start start 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.915+0000 7f8724546800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 0x55abb80fae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.915+0000 7f8724546800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55abb80f4890 con 0x55abb80f3a30 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.915+0000 7f8722037640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 0x55abb80fae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.915+0000 7f8722037640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 0x55abb80fae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34270/0 (socket says 172.21.15.192:34270) 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.915+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 learned_addr learned my addr 172.21.15.192:0/2374035127 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:34.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.915+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb80fb3a0 con 0x55abb80f3a30 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.916+0000 7f8722037640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 0x55abb80fae40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8714046130 tx=0x7f871409ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.916+0000 7f85f3fff640 1 -- 172.21.15.192:0/2374035127 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8714065070 con 0x55abb80f3a30 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.916+0000 7f85f3fff640 1 -- 172.21.15.192:0/2374035127 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8714075ca0 con 0x55abb80f3a30 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.916+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abb80fb3a0 con 0x55abb80f3a30 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.916+0000 7f85f3fff640 1 -- 172.21.15.192:0/2374035127 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87140755e0 con 0x55abb80f3a30 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.916+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb80fb3a0 con 0x55abb80f3a30 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.916+0000 7f85f3fff640 1 -- 172.21.15.192:0/2374035127 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f87140bc060 con 0x55abb80f3a30 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.917+0000 7f85f3fff640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f85ec03c730 0x7f85ec03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.917+0000 7f85f3fff640 1 -- 172.21.15.192:0/2374035127 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f87140bfd10 con 0x55abb80f3a30 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.917+0000 7f8721836640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f85ec03c730 0x7f85ec03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.917+0000 7f8721836640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f85ec03c730 0x7f85ec03ebf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f871800ffd0 tx=0x7f8718023040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.917+0000 7f8724546800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.917+0000 7f8724546800 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55abb8106460 0x55abb8108920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.917+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109070 con 0x55abb8106460 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8722838640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55abb8106460 0x55abb8108920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8722838640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55abb8106460 0x55abb8108920 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f871c0083e0 con 0x55abb8106460 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8724546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8724546800 20 realm 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8724546800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109480 con 0x55abb8106460 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f871c0083e0 con 0x55abb8106460 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8724546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8724546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8724546800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb8106460 2024-09-10T05:13:34.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f871c0083e0 con 0x55abb8106460 2024-09-10T05:13:34.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8724546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8724546800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.918+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb810a0f0 con 0x55abb8106460 2024-09-10T05:13:34.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.919+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f871c0083e0 con 0x55abb8106460 2024-09-10T05:13:34.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.919+0000 7f8724546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.919+0000 7f8724546800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.919+0000 7f8724546800 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55abb810aab0 0x55abb810cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.919+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb810d4f0 con 0x55abb810aab0 2024-09-10T05:13:34.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.919+0000 7f8722037640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55abb810aab0 0x55abb810cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.919+0000 7f8722037640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55abb810aab0 0x55abb810cea0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.920+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.920+0000 7f8724546800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.920+0000 7f8724546800 20 searching for the correct realm 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.920+0000 7f8724546800 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55abb810f480 0x55abb8111940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.920+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8111fc0 con 0x55abb810f480 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.920+0000 7f8721836640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55abb810f480 0x55abb8111940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.920+0000 7f8721836640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55abb810f480 0x55abb8111940 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.920+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.920+0000 7f8721836640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f871802e910 0x7f871803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.920+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8111fc0 con 0x7f871802e910 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.920+0000 7f8722838640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f871802e910 0x7f871803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.921+0000 7f8722838640 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f871802e910 0x7f871803a3c0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.921+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f871c0083e0 con 0x7f871802e910 2024-09-10T05:13:34.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.921+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810aab0 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.921+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.921+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb8106460 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.922+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c0083e0 con 0x55abb8106460 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.922+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb8106460 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.922+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c026040 con 0x55abb8106460 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.922+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810aab0 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.922+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.922+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810aab0 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.922+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.922+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x7f871802e910 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.922+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c026040 con 0x7f871802e910 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.922+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810f480 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.923+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.923+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb8106460 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.923+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c026040 con 0x55abb8106460 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.923+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810aab0 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.923+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.923+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb8106460 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.923+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c026040 con 0x55abb8106460 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.923+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x7f871802e910 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.924+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f871c026040 con 0x7f871802e910 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.924+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810f480 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.924+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.924+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810f480 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.924+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.924+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810aab0 2024-09-10T05:13:34.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.924+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.924+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810f480 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.925+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.925+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810f480 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.925+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.925+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb8106460 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.925+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c026040 con 0x55abb8106460 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.925+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb8106460 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.925+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f871c026040 con 0x55abb8106460 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.925+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x7f871802e910 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.925+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c026040 con 0x7f871802e910 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.925+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810f480 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.926+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.926+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x7f871802e910 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.926+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c026040 con 0x7f871802e910 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.926+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb8106460 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.926+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.926+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810aab0 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.926+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.926+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810f480 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.927+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.927+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810aab0 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.927+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.927+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x7f871802e910 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.927+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c035040 con 0x7f871802e910 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.927+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb810f480 2024-09-10T05:13:34.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.927+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.927+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x7f871802e910 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c035040 con 0x7f871802e910 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f871c03a040 con 0x55abb8106460 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f871c03a040 con 0x7f871802e910 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871c035040 con 0x7f871802e910 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8724546800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8724546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8724546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8724546800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8724546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8724546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8724546800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb8106460 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8724546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8724546800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.928+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x55abb8106460 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb8109d50 con 0x7f871802e910 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f871c035040 con 0x7f871802e910 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 20 zone default found 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 4 Realm: () 2024-09-10T05:13:34.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:34.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:34.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:34.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 20 zonegroup default 2024-09-10T05:13:34.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb810de50 con 0x55abb810aab0 2024-09-10T05:13:34.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb8113900 con 0x55abb810f480 2024-09-10T05:13:34.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.929+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.930+0000 7f8724546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.930+0000 7f8724546800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.930+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb8113ca0 con 0x55abb810f480 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.930+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.930+0000 7f8724546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.930+0000 7f8724546800 20 started sync module instance, tier type = 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.930+0000 7f8724546800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.930+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8112d90 con 0x7f871802e910 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.931+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x7f871802e910 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.931+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94196015903408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8112d90 con 0x7f871802e910 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.931+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8114830 con 0x55abb8106460 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.932+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94196015903408] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x7f871802e910 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.932+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.932+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94196015907584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8112d90 con 0x55abb8106460 2024-09-10T05:13:34.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.932+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb81152c0 con 0x55abb810f480 2024-09-10T05:13:34.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.933+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.933+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94196015910288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8115b60 con 0x55abb810f480 2024-09-10T05:13:34.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.933+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8116600 con 0x7f871802e910 2024-09-10T05:13:34.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.934+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94196015907584] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.934+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94196015910288] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.934+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x7f871802e910 2024-09-10T05:13:34.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.934+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94196015912624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb81128e0 con 0x7f871802e910 2024-09-10T05:13:34.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.935+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8116ed0 con 0x55abb8106460 2024-09-10T05:13:34.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.936+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.936+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94196015912624] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x7f871802e910 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.936+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94196015917472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8117270 con 0x55abb8106460 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.936+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8116130 con 0x55abb810aab0 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.937+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94196015917472] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.937+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.937+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94196015919008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8117d10 con 0x55abb810aab0 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.937+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb81186d0 con 0x55abb810aab0 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.938+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94196015919008] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.938+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.938+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94196015921248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8118f20 con 0x55abb810aab0 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.938+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb81197b0 con 0x55abb810aab0 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.939+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94196015921248] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.939+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.939+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94196015925872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8119990 con 0x55abb810aab0 2024-09-10T05:13:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.939+0000 7f8724546800 20 add_watcher() i=0 2024-09-10T05:13:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.939+0000 7f8724546800 20 add_watcher() i=1 2024-09-10T05:13:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.939+0000 7f8724546800 20 add_watcher() i=2 2024-09-10T05:13:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.939+0000 7f8724546800 20 add_watcher() i=3 2024-09-10T05:13:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.939+0000 7f8724546800 20 add_watcher() i=4 2024-09-10T05:13:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.939+0000 7f8724546800 20 add_watcher() i=5 2024-09-10T05:13:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.939+0000 7f8724546800 20 add_watcher() i=6 2024-09-10T05:13:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.940+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94196015925872] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.940+0000 7f8724546800 20 add_watcher() i=7 2024-09-10T05:13:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.940+0000 7f8724546800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.940+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb811cd60 con 0x55abb8106460 2024-09-10T05:13:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.940+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.940+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94196015929472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb811a150 con 0x55abb8106460 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.942+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94196015929472] v37'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.943+0000 7f85d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.943+0000 7f8724546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.943+0000 7f8724546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.943+0000 7f8724546800 5 note: GC not initialized 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.943+0000 7f85537fe640 20 reqs_thread_entry: start 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.943+0000 7f8724546800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.943+0000 7f8724546800 20 Filter name: none 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.943+0000 7f85517fa640 20 reqs_thread_entry: start 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.943+0000 7f8724546800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.943+0000 7f8724546800 20 rados->read ofs=0 len=0 2024-09-10T05:13:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.943+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb814fcd0 con 0x55abb810aab0 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.944+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.944+0000 7f8724546800 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.944+0000 7f8724546800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.944+0000 7f8724546800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.944+0000 7f8724546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.944+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8156140 con 0x55abb810aab0 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v37'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8724546800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8724546800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8724546800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94196016175872 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55abb8151760 con 0x55abb8106460 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== watch-notify(notify (1) cookie 94196015917472 notify 158913789980 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f871c010040 con 0x55abb8106460 2024-09-10T05:13:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8605ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789980 cookie 94196015917472 notifier 4910 bl.length()=666 2024-09-10T05:13:34.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 notify.4 [notify cookie 94196016175872 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8605ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:34.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8605ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:34.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8605ffb640 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f85e8003ea0 con 0x55abb8106460 2024-09-10T05:13:34.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.946+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== watch-notify(notify_complete (2) cookie 94196016175872 notify 158913789980 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f871c00ad80 con 0x55abb8106460 2024-09-10T05:13:34.954 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:13:33.468641Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:13:33.468623Z","tags":[],"group_ids":[]} 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.947+0000 7f85d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.947+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94196015929472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb814db40 con 0x55abb8106460 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.948+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94196015929472] v37'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.948+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94196015903408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb814db40 con 0x7f871802e910 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.949+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94196015903408] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x7f871802e910 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.949+0000 7f8724546800 20 remove_watcher() i=0 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.949+0000 7f8724546800 2 removed watcher, disabling cache 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.949+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94196015907584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb814db40 con 0x55abb8106460 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.950+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94196015907584] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.950+0000 7f8724546800 20 remove_watcher() i=1 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.950+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94196015910288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb814db40 con 0x55abb810f480 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.951+0000 7f8721836640 1 -- 172.21.15.192:0/2374035127 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94196015910288] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8718037040 con 0x55abb810f480 2024-09-10T05:13:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.951+0000 7f8724546800 20 remove_watcher() i=2 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.951+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94196015912624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8114d90 con 0x7f871802e910 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.952+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94196015912624] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x7f871802e910 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.952+0000 7f8724546800 20 remove_watcher() i=3 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.952+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94196015917472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8114d90 con 0x55abb8106460 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.953+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94196015917472] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871c035040 con 0x55abb8106460 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.953+0000 7f8724546800 20 remove_watcher() i=4 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.953+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94196015919008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb81169a0 con 0x55abb810aab0 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.954+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94196015919008] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.954+0000 7f8724546800 20 remove_watcher() i=5 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.954+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94196015921248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb8114d90 con 0x55abb810aab0 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.955+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94196015921248] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.955+0000 7f8724546800 20 remove_watcher() i=6 2024-09-10T05:13:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.955+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94196015925872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55abb81169a0 con 0x55abb810aab0 2024-09-10T05:13:34.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.956+0000 7f8722037640 1 -- 172.21.15.192:0/2374035127 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94196015925872] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87140769d0 con 0x55abb810aab0 2024-09-10T05:13:34.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.956+0000 7f8724546800 20 remove_watcher() i=7 2024-09-10T05:13:34.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.956+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55abb810aab0 msgr2=0x55abb810cea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.956+0000 7f8724546800 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55abb810aab0 0x55abb810cea0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.956+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55abb8106460 msgr2=0x55abb8108920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.956+0000 7f8724546800 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55abb8106460 0x55abb8108920 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.956+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f871802e910 msgr2=0x7f871803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.956+0000 7f8724546800 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f871802e910 0x7f871803a3c0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.956+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55abb810f480 msgr2=0x55abb8111940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.956+0000 7f8724546800 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55abb810f480 0x55abb8111940 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f85ec03c730 msgr2=0x7f85ec03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f85ec03c730 0x7f85ec03ebf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f871800ffd0 tx=0x7f8718023040 comp rx=0 tx=0).stop 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 msgr2=0x55abb80fae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 --2- 172.21.15.192:0/2374035127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80f3a30 0x55abb80fae40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8714046130 tx=0x7f871409ceb0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 reap_dead start 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8722838640 1 -- 172.21.15.192:0/2374035127 reap_dead start 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 shutdown_connections 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 >> 172.21.15.192:0/2374035127 conn(0x55abb80efe30 msgr2=0x55abb80ee040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 shutdown_connections 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/2374035127 wait complete. 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/2156411610 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f85fc03c6e0 msgr2=0x7f85fc03eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 --2- 172.21.15.192:0/2156411610 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f85fc03c6e0 0x7f85fc03eba0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55abb80d0ce0 tx=0x7f8718006000 comp rx=0 tx=0).stop 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/2156411610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80e7170 msgr2=0x55abb80e7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 --2- 172.21.15.192:0/2156411610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80e7170 0x55abb80e7590 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8714095800 tx=0x7f871406e390 comp rx=0 tx=0).stop 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/2156411610 shutdown_connections 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 --2- 172.21.15.192:0/2156411610 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f85fc03c6e0 0x7f85fc03eba0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 --2- 172.21.15.192:0/2156411610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb80e7170 0x55abb80e7590 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/2156411610 >> 172.21.15.192:0/2156411610 conn(0x55abb80db520 msgr2=0x55abb80db900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/2156411610 shutdown_connections 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/2156411610 wait complete. 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55abb80d2af0 msgr2=0x55abb80d4ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55abb80d2af0 0x55abb80d4ee0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55abb7fcedf0 msgr2=0x55abb80d0640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55abb7fcedf0 0x55abb80d0640 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55abb80d69f0 msgr2=0x55abb80d8de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.957+0000 7f8724546800 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55abb80d69f0 0x55abb80d8de0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.958+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f860803c780 msgr2=0x7f860803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.958+0000 7f8724546800 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f860803c780 0x7f860803ec40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8718000c00 tx=0x7f87180013b0 comp rx=0 tx=0).stop 2024-09-10T05:13:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.958+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 msgr2=0x55abb80c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.958+0000 7f8724546800 1 --2- 172.21.15.192:0/3426413216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55abb7fce4b0 0x55abb80c8ff0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8714025a60 tx=0x7f8714003330 comp rx=0 tx=0).stop 2024-09-10T05:13:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.958+0000 7f8722838640 1 -- 172.21.15.192:0/3426413216 reap_dead start 2024-09-10T05:13:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.958+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 shutdown_connections 2024-09-10T05:13:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.958+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 >> 172.21.15.192:0/3426413216 conn(0x55abb7fca200 msgr2=0x55abb80c28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.958+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 shutdown_connections 2024-09-10T05:13:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:34.958+0000 7f8724546800 1 -- 172.21.15.192:0/3426413216 wait complete. 2024-09-10T05:13:34.967 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:34.967 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:34.968 ERROR:root:0 2024-09-10T05:13:34.968 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:34.972 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000004b0cbfe237e170e7-0066dfd57e-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:13:34.972 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T05:13:34.973 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-10T05:13:34.973 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-10T05:13:35.019 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:35.019 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:35.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.019+0000 7f380c898800 1 Processor -- start 2024-09-10T05:13:35.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.019+0000 7f380c898800 1 -- start start 2024-09-10T05:13:35.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.019+0000 7f380c898800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5614c3d54510 0x5614c3d54910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.020+0000 7f380c898800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5614c3bfde40 con 0x5614c3d59330 2024-09-10T05:13:35.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.020+0000 7f380c898800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5614c3bc8680 con 0x5614c3d54510 2024-09-10T05:13:35.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.020+0000 7f380a382640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5614c3d54510 0x5614c3d54910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.020+0000 7f380a382640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x5614c3d54510 0x5614c3d54910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34274/0 (socket says 172.21.15.192:34274) 2024-09-10T05:13:35.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.020+0000 7f380a382640 1 -- 172.21.15.192:0/2446202181 learned_addr learned my addr 172.21.15.192:0/2446202181 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.020+0000 7f380a382640 1 -- 172.21.15.192:0/2446202181 >> v1:172.21.15.139:6789/0 conn(0x5614c3d59330 legacy=0x5614c3d5b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.020+0000 7f3809b81640 1 -- 172.21.15.192:0/2446202181 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809239844 0 0) 0x5614c3bfde40 con 0x5614c3d59330 2024-09-10T05:13:35.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.020+0000 7f380a382640 1 -- 172.21.15.192:0/2446202181 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614c3be46b0 con 0x5614c3d54510 2024-09-10T05:13:35.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.022+0000 7f380a382640 1 --2- 172.21.15.192:0/2446202181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3d54910 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00a520 tx=0x7f37fc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b60193756b9711 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.022+0000 7f3809b81640 1 -- 172.21.15.192:0/2446202181 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc055070 con 0x5614c3d54510 2024-09-10T05:13:35.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.022+0000 7f3809b81640 1 -- 172.21.15.192:0/2446202181 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37fc0515b0 con 0x5614c3d54510 2024-09-10T05:13:35.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.022+0000 7f3809b81640 1 -- 172.21.15.192:0/2446202181 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc0518d0 con 0x5614c3d54510 2024-09-10T05:13:35.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.022+0000 7f380c898800 1 -- 172.21.15.192:0/2446202181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 msgr2=0x5614c3d54910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.022+0000 7f380c898800 1 --2- 172.21.15.192:0/2446202181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3d54910 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00a520 tx=0x7f37fc045ba0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.022+0000 7f380c898800 1 -- 172.21.15.192:0/2446202181 shutdown_connections 2024-09-10T05:13:35.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.022+0000 7f380c898800 1 --2- 172.21.15.192:0/2446202181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3d54910 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.022+0000 7f380c898800 1 -- 172.21.15.192:0/2446202181 >> 172.21.15.192:0/2446202181 conn(0x5614c3d4d930 msgr2=0x5614c3d4fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.022+0000 7f380c898800 1 -- 172.21.15.192:0/2446202181 shutdown_connections 2024-09-10T05:13:35.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.023+0000 7f380c898800 1 -- 172.21.15.192:0/2446202181 wait complete. 2024-09-10T05:13:35.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.036+0000 7f380c898800 1 Processor -- start 2024-09-10T05:13:35.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.036+0000 7f380c898800 1 -- start start 2024-09-10T05:13:35.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.037+0000 7f380c898800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3e45740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.037+0000 7f380c898800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5614c3becdd0 con 0x5614c3d54510 2024-09-10T05:13:35.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.037+0000 7f380a382640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3e45740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.037+0000 7f380a382640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3e45740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34276/0 (socket says 172.21.15.192:34276) 2024-09-10T05:13:35.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.037+0000 7f380a382640 1 -- 172.21.15.192:0/1326043973 learned_addr learned my addr 172.21.15.192:0/1326043973 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.037+0000 7f380a382640 1 -- 172.21.15.192:0/1326043973 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614c3c05e10 con 0x5614c3d54510 2024-09-10T05:13:35.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.037+0000 7f380a382640 1 --2- 172.21.15.192:0/1326043973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3e45740 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f37fc025da0 tx=0x7f37fc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a347d6407569a4d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.037+0000 7f36f8608640 1 -- 172.21.15.192:0/1326043973 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc051950 con 0x5614c3d54510 2024-09-10T05:13:35.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.037+0000 7f36f8608640 1 -- 172.21.15.192:0/1326043973 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37fc051af0 con 0x5614c3d54510 2024-09-10T05:13:35.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.037+0000 7f36f8608640 1 -- 172.21.15.192:0/1326043973 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc051dd0 con 0x5614c3d54510 2024-09-10T05:13:35.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.038+0000 7f380c898800 1 -- 172.21.15.192:0/1326043973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 msgr2=0x5614c3e45740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.038+0000 7f380c898800 1 --2- 172.21.15.192:0/1326043973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3e45740 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f37fc025da0 tx=0x7f37fc051000 comp rx=0 tx=0).stop 2024-09-10T05:13:35.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.038+0000 7f380c898800 1 -- 172.21.15.192:0/1326043973 shutdown_connections 2024-09-10T05:13:35.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.038+0000 7f380c898800 1 --2- 172.21.15.192:0/1326043973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3e45740 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.038+0000 7f380c898800 1 -- 172.21.15.192:0/1326043973 >> 172.21.15.192:0/1326043973 conn(0x5614c3d4d930 msgr2=0x5614c3e410c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.038+0000 7f380c898800 1 -- 172.21.15.192:0/1326043973 shutdown_connections 2024-09-10T05:13:35.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.038+0000 7f380c898800 1 -- 172.21.15.192:0/1326043973 wait complete. 2024-09-10T05:13:35.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.038+0000 7f380c898800 1 Processor -- start 2024-09-10T05:13:35.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.038+0000 7f380c898800 1 -- start start 2024-09-10T05:13:35.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.039+0000 7f380c898800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3e4cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.039+0000 7f380c898800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5614c3d5d260 con 0x5614c3d54510 2024-09-10T05:13:35.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.039+0000 7f380a382640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3e4cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.039+0000 7f380a382640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3e4cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34278/0 (socket says 172.21.15.192:34278) 2024-09-10T05:13:35.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.039+0000 7f380a382640 1 -- 172.21.15.192:0/3542274013 learned_addr learned my addr 172.21.15.192:0/3542274013 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.039+0000 7f380a382640 1 -- 172.21.15.192:0/3542274013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614c3e4d440 con 0x5614c3d54510 2024-09-10T05:13:35.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.039+0000 7f380a382640 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3e4cee0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f37fc025da0 tx=0x7f37fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.040+0000 7f36f6e05640 1 -- 172.21.15.192:0/3542274013 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc05a600 con 0x5614c3d54510 2024-09-10T05:13:35.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.040+0000 7f36f6e05640 1 -- 172.21.15.192:0/3542274013 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37fc073070 con 0x5614c3d54510 2024-09-10T05:13:35.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.040+0000 7f36f6e05640 1 -- 172.21.15.192:0/3542274013 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc05a910 con 0x5614c3d54510 2024-09-10T05:13:35.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.040+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614c3e4d6d0 con 0x5614c3d54510 2024-09-10T05:13:35.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.040+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614c3e4e2e0 con 0x5614c3d54510 2024-09-10T05:13:35.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.040+0000 7f36f6e05640 1 -- 172.21.15.192:0/3542274013 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f37fc058070 con 0x5614c3d54510 2024-09-10T05:13:35.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.041+0000 7f36f6e05640 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36f003c780 0x7f36f003ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.041+0000 7f36f6e05640 1 -- 172.21.15.192:0/3542274013 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f37fc06b040 con 0x5614c3d54510 2024-09-10T05:13:35.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.041+0000 7f3801b81640 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36f003c780 0x7f36f003ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.041+0000 7f380c898800 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5614c3d59330 0x5614c3e54530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.041+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e54a70 con 0x5614c3d59330 2024-09-10T05:13:35.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.041+0000 7f380ab83640 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5614c3d59330 0x5614c3e54530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.041+0000 7f3801b81640 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36f003c780 0x7f36f003ec40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f37f4000f60 tx=0x7f37f40013f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.041+0000 7f380ab83640 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5614c3d59330 0x5614c3e54530 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.041+0000 7f380ab83640 1 -- 172.21.15.192:0/3542274013 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3d59330 2024-09-10T05:13:35.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.041+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e54e10 con 0x5614c3d59330 2024-09-10T05:13:35.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.042+0000 7f380ab83640 1 -- 172.21.15.192:0/3542274013 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3d59330 2024-09-10T05:13:35.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.042+0000 7f380c898800 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5614c3e56950 0x5614c3e58dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.042+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e59550 con 0x5614c3e56950 2024-09-10T05:13:35.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.042+0000 7f380a382640 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5614c3e56950 0x5614c3e58dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.042+0000 7f380a382640 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5614c3e56950 0x5614c3e58dc0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.043+0000 7f380a382640 1 -- 172.21.15.192:0/3542274013 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37fc057030 con 0x5614c3e56950 2024-09-10T05:13:35.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.043+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e55660 con 0x5614c3d59330 2024-09-10T05:13:35.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.043+0000 7f380ab83640 1 -- 172.21.15.192:0/3542274013 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3d59330 2024-09-10T05:13:35.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.043+0000 7f380c898800 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5614c3e5a9b0 0x5614c3e5cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.043+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e5d4e0 con 0x5614c3e5a9b0 2024-09-10T05:13:35.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.043+0000 7f3801b81640 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5614c3e5a9b0 0x5614c3e5cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.043+0000 7f3801b81640 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5614c3e5a9b0 0x5614c3e5cda0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.044+0000 7f3801b81640 1 -- 172.21.15.192:0/3542274013 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37f4010540 con 0x5614c3e5a9b0 2024-09-10T05:13:35.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.044+0000 7f380c898800 1 Processor -- start 2024-09-10T05:13:35.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.044+0000 7f380c898800 1 -- start start 2024-09-10T05:13:35.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.044+0000 7f380c898800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e6b120 0x5614c3e6b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.044+0000 7f380c898800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5614c3c4aa00 con 0x5614c3e6b120 2024-09-10T05:13:35.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.044+0000 7f380a382640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e6b120 0x5614c3e6b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.044+0000 7f380a382640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e6b120 0x5614c3e6b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34280/0 (socket says 172.21.15.192:34280) 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.044+0000 7f380a382640 1 -- 172.21.15.192:0/3450407220 learned_addr learned my addr 172.21.15.192:0/3450407220 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.045+0000 7f380a382640 1 -- 172.21.15.192:0/3450407220 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614c3e6bb80 con 0x5614c3e6b120 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.045+0000 7f380a382640 1 --2- 172.21.15.192:0/3450407220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e6b120 0x5614c3e6b540 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f37fc051580 tx=0x7f37fc050fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.045+0000 7f36effff640 1 -- 172.21.15.192:0/3450407220 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc05acc0 con 0x5614c3e6b120 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.045+0000 7f36effff640 1 -- 172.21.15.192:0/3450407220 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37fc064570 con 0x5614c3e6b120 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.045+0000 7f380c898800 1 -- 172.21.15.192:0/3450407220 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614c3e6c3b0 con 0x5614c3e6b120 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.045+0000 7f36effff640 1 -- 172.21.15.192:0/3450407220 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc05ae60 con 0x5614c3e6b120 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.045+0000 7f380c898800 1 -- 172.21.15.192:0/3450407220 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614c3e6c950 con 0x5614c3e6b120 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.046+0000 7f36effff640 1 -- 172.21.15.192:0/3450407220 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f37fc04f070 con 0x5614c3e6b120 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.046+0000 7f36effff640 1 --2- 172.21.15.192:0/3450407220 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36e403c730 0x7f36e403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.046+0000 7f36effff640 1 -- 172.21.15.192:0/3450407220 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f37fc088070 con 0x5614c3e6b120 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.046+0000 7f3801b81640 1 --2- 172.21.15.192:0/3450407220 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36e403c730 0x7f36e403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.046+0000 7f380c898800 1 Processor -- start 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.046+0000 7f380c898800 1 -- start start 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.046+0000 7f3801b81640 1 --2- 172.21.15.192:0/3450407220 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36e403c730 0x7f36e403ebf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f37f400c010 tx=0x7f37f4006000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.046+0000 7f380c898800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 0x5614c3e77d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.046+0000 7f380c898800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5614c3e45ed0 con 0x5614c3e77910 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f380a382640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 0x5614c3e77d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f380a382640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 0x5614c3e77d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34292/0 (socket says 172.21.15.192:34292) 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f380a382640 1 -- 172.21.15.192:0/225281836 learned_addr learned my addr 172.21.15.192:0/225281836 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f380a382640 1 -- 172.21.15.192:0/225281836 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614c3e78300 con 0x5614c3e77910 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f380a382640 1 --2- 172.21.15.192:0/225281836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 0x5614c3e77d10 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f37fc051ef0 tx=0x7f37fc06e3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc677a52a99ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f36edffb640 1 -- 172.21.15.192:0/225281836 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc08b410 con 0x5614c3e77910 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f36edffb640 1 -- 172.21.15.192:0/225281836 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37fc099d50 con 0x5614c3e77910 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f36edffb640 1 -- 172.21.15.192:0/225281836 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc0970b0 con 0x5614c3e77910 2024-09-10T05:13:35.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f380c898800 1 -- 172.21.15.192:0/225281836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 msgr2=0x5614c3e77d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f380c898800 1 --2- 172.21.15.192:0/225281836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 0x5614c3e77d10 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f37fc051ef0 tx=0x7f37fc06e3f0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f380c898800 1 -- 172.21.15.192:0/225281836 shutdown_connections 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f380c898800 1 --2- 172.21.15.192:0/225281836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 0x5614c3e77d10 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.047+0000 7f380c898800 1 -- 172.21.15.192:0/225281836 >> 172.21.15.192:0/225281836 conn(0x5614c3e73d10 msgr2=0x5614c3e71f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.048+0000 7f380c898800 1 -- 172.21.15.192:0/225281836 shutdown_connections 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.048+0000 7f380c898800 1 -- 172.21.15.192:0/225281836 wait complete. 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.048+0000 7f380c898800 1 Processor -- start 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.048+0000 7f380c898800 1 -- start start 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.048+0000 7f380c898800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 0x5614c3e7edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.048+0000 7f380c898800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5614c3e78770 con 0x5614c3e77910 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.048+0000 7f380a382640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 0x5614c3e7edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.048+0000 7f380a382640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 0x5614c3e7edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34298/0 (socket says 172.21.15.192:34298) 2024-09-10T05:13:35.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.048+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 learned_addr learned my addr 172.21.15.192:0/1641231540 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.048+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614c3e7f330 con 0x5614c3e77910 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.049+0000 7f380a382640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 0x5614c3e7edd0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0948c0 tx=0x7f37fc07deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.049+0000 7f36dbfff640 1 -- 172.21.15.192:0/1641231540 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc08b410 con 0x5614c3e77910 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.049+0000 7f36dbfff640 1 -- 172.21.15.192:0/1641231540 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37fc05ca60 con 0x5614c3e77910 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.049+0000 7f36dbfff640 1 -- 172.21.15.192:0/1641231540 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37fc05cc50 con 0x5614c3e77910 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.049+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614c3e7f330 con 0x5614c3e77910 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.049+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614c3e7f330 con 0x5614c3e77910 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.050+0000 7f36dbfff640 1 -- 172.21.15.192:0/1641231540 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f37fc0a8070 con 0x5614c3e77910 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.050+0000 7f36dbfff640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36d403c730 0x7f36d403ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.050+0000 7f36dbfff640 1 -- 172.21.15.192:0/1641231540 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f37fc0ae070 con 0x5614c3e77910 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.050+0000 7f3801b81640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36d403c730 0x7f36d403ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.050+0000 7f380c898800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.050+0000 7f380c898800 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5614c3e8a340 0x5614c3e8c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.050+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8cf50 con 0x5614c3e8a340 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.050+0000 7f3801b81640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36d403c730 0x7f36d403ebf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x5614c3e598f0 tx=0x7f37f4022040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.051+0000 7f380ab83640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5614c3e8a340 0x5614c3e8c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.051+0000 7f380ab83640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5614c3e8a340 0x5614c3e8c800 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.051+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.051+0000 7f380c898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.051+0000 7f380c898800 20 realm 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.051+0000 7f380c898800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.051+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8d360 con 0x5614c3e8a340 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.051+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.051+0000 7f380c898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.051+0000 7f380c898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.051+0000 7f380c898800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.051+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dc30 con 0x5614c3e8a340 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.052+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.052+0000 7f380c898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.052+0000 7f380c898800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.052+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8a340 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.052+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.052+0000 7f380c898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.052+0000 7f380c898800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.052+0000 7f380c898800 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5614c3e8ed30 0x5614c3e91120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.052+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e916e0 con 0x5614c3e8ed30 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.052+0000 7f380a382640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5614c3e8ed30 0x5614c3e91120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.052+0000 7f380a382640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5614c3e8ed30 0x5614c3e91120 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.053+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.053+0000 7f380c898800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.053+0000 7f380c898800 20 searching for the correct realm 2024-09-10T05:13:35.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.053+0000 7f380c898800 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5614c3e93690 0x5614c3e95b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.053+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e96220 con 0x5614c3e93690 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.053+0000 7f3801b81640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5614c3e93690 0x5614c3e95b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.053+0000 7f3801b81640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5614c3e93690 0x5614c3e95b50 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.053+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.053+0000 7f3801b81640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f37f402d910 0x7f37f40393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.053+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e96220 con 0x7f37f402d910 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.054+0000 7f380ab83640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f37f402d910 0x7f37f40393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.054+0000 7f380ab83640 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f37f402d910 0x7f37f40393c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.054+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.054+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8ed30 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.055+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.055+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8a340 2024-09-10T05:13:35.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.055+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.055+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8a340 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.055+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.055+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8ed30 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.055+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.055+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8ed30 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.055+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.055+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x7f37f402d910 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.056+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.056+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e93690 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.056+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.056+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8a340 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.056+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.056+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8ed30 2024-09-10T05:13:35.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.056+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.056+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8a340 2024-09-10T05:13:35.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.057+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.057+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x7f37f402d910 2024-09-10T05:13:35.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.057+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.057+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e93690 2024-09-10T05:13:35.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.057+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.057+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e93690 2024-09-10T05:13:35.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.057+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.057+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8ed30 2024-09-10T05:13:35.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.058+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.058+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e93690 2024-09-10T05:13:35.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.058+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.058+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e93690 2024-09-10T05:13:35.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.058+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.058+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8a340 2024-09-10T05:13:35.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.058+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.058+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8a340 2024-09-10T05:13:35.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.058+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.059+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x7f37f402d910 2024-09-10T05:13:35.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.059+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.059+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e93690 2024-09-10T05:13:35.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.059+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.059+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x7f37f402d910 2024-09-10T05:13:35.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.059+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.059+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8a340 2024-09-10T05:13:35.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.059+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.059+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8ed30 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.060+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.060+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e93690 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.060+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.060+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8ed30 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.060+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.060+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x7f37f402d910 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.060+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.060+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e93690 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x7f37f402d910 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x5614c3e8a340 2024-09-10T05:13:35.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e8dfd0 con 0x7f37f402d910 2024-09-10T05:13:35.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380c898800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:35.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380c898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:35.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380c898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:35.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380c898800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:35.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380c898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:35.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380c898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:35.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380c898800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e91fa0 con 0x5614c3e8a340 2024-09-10T05:13:35.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.061+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e91fa0 con 0x5614c3e8a340 2024-09-10T05:13:35.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:35.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e91fa0 con 0x7f37f402d910 2024-09-10T05:13:35.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:35.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 20 zone default found 2024-09-10T05:13:35.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 4 Realm: () 2024-09-10T05:13:35.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:35.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:35.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:35.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 20 zonegroup default 2024-09-10T05:13:35.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.062+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e91f90 con 0x5614c3e8ed30 2024-09-10T05:13:35.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f380c898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f380c898800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e98090 con 0x5614c3e93690 2024-09-10T05:13:35.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f380c898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f380c898800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e98430 con 0x5614c3e93690 2024-09-10T05:13:35.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f380c898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f380c898800 20 started sync module instance, tier type = 2024-09-10T05:13:35.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f380c898800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:35.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.063+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e97530 con 0x7f37f402d910 2024-09-10T05:13:35.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.064+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.064+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94647186193024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e97530 con 0x7f37f402d910 2024-09-10T05:13:35.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.064+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e98e50 con 0x5614c3e8a340 2024-09-10T05:13:35.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.065+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94647186193024] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.065+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.066+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94647186196800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e97530 con 0x5614c3e8a340 2024-09-10T05:13:35.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.066+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e998f0 con 0x5614c3e93690 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.067+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94647186196800] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.067+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.067+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94647186190464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e974a0 con 0x5614c3e93690 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.067+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9a7b0 con 0x7f37f402d910 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.067+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94647186190464] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.068+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.068+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94647186203392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9abd0 con 0x7f37f402d910 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.068+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9b590 con 0x5614c3e8a340 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.069+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.069+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94647186203392] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.069+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94647186206944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9b9b0 con 0x5614c3e8a340 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.069+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9a760 con 0x5614c3e8ed30 2024-09-10T05:13:35.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.070+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.070+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94647186206944] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.070+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94647186208480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9c3f0 con 0x5614c3e8ed30 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.070+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9cdb0 con 0x5614c3e8ed30 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.071+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94647186208480] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.071+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.071+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94647186210624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9d600 con 0x5614c3e8ed30 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.071+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9de90 con 0x5614c3e8ed30 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.072+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94647186210624] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.072+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.072+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94647186215248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9e130 con 0x5614c3e8ed30 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.072+0000 7f380c898800 20 add_watcher() i=0 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.072+0000 7f380c898800 20 add_watcher() i=1 2024-09-10T05:13:35.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.072+0000 7f380c898800 20 add_watcher() i=2 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.072+0000 7f380c898800 20 add_watcher() i=3 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.072+0000 7f380c898800 20 add_watcher() i=4 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.072+0000 7f380c898800 20 add_watcher() i=5 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.072+0000 7f380c898800 20 add_watcher() i=6 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.073+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94647186215248] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.073+0000 7f380c898800 20 add_watcher() i=7 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.073+0000 7f380c898800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.073+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3ea1670 con 0x5614c3e8a340 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.073+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.073+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94647186217440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9eaf0 con 0x5614c3e8a340 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.075+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94647186217440] v37'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.075+0000 7f36c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.075+0000 7f380c898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:35.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.075+0000 7f380c898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.075+0000 7f380c898800 5 note: GC not initialized 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.075+0000 7f363b7fe640 20 reqs_thread_entry: start 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.075+0000 7f380c898800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.075+0000 7f380c898800 20 Filter name: none 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.075+0000 7f36397fa640 20 reqs_thread_entry: start 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.075+0000 7f380c898800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.075+0000 7f380c898800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.075+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3ed45f0 con 0x5614c3e8ed30 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.076+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.076+0000 7f380c898800 20 rados_obj.operate() r=0 bl.length=490 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.076+0000 7f380c898800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.076+0000 7f380c898800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.076+0000 7f380c898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:35.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.076+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3edab50 con 0x5614c3e8ed30 2024-09-10T05:13:35.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.077+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v37'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.077+0000 7f380c898800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:35.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.077+0000 7f380c898800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:35.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.077+0000 7f380c898800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:13:35.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.077+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94647186466064 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5614c3ed6190 con 0x5614c3e8a340 2024-09-10T05:13:35.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.078+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== watch-notify(notify (1) cookie 94647186206944 notify 158913789981 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f3804018b40 con 0x5614c3e8a340 2024-09-10T05:13:35.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.078+0000 7f36edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789981 cookie 94647186206944 notifier 4917 bl.length()=636 2024-09-10T05:13:35.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.078+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 notify.4 [notify cookie 94647186466064 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.078+0000 7f36edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:35.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.078+0000 7f36edffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:35.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.078+0000 7f36edffb640 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f36d0003ea0 con 0x5614c3e8a340 2024-09-10T05:13:35.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.078+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.078+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== watch-notify(notify_complete (2) cookie 94647186466064 notify 158913789981 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3804018de0 con 0x5614c3e8a340 2024-09-10T05:13:35.091 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:13:33.468641Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:13:33.468623Z","tags":[],"group_ids":[]} 2024-09-10T05:13:35.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.079+0000 7f36c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:35.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.079+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94647186217440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3ed2420 con 0x5614c3e8a340 2024-09-10T05:13:35.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.080+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94647186217440] v37'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.080+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94647186193024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3ed2420 con 0x7f37f402d910 2024-09-10T05:13:35.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.081+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94647186193024] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.081+0000 7f380c898800 20 remove_watcher() i=0 2024-09-10T05:13:35.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.081+0000 7f380c898800 2 removed watcher, disabling cache 2024-09-10T05:13:35.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.081+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94647186196800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3ed2420 con 0x5614c3e8a340 2024-09-10T05:13:35.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.082+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94647186196800] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.082+0000 7f380c898800 20 remove_watcher() i=1 2024-09-10T05:13:35.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.082+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94647186190464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3ed2420 con 0x5614c3e93690 2024-09-10T05:13:35.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.083+0000 7f3801b81640 1 -- 172.21.15.192:0/1641231540 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94647186190464] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37f4036040 con 0x5614c3e93690 2024-09-10T05:13:35.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.083+0000 7f380c898800 20 remove_watcher() i=2 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.083+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94647186203392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e97080 con 0x7f37f402d910 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.084+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94647186203392] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x7f37f402d910 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.084+0000 7f380c898800 20 remove_watcher() i=3 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.084+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94647186206944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e97080 con 0x5614c3e8a340 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.085+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94647186206944] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400a4d0 con 0x5614c3e8a340 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.085+0000 7f380c898800 20 remove_watcher() i=4 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.085+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94647186208480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9b0e0 con 0x5614c3e8ed30 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.087+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94647186208480] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.087+0000 7f380c898800 20 remove_watcher() i=5 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.087+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94647186210624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e97080 con 0x5614c3e8ed30 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.088+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94647186210624] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.088+0000 7f380c898800 20 remove_watcher() i=6 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.088+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94647186215248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5614c3e9b6e0 con 0x5614c3e8ed30 2024-09-10T05:13:35.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380a382640 1 -- 172.21.15.192:0/1641231540 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94647186215248] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37fc0c1020 con 0x5614c3e8ed30 2024-09-10T05:13:35.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 20 remove_watcher() i=7 2024-09-10T05:13:35.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5614c3e8ed30 msgr2=0x5614c3e91120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5614c3e8ed30 0x5614c3e91120 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5614c3e8a340 msgr2=0x5614c3e8c800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5614c3e8a340 0x5614c3e8c800 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f37f402d910 msgr2=0x7f37f40393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f37f402d910 0x7f37f40393c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5614c3e93690 msgr2=0x5614c3e95b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x5614c3e93690 0x5614c3e95b50 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36d403c730 msgr2=0x7f36d403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36d403c730 0x7f36d403ebf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x5614c3e598f0 tx=0x7f37f4022040 comp rx=0 tx=0).stop 2024-09-10T05:13:35.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 msgr2=0x5614c3e7edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380ab83640 1 -- 172.21.15.192:0/1641231540 reap_dead start 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 0x5614c3e7edd0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0948c0 tx=0x7f37fc07deb0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 shutdown_connections 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 --2- 172.21.15.192:0/1641231540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e77910 0x5614c3e7edd0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 >> 172.21.15.192:0/1641231540 conn(0x5614c3e73d10 msgr2=0x5614c3e71f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 shutdown_connections 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 -- 172.21.15.192:0/1641231540 wait complete. 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 -- 172.21.15.192:0/3450407220 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36e403c730 msgr2=0x7f36e403ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 --2- 172.21.15.192:0/3450407220 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36e403c730 0x7f36e403ebf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f37f400c010 tx=0x7f37f4006000 comp rx=0 tx=0).stop 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 -- 172.21.15.192:0/3450407220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e6b120 msgr2=0x5614c3e6b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.089+0000 7f380c898800 1 --2- 172.21.15.192:0/3450407220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e6b120 0x5614c3e6b540 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f37fc051580 tx=0x7f37fc050fe0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3450407220 shutdown_connections 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 --2- 172.21.15.192:0/3450407220 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36e403c730 0x7f36e403ebf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 --2- 172.21.15.192:0/3450407220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3e6b120 0x5614c3e6b540 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3450407220 >> 172.21.15.192:0/3450407220 conn(0x5614c3e5f4d0 msgr2=0x5614c3e5f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3450407220 shutdown_connections 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3450407220 wait complete. 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5614c3e56950 msgr2=0x5614c3e58dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x5614c3e56950 0x5614c3e58dc0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5614c3d59330 msgr2=0x5614c3e54530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5614c3d59330 0x5614c3e54530 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5614c3e5a9b0 msgr2=0x5614c3e5cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x5614c3e5a9b0 0x5614c3e5cda0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36f003c780 msgr2=0x7f36f003ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f36f003c780 0x7f36f003ec40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f37f4000f60 tx=0x7f37f40013f0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 msgr2=0x5614c3e4cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 --2- 172.21.15.192:0/3542274013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5614c3d54510 0x5614c3e4cee0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f37fc025da0 tx=0x7f37fc002fb0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380ab83640 1 -- 172.21.15.192:0/3542274013 reap_dead start 2024-09-10T05:13:35.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 shutdown_connections 2024-09-10T05:13:35.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 >> 172.21.15.192:0/3542274013 conn(0x5614c3d4d930 msgr2=0x5614c3e3f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 shutdown_connections 2024-09-10T05:13:35.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.090+0000 7f380c898800 1 -- 172.21.15.192:0/3542274013 wait complete. 2024-09-10T05:13:35.102 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:35.102 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:35.102 ERROR:root:0 2024-09-10T05:13:35.102 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:13:35.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:13:35.102 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T05:13:35.148 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:35.148 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:35.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.148+0000 7efda7a98800 1 Processor -- start 2024-09-10T05:13:35.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.148+0000 7efda7a98800 1 -- start start 2024-09-10T05:13:35.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.149+0000 7efda7a98800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x561ccbc3f570 0x561ccbc44ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.149+0000 7efda7a98800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561ccbae7e40 con 0x561ccbc3c450 2024-09-10T05:13:35.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.149+0000 7efda7a98800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x561ccbab2680 con 0x561ccbc3f570 2024-09-10T05:13:35.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.149+0000 7efda4d81640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x561ccbc3f570 0x561ccbc44ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.149+0000 7efda4d81640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x561ccbc3f570 0x561ccbc44ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34306/0 (socket says 172.21.15.192:34306) 2024-09-10T05:13:35.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.149+0000 7efda4d81640 1 -- 172.21.15.192:0/3195590525 learned_addr learned my addr 172.21.15.192:0/3195590525 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.149+0000 7efda5582640 1 --1- 172.21.15.192:0/3195590525 >> v1:172.21.15.139:6789/0 conn(0x561ccbc3c450 0x561ccbc3ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46618/0 (socket says 172.21.15.192:46618) 2024-09-10T05:13:35.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.149+0000 7efda4d81640 1 -- 172.21.15.192:0/3195590525 >> v1:172.21.15.139:6789/0 conn(0x561ccbc3c450 legacy=0x561ccbc3ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.149+0000 7efda4d81640 1 -- 172.21.15.192:0/3195590525 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccbace6b0 con 0x561ccbc3f570 2024-09-10T05:13:35.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.149+0000 7efd9ffff640 1 -- 172.21.15.192:0/3195590525 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561786419 0 0) 0x561ccbae7e40 con 0x561ccbc3c450 2024-09-10T05:13:35.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.151+0000 7efda4d81640 1 --2- 172.21.15.192:0/3195590525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3f570 0x561ccbc44ec0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7efd9000a520 tx=0x7efd90045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38745137d75a711 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.151+0000 7efd9ffff640 1 -- 172.21.15.192:0/3195590525 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd90055070 con 0x561ccbc3f570 2024-09-10T05:13:35.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.151+0000 7efd9ffff640 1 -- 172.21.15.192:0/3195590525 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd900515b0 con 0x561ccbc3f570 2024-09-10T05:13:35.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.151+0000 7efd9ffff640 1 -- 172.21.15.192:0/3195590525 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd900518d0 con 0x561ccbc3f570 2024-09-10T05:13:35.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.152+0000 7efda7a98800 1 -- 172.21.15.192:0/3195590525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3f570 msgr2=0x561ccbc44ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.152+0000 7efda7a98800 1 --2- 172.21.15.192:0/3195590525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3f570 0x561ccbc44ec0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7efd9000a520 tx=0x7efd90045ba0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.152+0000 7efda7a98800 1 -- 172.21.15.192:0/3195590525 shutdown_connections 2024-09-10T05:13:35.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.152+0000 7efda7a98800 1 --2- 172.21.15.192:0/3195590525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3f570 0x561ccbc44ec0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.152+0000 7efda7a98800 1 -- 172.21.15.192:0/3195590525 >> 172.21.15.192:0/3195590525 conn(0x561ccbc37930 msgr2=0x561ccbc39db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.152+0000 7efda7a98800 1 -- 172.21.15.192:0/3195590525 shutdown_connections 2024-09-10T05:13:35.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.152+0000 7efda7a98800 1 -- 172.21.15.192:0/3195590525 wait complete. 2024-09-10T05:13:35.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.165+0000 7efda7a98800 1 Processor -- start 2024-09-10T05:13:35.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.165+0000 7efda7a98800 1 -- start start 2024-09-10T05:13:35.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.166+0000 7efda7a98800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 0x561ccbc3e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.166+0000 7efda7a98800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561ccbad6dd0 con 0x561ccbc3c450 2024-09-10T05:13:35.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.166+0000 7efda5582640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 0x561ccbc3e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.166+0000 7efda5582640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 0x561ccbc3e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34314/0 (socket says 172.21.15.192:34314) 2024-09-10T05:13:35.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.166+0000 7efda5582640 1 -- 172.21.15.192:0/2579509710 learned_addr learned my addr 172.21.15.192:0/2579509710 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.166+0000 7efda5582640 1 -- 172.21.15.192:0/2579509710 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccbaefe10 con 0x561ccbc3c450 2024-09-10T05:13:35.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.166+0000 7efda5582640 1 --2- 172.21.15.192:0/2579509710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 0x561ccbc3e610 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7efd98006fa0 tx=0x7efd98001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0735d8f2a3c8e3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.167+0000 7efc93606640 1 -- 172.21.15.192:0/2579509710 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd98003450 con 0x561ccbc3c450 2024-09-10T05:13:35.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.167+0000 7efc93606640 1 -- 172.21.15.192:0/2579509710 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98003610 con 0x561ccbc3c450 2024-09-10T05:13:35.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.167+0000 7efc93606640 1 -- 172.21.15.192:0/2579509710 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd98003970 con 0x561ccbc3c450 2024-09-10T05:13:35.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.167+0000 7efda7a98800 1 -- 172.21.15.192:0/2579509710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 msgr2=0x561ccbc3e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.167+0000 7efda7a98800 1 --2- 172.21.15.192:0/2579509710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 0x561ccbc3e610 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7efd98006fa0 tx=0x7efd98001b00 comp rx=0 tx=0).stop 2024-09-10T05:13:35.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.167+0000 7efda7a98800 1 -- 172.21.15.192:0/2579509710 shutdown_connections 2024-09-10T05:13:35.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.167+0000 7efda7a98800 1 --2- 172.21.15.192:0/2579509710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 0x561ccbc3e610 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.167+0000 7efda7a98800 1 -- 172.21.15.192:0/2579509710 >> 172.21.15.192:0/2579509710 conn(0x561ccbc37930 msgr2=0x561ccbd290c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.167+0000 7efda7a98800 1 -- 172.21.15.192:0/2579509710 shutdown_connections 2024-09-10T05:13:35.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.167+0000 7efda7a98800 1 -- 172.21.15.192:0/2579509710 wait complete. 2024-09-10T05:13:35.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.168+0000 7efda7a98800 1 Processor -- start 2024-09-10T05:13:35.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.168+0000 7efda7a98800 1 -- start start 2024-09-10T05:13:35.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.168+0000 7efda7a98800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 0x561ccbd37280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.168+0000 7efda7a98800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561ccbc45400 con 0x561ccbc3c450 2024-09-10T05:13:35.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.168+0000 7efda5582640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 0x561ccbd37280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.168+0000 7efda5582640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 0x561ccbd37280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34330/0 (socket says 172.21.15.192:34330) 2024-09-10T05:13:35.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.168+0000 7efda5582640 1 -- 172.21.15.192:0/3092551624 learned_addr learned my addr 172.21.15.192:0/3092551624 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.168+0000 7efda5582640 1 -- 172.21.15.192:0/3092551624 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccbd377e0 con 0x561ccbc3c450 2024-09-10T05:13:35.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.169+0000 7efda5582640 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 0x561ccbd37280 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7efd98001330 tx=0x7efd98001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.169+0000 7efc91e03640 1 -- 172.21.15.192:0/3092551624 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd98014a10 con 0x561ccbc3c450 2024-09-10T05:13:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.169+0000 7efc91e03640 1 -- 172.21.15.192:0/3092551624 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98014bb0 con 0x561ccbc3c450 2024-09-10T05:13:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.169+0000 7efc91e03640 1 -- 172.21.15.192:0/3092551624 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd9801e3f0 con 0x561ccbc3c450 2024-09-10T05:13:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.169+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561ccbd37a70 con 0x561ccbc3c450 2024-09-10T05:13:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.169+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ccbd38470 con 0x561ccbc3c450 2024-09-10T05:13:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.169+0000 7efc91e03640 1 -- 172.21.15.192:0/3092551624 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7efd98010070 con 0x561ccbc3c450 2024-09-10T05:13:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.170+0000 7efc91e03640 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc8c03c730 0x7efc8c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.170+0000 7efc91e03640 1 -- 172.21.15.192:0/3092551624 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7efd98018070 con 0x561ccbc3c450 2024-09-10T05:13:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.170+0000 7efda4d81640 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc8c03c730 0x7efc8c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.170+0000 7efda7a98800 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561ccbc3f570 0x561ccbd3e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.170+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd3ee10 con 0x561ccbc3f570 2024-09-10T05:13:35.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.170+0000 7efda5d83640 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561ccbc3f570 0x561ccbd3e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.170+0000 7efda4d81640 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc8c03c730 0x7efc8c03ebf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efd90057000 tx=0x7efd90052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.170+0000 7efda5d83640 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561ccbc3f570 0x561ccbd3e8d0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.171+0000 7efda5d83640 1 -- 172.21.15.192:0/3092551624 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efda00083e0 con 0x561ccbc3f570 2024-09-10T05:13:35.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.171+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd3f1b0 con 0x561ccbc3f570 2024-09-10T05:13:35.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.171+0000 7efda5d83640 1 -- 172.21.15.192:0/3092551624 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efda00083e0 con 0x561ccbc3f570 2024-09-10T05:13:35.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.171+0000 7efda7a98800 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561ccbd40c70 0x561ccbd430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.171+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd43880 con 0x561ccbd40c70 2024-09-10T05:13:35.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.171+0000 7efda5582640 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561ccbd40c70 0x561ccbd430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.171+0000 7efda5582640 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561ccbd40c70 0x561ccbd430f0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.172+0000 7efda5582640 1 -- 172.21.15.192:0/3092551624 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efd9801b070 con 0x561ccbd40c70 2024-09-10T05:13:35.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.172+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd3fa00 con 0x561ccbc3f570 2024-09-10T05:13:35.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.172+0000 7efda5d83640 1 -- 172.21.15.192:0/3092551624 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efda00083e0 con 0x561ccbc3f570 2024-09-10T05:13:35.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.172+0000 7efda7a98800 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561ccbd44ce0 0x561ccbd470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.172+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd47840 con 0x561ccbd44ce0 2024-09-10T05:13:35.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.172+0000 7efda4d81640 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561ccbd44ce0 0x561ccbd470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.172+0000 7efda4d81640 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561ccbd44ce0 0x561ccbd470d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.173+0000 7efda4d81640 1 -- 172.21.15.192:0/3092551624 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd44ce0 2024-09-10T05:13:35.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.173+0000 7efda7a98800 1 Processor -- start 2024-09-10T05:13:35.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.173+0000 7efda7a98800 1 -- start start 2024-09-10T05:13:35.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.173+0000 7efda7a98800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd55480 0x561ccbd558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.173+0000 7efda7a98800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561ccbb34a00 con 0x561ccbd55480 2024-09-10T05:13:35.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.173+0000 7efda5582640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd55480 0x561ccbd558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.173+0000 7efda5582640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd55480 0x561ccbd558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34340/0 (socket says 172.21.15.192:34340) 2024-09-10T05:13:35.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.173+0000 7efda5582640 1 -- 172.21.15.192:0/2311538649 learned_addr learned my addr 172.21.15.192:0/2311538649 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.174+0000 7efda5582640 1 -- 172.21.15.192:0/2311538649 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccbd55ee0 con 0x561ccbd55480 2024-09-10T05:13:35.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.174+0000 7efda5582640 1 --2- 172.21.15.192:0/2311538649 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd55480 0x561ccbd558a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7efd98010f90 tx=0x7efd98010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.174+0000 7efc8affd640 1 -- 172.21.15.192:0/2311538649 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd98048070 con 0x561ccbd55480 2024-09-10T05:13:35.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.174+0000 7efc8affd640 1 -- 172.21.15.192:0/2311538649 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98010360 con 0x561ccbd55480 2024-09-10T05:13:35.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.174+0000 7efda7a98800 1 -- 172.21.15.192:0/2311538649 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561ccbd56710 con 0x561ccbd55480 2024-09-10T05:13:35.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.174+0000 7efc8affd640 1 -- 172.21.15.192:0/2311538649 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd98012cc0 con 0x561ccbd55480 2024-09-10T05:13:35.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.174+0000 7efda7a98800 1 -- 172.21.15.192:0/2311538649 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ccbd56cb0 con 0x561ccbd55480 2024-09-10T05:13:35.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.175+0000 7efc8affd640 1 -- 172.21.15.192:0/2311538649 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7efd9804b070 con 0x561ccbd55480 2024-09-10T05:13:35.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.175+0000 7efc8affd640 1 --2- 172.21.15.192:0/2311538649 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc8003c730 0x7efc8003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.175+0000 7efc8affd640 1 -- 172.21.15.192:0/2311538649 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7efd9804ed50 con 0x561ccbd55480 2024-09-10T05:13:35.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.175+0000 7efda4d81640 1 --2- 172.21.15.192:0/2311538649 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc8003c730 0x7efc8003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.175+0000 7efda7a98800 1 Processor -- start 2024-09-10T05:13:35.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.175+0000 7efda7a98800 1 -- start start 2024-09-10T05:13:35.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.175+0000 7efda4d81640 1 --2- 172.21.15.192:0/2311538649 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc8003c730 0x7efc8003ebf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x561ccbd43c20 tx=0x7efd90005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.175+0000 7efda7a98800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 0x561ccbd62320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.175+0000 7efda7a98800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561ccbc3ceb0 con 0x561ccbd61f20 2024-09-10T05:13:35.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.176+0000 7efda5582640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 0x561ccbd62320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.176+0000 7efda5582640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 0x561ccbd62320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34346/0 (socket says 172.21.15.192:34346) 2024-09-10T05:13:35.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.176+0000 7efda5582640 1 -- 172.21.15.192:0/1449362704 learned_addr learned my addr 172.21.15.192:0/1449362704 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.176+0000 7efda5582640 1 -- 172.21.15.192:0/1449362704 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccbd62910 con 0x561ccbd61f20 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.176+0000 7efda5582640 1 --2- 172.21.15.192:0/1449362704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 0x561ccbd62320 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7efd98012f10 tx=0x7efd98043b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe308d6c529f8e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.176+0000 7efc88ff9640 1 -- 172.21.15.192:0/1449362704 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd9805a040 con 0x561ccbd61f20 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.176+0000 7efc88ff9640 1 -- 172.21.15.192:0/1449362704 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98052460 con 0x561ccbd61f20 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.176+0000 7efc88ff9640 1 -- 172.21.15.192:0/1449362704 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd980123c0 con 0x561ccbd61f20 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.177+0000 7efda7a98800 1 -- 172.21.15.192:0/1449362704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 msgr2=0x561ccbd62320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.177+0000 7efda7a98800 1 --2- 172.21.15.192:0/1449362704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 0x561ccbd62320 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7efd98012f10 tx=0x7efd98043b50 comp rx=0 tx=0).stop 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.177+0000 7efda7a98800 1 -- 172.21.15.192:0/1449362704 shutdown_connections 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.177+0000 7efda7a98800 1 --2- 172.21.15.192:0/1449362704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 0x561ccbd62320 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.177+0000 7efda7a98800 1 -- 172.21.15.192:0/1449362704 >> 172.21.15.192:0/1449362704 conn(0x561ccbd5e320 msgr2=0x561ccbd5c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.177+0000 7efda7a98800 1 -- 172.21.15.192:0/1449362704 shutdown_connections 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.177+0000 7efda7a98800 1 -- 172.21.15.192:0/1449362704 wait complete. 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.177+0000 7efda7a98800 1 Processor -- start 2024-09-10T05:13:35.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.177+0000 7efda7a98800 1 -- start start 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.177+0000 7efda7a98800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 0x561ccbd69330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.178+0000 7efda7a98800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561ccbd62d80 con 0x561ccbd61f20 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.178+0000 7efda5582640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 0x561ccbd69330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.178+0000 7efda5582640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 0x561ccbd69330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34348/0 (socket says 172.21.15.192:34348) 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.178+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 learned_addr learned my addr 172.21.15.192:0/3482630140 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.178+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccbd69890 con 0x561ccbd61f20 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.178+0000 7efda5582640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 0x561ccbd69330 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7efd98028e60 tx=0x7efd9802ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.178+0000 7efc76ffd640 1 -- 172.21.15.192:0/3482630140 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd98043c90 con 0x561ccbd61f20 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.178+0000 7efc76ffd640 1 -- 172.21.15.192:0/3482630140 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd9806e030 con 0x561ccbd61f20 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.178+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561ccbd69890 con 0x561ccbd61f20 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.178+0000 7efc76ffd640 1 -- 172.21.15.192:0/3482630140 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd98035520 con 0x561ccbd61f20 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.178+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ccbd69890 con 0x561ccbd61f20 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.179+0000 7efc76ffd640 1 -- 172.21.15.192:0/3482630140 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7efd98052680 con 0x561ccbd61f20 2024-09-10T05:13:35.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.179+0000 7efc76ffd640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc7003c730 0x7efc7003ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.179+0000 7efc76ffd640 1 -- 172.21.15.192:0/3482630140 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7efd98077a60 con 0x561ccbd61f20 2024-09-10T05:13:35.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.179+0000 7efda4d81640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc7003c730 0x7efc7003ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.180+0000 7efda4d81640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc7003c730 0x7efc7003ebf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efd90000c00 tx=0x7efd90053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.180+0000 7efda7a98800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.180+0000 7efda7a98800 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561ccbd74930 0x561ccbd76df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.180+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd77540 con 0x561ccbd74930 2024-09-10T05:13:35.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.180+0000 7efda5d83640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561ccbd74930 0x561ccbd76df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.180+0000 7efda5d83640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561ccbd74930 0x561ccbd76df0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efda00083e0 con 0x561ccbd74930 2024-09-10T05:13:35.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 20 realm 2024-09-10T05:13:35.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd77950 con 0x561ccbd74930 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efda00083e0 con 0x561ccbd74930 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd74930 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efda00083e0 con 0x561ccbd74930 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd785c0 con 0x561ccbd74930 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efda00083e0 con 0x561ccbd74930 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:35.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561ccbd78f80 0x561ccbd7b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.181+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd7b980 con 0x561ccbd78f80 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.182+0000 7efda5582640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561ccbd78f80 0x561ccbd7b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.182+0000 7efda5582640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561ccbd78f80 0x561ccbd7b370 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.182+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.182+0000 7efda7a98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.182+0000 7efda7a98800 20 searching for the correct realm 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.182+0000 7efda7a98800 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561ccbd7d930 0x561ccbd7fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.182+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd80470 con 0x561ccbd7d930 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.182+0000 7efda4d81640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561ccbd7d930 0x561ccbd7fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.182+0000 7efda4d81640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561ccbd7d930 0x561ccbd7fdf0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.183+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.183+0000 7efda4d81640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7efd90069040 0x7efd9006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.183+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd80470 con 0x7efd90069040 2024-09-10T05:13:35.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.183+0000 7efda5d83640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7efd90069040 0x7efd9006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.183+0000 7efda5d83640 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7efd90069040 0x7efd9006a940 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.183+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efda00083e0 con 0x7efd90069040 2024-09-10T05:13:35.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.183+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd78f80 2024-09-10T05:13:35.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.184+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.184+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd74930 2024-09-10T05:13:35.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.184+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda00083e0 con 0x561ccbd74930 2024-09-10T05:13:35.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.184+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd74930 2024-09-10T05:13:35.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.184+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda0026040 con 0x561ccbd74930 2024-09-10T05:13:35.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.184+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd78f80 2024-09-10T05:13:35.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.184+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.184+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd78f80 2024-09-10T05:13:35.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.185+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.185+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x7efd90069040 2024-09-10T05:13:35.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.185+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda0026040 con 0x7efd90069040 2024-09-10T05:13:35.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.185+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd7d930 2024-09-10T05:13:35.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.185+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.185+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd74930 2024-09-10T05:13:35.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.185+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda0026040 con 0x561ccbd74930 2024-09-10T05:13:35.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.185+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd78f80 2024-09-10T05:13:35.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.185+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.185+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd74930 2024-09-10T05:13:35.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.186+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda0026040 con 0x561ccbd74930 2024-09-10T05:13:35.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.186+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x7efd90069040 2024-09-10T05:13:35.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.186+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efda0026040 con 0x7efd90069040 2024-09-10T05:13:35.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.186+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd7d930 2024-09-10T05:13:35.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.186+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.186+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd7d930 2024-09-10T05:13:35.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.186+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.186+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd78f80 2024-09-10T05:13:35.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.187+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.187+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd7d930 2024-09-10T05:13:35.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.187+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.187+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd7d930 2024-09-10T05:13:35.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.187+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.187+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd74930 2024-09-10T05:13:35.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.187+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda0026040 con 0x561ccbd74930 2024-09-10T05:13:35.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.187+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd74930 2024-09-10T05:13:35.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.187+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efda0026040 con 0x561ccbd74930 2024-09-10T05:13:35.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.187+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x7efd90069040 2024-09-10T05:13:35.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.188+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda0026040 con 0x7efd90069040 2024-09-10T05:13:35.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.188+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd7d930 2024-09-10T05:13:35.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.188+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.188+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x7efd90069040 2024-09-10T05:13:35.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.188+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda0026040 con 0x7efd90069040 2024-09-10T05:13:35.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.188+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd74930 2024-09-10T05:13:35.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.188+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.188+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd78f80 2024-09-10T05:13:35.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.189+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.189+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd7d930 2024-09-10T05:13:35.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.189+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.189+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd78f80 2024-09-10T05:13:35.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.189+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.189+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x7efd90069040 2024-09-10T05:13:35.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.189+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda0035040 con 0x7efd90069040 2024-09-10T05:13:35.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.189+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd7d930 2024-09-10T05:13:35.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.189+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.189+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x7efd90069040 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda0035040 con 0x7efd90069040 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7efda003a040 con 0x561ccbd74930 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7efda003a040 con 0x7efd90069040 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efda0035040 con 0x7efd90069040 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda7a98800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda7a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda7a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda7a98800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda7a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda7a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:35.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda7a98800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd74930 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda7a98800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.190+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x561ccbd74930 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda7a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda7a98800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd78220 con 0x7efd90069040 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efda0035040 con 0x7efd90069040 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda7a98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda7a98800 20 zone default found 2024-09-10T05:13:35.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda7a98800 4 Realm: () 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda7a98800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda7a98800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda7a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda7a98800 20 zonegroup default 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda7a98800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd7c240 con 0x561ccbd78f80 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.191+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.192+0000 7efda7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.192+0000 7efda7a98800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.192+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd81a00 con 0x561ccbd7d930 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.192+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.192+0000 7efda7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.192+0000 7efda7a98800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.192+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd81f40 con 0x561ccbd7d930 2024-09-10T05:13:35.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.192+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.192+0000 7efda7a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.192+0000 7efda7a98800 20 started sync module instance, tier type = 2024-09-10T05:13:35.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.192+0000 7efda7a98800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:35.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.192+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd80da0 con 0x7efd90069040 2024-09-10T05:13:35.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.193+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x7efd90069040 2024-09-10T05:13:35.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.193+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94681679008416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd80da0 con 0x7efd90069040 2024-09-10T05:13:35.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.193+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd829c0 con 0x561ccbd74930 2024-09-10T05:13:35.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.194+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94681679008416] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x7efd90069040 2024-09-10T05:13:35.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.194+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.194+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94681679013616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd80da0 con 0x561ccbd74930 2024-09-10T05:13:35.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.194+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd83410 con 0x561ccbd7d930 2024-09-10T05:13:35.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.195+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.195+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94681679015712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd83cb0 con 0x561ccbd7d930 2024-09-10T05:13:35.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.196+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd84770 con 0x7efd90069040 2024-09-10T05:13:35.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.196+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94681679013616] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.197+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94681679015712] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.197+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x7efd90069040 2024-09-10T05:13:35.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.197+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94681679017984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd808f0 con 0x7efd90069040 2024-09-10T05:13:35.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.197+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd85010 con 0x561ccbd74930 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.198+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.198+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94681679022784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd85440 con 0x561ccbd74930 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.198+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd85f50 con 0x561ccbd78f80 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.198+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94681679017984] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x7efd90069040 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.199+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94681679022784] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.199+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.199+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94681679023840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd84240 con 0x561ccbd78f80 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.199+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd867f0 con 0x561ccbd78f80 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.200+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94681679023840] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.200+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.200+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94681679026688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd867f0 con 0x561ccbd78f80 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.200+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd87230 con 0x561ccbd78f80 2024-09-10T05:13:35.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.201+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94681679026688] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.201+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.201+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94681679029056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd86760 con 0x561ccbd78f80 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.201+0000 7efda7a98800 20 add_watcher() i=0 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.201+0000 7efda7a98800 20 add_watcher() i=1 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.201+0000 7efda7a98800 20 add_watcher() i=2 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.201+0000 7efda7a98800 20 add_watcher() i=3 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.201+0000 7efda7a98800 20 add_watcher() i=4 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.201+0000 7efda7a98800 20 add_watcher() i=5 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.201+0000 7efda7a98800 20 add_watcher() i=6 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.202+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94681679029056] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.202+0000 7efda7a98800 20 add_watcher() i=7 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.202+0000 7efda7a98800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.202+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd8a6d0 con 0x561ccbd74930 2024-09-10T05:13:35.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.202+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.202+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94681679032816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd87bd0 con 0x561ccbd74930 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.203+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94681679032816] v37'277 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.203+0000 7efc5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.203+0000 7efda7a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.203+0000 7efda7a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.203+0000 7efda7a98800 5 note: GC not initialized 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.204+0000 7efc5a7e4640 20 reqs_thread_entry: start 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.204+0000 7efda7a98800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.204+0000 7efda7a98800 20 Filter name: none 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.204+0000 7efbcbfff640 20 reqs_thread_entry: start 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.204+0000 7efda7a98800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.204+0000 7efda7a98800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.204+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbdbd790 con 0x561ccbd78f80 2024-09-10T05:13:35.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.205+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.205+0000 7efda7a98800 20 rados_obj.operate() r=0 bl.length=460 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.205+0000 7efda7a98800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.205+0000 7efda7a98800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.205+0000 7efda7a98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.205+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbdc3bd0 con 0x561ccbd78f80 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.206+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v37'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.206+0000 7efda7a98800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.206+0000 7efda7a98800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.206+0000 7efda7a98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.206+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94681679279568 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561ccbdbf230 con 0x561ccbd74930 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.206+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== watch-notify(notify (1) cookie 94681679022784 notify 158913789982 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7efda0010040 con 0x561ccbd74930 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.206+0000 7efc88ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789982 cookie 94681679022784 notifier 4924 bl.length()=649 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.206+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 notify.4 [notify cookie 94681679279568 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.206+0000 7efc88ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:35.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.206+0000 7efc88ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:35.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.206+0000 7efc88ff9640 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7efc68003ea0 con 0x561ccbd74930 2024-09-10T05:13:35.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.206+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.207+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== watch-notify(notify_complete (2) cookie 94681679279568 notify 158913789982 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efda000aa70 con 0x561ccbd74930 2024-09-10T05:13:35.222 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:13:33.468641Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:13:33.468623Z","tags":[],"group_ids":[]} 2024-09-10T05:13:35.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.207+0000 7efc5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:35.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.207+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94681679032816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbdc2eb0 con 0x561ccbd74930 2024-09-10T05:13:35.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.208+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94681679032816] v37'278 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.208+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94681679008416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbdc2eb0 con 0x7efd90069040 2024-09-10T05:13:35.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.209+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94681679008416] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x7efd90069040 2024-09-10T05:13:35.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.209+0000 7efda7a98800 20 remove_watcher() i=0 2024-09-10T05:13:35.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.209+0000 7efda7a98800 2 removed watcher, disabling cache 2024-09-10T05:13:35.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.209+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94681679013616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbdc2eb0 con 0x561ccbd74930 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.210+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94681679013616] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.210+0000 7efda7a98800 20 remove_watcher() i=1 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.210+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94681679015712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbdc2eb0 con 0x561ccbd7d930 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.211+0000 7efda4d81640 1 -- 172.21.15.192:0/3482630140 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94681679015712] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd90057030 con 0x561ccbd7d930 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.211+0000 7efda7a98800 20 remove_watcher() i=2 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.211+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94681679017984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbdbb600 con 0x7efd90069040 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.212+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94681679017984] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x7efd90069040 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.212+0000 7efda7a98800 20 remove_watcher() i=3 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.212+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94681679022784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbdbb600 con 0x561ccbd74930 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.213+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94681679022784] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efda0035040 con 0x561ccbd74930 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.213+0000 7efda7a98800 20 remove_watcher() i=4 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.213+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94681679023840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbdbb600 con 0x561ccbd78f80 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.214+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94681679023840] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.214+0000 7efda7a98800 20 remove_watcher() i=5 2024-09-10T05:13:35.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.214+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94681679026688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbd84f70 con 0x561ccbd78f80 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.215+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94681679026688] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.215+0000 7efda7a98800 20 remove_watcher() i=6 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.215+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94681679029056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561ccbdbb600 con 0x561ccbd78f80 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.216+0000 7efda5582640 1 -- 172.21.15.192:0/3482630140 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94681679029056] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9804a030 con 0x561ccbd78f80 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.216+0000 7efda7a98800 20 remove_watcher() i=7 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.216+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561ccbd78f80 msgr2=0x561ccbd7b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.216+0000 7efda7a98800 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561ccbd78f80 0x561ccbd7b370 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.216+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561ccbd74930 msgr2=0x561ccbd76df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.216+0000 7efda7a98800 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561ccbd74930 0x561ccbd76df0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7efd90069040 msgr2=0x7efd9006a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7efd90069040 0x7efd9006a940 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561ccbd7d930 msgr2=0x561ccbd7fdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x561ccbd7d930 0x561ccbd7fdf0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc7003c730 msgr2=0x7efc7003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc7003c730 0x7efc7003ebf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efd90000c00 tx=0x7efd90053000 comp rx=0 tx=0).stop 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 msgr2=0x561ccbd69330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda5d83640 1 -- 172.21.15.192:0/3482630140 reap_dead start 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 0x561ccbd69330 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7efd98028e60 tx=0x7efd9802ff90 comp rx=0 tx=0).stop 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 shutdown_connections 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 --2- 172.21.15.192:0/3482630140 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd61f20 0x561ccbd69330 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 >> 172.21.15.192:0/3482630140 conn(0x561ccbd5e320 msgr2=0x561ccbd5c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 shutdown_connections 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/3482630140 wait complete. 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/2311538649 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc8003c730 msgr2=0x7efc8003ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 --2- 172.21.15.192:0/2311538649 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc8003c730 0x7efc8003ebf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x561ccbd43c20 tx=0x7efd90005ac0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/2311538649 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd55480 msgr2=0x561ccbd558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 --2- 172.21.15.192:0/2311538649 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd55480 0x561ccbd558a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7efd98010f90 tx=0x7efd98010ab0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/2311538649 shutdown_connections 2024-09-10T05:13:35.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 --2- 172.21.15.192:0/2311538649 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc8003c730 0x7efc8003ebf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 --2- 172.21.15.192:0/2311538649 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbd55480 0x561ccbd558a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/2311538649 >> 172.21.15.192:0/2311538649 conn(0x561ccbd49830 msgr2=0x561ccbd49c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/2311538649 shutdown_connections 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.217+0000 7efda7a98800 1 -- 172.21.15.192:0/2311538649 wait complete. 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561ccbd40c70 msgr2=0x561ccbd430f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561ccbd40c70 0x561ccbd430f0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561ccbc3f570 msgr2=0x561ccbd3e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x561ccbc3f570 0x561ccbd3e8d0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561ccbd44ce0 msgr2=0x561ccbd470d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561ccbd44ce0 0x561ccbd470d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc8c03c730 msgr2=0x7efc8c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7efc8c03c730 0x7efc8c03ebf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efd90057000 tx=0x7efd90052000 comp rx=0 tx=0).stop 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 msgr2=0x561ccbd37280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 --2- 172.21.15.192:0/3092551624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ccbc3c450 0x561ccbd37280 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7efd98001330 tx=0x7efd98001250 comp rx=0 tx=0).stop 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda5d83640 1 -- 172.21.15.192:0/3092551624 reap_dead start 2024-09-10T05:13:35.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 shutdown_connections 2024-09-10T05:13:35.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 >> 172.21.15.192:0/3092551624 conn(0x561ccbc37930 msgr2=0x561ccbd28c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 shutdown_connections 2024-09-10T05:13:35.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.218+0000 7efda7a98800 1 -- 172.21.15.192:0/3092551624 wait complete. 2024-09-10T05:13:35.232 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:35.232 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:35.232 ERROR:root:0 2024-09-10T05:13:35.232 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:13:35.232 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-10T05:13:35.232 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-10T05:13:35.279 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:13:35.279 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:13:35.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.279+0000 7f0eefa87800 1 Processor -- start 2024-09-10T05:13:35.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.279+0000 7f0eefa87800 1 -- start start 2024-09-10T05:13:35.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.279+0000 7f0eefa87800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55d713e6c570 0x55d713e71ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.279+0000 7f0eefa87800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d713d14e40 con 0x55d713e69450 2024-09-10T05:13:35.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.279+0000 7f0eefa87800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x55d713cdf680 con 0x55d713e6c570 2024-09-10T05:13:35.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.279+0000 7f0eecd70640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55d713e6c570 0x55d713e71ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.279+0000 7f0eed571640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x55d713e69450 0x55d713e6be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:46624/0 (socket says 172.21.15.192:46624) 2024-09-10T05:13:35.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.279+0000 7f0eed571640 1 -- 172.21.15.192:0/2669088609 learned_addr learned my addr 172.21.15.192:0/2669088609 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:13:35.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.279+0000 7f0eecd70640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x55d713e6c570 0x55d713e71ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34360/0 (socket says 172.21.15.192:34360) 2024-09-10T05:13:35.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.279+0000 7f0eecd70640 1 -- 172.21.15.192:0/2669088609 >> v1:172.21.15.139:6789/0 conn(0x55d713e69450 legacy=0x55d713e6be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.279+0000 7f0edffff640 1 -- 172.21.15.192:0/2669088609 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685974051 0 0) 0x55d713d14e40 con 0x55d713e69450 2024-09-10T05:13:35.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.279+0000 7f0eecd70640 1 -- 172.21.15.192:0/2669088609 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d713cfb6b0 con 0x55d713e6c570 2024-09-10T05:13:35.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.281+0000 7f0eecd70640 1 --2- 172.21.15.192:0/2669088609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e6c570 0x55d713e71ec0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400a470 tx=0x7f0ee4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9653cea1d6f90692 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.281+0000 7f0edffff640 1 -- 172.21.15.192:0/2669088609 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee4053570 con 0x55d713e6c570 2024-09-10T05:13:35.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.281+0000 7f0edffff640 1 -- 172.21.15.192:0/2669088609 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee4058070 con 0x55d713e6c570 2024-09-10T05:13:35.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.281+0000 7f0edffff640 1 -- 172.21.15.192:0/2669088609 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee4053880 con 0x55d713e6c570 2024-09-10T05:13:35.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.282+0000 7f0eefa87800 1 -- 172.21.15.192:0/2669088609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e6c570 msgr2=0x55d713e71ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.282+0000 7f0eefa87800 1 --2- 172.21.15.192:0/2669088609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e6c570 0x55d713e71ec0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400a470 tx=0x7f0ee4045a20 comp rx=0 tx=0).stop 2024-09-10T05:13:35.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.282+0000 7f0eefa87800 1 -- 172.21.15.192:0/2669088609 shutdown_connections 2024-09-10T05:13:35.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.282+0000 7f0eefa87800 1 --2- 172.21.15.192:0/2669088609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e6c570 0x55d713e71ec0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.282+0000 7f0eefa87800 1 -- 172.21.15.192:0/2669088609 >> 172.21.15.192:0/2669088609 conn(0x55d713e64930 msgr2=0x55d713e66db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.282+0000 7f0eefa87800 1 -- 172.21.15.192:0/2669088609 shutdown_connections 2024-09-10T05:13:35.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.282+0000 7f0eefa87800 1 -- 172.21.15.192:0/2669088609 wait complete. 2024-09-10T05:13:35.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.296+0000 7f0eefa87800 1 Processor -- start 2024-09-10T05:13:35.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.296+0000 7f0eefa87800 1 -- start start 2024-09-10T05:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.296+0000 7f0eefa87800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 0x55d713e6b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.296+0000 7f0eefa87800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d713d03dd0 con 0x55d713e69450 2024-09-10T05:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.296+0000 7f0eed571640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 0x55d713e6b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.296+0000 7f0eed571640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 0x55d713e6b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34366/0 (socket says 172.21.15.192:34366) 2024-09-10T05:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.296+0000 7f0eed571640 1 -- 172.21.15.192:0/2370225156 learned_addr learned my addr 172.21.15.192:0/2370225156 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.296+0000 7f0eed571640 1 -- 172.21.15.192:0/2370225156 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d713d1ce10 con 0x55d713e69450 2024-09-10T05:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.296+0000 7f0eed571640 1 --2- 172.21.15.192:0/2370225156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 0x55d713e6b5d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0001ea0 tx=0x7f0ee000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8e86274ddac901 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.297+0000 7f0ddb606640 1 -- 172.21.15.192:0/2370225156 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee0008070 con 0x55d713e69450 2024-09-10T05:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.297+0000 7f0ddb606640 1 -- 172.21.15.192:0/2370225156 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee000d500 con 0x55d713e69450 2024-09-10T05:13:35.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.297+0000 7f0ddb606640 1 -- 172.21.15.192:0/2370225156 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee000d880 con 0x55d713e69450 2024-09-10T05:13:35.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.297+0000 7f0eefa87800 1 -- 172.21.15.192:0/2370225156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 msgr2=0x55d713e6b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.297+0000 7f0eefa87800 1 --2- 172.21.15.192:0/2370225156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 0x55d713e6b5d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0001ea0 tx=0x7f0ee000b6a0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.297+0000 7f0eefa87800 1 -- 172.21.15.192:0/2370225156 shutdown_connections 2024-09-10T05:13:35.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.297+0000 7f0eefa87800 1 --2- 172.21.15.192:0/2370225156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 0x55d713e6b5d0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.297+0000 7f0eefa87800 1 -- 172.21.15.192:0/2370225156 >> 172.21.15.192:0/2370225156 conn(0x55d713e64930 msgr2=0x55d713f560c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.297+0000 7f0eefa87800 1 -- 172.21.15.192:0/2370225156 shutdown_connections 2024-09-10T05:13:35.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.297+0000 7f0eefa87800 1 -- 172.21.15.192:0/2370225156 wait complete. 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.298+0000 7f0eefa87800 1 Processor -- start 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.298+0000 7f0eefa87800 1 -- start start 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.298+0000 7f0eefa87800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 0x55d713f64270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.298+0000 7f0eefa87800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d713e72400 con 0x55d713e69450 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.298+0000 7f0eed571640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 0x55d713f64270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.298+0000 7f0eed571640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 0x55d713f64270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34374/0 (socket says 172.21.15.192:34374) 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.298+0000 7f0eed571640 1 -- 172.21.15.192:0/874749390 learned_addr learned my addr 172.21.15.192:0/874749390 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.298+0000 7f0eed571640 1 -- 172.21.15.192:0/874749390 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d713f647d0 con 0x55d713e69450 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.299+0000 7f0eed571640 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 0x55d713f64270 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00012f0 tx=0x7f0ee0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.299+0000 7f0dd9e03640 1 -- 172.21.15.192:0/874749390 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee000f9d0 con 0x55d713e69450 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.299+0000 7f0dd9e03640 1 -- 172.21.15.192:0/874749390 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee000fb70 con 0x55d713e69450 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.299+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d713f64a60 con 0x55d713e69450 2024-09-10T05:13:35.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.299+0000 7f0dd9e03640 1 -- 172.21.15.192:0/874749390 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee000fe50 con 0x55d713e69450 2024-09-10T05:13:35.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.299+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d713f65460 con 0x55d713e69450 2024-09-10T05:13:35.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.300+0000 7f0dd9e03640 1 -- 172.21.15.192:0/874749390 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0ee0017040 con 0x55d713e69450 2024-09-10T05:13:35.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.300+0000 7f0dd9e03640 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0dd403c920 0x7f0dd403ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.300+0000 7f0dd9e03640 1 -- 172.21.15.192:0/874749390 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f0ee0015020 con 0x55d713e69450 2024-09-10T05:13:35.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.300+0000 7f0eecd70640 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0dd403c920 0x7f0dd403ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.300+0000 7f0eefa87800 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d713e6c570 0x55d713f6b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.300+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713f6be00 con 0x55d713e6c570 2024-09-10T05:13:35.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.300+0000 7f0eedd72640 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d713e6c570 0x55d713f6b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.300+0000 7f0eecd70640 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0dd403c920 0x7f0dd403ede0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4057000 tx=0x7f0ee4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.300+0000 7f0eedd72640 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d713e6c570 0x55d713f6b8c0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.301+0000 7f0eedd72640 1 -- 172.21.15.192:0/874749390 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713e6c570 2024-09-10T05:13:35.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.301+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713f6c1a0 con 0x55d713e6c570 2024-09-10T05:13:35.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.301+0000 7f0eedd72640 1 -- 172.21.15.192:0/874749390 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713e6c570 2024-09-10T05:13:35.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.301+0000 7f0eefa87800 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d713f6dca0 0x55d713f70120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.301+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713f708b0 con 0x55d713f6dca0 2024-09-10T05:13:35.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.301+0000 7f0eed571640 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d713f6dca0 0x55d713f70120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.302+0000 7f0eed571640 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d713f6dca0 0x55d713f70120 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.302+0000 7f0eed571640 1 -- 172.21.15.192:0/874749390 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ee002d070 con 0x55d713f6dca0 2024-09-10T05:13:35.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.302+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713f6c9f0 con 0x55d713e6c570 2024-09-10T05:13:35.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.302+0000 7f0eedd72640 1 -- 172.21.15.192:0/874749390 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713e6c570 2024-09-10T05:13:35.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.303+0000 7f0eefa87800 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55d713f71d10 0x55d713f74100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.303+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713f74870 con 0x55d713f71d10 2024-09-10T05:13:35.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.303+0000 7f0eecd70640 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55d713f71d10 0x55d713f74100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.303+0000 7f0eecd70640 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55d713f71d10 0x55d713f74100 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.303+0000 7f0eecd70640 1 -- 172.21.15.192:0/874749390 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0ee4051070 con 0x55d713f71d10 2024-09-10T05:13:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.303+0000 7f0eefa87800 1 Processor -- start 2024-09-10T05:13:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0eefa87800 1 -- start start 2024-09-10T05:13:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0eefa87800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f824a0 0x55d713f828c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0eefa87800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d713d61a00 con 0x55d713f824a0 2024-09-10T05:13:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0eed571640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f824a0 0x55d713f828c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0eed571640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f824a0 0x55d713f828c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34382/0 (socket says 172.21.15.192:34382) 2024-09-10T05:13:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0eed571640 1 -- 172.21.15.192:0/1965491840 learned_addr learned my addr 172.21.15.192:0/1965491840 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0eed571640 1 -- 172.21.15.192:0/1965491840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d713f82f00 con 0x55d713f824a0 2024-09-10T05:13:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0eed571640 1 --2- 172.21.15.192:0/1965491840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f824a0 0x55d713f828c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000ed00 tx=0x7f0ee00187a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0dd2ffd640 1 -- 172.21.15.192:0/1965491840 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee00198c0 con 0x55d713f824a0 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0dd2ffd640 1 -- 172.21.15.192:0/1965491840 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee001a3c0 con 0x55d713f824a0 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0eefa87800 1 -- 172.21.15.192:0/1965491840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d713f83730 con 0x55d713f824a0 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0dd2ffd640 1 -- 172.21.15.192:0/1965491840 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee0044910 con 0x55d713f824a0 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.304+0000 7f0eefa87800 1 -- 172.21.15.192:0/1965491840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d713f83cd0 con 0x55d713f824a0 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.305+0000 7f0dd2ffd640 1 -- 172.21.15.192:0/1965491840 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0ee0044ab0 con 0x55d713f824a0 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.305+0000 7f0dd2ffd640 1 --2- 172.21.15.192:0/1965491840 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0dc403c780 0x7f0dc403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.305+0000 7f0dd2ffd640 1 -- 172.21.15.192:0/1965491840 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f0ee003c5f0 con 0x55d713f824a0 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.305+0000 7f0eecd70640 1 --2- 172.21.15.192:0/1965491840 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0dc403c780 0x7f0dc403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.306+0000 7f0eefa87800 1 Processor -- start 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.306+0000 7f0eefa87800 1 -- start start 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.306+0000 7f0eecd70640 1 --2- 172.21.15.192:0/1965491840 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0dc403c780 0x7f0dc403ec40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4000c00 tx=0x7f0ee4005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.306+0000 7f0eefa87800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 0x55d713f8f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.306+0000 7f0eefa87800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d713e69e70 con 0x55d713f8eee0 2024-09-10T05:13:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.306+0000 7f0eed571640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 0x55d713f8f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.306+0000 7f0eed571640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 0x55d713f8f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34388/0 (socket says 172.21.15.192:34388) 2024-09-10T05:13:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.306+0000 7f0eed571640 1 -- 172.21.15.192:0/631832644 learned_addr learned my addr 172.21.15.192:0/631832644 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.306+0000 7f0eed571640 1 -- 172.21.15.192:0/631832644 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d713f8f8d0 con 0x55d713f8eee0 2024-09-10T05:13:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.306+0000 7f0eed571640 1 --2- 172.21.15.192:0/631832644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 0x55d713f8f2e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0019fd0 tx=0x7f0ee001cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08d5731dc7d9356 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.306+0000 7f0dd0ff9640 1 -- 172.21.15.192:0/631832644 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee0035040 con 0x55d713f8eee0 2024-09-10T05:13:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.306+0000 7f0dd0ff9640 1 -- 172.21.15.192:0/631832644 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee0048020 con 0x55d713f8eee0 2024-09-10T05:13:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.307+0000 7f0dd0ff9640 1 -- 172.21.15.192:0/631832644 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee003aa50 con 0x55d713f8eee0 2024-09-10T05:13:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.307+0000 7f0eefa87800 1 -- 172.21.15.192:0/631832644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 msgr2=0x55d713f8f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.307+0000 7f0eefa87800 1 --2- 172.21.15.192:0/631832644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 0x55d713f8f2e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0019fd0 tx=0x7f0ee001cda0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.307+0000 7f0eefa87800 1 -- 172.21.15.192:0/631832644 shutdown_connections 2024-09-10T05:13:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.307+0000 7f0eefa87800 1 --2- 172.21.15.192:0/631832644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 0x55d713f8f2e0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.307+0000 7f0eefa87800 1 -- 172.21.15.192:0/631832644 >> 172.21.15.192:0/631832644 conn(0x55d713f8b2e0 msgr2=0x55d713f89520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.307+0000 7f0eefa87800 1 -- 172.21.15.192:0/631832644 shutdown_connections 2024-09-10T05:13:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.307+0000 7f0eefa87800 1 -- 172.21.15.192:0/631832644 wait complete. 2024-09-10T05:13:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.307+0000 7f0eefa87800 1 Processor -- start 2024-09-10T05:13:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.307+0000 7f0eefa87800 1 -- start start 2024-09-10T05:13:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.308+0000 7f0eefa87800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 0x55d713f962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.308+0000 7f0eefa87800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d713f8fd40 con 0x55d713f8eee0 2024-09-10T05:13:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.308+0000 7f0eed571640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 0x55d713f962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.308+0000 7f0eed571640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 0x55d713f962b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34398/0 (socket says 172.21.15.192:34398) 2024-09-10T05:13:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.308+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 learned_addr learned my addr 172.21.15.192:0/4218699885 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:13:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.308+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d713f96810 con 0x55d713f8eee0 2024-09-10T05:13:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.308+0000 7f0eed571640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 0x55d713f962b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0ee002f710 tx=0x7f0ee003a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.308+0000 7f0dc2ffd640 1 -- 172.21.15.192:0/4218699885 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee0035050 con 0x55d713f8eee0 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.308+0000 7f0dc2ffd640 1 -- 172.21.15.192:0/4218699885 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee0039510 con 0x55d713f8eee0 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.308+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d713f96810 con 0x55d713f8eee0 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.308+0000 7f0dc2ffd640 1 -- 172.21.15.192:0/4218699885 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee004b680 con 0x55d713f8eee0 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.308+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d713f96810 con 0x55d713f8eee0 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.309+0000 7f0dc2ffd640 1 -- 172.21.15.192:0/4218699885 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0ee003e110 con 0x55d713f8eee0 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.309+0000 7f0dc2ffd640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0db803c730 0x7f0db803ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.309+0000 7f0dc2ffd640 1 -- 172.21.15.192:0/4218699885 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f0ee005b030 con 0x55d713f8eee0 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.309+0000 7f0eecd70640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0db803c730 0x7f0db803ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.310+0000 7f0eecd70640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0db803c730 0x7f0db803ebf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55d713f74c70 tx=0x7f0ee4053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.310+0000 7f0eefa87800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.310+0000 7f0eefa87800 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d713fa1870 0x55d713fa3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.310+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa4480 con 0x55d713fa1870 2024-09-10T05:13:35.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.310+0000 7f0eedd72640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d713fa1870 0x55d713fa3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.310+0000 7f0eedd72640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d713fa1870 0x55d713fa3d30 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 20 realm 2024-09-10T05:13:35.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa4890 con 0x55d713fa1870 2024-09-10T05:13:35.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:13:35.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5160 con 0x55d713fa1870 2024-09-10T05:13:35.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa1870 2024-09-10T05:13:35.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:35.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d713fa6260 0x55d713fa8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.311+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa8c10 con 0x55d713fa6260 2024-09-10T05:13:35.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.312+0000 7f0eed571640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d713fa6260 0x55d713fa8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.312+0000 7f0eed571640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d713fa6260 0x55d713fa8650 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.312+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.312+0000 7f0eefa87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.312+0000 7f0eefa87800 20 searching for the correct realm 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.312+0000 7f0eefa87800 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55d713faabc0 0x55d713fad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.312+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fad750 con 0x55d713faabc0 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.312+0000 7f0eecd70640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55d713faabc0 0x55d713fad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.313+0000 7f0eecd70640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55d713faabc0 0x55d713fad080 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.313+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.313+0000 7f0eecd70640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0ee405f040 0x7f0ee406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.313+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fad750 con 0x7f0ee405f040 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.313+0000 7f0eedd72640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0ee405f040 0x7f0ee406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:13:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.313+0000 7f0eedd72640 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0ee405f040 0x7f0ee406b410 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.313+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.314+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa6260 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.314+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.314+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa1870 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.314+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.314+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa1870 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.314+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.314+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa6260 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.315+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.315+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa6260 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.315+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.315+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x7f0ee405f040 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.315+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.315+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713faabc0 2024-09-10T05:13:35.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.315+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.315+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa1870 2024-09-10T05:13:35.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.315+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.315+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa6260 2024-09-10T05:13:35.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.316+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.316+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa1870 2024-09-10T05:13:35.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.316+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.316+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x7f0ee405f040 2024-09-10T05:13:35.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.316+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.316+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713faabc0 2024-09-10T05:13:35.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.316+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.316+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713faabc0 2024-09-10T05:13:35.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.317+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.317+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa6260 2024-09-10T05:13:35.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.317+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.317+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713faabc0 2024-09-10T05:13:35.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.317+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.317+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713faabc0 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.317+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.317+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa1870 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.318+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.318+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa1870 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.318+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.318+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x7f0ee405f040 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.318+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.318+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713faabc0 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.318+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.318+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x7f0ee405f040 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.319+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.319+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa1870 2024-09-10T05:13:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.319+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.319+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa6260 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.319+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.319+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713faabc0 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.319+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.319+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa6260 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.320+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.320+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x7f0ee405f040 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.320+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.320+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713faabc0 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.320+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.320+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x7f0ee405f040 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x55d713fa1870 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa5500 con 0x7f0ee405f040 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eefa87800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eefa87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eefa87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eefa87800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eefa87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eefa87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eefa87800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa94d0 con 0x55d713fa1870 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eefa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eefa87800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa94d0 con 0x55d713fa1870 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.321+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa94d0 con 0x7f0ee405f040 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 20 zone default found 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 4 Realm: () 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:13:35.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 20 zonegroup default 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713fa98c0 con 0x55d713fa6260 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713faf5c0 con 0x55d713faabc0 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.322+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713faf960 con 0x55d713faabc0 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.323+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.323+0000 7f0eefa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:13:35.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.323+0000 7f0eefa87800 20 started sync module instance, tier type = 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.323+0000 7f0eefa87800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.323+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713faea60 con 0x7f0ee405f040 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.324+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.324+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94382241541712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713faea60 con 0x7f0ee405f040 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.324+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb01b0 con 0x55d713fa1870 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.325+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94382241541712] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.325+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.325+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94382241539984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb01b0 con 0x55d713fa1870 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.325+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb0bf0 con 0x55d713faabc0 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.326+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.326+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94382241547968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb1490 con 0x55d713faabc0 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.326+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb1f50 con 0x7f0ee405f040 2024-09-10T05:13:35.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.327+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94382241539984] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.327+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94382241547968] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.327+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.327+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94382241550304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fafd00 con 0x7f0ee405f040 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.327+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb27f0 con 0x55d713fa1870 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.328+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94382241550304] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.329+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.329+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94382241552928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb2750 con 0x55d713fa1870 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.329+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb3200 con 0x55d713fa6260 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.330+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94382241552928] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.330+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.330+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94382241555104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb26c0 con 0x55d713fa6260 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.330+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb40c0 con 0x55d713fa6260 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.331+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(56 notify.6 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.331+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94382241563744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb4d30 con 0x55d713fa6260 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.331+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb56f0 con 0x55d713fa6260 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.331+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94382241555104] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.332+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94382241563744] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.332+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.332+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94382241559968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb56f0 con 0x55d713fa6260 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.332+0000 7f0eefa87800 20 add_watcher() i=0 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.332+0000 7f0eefa87800 20 add_watcher() i=1 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.332+0000 7f0eefa87800 20 add_watcher() i=2 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.332+0000 7f0eefa87800 20 add_watcher() i=3 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.332+0000 7f0eefa87800 20 add_watcher() i=4 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.332+0000 7f0eefa87800 20 add_watcher() i=5 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.332+0000 7f0eefa87800 20 add_watcher() i=6 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.333+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94382241559968] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.333+0000 7f0eefa87800 20 add_watcher() i=7 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.333+0000 7f0eefa87800 2 all 8 watchers are set, enabling cache 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.333+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb88c0 con 0x55d713fa1870 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.333+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.333+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94382241567664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fb5c80 con 0x55d713fa1870 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.334+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94382241567664] v37'279 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.334+0000 7f0da37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.334+0000 7f0eefa87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.334+0000 7f0eefa87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.334+0000 7f0eefa87800 5 note: GC not initialized 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.335+0000 7f0da27e4640 20 reqs_thread_entry: start 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.335+0000 7f0eefa87800 20 init_complete bucket index max shards: 11 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.335+0000 7f0eefa87800 20 Filter name: none 2024-09-10T05:13:35.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.335+0000 7f0d13fff640 20 reqs_thread_entry: start 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.335+0000 7f0eefa87800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.335+0000 7f0eefa87800 20 rados->read ofs=0 len=0 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.335+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713feb9f0 con 0x55d713fa6260 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.336+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.336+0000 7f0eefa87800 20 rados_obj.operate() r=0 bl.length=473 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.336+0000 7f0eefa87800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.336+0000 7f0eefa87800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.336+0000 7f0eefa87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.336+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713ff2160 con 0x55d713fa6260 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v37'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0eefa87800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0eefa87800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0eefa87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-10T05:13:35.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94382241815392 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55d713fed7c0 con 0x55d713fa1870 2024-09-10T05:13:35.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== watch-notify(notify (1) cookie 94382241552928 notify 158913789983 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f0ee8018b20 con 0x55d713fa1870 2024-09-10T05:13:35.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0dd0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789983 cookie 94382241552928 notifier 4931 bl.length()=649 2024-09-10T05:13:35.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(64 notify.4 [notify cookie 94382241815392 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0dd0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-10T05:13:35.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0dd0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-10T05:13:35.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0dd0ff9640 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f0db0003ea0 con 0x55d713fa1870 2024-09-10T05:13:35.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.338+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== watch-notify(notify_complete (2) cookie 94382241815392 notify 158913789983 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0ee8018cf0 con 0x55d713fa1870 2024-09-10T05:13:35.350 INFO:teuthology.orchestra.run.smithi192.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-10T05:13:33.468641Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-10T05:13:33.468623Z","tags":[],"group_ids":[]} 2024-09-10T05:13:35.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.339+0000 7f0da37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:13:35.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.339+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94382241567664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fe9840 con 0x55d713fa1870 2024-09-10T05:13:35.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.340+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94382241567664] v37'280 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.340+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94382241541712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fe9840 con 0x7f0ee405f040 2024-09-10T05:13:35.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.341+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94382241541712] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.341+0000 7f0eefa87800 20 remove_watcher() i=0 2024-09-10T05:13:35.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.341+0000 7f0eefa87800 2 removed watcher, disabling cache 2024-09-10T05:13:35.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.341+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94382241539984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fe9840 con 0x55d713fa1870 2024-09-10T05:13:35.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.342+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94382241539984] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.342+0000 7f0eefa87800 20 remove_watcher() i=1 2024-09-10T05:13:35.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.342+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94382241547968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fe9840 con 0x55d713faabc0 2024-09-10T05:13:35.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.343+0000 7f0eecd70640 1 -- 172.21.15.192:0/4218699885 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94382241547968] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee407c040 con 0x55d713faabc0 2024-09-10T05:13:35.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.343+0000 7f0eefa87800 20 remove_watcher() i=2 2024-09-10T05:13:35.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.343+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94382241550304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fe9840 con 0x7f0ee405f040 2024-09-10T05:13:35.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.344+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94382241550304] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x7f0ee405f040 2024-09-10T05:13:35.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.344+0000 7f0eefa87800 20 remove_watcher() i=3 2024-09-10T05:13:35.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.344+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94382241552928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fe9840 con 0x55d713fa1870 2024-09-10T05:13:35.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.345+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94382241552928] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee800a4d0 con 0x55d713fa1870 2024-09-10T05:13:35.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.345+0000 7f0eefa87800 20 remove_watcher() i=4 2024-09-10T05:13:35.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.345+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94382241555104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fe9840 con 0x55d713fa6260 2024-09-10T05:13:35.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.346+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94382241555104] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.346+0000 7f0eefa87800 20 remove_watcher() i=5 2024-09-10T05:13:35.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.346+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94382241563744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fe9840 con 0x55d713fa6260 2024-09-10T05:13:35.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.347+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94382241563744] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.347+0000 7f0eefa87800 20 remove_watcher() i=6 2024-09-10T05:13:35.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.347+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94382241559968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55d713fe9840 con 0x55d713fa6260 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eed571640 1 -- 172.21.15.192:0/4218699885 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94382241559968] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee0037070 con 0x55d713fa6260 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 20 remove_watcher() i=7 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d713fa6260 msgr2=0x55d713fa8650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d713fa6260 0x55d713fa8650 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d713fa1870 msgr2=0x55d713fa3d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d713fa1870 0x55d713fa3d30 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0ee405f040 msgr2=0x7f0ee406b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f0ee405f040 0x7f0ee406b410 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55d713faabc0 msgr2=0x55d713fad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x55d713faabc0 0x55d713fad080 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0db803c730 msgr2=0x7f0db803ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0db803c730 0x7f0db803ebf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55d713f74c70 tx=0x7f0ee4053000 comp rx=0 tx=0).stop 2024-09-10T05:13:35.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 msgr2=0x55d713f962b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eedd72640 1 -- 172.21.15.192:0/4218699885 reap_dead start 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.348+0000 7f0eefa87800 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 0x55d713f962b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0ee002f710 tx=0x7f0ee003a8a0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 shutdown_connections 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 --2- 172.21.15.192:0/4218699885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f8eee0 0x55d713f962b0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 >> 172.21.15.192:0/4218699885 conn(0x55d713f8b2e0 msgr2=0x55d713f894f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 shutdown_connections 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/4218699885 wait complete. 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/1965491840 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0dc403c780 msgr2=0x7f0dc403ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 --2- 172.21.15.192:0/1965491840 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0dc403c780 0x7f0dc403ec40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4000c00 tx=0x7f0ee4005a00 comp rx=0 tx=0).stop 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/1965491840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f824a0 msgr2=0x55d713f828c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 --2- 172.21.15.192:0/1965491840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f824a0 0x55d713f828c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000ed00 tx=0x7f0ee00187a0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/1965491840 shutdown_connections 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 --2- 172.21.15.192:0/1965491840 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0dc403c780 0x7f0dc403ec40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 --2- 172.21.15.192:0/1965491840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713f824a0 0x55d713f828c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/1965491840 >> 172.21.15.192:0/1965491840 conn(0x55d713f76800 msgr2=0x55d713f76be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/1965491840 shutdown_connections 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/1965491840 wait complete. 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d713f6dca0 msgr2=0x55d713f70120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x55d713f6dca0 0x55d713f70120 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d713e6c570 msgr2=0x55d713f6b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x55d713e6c570 0x55d713f6b8c0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55d713f71d10 msgr2=0x55d713f74100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x55d713f71d10 0x55d713f74100 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0dd403c920 msgr2=0x7f0dd403ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f0dd403c920 0x7f0dd403ede0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4057000 tx=0x7f0ee4052000 comp rx=0 tx=0).stop 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 msgr2=0x55d713f64270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.349+0000 7f0eefa87800 1 --2- 172.21.15.192:0/874749390 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d713e69450 0x55d713f64270 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00012f0 tx=0x7f0ee0000ed0 comp rx=0 tx=0).stop 2024-09-10T05:13:35.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.350+0000 7f0eedd72640 1 -- 172.21.15.192:0/874749390 reap_dead start 2024-09-10T05:13:35.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.350+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 shutdown_connections 2024-09-10T05:13:35.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.350+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 >> 172.21.15.192:0/874749390 conn(0x55d713e64930 msgr2=0x55d713f55c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:13:35.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.350+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 shutdown_connections 2024-09-10T05:13:35.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:13:35.350+0000 7f0eefa87800 1 -- 172.21.15.192:0/874749390 wait complete. 2024-09-10T05:13:35.362 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:35.362 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-10T05:13:33.468641Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-10T05:13:33.468623Z', 'tags': [], 'group_ids': []} 2024-09-10T05:13:35.362 ERROR:root:0 2024-09-10T05:13:35.362 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-10T05:13:35.369 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:35.369 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:35.373 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:35.373 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-10T05:13:35.379 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:35.379 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:35.383 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:35.383 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-10T05:13:35.391 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-10T05:13:35.391 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:35.394 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:35.395 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-10T05:13:35.401 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:13:35.402 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:35.405 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:35.405 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-10T05:13:35.412 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-10T05:13:35.413 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:35.416 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:35.417 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-10T05:13:35.424 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-10T05:13:35.425 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:35.428 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:35.428 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-10T05:13:35.435 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:13:35.435 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:35.439 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:35.439 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-10T05:13:35.444 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:13:35.444 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:35.448 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:35.448 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-10T05:13:35.455 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:13:35.456 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:13:35.459 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:35.460 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-10T05:13:35.464 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T05:13:35.465 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-10T05:13:35.468 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T05:13:35.484 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-10T05:13:35.490 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-10T05:13:35.490 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T05:13:35.495 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '236edb0a-22f9-4c79-a204-203688ed4bab', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.11', 'marker': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:13:35.479338Z', 'creation_time': '2024-09-10T05:13:35.472439Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T05:13:35.495 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-10T05:13:35.500 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '236edb0a-22f9-4c79-a204-203688ed4bab', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.11', 'marker': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:13:35.479338Z', 'creation_time': '2024-09-10T05:13:35.472439Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-10T05:13:35.505 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T05:13:35.509 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '236edb0a-22f9-4c79-a204-203688ed4bab', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.11', 'marker': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:13:35.479338Z', 'creation_time': '2024-09-10T05:13:35.472439Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-10T05:13:35.510 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-10T05:13:35.514 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000b794918a176e7962-0066dfd57f-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:13:35.518 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-10T05:13:35.524 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:13:35.524 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-10T05:13:35.532 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:13:35.541 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.11'} 2024-09-10T05:13:35.550 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:13:35.593 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.11'} 2024-09-10T05:13:35.603 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:13:35.604 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-10T05:13:35.612 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:13:35.619 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-10T05:13:35.626 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:13:35.626 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-10T05:13:35.631 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '236edb0a-22f9-4c79-a204-203688ed4bab', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.11', 'marker': '92aa256a-2802-419e-96e0-ba675846cbc3.4238.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-10T05:13:35.598866Z', 'creation_time': '2024-09-10T05:13:35.472439Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-10T05:14:35.682 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-10T05:14:35.701 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:14:35.702 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-10T05:14:35.716 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:14:35.717 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-10T05:14:35.722 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:14:35.722 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-10T05:14:35.728 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:14:35.728 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-10T05:14:35.733 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:14:35.733 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-10T05:14:35.737 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:14:35.737 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-10T05:14:35.741 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-10T05:00:00.000000Z', 'epoch': 1725944400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-10T05:14:35.742 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-10T05:14:35.748 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:14:35.749 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-10T05:14:35.755 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-10T05:14:35.755 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-10T05:14:35.764 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:14:35.768 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-10T05:14:35.777 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:14:36.032 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-10T05:14:36.036 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000e1d628b85ec1a6f8-0066dfd5bc-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:14:36.182 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-10T05:14:36.186 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-10T05:14:36.191 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-10T05:14:36.195 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-10T05:14:36.313 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-10T05:14:36.350 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:14:36.351 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-10T05:14:36.357 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-10T05:14:36.357 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-10T05:14:36.362 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-10T05:14:36.373 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-10T05:14:36.378 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000bc7e46e11ac8b038-0066dfd5bc-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:14:36.402 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-10T05:14:36.434 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:14:36.434 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-10T05:14:36.440 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000228f944bf66468b7-0066dfd5bc-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:14:36.440 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-10T05:14:36.445 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '3465d198-8f8d-4e0c-ba83-88b13d9b49be'}]}} 2024-09-10T05:14:36.445 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-10T05:14:36.456 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-10T05:14:36.456 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-10T05:14:36.460 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T05:14:36.461 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-10T05:14:36.465 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000000c952bc37883ff91-0066dfd5bc-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:14:36.465 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-10T05:14:36.468 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000003a88178e8f657a06-0066dfd5bc-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:14:36.484 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-10T05:14:36.532 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T05:14:36.532 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-10T05:14:36.536 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000023cdfba2414f4ad9-0066dfd5bc-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:14:36.536 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-10T05:14:36.539 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000000acbecd979261018-0066dfd5bc-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:14:36.540 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-10T05:14:36.544 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-10T05:14:36.544 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-10T05:14:36.548 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000d248db041125c357-0066dfd5bc-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:14:36.548 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-10T05:14:36.551 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000fdf26b6f7510f359-0066dfd5bc-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:14:36.552 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-10T05:14:36.555 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000033032481da97cb33-0066dfd5bc-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:14:36.555 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-10T05:14:36.559 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000ec67ec5583fdd5d7-0066dfd5bc-4238-default', 'HostId': '4238-default-default'} 2024-09-10T05:14:36.559 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-10T05:14:36.569 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:14:36.569 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-10T05:14:36.572 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-10T05:14:36.573 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-10T05:14:36.578 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:14:36.578 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-10T05:14:36.582 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-10T05:14:36.582 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-10T05:14:36.587 INFO:tasks.radosgw_admin_rest: empty result 2024-09-10T05:14:36.592 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-10T05:14:36.601 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-10T05:14:36.602 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:14:36.603 INFO:tasks.rgw.client.0.smithi192.stdout:2024-09-10T05:14:36.602+0000 7f3faadcc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35928) UID: 0 2024-09-10T05:14:36.603 INFO:tasks.rgw.client.0.smithi192.stdout:2024-09-10T05:14:36.602+0000 7f3fae624880 -1 shutting down 2024-09-10T05:14:42.704 INFO:tasks.rgw.client.0:Stopped 2024-09-10T05:14:42.704 DEBUG:teuthology.orchestra.run.smithi192:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-10T05:14:42.723 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/vault-root-token 2024-09-10T05:14:42.793 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-10T05:14:42.862 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-10T05:14:42.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-10T05:14:42.863 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-10T05:14:42.950 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setuser ceph since I am not root 2024-09-10T05:14:42.951 INFO:teuthology.orchestra.run.smithi192.stderr:ignoring --setgroup ceph since I am not root 2024-09-10T05:14:42.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.950+0000 7f3e67c31800 1 Processor -- start 2024-09-10T05:14:42.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.950+0000 7f3e67c31800 1 -- start start 2024-09-10T05:14:42.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.950+0000 7f3e67c31800 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56170284bed0 0x56170284cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.950+0000 7f3e67c31800 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5617026f5e40 con 0x56170284d110 2024-09-10T05:14:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.950+0000 7f3e67c31800 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x5617026c0680 con 0x56170284bed0 2024-09-10T05:14:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.951+0000 7f3e62f8b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x56170284bed0 0x56170284cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.951+0000 7f3e6278a640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x56170284d110 0x561702851e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.192:38344/0 (socket says 172.21.15.192:38344) 2024-09-10T05:14:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.951+0000 7f3e6278a640 1 -- 172.21.15.192:0/1274118038 learned_addr learned my addr 172.21.15.192:0/1274118038 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-10T05:14:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.951+0000 7f3e61f89640 1 -- 172.21.15.192:0/1274118038 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 764753639 0 0) 0x5617026f5e40 con 0x56170284d110 2024-09-10T05:14:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.951+0000 7f3e61f89640 1 -- 172.21.15.192:0/1274118038 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e4c001e10 con 0x56170284d110 2024-09-10T05:14:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.951+0000 7f3e62f8b640 1 -- 172.21.15.192:0/1274118038 >> v1:172.21.15.139:6789/0 conn(0x56170284d110 legacy=0x561702851e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.951+0000 7f3e62f8b640 1 -- 172.21.15.192:0/1274118038 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617026dc6b0 con 0x56170284bed0 2024-09-10T05:14:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.953+0000 7f3e62f8b640 1 --2- 172.21.15.192:0/1274118038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x56170284cbd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005fd0 tx=0x7f3e54045b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49823a7b63936c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.953+0000 7f3e61f89640 1 -- 172.21.15.192:0/1274118038 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e54055070 con 0x56170284bed0 2024-09-10T05:14:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.953+0000 7f3e61f89640 1 -- 172.21.15.192:0/1274118038 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e54051540 con 0x56170284bed0 2024-09-10T05:14:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.953+0000 7f3e61f89640 1 -- 172.21.15.192:0/1274118038 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e54051840 con 0x56170284bed0 2024-09-10T05:14:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.954+0000 7f3e67c31800 1 -- 172.21.15.192:0/1274118038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 msgr2=0x56170284cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.954+0000 7f3e67c31800 1 --2- 172.21.15.192:0/1274118038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x56170284cbd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005fd0 tx=0x7f3e54045b30 comp rx=0 tx=0).stop 2024-09-10T05:14:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.954+0000 7f3e67c31800 1 -- 172.21.15.192:0/1274118038 shutdown_connections 2024-09-10T05:14:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.954+0000 7f3e67c31800 1 --2- 172.21.15.192:0/1274118038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x56170284cbd0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:42.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.954+0000 7f3e67c31800 1 -- 172.21.15.192:0/1274118038 >> 172.21.15.192:0/1274118038 conn(0x561702847300 msgr2=0x561702849720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:42.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.954+0000 7f3e67c31800 1 -- 172.21.15.192:0/1274118038 shutdown_connections 2024-09-10T05:14:42.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.954+0000 7f3e67c31800 1 -- 172.21.15.192:0/1274118038 wait complete. 2024-09-10T05:14:42.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.969+0000 7f3e67c31800 1 Processor -- start 2024-09-10T05:14:42.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.969+0000 7f3e67c31800 1 -- start start 2024-09-10T05:14:42.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.969+0000 7f3e67c31800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x56170293b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.969+0000 7f3e67c31800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5617026e4dd0 con 0x56170284bed0 2024-09-10T05:14:42.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.970+0000 7f3e62f8b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x56170293b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.970+0000 7f3e62f8b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x56170293b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34302/0 (socket says 172.21.15.192:34302) 2024-09-10T05:14:42.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.970+0000 7f3e62f8b640 1 -- 172.21.15.192:0/753074466 learned_addr learned my addr 172.21.15.192:0/753074466 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:14:42.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.970+0000 7f3e62f8b640 1 -- 172.21.15.192:0/753074466 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617026fde10 con 0x56170284bed0 2024-09-10T05:14:42.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.970+0000 7f3e62f8b640 1 --2- 172.21.15.192:0/753074466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x56170293b450 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005fd0 tx=0x7f3e54051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06efa05ca0819e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.970+0000 7f3d50e09640 1 -- 172.21.15.192:0/753074466 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e54069070 con 0x56170284bed0 2024-09-10T05:14:42.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.970+0000 7f3d50e09640 1 -- 172.21.15.192:0/753074466 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e540518e0 con 0x56170284bed0 2024-09-10T05:14:42.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.970+0000 7f3d50e09640 1 -- 172.21.15.192:0/753074466 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e54055040 con 0x56170284bed0 2024-09-10T05:14:42.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.971+0000 7f3e67c31800 1 -- 172.21.15.192:0/753074466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 msgr2=0x56170293b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:42.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.971+0000 7f3e67c31800 1 --2- 172.21.15.192:0/753074466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x56170293b450 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005fd0 tx=0x7f3e54051000 comp rx=0 tx=0).stop 2024-09-10T05:14:42.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.971+0000 7f3e67c31800 1 -- 172.21.15.192:0/753074466 shutdown_connections 2024-09-10T05:14:42.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.971+0000 7f3e67c31800 1 --2- 172.21.15.192:0/753074466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x56170293b450 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:42.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.971+0000 7f3e67c31800 1 -- 172.21.15.192:0/753074466 >> 172.21.15.192:0/753074466 conn(0x561702847300 msgr2=0x561702936dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:42.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.971+0000 7f3e67c31800 1 -- 172.21.15.192:0/753074466 shutdown_connections 2024-09-10T05:14:42.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.971+0000 7f3e67c31800 1 -- 172.21.15.192:0/753074466 wait complete. 2024-09-10T05:14:42.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.971+0000 7f3e67c31800 1 Processor -- start 2024-09-10T05:14:42.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.972+0000 7f3e67c31800 1 -- start start 2024-09-10T05:14:42.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.972+0000 7f3e67c31800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x561702942cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.972+0000 7f3e67c31800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56170284d800 con 0x56170284bed0 2024-09-10T05:14:42.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.972+0000 7f3e62f8b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x561702942cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.972+0000 7f3e62f8b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x561702942cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34318/0 (socket says 172.21.15.192:34318) 2024-09-10T05:14:42.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.972+0000 7f3e62f8b640 1 -- 172.21.15.192:0/2640428517 learned_addr learned my addr 172.21.15.192:0/2640428517 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:14:42.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.972+0000 7f3e62f8b640 1 -- 172.21.15.192:0/2640428517 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561702943250 con 0x56170284bed0 2024-09-10T05:14:42.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.972+0000 7f3e62f8b640 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x561702942cf0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005fd0 tx=0x7f3e54003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.973+0000 7f3d4f606640 1 -- 172.21.15.192:0/2640428517 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e54069040 con 0x56170284bed0 2024-09-10T05:14:42.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.973+0000 7f3d4f606640 1 -- 172.21.15.192:0/2640428517 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e54072070 con 0x56170284bed0 2024-09-10T05:14:42.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.973+0000 7f3d4f606640 1 -- 172.21.15.192:0/2640428517 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e54055040 con 0x56170284bed0 2024-09-10T05:14:42.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.973+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617029434e0 con 0x56170284bed0 2024-09-10T05:14:42.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.973+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561702943e60 con 0x56170284bed0 2024-09-10T05:14:42.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.974+0000 7f3d4f606640 1 -- 172.21.15.192:0/2640428517 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3e54058070 con 0x56170284bed0 2024-09-10T05:14:42.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.974+0000 7f3d4f606640 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d4803c780 0x7f3d4803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.974+0000 7f3d4f606640 1 -- 172.21.15.192:0/2640428517 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f3e54061030 con 0x56170284bed0 2024-09-10T05:14:42.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.974+0000 7f3e6278a640 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d4803c780 0x7f3d4803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.974+0000 7f3e67c31800 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56170284d110 0x56170294a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.974+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561702944ad0 con 0x56170284d110 2024-09-10T05:14:42.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.974+0000 7f3e6378c640 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56170284d110 0x56170294a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.974+0000 7f3e6278a640 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d4803c780 0x7f3d4803ec40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e58001db0 tx=0x7f3e58001310 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.974+0000 7f3e6378c640 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56170284d110 0x56170294a340 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.975+0000 7f3e6378c640 1 -- 172.21.15.192:0/2640428517 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e5c0083e0 con 0x56170284d110 2024-09-10T05:14:42.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.975+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561702944360 con 0x56170284d110 2024-09-10T05:14:42.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.975+0000 7f3e6378c640 1 -- 172.21.15.192:0/2640428517 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e5c0083e0 con 0x56170284d110 2024-09-10T05:14:42.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.975+0000 7f3e67c31800 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56170294c830 0x56170294ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.975+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:3 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56170294f2f0 con 0x56170294c830 2024-09-10T05:14:42.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.975+0000 7f3e62f8b640 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56170294c830 0x56170294ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.976+0000 7f3e62f8b640 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56170294c830 0x56170294ec20 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.976+0000 7f3e62f8b640 1 -- 172.21.15.192:0/2640428517 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(3 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3e54057030 con 0x56170294c830 2024-09-10T05:14:42.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.976+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56170294b6d0 con 0x56170284d110 2024-09-10T05:14:42.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.976+0000 7f3e6378c640 1 -- 172.21.15.192:0/2640428517 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e5c0083e0 con 0x56170284d110 2024-09-10T05:14:42.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.976+0000 7f3e67c31800 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561702950730 0x561702952b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.976+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:5 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561702953290 con 0x561702950730 2024-09-10T05:14:42.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.977+0000 7f3e6278a640 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561702950730 0x561702952b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.977+0000 7f3e6278a640 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561702950730 0x561702952b20 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.977+0000 7f3e6278a640 1 -- 172.21.15.192:0/2640428517 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(5 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3e58009050 con 0x561702950730 2024-09-10T05:14:42.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.977+0000 7f3e67c31800 1 Processor -- start 2024-09-10T05:14:42.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.978+0000 7f3e67c31800 1 -- start start 2024-09-10T05:14:42.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.978+0000 7f3e67c31800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617027c0ee0 0x5617027bf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.978+0000 7f3e67c31800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561702742a00 con 0x5617027c0ee0 2024-09-10T05:14:42.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.978+0000 7f3e62f8b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617027c0ee0 0x5617027bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.978+0000 7f3e62f8b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617027c0ee0 0x5617027bf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34332/0 (socket says 172.21.15.192:34332) 2024-09-10T05:14:42.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.978+0000 7f3e62f8b640 1 -- 172.21.15.192:0/2984567343 learned_addr learned my addr 172.21.15.192:0/2984567343 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:14:42.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.978+0000 7f3e62f8b640 1 -- 172.21.15.192:0/2984567343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617027c1400 con 0x5617027c0ee0 2024-09-10T05:14:42.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.978+0000 7f3e62f8b640 1 --2- 172.21.15.192:0/2984567343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617027c0ee0 0x5617027bf750 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3e54059b70 tx=0x7f3e5405ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.979+0000 7f3d4ce01640 1 -- 172.21.15.192:0/2984567343 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e5406cae0 con 0x5617027c0ee0 2024-09-10T05:14:42.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.979+0000 7f3d4ce01640 1 -- 172.21.15.192:0/2984567343 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5406cc80 con 0x5617027c0ee0 2024-09-10T05:14:42.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.979+0000 7f3e67c31800 1 -- 172.21.15.192:0/2984567343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617027bfc90 con 0x5617027c0ee0 2024-09-10T05:14:42.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.979+0000 7f3d4ce01640 1 -- 172.21.15.192:0/2984567343 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e5406c550 con 0x5617027c0ee0 2024-09-10T05:14:42.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.979+0000 7f3e67c31800 1 -- 172.21.15.192:0/2984567343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617027c0230 con 0x5617027c0ee0 2024-09-10T05:14:42.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.980+0000 7f3d4ce01640 1 -- 172.21.15.192:0/2984567343 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3e54077d10 con 0x5617027c0ee0 2024-09-10T05:14:42.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.980+0000 7f3d4ce01640 1 --2- 172.21.15.192:0/2984567343 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d3c03c730 0x7f3d3c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.980+0000 7f3d4ce01640 1 -- 172.21.15.192:0/2984567343 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f3e54087070 con 0x5617027c0ee0 2024-09-10T05:14:42.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.980+0000 7f3e6278a640 1 --2- 172.21.15.192:0/2984567343 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d3c03c730 0x7f3d3c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.980+0000 7f3e67c31800 1 Processor -- start 2024-09-10T05:14:42.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.980+0000 7f3e67c31800 1 -- start start 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.980+0000 7f3e6278a640 1 --2- 172.21.15.192:0/2984567343 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d3c03c730 0x7f3d3c03ebf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x561702953690 tx=0x7f3e5800f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.980+0000 7f3e67c31800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 0x56170296fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.980+0000 7f3e67c31800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56170293bbe0 con 0x56170296f9b0 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.981+0000 7f3e62f8b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 0x56170296fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.981+0000 7f3e62f8b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 0x56170296fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34338/0 (socket says 172.21.15.192:34338) 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.981+0000 7f3e62f8b640 1 -- 172.21.15.192:0/1140425469 learned_addr learned my addr 172.21.15.192:0/1140425469 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.981+0000 7f3e62f8b640 1 -- 172.21.15.192:0/1140425469 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561702970380 con 0x56170296f9b0 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.981+0000 7f3e62f8b640 1 --2- 172.21.15.192:0/1140425469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 0x56170296fd90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3e54076d50 tx=0x7f3e54076e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c30cf59a038632e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.981+0000 7f3d467fc640 1 -- 172.21.15.192:0/1140425469 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e54064900 con 0x56170296f9b0 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.981+0000 7f3d467fc640 1 -- 172.21.15.192:0/1140425469 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e540941a0 con 0x56170296f9b0 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.981+0000 7f3d467fc640 1 -- 172.21.15.192:0/1140425469 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e5406c6f0 con 0x56170296f9b0 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e67c31800 1 -- 172.21.15.192:0/1140425469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 msgr2=0x56170296fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:42.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e67c31800 1 --2- 172.21.15.192:0/1140425469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 0x56170296fd90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3e54076d50 tx=0x7f3e54076e40 comp rx=0 tx=0).stop 2024-09-10T05:14:42.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e67c31800 1 -- 172.21.15.192:0/1140425469 shutdown_connections 2024-09-10T05:14:42.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e67c31800 1 --2- 172.21.15.192:0/1140425469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 0x56170296fd90 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:42.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e67c31800 1 -- 172.21.15.192:0/1140425469 >> 172.21.15.192:0/1140425469 conn(0x56170296bdb0 msgr2=0x561702969ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:42.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e67c31800 1 -- 172.21.15.192:0/1140425469 shutdown_connections 2024-09-10T05:14:42.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e67c31800 1 -- 172.21.15.192:0/1140425469 wait complete. 2024-09-10T05:14:42.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e67c31800 1 Processor -- start 2024-09-10T05:14:42.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e67c31800 1 -- start start 2024-09-10T05:14:42.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e67c31800 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 0x561702976db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e67c31800 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561702970810 con 0x56170296f9b0 2024-09-10T05:14:42.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e62f8b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 0x561702976db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e62f8b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 0x561702976db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.192:34346/0 (socket says 172.21.15.192:34346) 2024-09-10T05:14:42.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.982+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 learned_addr learned my addr 172.21.15.192:0/927618962 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T05:14:42.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.983+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561702977310 con 0x56170296f9b0 2024-09-10T05:14:42.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.983+0000 7f3e62f8b640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 0x561702976db0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3e54076d50 tx=0x7f3e54079f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.983+0000 7f3d44ff9640 1 -- 172.21.15.192:0/927618962 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e540ba020 con 0x56170296f9b0 2024-09-10T05:14:42.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.983+0000 7f3d44ff9640 1 -- 172.21.15.192:0/927618962 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e540589f0 con 0x56170296f9b0 2024-09-10T05:14:42.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.983+0000 7f3d44ff9640 1 -- 172.21.15.192:0/927618962 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e54058d10 con 0x56170296f9b0 2024-09-10T05:14:42.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.983+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561702977310 con 0x56170296f9b0 2024-09-10T05:14:42.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.983+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561702977310 con 0x56170296f9b0 2024-09-10T05:14:42.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.984+0000 7f3d44ff9640 1 -- 172.21.15.192:0/927618962 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f3e540bd020 con 0x56170296f9b0 2024-09-10T05:14:42.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.984+0000 7f3d44ff9640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d2c03c730 0x7f3d2c03ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.984+0000 7f3d44ff9640 1 -- 172.21.15.192:0/927618962 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f3e540b0050 con 0x56170296f9b0 2024-09-10T05:14:42.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.984+0000 7f3e6278a640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d2c03c730 0x7f3d2c03ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.985+0000 7f3e6278a640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d2c03c730 0x7f3d2c03ebf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800efd0 tx=0x7f3e58024000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.985+0000 7f3e67c31800 20 rados->read ofs=0 len=0 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.985+0000 7f3e67c31800 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5617029823e0 0x5617029848a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.985+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561702984ff0 con 0x5617029823e0 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.985+0000 7f3e6378c640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5617029823e0 0x5617029848a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.985+0000 7f3e6378c640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5617029823e0 0x5617029848a0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e5c0083e0 con 0x5617029823e0 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 20 realm 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 20 rados->read ofs=0 len=0 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561702985400 con 0x5617029823e0 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e5c0083e0 con 0x5617029823e0 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:14:42.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 20 rados->read ofs=0 len=0 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x5617029823e0 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e5c0083e0 con 0x5617029823e0 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 20 rados->read ofs=0 len=0 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561702986070 con 0x5617029823e0 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e5c0083e0 con 0x5617029823e0 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 20 rados->read ofs=0 len=0 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561702986a30 0x561702988e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.986+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:5 5.b 5:d7b27c4d:::zone_info.92aa256a-2802-419e-96e0-ba675846cbc3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561702989470 con 0x561702986a30 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.987+0000 7f3e62f8b640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561702986a30 0x561702988e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.987+0000 7f3e62f8b640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561702986a30 0x561702988e20 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.987+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== osd_op_reply(5 zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:42.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.987+0000 7f3e67c31800 20 rados_obj.operate() r=0 bl.length=993 2024-09-10T05:14:42.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.987+0000 7f3e67c31800 20 searching for the correct realm 2024-09-10T05:14:42.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.987+0000 7f3e67c31800 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56170298b400 0x56170298d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.987+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56170298df40 con 0x56170298b400 2024-09-10T05:14:42.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.988+0000 7f3e6278a640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56170298b400 0x56170298d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.988+0000 7f3e6278a640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56170298b400 0x56170298d8c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.988+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:42.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.988+0000 7f3e6278a640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3e58038040 0x7f3e58039ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:42.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.988+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56170298df40 con 0x7f3e58038040 2024-09-10T05:14:42.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.988+0000 7f3e6378c640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3e58038040 0x7f3e58039ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:42.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.989+0000 7f3e6378c640 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3e58038040 0x7f3e58039ab0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:42.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.989+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3e5c0083e0 con 0x7f3e58038040 2024-09-10T05:14:42.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.989+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x561702986a30 2024-09-10T05:14:43.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.989+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.989+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x5617029823e0 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.989+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5c0083e0 con 0x5617029823e0 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.989+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x5617029823e0 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.990+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5c026040 con 0x5617029823e0 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.990+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x561702986a30 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.990+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.990+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x561702986a30 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.990+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.990+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x7f3e58038040 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.990+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5c026040 con 0x7f3e58038040 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.990+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x56170298b400 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.991+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.991+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x5617029823e0 2024-09-10T05:14:43.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.991+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5c026040 con 0x5617029823e0 2024-09-10T05:14:43.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.991+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x561702986a30 2024-09-10T05:14:43.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.991+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.991+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x5617029823e0 2024-09-10T05:14:43.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.991+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5c026040 con 0x5617029823e0 2024-09-10T05:14:43.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.991+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x7f3e58038040 2024-09-10T05:14:43.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.992+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3e5c026040 con 0x7f3e58038040 2024-09-10T05:14:43.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.992+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x56170298b400 2024-09-10T05:14:43.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.992+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.992+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x56170298b400 2024-09-10T05:14:43.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.992+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.992+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x561702986a30 2024-09-10T05:14:43.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.993+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.993+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x56170298b400 2024-09-10T05:14:43.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.993+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.993+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x56170298b400 2024-09-10T05:14:43.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.993+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.993+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x5617029823e0 2024-09-10T05:14:43.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.993+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5c026040 con 0x5617029823e0 2024-09-10T05:14:43.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.993+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x5617029823e0 2024-09-10T05:14:43.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.993+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3e5c026040 con 0x5617029823e0 2024-09-10T05:14:43.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.994+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x7f3e58038040 2024-09-10T05:14:43.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.994+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 4 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5c026040 con 0x7f3e58038040 2024-09-10T05:14:43.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.994+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x56170298b400 2024-09-10T05:14:43.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.994+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.994+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x7f3e58038040 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.994+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5c026040 con 0x7f3e58038040 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.994+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x5617029823e0 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.994+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.994+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x561702986a30 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.995+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 7 ==== osd_op_reply(30 [pgnls start_epoch 37 out=82b] v37'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.995+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x56170298b400 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.995+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.995+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x561702986a30 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.995+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 8 ==== osd_op_reply(32 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.995+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x7f3e58038040 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.996+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.996+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x56170298b400 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.996+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.996+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x7f3e58038040 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.996+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 7 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.996+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3e5c03a040 con 0x5617029823e0 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.996+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.996+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3e5c03a040 con 0x7f3e58038040 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 8 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 RGWRados::pool_iterate: got zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 RGWRados::pool_iterate: got period_config.default 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 RGWRados::pool_iterate: got zone_info.92aa256a-2802-419e-96e0-ba675846cbc3 2024-09-10T05:14:43.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-10T05:14:43.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-10T05:14:43.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 rados->read ofs=0 len=0 2024-09-10T05:14:43.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x5617029823e0 2024-09-10T05:14:43.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:14:43.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 rados->read ofs=0 len=0 2024-09-10T05:14:43.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x5617029823e0 2024-09-10T05:14:43.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-10T05:14:43.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 rados->read ofs=0 len=0 2024-09-10T05:14:43.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:40 5.10 5:0ea59482:::zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561702985cd0 con 0x7f3e58038040 2024-09-10T05:14:43.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 9 ==== osd_op_reply(40 zonegroup_info.236edb0a-22f9-4c79-a204-203688ed4bab [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 rados_obj.operate() r=0 bl.length=436 2024-09-10T05:14:43.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 zone default found 2024-09-10T05:14:43.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 4 Realm: () 2024-09-10T05:14:43.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 4 ZoneGroup: default (236edb0a-22f9-4c79-a204-203688ed4bab) 2024-09-10T05:14:43.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 4 Zone: default (92aa256a-2802-419e-96e0-ba675846cbc3) 2024-09-10T05:14:43.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-10T05:14:43.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 zonegroup default 2024-09-10T05:14:43.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 20 rados->read ofs=0 len=0 2024-09-10T05:14:43.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.997+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56170298a920 con 0x561702986a30 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.998+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.998+0000 7f3e67c31800 20 rados_obj.operate() r=0 bl.length=187 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.998+0000 7f3e67c31800 20 rados->read ofs=0 len=0 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.998+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56170298f880 con 0x56170298b400 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.998+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.998+0000 7f3e67c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.998+0000 7f3e67c31800 20 rados->read ofs=0 len=0 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.998+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56170298fce0 con 0x56170298b400 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.998+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.999+0000 7f3e67c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.999+0000 7f3e67c31800 20 started sync module instance, tier type = 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.999+0000 7f3e67c31800 20 started zone id=92aa256a-2802-419e-96e0-ba675846cbc3 (name=default) with tier type = 2024-09-10T05:14:43.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:42.999+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170298ed10 con 0x7f3e58038040 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.000+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 10 ==== osd_op_reply(44 notify.0 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.000+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94656827814416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170298ed10 con 0x7f3e58038040 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.000+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029907c0 con 0x5617029823e0 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.001+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94656827814416] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.001+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 15 ==== osd_op_reply(46 notify.1 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.001+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94656827818672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170298ed10 con 0x5617029823e0 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.001+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029911d0 con 0x56170298b400 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.003+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94656827818672] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.003+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 12 ==== osd_op_reply(48 notify.2 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.003+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94656827811936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170298ec80 con 0x56170298b400 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.003+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561702992090 con 0x7f3e58038040 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.004+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 12 ==== osd_op_reply(50 notify.3 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.004+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94656827825600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561702992830 con 0x7f3e58038040 2024-09-10T05:14:43.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.004+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561702993330 con 0x5617029823e0 2024-09-10T05:14:43.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.004+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94656827811936] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.005+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94656827825600] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.006+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 17 ==== osd_op_reply(52 notify.4 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.006+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94656827829792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029932f0 con 0x5617029823e0 2024-09-10T05:14:43.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.006+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561702993c00 con 0x561702986a30 2024-09-10T05:14:43.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.007+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94656827829792] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.007+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 10 ==== osd_op_reply(54 notify.5 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.007+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94656827823552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029932f0 con 0x561702986a30 2024-09-10T05:14:43.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.007+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029932f0 con 0x561702986a30 2024-09-10T05:14:43.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.008+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94656827823552] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.008+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 12 ==== osd_op_reply(56 notify.6 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.008+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94656827833712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561702994270 con 0x561702986a30 2024-09-10T05:14:43.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.008+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561702994c70 con 0x561702986a30 2024-09-10T05:14:43.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.009+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94656827833712] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.012+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 14 ==== osd_op_reply(58 notify.7 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.012+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94656827832144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561702994c30 con 0x561702986a30 2024-09-10T05:14:43.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.012+0000 7f3e67c31800 20 add_watcher() i=0 2024-09-10T05:14:43.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.012+0000 7f3e67c31800 20 add_watcher() i=1 2024-09-10T05:14:43.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.012+0000 7f3e67c31800 20 add_watcher() i=2 2024-09-10T05:14:43.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.012+0000 7f3e67c31800 20 add_watcher() i=3 2024-09-10T05:14:43.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.012+0000 7f3e67c31800 20 add_watcher() i=4 2024-09-10T05:14:43.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.012+0000 7f3e67c31800 20 add_watcher() i=5 2024-09-10T05:14:43.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.012+0000 7f3e67c31800 20 add_watcher() i=6 2024-09-10T05:14:43.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.013+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94656827832144] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.013+0000 7f3e67c31800 20 add_watcher() i=7 2024-09-10T05:14:43.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.013+0000 7f3e67c31800 2 all 8 watchers are set, enabling cache 2024-09-10T05:14:43.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.013+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029980f0 con 0x5617029823e0 2024-09-10T05:14:43.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.014+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.014+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94656827836752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561702995640 con 0x5617029823e0 2024-09-10T05:14:43.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.015+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94656827836752] v37'282 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.015+0000 7f3d197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:14:43.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.015+0000 7f3e67c31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-10T05:14:43.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.015+0000 7f3e67c31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-10T05:14:43.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.015+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029a0940 con 0x5617029823e0 2024-09-10T05:14:43.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.016+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'61 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.017+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029a0940 con 0x561702986a30 2024-09-10T05:14:43.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.018+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.018+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029a0940 con 0x56170298b400 2024-09-10T05:14:43.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.019+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.019+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029a00a0 con 0x5617029823e0 2024-09-10T05:14:43.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.020+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'283 uv169 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.020+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029a00a0 con 0x7f3e58038040 2024-09-10T05:14:43.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.021+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'89 uv57 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.021+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029a2090 con 0x56170298b400 2024-09-10T05:14:43.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.022+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'67 uv46 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.022+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029a2ab0 con 0x5617029823e0 2024-09-10T05:14:43.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.023+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.023+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029a2ab0 con 0x561702986a30 2024-09-10T05:14:43.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.024+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'61 uv40 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.024+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029a2ab0 con 0x7f3e58038040 2024-09-10T05:14:43.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.025+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.026+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029a2ab0 con 0x56170298b400 2024-09-10T05:14:43.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.027+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.027+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299efa0 con 0x7f3e58038040 2024-09-10T05:14:43.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.028+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'90 uv59 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.028+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299efa0 con 0x561702986a30 2024-09-10T05:14:43.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.029+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'43 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.029+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f0a0 con 0x7f3e58038040 2024-09-10T05:14:43.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.030+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.030+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299e920 con 0x561702986a30 2024-09-10T05:14:43.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.031+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'74 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.031+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f0a0 con 0x5617029823e0 2024-09-10T05:14:43.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.032+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'284 uv171 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.032+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299e920 con 0x56170298b400 2024-09-10T05:14:43.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.034+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'86 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.034+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f0a0 con 0x7f3e58038040 2024-09-10T05:14:43.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.034+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'91 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.034+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f0a0 con 0x56170298b400 2024-09-10T05:14:43.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.035+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'45 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.035+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f190 con 0x5617029823e0 2024-09-10T05:14:43.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.037+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.037+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f190 con 0x5617029823e0 2024-09-10T05:14:43.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.038+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'285 uv174 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.038+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f190 con 0x56170298b400 2024-09-10T05:14:43.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.039+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'87 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.039+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f290 con 0x7f3e58038040 2024-09-10T05:14:43.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.040+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'48 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.040+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f290 con 0x56170298b400 2024-09-10T05:14:43.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.041+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.041+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f290 con 0x56170298b400 2024-09-10T05:14:43.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.042+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'49 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.042+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f290 con 0x56170298b400 2024-09-10T05:14:43.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.043+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.043+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f290 con 0x56170298b400 2024-09-10T05:14:43.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.044+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'68 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.044+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f290 con 0x561702986a30 2024-09-10T05:14:43.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.045+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.045+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f290 con 0x56170298b400 2024-09-10T05:14:43.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.046+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'45 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.046+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f290 con 0x561702986a30 2024-09-10T05:14:43.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.047+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.047+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56170299f290 con 0x56170298b400 2024-09-10T05:14:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.049+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'88 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.049+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029a3610 con 0x561702986a30 2024-09-10T05:14:43.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.050+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'75 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.050+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029a3610 con 0x7f3e58038040 2024-09-10T05:14:43.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.051+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.051+0000 7f3c93fff640 20 reqs_thread_entry: start 2024-09-10T05:14:43.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.051+0000 7f3e67c31800 20 init_complete bucket index max shards: 11 2024-09-10T05:14:43.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.051+0000 7f3e67c31800 20 Filter name: none 2024-09-10T05:14:43.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.051+0000 7f3c91ffb640 20 reqs_thread_entry: start 2024-09-10T05:14:43.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.051+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-10T05:14:43.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.051+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:94 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.052+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 21 ==== osd_op_reply(94 gc.8 [call] v37'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.052+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:95 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.053+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 22 ==== osd_op_reply(95 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.053+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.053+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:96 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x7f3e58038040 2024-09-10T05:14:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.053+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 23 ==== osd_op_reply(96 gc.8 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.053+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:97 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.053+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 24 ==== osd_op_reply(97 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.053+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.053+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:98 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.053+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 25 ==== osd_op_reply(98 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.053+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.053+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:99 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.054+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 26 ==== osd_op_reply(99 gc.8 [call] v37'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.054+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-10T05:14:43.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.054+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:100 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.055+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 26 ==== osd_op_reply(100 gc.9 [call] v37'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.055+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:101 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.055+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 27 ==== osd_op_reply(101 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.055+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.055+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:102 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x56170298b400 2024-09-10T05:14:43.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.056+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 28 ==== osd_op_reply(102 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.056+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:103 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.056+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 29 ==== osd_op_reply(103 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.056+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.056+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:104 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.056+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 30 ==== osd_op_reply(104 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.056+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.056+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:105 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.057+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 31 ==== osd_op_reply(105 gc.9 [call] v37'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.057+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-10T05:14:43.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.057+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:106 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.058+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 27 ==== osd_op_reply(106 gc.10 [call] v37'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.058+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:107 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.058+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 28 ==== osd_op_reply(107 gc.10 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.058+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.058+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:108 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x7f3e58038040 2024-09-10T05:14:43.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.058+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 29 ==== osd_op_reply(108 gc.10 [call out=24b] v0'0 uv92 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.058+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:109 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.059+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 30 ==== osd_op_reply(109 gc.10 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.059+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.059+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:110 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.059+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 31 ==== osd_op_reply(110 gc.10 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.059+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.059+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:111 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.060+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 32 ==== osd_op_reply(111 gc.10 [call] v37'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.060+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-10T05:14:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.060+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:112 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.061+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 23 ==== osd_op_reply(112 gc.11 [call] v37'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.061+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:113 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.061+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 24 ==== osd_op_reply(113 gc.11 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.061+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.061+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:114 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x561702986a30 2024-09-10T05:14:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.061+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 25 ==== osd_op_reply(114 gc.11 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.061+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:115 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.062+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 26 ==== osd_op_reply(115 gc.11 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.062+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.062+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:116 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.062+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 27 ==== osd_op_reply(116 gc.11 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.062+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.062+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:117 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.063+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 28 ==== osd_op_reply(117 gc.11 [call] v37'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.063+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-10T05:14:43.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.063+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:118 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.064+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 33 ==== osd_op_reply(118 gc.12 [call] v37'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.064+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:119 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.064+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 34 ==== osd_op_reply(119 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.064+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.064+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:120 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x7f3e58038040 2024-09-10T05:14:43.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.065+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 35 ==== osd_op_reply(120 gc.12 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.065+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:121 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.065+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 36 ==== osd_op_reply(121 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.065+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.065+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:122 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.065+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 37 ==== osd_op_reply(122 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.065+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.065+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:123 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.066+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 38 ==== osd_op_reply(123 gc.12 [call] v37'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.066+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-10T05:14:43.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.066+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:124 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.067+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 29 ==== osd_op_reply(124 gc.13 [call] v37'76 uv76 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.067+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:125 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.067+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 30 ==== osd_op_reply(125 gc.13 [call out=15b] v0'0 uv76 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.067+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.067+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:126 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x561702986a30 2024-09-10T05:14:43.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.068+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 31 ==== osd_op_reply(126 gc.13 [call out=24b] v0'0 uv76 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.068+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:127 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.068+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 32 ==== osd_op_reply(127 gc.13 [call out=15b] v0'0 uv76 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.068+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.068+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:128 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.068+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 33 ==== osd_op_reply(128 gc.13 [call out=15b] v0'0 uv76 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.068+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.068+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:129 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.069+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 34 ==== osd_op_reply(129 gc.13 [call] v37'77 uv77 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.069+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-10T05:14:43.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.069+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:130 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.070+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 27 ==== osd_op_reply(130 gc.14 [call] v37'286 uv286 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.070+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:131 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.070+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 28 ==== osd_op_reply(131 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.070+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.070+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:132 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x5617029823e0 2024-09-10T05:14:43.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.071+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 29 ==== osd_op_reply(132 gc.14 [call out=24b] v0'0 uv286 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.071+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:133 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.071+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 30 ==== osd_op_reply(133 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.071+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.071+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:134 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.071+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 31 ==== osd_op_reply(134 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.071+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.071+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:135 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.072+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 32 ==== osd_op_reply(135 gc.14 [call] v37'287 uv287 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.072+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-10T05:14:43.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.072+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:136 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.073+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 32 ==== osd_op_reply(136 gc.15 [call] v37'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.073+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:137 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.074+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 33 ==== osd_op_reply(137 gc.15 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.074+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.074+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:138 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x56170298b400 2024-09-10T05:14:43.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.074+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 34 ==== osd_op_reply(138 gc.15 [call out=24b] v0'0 uv89 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.074+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.074+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.074+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.074+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.074+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 36 ==== osd_op_reply(140 gc.15 [call out=15b] v0'0 uv89 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.074+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.074+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.075+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 37 ==== osd_op_reply(141 gc.15 [call] v37'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.075+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-10T05:14:43.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.075+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.076+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 39 ==== osd_op_reply(142 gc.16 [call] v37'94 uv94 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.076+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.076+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 40 ==== osd_op_reply(143 gc.16 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.077+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.077+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x7f3e58038040 2024-09-10T05:14:43.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.077+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 41 ==== osd_op_reply(144 gc.16 [call out=24b] v0'0 uv94 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.077+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:145 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.077+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 42 ==== osd_op_reply(145 gc.16 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.077+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.077+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:146 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.077+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 43 ==== osd_op_reply(146 gc.16 [call out=15b] v0'0 uv94 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.077+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.077+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:147 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.078+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 44 ==== osd_op_reply(147 gc.16 [call] v37'95 uv95 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.078+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-10T05:14:43.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.078+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:148 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.079+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 38 ==== osd_op_reply(148 gc.17 [call] v37'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.079+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:149 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.079+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 39 ==== osd_op_reply(149 gc.17 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.079+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.079+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:150 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x56170298b400 2024-09-10T05:14:43.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.080+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 40 ==== osd_op_reply(150 gc.17 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.080+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:151 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.080+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 41 ==== osd_op_reply(151 gc.17 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.080+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.080+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:152 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.080+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 42 ==== osd_op_reply(152 gc.17 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.080+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.080+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:153 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.081+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 43 ==== osd_op_reply(153 gc.17 [call] v37'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.081+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-10T05:14:43.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.081+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:154 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.082+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 33 ==== osd_op_reply(154 gc.18 [call] v37'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.082+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:155 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.082+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 34 ==== osd_op_reply(155 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.082+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.082+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:156 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x5617029823e0 2024-09-10T05:14:43.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.082+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 35 ==== osd_op_reply(156 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.083+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:157 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.083+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 36 ==== osd_op_reply(157 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.083+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.083+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:158 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.083+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 37 ==== osd_op_reply(158 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.083+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.083+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:159 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.084+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 38 ==== osd_op_reply(159 gc.18 [call] v37'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.084+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-10T05:14:43.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.084+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:160 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.085+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 39 ==== osd_op_reply(160 gc.19 [call] v37'288 uv288 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.085+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:161 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.085+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 40 ==== osd_op_reply(161 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.085+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.085+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:162 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x5617029823e0 2024-09-10T05:14:43.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.085+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 41 ==== osd_op_reply(162 gc.19 [call out=24b] v0'0 uv288 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.085+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:163 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.086+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 42 ==== osd_op_reply(163 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.086+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.086+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:164 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.086+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 43 ==== osd_op_reply(164 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.086+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.086+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:165 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x5617029823e0 2024-09-10T05:14:43.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.087+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 44 ==== osd_op_reply(165 gc.19 [call] v37'289 uv289 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.087+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-10T05:14:43.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.087+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:166 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.088+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 44 ==== osd_op_reply(166 gc.20 [call] v37'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.088+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:167 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.088+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 45 ==== osd_op_reply(167 gc.20 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.088+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.088+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:168 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x56170298b400 2024-09-10T05:14:43.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.088+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 46 ==== osd_op_reply(168 gc.20 [call out=24b] v0'0 uv91 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.088+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:169 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.089+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 47 ==== osd_op_reply(169 gc.20 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.089+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.089+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:170 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.089+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 48 ==== osd_op_reply(170 gc.20 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.089+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.089+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:171 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.090+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 49 ==== osd_op_reply(171 gc.20 [call] v37'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.090+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-10T05:14:43.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.090+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:172 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.091+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 45 ==== osd_op_reply(172 gc.21 [call] v37'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.091+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:173 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.091+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 46 ==== osd_op_reply(173 gc.21 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.091+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.091+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:174 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x7f3e58038040 2024-09-10T05:14:43.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.091+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 47 ==== osd_op_reply(174 gc.21 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.091+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:175 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.092+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 48 ==== osd_op_reply(175 gc.21 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.092+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.092+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:176 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.092+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 49 ==== osd_op_reply(176 gc.21 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.092+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.092+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:177 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.093+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 50 ==== osd_op_reply(177 gc.21 [call] v37'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.093+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-10T05:14:43.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.093+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:178 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.094+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 50 ==== osd_op_reply(178 gc.22 [call] v37'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.094+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:179 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.094+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 51 ==== osd_op_reply(179 gc.22 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.094+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.094+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:180 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x56170298b400 2024-09-10T05:14:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.094+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 52 ==== osd_op_reply(180 gc.22 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.094+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:181 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.094+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 53 ==== osd_op_reply(181 gc.22 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.094+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.094+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:182 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.095+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 54 ==== osd_op_reply(182 gc.22 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.095+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.095+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:183 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.095+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 55 ==== osd_op_reply(183 gc.22 [call] v37'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.095+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.095+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:184 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.096+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 56 ==== osd_op_reply(184 gc.23 [call] v37'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.096+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:185 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.097+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 57 ==== osd_op_reply(185 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.097+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.097+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:186 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x56170298b400 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.097+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 58 ==== osd_op_reply(186 gc.23 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.097+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:187 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.097+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 59 ==== osd_op_reply(187 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.097+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.097+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:188 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.097+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 60 ==== osd_op_reply(188 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.097+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.097+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:189 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.098+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 61 ==== osd_op_reply(189 gc.23 [call] v37'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.098+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-10T05:14:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.098+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:190 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.099+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 62 ==== osd_op_reply(190 gc.24 [call] v37'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.099+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:191 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.099+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 63 ==== osd_op_reply(191 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.099+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.099+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:192 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x56170298b400 2024-09-10T05:14:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.100+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 64 ==== osd_op_reply(192 gc.24 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.100+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:193 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.100+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 65 ==== osd_op_reply(193 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.100+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.100+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:194 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.100+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 66 ==== osd_op_reply(194 gc.24 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.100+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.100+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:195 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.101+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 67 ==== osd_op_reply(195 gc.24 [call] v37'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.101+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-10T05:14:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.101+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:196 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.102+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 68 ==== osd_op_reply(196 gc.25 [call] v37'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.102+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:197 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.102+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 69 ==== osd_op_reply(197 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.102+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.102+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:198 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x56170298b400 2024-09-10T05:14:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.102+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 70 ==== osd_op_reply(198 gc.25 [call out=24b] v0'0 uv69 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.103+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:199 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.103+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 71 ==== osd_op_reply(199 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.103+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.103+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:200 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.103+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 72 ==== osd_op_reply(200 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.103+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.103+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:201 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.104+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 73 ==== osd_op_reply(201 gc.25 [call] v37'70 uv70 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.104+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-10T05:14:43.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.104+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:202 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.105+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 35 ==== osd_op_reply(202 gc.26 [call] v37'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.105+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:203 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.105+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 36 ==== osd_op_reply(203 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.105+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.105+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:204 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x561702986a30 2024-09-10T05:14:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.106+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 37 ==== osd_op_reply(204 gc.26 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.106+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:205 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.106+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 38 ==== osd_op_reply(205 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.106+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.106+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:206 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.106+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 39 ==== osd_op_reply(206 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.106+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.106+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:207 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.107+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 40 ==== osd_op_reply(207 gc.26 [call] v37'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.107+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-10T05:14:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.107+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:208 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.108+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 74 ==== osd_op_reply(208 gc.27 [call] v37'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.108+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:209 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.109+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 75 ==== osd_op_reply(209 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.109+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.109+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:210 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x56170298b400 2024-09-10T05:14:43.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.109+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 76 ==== osd_op_reply(210 gc.27 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.109+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:211 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.109+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 77 ==== osd_op_reply(211 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.109+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.109+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:212 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.109+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 78 ==== osd_op_reply(212 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.109+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.109+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:213 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.110+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 79 ==== osd_op_reply(213 gc.27 [call] v37'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.110+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-10T05:14:43.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.110+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:214 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.111+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 41 ==== osd_op_reply(214 gc.28 [call] v37'63 uv63 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.111+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:215 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.112+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 42 ==== osd_op_reply(215 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.112+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.112+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:216 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x561702986a30 2024-09-10T05:14:43.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.112+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 43 ==== osd_op_reply(216 gc.28 [call out=24b] v0'0 uv63 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.112+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:217 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.112+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 44 ==== osd_op_reply(217 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.112+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.112+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:218 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.113+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 45 ==== osd_op_reply(218 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.113+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.113+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:219 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.114+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 46 ==== osd_op_reply(219 gc.28 [call] v37'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.114+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-10T05:14:43.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.114+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:220 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.116+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 80 ==== osd_op_reply(220 gc.29 [call] v37'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.116+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:221 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.116+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 81 ==== osd_op_reply(221 gc.29 [call out=15b] v0'0 uv93 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.116+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.116+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:222 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x56170298b400 2024-09-10T05:14:43.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.116+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 82 ==== osd_op_reply(222 gc.29 [call out=24b] v0'0 uv93 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.116+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:223 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.116+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 83 ==== osd_op_reply(223 gc.29 [call out=15b] v0'0 uv93 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.116+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.116+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:224 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.117+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 84 ==== osd_op_reply(224 gc.29 [call out=15b] v0'0 uv93 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.117+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.117+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:225 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x56170298b400 2024-09-10T05:14:43.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.118+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 85 ==== osd_op_reply(225 gc.29 [call] v37'94 uv94 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.118+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-10T05:14:43.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.118+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:226 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.119+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 47 ==== osd_op_reply(226 gc.30 [call] v37'78 uv78 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.119+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:227 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.119+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 48 ==== osd_op_reply(227 gc.30 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.119+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.119+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:228 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x561702986a30 2024-09-10T05:14:43.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.119+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 49 ==== osd_op_reply(228 gc.30 [call out=24b] v0'0 uv78 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.119+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:229 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.119+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 50 ==== osd_op_reply(229 gc.30 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.119+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.119+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:230 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.120+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 51 ==== osd_op_reply(230 gc.30 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.120+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.120+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:231 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x561702986a30 2024-09-10T05:14:43.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.121+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 52 ==== osd_op_reply(231 gc.30 [call] v37'79 uv79 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.121+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-10T05:14:43.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.121+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:232 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.122+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 51 ==== osd_op_reply(232 gc.31 [call] v37'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.122+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:233 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.122+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 52 ==== osd_op_reply(233 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.122+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.122+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:234 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029ce110 con 0x7f3e58038040 2024-09-10T05:14:43.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 53 ==== osd_op_reply(234 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:235 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 54 ==== osd_op_reply(235 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:236 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029cf120 con 0x7f3e58038040 2024-09-10T05:14:43.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 55 ==== osd_op_reply(236 gc.31 [call out=1716b] v0'0 uv39 ondisk = 0) ==== 149+0+1716 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-10T05:14:43.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 20 garbage collection: RGWGC::process iterating over entry tag='92aa256a-2802-419e-96e0-ba675846cbc3.4238.17417078357073562510', time=2024-09-10T05:14:51.031009+0000, chain.objs.size()=7 2024-09-10T05:14:43.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_1 2024-09-10T05:14:43.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:237 3.3ds0 3:beccb35d:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029cd3c0 con 0x56170298b400 2024-09-10T05:14:43.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_2 2024-09-10T05:14:43.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:238 3.28s0 3:1564509c:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029d25c0 con 0x56170298b400 2024-09-10T05:14:43.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_3 2024-09-10T05:14:43.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:239 3.33s0 3:cd7c6af1:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029d4ea0 con 0x561702986a30 2024-09-10T05:14:43.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_4 2024-09-10T05:14:43.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:240 3.8s0 3:12acc246:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029d7710 con 0x56170298b400 2024-09-10T05:14:43.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_5 2024-09-10T05:14:43.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:241 3.6s0 3:61bf621f:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029d4ea0 con 0x5617029823e0 2024-09-10T05:14:43.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_6 2024-09-10T05:14:43.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:242 3.14s0 3:29e1eabb:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029d7710 con 0x56170298b400 2024-09-10T05:14:43.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_7 2024-09-10T05:14:43.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.123+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:243 3.2as0 3:5573f609:::92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dedc0 con 0x5617029823e0 2024-09-10T05:14:43.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.125+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 53 ==== osd_op_reply(239 92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_3 [call] v37'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.127+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 86 ==== osd_op_reply(237 92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_1 [call] v37'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.128+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 45 ==== osd_op_reply(241 92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_5 [call] v37'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.128+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 46 ==== osd_op_reply(243 92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_7 [call] v37'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.128+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 87 ==== osd_op_reply(242 92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_6 [call] v37'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.128+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 88 ==== osd_op_reply(240 92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_4 [call] v37'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.129+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 89 ==== osd_op_reply(238 92aa256a-2802-419e-96e0-ba675846cbc3.4238.11__shadow_.Jr3Tfnmxfi60OJnBB-MW2fNP_jT0mvu_2 [call] v37'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.129+0000 7f3e67c31800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-10T05:14:43.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.129+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:244 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029d49f0 con 0x7f3e58038040 2024-09-10T05:14:43.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.131+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 56 ==== osd_op_reply(244 gc.31 [call] v37'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.131+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:245 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029d49f0 con 0x7f3e58038040 2024-09-10T05:14:43.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.133+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 57 ==== osd_op_reply(245 gc.31 [call] v37'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.133+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-10T05:14:43.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.133+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:246 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029d49f0 con 0x5617029823e0 2024-09-10T05:14:43.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.134+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 47 ==== osd_op_reply(246 gc.0 [call] v37'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.134+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:247 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029d49f0 con 0x5617029823e0 2024-09-10T05:14:43.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.134+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 48 ==== osd_op_reply(247 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.134+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.134+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:248 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029d49f0 con 0x5617029823e0 2024-09-10T05:14:43.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.134+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 49 ==== osd_op_reply(248 gc.0 [call out=24b] v0'0 uv62 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.134+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:249 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029d49f0 con 0x5617029823e0 2024-09-10T05:14:43.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.134+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 50 ==== osd_op_reply(249 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.134+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.134+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:250 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.135+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 51 ==== osd_op_reply(250 gc.0 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.135+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.135+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:251 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.136+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 52 ==== osd_op_reply(251 gc.0 [call] v37'63 uv63 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.136+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-10T05:14:43.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.136+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:252 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x561702986a30 2024-09-10T05:14:43.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.137+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 54 ==== osd_op_reply(252 gc.1 [call] v37'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.137+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:253 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x561702986a30 2024-09-10T05:14:43.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.137+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 55 ==== osd_op_reply(253 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.137+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.137+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:254 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x561702986a30 2024-09-10T05:14:43.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.137+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 56 ==== osd_op_reply(254 gc.1 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.137+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:255 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x561702986a30 2024-09-10T05:14:43.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.137+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 57 ==== osd_op_reply(255 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.137+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.137+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:256 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x561702986a30 2024-09-10T05:14:43.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.138+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 58 ==== osd_op_reply(256 gc.1 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.138+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.138+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:257 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x561702986a30 2024-09-10T05:14:43.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.139+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 59 ==== osd_op_reply(257 gc.1 [call] v37'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.139+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-10T05:14:43.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.139+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:258 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x56170298b400 2024-09-10T05:14:43.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.139+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 90 ==== osd_op_reply(258 gc.2 [call] v37'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.140+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:259 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x56170298b400 2024-09-10T05:14:43.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.140+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 91 ==== osd_op_reply(259 gc.2 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.140+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.140+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:260 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x56170298b400 2024-09-10T05:14:43.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.140+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 92 ==== osd_op_reply(260 gc.2 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.140+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:261 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x56170298b400 2024-09-10T05:14:43.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.140+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 93 ==== osd_op_reply(261 gc.2 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.140+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.140+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:262 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x56170298b400 2024-09-10T05:14:43.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.140+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 94 ==== osd_op_reply(262 gc.2 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.141+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.141+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:263 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x56170298b400 2024-09-10T05:14:43.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.141+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 95 ==== osd_op_reply(263 gc.2 [call] v37'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.141+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-10T05:14:43.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.141+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:264 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.142+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 53 ==== osd_op_reply(264 gc.3 [call] v37'290 uv290 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.142+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:265 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.143+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 54 ==== osd_op_reply(265 gc.3 [call out=15b] v0'0 uv290 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.143+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.143+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:266 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.143+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 55 ==== osd_op_reply(266 gc.3 [call out=24b] v0'0 uv290 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.143+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:267 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.143+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 56 ==== osd_op_reply(267 gc.3 [call out=15b] v0'0 uv290 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.143+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.143+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:268 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.143+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 57 ==== osd_op_reply(268 gc.3 [call out=15b] v0'0 uv290 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.143+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.143+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:269 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.144+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 58 ==== osd_op_reply(269 gc.3 [call] v37'291 uv291 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.144+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-10T05:14:43.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.144+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:270 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x7f3e58038040 2024-09-10T05:14:43.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.145+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 58 ==== osd_op_reply(270 gc.4 [call] v37'96 uv96 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.145+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:271 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x7f3e58038040 2024-09-10T05:14:43.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.145+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 59 ==== osd_op_reply(271 gc.4 [call out=15b] v0'0 uv96 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.145+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.145+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:272 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x7f3e58038040 2024-09-10T05:14:43.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.146+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 60 ==== osd_op_reply(272 gc.4 [call out=24b] v0'0 uv96 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.146+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:273 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x7f3e58038040 2024-09-10T05:14:43.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.146+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 61 ==== osd_op_reply(273 gc.4 [call out=15b] v0'0 uv96 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.146+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.146+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:274 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x7f3e58038040 2024-09-10T05:14:43.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.146+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 62 ==== osd_op_reply(274 gc.4 [call out=15b] v0'0 uv96 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.146+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.146+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:275 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x7f3e58038040 2024-09-10T05:14:43.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.147+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 63 ==== osd_op_reply(275 gc.4 [call] v37'97 uv97 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.147+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-10T05:14:43.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.147+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:276 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x56170298b400 2024-09-10T05:14:43.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.148+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 96 ==== osd_op_reply(276 gc.5 [call] v37'71 uv71 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.148+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:277 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x56170298b400 2024-09-10T05:14:43.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.148+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 97 ==== osd_op_reply(277 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.148+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.148+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:278 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x56170298b400 2024-09-10T05:14:43.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.149+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 98 ==== osd_op_reply(278 gc.5 [call out=24b] v0'0 uv71 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.149+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:279 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x56170298b400 2024-09-10T05:14:43.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.149+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 99 ==== osd_op_reply(279 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.149+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.149+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:280 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x56170298b400 2024-09-10T05:14:43.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.149+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 100 ==== osd_op_reply(280 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.149+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.149+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:281 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x56170298b400 2024-09-10T05:14:43.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.150+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 101 ==== osd_op_reply(281 gc.5 [call] v37'72 uv72 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.150+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-10T05:14:43.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.150+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:282 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.151+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 59 ==== osd_op_reply(282 gc.6 [call] v37'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.151+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:283 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.151+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 60 ==== osd_op_reply(283 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.151+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.151+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:284 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.152+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 61 ==== osd_op_reply(284 gc.6 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.152+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:285 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.152+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 62 ==== osd_op_reply(285 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.152+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.152+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:286 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.152+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 63 ==== osd_op_reply(286 gc.6 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.152+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.152+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:287 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.153+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 64 ==== osd_op_reply(287 gc.6 [call] v37'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.153+0000 7f3e67c31800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-10T05:14:43.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.153+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:288 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x561702986a30 2024-09-10T05:14:43.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.155+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 60 ==== osd_op_reply(288 gc.7 [call] v37'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.155+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:289 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x561702986a30 2024-09-10T05:14:43.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.155+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 61 ==== osd_op_reply(289 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.155+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.155+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:290 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x561702986a30 2024-09-10T05:14:43.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.155+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 62 ==== osd_op_reply(290 gc.7 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.155+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:291 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x561702986a30 2024-09-10T05:14:43.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.156+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 63 ==== osd_op_reply(291 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.156+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-10T05:14:43.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.156+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:292 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x561702986a30 2024-09-10T05:14:43.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.156+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 64 ==== osd_op_reply(292 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.156+0000 7f3e67c31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-10T05:14:43.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.156+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:293 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x561702986a30 2024-09-10T05:14:43.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.157+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 65 ==== osd_op_reply(293 gc.7 [call] v37'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.158+0000 7f3d197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-10T05:14:43.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.158+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94656827836752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029dc180 con 0x5617029823e0 2024-09-10T05:14:43.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.159+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94656827836752] v37'292 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.159+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94656827814416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561702994920 con 0x7f3e58038040 2024-09-10T05:14:43.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.160+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94656827814416] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.160+0000 7f3e67c31800 20 remove_watcher() i=0 2024-09-10T05:14:43.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.160+0000 7f3e67c31800 2 removed watcher, disabling cache 2024-09-10T05:14:43.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.160+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94656827818672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561702994920 con 0x5617029823e0 2024-09-10T05:14:43.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.161+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94656827818672] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.161+0000 7f3e67c31800 20 remove_watcher() i=1 2024-09-10T05:14:43.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.161+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94656827811936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029902b0 con 0x56170298b400 2024-09-10T05:14:43.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.162+0000 7f3e6278a640 1 -- 172.21.15.192:0/927618962 <== osd.3 v2:172.21.15.192:6816/1620624472 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94656827811936] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e58009050 con 0x56170298b400 2024-09-10T05:14:43.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.163+0000 7f3e67c31800 20 remove_watcher() i=2 2024-09-10T05:14:43.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.163+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94656827825600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029902b0 con 0x7f3e58038040 2024-09-10T05:14:43.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.164+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.2 v2:172.21.15.192:6801/2435677948 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94656827825600] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x7f3e58038040 2024-09-10T05:14:43.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.164+0000 7f3e67c31800 20 remove_watcher() i=3 2024-09-10T05:14:43.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.164+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94656827829792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561702991dc0 con 0x5617029823e0 2024-09-10T05:14:43.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.165+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 <== osd.1 v2:172.21.15.192:6800/3487349558 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94656827829792] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5c035040 con 0x5617029823e0 2024-09-10T05:14:43.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.165+0000 7f3e67c31800 20 remove_watcher() i=4 2024-09-10T05:14:43.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.165+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94656827823552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029902b0 con 0x561702986a30 2024-09-10T05:14:43.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.166+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94656827823552] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.166+0000 7f3e67c31800 20 remove_watcher() i=5 2024-09-10T05:14:43.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.166+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94656827833712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561702991dc0 con 0x561702986a30 2024-09-10T05:14:43.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.167+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94656827833712] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.167+0000 7f3e67c31800 20 remove_watcher() i=6 2024-09-10T05:14:43.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.167+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94656827832144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5617029902b0 con 0x561702986a30 2024-09-10T05:14:43.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e62f8b640 1 -- 172.21.15.192:0/927618962 <== osd.0 v2:172.21.15.139:6800/2915567440 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94656827832144] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e5409e070 con 0x561702986a30 2024-09-10T05:14:43.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 20 remove_watcher() i=7 2024-09-10T05:14:43.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561702986a30 msgr2=0x561702988e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x561702986a30 0x561702988e20 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5617029823e0 msgr2=0x5617029848a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x5617029823e0 0x5617029848a0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3e58038040 msgr2=0x7f3e58039ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f3e58038040 0x7f3e58039ab0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56170298b400 msgr2=0x56170298d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x56170298b400 0x56170298d8c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d2c03c730 msgr2=0x7f3d2c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d2c03c730 0x7f3d2c03ebf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800efd0 tx=0x7f3e58024000 comp rx=0 tx=0).stop 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 msgr2=0x561702976db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 --2- 172.21.15.192:0/927618962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170296f9b0 0x561702976db0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3e54076d50 tx=0x7f3e54079f80 comp rx=0 tx=0).stop 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e6378c640 1 -- 172.21.15.192:0/927618962 reap_dead start 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 shutdown_connections 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 >> 172.21.15.192:0/927618962 conn(0x56170296bdb0 msgr2=0x561702969fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 shutdown_connections 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.168+0000 7f3e67c31800 1 -- 172.21.15.192:0/927618962 wait complete. 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2984567343 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d3c03c730 msgr2=0x7f3d3c03ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 --2- 172.21.15.192:0/2984567343 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d3c03c730 0x7f3d3c03ebf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x561702953690 tx=0x7f3e5800f000 comp rx=0 tx=0).stop 2024-09-10T05:14:43.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2984567343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617027c0ee0 msgr2=0x5617027bf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 --2- 172.21.15.192:0/2984567343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617027c0ee0 0x5617027bf750 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3e54059b70 tx=0x7f3e5405ad90 comp rx=0 tx=0).stop 2024-09-10T05:14:43.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2984567343 shutdown_connections 2024-09-10T05:14:43.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 --2- 172.21.15.192:0/2984567343 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d3c03c730 0x7f3d3c03ebf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 --2- 172.21.15.192:0/2984567343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617027c0ee0 0x5617027bf750 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2984567343 >> 172.21.15.192:0/2984567343 conn(0x561702955260 msgr2=0x561702955640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:43.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2984567343 shutdown_connections 2024-09-10T05:14:43.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2984567343 wait complete. 2024-09-10T05:14:43.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56170294c830 msgr2=0x56170294ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x56170294c830 0x56170294ec20 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56170284d110 msgr2=0x56170294a340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x56170284d110 0x56170294a340 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561702950730 msgr2=0x561702952b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x561702950730 0x561702952b20 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d4803c780 msgr2=0x7f3d4803ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f3d4803c780 0x7f3d4803ec40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e58001db0 tx=0x7f3e58001310 comp rx=0 tx=0).stop 2024-09-10T05:14:43.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 msgr2=0x561702942cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 --2- 172.21.15.192:0/2640428517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56170284bed0 0x561702942cf0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005fd0 tx=0x7f3e54003330 comp rx=0 tx=0).stop 2024-09-10T05:14:43.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e6378c640 1 -- 172.21.15.192:0/2640428517 reap_dead start 2024-09-10T05:14:43.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 shutdown_connections 2024-09-10T05:14:43.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 >> 172.21.15.192:0/2640428517 conn(0x561702847300 msgr2=0x56170293c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:43.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 shutdown_connections 2024-09-10T05:14:43.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T05:14:43.169+0000 7f3e67c31800 1 -- 172.21.15.192:0/2640428517 wait complete. 2024-09-10T05:14:43.179 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T05:14:43.188 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T05:14:43.188 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:14:43.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.286+0000 7f037e67f640 1 Processor -- start 2024-09-10T05:14:43.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.286+0000 7f037e67f640 1 -- start start 2024-09-10T05:14:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.287+0000 7f037e67f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0378113220 0x7f0378131380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.287+0000 7f037e67f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037806dc00 con 0x7f0378112730 2024-09-10T05:14:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.287+0000 7f037e67f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f0378113630 con 0x7f0378113220 2024-09-10T05:14:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.287+0000 7f036ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0378113220 0x7f0378131380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.287+0000 7f0377fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f0378112730 0x7f0378112b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40880/0 (socket says 172.21.15.139:40880) 2024-09-10T05:14:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.287+0000 7f0377fff640 1 -- 172.21.15.139:0/122521767 learned_addr learned my addr 172.21.15.139:0/122521767 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.287+0000 7f036ffff640 1 -- 172.21.15.139:0/122521767 >> v1:172.21.15.139:6789/0 conn(0x7f0378112730 legacy=0x7f0378112b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.287+0000 7f036ffff640 1 -- 172.21.15.139:0/122521767 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0378113c00 con 0x7f0378113220 2024-09-10T05:14:43.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.287+0000 7f03777fe640 1 -- 172.21.15.139:0/122521767 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913773809 0 0) 0x7f037806dc00 con 0x7f0378112730 2024-09-10T05:14:43.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.288+0000 7f036ffff640 1 --2- 172.21.15.139:0/122521767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0378113220 0x7f0378131380 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0360009720 tx=0x7f036002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0176ca2235fb2c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.288+0000 7f03777fe640 1 -- 172.21.15.139:0/122521767 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0360037070 con 0x7f0378113220 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.288+0000 7f03777fe640 1 -- 172.21.15.139:0/122521767 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036002ad90 con 0x7f0378113220 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.288+0000 7f03777fe640 1 -- 172.21.15.139:0/122521767 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0360032590 con 0x7f0378113220 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.289+0000 7f037e67f640 1 -- 172.21.15.139:0/122521767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0378113220 msgr2=0x7f0378131380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.289+0000 7f037e67f640 1 --2- 172.21.15.139:0/122521767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0378113220 0x7f0378131380 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0360009720 tx=0x7f036002a110 comp rx=0 tx=0).stop 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.289+0000 7f037e67f640 1 -- 172.21.15.139:0/122521767 shutdown_connections 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.289+0000 7f037e67f640 1 --2- 172.21.15.139:0/122521767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0378113220 0x7f0378131380 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.289+0000 7f037e67f640 1 -- 172.21.15.139:0/122521767 >> 172.21.15.139:0/122521767 conn(0x7f0378070850 msgr2=0x7f0378072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.289+0000 7f037e67f640 1 -- 172.21.15.139:0/122521767 shutdown_connections 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.289+0000 7f037e67f640 1 -- 172.21.15.139:0/122521767 wait complete. 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.290+0000 7f037e67f640 1 Processor -- start 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.290+0000 7f037e67f640 1 -- start start 2024-09-10T05:14:43.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.290+0000 7f037e67f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0378112730 0x7f03781c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:43.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.290+0000 7f037e67f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0378131a40 con 0x7f0378112730 2024-09-10T05:14:43.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.290+0000 7f0377fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0378112730 0x7f03781c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:43.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.290+0000 7f0377fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0378112730 0x7f03781c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34650/0 (socket says 172.21.15.139:34650) 2024-09-10T05:14:43.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.290+0000 7f0377fff640 1 -- 172.21.15.139:0/874177464 learned_addr learned my addr 172.21.15.139:0/874177464 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:43.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.290+0000 7f0377fff640 1 -- 172.21.15.139:0/874177464 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0378126540 con 0x7f0378112730 2024-09-10T05:14:43.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.290+0000 7f0377fff640 1 --2- 172.21.15.139:0/874177464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0378112730 0x7f03781c40c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f036800c320 tx=0x7f036800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:43.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.290+0000 7f03757fa640 1 -- 172.21.15.139:0/874177464 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0368007410 con 0x7f0378112730 2024-09-10T05:14:43.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.290+0000 7f03757fa640 1 -- 172.21.15.139:0/874177464 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03680075d0 con 0x7f0378112730 2024-09-10T05:14:43.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.291+0000 7f037e67f640 1 -- 172.21.15.139:0/874177464 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03781156f0 con 0x7f0378112730 2024-09-10T05:14:43.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.291+0000 7f03757fa640 1 -- 172.21.15.139:0/874177464 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0368004950 con 0x7f0378112730 2024-09-10T05:14:43.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.291+0000 7f037e67f640 1 -- 172.21.15.139:0/874177464 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0378116f70 con 0x7f0378112730 2024-09-10T05:14:43.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.291+0000 7f03757fa640 1 -- 172.21.15.139:0/874177464 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f0368011070 con 0x7f0378112730 2024-09-10T05:14:43.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.292+0000 7f037e67f640 1 -- 172.21.15.139:0/874177464 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0378112b10 con 0x7f0378112730 2024-09-10T05:14:43.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.292+0000 7f03757fa640 1 --2- 172.21.15.139:0/874177464 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f035803dec0 0x7f0358040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:43.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.292+0000 7f03757fa640 1 -- 172.21.15.139:0/874177464 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f0368052910 con 0x7f0378112730 2024-09-10T05:14:43.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.292+0000 7f036ffff640 1 --2- 172.21.15.139:0/874177464 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f035803dec0 0x7f0358040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:43.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.293+0000 7f036ffff640 1 --2- 172.21.15.139:0/874177464 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f035803dec0 0x7f0358040380 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0360034000 tx=0x7f036002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:43.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.296+0000 7f03757fa640 1 -- 172.21.15.139:0/874177464 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f0378126540 con 0x7f0378112730 2024-09-10T05:14:43.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.467+0000 7f037e67f640 1 -- 172.21.15.139:0/874177464 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03781163b0 con 0x7f035803dec0 2024-09-10T05:14:43.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.477+0000 7f03757fa640 1 -- 172.21.15.139:0/874177464 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665808 (secure 0 0 0) 0x7f03781163b0 con 0x7f035803dec0 2024-09-10T05:14:43.488 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:14:43.495 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-10T05:14:43.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.482+0000 7f037e67f640 1 -- 172.21.15.139:0/874177464 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f035803dec0 msgr2=0x7f0358040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.482+0000 7f037e67f640 1 --2- 172.21.15.139:0/874177464 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f035803dec0 0x7f0358040380 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0360034000 tx=0x7f036002e000 comp rx=0 tx=0).stop 2024-09-10T05:14:43.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.482+0000 7f037e67f640 1 -- 172.21.15.139:0/874177464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0378112730 msgr2=0x7f03781c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.482+0000 7f037e67f640 1 --2- 172.21.15.139:0/874177464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0378112730 0x7f03781c40c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f036800c320 tx=0x7f036800c7e0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.482+0000 7f037e67f640 1 -- 172.21.15.139:0/874177464 shutdown_connections 2024-09-10T05:14:43.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.482+0000 7f037e67f640 1 --2- 172.21.15.139:0/874177464 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f035803dec0 0x7f0358040380 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.482+0000 7f037e67f640 1 --2- 172.21.15.139:0/874177464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0378112730 0x7f03781c40c0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.482+0000 7f037e67f640 1 -- 172.21.15.139:0/874177464 >> 172.21.15.139:0/874177464 conn(0x7f0378070850 msgr2=0x7f0378111600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:43.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.482+0000 7f037e67f640 1 -- 172.21.15.139:0/874177464 shutdown_connections 2024-09-10T05:14:43.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.482+0000 7f037e67f640 1 -- 172.21.15.139:0/874177464 wait complete. 2024-09-10T05:14:43.499 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-10T05:14:41.938470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412817,"num_objects":261,"num_object_clones":0,"num_object_copies":529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5217,"num_read_kb":4767,"num_write":2240,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4632,"ondisk_log_size":4632,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190524,"kb_used_data":40828,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377296836,"statfs":{"total":386547056640,"available":386351960064,"internally_reserved":0,"allocated":41807872,"data_stored":40543938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003764"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962470+0000","last_change":"2024-09-10T05:11:27.721757+0000","last_active":"2024-09-10T05:12:04.962470+0000","last_peered":"2024-09-10T05:12:04.962470+0000","last_clean":"2024-09-10T05:12:04.962470+0000","last_became_active":"2024-09-10T05:11:27.716775+0000","last_became_peered":"2024-09-10T05:11:27.716775+0000","last_unstale":"2024-09-10T05:12:04.962470+0000","last_undegraded":"2024-09-10T05:12:04.962470+0000","last_fullsized":"2024-09-10T05:12:04.962470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:21.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.438467+0000","last_change":"2024-09-10T05:11:29.733870+0000","last_active":"2024-09-10T05:12:09.438467+0000","last_peered":"2024-09-10T05:12:09.438467+0000","last_clean":"2024-09-10T05:12:09.438467+0000","last_became_active":"2024-09-10T05:11:29.733565+0000","last_became_peered":"2024-09-10T05:11:29.733565+0000","last_unstale":"2024-09-10T05:12:09.438467+0000","last_undegraded":"2024-09-10T05:12:09.438467+0000","last_fullsized":"2024-09-10T05:12:09.438467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:13.290526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958456+0000","last_change":"2024-09-10T05:11:27.715287+0000","last_active":"2024-09-10T05:12:04.958456+0000","last_peered":"2024-09-10T05:12:04.958456+0000","last_clean":"2024-09-10T05:12:04.958456+0000","last_became_active":"2024-09-10T05:11:27.713698+0000","last_became_peered":"2024-09-10T05:11:27.713698+0000","last_unstale":"2024-09-10T05:12:04.958456+0000","last_undegraded":"2024-09-10T05:12:04.958456+0000","last_fullsized":"2024-09-10T05:12:04.958456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:11.833568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'10","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417350+0000","last_change":"2024-09-10T05:11:29.728909+0000","last_active":"2024-09-10T05:14:36.417350+0000","last_peered":"2024-09-10T05:14:36.417350+0000","last_clean":"2024-09-10T05:14:36.417350+0000","last_became_active":"2024-09-10T05:11:29.728621+0000","last_became_peered":"2024-09-10T05:11:29.728621+0000","last_unstale":"2024-09-10T05:14:36.417350+0000","last_undegraded":"2024-09-10T05:14:36.417350+0000","last_fullsized":"2024-09-10T05:14:36.417350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:44.019015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"37'3","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.091200+0000","last_change":"2024-09-10T05:11:27.734457+0000","last_active":"2024-09-10T05:14:36.091200+0000","last_peered":"2024-09-10T05:14:36.091200+0000","last_clean":"2024-09-10T05:14:36.091200+0000","last_became_active":"2024-09-10T05:11:27.733147+0000","last_became_peered":"2024-09-10T05:11:27.733147+0000","last_unstale":"2024-09-10T05:14:36.091200+0000","last_undegraded":"2024-09-10T05:14:36.091200+0000","last_fullsized":"2024-09-10T05:14:36.091200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:03.092088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339232+0000","last_change":"2024-09-10T05:11:29.728946+0000","last_active":"2024-09-10T05:14:36.339232+0000","last_peered":"2024-09-10T05:14:36.339232+0000","last_clean":"2024-09-10T05:14:36.339232+0000","last_became_active":"2024-09-10T05:11:29.728696+0000","last_became_peered":"2024-09-10T05:11:29.728696+0000","last_unstale":"2024-09-10T05:14:36.339232+0000","last_undegraded":"2024-09-10T05:14:36.339232+0000","last_fullsized":"2024-09-10T05:14:36.339232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:06.277517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958649+0000","last_change":"2024-09-10T05:11:27.724506+0000","last_active":"2024-09-10T05:12:04.958649+0000","last_peered":"2024-09-10T05:12:04.958649+0000","last_clean":"2024-09-10T05:12:04.958649+0000","last_became_active":"2024-09-10T05:11:27.722701+0000","last_became_peered":"2024-09-10T05:11:27.722701+0000","last_unstale":"2024-09-10T05:12:04.958649+0000","last_undegraded":"2024-09-10T05:12:04.958649+0000","last_fullsized":"2024-09-10T05:12:04.958649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:36.792228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'21","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.346432+0000","last_change":"2024-09-10T05:11:29.732128+0000","last_active":"2024-09-10T05:14:36.346432+0000","last_peered":"2024-09-10T05:14:36.346432+0000","last_clean":"2024-09-10T05:14:36.346432+0000","last_became_active":"2024-09-10T05:11:29.731850+0000","last_became_peered":"2024-09-10T05:11:29.731850+0000","last_unstale":"2024-09-10T05:14:36.346432+0000","last_undegraded":"2024-09-10T05:14:36.346432+0000","last_fullsized":"2024-09-10T05:14:36.346432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:29.844887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956059+0000","last_change":"2024-09-10T05:11:27.733926+0000","last_active":"2024-09-10T05:12:04.956059+0000","last_peered":"2024-09-10T05:12:04.956059+0000","last_clean":"2024-09-10T05:12:04.956059+0000","last_became_active":"2024-09-10T05:11:27.732922+0000","last_became_peered":"2024-09-10T05:11:27.732922+0000","last_unstale":"2024-09-10T05:12:04.956059+0000","last_undegraded":"2024-09-10T05:12:04.956059+0000","last_fullsized":"2024-09-10T05:12:04.956059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:10.400715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960102+0000","last_change":"2024-09-10T05:11:29.722746+0000","last_active":"2024-09-10T05:12:04.960102+0000","last_peered":"2024-09-10T05:12:04.960102+0000","last_clean":"2024-09-10T05:12:04.960102+0000","last_became_active":"2024-09-10T05:11:29.722189+0000","last_became_peered":"2024-09-10T05:11:29.722189+0000","last_unstale":"2024-09-10T05:12:04.960102+0000","last_undegraded":"2024-09-10T05:12:04.960102+0000","last_fullsized":"2024-09-10T05:12:04.960102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:20.901027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.655335+0000","last_change":"2024-09-10T05:11:27.706947+0000","last_active":"2024-09-10T05:12:09.655335+0000","last_peered":"2024-09-10T05:12:09.655335+0000","last_clean":"2024-09-10T05:12:09.655335+0000","last_became_active":"2024-09-10T05:11:27.706559+0000","last_became_peered":"2024-09-10T05:11:27.706559+0000","last_unstale":"2024-09-10T05:12:09.655335+0000","last_undegraded":"2024-09-10T05:12:09.655335+0000","last_fullsized":"2024-09-10T05:12:09.655335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:12.536123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957220+0000","last_change":"2024-09-10T05:11:29.730769+0000","last_active":"2024-09-10T05:12:04.957220+0000","last_peered":"2024-09-10T05:12:04.957220+0000","last_clean":"2024-09-10T05:12:04.957220+0000","last_became_active":"2024-09-10T05:11:29.730492+0000","last_became_peered":"2024-09-10T05:11:29.730492+0000","last_unstale":"2024-09-10T05:12:04.957220+0000","last_undegraded":"2024-09-10T05:12:04.957220+0000","last_fullsized":"2024-09-10T05:12:04.957220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:36.538972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954889+0000","last_change":"2024-09-10T05:11:27.718698+0000","last_active":"2024-09-10T05:12:04.954889+0000","last_peered":"2024-09-10T05:12:04.954889+0000","last_clean":"2024-09-10T05:12:04.954889+0000","last_became_active":"2024-09-10T05:11:27.718363+0000","last_became_peered":"2024-09-10T05:11:27.718363+0000","last_unstale":"2024-09-10T05:12:04.954889+0000","last_undegraded":"2024-09-10T05:12:04.954889+0000","last_fullsized":"2024-09-10T05:12:04.954889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:56.809195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417284+0000","last_change":"2024-09-10T05:11:29.727171+0000","last_active":"2024-09-10T05:14:36.417284+0000","last_peered":"2024-09-10T05:14:36.417284+0000","last_clean":"2024-09-10T05:14:36.417284+0000","last_became_active":"2024-09-10T05:11:29.726884+0000","last_became_peered":"2024-09-10T05:11:29.726884+0000","last_unstale":"2024-09-10T05:14:36.417284+0000","last_undegraded":"2024-09-10T05:14:36.417284+0000","last_fullsized":"2024-09-10T05:14:36.417284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:28.260482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.646405+0000","last_change":"2024-09-10T05:11:27.719213+0000","last_active":"2024-09-10T05:12:09.646405+0000","last_peered":"2024-09-10T05:12:09.646405+0000","last_clean":"2024-09-10T05:12:09.646405+0000","last_became_active":"2024-09-10T05:11:27.718868+0000","last_became_peered":"2024-09-10T05:11:27.718868+0000","last_unstale":"2024-09-10T05:12:09.646405+0000","last_undegraded":"2024-09-10T05:12:09.646405+0000","last_fullsized":"2024-09-10T05:12:09.646405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:27.106277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.093231+0000","last_change":"2024-09-10T05:11:29.723967+0000","last_active":"2024-09-10T05:12:09.093231+0000","last_peered":"2024-09-10T05:12:09.093231+0000","last_clean":"2024-09-10T05:12:09.093231+0000","last_became_active":"2024-09-10T05:11:29.723497+0000","last_became_peered":"2024-09-10T05:11:29.723497+0000","last_unstale":"2024-09-10T05:12:09.093231+0000","last_undegraded":"2024-09-10T05:12:09.093231+0000","last_fullsized":"2024-09-10T05:12:09.093231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:35.779331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'5","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.208052+0000","last_change":"2024-09-10T05:11:29.727785+0000","last_active":"2024-09-10T05:14:36.208052+0000","last_peered":"2024-09-10T05:14:36.208052+0000","last_clean":"2024-09-10T05:14:36.208052+0000","last_became_active":"2024-09-10T05:11:29.727536+0000","last_became_peered":"2024-09-10T05:11:29.727536+0000","last_unstale":"2024-09-10T05:14:36.208052+0000","last_undegraded":"2024-09-10T05:14:36.208052+0000","last_fullsized":"2024-09-10T05:14:36.208052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:01.849780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.517983+0000","last_change":"2024-09-10T05:11:27.728861+0000","last_active":"2024-09-10T05:13:35.517983+0000","last_peered":"2024-09-10T05:13:35.517983+0000","last_clean":"2024-09-10T05:13:35.517983+0000","last_became_active":"2024-09-10T05:11:27.728114+0000","last_became_peered":"2024-09-10T05:11:27.728114+0000","last_unstale":"2024-09-10T05:13:35.517983+0000","last_undegraded":"2024-09-10T05:13:35.517983+0000","last_fullsized":"2024-09-10T05:13:35.517983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.559031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.202264+0000","last_change":"2024-09-10T05:11:29.733110+0000","last_active":"2024-09-10T05:14:36.202264+0000","last_peered":"2024-09-10T05:14:36.202264+0000","last_clean":"2024-09-10T05:14:36.202264+0000","last_became_active":"2024-09-10T05:11:29.732864+0000","last_became_peered":"2024-09-10T05:11:29.732864+0000","last_unstale":"2024-09-10T05:14:36.202264+0000","last_undegraded":"2024-09-10T05:14:36.202264+0000","last_fullsized":"2024-09-10T05:14:36.202264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:27.593815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.964231+0000","last_change":"2024-09-10T05:11:27.707811+0000","last_active":"2024-09-10T05:12:04.964231+0000","last_peered":"2024-09-10T05:12:04.964231+0000","last_clean":"2024-09-10T05:12:04.964231+0000","last_became_active":"2024-09-10T05:11:27.706698+0000","last_became_peered":"2024-09-10T05:11:27.706698+0000","last_unstale":"2024-09-10T05:12:04.964231+0000","last_undegraded":"2024-09-10T05:12:04.964231+0000","last_fullsized":"2024-09-10T05:12:04.964231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.559031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'10","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.963001+0000","last_change":"2024-09-10T05:11:29.732128+0000","last_active":"2024-09-10T05:12:51.963001+0000","last_peered":"2024-09-10T05:12:51.963001+0000","last_clean":"2024-09-10T05:12:51.963001+0000","last_became_active":"2024-09-10T05:11:29.731842+0000","last_became_peered":"2024-09-10T05:11:29.731842+0000","last_unstale":"2024-09-10T05:12:51.963001+0000","last_undegraded":"2024-09-10T05:12:51.963001+0000","last_fullsized":"2024-09-10T05:12:51.963001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:54.021671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960653+0000","last_change":"2024-09-10T05:11:27.719633+0000","last_active":"2024-09-10T05:12:04.960653+0000","last_peered":"2024-09-10T05:12:04.960653+0000","last_clean":"2024-09-10T05:12:04.960653+0000","last_became_active":"2024-09-10T05:11:27.719257+0000","last_became_peered":"2024-09-10T05:11:27.719257+0000","last_unstale":"2024-09-10T05:12:04.960653+0000","last_undegraded":"2024-09-10T05:12:04.960653+0000","last_fullsized":"2024-09-10T05:12:04.960653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:49.735409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339173+0000","last_change":"2024-09-10T05:12:04.976749+0000","last_active":"2024-09-10T05:14:36.339173+0000","last_peered":"2024-09-10T05:14:36.339173+0000","last_clean":"2024-09-10T05:14:36.339173+0000","last_became_active":"2024-09-10T05:12:04.967642+0000","last_became_peered":"2024-09-10T05:12:04.967642+0000","last_unstale":"2024-09-10T05:14:36.339173+0000","last_undegraded":"2024-09-10T05:14:36.339173+0000","last_fullsized":"2024-09-10T05:14:36.339173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:14.879637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"37'3","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.952834+0000","last_change":"2024-09-10T05:11:27.724754+0000","last_active":"2024-09-10T05:12:51.952834+0000","last_peered":"2024-09-10T05:12:51.952834+0000","last_clean":"2024-09-10T05:12:51.952834+0000","last_became_active":"2024-09-10T05:11:27.724439+0000","last_became_peered":"2024-09-10T05:11:27.724439+0000","last_unstale":"2024-09-10T05:12:51.952834+0000","last_undegraded":"2024-09-10T05:12:51.952834+0000","last_fullsized":"2024-09-10T05:12:51.952834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:46:03.289983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382409+0000","last_change":"2024-09-10T05:11:29.723195+0000","last_active":"2024-09-10T05:14:36.382409+0000","last_peered":"2024-09-10T05:14:36.382409+0000","last_clean":"2024-09-10T05:14:36.382409+0000","last_became_active":"2024-09-10T05:11:29.722894+0000","last_became_peered":"2024-09-10T05:11:29.722894+0000","last_unstale":"2024-09-10T05:14:36.382409+0000","last_undegraded":"2024-09-10T05:14:36.382409+0000","last_fullsized":"2024-09-10T05:14:36.382409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:16.388042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:53.911207+0000","last_change":"2024-09-10T05:11:27.716016+0000","last_active":"2024-09-10T05:13:53.911207+0000","last_peered":"2024-09-10T05:13:53.911207+0000","last_clean":"2024-09-10T05:13:53.911207+0000","last_became_active":"2024-09-10T05:11:27.714926+0000","last_became_peered":"2024-09-10T05:11:27.714926+0000","last_unstale":"2024-09-10T05:13:53.911207+0000","last_undegraded":"2024-09-10T05:13:53.911207+0000","last_fullsized":"2024-09-10T05:13:53.911207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:51.116402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.384792+0000","last_change":"2024-09-10T05:11:29.722979+0000","last_active":"2024-09-10T05:14:36.384792+0000","last_peered":"2024-09-10T05:14:36.384792+0000","last_clean":"2024-09-10T05:14:36.384792+0000","last_became_active":"2024-09-10T05:11:29.721876+0000","last_became_peered":"2024-09-10T05:11:29.721876+0000","last_unstale":"2024-09-10T05:14:36.384792+0000","last_undegraded":"2024-09-10T05:14:36.384792+0000","last_fullsized":"2024-09-10T05:14:36.384792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:11:48.560871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955723+0000","last_change":"2024-09-10T05:11:27.720509+0000","last_active":"2024-09-10T05:12:04.955723+0000","last_peered":"2024-09-10T05:12:04.955723+0000","last_clean":"2024-09-10T05:12:04.955723+0000","last_became_active":"2024-09-10T05:11:27.720197+0000","last_became_peered":"2024-09-10T05:11:27.720197+0000","last_unstale":"2024-09-10T05:12:04.955723+0000","last_undegraded":"2024-09-10T05:12:04.955723+0000","last_fullsized":"2024-09-10T05:12:04.955723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:14.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.361804+0000","last_change":"2024-09-10T05:11:37.763268+0000","last_active":"2024-09-10T05:14:36.361804+0000","last_peered":"2024-09-10T05:14:36.361804+0000","last_clean":"2024-09-10T05:14:36.361804+0000","last_became_active":"2024-09-10T05:11:37.763019+0000","last_became_peered":"2024-09-10T05:11:37.763019+0000","last_unstale":"2024-09-10T05:14:36.361804+0000","last_undegraded":"2024-09-10T05:14:36.361804+0000","last_fullsized":"2024-09-10T05:14:36.361804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:54.698085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:10.169121+0000","last_change":"2024-09-10T05:11:29.729685+0000","last_active":"2024-09-10T05:12:10.169121+0000","last_peered":"2024-09-10T05:12:10.169121+0000","last_clean":"2024-09-10T05:12:10.169121+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:12:10.169121+0000","last_undegraded":"2024-09-10T05:12:10.169121+0000","last_fullsized":"2024-09-10T05:12:10.169121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.365568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955666+0000","last_change":"2024-09-10T05:11:27.734206+0000","last_active":"2024-09-10T05:12:04.955666+0000","last_peered":"2024-09-10T05:12:04.955666+0000","last_clean":"2024-09-10T05:12:04.955666+0000","last_became_active":"2024-09-10T05:11:27.733612+0000","last_became_peered":"2024-09-10T05:11:27.733612+0000","last_unstale":"2024-09-10T05:12:04.955666+0000","last_undegraded":"2024-09-10T05:12:04.955666+0000","last_fullsized":"2024-09-10T05:12:04.955666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:47.697103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957082+0000","last_change":"2024-09-10T05:11:31.737509+0000","last_active":"2024-09-10T05:12:04.957082+0000","last_peered":"2024-09-10T05:12:04.957082+0000","last_clean":"2024-09-10T05:12:04.957082+0000","last_became_active":"2024-09-10T05:11:31.736788+0000","last_became_peered":"2024-09-10T05:11:31.736788+0000","last_unstale":"2024-09-10T05:12:04.957082+0000","last_undegraded":"2024-09-10T05:12:04.957082+0000","last_fullsized":"2024-09-10T05:12:04.957082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:26.107225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'44","reported_seq":99,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.265414+0000","last_change":"2024-09-10T05:11:33.746939+0000","last_active":"2024-09-10T05:13:34.265414+0000","last_peered":"2024-09-10T05:13:34.265414+0000","last_clean":"2024-09-10T05:13:34.265414+0000","last_became_active":"2024-09-10T05:11:33.746595+0000","last_became_peered":"2024-09-10T05:11:33.746595+0000","last_unstale":"2024-09-10T05:13:34.265414+0000","last_undegraded":"2024-09-10T05:13:34.265414+0000","last_fullsized":"2024-09-10T05:13:34.265414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:39.379252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963055+0000","last_change":"2024-09-10T05:11:35.746892+0000","last_active":"2024-09-10T05:12:04.963055+0000","last_peered":"2024-09-10T05:12:04.963055+0000","last_clean":"2024-09-10T05:12:04.963055+0000","last_became_active":"2024-09-10T05:11:35.746594+0000","last_became_peered":"2024-09-10T05:11:35.746594+0000","last_unstale":"2024-09-10T05:12:04.963055+0000","last_undegraded":"2024-09-10T05:12:04.963055+0000","last_fullsized":"2024-09-10T05:12:04.963055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:15.325826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.968440+0000","last_change":"2024-09-10T05:11:37.756768+0000","last_active":"2024-09-10T05:12:51.968440+0000","last_peered":"2024-09-10T05:12:51.968440+0000","last_clean":"2024-09-10T05:12:51.968440+0000","last_became_active":"2024-09-10T05:11:37.756495+0000","last_became_peered":"2024-09-10T05:11:37.756495+0000","last_unstale":"2024-09-10T05:12:51.968440+0000","last_undegraded":"2024-09-10T05:12:51.968440+0000","last_fullsized":"2024-09-10T05:12:51.968440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:13.070344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417430+0000","last_change":"2024-09-10T05:11:29.732574+0000","last_active":"2024-09-10T05:14:36.417430+0000","last_peered":"2024-09-10T05:14:36.417430+0000","last_clean":"2024-09-10T05:14:36.417430+0000","last_became_active":"2024-09-10T05:11:29.732267+0000","last_became_peered":"2024-09-10T05:11:29.732267+0000","last_unstale":"2024-09-10T05:14:36.417430+0000","last_undegraded":"2024-09-10T05:14:36.417430+0000","last_fullsized":"2024-09-10T05:14:36.417430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:00.006923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958078+0000","last_change":"2024-09-10T05:11:27.726953+0000","last_active":"2024-09-10T05:12:04.958078+0000","last_peered":"2024-09-10T05:12:04.958078+0000","last_clean":"2024-09-10T05:12:04.958078+0000","last_became_active":"2024-09-10T05:11:27.726599+0000","last_became_peered":"2024-09-10T05:11:27.726599+0000","last_unstale":"2024-09-10T05:12:04.958078+0000","last_undegraded":"2024-09-10T05:12:04.958078+0000","last_fullsized":"2024-09-10T05:12:04.958078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:37.354012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957165+0000","last_change":"2024-09-10T05:11:31.731495+0000","last_active":"2024-09-10T05:12:04.957165+0000","last_peered":"2024-09-10T05:12:04.957165+0000","last_clean":"2024-09-10T05:12:04.957165+0000","last_became_active":"2024-09-10T05:11:31.731231+0000","last_became_peered":"2024-09-10T05:11:31.731231+0000","last_unstale":"2024-09-10T05:12:04.957165+0000","last_undegraded":"2024-09-10T05:12:04.957165+0000","last_fullsized":"2024-09-10T05:12:04.957165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:09.451414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'13","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960893+0000","last_change":"2024-09-10T05:11:33.744170+0000","last_active":"2024-09-10T05:12:04.960893+0000","last_peered":"2024-09-10T05:12:04.960893+0000","last_clean":"2024-09-10T05:12:04.960893+0000","last_became_active":"2024-09-10T05:11:33.743847+0000","last_became_peered":"2024-09-10T05:11:33.743847+0000","last_unstale":"2024-09-10T05:12:04.960893+0000","last_undegraded":"2024-09-10T05:12:04.960893+0000","last_fullsized":"2024-09-10T05:12:04.960893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:57.085007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962494+0000","last_change":"2024-09-10T05:11:35.749895+0000","last_active":"2024-09-10T05:12:04.962494+0000","last_peered":"2024-09-10T05:12:04.962494+0000","last_clean":"2024-09-10T05:12:04.962494+0000","last_became_active":"2024-09-10T05:11:35.749634+0000","last_became_peered":"2024-09-10T05:11:35.749634+0000","last_unstale":"2024-09-10T05:12:04.962494+0000","last_undegraded":"2024-09-10T05:12:04.962494+0000","last_fullsized":"2024-09-10T05:12:04.962494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:01.486680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956547+0000","last_change":"2024-09-10T05:11:37.755426+0000","last_active":"2024-09-10T05:12:04.956547+0000","last_peered":"2024-09-10T05:12:04.956547+0000","last_clean":"2024-09-10T05:12:04.956547+0000","last_became_active":"2024-09-10T05:11:37.755078+0000","last_became_peered":"2024-09-10T05:11:37.755078+0000","last_unstale":"2024-09-10T05:12:04.956547+0000","last_undegraded":"2024-09-10T05:12:04.956547+0000","last_fullsized":"2024-09-10T05:12:04.956547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:03.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961705+0000","last_change":"2024-09-10T05:11:29.732068+0000","last_active":"2024-09-10T05:12:04.961705+0000","last_peered":"2024-09-10T05:12:04.961705+0000","last_clean":"2024-09-10T05:12:04.961705+0000","last_became_active":"2024-09-10T05:11:29.731780+0000","last_became_peered":"2024-09-10T05:11:29.731780+0000","last_unstale":"2024-09-10T05:12:04.961705+0000","last_undegraded":"2024-09-10T05:12:04.961705+0000","last_fullsized":"2024-09-10T05:12:04.961705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:47.912310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954517+0000","last_change":"2024-09-10T05:11:27.732925+0000","last_active":"2024-09-10T05:12:04.954517+0000","last_peered":"2024-09-10T05:12:04.954517+0000","last_clean":"2024-09-10T05:12:04.954517+0000","last_became_active":"2024-09-10T05:11:27.732573+0000","last_became_peered":"2024-09-10T05:11:27.732573+0000","last_unstale":"2024-09-10T05:12:04.954517+0000","last_undegraded":"2024-09-10T05:12:04.954517+0000","last_fullsized":"2024-09-10T05:12:04.954517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:48.014510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:05.900569+0000","last_change":"2024-09-10T05:12:04.965872+0000","last_active":"2024-09-10T05:12:05.900569+0000","last_peered":"2024-09-10T05:12:05.900569+0000","last_clean":"2024-09-10T05:12:05.900569+0000","last_became_active":"2024-09-10T05:12:04.965494+0000","last_became_peered":"2024-09-10T05:12:04.965494+0000","last_unstale":"2024-09-10T05:12:05.900569+0000","last_undegraded":"2024-09-10T05:12:05.900569+0000","last_fullsized":"2024-09-10T05:12:05.900569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:04.430595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959616+0000","last_change":"2024-09-10T05:11:33.745608+0000","last_active":"2024-09-10T05:12:04.959616+0000","last_peered":"2024-09-10T05:12:04.959616+0000","last_clean":"2024-09-10T05:12:04.959616+0000","last_became_active":"2024-09-10T05:11:33.745336+0000","last_became_peered":"2024-09-10T05:11:33.745336+0000","last_unstale":"2024-09-10T05:12:04.959616+0000","last_undegraded":"2024-09-10T05:12:04.959616+0000","last_fullsized":"2024-09-10T05:12:04.959616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:41.078775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'282","reported_seq":415,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.421973+0000","last_change":"2024-09-10T05:11:35.752548+0000","last_active":"2024-09-10T05:14:36.421973+0000","last_peered":"2024-09-10T05:14:36.421973+0000","last_clean":"2024-09-10T05:14:36.421973+0000","last_became_active":"2024-09-10T05:11:35.752290+0000","last_became_peered":"2024-09-10T05:11:35.752290+0000","last_unstale":"2024-09-10T05:14:36.421973+0000","last_undegraded":"2024-09-10T05:14:36.421973+0000","last_fullsized":"2024-09-10T05:14:36.421973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.244961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959825+0000","last_change":"2024-09-10T05:11:37.759873+0000","last_active":"2024-09-10T05:12:04.959825+0000","last_peered":"2024-09-10T05:12:04.959825+0000","last_clean":"2024-09-10T05:12:04.959825+0000","last_became_active":"2024-09-10T05:11:37.759311+0000","last_became_peered":"2024-09-10T05:11:37.759311+0000","last_unstale":"2024-09-10T05:12:04.959825+0000","last_undegraded":"2024-09-10T05:12:04.959825+0000","last_fullsized":"2024-09-10T05:12:04.959825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:37.479923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.383082+0000","last_change":"2024-09-10T05:11:29.724315+0000","last_active":"2024-09-10T05:14:36.383082+0000","last_peered":"2024-09-10T05:14:36.383082+0000","last_clean":"2024-09-10T05:14:36.383082+0000","last_became_active":"2024-09-10T05:11:29.723919+0000","last_became_peered":"2024-09-10T05:11:29.723919+0000","last_unstale":"2024-09-10T05:14:36.383082+0000","last_undegraded":"2024-09-10T05:14:36.383082+0000","last_fullsized":"2024-09-10T05:14:36.383082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:04.172142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957233+0000","last_change":"2024-09-10T05:11:27.720680+0000","last_active":"2024-09-10T05:12:04.957233+0000","last_peered":"2024-09-10T05:12:04.957233+0000","last_clean":"2024-09-10T05:12:04.957233+0000","last_became_active":"2024-09-10T05:11:27.719835+0000","last_became_peered":"2024-09-10T05:11:27.719835+0000","last_unstale":"2024-09-10T05:12:04.957233+0000","last_undegraded":"2024-09-10T05:12:04.957233+0000","last_fullsized":"2024-09-10T05:12:04.957233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962693+0000","last_change":"2024-09-10T05:11:31.737694+0000","last_active":"2024-09-10T05:12:04.962693+0000","last_peered":"2024-09-10T05:12:04.962693+0000","last_clean":"2024-09-10T05:12:04.962693+0000","last_became_active":"2024-09-10T05:11:31.737411+0000","last_became_peered":"2024-09-10T05:11:31.737411+0000","last_unstale":"2024-09-10T05:12:04.962693+0000","last_undegraded":"2024-09-10T05:12:04.962693+0000","last_fullsized":"2024-09-10T05:12:04.962693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:48.673581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'36","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.259091+0000","last_change":"2024-09-10T05:11:33.745209+0000","last_active":"2024-09-10T05:13:34.259091+0000","last_peered":"2024-09-10T05:13:34.259091+0000","last_clean":"2024-09-10T05:13:34.259091+0000","last_became_active":"2024-09-10T05:11:33.744920+0000","last_became_peered":"2024-09-10T05:11:33.744920+0000","last_unstale":"2024-09-10T05:13:34.259091+0000","last_undegraded":"2024-09-10T05:13:34.259091+0000","last_fullsized":"2024-09-10T05:13:34.259091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:36.085525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'282","reported_seq":424,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.420466+0000","last_change":"2024-09-10T05:11:35.748524+0000","last_active":"2024-09-10T05:14:36.420466+0000","last_peered":"2024-09-10T05:14:36.420466+0000","last_clean":"2024-09-10T05:14:36.420466+0000","last_became_active":"2024-09-10T05:11:35.748328+0000","last_became_peered":"2024-09-10T05:11:35.748328+0000","last_unstale":"2024-09-10T05:14:36.420466+0000","last_undegraded":"2024-09-10T05:14:36.420466+0000","last_fullsized":"2024-09-10T05:14:36.420466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:39.020754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'7","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116685+0000","last_change":"2024-09-10T05:11:29.736309+0000","last_active":"2024-09-10T05:14:36.116685+0000","last_peered":"2024-09-10T05:14:36.116685+0000","last_clean":"2024-09-10T05:14:36.116685+0000","last_became_active":"2024-09-10T05:11:29.735799+0000","last_became_peered":"2024-09-10T05:11:29.735799+0000","last_unstale":"2024-09-10T05:14:36.116685+0000","last_undegraded":"2024-09-10T05:14:36.116685+0000","last_fullsized":"2024-09-10T05:14:36.116685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:38.598374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962727+0000","last_change":"2024-09-10T05:11:27.721631+0000","last_active":"2024-09-10T05:12:04.962727+0000","last_peered":"2024-09-10T05:12:04.962727+0000","last_clean":"2024-09-10T05:12:04.962727+0000","last_became_active":"2024-09-10T05:11:27.716318+0000","last_became_peered":"2024-09-10T05:11:27.716318+0000","last_unstale":"2024-09-10T05:12:04.962727+0000","last_undegraded":"2024-09-10T05:12:04.962727+0000","last_fullsized":"2024-09-10T05:12:04.962727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:40.603860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958076+0000","last_change":"2024-09-10T05:11:31.735274+0000","last_active":"2024-09-10T05:12:04.958076+0000","last_peered":"2024-09-10T05:12:04.958076+0000","last_clean":"2024-09-10T05:12:04.958076+0000","last_became_active":"2024-09-10T05:11:31.734975+0000","last_became_peered":"2024-09-10T05:11:31.734975+0000","last_unstale":"2024-09-10T05:12:04.958076+0000","last_undegraded":"2024-09-10T05:12:04.958076+0000","last_fullsized":"2024-09-10T05:12:04.958076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:45.105200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'47","reported_seq":101,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.270154+0000","last_change":"2024-09-10T05:11:33.746845+0000","last_active":"2024-09-10T05:13:34.270154+0000","last_peered":"2024-09-10T05:13:34.270154+0000","last_clean":"2024-09-10T05:13:34.270154+0000","last_became_active":"2024-09-10T05:11:33.746522+0000","last_became_peered":"2024-09-10T05:11:33.746522+0000","last_unstale":"2024-09-10T05:13:34.270154+0000","last_undegraded":"2024-09-10T05:13:34.270154+0000","last_fullsized":"2024-09-10T05:13:34.270154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:43.397048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957524+0000","last_change":"2024-09-10T05:11:35.746098+0000","last_active":"2024-09-10T05:12:04.957524+0000","last_peered":"2024-09-10T05:12:04.957524+0000","last_clean":"2024-09-10T05:12:04.957524+0000","last_became_active":"2024-09-10T05:11:35.745840+0000","last_became_peered":"2024-09-10T05:11:35.745840+0000","last_unstale":"2024-09-10T05:12:04.957524+0000","last_undegraded":"2024-09-10T05:12:04.957524+0000","last_fullsized":"2024-09-10T05:12:04.957524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:48.168086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.970146+0000","last_change":"2024-09-10T05:11:37.754850+0000","last_active":"2024-09-10T05:12:51.970146+0000","last_peered":"2024-09-10T05:12:51.970146+0000","last_clean":"2024-09-10T05:12:51.970146+0000","last_became_active":"2024-09-10T05:11:37.754562+0000","last_became_peered":"2024-09-10T05:11:37.754562+0000","last_unstale":"2024-09-10T05:12:51.970146+0000","last_undegraded":"2024-09-10T05:12:51.970146+0000","last_fullsized":"2024-09-10T05:12:51.970146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:27.172242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.199301+0000","last_change":"2024-09-10T05:11:29.721603+0000","last_active":"2024-09-10T05:14:36.199301+0000","last_peered":"2024-09-10T05:14:36.199301+0000","last_clean":"2024-09-10T05:14:36.199301+0000","last_became_active":"2024-09-10T05:11:29.721292+0000","last_became_peered":"2024-09-10T05:11:29.721292+0000","last_unstale":"2024-09-10T05:14:36.199301+0000","last_undegraded":"2024-09-10T05:14:36.199301+0000","last_fullsized":"2024-09-10T05:14:36.199301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.549609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.324967+0000","last_change":"2024-09-10T05:11:27.728236+0000","last_active":"2024-09-10T05:14:36.324967+0000","last_peered":"2024-09-10T05:14:36.324967+0000","last_clean":"2024-09-10T05:14:36.324967+0000","last_became_active":"2024-09-10T05:11:27.726419+0000","last_became_peered":"2024-09-10T05:11:27.726419+0000","last_unstale":"2024-09-10T05:14:36.324967+0000","last_undegraded":"2024-09-10T05:14:36.324967+0000","last_fullsized":"2024-09-10T05:14:36.324967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:45.107412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956724+0000","last_change":"2024-09-10T05:11:31.732240+0000","last_active":"2024-09-10T05:12:04.956724+0000","last_peered":"2024-09-10T05:12:04.956724+0000","last_clean":"2024-09-10T05:12:04.956724+0000","last_became_active":"2024-09-10T05:11:31.732017+0000","last_became_peered":"2024-09-10T05:11:31.732017+0000","last_unstale":"2024-09-10T05:12:04.956724+0000","last_undegraded":"2024-09-10T05:12:04.956724+0000","last_fullsized":"2024-09-10T05:12:04.956724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:35.116886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'37","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:50.916771+0000","last_change":"2024-09-10T05:11:33.747704+0000","last_active":"2024-09-10T05:13:50.916771+0000","last_peered":"2024-09-10T05:13:50.916771+0000","last_clean":"2024-09-10T05:13:50.916771+0000","last_became_active":"2024-09-10T05:11:33.747334+0000","last_became_peered":"2024-09-10T05:11:33.747334+0000","last_unstale":"2024-09-10T05:13:50.916771+0000","last_undegraded":"2024-09-10T05:13:50.916771+0000","last_fullsized":"2024-09-10T05:13:50.916771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:02.895443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956478+0000","last_change":"2024-09-10T05:11:35.753755+0000","last_active":"2024-09-10T05:12:04.956478+0000","last_peered":"2024-09-10T05:12:04.956478+0000","last_clean":"2024-09-10T05:12:04.956478+0000","last_became_active":"2024-09-10T05:11:35.753453+0000","last_became_peered":"2024-09-10T05:11:35.753453+0000","last_unstale":"2024-09-10T05:12:04.956478+0000","last_undegraded":"2024-09-10T05:12:04.956478+0000","last_fullsized":"2024-09-10T05:12:04.956478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:03.592621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:46.437159+0000","last_change":"2024-09-10T05:11:37.758133+0000","last_active":"2024-09-10T05:12:46.437159+0000","last_peered":"2024-09-10T05:12:46.437159+0000","last_clean":"2024-09-10T05:12:46.437159+0000","last_became_active":"2024-09-10T05:11:37.757307+0000","last_became_peered":"2024-09-10T05:11:37.757307+0000","last_unstale":"2024-09-10T05:12:46.437159+0000","last_undegraded":"2024-09-10T05:12:46.437159+0000","last_fullsized":"2024-09-10T05:12:46.437159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:15.800062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958765+0000","last_change":"2024-09-10T05:11:29.722984+0000","last_active":"2024-09-10T05:12:04.958765+0000","last_peered":"2024-09-10T05:12:04.958765+0000","last_clean":"2024-09-10T05:12:04.958765+0000","last_became_active":"2024-09-10T05:11:29.722719+0000","last_became_peered":"2024-09-10T05:11:29.722719+0000","last_unstale":"2024-09-10T05:12:04.958765+0000","last_undegraded":"2024-09-10T05:12:04.958765+0000","last_fullsized":"2024-09-10T05:12:04.958765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:12.408667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.656125+0000","last_change":"2024-09-10T05:11:27.722920+0000","last_active":"2024-09-10T05:13:35.656125+0000","last_peered":"2024-09-10T05:13:35.656125+0000","last_clean":"2024-09-10T05:13:35.656125+0000","last_became_active":"2024-09-10T05:11:27.722553+0000","last_became_peered":"2024-09-10T05:11:27.722553+0000","last_unstale":"2024-09-10T05:13:35.656125+0000","last_undegraded":"2024-09-10T05:13:35.656125+0000","last_fullsized":"2024-09-10T05:13:35.656125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:26.252530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'4","reported_seq":227,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.313246+0000","last_change":"2024-09-10T05:11:31.734260+0000","last_active":"2024-09-10T05:13:35.313246+0000","last_peered":"2024-09-10T05:13:35.313246+0000","last_clean":"2024-09-10T05:13:35.313246+0000","last_became_active":"2024-09-10T05:11:31.733822+0000","last_became_peered":"2024-09-10T05:11:31.733822+0000","last_unstale":"2024-09-10T05:13:35.313246+0000","last_undegraded":"2024-09-10T05:13:35.313246+0000","last_fullsized":"2024-09-10T05:13:35.313246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:41.836144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'48","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.272006+0000","last_change":"2024-09-10T05:11:33.748247+0000","last_active":"2024-09-10T05:13:34.272006+0000","last_peered":"2024-09-10T05:13:34.272006+0000","last_clean":"2024-09-10T05:13:34.272006+0000","last_became_active":"2024-09-10T05:11:33.747938+0000","last_became_peered":"2024-09-10T05:11:33.747938+0000","last_unstale":"2024-09-10T05:13:34.272006+0000","last_undegraded":"2024-09-10T05:13:34.272006+0000","last_fullsized":"2024-09-10T05:13:34.272006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:53.311224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'282","reported_seq":348,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.587512+0000","last_change":"2024-09-10T05:11:35.754114+0000","last_active":"2024-09-10T05:14:36.587512+0000","last_peered":"2024-09-10T05:14:36.587512+0000","last_clean":"2024-09-10T05:14:36.587512+0000","last_became_active":"2024-09-10T05:11:35.753663+0000","last_became_peered":"2024-09-10T05:11:35.753663+0000","last_unstale":"2024-09-10T05:14:36.587512+0000","last_undegraded":"2024-09-10T05:14:36.587512+0000","last_fullsized":"2024-09-10T05:14:36.587512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.071659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.125804+0000","last_change":"2024-09-10T05:11:37.755275+0000","last_active":"2024-09-10T05:14:36.125804+0000","last_peered":"2024-09-10T05:14:36.125804+0000","last_clean":"2024-09-10T05:14:36.125804+0000","last_became_active":"2024-09-10T05:11:37.754959+0000","last_became_peered":"2024-09-10T05:11:37.754959+0000","last_unstale":"2024-09-10T05:14:36.125804+0000","last_undegraded":"2024-09-10T05:14:36.125804+0000","last_fullsized":"2024-09-10T05:14:36.125804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:34:33.810681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'17","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:45.915314+0000","last_change":"2024-09-10T05:11:29.722535+0000","last_active":"2024-09-10T05:13:45.915314+0000","last_peered":"2024-09-10T05:13:45.915314+0000","last_clean":"2024-09-10T05:13:45.915314+0000","last_became_active":"2024-09-10T05:11:29.722267+0000","last_became_peered":"2024-09-10T05:11:29.722267+0000","last_unstale":"2024-09-10T05:13:45.915314+0000","last_undegraded":"2024-09-10T05:13:45.915314+0000","last_fullsized":"2024-09-10T05:13:45.915314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:18.707927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.334065+0000","last_change":"2024-09-10T05:11:27.732198+0000","last_active":"2024-09-10T05:14:36.334065+0000","last_peered":"2024-09-10T05:14:36.334065+0000","last_clean":"2024-09-10T05:14:36.334065+0000","last_became_active":"2024-09-10T05:11:27.731909+0000","last_became_peered":"2024-09-10T05:11:27.731909+0000","last_unstale":"2024-09-10T05:14:36.334065+0000","last_undegraded":"2024-09-10T05:14:36.334065+0000","last_fullsized":"2024-09-10T05:14:36.334065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:44.836107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957106+0000","last_change":"2024-09-10T05:11:31.733054+0000","last_active":"2024-09-10T05:12:04.957106+0000","last_peered":"2024-09-10T05:12:04.957106+0000","last_clean":"2024-09-10T05:12:04.957106+0000","last_became_active":"2024-09-10T05:11:31.732807+0000","last_became_peered":"2024-09-10T05:11:31.732807+0000","last_unstale":"2024-09-10T05:12:04.957106+0000","last_undegraded":"2024-09-10T05:12:04.957106+0000","last_fullsized":"2024-09-10T05:12:04.957106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:45.290579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'66","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.273739+0000","last_change":"2024-09-10T05:11:33.747177+0000","last_active":"2024-09-10T05:13:34.273739+0000","last_peered":"2024-09-10T05:13:34.273739+0000","last_clean":"2024-09-10T05:13:34.273739+0000","last_became_active":"2024-09-10T05:11:33.745449+0000","last_became_peered":"2024-09-10T05:11:33.745449+0000","last_unstale":"2024-09-10T05:13:34.273739+0000","last_undegraded":"2024-09-10T05:13:34.273739+0000","last_fullsized":"2024-09-10T05:13:34.273739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:08.744407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956380+0000","last_change":"2024-09-10T05:11:35.748171+0000","last_active":"2024-09-10T05:12:04.956380+0000","last_peered":"2024-09-10T05:12:04.956380+0000","last_clean":"2024-09-10T05:12:04.956380+0000","last_became_active":"2024-09-10T05:11:35.747913+0000","last_became_peered":"2024-09-10T05:11:35.747913+0000","last_unstale":"2024-09-10T05:12:04.956380+0000","last_undegraded":"2024-09-10T05:12:04.956380+0000","last_fullsized":"2024-09-10T05:12:04.956380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:43.800560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'20","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.564815+0000","last_change":"2024-09-10T05:11:37.755327+0000","last_active":"2024-09-10T05:14:36.564815+0000","last_peered":"2024-09-10T05:14:36.564815+0000","last_clean":"2024-09-10T05:14:36.564815+0000","last_became_active":"2024-09-10T05:11:37.754915+0000","last_became_peered":"2024-09-10T05:11:37.754915+0000","last_unstale":"2024-09-10T05:14:36.564815+0000","last_undegraded":"2024-09-10T05:14:36.564815+0000","last_fullsized":"2024-09-10T05:14:36.564815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:57.393330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'14","reported_seq":78,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107522+0000","last_change":"2024-09-10T05:11:29.728158+0000","last_active":"2024-09-10T05:14:36.107522+0000","last_peered":"2024-09-10T05:14:36.107522+0000","last_clean":"2024-09-10T05:14:36.107522+0000","last_became_active":"2024-09-10T05:11:29.727349+0000","last_became_peered":"2024-09-10T05:11:29.727349+0000","last_unstale":"2024-09-10T05:14:36.107522+0000","last_undegraded":"2024-09-10T05:14:36.107522+0000","last_fullsized":"2024-09-10T05:14:36.107522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.550005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957300+0000","last_change":"2024-09-10T05:11:27.718217+0000","last_active":"2024-09-10T05:12:04.957300+0000","last_peered":"2024-09-10T05:12:04.957300+0000","last_clean":"2024-09-10T05:12:04.957300+0000","last_became_active":"2024-09-10T05:11:27.717887+0000","last_became_peered":"2024-09-10T05:11:27.717887+0000","last_unstale":"2024-09-10T05:12:04.957300+0000","last_undegraded":"2024-09-10T05:12:04.957300+0000","last_fullsized":"2024-09-10T05:12:04.957300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:12.698794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959422+0000","last_change":"2024-09-10T05:11:31.735674+0000","last_active":"2024-09-10T05:12:04.959422+0000","last_peered":"2024-09-10T05:12:04.959422+0000","last_clean":"2024-09-10T05:12:04.959422+0000","last_became_active":"2024-09-10T05:11:31.735386+0000","last_became_peered":"2024-09-10T05:11:31.735386+0000","last_unstale":"2024-09-10T05:12:04.959422+0000","last_undegraded":"2024-09-10T05:12:04.959422+0000","last_fullsized":"2024-09-10T05:12:04.959422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:05.541110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'38","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.253218+0000","last_change":"2024-09-10T05:11:33.744354+0000","last_active":"2024-09-10T05:13:34.253218+0000","last_peered":"2024-09-10T05:13:34.253218+0000","last_clean":"2024-09-10T05:13:34.253218+0000","last_became_active":"2024-09-10T05:11:33.744026+0000","last_became_peered":"2024-09-10T05:11:33.744026+0000","last_unstale":"2024-09-10T05:13:34.253218+0000","last_undegraded":"2024-09-10T05:13:34.253218+0000","last_fullsized":"2024-09-10T05:13:34.253218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.017634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960608+0000","last_change":"2024-09-10T05:11:35.749447+0000","last_active":"2024-09-10T05:12:04.960608+0000","last_peered":"2024-09-10T05:12:04.960608+0000","last_clean":"2024-09-10T05:12:04.960608+0000","last_became_active":"2024-09-10T05:11:35.748874+0000","last_became_peered":"2024-09-10T05:11:35.748874+0000","last_unstale":"2024-09-10T05:12:04.960608+0000","last_undegraded":"2024-09-10T05:12:04.960608+0000","last_fullsized":"2024-09-10T05:12:04.960608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:09.658936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'9","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.113777+0000","last_change":"2024-09-10T05:11:37.768186+0000","last_active":"2024-09-10T05:14:36.113777+0000","last_peered":"2024-09-10T05:14:36.113777+0000","last_clean":"2024-09-10T05:14:36.113777+0000","last_became_active":"2024-09-10T05:11:37.767895+0000","last_became_peered":"2024-09-10T05:11:37.767895+0000","last_unstale":"2024-09-10T05:14:36.113777+0000","last_undegraded":"2024-09-10T05:14:36.113777+0000","last_fullsized":"2024-09-10T05:14:36.113777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:10.944772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'16","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604812+0000","last_change":"2024-09-10T05:11:29.734119+0000","last_active":"2024-09-10T05:13:32.604812+0000","last_peered":"2024-09-10T05:13:32.604812+0000","last_clean":"2024-09-10T05:13:32.604812+0000","last_became_active":"2024-09-10T05:11:29.733870+0000","last_became_peered":"2024-09-10T05:11:29.733870+0000","last_unstale":"2024-09-10T05:13:32.604812+0000","last_undegraded":"2024-09-10T05:13:32.604812+0000","last_fullsized":"2024-09-10T05:13:32.604812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:25:17.874072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956901+0000","last_change":"2024-09-10T05:11:27.726184+0000","last_active":"2024-09-10T05:12:04.956901+0000","last_peered":"2024-09-10T05:12:04.956901+0000","last_clean":"2024-09-10T05:12:04.956901+0000","last_became_active":"2024-09-10T05:11:27.725852+0000","last_became_peered":"2024-09-10T05:11:27.725852+0000","last_unstale":"2024-09-10T05:12:04.956901+0000","last_undegraded":"2024-09-10T05:12:04.956901+0000","last_fullsized":"2024-09-10T05:12:04.956901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:25.585863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957204+0000","last_change":"2024-09-10T05:11:31.734106+0000","last_active":"2024-09-10T05:12:04.957204+0000","last_peered":"2024-09-10T05:12:04.957204+0000","last_clean":"2024-09-10T05:12:04.957204+0000","last_became_active":"2024-09-10T05:11:31.733756+0000","last_became_peered":"2024-09-10T05:11:31.733756+0000","last_unstale":"2024-09-10T05:12:04.957204+0000","last_undegraded":"2024-09-10T05:12:04.957204+0000","last_fullsized":"2024-09-10T05:12:04.957204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:20.576939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'37","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:50.916277+0000","last_change":"2024-09-10T05:11:33.742119+0000","last_active":"2024-09-10T05:13:50.916277+0000","last_peered":"2024-09-10T05:13:50.916277+0000","last_clean":"2024-09-10T05:13:50.916277+0000","last_became_active":"2024-09-10T05:11:33.741848+0000","last_became_peered":"2024-09-10T05:11:33.741848+0000","last_unstale":"2024-09-10T05:13:50.916277+0000","last_undegraded":"2024-09-10T05:13:50.916277+0000","last_fullsized":"2024-09-10T05:13:50.916277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:58.109463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'282","reported_seq":452,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.569053+0000","last_change":"2024-09-10T05:11:35.752932+0000","last_active":"2024-09-10T05:14:36.569053+0000","last_peered":"2024-09-10T05:14:36.569053+0000","last_clean":"2024-09-10T05:14:36.569053+0000","last_became_active":"2024-09-10T05:11:35.752511+0000","last_became_peered":"2024-09-10T05:11:35.752511+0000","last_unstale":"2024-09-10T05:14:36.569053+0000","last_undegraded":"2024-09-10T05:14:36.569053+0000","last_fullsized":"2024-09-10T05:14:36.569053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:09.522467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'14","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:43.909368+0000","last_change":"2024-09-10T05:11:37.758779+0000","last_active":"2024-09-10T05:13:43.909368+0000","last_peered":"2024-09-10T05:13:43.909368+0000","last_clean":"2024-09-10T05:13:43.909368+0000","last_became_active":"2024-09-10T05:11:37.758381+0000","last_became_peered":"2024-09-10T05:11:37.758381+0000","last_unstale":"2024-09-10T05:13:43.909368+0000","last_undegraded":"2024-09-10T05:13:43.909368+0000","last_fullsized":"2024-09-10T05:13:43.909368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:32.090333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'14","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417408+0000","last_change":"2024-09-10T05:11:29.722434+0000","last_active":"2024-09-10T05:14:36.417408+0000","last_peered":"2024-09-10T05:14:36.417408+0000","last_clean":"2024-09-10T05:14:36.417408+0000","last_became_active":"2024-09-10T05:11:29.722170+0000","last_became_peered":"2024-09-10T05:11:29.722170+0000","last_unstale":"2024-09-10T05:14:36.417408+0000","last_undegraded":"2024-09-10T05:14:36.417408+0000","last_fullsized":"2024-09-10T05:14:36.417408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.550005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.331217+0000","last_change":"2024-09-10T05:11:27.735604+0000","last_active":"2024-09-10T05:14:36.331217+0000","last_peered":"2024-09-10T05:14:36.331217+0000","last_clean":"2024-09-10T05:14:36.331217+0000","last_became_active":"2024-09-10T05:11:27.732591+0000","last_became_peered":"2024-09-10T05:11:27.732591+0000","last_unstale":"2024-09-10T05:14:36.331217+0000","last_undegraded":"2024-09-10T05:14:36.331217+0000","last_fullsized":"2024-09-10T05:14:36.331217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:31.318349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":414,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.322657+0000","last_change":"2024-09-10T05:11:31.735002+0000","last_active":"2024-09-10T05:13:35.322657+0000","last_peered":"2024-09-10T05:13:35.322657+0000","last_clean":"2024-09-10T05:13:35.322657+0000","last_became_active":"2024-09-10T05:11:31.734714+0000","last_became_peered":"2024-09-10T05:11:31.734714+0000","last_unstale":"2024-09-10T05:13:35.322657+0000","last_undegraded":"2024-09-10T05:13:35.322657+0000","last_fullsized":"2024-09-10T05:13:35.322657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:15.409455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958372+0000","last_change":"2024-09-10T05:11:33.747604+0000","last_active":"2024-09-10T05:12:04.958372+0000","last_peered":"2024-09-10T05:12:04.958372+0000","last_clean":"2024-09-10T05:12:04.958372+0000","last_became_active":"2024-09-10T05:11:33.747376+0000","last_became_peered":"2024-09-10T05:11:33.747376+0000","last_unstale":"2024-09-10T05:12:04.958372+0000","last_undegraded":"2024-09-10T05:12:04.958372+0000","last_fullsized":"2024-09-10T05:12:04.958372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:06.584551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'282","reported_seq":463,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.578120+0000","last_change":"2024-09-10T05:11:35.751653+0000","last_active":"2024-09-10T05:14:36.578120+0000","last_peered":"2024-09-10T05:14:36.578120+0000","last_clean":"2024-09-10T05:14:36.578120+0000","last_became_active":"2024-09-10T05:11:35.751352+0000","last_became_peered":"2024-09-10T05:11:35.751352+0000","last_unstale":"2024-09-10T05:14:36.578120+0000","last_undegraded":"2024-09-10T05:14:36.578120+0000","last_fullsized":"2024-09-10T05:14:36.578120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:50.857756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.203681+0000","last_change":"2024-09-10T05:11:37.757022+0000","last_active":"2024-09-10T05:14:36.203681+0000","last_peered":"2024-09-10T05:14:36.203681+0000","last_clean":"2024-09-10T05:14:36.203681+0000","last_became_active":"2024-09-10T05:11:37.756734+0000","last_became_peered":"2024-09-10T05:11:37.756734+0000","last_unstale":"2024-09-10T05:14:36.203681+0000","last_undegraded":"2024-09-10T05:14:36.203681+0000","last_fullsized":"2024-09-10T05:14:36.203681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:18.190348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'24","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382763+0000","last_change":"2024-09-10T05:11:29.735311+0000","last_active":"2024-09-10T05:14:36.382763+0000","last_peered":"2024-09-10T05:14:36.382763+0000","last_clean":"2024-09-10T05:14:36.382763+0000","last_became_active":"2024-09-10T05:11:29.735032+0000","last_became_peered":"2024-09-10T05:11:29.735032+0000","last_unstale":"2024-09-10T05:14:36.382763+0000","last_undegraded":"2024-09-10T05:14:36.382763+0000","last_fullsized":"2024-09-10T05:14:36.382763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:36.894039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914802+0000","last_change":"2024-09-10T05:11:27.734962+0000","last_active":"2024-09-10T05:13:40.914802+0000","last_peered":"2024-09-10T05:13:40.914802+0000","last_clean":"2024-09-10T05:13:40.914802+0000","last_became_active":"2024-09-10T05:11:27.734204+0000","last_became_peered":"2024-09-10T05:11:27.734204+0000","last_unstale":"2024-09-10T05:13:40.914802+0000","last_undegraded":"2024-09-10T05:13:40.914802+0000","last_fullsized":"2024-09-10T05:13:40.914802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:06.500114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962223+0000","last_change":"2024-09-10T05:11:31.737418+0000","last_active":"2024-09-10T05:12:04.962223+0000","last_peered":"2024-09-10T05:12:04.962223+0000","last_clean":"2024-09-10T05:12:04.962223+0000","last_became_active":"2024-09-10T05:11:31.736841+0000","last_became_peered":"2024-09-10T05:11:31.736841+0000","last_unstale":"2024-09-10T05:12:04.962223+0000","last_undegraded":"2024-09-10T05:12:04.962223+0000","last_fullsized":"2024-09-10T05:12:04.962223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:39.906395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'39","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.266836+0000","last_change":"2024-09-10T05:11:33.744918+0000","last_active":"2024-09-10T05:13:34.266836+0000","last_peered":"2024-09-10T05:13:34.266836+0000","last_clean":"2024-09-10T05:13:34.266836+0000","last_became_active":"2024-09-10T05:11:33.744394+0000","last_became_peered":"2024-09-10T05:11:33.744394+0000","last_unstale":"2024-09-10T05:13:34.266836+0000","last_undegraded":"2024-09-10T05:13:34.266836+0000","last_fullsized":"2024-09-10T05:13:34.266836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:42.791441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959396+0000","last_change":"2024-09-10T05:11:35.750802+0000","last_active":"2024-09-10T05:12:04.959396+0000","last_peered":"2024-09-10T05:12:04.959396+0000","last_clean":"2024-09-10T05:12:04.959396+0000","last_became_active":"2024-09-10T05:11:35.750450+0000","last_became_peered":"2024-09-10T05:11:35.750450+0000","last_unstale":"2024-09-10T05:12:04.959396+0000","last_undegraded":"2024-09-10T05:12:04.959396+0000","last_fullsized":"2024-09-10T05:12:04.959396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:00.422593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'6","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.453623+0000","last_change":"2024-09-10T05:11:37.757621+0000","last_active":"2024-09-10T05:14:36.453623+0000","last_peered":"2024-09-10T05:14:36.453623+0000","last_clean":"2024-09-10T05:14:36.453623+0000","last_became_active":"2024-09-10T05:11:37.757289+0000","last_became_peered":"2024-09-10T05:11:37.757289+0000","last_unstale":"2024-09-10T05:14:36.453623+0000","last_undegraded":"2024-09-10T05:14:36.453623+0000","last_fullsized":"2024-09-10T05:14:36.453623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:57.261211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'8","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417687+0000","last_change":"2024-09-10T05:11:29.734971+0000","last_active":"2024-09-10T05:14:36.417687+0000","last_peered":"2024-09-10T05:14:36.417687+0000","last_clean":"2024-09-10T05:14:36.417687+0000","last_became_active":"2024-09-10T05:11:29.734367+0000","last_became_peered":"2024-09-10T05:11:29.734367+0000","last_unstale":"2024-09-10T05:14:36.417687+0000","last_undegraded":"2024-09-10T05:14:36.417687+0000","last_fullsized":"2024-09-10T05:14:36.417687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:48.993029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957132+0000","last_change":"2024-09-10T05:11:14.294244+0000","last_active":"2024-09-10T05:12:04.957132+0000","last_peered":"2024-09-10T05:12:04.957132+0000","last_clean":"2024-09-10T05:12:04.957132+0000","last_became_active":"2024-09-10T05:11:14.293121+0000","last_became_peered":"2024-09-10T05:11:14.293121+0000","last_unstale":"2024-09-10T05:12:04.957132+0000","last_undegraded":"2024-09-10T05:12:04.957132+0000","last_fullsized":"2024-09-10T05:12:04.957132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:12.494055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:12.494055+0000","last_clean_scrub_stamp":"2024-09-10T05:11:12.494055+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:00.347397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955461+0000","last_change":"2024-09-10T05:11:18.533277+0000","last_active":"2024-09-10T05:12:04.955461+0000","last_peered":"2024-09-10T05:12:04.955461+0000","last_clean":"2024-09-10T05:12:04.955461+0000","last_became_active":"2024-09-10T05:11:16.531926+0000","last_became_peered":"2024-09-10T05:11:16.531926+0000","last_unstale":"2024-09-10T05:12:04.955461+0000","last_undegraded":"2024-09-10T05:12:04.955461+0000","last_fullsized":"2024-09-10T05:12:04.955461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:44.106335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121101,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955445+0000","last_change":"2024-09-10T05:11:27.736386+0000","last_active":"2024-09-10T05:12:04.955445+0000","last_peered":"2024-09-10T05:12:04.955445+0000","last_clean":"2024-09-10T05:12:04.955445+0000","last_became_active":"2024-09-10T05:11:27.735941+0000","last_became_peered":"2024-09-10T05:11:27.735941+0000","last_unstale":"2024-09-10T05:12:04.955445+0000","last_undegraded":"2024-09-10T05:12:04.955445+0000","last_fullsized":"2024-09-10T05:12:04.955445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:05.735103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960299+0000","last_change":"2024-09-10T05:11:31.736397+0000","last_active":"2024-09-10T05:12:04.960299+0000","last_peered":"2024-09-10T05:12:04.960299+0000","last_clean":"2024-09-10T05:12:04.960299+0000","last_became_active":"2024-09-10T05:11:31.736104+0000","last_became_peered":"2024-09-10T05:11:31.736104+0000","last_unstale":"2024-09-10T05:12:04.960299+0000","last_undegraded":"2024-09-10T05:12:04.960299+0000","last_fullsized":"2024-09-10T05:12:04.960299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:58.631203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'85","reported_seq":161,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.278155+0000","last_change":"2024-09-10T05:11:33.744321+0000","last_active":"2024-09-10T05:13:34.278155+0000","last_peered":"2024-09-10T05:13:34.278155+0000","last_clean":"2024-09-10T05:13:34.278155+0000","last_became_active":"2024-09-10T05:11:33.743933+0000","last_became_peered":"2024-09-10T05:11:33.743933+0000","last_unstale":"2024-09-10T05:13:34.278155+0000","last_undegraded":"2024-09-10T05:13:34.278155+0000","last_fullsized":"2024-09-10T05:13:34.278155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:30.903532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957924+0000","last_change":"2024-09-10T05:11:35.750549+0000","last_active":"2024-09-10T05:12:04.957924+0000","last_peered":"2024-09-10T05:12:04.957924+0000","last_clean":"2024-09-10T05:12:04.957924+0000","last_became_active":"2024-09-10T05:11:35.750248+0000","last_became_peered":"2024-09-10T05:11:35.750248+0000","last_unstale":"2024-09-10T05:12:04.957924+0000","last_undegraded":"2024-09-10T05:12:04.957924+0000","last_fullsized":"2024-09-10T05:12:04.957924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:19.363818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'85","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.427998+0000","last_change":"2024-09-10T05:11:37.755526+0000","last_active":"2024-09-10T05:14:36.427998+0000","last_peered":"2024-09-10T05:14:36.427998+0000","last_clean":"2024-09-10T05:14:36.427998+0000","last_became_active":"2024-09-10T05:11:37.755239+0000","last_became_peered":"2024-09-10T05:11:37.755239+0000","last_unstale":"2024-09-10T05:14:36.427998+0000","last_undegraded":"2024-09-10T05:14:36.427998+0000","last_fullsized":"2024-09-10T05:14:36.427998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:13.536289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.387697+0000","last_change":"2024-09-10T05:11:29.732838+0000","last_active":"2024-09-10T05:14:36.387697+0000","last_peered":"2024-09-10T05:14:36.387697+0000","last_clean":"2024-09-10T05:14:36.387697+0000","last_became_active":"2024-09-10T05:11:29.732560+0000","last_became_peered":"2024-09-10T05:11:29.732560+0000","last_unstale":"2024-09-10T05:14:36.387697+0000","last_undegraded":"2024-09-10T05:14:36.387697+0000","last_fullsized":"2024-09-10T05:14:36.387697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:38.766836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954364+0000","last_change":"2024-09-10T05:11:18.532549+0000","last_active":"2024-09-10T05:12:04.954364+0000","last_peered":"2024-09-10T05:12:04.954364+0000","last_clean":"2024-09-10T05:12:04.954364+0000","last_became_active":"2024-09-10T05:11:16.531911+0000","last_became_peered":"2024-09-10T05:11:16.531911+0000","last_unstale":"2024-09-10T05:12:04.954364+0000","last_undegraded":"2024-09-10T05:12:04.954364+0000","last_fullsized":"2024-09-10T05:12:04.954364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:51:16.716892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039105900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.649449+0000","last_change":"2024-09-10T05:11:27.713561+0000","last_active":"2024-09-10T05:12:09.649449+0000","last_peered":"2024-09-10T05:12:09.649449+0000","last_clean":"2024-09-10T05:12:09.649449+0000","last_became_active":"2024-09-10T05:11:27.713026+0000","last_became_peered":"2024-09-10T05:11:27.713026+0000","last_unstale":"2024-09-10T05:12:09.649449+0000","last_undegraded":"2024-09-10T05:12:09.649449+0000","last_fullsized":"2024-09-10T05:12:09.649449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:55.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961506+0000","last_change":"2024-09-10T05:11:31.738104+0000","last_active":"2024-09-10T05:12:04.961506+0000","last_peered":"2024-09-10T05:12:04.961506+0000","last_clean":"2024-09-10T05:12:04.961506+0000","last_became_active":"2024-09-10T05:11:31.737199+0000","last_became_peered":"2024-09-10T05:11:31.737199+0000","last_unstale":"2024-09-10T05:12:04.961506+0000","last_undegraded":"2024-09-10T05:12:04.961506+0000","last_fullsized":"2024-09-10T05:12:04.961506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:08.807684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'281","reported_seq":490,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813328+0000","last_change":"2024-09-10T05:11:33.744372+0000","last_active":"2024-09-10T05:14:31.813328+0000","last_peered":"2024-09-10T05:14:31.813328+0000","last_clean":"2024-09-10T05:14:31.813328+0000","last_became_active":"2024-09-10T05:11:33.744103+0000","last_became_peered":"2024-09-10T05:11:33.744103+0000","last_unstale":"2024-09-10T05:14:31.813328+0000","last_undegraded":"2024-09-10T05:14:31.813328+0000","last_fullsized":"2024-09-10T05:14:31.813328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:33.869492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":372,"num_read_kb":371,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956847+0000","last_change":"2024-09-10T05:11:35.749117+0000","last_active":"2024-09-10T05:12:04.956847+0000","last_peered":"2024-09-10T05:12:04.956847+0000","last_clean":"2024-09-10T05:12:04.956847+0000","last_became_active":"2024-09-10T05:11:35.748767+0000","last_became_peered":"2024-09-10T05:11:35.748767+0000","last_unstale":"2024-09-10T05:12:04.956847+0000","last_undegraded":"2024-09-10T05:12:04.956847+0000","last_fullsized":"2024-09-10T05:12:04.956847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:02.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.966773+0000","last_change":"2024-09-10T05:11:37.758407+0000","last_active":"2024-09-10T05:12:51.966773+0000","last_peered":"2024-09-10T05:12:51.966773+0000","last_clean":"2024-09-10T05:12:51.966773+0000","last_became_active":"2024-09-10T05:11:37.758114+0000","last_became_peered":"2024-09-10T05:11:37.758114+0000","last_unstale":"2024-09-10T05:12:51.966773+0000","last_undegraded":"2024-09-10T05:12:51.966773+0000","last_fullsized":"2024-09-10T05:12:51.966773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:43.659998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'14","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417308+0000","last_change":"2024-09-10T05:11:29.724542+0000","last_active":"2024-09-10T05:14:36.417308+0000","last_peered":"2024-09-10T05:14:36.417308+0000","last_clean":"2024-09-10T05:14:36.417308+0000","last_became_active":"2024-09-10T05:11:29.723609+0000","last_became_peered":"2024-09-10T05:11:29.723609+0000","last_unstale":"2024-09-10T05:14:36.417308+0000","last_undegraded":"2024-09-10T05:14:36.417308+0000","last_fullsized":"2024-09-10T05:14:36.417308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:37.264959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956636+0000","last_change":"2024-09-10T05:11:18.530458+0000","last_active":"2024-09-10T05:12:04.956636+0000","last_peered":"2024-09-10T05:12:04.956636+0000","last_clean":"2024-09-10T05:12:04.956636+0000","last_became_active":"2024-09-10T05:11:16.530448+0000","last_became_peered":"2024-09-10T05:11:16.530448+0000","last_unstale":"2024-09-10T05:12:04.956636+0000","last_undegraded":"2024-09-10T05:12:04.956636+0000","last_fullsized":"2024-09-10T05:12:04.956636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:12.102135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036982300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.027950+0000","last_change":"2024-09-10T05:11:27.715078+0000","last_active":"2024-09-10T05:14:36.027950+0000","last_peered":"2024-09-10T05:14:36.027950+0000","last_clean":"2024-09-10T05:14:36.027950+0000","last_became_active":"2024-09-10T05:11:27.714299+0000","last_became_peered":"2024-09-10T05:11:27.714299+0000","last_unstale":"2024-09-10T05:14:36.027950+0000","last_undegraded":"2024-09-10T05:14:36.027950+0000","last_fullsized":"2024-09-10T05:14:36.027950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:12.065688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963356+0000","last_change":"2024-09-10T05:11:31.731588+0000","last_active":"2024-09-10T05:12:04.963356+0000","last_peered":"2024-09-10T05:12:04.963356+0000","last_clean":"2024-09-10T05:12:04.963356+0000","last_became_active":"2024-09-10T05:11:31.730978+0000","last_became_peered":"2024-09-10T05:11:31.730978+0000","last_unstale":"2024-09-10T05:12:04.963356+0000","last_undegraded":"2024-09-10T05:12:04.963356+0000","last_fullsized":"2024-09-10T05:12:04.963356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:07.052816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'17","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813393+0000","last_change":"2024-09-10T05:11:33.746382+0000","last_active":"2024-09-10T05:14:31.813393+0000","last_peered":"2024-09-10T05:14:31.813393+0000","last_clean":"2024-09-10T05:14:31.813393+0000","last_became_active":"2024-09-10T05:11:33.746102+0000","last_became_peered":"2024-09-10T05:11:33.746102+0000","last_unstale":"2024-09-10T05:14:31.813393+0000","last_undegraded":"2024-09-10T05:14:31.813393+0000","last_fullsized":"2024-09-10T05:14:31.813393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:53.746336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957971+0000","last_change":"2024-09-10T05:11:35.753872+0000","last_active":"2024-09-10T05:12:04.957971+0000","last_peered":"2024-09-10T05:12:04.957971+0000","last_clean":"2024-09-10T05:12:04.957971+0000","last_became_active":"2024-09-10T05:11:35.753342+0000","last_became_peered":"2024-09-10T05:11:35.753342+0000","last_unstale":"2024-09-10T05:12:04.957971+0000","last_undegraded":"2024-09-10T05:12:04.957971+0000","last_fullsized":"2024-09-10T05:12:04.957971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:37.752504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955113+0000","last_change":"2024-09-10T05:11:37.769011+0000","last_active":"2024-09-10T05:12:04.955113+0000","last_peered":"2024-09-10T05:12:04.955113+0000","last_clean":"2024-09-10T05:12:04.955113+0000","last_became_active":"2024-09-10T05:11:37.767788+0000","last_became_peered":"2024-09-10T05:11:37.767788+0000","last_unstale":"2024-09-10T05:12:04.955113+0000","last_undegraded":"2024-09-10T05:12:04.955113+0000","last_fullsized":"2024-09-10T05:12:04.955113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:55.792983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'6","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417182+0000","last_change":"2024-09-10T05:11:29.727352+0000","last_active":"2024-09-10T05:14:36.417182+0000","last_peered":"2024-09-10T05:14:36.417182+0000","last_clean":"2024-09-10T05:14:36.417182+0000","last_became_active":"2024-09-10T05:11:29.727022+0000","last_became_peered":"2024-09-10T05:11:29.727022+0000","last_unstale":"2024-09-10T05:14:36.417182+0000","last_undegraded":"2024-09-10T05:14:36.417182+0000","last_fullsized":"2024-09-10T05:14:36.417182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:07.042493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955161+0000","last_change":"2024-09-10T05:11:18.533201+0000","last_active":"2024-09-10T05:12:04.955161+0000","last_peered":"2024-09-10T05:12:04.955161+0000","last_clean":"2024-09-10T05:12:04.955161+0000","last_became_active":"2024-09-10T05:11:16.530756+0000","last_became_peered":"2024-09-10T05:11:16.530756+0000","last_unstale":"2024-09-10T05:12:04.955161+0000","last_undegraded":"2024-09-10T05:12:04.955161+0000","last_fullsized":"2024-09-10T05:12:04.955161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:46.741517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047784,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960447+0000","last_change":"2024-09-10T05:11:27.722242+0000","last_active":"2024-09-10T05:12:04.960447+0000","last_peered":"2024-09-10T05:12:04.960447+0000","last_clean":"2024-09-10T05:12:04.960447+0000","last_became_active":"2024-09-10T05:11:27.718333+0000","last_became_peered":"2024-09-10T05:11:27.718333+0000","last_unstale":"2024-09-10T05:12:04.960447+0000","last_undegraded":"2024-09-10T05:12:04.960447+0000","last_fullsized":"2024-09-10T05:12:04.960447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:32.972378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:05.900504+0000","last_change":"2024-09-10T05:12:04.965299+0000","last_active":"2024-09-10T05:12:05.900504+0000","last_peered":"2024-09-10T05:12:05.900504+0000","last_clean":"2024-09-10T05:12:05.900504+0000","last_became_active":"2024-09-10T05:12:04.964996+0000","last_became_peered":"2024-09-10T05:12:04.964996+0000","last_unstale":"2024-09-10T05:12:05.900504+0000","last_undegraded":"2024-09-10T05:12:05.900504+0000","last_fullsized":"2024-09-10T05:12:05.900504+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:02.241258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"37'13","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.691724+0000","last_change":"2024-09-10T05:11:33.743920+0000","last_active":"2024-09-10T05:14:35.691724+0000","last_peered":"2024-09-10T05:14:35.691724+0000","last_clean":"2024-09-10T05:14:35.691724+0000","last_became_active":"2024-09-10T05:11:33.743292+0000","last_became_peered":"2024-09-10T05:11:33.743292+0000","last_unstale":"2024-09-10T05:14:35.691724+0000","last_undegraded":"2024-09-10T05:14:35.691724+0000","last_fullsized":"2024-09-10T05:14:35.691724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:18.442235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960791+0000","last_change":"2024-09-10T05:11:35.752348+0000","last_active":"2024-09-10T05:12:04.960791+0000","last_peered":"2024-09-10T05:12:04.960791+0000","last_clean":"2024-09-10T05:12:04.960791+0000","last_became_active":"2024-09-10T05:11:35.751982+0000","last_became_peered":"2024-09-10T05:11:35.751982+0000","last_unstale":"2024-09-10T05:12:04.960791+0000","last_undegraded":"2024-09-10T05:12:04.960791+0000","last_fullsized":"2024-09-10T05:12:04.960791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:53.013137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.434600+0000","last_change":"2024-09-10T05:11:37.762596+0000","last_active":"2024-09-10T05:13:35.434600+0000","last_peered":"2024-09-10T05:13:35.434600+0000","last_clean":"2024-09-10T05:13:35.434600+0000","last_became_active":"2024-09-10T05:11:37.762327+0000","last_became_peered":"2024-09-10T05:11:37.762327+0000","last_unstale":"2024-09-10T05:13:35.434600+0000","last_undegraded":"2024-09-10T05:13:35.434600+0000","last_fullsized":"2024-09-10T05:13:35.434600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:33.354245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'16","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339389+0000","last_change":"2024-09-10T05:11:29.731028+0000","last_active":"2024-09-10T05:14:36.339389+0000","last_peered":"2024-09-10T05:14:36.339389+0000","last_clean":"2024-09-10T05:14:36.339389+0000","last_became_active":"2024-09-10T05:11:29.730589+0000","last_became_peered":"2024-09-10T05:11:29.730589+0000","last_unstale":"2024-09-10T05:14:36.339389+0000","last_undegraded":"2024-09-10T05:14:36.339389+0000","last_fullsized":"2024-09-10T05:14:36.339389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:05.100041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959159+0000","last_change":"2024-09-10T05:11:27.718564+0000","last_active":"2024-09-10T05:12:04.959159+0000","last_peered":"2024-09-10T05:12:04.959159+0000","last_clean":"2024-09-10T05:12:04.959159+0000","last_became_active":"2024-09-10T05:11:27.716023+0000","last_became_peered":"2024-09-10T05:11:27.716023+0000","last_unstale":"2024-09-10T05:12:04.959159+0000","last_undegraded":"2024-09-10T05:12:04.959159+0000","last_fullsized":"2024-09-10T05:12:04.959159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:47:35.592580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957535+0000","last_change":"2024-09-10T05:11:18.534946+0000","last_active":"2024-09-10T05:12:04.957535+0000","last_peered":"2024-09-10T05:12:04.957535+0000","last_clean":"2024-09-10T05:12:04.957535+0000","last_became_active":"2024-09-10T05:11:16.532795+0000","last_became_peered":"2024-09-10T05:11:16.532795+0000","last_unstale":"2024-09-10T05:12:04.957535+0000","last_undegraded":"2024-09-10T05:12:04.957535+0000","last_fullsized":"2024-09-10T05:12:04.957535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:22.750871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060128199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:38.908572+0000","last_change":"2024-09-10T05:11:31.734963+0000","last_active":"2024-09-10T05:13:38.908572+0000","last_peered":"2024-09-10T05:13:38.908572+0000","last_clean":"2024-09-10T05:13:38.908572+0000","last_became_active":"2024-09-10T05:11:31.734707+0000","last_became_peered":"2024-09-10T05:11:31.734707+0000","last_unstale":"2024-09-10T05:13:38.908572+0000","last_undegraded":"2024-09-10T05:13:38.908572+0000","last_fullsized":"2024-09-10T05:13:38.908572+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:00.334943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'73","reported_seq":145,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.279404+0000","last_change":"2024-09-10T05:11:33.743569+0000","last_active":"2024-09-10T05:13:34.279404+0000","last_peered":"2024-09-10T05:13:34.279404+0000","last_clean":"2024-09-10T05:13:34.279404+0000","last_became_active":"2024-09-10T05:11:33.743238+0000","last_became_peered":"2024-09-10T05:11:33.743238+0000","last_unstale":"2024-09-10T05:13:34.279404+0000","last_undegraded":"2024-09-10T05:13:34.279404+0000","last_fullsized":"2024-09-10T05:13:34.279404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:26.759194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957685+0000","last_change":"2024-09-10T05:11:35.751255+0000","last_active":"2024-09-10T05:12:04.957685+0000","last_peered":"2024-09-10T05:12:04.957685+0000","last_clean":"2024-09-10T05:12:04.957685+0000","last_became_active":"2024-09-10T05:11:35.750830+0000","last_became_peered":"2024-09-10T05:11:35.750830+0000","last_unstale":"2024-09-10T05:12:04.957685+0000","last_undegraded":"2024-09-10T05:12:04.957685+0000","last_fullsized":"2024-09-10T05:12:04.957685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:07.959084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.612283+0000","last_change":"2024-09-10T05:11:37.759212+0000","last_active":"2024-09-10T05:13:35.612283+0000","last_peered":"2024-09-10T05:13:35.612283+0000","last_clean":"2024-09-10T05:13:35.612283+0000","last_became_active":"2024-09-10T05:11:37.758971+0000","last_became_peered":"2024-09-10T05:11:37.758971+0000","last_unstale":"2024-09-10T05:13:35.612283+0000","last_undegraded":"2024-09-10T05:13:35.612283+0000","last_fullsized":"2024-09-10T05:13:35.612283+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:10.652277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'14","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116914+0000","last_change":"2024-09-10T05:11:29.730327+0000","last_active":"2024-09-10T05:14:36.116914+0000","last_peered":"2024-09-10T05:14:36.116914+0000","last_clean":"2024-09-10T05:14:36.116914+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:14:36.116914+0000","last_undegraded":"2024-09-10T05:14:36.116914+0000","last_fullsized":"2024-09-10T05:14:36.116914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:07.743055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958331+0000","last_change":"2024-09-10T05:11:27.719090+0000","last_active":"2024-09-10T05:12:04.958331+0000","last_peered":"2024-09-10T05:12:04.958331+0000","last_clean":"2024-09-10T05:12:04.958331+0000","last_became_active":"2024-09-10T05:11:27.718756+0000","last_became_peered":"2024-09-10T05:11:27.718756+0000","last_unstale":"2024-09-10T05:12:04.958331+0000","last_undegraded":"2024-09-10T05:12:04.958331+0000","last_fullsized":"2024-09-10T05:12:04.958331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:48.332632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957276+0000","last_change":"2024-09-10T05:11:18.532627+0000","last_active":"2024-09-10T05:12:04.957276+0000","last_peered":"2024-09-10T05:12:04.957276+0000","last_clean":"2024-09-10T05:12:04.957276+0000","last_became_active":"2024-09-10T05:11:16.530746+0000","last_became_peered":"2024-09-10T05:11:16.530746+0000","last_unstale":"2024-09-10T05:12:04.957276+0000","last_undegraded":"2024-09-10T05:12:04.957276+0000","last_fullsized":"2024-09-10T05:12:04.957276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:33.333497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048256999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955118+0000","last_change":"2024-09-10T05:11:31.734598+0000","last_active":"2024-09-10T05:12:04.955118+0000","last_peered":"2024-09-10T05:12:04.955118+0000","last_clean":"2024-09-10T05:12:04.955118+0000","last_became_active":"2024-09-10T05:11:31.734333+0000","last_became_peered":"2024-09-10T05:11:31.734333+0000","last_unstale":"2024-09-10T05:12:04.955118+0000","last_undegraded":"2024-09-10T05:12:04.955118+0000","last_fullsized":"2024-09-10T05:12:04.955118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:04.362140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958360+0000","last_change":"2024-09-10T05:11:33.744326+0000","last_active":"2024-09-10T05:12:04.958360+0000","last_peered":"2024-09-10T05:12:04.958360+0000","last_clean":"2024-09-10T05:12:04.958360+0000","last_became_active":"2024-09-10T05:11:33.744011+0000","last_became_peered":"2024-09-10T05:11:33.744011+0000","last_unstale":"2024-09-10T05:12:04.958360+0000","last_undegraded":"2024-09-10T05:12:04.958360+0000","last_fullsized":"2024-09-10T05:12:04.958360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:25:21.898677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'282","reported_seq":346,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813409+0000","last_change":"2024-09-10T05:11:35.743851+0000","last_active":"2024-09-10T05:14:31.813409+0000","last_peered":"2024-09-10T05:14:31.813409+0000","last_clean":"2024-09-10T05:14:31.813409+0000","last_became_active":"2024-09-10T05:11:35.743571+0000","last_became_peered":"2024-09-10T05:11:35.743571+0000","last_unstale":"2024-09-10T05:14:31.813409+0000","last_undegraded":"2024-09-10T05:14:31.813409+0000","last_fullsized":"2024-09-10T05:14:31.813409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.416572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.602302+0000","last_change":"2024-09-10T05:11:37.764931+0000","last_active":"2024-09-10T05:13:32.602302+0000","last_peered":"2024-09-10T05:13:32.602302+0000","last_clean":"2024-09-10T05:13:32.602302+0000","last_became_active":"2024-09-10T05:11:37.764657+0000","last_became_peered":"2024-09-10T05:11:37.764657+0000","last_unstale":"2024-09-10T05:13:32.602302+0000","last_undegraded":"2024-09-10T05:13:32.602302+0000","last_fullsized":"2024-09-10T05:13:32.602302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:33.836899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382938+0000","last_change":"2024-09-10T05:11:29.735974+0000","last_active":"2024-09-10T05:14:36.382938+0000","last_peered":"2024-09-10T05:14:36.382938+0000","last_clean":"2024-09-10T05:14:36.382938+0000","last_became_active":"2024-09-10T05:11:29.734731+0000","last_became_peered":"2024-09-10T05:11:29.734731+0000","last_unstale":"2024-09-10T05:14:36.382938+0000","last_undegraded":"2024-09-10T05:14:36.382938+0000","last_fullsized":"2024-09-10T05:14:36.382938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:47.453260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961339+0000","last_change":"2024-09-10T05:11:27.723646+0000","last_active":"2024-09-10T05:12:04.961339+0000","last_peered":"2024-09-10T05:12:04.961339+0000","last_clean":"2024-09-10T05:12:04.961339+0000","last_became_active":"2024-09-10T05:11:27.723268+0000","last_became_peered":"2024-09-10T05:11:27.723268+0000","last_unstale":"2024-09-10T05:12:04.961339+0000","last_undegraded":"2024-09-10T05:12:04.961339+0000","last_fullsized":"2024-09-10T05:12:04.961339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:31.006213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958152+0000","last_change":"2024-09-10T05:11:18.534977+0000","last_active":"2024-09-10T05:12:04.958152+0000","last_peered":"2024-09-10T05:12:04.958152+0000","last_clean":"2024-09-10T05:12:04.958152+0000","last_became_active":"2024-09-10T05:11:16.531550+0000","last_became_peered":"2024-09-10T05:11:16.531550+0000","last_unstale":"2024-09-10T05:12:04.958152+0000","last_undegraded":"2024-09-10T05:12:04.958152+0000","last_fullsized":"2024-09-10T05:12:04.958152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:22.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063503699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955664+0000","last_change":"2024-09-10T05:11:31.734677+0000","last_active":"2024-09-10T05:12:04.955664+0000","last_peered":"2024-09-10T05:12:04.955664+0000","last_clean":"2024-09-10T05:12:04.955664+0000","last_became_active":"2024-09-10T05:11:31.734310+0000","last_became_peered":"2024-09-10T05:11:31.734310+0000","last_unstale":"2024-09-10T05:12:04.955664+0000","last_undegraded":"2024-09-10T05:12:04.955664+0000","last_fullsized":"2024-09-10T05:12:04.955664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:04.152181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'17","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.669838+0000","last_change":"2024-09-10T05:11:33.748918+0000","last_active":"2024-09-10T05:12:09.669838+0000","last_peered":"2024-09-10T05:12:09.669838+0000","last_clean":"2024-09-10T05:12:09.669838+0000","last_became_active":"2024-09-10T05:11:33.748603+0000","last_became_peered":"2024-09-10T05:11:33.748603+0000","last_unstale":"2024-09-10T05:12:09.669838+0000","last_undegraded":"2024-09-10T05:12:09.669838+0000","last_fullsized":"2024-09-10T05:12:09.669838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:30.495078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'282","reported_seq":389,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.565579+0000","last_change":"2024-09-10T05:11:35.746066+0000","last_active":"2024-09-10T05:14:36.565579+0000","last_peered":"2024-09-10T05:14:36.565579+0000","last_clean":"2024-09-10T05:14:36.565579+0000","last_became_active":"2024-09-10T05:11:35.745807+0000","last_became_peered":"2024-09-10T05:11:35.745807+0000","last_unstale":"2024-09-10T05:14:36.565579+0000","last_undegraded":"2024-09-10T05:14:36.565579+0000","last_fullsized":"2024-09-10T05:14:36.565579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:15.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960007+0000","last_change":"2024-09-10T05:11:37.762669+0000","last_active":"2024-09-10T05:12:04.960007+0000","last_peered":"2024-09-10T05:12:04.960007+0000","last_clean":"2024-09-10T05:12:04.960007+0000","last_became_active":"2024-09-10T05:11:37.762407+0000","last_became_peered":"2024-09-10T05:11:37.762407+0000","last_unstale":"2024-09-10T05:12:04.960007+0000","last_undegraded":"2024-09-10T05:12:04.960007+0000","last_fullsized":"2024-09-10T05:12:04.960007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:01.260628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.199374+0000","last_change":"2024-09-10T05:11:29.730717+0000","last_active":"2024-09-10T05:14:36.199374+0000","last_peered":"2024-09-10T05:14:36.199374+0000","last_clean":"2024-09-10T05:14:36.199374+0000","last_became_active":"2024-09-10T05:11:29.730285+0000","last_became_peered":"2024-09-10T05:11:29.730285+0000","last_unstale":"2024-09-10T05:14:36.199374+0000","last_undegraded":"2024-09-10T05:14:36.199374+0000","last_fullsized":"2024-09-10T05:14:36.199374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:27.593815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914614+0000","last_change":"2024-09-10T05:11:27.731410+0000","last_active":"2024-09-10T05:13:40.914614+0000","last_peered":"2024-09-10T05:13:40.914614+0000","last_clean":"2024-09-10T05:13:40.914614+0000","last_became_active":"2024-09-10T05:11:27.731108+0000","last_became_peered":"2024-09-10T05:11:27.731108+0000","last_unstale":"2024-09-10T05:13:40.914614+0000","last_undegraded":"2024-09-10T05:13:40.914614+0000","last_fullsized":"2024-09-10T05:13:40.914614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:36.345654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960717+0000","last_change":"2024-09-10T05:11:18.533507+0000","last_active":"2024-09-10T05:12:04.960717+0000","last_peered":"2024-09-10T05:12:04.960717+0000","last_clean":"2024-09-10T05:12:04.960717+0000","last_became_active":"2024-09-10T05:11:16.531468+0000","last_became_peered":"2024-09-10T05:11:16.531468+0000","last_unstale":"2024-09-10T05:12:04.960717+0000","last_undegraded":"2024-09-10T05:12:04.960717+0000","last_fullsized":"2024-09-10T05:12:04.960717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:30:18.685084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001329722,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:31.733033+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:31.732753+0000","last_became_peered":"2024-09-10T05:11:31.732753+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:51.417779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'88","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.264512+0000","last_change":"2024-09-10T05:11:33.744480+0000","last_active":"2024-09-10T05:13:34.264512+0000","last_peered":"2024-09-10T05:13:34.264512+0000","last_clean":"2024-09-10T05:13:34.264512+0000","last_became_active":"2024-09-10T05:11:33.744217+0000","last_became_peered":"2024-09-10T05:11:33.744217+0000","last_unstale":"2024-09-10T05:13:34.264512+0000","last_undegraded":"2024-09-10T05:13:34.264512+0000","last_fullsized":"2024-09-10T05:13:34.264512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:27.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957339+0000","last_change":"2024-09-10T05:11:35.748212+0000","last_active":"2024-09-10T05:12:04.957339+0000","last_peered":"2024-09-10T05:12:04.957339+0000","last_clean":"2024-09-10T05:12:04.957339+0000","last_became_active":"2024-09-10T05:11:35.747924+0000","last_became_peered":"2024-09-10T05:11:35.747924+0000","last_unstale":"2024-09-10T05:12:04.957339+0000","last_undegraded":"2024-09-10T05:12:04.957339+0000","last_fullsized":"2024-09-10T05:12:04.957339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:15.162433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961201+0000","last_change":"2024-09-10T05:11:37.758521+0000","last_active":"2024-09-10T05:12:04.961201+0000","last_peered":"2024-09-10T05:12:04.961201+0000","last_clean":"2024-09-10T05:12:04.961201+0000","last_became_active":"2024-09-10T05:11:37.757947+0000","last_became_peered":"2024-09-10T05:11:37.757947+0000","last_unstale":"2024-09-10T05:12:04.961201+0000","last_undegraded":"2024-09-10T05:12:04.961201+0000","last_fullsized":"2024-09-10T05:12:04.961201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:42.540458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:52.143036+0000","last_change":"2024-09-10T05:11:37.759509+0000","last_active":"2024-09-10T05:12:52.143036+0000","last_peered":"2024-09-10T05:12:52.143036+0000","last_clean":"2024-09-10T05:12:52.143036+0000","last_became_active":"2024-09-10T05:11:37.759217+0000","last_became_peered":"2024-09-10T05:11:37.759217+0000","last_unstale":"2024-09-10T05:12:52.143036+0000","last_undegraded":"2024-09-10T05:12:52.143036+0000","last_fullsized":"2024-09-10T05:12:52.143036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:30.264676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'12","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116908+0000","last_change":"2024-09-10T05:11:29.730421+0000","last_active":"2024-09-10T05:14:36.116908+0000","last_peered":"2024-09-10T05:14:36.116908+0000","last_clean":"2024-09-10T05:14:36.116908+0000","last_became_active":"2024-09-10T05:11:29.730105+0000","last_became_peered":"2024-09-10T05:11:29.730105+0000","last_unstale":"2024-09-10T05:14:36.116908+0000","last_undegraded":"2024-09-10T05:14:36.116908+0000","last_fullsized":"2024-09-10T05:14:36.116908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:52.776885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:50.916828+0000","last_change":"2024-09-10T05:11:27.732124+0000","last_active":"2024-09-10T05:13:50.916828+0000","last_peered":"2024-09-10T05:13:50.916828+0000","last_clean":"2024-09-10T05:13:50.916828+0000","last_became_active":"2024-09-10T05:11:27.731634+0000","last_became_peered":"2024-09-10T05:11:27.731634+0000","last_unstale":"2024-09-10T05:13:50.916828+0000","last_undegraded":"2024-09-10T05:13:50.916828+0000","last_fullsized":"2024-09-10T05:13:50.916828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:55.962255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.970384+0000","last_change":"2024-09-10T05:12:04.967896+0000","last_active":"2024-09-10T05:12:04.970384+0000","last_peered":"2024-09-10T05:12:04.970384+0000","last_clean":"2024-09-10T05:12:04.970384+0000","last_became_active":"2024-09-10T05:12:04.967513+0000","last_became_peered":"2024-09-10T05:12:04.967513+0000","last_unstale":"2024-09-10T05:12:04.970384+0000","last_undegraded":"2024-09-10T05:12:04.970384+0000","last_fullsized":"2024-09-10T05:12:04.970384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:00.790327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.680527+0000","last_change":"2024-09-10T05:11:33.745631+0000","last_active":"2024-09-10T05:13:35.680527+0000","last_peered":"2024-09-10T05:13:35.680527+0000","last_clean":"2024-09-10T05:13:35.680527+0000","last_became_active":"2024-09-10T05:11:33.745347+0000","last_became_peered":"2024-09-10T05:11:33.745347+0000","last_unstale":"2024-09-10T05:13:35.680527+0000","last_undegraded":"2024-09-10T05:13:35.680527+0000","last_fullsized":"2024-09-10T05:13:35.680527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:36.538308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954872+0000","last_change":"2024-09-10T05:11:35.754614+0000","last_active":"2024-09-10T05:12:04.954872+0000","last_peered":"2024-09-10T05:12:04.954872+0000","last_clean":"2024-09-10T05:12:04.954872+0000","last_became_active":"2024-09-10T05:11:35.754318+0000","last_became_peered":"2024-09-10T05:11:35.754318+0000","last_unstale":"2024-09-10T05:12:04.954872+0000","last_undegraded":"2024-09-10T05:12:04.954872+0000","last_fullsized":"2024-09-10T05:12:04.954872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:32.929275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:33.971128+0000","last_change":"2024-09-10T05:11:37.760662+0000","last_active":"2024-09-10T05:13:33.971128+0000","last_peered":"2024-09-10T05:13:33.971128+0000","last_clean":"2024-09-10T05:13:33.971128+0000","last_became_active":"2024-09-10T05:11:37.760471+0000","last_became_peered":"2024-09-10T05:11:37.760471+0000","last_unstale":"2024-09-10T05:13:33.971128+0000","last_undegraded":"2024-09-10T05:13:33.971128+0000","last_fullsized":"2024-09-10T05:13:33.971128+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:16.361621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.346649+0000","last_change":"2024-09-10T05:11:29.727844+0000","last_active":"2024-09-10T05:14:36.346649+0000","last_peered":"2024-09-10T05:14:36.346649+0000","last_clean":"2024-09-10T05:14:36.346649+0000","last_became_active":"2024-09-10T05:11:29.727550+0000","last_became_peered":"2024-09-10T05:11:29.727550+0000","last_unstale":"2024-09-10T05:14:36.346649+0000","last_undegraded":"2024-09-10T05:14:36.346649+0000","last_fullsized":"2024-09-10T05:14:36.346649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:05.037792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563704+0000","last_change":"2024-09-10T05:11:27.724954+0000","last_active":"2024-09-10T05:12:08.563704+0000","last_peered":"2024-09-10T05:12:08.563704+0000","last_clean":"2024-09-10T05:12:08.563704+0000","last_became_active":"2024-09-10T05:11:27.724637+0000","last_became_peered":"2024-09-10T05:11:27.724637+0000","last_unstale":"2024-09-10T05:12:08.563704+0000","last_undegraded":"2024-09-10T05:12:08.563704+0000","last_fullsized":"2024-09-10T05:12:08.563704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:06.669117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956587+0000","last_change":"2024-09-10T05:11:31.737152+0000","last_active":"2024-09-10T05:12:04.956587+0000","last_peered":"2024-09-10T05:12:04.956587+0000","last_clean":"2024-09-10T05:12:04.956587+0000","last_became_active":"2024-09-10T05:11:31.736758+0000","last_became_peered":"2024-09-10T05:11:31.736758+0000","last_unstale":"2024-09-10T05:12:04.956587+0000","last_undegraded":"2024-09-10T05:12:04.956587+0000","last_fullsized":"2024-09-10T05:12:04.956587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:07.236386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'6","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.711356+0000","last_change":"2024-09-10T05:11:33.742432+0000","last_active":"2024-09-10T05:14:35.711356+0000","last_peered":"2024-09-10T05:14:35.711356+0000","last_clean":"2024-09-10T05:14:35.711356+0000","last_became_active":"2024-09-10T05:11:33.742039+0000","last_became_peered":"2024-09-10T05:11:33.742039+0000","last_unstale":"2024-09-10T05:14:35.711356+0000","last_undegraded":"2024-09-10T05:14:35.711356+0000","last_fullsized":"2024-09-10T05:14:35.711356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:31.077478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956813+0000","last_change":"2024-09-10T05:11:35.751536+0000","last_active":"2024-09-10T05:12:04.956813+0000","last_peered":"2024-09-10T05:12:04.956813+0000","last_clean":"2024-09-10T05:12:04.956813+0000","last_became_active":"2024-09-10T05:11:35.751244+0000","last_became_peered":"2024-09-10T05:11:35.751244+0000","last_unstale":"2024-09-10T05:12:04.956813+0000","last_undegraded":"2024-09-10T05:12:04.956813+0000","last_fullsized":"2024-09-10T05:12:04.956813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.673711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.676093+0000","last_change":"2024-09-10T05:11:37.755735+0000","last_active":"2024-09-10T05:13:35.676093+0000","last_peered":"2024-09-10T05:13:35.676093+0000","last_clean":"2024-09-10T05:13:35.676093+0000","last_became_active":"2024-09-10T05:11:37.755533+0000","last_became_peered":"2024-09-10T05:11:37.755533+0000","last_unstale":"2024-09-10T05:13:35.676093+0000","last_undegraded":"2024-09-10T05:13:35.676093+0000","last_fullsized":"2024-09-10T05:13:35.676093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:37.895455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604904+0000","last_change":"2024-09-10T05:11:29.727735+0000","last_active":"2024-09-10T05:13:32.604904+0000","last_peered":"2024-09-10T05:13:32.604904+0000","last_clean":"2024-09-10T05:13:32.604904+0000","last_became_active":"2024-09-10T05:11:29.727400+0000","last_became_peered":"2024-09-10T05:11:29.727400+0000","last_unstale":"2024-09-10T05:13:32.604904+0000","last_undegraded":"2024-09-10T05:13:32.604904+0000","last_fullsized":"2024-09-10T05:13:32.604904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:52.691912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.328244+0000","last_change":"2024-09-10T05:11:27.728450+0000","last_active":"2024-09-10T05:14:36.328244+0000","last_peered":"2024-09-10T05:14:36.328244+0000","last_clean":"2024-09-10T05:14:36.328244+0000","last_became_active":"2024-09-10T05:11:27.727561+0000","last_became_peered":"2024-09-10T05:11:27.727561+0000","last_unstale":"2024-09-10T05:14:36.328244+0000","last_undegraded":"2024-09-10T05:14:36.328244+0000","last_fullsized":"2024-09-10T05:14:36.328244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:09.173780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"28'1","reported_seq":219,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.322927+0000","last_change":"2024-09-10T05:11:31.734288+0000","last_active":"2024-09-10T05:13:35.322927+0000","last_peered":"2024-09-10T05:13:35.322927+0000","last_clean":"2024-09-10T05:13:35.322927+0000","last_became_active":"2024-09-10T05:11:31.733793+0000","last_became_peered":"2024-09-10T05:11:31.733793+0000","last_unstale":"2024-09-10T05:13:35.322927+0000","last_undegraded":"2024-09-10T05:13:35.322927+0000","last_fullsized":"2024-09-10T05:13:35.322927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:15.305550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'42","reported_seq":102,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.349250+0000","last_change":"2024-09-10T05:11:33.744948+0000","last_active":"2024-09-10T05:14:36.349250+0000","last_peered":"2024-09-10T05:14:36.349250+0000","last_clean":"2024-09-10T05:14:36.349250+0000","last_became_active":"2024-09-10T05:11:33.744634+0000","last_became_peered":"2024-09-10T05:11:33.744634+0000","last_unstale":"2024-09-10T05:14:36.349250+0000","last_undegraded":"2024-09-10T05:14:36.349250+0000","last_fullsized":"2024-09-10T05:14:36.349250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:09.908383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959076+0000","last_change":"2024-09-10T05:11:35.748666+0000","last_active":"2024-09-10T05:12:04.959076+0000","last_peered":"2024-09-10T05:12:04.959076+0000","last_clean":"2024-09-10T05:12:04.959076+0000","last_became_active":"2024-09-10T05:11:35.748406+0000","last_became_peered":"2024-09-10T05:11:35.748406+0000","last_unstale":"2024-09-10T05:12:04.959076+0000","last_undegraded":"2024-09-10T05:12:04.959076+0000","last_fullsized":"2024-09-10T05:12:04.959076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:01.833099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.370496+0000","last_change":"2024-09-10T05:11:37.765627+0000","last_active":"2024-09-10T05:14:36.370496+0000","last_peered":"2024-09-10T05:14:36.370496+0000","last_clean":"2024-09-10T05:14:36.370496+0000","last_became_active":"2024-09-10T05:11:37.765188+0000","last_became_peered":"2024-09-10T05:11:37.765188+0000","last_unstale":"2024-09-10T05:14:36.370496+0000","last_undegraded":"2024-09-10T05:14:36.370496+0000","last_fullsized":"2024-09-10T05:14:36.370496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:35.729959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954466+0000","last_change":"2024-09-10T05:11:29.736060+0000","last_active":"2024-09-10T05:12:04.954466+0000","last_peered":"2024-09-10T05:12:04.954466+0000","last_clean":"2024-09-10T05:12:04.954466+0000","last_became_active":"2024-09-10T05:11:29.735101+0000","last_became_peered":"2024-09-10T05:11:29.735101+0000","last_unstale":"2024-09-10T05:12:04.954466+0000","last_undegraded":"2024-09-10T05:12:04.954466+0000","last_fullsized":"2024-09-10T05:12:04.954466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:46.282001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962997+0000","last_change":"2024-09-10T05:11:27.716910+0000","last_active":"2024-09-10T05:12:04.962997+0000","last_peered":"2024-09-10T05:12:04.962997+0000","last_clean":"2024-09-10T05:12:04.962997+0000","last_became_active":"2024-09-10T05:11:27.715729+0000","last_became_peered":"2024-09-10T05:11:27.715729+0000","last_unstale":"2024-09-10T05:12:04.962997+0000","last_undegraded":"2024-09-10T05:12:04.962997+0000","last_fullsized":"2024-09-10T05:12:04.962997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:34.486986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954515+0000","last_change":"2024-09-10T05:11:31.732767+0000","last_active":"2024-09-10T05:12:04.954515+0000","last_peered":"2024-09-10T05:12:04.954515+0000","last_clean":"2024-09-10T05:12:04.954515+0000","last_became_active":"2024-09-10T05:11:31.732476+0000","last_became_peered":"2024-09-10T05:11:31.732476+0000","last_unstale":"2024-09-10T05:12:04.954515+0000","last_undegraded":"2024-09-10T05:12:04.954515+0000","last_fullsized":"2024-09-10T05:12:04.954515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:22.178149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'31","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.255150+0000","last_change":"2024-09-10T05:11:33.742425+0000","last_active":"2024-09-10T05:13:34.255150+0000","last_peered":"2024-09-10T05:13:34.255150+0000","last_clean":"2024-09-10T05:13:34.255150+0000","last_became_active":"2024-09-10T05:11:33.740483+0000","last_became_peered":"2024-09-10T05:11:33.740483+0000","last_unstale":"2024-09-10T05:13:34.255150+0000","last_undegraded":"2024-09-10T05:13:34.255150+0000","last_fullsized":"2024-09-10T05:13:34.255150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:21.633618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960060+0000","last_change":"2024-09-10T05:11:35.746206+0000","last_active":"2024-09-10T05:12:04.960060+0000","last_peered":"2024-09-10T05:12:04.960060+0000","last_clean":"2024-09-10T05:12:04.960060+0000","last_became_active":"2024-09-10T05:11:35.745886+0000","last_became_peered":"2024-09-10T05:11:35.745886+0000","last_unstale":"2024-09-10T05:12:04.960060+0000","last_undegraded":"2024-09-10T05:12:04.960060+0000","last_fullsized":"2024-09-10T05:12:04.960060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:38.963303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.109858+0000","last_change":"2024-09-10T05:11:29.732079+0000","last_active":"2024-09-10T05:14:36.109858+0000","last_peered":"2024-09-10T05:14:36.109858+0000","last_clean":"2024-09-10T05:14:36.109858+0000","last_became_active":"2024-09-10T05:11:29.731824+0000","last_became_peered":"2024-09-10T05:11:29.731824+0000","last_unstale":"2024-09-10T05:14:36.109858+0000","last_undegraded":"2024-09-10T05:14:36.109858+0000","last_fullsized":"2024-09-10T05:14:36.109858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:53.060402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954430+0000","last_change":"2024-09-10T05:11:27.735230+0000","last_active":"2024-09-10T05:12:04.954430+0000","last_peered":"2024-09-10T05:12:04.954430+0000","last_clean":"2024-09-10T05:12:04.954430+0000","last_became_active":"2024-09-10T05:11:27.734652+0000","last_became_peered":"2024-09-10T05:11:27.734652+0000","last_unstale":"2024-09-10T05:12:04.954430+0000","last_undegraded":"2024-09-10T05:12:04.954430+0000","last_fullsized":"2024-09-10T05:12:04.954430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:41.386631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959243+0000","last_change":"2024-09-10T05:11:31.735122+0000","last_active":"2024-09-10T05:12:04.959243+0000","last_peered":"2024-09-10T05:12:04.959243+0000","last_clean":"2024-09-10T05:12:04.959243+0000","last_became_active":"2024-09-10T05:11:31.734774+0000","last_became_peered":"2024-09-10T05:11:31.734774+0000","last_unstale":"2024-09-10T05:12:04.959243+0000","last_undegraded":"2024-09-10T05:12:04.959243+0000","last_fullsized":"2024-09-10T05:12:04.959243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:38.074776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'60","reported_seq":123,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.276849+0000","last_change":"2024-09-10T05:11:33.741409+0000","last_active":"2024-09-10T05:13:34.276849+0000","last_peered":"2024-09-10T05:13:34.276849+0000","last_clean":"2024-09-10T05:13:34.276849+0000","last_became_active":"2024-09-10T05:11:33.741136+0000","last_became_peered":"2024-09-10T05:11:33.741136+0000","last_unstale":"2024-09-10T05:13:34.276849+0000","last_undegraded":"2024-09-10T05:13:34.276849+0000","last_fullsized":"2024-09-10T05:13:34.276849+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:48.815209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958544+0000","last_change":"2024-09-10T05:11:35.746094+0000","last_active":"2024-09-10T05:12:04.958544+0000","last_peered":"2024-09-10T05:12:04.958544+0000","last_clean":"2024-09-10T05:12:04.958544+0000","last_became_active":"2024-09-10T05:11:35.745795+0000","last_became_peered":"2024-09-10T05:11:35.745795+0000","last_unstale":"2024-09-10T05:12:04.958544+0000","last_undegraded":"2024-09-10T05:12:04.958544+0000","last_fullsized":"2024-09-10T05:12:04.958544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:43.698313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.609239+0000","last_change":"2024-09-10T05:11:37.758689+0000","last_active":"2024-09-10T05:13:35.609239+0000","last_peered":"2024-09-10T05:13:35.609239+0000","last_clean":"2024-09-10T05:13:35.609239+0000","last_became_active":"2024-09-10T05:11:37.758360+0000","last_became_peered":"2024-09-10T05:11:37.758360+0000","last_unstale":"2024-09-10T05:13:35.609239+0000","last_undegraded":"2024-09-10T05:13:35.609239+0000","last_fullsized":"2024-09-10T05:13:35.609239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:10.895588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'9","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.423853+0000","last_change":"2024-09-10T05:11:29.725587+0000","last_active":"2024-09-10T05:14:36.423853+0000","last_peered":"2024-09-10T05:14:36.423853+0000","last_clean":"2024-09-10T05:14:36.423853+0000","last_became_active":"2024-09-10T05:11:29.723722+0000","last_became_peered":"2024-09-10T05:11:29.723722+0000","last_unstale":"2024-09-10T05:14:36.423853+0000","last_undegraded":"2024-09-10T05:14:36.423853+0000","last_fullsized":"2024-09-10T05:14:36.423853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:27.494677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957932+0000","last_change":"2024-09-10T05:11:27.728290+0000","last_active":"2024-09-10T05:12:04.957932+0000","last_peered":"2024-09-10T05:12:04.957932+0000","last_clean":"2024-09-10T05:12:04.957932+0000","last_became_active":"2024-09-10T05:11:27.727770+0000","last_became_peered":"2024-09-10T05:11:27.727770+0000","last_unstale":"2024-09-10T05:12:04.957932+0000","last_undegraded":"2024-09-10T05:12:04.957932+0000","last_fullsized":"2024-09-10T05:12:04.957932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:49.547692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962377+0000","last_change":"2024-09-10T05:11:31.728930+0000","last_active":"2024-09-10T05:12:04.962377+0000","last_peered":"2024-09-10T05:12:04.962377+0000","last_clean":"2024-09-10T05:12:04.962377+0000","last_became_active":"2024-09-10T05:11:31.728653+0000","last_became_peered":"2024-09-10T05:11:31.728653+0000","last_unstale":"2024-09-10T05:12:04.962377+0000","last_undegraded":"2024-09-10T05:12:04.962377+0000","last_fullsized":"2024-09-10T05:12:04.962377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:11:50.575895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.256106+0000","last_change":"2024-09-10T05:11:33.743527+0000","last_active":"2024-09-10T05:13:34.256106+0000","last_peered":"2024-09-10T05:13:34.256106+0000","last_clean":"2024-09-10T05:13:34.256106+0000","last_became_active":"2024-09-10T05:11:33.743048+0000","last_became_peered":"2024-09-10T05:11:33.743048+0000","last_unstale":"2024-09-10T05:13:34.256106+0000","last_undegraded":"2024-09-10T05:13:34.256106+0000","last_fullsized":"2024-09-10T05:13:34.256106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:52:59.505330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960230+0000","last_change":"2024-09-10T05:11:35.753237+0000","last_active":"2024-09-10T05:12:04.960230+0000","last_peered":"2024-09-10T05:12:04.960230+0000","last_clean":"2024-09-10T05:12:04.960230+0000","last_became_active":"2024-09-10T05:11:35.752971+0000","last_became_peered":"2024-09-10T05:11:35.752971+0000","last_unstale":"2024-09-10T05:12:04.960230+0000","last_undegraded":"2024-09-10T05:12:04.960230+0000","last_fullsized":"2024-09-10T05:12:04.960230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:16.416535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954464+0000","last_change":"2024-09-10T05:11:37.768354+0000","last_active":"2024-09-10T05:12:04.954464+0000","last_peered":"2024-09-10T05:12:04.954464+0000","last_clean":"2024-09-10T05:12:04.954464+0000","last_became_active":"2024-09-10T05:11:37.768036+0000","last_became_peered":"2024-09-10T05:11:37.768036+0000","last_unstale":"2024-09-10T05:12:04.954464+0000","last_undegraded":"2024-09-10T05:12:04.954464+0000","last_fullsized":"2024-09-10T05:12:04.954464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:28.716788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'3","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.210570+0000","last_change":"2024-09-10T05:11:29.735292+0000","last_active":"2024-09-10T05:14:36.210570+0000","last_peered":"2024-09-10T05:14:36.210570+0000","last_clean":"2024-09-10T05:14:36.210570+0000","last_became_active":"2024-09-10T05:11:29.734714+0000","last_became_peered":"2024-09-10T05:11:29.734714+0000","last_unstale":"2024-09-10T05:14:36.210570+0000","last_undegraded":"2024-09-10T05:14:36.210570+0000","last_fullsized":"2024-09-10T05:14:36.210570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:28.419157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.564082+0000","last_change":"2024-09-10T05:11:27.718573+0000","last_active":"2024-09-10T05:12:08.564082+0000","last_peered":"2024-09-10T05:12:08.564082+0000","last_clean":"2024-09-10T05:12:08.564082+0000","last_became_active":"2024-09-10T05:11:27.718251+0000","last_became_peered":"2024-09-10T05:11:27.718251+0000","last_unstale":"2024-09-10T05:12:08.564082+0000","last_undegraded":"2024-09-10T05:12:08.564082+0000","last_fullsized":"2024-09-10T05:12:08.564082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:05.213355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958875+0000","last_change":"2024-09-10T05:11:31.728291+0000","last_active":"2024-09-10T05:12:04.958875+0000","last_peered":"2024-09-10T05:12:04.958875+0000","last_clean":"2024-09-10T05:12:04.958875+0000","last_became_active":"2024-09-10T05:11:31.727998+0000","last_became_peered":"2024-09-10T05:11:31.727998+0000","last_unstale":"2024-09-10T05:12:04.958875+0000","last_undegraded":"2024-09-10T05:12:04.958875+0000","last_fullsized":"2024-09-10T05:12:04.958875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:33.243917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'38","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.274731+0000","last_change":"2024-09-10T05:11:33.742831+0000","last_active":"2024-09-10T05:13:34.274731+0000","last_peered":"2024-09-10T05:13:34.274731+0000","last_clean":"2024-09-10T05:13:34.274731+0000","last_became_active":"2024-09-10T05:11:33.742594+0000","last_became_peered":"2024-09-10T05:11:33.742594+0000","last_unstale":"2024-09-10T05:13:34.274731+0000","last_undegraded":"2024-09-10T05:13:34.274731+0000","last_fullsized":"2024-09-10T05:13:34.274731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:54.003296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957834+0000","last_change":"2024-09-10T05:11:35.748750+0000","last_active":"2024-09-10T05:12:04.957834+0000","last_peered":"2024-09-10T05:12:04.957834+0000","last_clean":"2024-09-10T05:12:04.957834+0000","last_became_active":"2024-09-10T05:11:35.748464+0000","last_became_peered":"2024-09-10T05:11:35.748464+0000","last_unstale":"2024-09-10T05:12:04.957834+0000","last_undegraded":"2024-09-10T05:12:04.957834+0000","last_fullsized":"2024-09-10T05:12:04.957834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:02:44.003459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.674549+0000","last_change":"2024-09-10T05:11:37.768552+0000","last_active":"2024-09-10T05:13:35.674549+0000","last_peered":"2024-09-10T05:13:35.674549+0000","last_clean":"2024-09-10T05:13:35.674549+0000","last_became_active":"2024-09-10T05:11:37.768248+0000","last_became_peered":"2024-09-10T05:11:37.768248+0000","last_unstale":"2024-09-10T05:13:35.674549+0000","last_undegraded":"2024-09-10T05:13:35.674549+0000","last_fullsized":"2024-09-10T05:13:35.674549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:47.039216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.109389+0000","last_change":"2024-09-10T05:11:29.727709+0000","last_active":"2024-09-10T05:14:36.109389+0000","last_peered":"2024-09-10T05:14:36.109389+0000","last_clean":"2024-09-10T05:14:36.109389+0000","last_became_active":"2024-09-10T05:11:29.727038+0000","last_became_peered":"2024-09-10T05:11:29.727038+0000","last_unstale":"2024-09-10T05:14:36.109389+0000","last_undegraded":"2024-09-10T05:14:36.109389+0000","last_fullsized":"2024-09-10T05:14:36.109389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.472157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:52.134013+0000","last_change":"2024-09-10T05:11:27.734905+0000","last_active":"2024-09-10T05:12:52.134013+0000","last_peered":"2024-09-10T05:12:52.134013+0000","last_clean":"2024-09-10T05:12:52.134013+0000","last_became_active":"2024-09-10T05:11:27.733320+0000","last_became_peered":"2024-09-10T05:11:27.733320+0000","last_unstale":"2024-09-10T05:12:52.134013+0000","last_undegraded":"2024-09-10T05:12:52.134013+0000","last_fullsized":"2024-09-10T05:12:52.134013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:27.826216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961436+0000","last_change":"2024-09-10T05:11:31.734989+0000","last_active":"2024-09-10T05:12:04.961436+0000","last_peered":"2024-09-10T05:12:04.961436+0000","last_clean":"2024-09-10T05:12:04.961436+0000","last_became_active":"2024-09-10T05:11:31.734684+0000","last_became_peered":"2024-09-10T05:11:31.734684+0000","last_unstale":"2024-09-10T05:12:04.961436+0000","last_undegraded":"2024-09-10T05:12:04.961436+0000","last_fullsized":"2024-09-10T05:12:04.961436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:16.215982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962397+0000","last_change":"2024-09-10T05:11:33.748823+0000","last_active":"2024-09-10T05:12:04.962397+0000","last_peered":"2024-09-10T05:12:04.962397+0000","last_clean":"2024-09-10T05:12:04.962397+0000","last_became_active":"2024-09-10T05:11:33.748547+0000","last_became_peered":"2024-09-10T05:11:33.748547+0000","last_unstale":"2024-09-10T05:12:04.962397+0000","last_undegraded":"2024-09-10T05:12:04.962397+0000","last_fullsized":"2024-09-10T05:12:04.962397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:00.711618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'282","reported_seq":366,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813472+0000","last_change":"2024-09-10T05:11:35.751082+0000","last_active":"2024-09-10T05:14:31.813472+0000","last_peered":"2024-09-10T05:14:31.813472+0000","last_clean":"2024-09-10T05:14:31.813472+0000","last_became_active":"2024-09-10T05:11:35.750761+0000","last_became_peered":"2024-09-10T05:11:35.750761+0000","last_unstale":"2024-09-10T05:14:31.813472+0000","last_undegraded":"2024-09-10T05:14:31.813472+0000","last_fullsized":"2024-09-10T05:14:31.813472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:35.877712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954021+0000","last_change":"2024-09-10T05:11:37.768088+0000","last_active":"2024-09-10T05:12:04.954021+0000","last_peered":"2024-09-10T05:12:04.954021+0000","last_clean":"2024-09-10T05:12:04.954021+0000","last_became_active":"2024-09-10T05:11:37.767816+0000","last_became_peered":"2024-09-10T05:11:37.767816+0000","last_unstale":"2024-09-10T05:12:04.954021+0000","last_undegraded":"2024-09-10T05:12:04.954021+0000","last_fullsized":"2024-09-10T05:12:04.954021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:32.684488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'5","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:00.917755+0000","last_change":"2024-09-10T05:11:29.720521+0000","last_active":"2024-09-10T05:14:00.917755+0000","last_peered":"2024-09-10T05:14:00.917755+0000","last_clean":"2024-09-10T05:14:00.917755+0000","last_became_active":"2024-09-10T05:11:29.720243+0000","last_became_peered":"2024-09-10T05:11:29.720243+0000","last_unstale":"2024-09-10T05:14:00.917755+0000","last_undegraded":"2024-09-10T05:14:00.917755+0000","last_fullsized":"2024-09-10T05:14:00.917755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:46.844060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960785+0000","last_change":"2024-09-10T05:11:27.723954+0000","last_active":"2024-09-10T05:12:04.960785+0000","last_peered":"2024-09-10T05:12:04.960785+0000","last_clean":"2024-09-10T05:12:04.960785+0000","last_became_active":"2024-09-10T05:11:27.723630+0000","last_became_peered":"2024-09-10T05:11:27.723630+0000","last_unstale":"2024-09-10T05:12:04.960785+0000","last_undegraded":"2024-09-10T05:12:04.960785+0000","last_fullsized":"2024-09-10T05:12:04.960785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:03.159929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961835+0000","last_change":"2024-09-10T05:11:31.737893+0000","last_active":"2024-09-10T05:12:04.961835+0000","last_peered":"2024-09-10T05:12:04.961835+0000","last_clean":"2024-09-10T05:12:04.961835+0000","last_became_active":"2024-09-10T05:11:31.737547+0000","last_became_peered":"2024-09-10T05:11:31.737547+0000","last_unstale":"2024-09-10T05:12:04.961835+0000","last_undegraded":"2024-09-10T05:12:04.961835+0000","last_fullsized":"2024-09-10T05:12:04.961835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:48.181735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'60","reported_seq":130,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.246813+0000","last_change":"2024-09-10T05:11:33.740808+0000","last_active":"2024-09-10T05:13:34.246813+0000","last_peered":"2024-09-10T05:13:34.246813+0000","last_clean":"2024-09-10T05:13:34.246813+0000","last_became_active":"2024-09-10T05:11:33.740489+0000","last_became_peered":"2024-09-10T05:11:33.740489+0000","last_unstale":"2024-09-10T05:13:34.246813+0000","last_undegraded":"2024-09-10T05:13:34.246813+0000","last_fullsized":"2024-09-10T05:13:34.246813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:04.031528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956220+0000","last_change":"2024-09-10T05:11:35.754168+0000","last_active":"2024-09-10T05:12:04.956220+0000","last_peered":"2024-09-10T05:12:04.956220+0000","last_clean":"2024-09-10T05:12:04.956220+0000","last_became_active":"2024-09-10T05:11:35.753856+0000","last_became_peered":"2024-09-10T05:11:35.753856+0000","last_unstale":"2024-09-10T05:12:04.956220+0000","last_undegraded":"2024-09-10T05:12:04.956220+0000","last_fullsized":"2024-09-10T05:12:04.956220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:03.169802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.439500+0000","last_change":"2024-09-10T05:11:37.758619+0000","last_active":"2024-09-10T05:12:09.439500+0000","last_peered":"2024-09-10T05:12:09.439500+0000","last_clean":"2024-09-10T05:12:09.439500+0000","last_became_active":"2024-09-10T05:11:37.758332+0000","last_became_peered":"2024-09-10T05:11:37.758332+0000","last_unstale":"2024-09-10T05:12:09.439500+0000","last_undegraded":"2024-09-10T05:12:09.439500+0000","last_fullsized":"2024-09-10T05:12:09.439500+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:34:24.838165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.678085+0000","last_change":"2024-09-10T05:11:29.722215+0000","last_active":"2024-09-10T05:13:35.678085+0000","last_peered":"2024-09-10T05:13:35.678085+0000","last_clean":"2024-09-10T05:13:35.678085+0000","last_became_active":"2024-09-10T05:11:29.721899+0000","last_became_peered":"2024-09-10T05:11:29.721899+0000","last_unstale":"2024-09-10T05:13:35.678085+0000","last_undegraded":"2024-09-10T05:13:35.678085+0000","last_fullsized":"2024-09-10T05:13:35.678085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:49.705056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957373+0000","last_change":"2024-09-10T05:11:27.733809+0000","last_active":"2024-09-10T05:12:04.957373+0000","last_peered":"2024-09-10T05:12:04.957373+0000","last_clean":"2024-09-10T05:12:04.957373+0000","last_became_active":"2024-09-10T05:11:27.733451+0000","last_became_peered":"2024-09-10T05:11:27.733451+0000","last_unstale":"2024-09-10T05:12:04.957373+0000","last_undegraded":"2024-09-10T05:12:04.957373+0000","last_fullsized":"2024-09-10T05:12:04.957373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:50.768933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961145+0000","last_change":"2024-09-10T05:11:31.736009+0000","last_active":"2024-09-10T05:12:04.961145+0000","last_peered":"2024-09-10T05:12:04.961145+0000","last_clean":"2024-09-10T05:12:04.961145+0000","last_became_active":"2024-09-10T05:11:31.735565+0000","last_became_peered":"2024-09-10T05:11:31.735565+0000","last_unstale":"2024-09-10T05:12:04.961145+0000","last_undegraded":"2024-09-10T05:12:04.961145+0000","last_fullsized":"2024-09-10T05:12:04.961145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:10.523091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'36","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.247976+0000","last_change":"2024-09-10T05:11:33.742997+0000","last_active":"2024-09-10T05:13:34.247976+0000","last_peered":"2024-09-10T05:13:34.247976+0000","last_clean":"2024-09-10T05:13:34.247976+0000","last_became_active":"2024-09-10T05:11:33.742656+0000","last_became_peered":"2024-09-10T05:11:33.742656+0000","last_unstale":"2024-09-10T05:13:34.247976+0000","last_undegraded":"2024-09-10T05:13:34.247976+0000","last_fullsized":"2024-09-10T05:13:34.247976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:28.611407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954236+0000","last_change":"2024-09-10T05:11:35.751391+0000","last_active":"2024-09-10T05:12:04.954236+0000","last_peered":"2024-09-10T05:12:04.954236+0000","last_clean":"2024-09-10T05:12:04.954236+0000","last_became_active":"2024-09-10T05:11:35.750960+0000","last_became_peered":"2024-09-10T05:11:35.750960+0000","last_unstale":"2024-09-10T05:12:04.954236+0000","last_undegraded":"2024-09-10T05:12:04.954236+0000","last_fullsized":"2024-09-10T05:12:04.954236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:07.690221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.959775+0000","last_change":"2024-09-10T05:11:37.768897+0000","last_active":"2024-09-10T05:12:51.959775+0000","last_peered":"2024-09-10T05:12:51.959775+0000","last_clean":"2024-09-10T05:12:51.959775+0000","last_became_active":"2024-09-10T05:11:37.768559+0000","last_became_peered":"2024-09-10T05:11:37.768559+0000","last_unstale":"2024-09-10T05:12:51.959775+0000","last_undegraded":"2024-09-10T05:12:51.959775+0000","last_fullsized":"2024-09-10T05:12:51.959775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:41.676922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'5","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.207817+0000","last_change":"2024-09-10T05:11:29.735124+0000","last_active":"2024-09-10T05:14:36.207817+0000","last_peered":"2024-09-10T05:14:36.207817+0000","last_clean":"2024-09-10T05:14:36.207817+0000","last_became_active":"2024-09-10T05:11:29.732703+0000","last_became_peered":"2024-09-10T05:11:29.732703+0000","last_unstale":"2024-09-10T05:14:36.207817+0000","last_undegraded":"2024-09-10T05:14:36.207817+0000","last_fullsized":"2024-09-10T05:14:36.207817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:46.587126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563575+0000","last_change":"2024-09-10T05:11:27.714395+0000","last_active":"2024-09-10T05:12:08.563575+0000","last_peered":"2024-09-10T05:12:08.563575+0000","last_clean":"2024-09-10T05:12:08.563575+0000","last_became_active":"2024-09-10T05:11:27.713416+0000","last_became_peered":"2024-09-10T05:11:27.713416+0000","last_unstale":"2024-09-10T05:12:08.563575+0000","last_undegraded":"2024-09-10T05:12:08.563575+0000","last_fullsized":"2024-09-10T05:12:08.563575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:50.330893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958275+0000","last_change":"2024-09-10T05:11:31.736882+0000","last_active":"2024-09-10T05:12:04.958275+0000","last_peered":"2024-09-10T05:12:04.958275+0000","last_clean":"2024-09-10T05:12:04.958275+0000","last_became_active":"2024-09-10T05:11:31.736540+0000","last_became_peered":"2024-09-10T05:11:31.736540+0000","last_unstale":"2024-09-10T05:12:04.958275+0000","last_undegraded":"2024-09-10T05:12:04.958275+0000","last_fullsized":"2024-09-10T05:12:04.958275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:34.452648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.272847+0000","last_change":"2024-09-10T05:11:33.743575+0000","last_active":"2024-09-10T05:13:34.272847+0000","last_peered":"2024-09-10T05:13:34.272847+0000","last_clean":"2024-09-10T05:13:34.272847+0000","last_became_active":"2024-09-10T05:11:33.743207+0000","last_became_peered":"2024-09-10T05:11:33.743207+0000","last_unstale":"2024-09-10T05:13:34.272847+0000","last_undegraded":"2024-09-10T05:13:34.272847+0000","last_fullsized":"2024-09-10T05:13:34.272847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:19.732970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:35.753328+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:35.753001+0000","last_became_peered":"2024-09-10T05:11:35.753001+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:19.217985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.480743+0000","last_change":"2024-09-10T05:11:37.767945+0000","last_active":"2024-09-10T05:14:36.480743+0000","last_peered":"2024-09-10T05:14:36.480743+0000","last_clean":"2024-09-10T05:14:36.480743+0000","last_became_active":"2024-09-10T05:11:37.767649+0000","last_became_peered":"2024-09-10T05:11:37.767649+0000","last_unstale":"2024-09-10T05:14:36.480743+0000","last_undegraded":"2024-09-10T05:14:36.480743+0000","last_fullsized":"2024-09-10T05:14:36.480743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:47.436935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'4","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382235+0000","last_change":"2024-09-10T05:11:29.718957+0000","last_active":"2024-09-10T05:14:36.382235+0000","last_peered":"2024-09-10T05:14:36.382235+0000","last_clean":"2024-09-10T05:14:36.382235+0000","last_became_active":"2024-09-10T05:11:29.718689+0000","last_became_peered":"2024-09-10T05:11:29.718689+0000","last_unstale":"2024-09-10T05:14:36.382235+0000","last_undegraded":"2024-09-10T05:14:36.382235+0000","last_fullsized":"2024-09-10T05:14:36.382235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.549609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963087+0000","last_change":"2024-09-10T05:11:27.716440+0000","last_active":"2024-09-10T05:12:04.963087+0000","last_peered":"2024-09-10T05:12:04.963087+0000","last_clean":"2024-09-10T05:12:04.963087+0000","last_became_active":"2024-09-10T05:11:27.716073+0000","last_became_peered":"2024-09-10T05:11:27.716073+0000","last_unstale":"2024-09-10T05:12:04.963087+0000","last_undegraded":"2024-09-10T05:12:04.963087+0000","last_fullsized":"2024-09-10T05:12:04.963087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:12:23.620289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'2","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.968798+0000","last_change":"2024-09-10T05:11:31.736020+0000","last_active":"2024-09-10T05:13:32.968798+0000","last_peered":"2024-09-10T05:13:32.968798+0000","last_clean":"2024-09-10T05:13:32.968798+0000","last_became_active":"2024-09-10T05:11:31.735726+0000","last_became_peered":"2024-09-10T05:11:31.735726+0000","last_unstale":"2024-09-10T05:13:32.968798+0000","last_undegraded":"2024-09-10T05:13:32.968798+0000","last_fullsized":"2024-09-10T05:13:32.968798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:49.251341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'44","reported_seq":101,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.696786+0000","last_change":"2024-09-10T05:11:33.748407+0000","last_active":"2024-09-10T05:14:35.696786+0000","last_peered":"2024-09-10T05:14:35.696786+0000","last_clean":"2024-09-10T05:14:35.696786+0000","last_became_active":"2024-09-10T05:11:33.748120+0000","last_became_peered":"2024-09-10T05:11:33.748120+0000","last_unstale":"2024-09-10T05:14:35.696786+0000","last_undegraded":"2024-09-10T05:14:35.696786+0000","last_fullsized":"2024-09-10T05:14:35.696786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:46:20.643301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956794+0000","last_change":"2024-09-10T05:11:35.753972+0000","last_active":"2024-09-10T05:12:04.956794+0000","last_peered":"2024-09-10T05:12:04.956794+0000","last_clean":"2024-09-10T05:12:04.956794+0000","last_became_active":"2024-09-10T05:11:35.753437+0000","last_became_peered":"2024-09-10T05:11:35.753437+0000","last_unstale":"2024-09-10T05:12:04.956794+0000","last_undegraded":"2024-09-10T05:12:04.956794+0000","last_fullsized":"2024-09-10T05:12:04.956794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:06.887746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'10","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.285208+0000","last_change":"2024-09-10T05:11:37.765397+0000","last_active":"2024-09-10T05:13:34.285208+0000","last_peered":"2024-09-10T05:13:34.285208+0000","last_clean":"2024-09-10T05:13:34.285208+0000","last_became_active":"2024-09-10T05:11:37.765102+0000","last_became_peered":"2024-09-10T05:11:37.765102+0000","last_unstale":"2024-09-10T05:13:34.285208+0000","last_undegraded":"2024-09-10T05:13:34.285208+0000","last_fullsized":"2024-09-10T05:13:34.285208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:41.297084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":67,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'7","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914653+0000","last_change":"2024-09-10T05:11:29.729956+0000","last_active":"2024-09-10T05:13:40.914653+0000","last_peered":"2024-09-10T05:13:40.914653+0000","last_clean":"2024-09-10T05:13:40.914653+0000","last_became_active":"2024-09-10T05:11:29.729468+0000","last_became_peered":"2024-09-10T05:11:29.729468+0000","last_unstale":"2024-09-10T05:13:40.914653+0000","last_undegraded":"2024-09-10T05:13:40.914653+0000","last_fullsized":"2024-09-10T05:13:40.914653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:28.277156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956207+0000","last_change":"2024-09-10T05:11:27.706911+0000","last_active":"2024-09-10T05:12:04.956207+0000","last_peered":"2024-09-10T05:12:04.956207+0000","last_clean":"2024-09-10T05:12:04.956207+0000","last_became_active":"2024-09-10T05:11:27.706484+0000","last_became_peered":"2024-09-10T05:11:27.706484+0000","last_unstale":"2024-09-10T05:12:04.956207+0000","last_undegraded":"2024-09-10T05:12:04.956207+0000","last_fullsized":"2024-09-10T05:12:04.956207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:43.266234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'11","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:38.908717+0000","last_change":"2024-09-10T05:11:29.729314+0000","last_active":"2024-09-10T05:13:38.908717+0000","last_peered":"2024-09-10T05:13:38.908717+0000","last_clean":"2024-09-10T05:13:38.908717+0000","last_became_active":"2024-09-10T05:11:29.729019+0000","last_became_peered":"2024-09-10T05:11:29.729019+0000","last_unstale":"2024-09-10T05:13:38.908717+0000","last_undegraded":"2024-09-10T05:13:38.908717+0000","last_fullsized":"2024-09-10T05:13:38.908717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:42.589634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563597+0000","last_change":"2024-09-10T05:11:27.715436+0000","last_active":"2024-09-10T05:12:08.563597+0000","last_peered":"2024-09-10T05:12:08.563597+0000","last_clean":"2024-09-10T05:12:08.563597+0000","last_became_active":"2024-09-10T05:11:27.714487+0000","last_became_peered":"2024-09-10T05:11:27.714487+0000","last_unstale":"2024-09-10T05:12:08.563597+0000","last_undegraded":"2024-09-10T05:12:08.563597+0000","last_fullsized":"2024-09-10T05:12:08.563597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:29:45.038701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'2","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.666946+0000","last_change":"2024-09-10T05:11:29.729634+0000","last_active":"2024-09-10T05:12:09.666946+0000","last_peered":"2024-09-10T05:12:09.666946+0000","last_clean":"2024-09-10T05:12:09.666946+0000","last_became_active":"2024-09-10T05:11:29.729359+0000","last_became_peered":"2024-09-10T05:11:29.729359+0000","last_unstale":"2024-09-10T05:12:09.666946+0000","last_undegraded":"2024-09-10T05:12:09.666946+0000","last_fullsized":"2024-09-10T05:12:09.666946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:52.814750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955280+0000","last_change":"2024-09-10T05:11:27.731218+0000","last_active":"2024-09-10T05:12:04.955280+0000","last_peered":"2024-09-10T05:12:04.955280+0000","last_clean":"2024-09-10T05:12:04.955280+0000","last_became_active":"2024-09-10T05:11:27.730905+0000","last_became_peered":"2024-09-10T05:11:27.730905+0000","last_unstale":"2024-09-10T05:12:04.955280+0000","last_undegraded":"2024-09-10T05:12:04.955280+0000","last_fullsized":"2024-09-10T05:12:04.955280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:16.699974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604649+0000","last_change":"2024-09-10T05:11:29.727742+0000","last_active":"2024-09-10T05:13:32.604649+0000","last_peered":"2024-09-10T05:13:32.604649+0000","last_clean":"2024-09-10T05:13:32.604649+0000","last_became_active":"2024-09-10T05:11:29.727454+0000","last_became_peered":"2024-09-10T05:11:29.727454+0000","last_unstale":"2024-09-10T05:13:32.604649+0000","last_undegraded":"2024-09-10T05:13:32.604649+0000","last_fullsized":"2024-09-10T05:13:32.604649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:22.898915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957634+0000","last_change":"2024-09-10T05:11:27.714363+0000","last_active":"2024-09-10T05:12:04.957634+0000","last_peered":"2024-09-10T05:12:04.957634+0000","last_clean":"2024-09-10T05:12:04.957634+0000","last_became_active":"2024-09-10T05:11:27.713962+0000","last_became_peered":"2024-09-10T05:11:27.713962+0000","last_unstale":"2024-09-10T05:12:04.957634+0000","last_undegraded":"2024-09-10T05:12:04.957634+0000","last_fullsized":"2024-09-10T05:12:04.957634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:40.639981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'8","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.093386+0000","last_change":"2024-09-10T05:11:29.725511+0000","last_active":"2024-09-10T05:12:09.093386+0000","last_peered":"2024-09-10T05:12:09.093386+0000","last_clean":"2024-09-10T05:12:09.093386+0000","last_became_active":"2024-09-10T05:11:29.725099+0000","last_became_peered":"2024-09-10T05:11:29.725099+0000","last_unstale":"2024-09-10T05:12:09.093386+0000","last_undegraded":"2024-09-10T05:12:09.093386+0000","last_fullsized":"2024-09-10T05:12:09.093386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:14.626560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.652457+0000","last_change":"2024-09-10T05:11:27.719263+0000","last_active":"2024-09-10T05:12:09.652457+0000","last_peered":"2024-09-10T05:12:09.652457+0000","last_clean":"2024-09-10T05:12:09.652457+0000","last_became_active":"2024-09-10T05:11:27.718926+0000","last_became_peered":"2024-09-10T05:11:27.718926+0000","last_unstale":"2024-09-10T05:12:09.652457+0000","last_undegraded":"2024-09-10T05:12:09.652457+0000","last_fullsized":"2024-09-10T05:12:09.652457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:49.254771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'8","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107871+0000","last_change":"2024-09-10T05:12:04.978547+0000","last_active":"2024-09-10T05:14:36.107871+0000","last_peered":"2024-09-10T05:14:36.107871+0000","last_clean":"2024-09-10T05:14:36.107871+0000","last_became_active":"2024-09-10T05:12:04.964750+0000","last_became_peered":"2024-09-10T05:12:04.964750+0000","last_unstale":"2024-09-10T05:14:36.107871+0000","last_undegraded":"2024-09-10T05:14:36.107871+0000","last_fullsized":"2024-09-10T05:14:36.107871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:49.286618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960405+0000","last_change":"2024-09-10T05:11:27.718699+0000","last_active":"2024-09-10T05:12:04.960405+0000","last_peered":"2024-09-10T05:12:04.960405+0000","last_clean":"2024-09-10T05:12:04.960405+0000","last_became_active":"2024-09-10T05:11:27.718282+0000","last_became_peered":"2024-09-10T05:11:27.718282+0000","last_unstale":"2024-09-10T05:12:04.960405+0000","last_undegraded":"2024-09-10T05:12:04.960405+0000","last_fullsized":"2024-09-10T05:12:04.960405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:53.391299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.672364+0000","last_change":"2024-09-10T05:11:29.723846+0000","last_active":"2024-09-10T05:13:35.672364+0000","last_peered":"2024-09-10T05:13:35.672364+0000","last_clean":"2024-09-10T05:13:35.672364+0000","last_became_active":"2024-09-10T05:11:29.723387+0000","last_became_peered":"2024-09-10T05:11:29.723387+0000","last_unstale":"2024-09-10T05:13:35.672364+0000","last_undegraded":"2024-09-10T05:13:35.672364+0000","last_fullsized":"2024-09-10T05:13:35.672364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:05.820538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.964122+0000","last_change":"2024-09-10T05:11:27.727938+0000","last_active":"2024-09-10T05:12:04.964122+0000","last_peered":"2024-09-10T05:12:04.964122+0000","last_clean":"2024-09-10T05:12:04.964122+0000","last_became_active":"2024-09-10T05:11:27.724815+0000","last_became_peered":"2024-09-10T05:11:27.724815+0000","last_unstale":"2024-09-10T05:12:04.964122+0000","last_undegraded":"2024-09-10T05:12:04.964122+0000","last_fullsized":"2024-09-10T05:12:04.964122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:20.919577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957830+0000","last_change":"2024-09-10T05:11:29.724062+0000","last_active":"2024-09-10T05:12:04.957830+0000","last_peered":"2024-09-10T05:12:04.957830+0000","last_clean":"2024-09-10T05:12:04.957830+0000","last_became_active":"2024-09-10T05:11:29.723469+0000","last_became_peered":"2024-09-10T05:11:29.723469+0000","last_unstale":"2024-09-10T05:12:04.957830+0000","last_undegraded":"2024-09-10T05:12:04.957830+0000","last_fullsized":"2024-09-10T05:12:04.957830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:43.394583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958230+0000","last_change":"2024-09-10T05:11:27.715191+0000","last_active":"2024-09-10T05:12:04.958230+0000","last_peered":"2024-09-10T05:12:04.958230+0000","last_clean":"2024-09-10T05:12:04.958230+0000","last_became_active":"2024-09-10T05:11:27.714348+0000","last_became_peered":"2024-09-10T05:11:27.714348+0000","last_unstale":"2024-09-10T05:12:04.958230+0000","last_undegraded":"2024-09-10T05:12:04.958230+0000","last_fullsized":"2024-09-10T05:12:04.958230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:36.911942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'8","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417269+0000","last_change":"2024-09-10T05:11:29.730574+0000","last_active":"2024-09-10T05:14:36.417269+0000","last_peered":"2024-09-10T05:14:36.417269+0000","last_clean":"2024-09-10T05:14:36.417269+0000","last_became_active":"2024-09-10T05:11:29.729148+0000","last_became_peered":"2024-09-10T05:11:29.729148+0000","last_unstale":"2024-09-10T05:14:36.417269+0000","last_undegraded":"2024-09-10T05:14:36.417269+0000","last_fullsized":"2024-09-10T05:14:36.417269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:31.976539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914792+0000","last_change":"2024-09-10T05:11:27.735462+0000","last_active":"2024-09-10T05:13:40.914792+0000","last_peered":"2024-09-10T05:13:40.914792+0000","last_clean":"2024-09-10T05:13:40.914792+0000","last_became_active":"2024-09-10T05:11:27.735159+0000","last_became_peered":"2024-09-10T05:11:27.735159+0000","last_unstale":"2024-09-10T05:13:40.914792+0000","last_undegraded":"2024-09-10T05:13:40.914792+0000","last_fullsized":"2024-09-10T05:13:40.914792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:01:53.516341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'12","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339364+0000","last_change":"2024-09-10T05:11:29.729754+0000","last_active":"2024-09-10T05:14:36.339364+0000","last_peered":"2024-09-10T05:14:36.339364+0000","last_clean":"2024-09-10T05:14:36.339364+0000","last_became_active":"2024-09-10T05:11:29.729476+0000","last_became_peered":"2024-09-10T05:11:29.729476+0000","last_unstale":"2024-09-10T05:14:36.339364+0000","last_undegraded":"2024-09-10T05:14:36.339364+0000","last_fullsized":"2024-09-10T05:14:36.339364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:48.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956653+0000","last_change":"2024-09-10T05:11:27.716160+0000","last_active":"2024-09-10T05:12:04.956653+0000","last_peered":"2024-09-10T05:12:04.956653+0000","last_clean":"2024-09-10T05:12:04.956653+0000","last_became_active":"2024-09-10T05:11:27.715014+0000","last_became_peered":"2024-09-10T05:11:27.715014+0000","last_unstale":"2024-09-10T05:12:04.956653+0000","last_undegraded":"2024-09-10T05:12:04.956653+0000","last_fullsized":"2024-09-10T05:12:04.956653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:48.498486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'1","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:43.909553+0000","last_change":"2024-09-10T05:11:29.725420+0000","last_active":"2024-09-10T05:13:43.909553+0000","last_peered":"2024-09-10T05:13:43.909553+0000","last_clean":"2024-09-10T05:13:43.909553+0000","last_became_active":"2024-09-10T05:11:29.725047+0000","last_became_peered":"2024-09-10T05:11:29.725047+0000","last_unstale":"2024-09-10T05:13:43.909553+0000","last_undegraded":"2024-09-10T05:13:43.909553+0000","last_fullsized":"2024-09-10T05:13:43.909553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:53.902350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:45.915269+0000","last_change":"2024-09-10T05:11:27.728591+0000","last_active":"2024-09-10T05:13:45.915269+0000","last_peered":"2024-09-10T05:13:45.915269+0000","last_clean":"2024-09-10T05:13:45.915269+0000","last_became_active":"2024-09-10T05:11:27.728257+0000","last_became_peered":"2024-09-10T05:11:27.728257+0000","last_unstale":"2024-09-10T05:13:45.915269+0000","last_undegraded":"2024-09-10T05:13:45.915269+0000","last_fullsized":"2024-09-10T05:13:45.915269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:47:35.592580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960390+0000","last_change":"2024-09-10T05:11:29.722459+0000","last_active":"2024-09-10T05:12:04.960390+0000","last_peered":"2024-09-10T05:12:04.960390+0000","last_clean":"2024-09-10T05:12:04.960390+0000","last_became_active":"2024-09-10T05:11:29.721826+0000","last_became_peered":"2024-09-10T05:11:29.721826+0000","last_unstale":"2024-09-10T05:12:04.960390+0000","last_undegraded":"2024-09-10T05:12:04.960390+0000","last_fullsized":"2024-09-10T05:12:04.960390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:28.260482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958963+0000","last_change":"2024-09-10T05:11:27.730887+0000","last_active":"2024-09-10T05:12:04.958963+0000","last_peered":"2024-09-10T05:12:04.958963+0000","last_clean":"2024-09-10T05:12:04.958963+0000","last_became_active":"2024-09-10T05:11:27.730469+0000","last_became_peered":"2024-09-10T05:11:27.730469+0000","last_unstale":"2024-09-10T05:12:04.958963+0000","last_undegraded":"2024-09-10T05:12:04.958963+0000","last_fullsized":"2024-09-10T05:12:04.958963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:27.305881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'18","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339133+0000","last_change":"2024-09-10T05:12:04.973395+0000","last_active":"2024-09-10T05:14:36.339133+0000","last_peered":"2024-09-10T05:14:36.339133+0000","last_clean":"2024-09-10T05:14:36.339133+0000","last_became_active":"2024-09-10T05:12:04.965056+0000","last_became_peered":"2024-09-10T05:12:04.965056+0000","last_unstale":"2024-09-10T05:14:36.339133+0000","last_undegraded":"2024-09-10T05:14:36.339133+0000","last_fullsized":"2024-09-10T05:14:36.339133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:32.513703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563177+0000","last_change":"2024-09-10T05:11:27.722461+0000","last_active":"2024-09-10T05:12:08.563177+0000","last_peered":"2024-09-10T05:12:08.563177+0000","last_clean":"2024-09-10T05:12:08.563177+0000","last_became_active":"2024-09-10T05:11:27.722079+0000","last_became_peered":"2024-09-10T05:11:27.722079+0000","last_unstale":"2024-09-10T05:12:08.563177+0000","last_undegraded":"2024-09-10T05:12:08.563177+0000","last_fullsized":"2024-09-10T05:12:08.563177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:24.585536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'16","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107152+0000","last_change":"2024-09-10T05:11:29.734175+0000","last_active":"2024-09-10T05:14:36.107152+0000","last_peered":"2024-09-10T05:14:36.107152+0000","last_clean":"2024-09-10T05:14:36.107152+0000","last_became_active":"2024-09-10T05:11:29.733895+0000","last_became_peered":"2024-09-10T05:11:29.733895+0000","last_unstale":"2024-09-10T05:14:36.107152+0000","last_undegraded":"2024-09-10T05:14:36.107152+0000","last_fullsized":"2024-09-10T05:14:36.107152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:03.526086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961663+0000","last_change":"2024-09-10T05:11:27.736117+0000","last_active":"2024-09-10T05:12:04.961663+0000","last_peered":"2024-09-10T05:12:04.961663+0000","last_clean":"2024-09-10T05:12:04.961663+0000","last_became_active":"2024-09-10T05:11:27.735801+0000","last_became_peered":"2024-09-10T05:11:27.735801+0000","last_unstale":"2024-09-10T05:12:04.961663+0000","last_undegraded":"2024-09-10T05:12:04.961663+0000","last_fullsized":"2024-09-10T05:12:04.961663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:23.542052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.202329+0000","last_change":"2024-09-10T05:11:29.735884+0000","last_active":"2024-09-10T05:14:36.202329+0000","last_peered":"2024-09-10T05:14:36.202329+0000","last_clean":"2024-09-10T05:14:36.202329+0000","last_became_active":"2024-09-10T05:11:29.735555+0000","last_became_peered":"2024-09-10T05:11:29.735555+0000","last_unstale":"2024-09-10T05:14:36.202329+0000","last_undegraded":"2024-09-10T05:14:36.202329+0000","last_fullsized":"2024-09-10T05:14:36.202329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:40:54.995716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.964581+0000","last_change":"2024-09-10T05:11:27.727651+0000","last_active":"2024-09-10T05:12:04.964581+0000","last_peered":"2024-09-10T05:12:04.964581+0000","last_clean":"2024-09-10T05:12:04.964581+0000","last_became_active":"2024-09-10T05:11:27.723820+0000","last_became_peered":"2024-09-10T05:11:27.723820+0000","last_unstale":"2024-09-10T05:12:04.964581+0000","last_undegraded":"2024-09-10T05:12:04.964581+0000","last_fullsized":"2024-09-10T05:12:04.964581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:01:27.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.394391+0000","last_change":"2024-09-10T05:11:29.724350+0000","last_active":"2024-09-10T05:14:36.394391+0000","last_peered":"2024-09-10T05:14:36.394391+0000","last_clean":"2024-09-10T05:14:36.394391+0000","last_became_active":"2024-09-10T05:11:29.723816+0000","last_became_peered":"2024-09-10T05:11:29.723816+0000","last_unstale":"2024-09-10T05:14:36.394391+0000","last_undegraded":"2024-09-10T05:14:36.394391+0000","last_fullsized":"2024-09-10T05:14:36.394391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:33.014166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960833+0000","last_change":"2024-09-10T05:11:27.736745+0000","last_active":"2024-09-10T05:12:04.960833+0000","last_peered":"2024-09-10T05:12:04.960833+0000","last_clean":"2024-09-10T05:12:04.960833+0000","last_became_active":"2024-09-10T05:11:27.736370+0000","last_became_peered":"2024-09-10T05:11:27.736370+0000","last_unstale":"2024-09-10T05:12:04.960833+0000","last_undegraded":"2024-09-10T05:12:04.960833+0000","last_fullsized":"2024-09-10T05:12:04.960833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:18.893074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.411415+0000","last_change":"2024-09-10T05:11:27.731505+0000","last_active":"2024-09-10T05:14:36.411415+0000","last_peered":"2024-09-10T05:14:36.411415+0000","last_clean":"2024-09-10T05:14:36.411415+0000","last_became_active":"2024-09-10T05:11:27.731202+0000","last_became_peered":"2024-09-10T05:11:27.731202+0000","last_unstale":"2024-09-10T05:14:36.411415+0000","last_undegraded":"2024-09-10T05:14:36.411415+0000","last_fullsized":"2024-09-10T05:14:36.411415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:19.541656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.383073+0000","last_change":"2024-09-10T05:11:29.723977+0000","last_active":"2024-09-10T05:14:36.383073+0000","last_peered":"2024-09-10T05:14:36.383073+0000","last_clean":"2024-09-10T05:14:36.383073+0000","last_became_active":"2024-09-10T05:11:29.723467+0000","last_became_peered":"2024-09-10T05:11:29.723467+0000","last_unstale":"2024-09-10T05:14:36.383073+0000","last_undegraded":"2024-09-10T05:14:36.383073+0000","last_fullsized":"2024-09-10T05:14:36.383073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:38:33.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957046+0000","last_change":"2024-09-10T05:11:27.715255+0000","last_active":"2024-09-10T05:12:04.957046+0000","last_peered":"2024-09-10T05:12:04.957046+0000","last_clean":"2024-09-10T05:12:04.957046+0000","last_became_active":"2024-09-10T05:11:27.713659+0000","last_became_peered":"2024-09-10T05:11:27.713659+0000","last_unstale":"2024-09-10T05:12:04.957046+0000","last_undegraded":"2024-09-10T05:12:04.957046+0000","last_fullsized":"2024-09-10T05:12:04.957046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:40.253443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'10","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417292+0000","last_change":"2024-09-10T05:12:04.964980+0000","last_active":"2024-09-10T05:14:36.417292+0000","last_peered":"2024-09-10T05:14:36.417292+0000","last_clean":"2024-09-10T05:14:36.417292+0000","last_became_active":"2024-09-10T05:12:04.964552+0000","last_became_peered":"2024-09-10T05:12:04.964552+0000","last_unstale":"2024-09-10T05:14:36.417292+0000","last_undegraded":"2024-09-10T05:14:36.417292+0000","last_fullsized":"2024-09-10T05:14:36.417292+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:49.445729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1473,"ondisk_log_size":1473,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640301,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48508,"kb_used_data":9004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323332,"statfs":{"total":96636764160,"available":96587091968,"internally_reserved":0,"allocated":9220096,"data_stored":8873071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48964,"kb_used_data":13620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322876,"statfs":{"total":96636764160,"available":96586625024,"internally_reserved":0,"allocated":13946880,"data_stored":13657600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44888,"kb_used_data":9544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326952,"statfs":{"total":96636764160,"available":96590798848,"internally_reserved":0,"allocated":9773056,"data_stored":9462501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48164,"kb_used_data":8660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323676,"statfs":{"total":96636764160,"available":96587444224,"internally_reserved":0,"allocated":8867840,"data_stored":8550766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:14:43.559 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:14:43.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.655+0000 7f246e271640 1 Processor -- start 2024-09-10T05:14:43.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.655+0000 7f246e271640 1 -- start start 2024-09-10T05:14:43.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.655+0000 7f246e271640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2468113220 0x7f2468131380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:43.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.655+0000 7f246e271640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f246806dc00 con 0x7f2468112730 2024-09-10T05:14:43.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.655+0000 7f246e271640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f2468113630 con 0x7f2468113220 2024-09-10T05:14:43.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.656+0000 7f24677fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2468113220 0x7f2468131380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:43.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.656+0000 7f2467fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f2468112730 0x7f2468112b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40888/0 (socket says 172.21.15.139:40888) 2024-09-10T05:14:43.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.656+0000 7f2467fff640 1 -- 172.21.15.139:0/1095617703 learned_addr learned my addr 172.21.15.139:0/1095617703 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:43.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.656+0000 7f24677fe640 1 -- 172.21.15.139:0/1095617703 >> v1:172.21.15.139:6789/0 conn(0x7f2468112730 legacy=0x7f2468112b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.656+0000 7f2466ffd640 1 -- 172.21.15.139:0/1095617703 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418411043 0 0) 0x7f246806dc00 con 0x7f2468112730 2024-09-10T05:14:43.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.656+0000 7f24677fe640 1 -- 172.21.15.139:0/1095617703 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2468113c00 con 0x7f2468113220 2024-09-10T05:14:43.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.657+0000 7f24677fe640 1 --2- 172.21.15.139:0/1095617703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2468113220 0x7f2468131380 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f245c009720 tx=0x7f245c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23573baddafefa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:43.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.657+0000 7f2466ffd640 1 -- 172.21.15.139:0/1095617703 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f245c037070 con 0x7f2468113220 2024-09-10T05:14:43.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.657+0000 7f2466ffd640 1 -- 172.21.15.139:0/1095617703 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f245c02ad90 con 0x7f2468113220 2024-09-10T05:14:43.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.657+0000 7f2466ffd640 1 -- 172.21.15.139:0/1095617703 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f245c032590 con 0x7f2468113220 2024-09-10T05:14:43.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.657+0000 7f246e271640 1 -- 172.21.15.139:0/1095617703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2468113220 msgr2=0x7f2468131380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.657+0000 7f246e271640 1 --2- 172.21.15.139:0/1095617703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2468113220 0x7f2468131380 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f245c009720 tx=0x7f245c02a110 comp rx=0 tx=0).stop 2024-09-10T05:14:43.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.657+0000 7f246e271640 1 -- 172.21.15.139:0/1095617703 shutdown_connections 2024-09-10T05:14:43.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.657+0000 7f246e271640 1 --2- 172.21.15.139:0/1095617703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2468113220 0x7f2468131380 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.657+0000 7f246e271640 1 -- 172.21.15.139:0/1095617703 >> 172.21.15.139:0/1095617703 conn(0x7f2468070850 msgr2=0x7f2468072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:43.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.657+0000 7f246e271640 1 -- 172.21.15.139:0/1095617703 shutdown_connections 2024-09-10T05:14:43.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.657+0000 7f246e271640 1 -- 172.21.15.139:0/1095617703 wait complete. 2024-09-10T05:14:43.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.658+0000 7f246e271640 1 Processor -- start 2024-09-10T05:14:43.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.658+0000 7f246e271640 1 -- start start 2024-09-10T05:14:43.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.659+0000 7f246e271640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2468112730 0x7f2468114180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:43.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.659+0000 7f246e271640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2468131a40 con 0x7f2468112730 2024-09-10T05:14:43.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.659+0000 7f2467fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2468112730 0x7f2468114180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:43.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.659+0000 7f2467fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2468112730 0x7f2468114180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34662/0 (socket says 172.21.15.139:34662) 2024-09-10T05:14:43.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.659+0000 7f2467fff640 1 -- 172.21.15.139:0/405144199 learned_addr learned my addr 172.21.15.139:0/405144199 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:43.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.659+0000 7f2467fff640 1 -- 172.21.15.139:0/405144199 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2468126540 con 0x7f2468112730 2024-09-10T05:14:43.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.659+0000 7f2467fff640 1 --2- 172.21.15.139:0/405144199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2468112730 0x7f2468114180 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f245800c320 tx=0x7f245800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:43.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.659+0000 7f2464ff9640 1 -- 172.21.15.139:0/405144199 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2458007410 con 0x7f2468112730 2024-09-10T05:14:43.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.659+0000 7f2464ff9640 1 -- 172.21.15.139:0/405144199 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24580075d0 con 0x7f2468112730 2024-09-10T05:14:43.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.659+0000 7f246e271640 1 -- 172.21.15.139:0/405144199 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2468116460 con 0x7f2468112730 2024-09-10T05:14:43.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.659+0000 7f2464ff9640 1 -- 172.21.15.139:0/405144199 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2458004950 con 0x7f2468112730 2024-09-10T05:14:43.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.659+0000 7f246e271640 1 -- 172.21.15.139:0/405144199 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2468116ba0 con 0x7f2468112730 2024-09-10T05:14:43.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.660+0000 7f2464ff9640 1 -- 172.21.15.139:0/405144199 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2458011070 con 0x7f2468112730 2024-09-10T05:14:43.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.660+0000 7f246e271640 1 -- 172.21.15.139:0/405144199 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24681157b0 con 0x7f2468112730 2024-09-10T05:14:43.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.660+0000 7f2464ff9640 1 --2- 172.21.15.139:0/405144199 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f245403de90 0x7f2454040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:43.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.660+0000 7f2464ff9640 1 -- 172.21.15.139:0/405144199 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f2458052800 con 0x7f2468112730 2024-09-10T05:14:43.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.661+0000 7f24677fe640 1 --2- 172.21.15.139:0/405144199 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f245403de90 0x7f2454040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:43.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.661+0000 7f24677fe640 1 --2- 172.21.15.139:0/405144199 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f245403de90 0x7f2454040350 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f245c034000 tx=0x7f245c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:43.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.665+0000 7f2464ff9640 1 -- 172.21.15.139:0/405144199 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f2458012da0 con 0x7f2468112730 2024-09-10T05:14:43.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.837+0000 7f246e271640 1 -- 172.21.15.139:0/405144199 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2468112b10 con 0x7f245403de90 2024-09-10T05:14:43.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.847+0000 7f2464ff9640 1 -- 172.21.15.139:0/405144199 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665808 (secure 0 0 0) 0x7f2468112b10 con 0x7f245403de90 2024-09-10T05:14:43.856 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:14:43.861 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-10T05:14:43.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.853+0000 7f246e271640 1 -- 172.21.15.139:0/405144199 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f245403de90 msgr2=0x7f2454040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.853+0000 7f246e271640 1 --2- 172.21.15.139:0/405144199 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f245403de90 0x7f2454040350 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f245c034000 tx=0x7f245c02e000 comp rx=0 tx=0).stop 2024-09-10T05:14:43.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.853+0000 7f246e271640 1 -- 172.21.15.139:0/405144199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2468112730 msgr2=0x7f2468114180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:43.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.853+0000 7f246e271640 1 --2- 172.21.15.139:0/405144199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2468112730 0x7f2468114180 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f245800c320 tx=0x7f245800c7e0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.853+0000 7f246e271640 1 -- 172.21.15.139:0/405144199 shutdown_connections 2024-09-10T05:14:43.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.853+0000 7f246e271640 1 --2- 172.21.15.139:0/405144199 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f245403de90 0x7f2454040350 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.853+0000 7f246e271640 1 --2- 172.21.15.139:0/405144199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2468112730 0x7f2468114180 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:43.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.853+0000 7f246e271640 1 -- 172.21.15.139:0/405144199 >> 172.21.15.139:0/405144199 conn(0x7f2468070850 msgr2=0x7f2468111600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:43.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.853+0000 7f246e271640 1 -- 172.21.15.139:0/405144199 shutdown_connections 2024-09-10T05:14:43.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:43.853+0000 7f246e271640 1 -- 172.21.15.139:0/405144199 wait complete. 2024-09-10T05:14:43.865 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-10T05:14:41.938470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412817,"num_objects":261,"num_object_clones":0,"num_object_copies":529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5217,"num_read_kb":4767,"num_write":2240,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4632,"ondisk_log_size":4632,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190524,"kb_used_data":40828,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377296836,"statfs":{"total":386547056640,"available":386351960064,"internally_reserved":0,"allocated":41807872,"data_stored":40543938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":477,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003764"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962470+0000","last_change":"2024-09-10T05:11:27.721757+0000","last_active":"2024-09-10T05:12:04.962470+0000","last_peered":"2024-09-10T05:12:04.962470+0000","last_clean":"2024-09-10T05:12:04.962470+0000","last_became_active":"2024-09-10T05:11:27.716775+0000","last_became_peered":"2024-09-10T05:11:27.716775+0000","last_unstale":"2024-09-10T05:12:04.962470+0000","last_undegraded":"2024-09-10T05:12:04.962470+0000","last_fullsized":"2024-09-10T05:12:04.962470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:21.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.438467+0000","last_change":"2024-09-10T05:11:29.733870+0000","last_active":"2024-09-10T05:12:09.438467+0000","last_peered":"2024-09-10T05:12:09.438467+0000","last_clean":"2024-09-10T05:12:09.438467+0000","last_became_active":"2024-09-10T05:11:29.733565+0000","last_became_peered":"2024-09-10T05:11:29.733565+0000","last_unstale":"2024-09-10T05:12:09.438467+0000","last_undegraded":"2024-09-10T05:12:09.438467+0000","last_fullsized":"2024-09-10T05:12:09.438467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:13.290526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958456+0000","last_change":"2024-09-10T05:11:27.715287+0000","last_active":"2024-09-10T05:12:04.958456+0000","last_peered":"2024-09-10T05:12:04.958456+0000","last_clean":"2024-09-10T05:12:04.958456+0000","last_became_active":"2024-09-10T05:11:27.713698+0000","last_became_peered":"2024-09-10T05:11:27.713698+0000","last_unstale":"2024-09-10T05:12:04.958456+0000","last_undegraded":"2024-09-10T05:12:04.958456+0000","last_fullsized":"2024-09-10T05:12:04.958456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:11.833568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'10","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417350+0000","last_change":"2024-09-10T05:11:29.728909+0000","last_active":"2024-09-10T05:14:36.417350+0000","last_peered":"2024-09-10T05:14:36.417350+0000","last_clean":"2024-09-10T05:14:36.417350+0000","last_became_active":"2024-09-10T05:11:29.728621+0000","last_became_peered":"2024-09-10T05:11:29.728621+0000","last_unstale":"2024-09-10T05:14:36.417350+0000","last_undegraded":"2024-09-10T05:14:36.417350+0000","last_fullsized":"2024-09-10T05:14:36.417350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:44.019015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"37'3","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.091200+0000","last_change":"2024-09-10T05:11:27.734457+0000","last_active":"2024-09-10T05:14:36.091200+0000","last_peered":"2024-09-10T05:14:36.091200+0000","last_clean":"2024-09-10T05:14:36.091200+0000","last_became_active":"2024-09-10T05:11:27.733147+0000","last_became_peered":"2024-09-10T05:11:27.733147+0000","last_unstale":"2024-09-10T05:14:36.091200+0000","last_undegraded":"2024-09-10T05:14:36.091200+0000","last_fullsized":"2024-09-10T05:14:36.091200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:03.092088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339232+0000","last_change":"2024-09-10T05:11:29.728946+0000","last_active":"2024-09-10T05:14:36.339232+0000","last_peered":"2024-09-10T05:14:36.339232+0000","last_clean":"2024-09-10T05:14:36.339232+0000","last_became_active":"2024-09-10T05:11:29.728696+0000","last_became_peered":"2024-09-10T05:11:29.728696+0000","last_unstale":"2024-09-10T05:14:36.339232+0000","last_undegraded":"2024-09-10T05:14:36.339232+0000","last_fullsized":"2024-09-10T05:14:36.339232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:06.277517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958649+0000","last_change":"2024-09-10T05:11:27.724506+0000","last_active":"2024-09-10T05:12:04.958649+0000","last_peered":"2024-09-10T05:12:04.958649+0000","last_clean":"2024-09-10T05:12:04.958649+0000","last_became_active":"2024-09-10T05:11:27.722701+0000","last_became_peered":"2024-09-10T05:11:27.722701+0000","last_unstale":"2024-09-10T05:12:04.958649+0000","last_undegraded":"2024-09-10T05:12:04.958649+0000","last_fullsized":"2024-09-10T05:12:04.958649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:36.792228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'21","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.346432+0000","last_change":"2024-09-10T05:11:29.732128+0000","last_active":"2024-09-10T05:14:36.346432+0000","last_peered":"2024-09-10T05:14:36.346432+0000","last_clean":"2024-09-10T05:14:36.346432+0000","last_became_active":"2024-09-10T05:11:29.731850+0000","last_became_peered":"2024-09-10T05:11:29.731850+0000","last_unstale":"2024-09-10T05:14:36.346432+0000","last_undegraded":"2024-09-10T05:14:36.346432+0000","last_fullsized":"2024-09-10T05:14:36.346432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:29.844887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956059+0000","last_change":"2024-09-10T05:11:27.733926+0000","last_active":"2024-09-10T05:12:04.956059+0000","last_peered":"2024-09-10T05:12:04.956059+0000","last_clean":"2024-09-10T05:12:04.956059+0000","last_became_active":"2024-09-10T05:11:27.732922+0000","last_became_peered":"2024-09-10T05:11:27.732922+0000","last_unstale":"2024-09-10T05:12:04.956059+0000","last_undegraded":"2024-09-10T05:12:04.956059+0000","last_fullsized":"2024-09-10T05:12:04.956059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:10.400715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960102+0000","last_change":"2024-09-10T05:11:29.722746+0000","last_active":"2024-09-10T05:12:04.960102+0000","last_peered":"2024-09-10T05:12:04.960102+0000","last_clean":"2024-09-10T05:12:04.960102+0000","last_became_active":"2024-09-10T05:11:29.722189+0000","last_became_peered":"2024-09-10T05:11:29.722189+0000","last_unstale":"2024-09-10T05:12:04.960102+0000","last_undegraded":"2024-09-10T05:12:04.960102+0000","last_fullsized":"2024-09-10T05:12:04.960102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:20.901027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.655335+0000","last_change":"2024-09-10T05:11:27.706947+0000","last_active":"2024-09-10T05:12:09.655335+0000","last_peered":"2024-09-10T05:12:09.655335+0000","last_clean":"2024-09-10T05:12:09.655335+0000","last_became_active":"2024-09-10T05:11:27.706559+0000","last_became_peered":"2024-09-10T05:11:27.706559+0000","last_unstale":"2024-09-10T05:12:09.655335+0000","last_undegraded":"2024-09-10T05:12:09.655335+0000","last_fullsized":"2024-09-10T05:12:09.655335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:12.536123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957220+0000","last_change":"2024-09-10T05:11:29.730769+0000","last_active":"2024-09-10T05:12:04.957220+0000","last_peered":"2024-09-10T05:12:04.957220+0000","last_clean":"2024-09-10T05:12:04.957220+0000","last_became_active":"2024-09-10T05:11:29.730492+0000","last_became_peered":"2024-09-10T05:11:29.730492+0000","last_unstale":"2024-09-10T05:12:04.957220+0000","last_undegraded":"2024-09-10T05:12:04.957220+0000","last_fullsized":"2024-09-10T05:12:04.957220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:36.538972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954889+0000","last_change":"2024-09-10T05:11:27.718698+0000","last_active":"2024-09-10T05:12:04.954889+0000","last_peered":"2024-09-10T05:12:04.954889+0000","last_clean":"2024-09-10T05:12:04.954889+0000","last_became_active":"2024-09-10T05:11:27.718363+0000","last_became_peered":"2024-09-10T05:11:27.718363+0000","last_unstale":"2024-09-10T05:12:04.954889+0000","last_undegraded":"2024-09-10T05:12:04.954889+0000","last_fullsized":"2024-09-10T05:12:04.954889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:56.809195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417284+0000","last_change":"2024-09-10T05:11:29.727171+0000","last_active":"2024-09-10T05:14:36.417284+0000","last_peered":"2024-09-10T05:14:36.417284+0000","last_clean":"2024-09-10T05:14:36.417284+0000","last_became_active":"2024-09-10T05:11:29.726884+0000","last_became_peered":"2024-09-10T05:11:29.726884+0000","last_unstale":"2024-09-10T05:14:36.417284+0000","last_undegraded":"2024-09-10T05:14:36.417284+0000","last_fullsized":"2024-09-10T05:14:36.417284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:28.260482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.646405+0000","last_change":"2024-09-10T05:11:27.719213+0000","last_active":"2024-09-10T05:12:09.646405+0000","last_peered":"2024-09-10T05:12:09.646405+0000","last_clean":"2024-09-10T05:12:09.646405+0000","last_became_active":"2024-09-10T05:11:27.718868+0000","last_became_peered":"2024-09-10T05:11:27.718868+0000","last_unstale":"2024-09-10T05:12:09.646405+0000","last_undegraded":"2024-09-10T05:12:09.646405+0000","last_fullsized":"2024-09-10T05:12:09.646405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:27.106277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.093231+0000","last_change":"2024-09-10T05:11:29.723967+0000","last_active":"2024-09-10T05:12:09.093231+0000","last_peered":"2024-09-10T05:12:09.093231+0000","last_clean":"2024-09-10T05:12:09.093231+0000","last_became_active":"2024-09-10T05:11:29.723497+0000","last_became_peered":"2024-09-10T05:11:29.723497+0000","last_unstale":"2024-09-10T05:12:09.093231+0000","last_undegraded":"2024-09-10T05:12:09.093231+0000","last_fullsized":"2024-09-10T05:12:09.093231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:35.779331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'5","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.208052+0000","last_change":"2024-09-10T05:11:29.727785+0000","last_active":"2024-09-10T05:14:36.208052+0000","last_peered":"2024-09-10T05:14:36.208052+0000","last_clean":"2024-09-10T05:14:36.208052+0000","last_became_active":"2024-09-10T05:11:29.727536+0000","last_became_peered":"2024-09-10T05:11:29.727536+0000","last_unstale":"2024-09-10T05:14:36.208052+0000","last_undegraded":"2024-09-10T05:14:36.208052+0000","last_fullsized":"2024-09-10T05:14:36.208052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:01.849780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.517983+0000","last_change":"2024-09-10T05:11:27.728861+0000","last_active":"2024-09-10T05:13:35.517983+0000","last_peered":"2024-09-10T05:13:35.517983+0000","last_clean":"2024-09-10T05:13:35.517983+0000","last_became_active":"2024-09-10T05:11:27.728114+0000","last_became_peered":"2024-09-10T05:11:27.728114+0000","last_unstale":"2024-09-10T05:13:35.517983+0000","last_undegraded":"2024-09-10T05:13:35.517983+0000","last_fullsized":"2024-09-10T05:13:35.517983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.559031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.202264+0000","last_change":"2024-09-10T05:11:29.733110+0000","last_active":"2024-09-10T05:14:36.202264+0000","last_peered":"2024-09-10T05:14:36.202264+0000","last_clean":"2024-09-10T05:14:36.202264+0000","last_became_active":"2024-09-10T05:11:29.732864+0000","last_became_peered":"2024-09-10T05:11:29.732864+0000","last_unstale":"2024-09-10T05:14:36.202264+0000","last_undegraded":"2024-09-10T05:14:36.202264+0000","last_fullsized":"2024-09-10T05:14:36.202264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:27.593815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.964231+0000","last_change":"2024-09-10T05:11:27.707811+0000","last_active":"2024-09-10T05:12:04.964231+0000","last_peered":"2024-09-10T05:12:04.964231+0000","last_clean":"2024-09-10T05:12:04.964231+0000","last_became_active":"2024-09-10T05:11:27.706698+0000","last_became_peered":"2024-09-10T05:11:27.706698+0000","last_unstale":"2024-09-10T05:12:04.964231+0000","last_undegraded":"2024-09-10T05:12:04.964231+0000","last_fullsized":"2024-09-10T05:12:04.964231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.559031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'10","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.963001+0000","last_change":"2024-09-10T05:11:29.732128+0000","last_active":"2024-09-10T05:12:51.963001+0000","last_peered":"2024-09-10T05:12:51.963001+0000","last_clean":"2024-09-10T05:12:51.963001+0000","last_became_active":"2024-09-10T05:11:29.731842+0000","last_became_peered":"2024-09-10T05:11:29.731842+0000","last_unstale":"2024-09-10T05:12:51.963001+0000","last_undegraded":"2024-09-10T05:12:51.963001+0000","last_fullsized":"2024-09-10T05:12:51.963001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:54.021671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960653+0000","last_change":"2024-09-10T05:11:27.719633+0000","last_active":"2024-09-10T05:12:04.960653+0000","last_peered":"2024-09-10T05:12:04.960653+0000","last_clean":"2024-09-10T05:12:04.960653+0000","last_became_active":"2024-09-10T05:11:27.719257+0000","last_became_peered":"2024-09-10T05:11:27.719257+0000","last_unstale":"2024-09-10T05:12:04.960653+0000","last_undegraded":"2024-09-10T05:12:04.960653+0000","last_fullsized":"2024-09-10T05:12:04.960653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:49.735409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339173+0000","last_change":"2024-09-10T05:12:04.976749+0000","last_active":"2024-09-10T05:14:36.339173+0000","last_peered":"2024-09-10T05:14:36.339173+0000","last_clean":"2024-09-10T05:14:36.339173+0000","last_became_active":"2024-09-10T05:12:04.967642+0000","last_became_peered":"2024-09-10T05:12:04.967642+0000","last_unstale":"2024-09-10T05:14:36.339173+0000","last_undegraded":"2024-09-10T05:14:36.339173+0000","last_fullsized":"2024-09-10T05:14:36.339173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:14.879637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"37'3","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.952834+0000","last_change":"2024-09-10T05:11:27.724754+0000","last_active":"2024-09-10T05:12:51.952834+0000","last_peered":"2024-09-10T05:12:51.952834+0000","last_clean":"2024-09-10T05:12:51.952834+0000","last_became_active":"2024-09-10T05:11:27.724439+0000","last_became_peered":"2024-09-10T05:11:27.724439+0000","last_unstale":"2024-09-10T05:12:51.952834+0000","last_undegraded":"2024-09-10T05:12:51.952834+0000","last_fullsized":"2024-09-10T05:12:51.952834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:46:03.289983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382409+0000","last_change":"2024-09-10T05:11:29.723195+0000","last_active":"2024-09-10T05:14:36.382409+0000","last_peered":"2024-09-10T05:14:36.382409+0000","last_clean":"2024-09-10T05:14:36.382409+0000","last_became_active":"2024-09-10T05:11:29.722894+0000","last_became_peered":"2024-09-10T05:11:29.722894+0000","last_unstale":"2024-09-10T05:14:36.382409+0000","last_undegraded":"2024-09-10T05:14:36.382409+0000","last_fullsized":"2024-09-10T05:14:36.382409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:16.388042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:53.911207+0000","last_change":"2024-09-10T05:11:27.716016+0000","last_active":"2024-09-10T05:13:53.911207+0000","last_peered":"2024-09-10T05:13:53.911207+0000","last_clean":"2024-09-10T05:13:53.911207+0000","last_became_active":"2024-09-10T05:11:27.714926+0000","last_became_peered":"2024-09-10T05:11:27.714926+0000","last_unstale":"2024-09-10T05:13:53.911207+0000","last_undegraded":"2024-09-10T05:13:53.911207+0000","last_fullsized":"2024-09-10T05:13:53.911207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:51.116402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.384792+0000","last_change":"2024-09-10T05:11:29.722979+0000","last_active":"2024-09-10T05:14:36.384792+0000","last_peered":"2024-09-10T05:14:36.384792+0000","last_clean":"2024-09-10T05:14:36.384792+0000","last_became_active":"2024-09-10T05:11:29.721876+0000","last_became_peered":"2024-09-10T05:11:29.721876+0000","last_unstale":"2024-09-10T05:14:36.384792+0000","last_undegraded":"2024-09-10T05:14:36.384792+0000","last_fullsized":"2024-09-10T05:14:36.384792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:11:48.560871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955723+0000","last_change":"2024-09-10T05:11:27.720509+0000","last_active":"2024-09-10T05:12:04.955723+0000","last_peered":"2024-09-10T05:12:04.955723+0000","last_clean":"2024-09-10T05:12:04.955723+0000","last_became_active":"2024-09-10T05:11:27.720197+0000","last_became_peered":"2024-09-10T05:11:27.720197+0000","last_unstale":"2024-09-10T05:12:04.955723+0000","last_undegraded":"2024-09-10T05:12:04.955723+0000","last_fullsized":"2024-09-10T05:12:04.955723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:14.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.361804+0000","last_change":"2024-09-10T05:11:37.763268+0000","last_active":"2024-09-10T05:14:36.361804+0000","last_peered":"2024-09-10T05:14:36.361804+0000","last_clean":"2024-09-10T05:14:36.361804+0000","last_became_active":"2024-09-10T05:11:37.763019+0000","last_became_peered":"2024-09-10T05:11:37.763019+0000","last_unstale":"2024-09-10T05:14:36.361804+0000","last_undegraded":"2024-09-10T05:14:36.361804+0000","last_fullsized":"2024-09-10T05:14:36.361804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:54.698085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:10.169121+0000","last_change":"2024-09-10T05:11:29.729685+0000","last_active":"2024-09-10T05:12:10.169121+0000","last_peered":"2024-09-10T05:12:10.169121+0000","last_clean":"2024-09-10T05:12:10.169121+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:12:10.169121+0000","last_undegraded":"2024-09-10T05:12:10.169121+0000","last_fullsized":"2024-09-10T05:12:10.169121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.365568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955666+0000","last_change":"2024-09-10T05:11:27.734206+0000","last_active":"2024-09-10T05:12:04.955666+0000","last_peered":"2024-09-10T05:12:04.955666+0000","last_clean":"2024-09-10T05:12:04.955666+0000","last_became_active":"2024-09-10T05:11:27.733612+0000","last_became_peered":"2024-09-10T05:11:27.733612+0000","last_unstale":"2024-09-10T05:12:04.955666+0000","last_undegraded":"2024-09-10T05:12:04.955666+0000","last_fullsized":"2024-09-10T05:12:04.955666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:47.697103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957082+0000","last_change":"2024-09-10T05:11:31.737509+0000","last_active":"2024-09-10T05:12:04.957082+0000","last_peered":"2024-09-10T05:12:04.957082+0000","last_clean":"2024-09-10T05:12:04.957082+0000","last_became_active":"2024-09-10T05:11:31.736788+0000","last_became_peered":"2024-09-10T05:11:31.736788+0000","last_unstale":"2024-09-10T05:12:04.957082+0000","last_undegraded":"2024-09-10T05:12:04.957082+0000","last_fullsized":"2024-09-10T05:12:04.957082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:26.107225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'44","reported_seq":99,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.265414+0000","last_change":"2024-09-10T05:11:33.746939+0000","last_active":"2024-09-10T05:13:34.265414+0000","last_peered":"2024-09-10T05:13:34.265414+0000","last_clean":"2024-09-10T05:13:34.265414+0000","last_became_active":"2024-09-10T05:11:33.746595+0000","last_became_peered":"2024-09-10T05:11:33.746595+0000","last_unstale":"2024-09-10T05:13:34.265414+0000","last_undegraded":"2024-09-10T05:13:34.265414+0000","last_fullsized":"2024-09-10T05:13:34.265414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:39.379252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963055+0000","last_change":"2024-09-10T05:11:35.746892+0000","last_active":"2024-09-10T05:12:04.963055+0000","last_peered":"2024-09-10T05:12:04.963055+0000","last_clean":"2024-09-10T05:12:04.963055+0000","last_became_active":"2024-09-10T05:11:35.746594+0000","last_became_peered":"2024-09-10T05:11:35.746594+0000","last_unstale":"2024-09-10T05:12:04.963055+0000","last_undegraded":"2024-09-10T05:12:04.963055+0000","last_fullsized":"2024-09-10T05:12:04.963055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:15.325826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.968440+0000","last_change":"2024-09-10T05:11:37.756768+0000","last_active":"2024-09-10T05:12:51.968440+0000","last_peered":"2024-09-10T05:12:51.968440+0000","last_clean":"2024-09-10T05:12:51.968440+0000","last_became_active":"2024-09-10T05:11:37.756495+0000","last_became_peered":"2024-09-10T05:11:37.756495+0000","last_unstale":"2024-09-10T05:12:51.968440+0000","last_undegraded":"2024-09-10T05:12:51.968440+0000","last_fullsized":"2024-09-10T05:12:51.968440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:13.070344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417430+0000","last_change":"2024-09-10T05:11:29.732574+0000","last_active":"2024-09-10T05:14:36.417430+0000","last_peered":"2024-09-10T05:14:36.417430+0000","last_clean":"2024-09-10T05:14:36.417430+0000","last_became_active":"2024-09-10T05:11:29.732267+0000","last_became_peered":"2024-09-10T05:11:29.732267+0000","last_unstale":"2024-09-10T05:14:36.417430+0000","last_undegraded":"2024-09-10T05:14:36.417430+0000","last_fullsized":"2024-09-10T05:14:36.417430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:00.006923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958078+0000","last_change":"2024-09-10T05:11:27.726953+0000","last_active":"2024-09-10T05:12:04.958078+0000","last_peered":"2024-09-10T05:12:04.958078+0000","last_clean":"2024-09-10T05:12:04.958078+0000","last_became_active":"2024-09-10T05:11:27.726599+0000","last_became_peered":"2024-09-10T05:11:27.726599+0000","last_unstale":"2024-09-10T05:12:04.958078+0000","last_undegraded":"2024-09-10T05:12:04.958078+0000","last_fullsized":"2024-09-10T05:12:04.958078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:37.354012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957165+0000","last_change":"2024-09-10T05:11:31.731495+0000","last_active":"2024-09-10T05:12:04.957165+0000","last_peered":"2024-09-10T05:12:04.957165+0000","last_clean":"2024-09-10T05:12:04.957165+0000","last_became_active":"2024-09-10T05:11:31.731231+0000","last_became_peered":"2024-09-10T05:11:31.731231+0000","last_unstale":"2024-09-10T05:12:04.957165+0000","last_undegraded":"2024-09-10T05:12:04.957165+0000","last_fullsized":"2024-09-10T05:12:04.957165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:09.451414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'13","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960893+0000","last_change":"2024-09-10T05:11:33.744170+0000","last_active":"2024-09-10T05:12:04.960893+0000","last_peered":"2024-09-10T05:12:04.960893+0000","last_clean":"2024-09-10T05:12:04.960893+0000","last_became_active":"2024-09-10T05:11:33.743847+0000","last_became_peered":"2024-09-10T05:11:33.743847+0000","last_unstale":"2024-09-10T05:12:04.960893+0000","last_undegraded":"2024-09-10T05:12:04.960893+0000","last_fullsized":"2024-09-10T05:12:04.960893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:57.085007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962494+0000","last_change":"2024-09-10T05:11:35.749895+0000","last_active":"2024-09-10T05:12:04.962494+0000","last_peered":"2024-09-10T05:12:04.962494+0000","last_clean":"2024-09-10T05:12:04.962494+0000","last_became_active":"2024-09-10T05:11:35.749634+0000","last_became_peered":"2024-09-10T05:11:35.749634+0000","last_unstale":"2024-09-10T05:12:04.962494+0000","last_undegraded":"2024-09-10T05:12:04.962494+0000","last_fullsized":"2024-09-10T05:12:04.962494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:01.486680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956547+0000","last_change":"2024-09-10T05:11:37.755426+0000","last_active":"2024-09-10T05:12:04.956547+0000","last_peered":"2024-09-10T05:12:04.956547+0000","last_clean":"2024-09-10T05:12:04.956547+0000","last_became_active":"2024-09-10T05:11:37.755078+0000","last_became_peered":"2024-09-10T05:11:37.755078+0000","last_unstale":"2024-09-10T05:12:04.956547+0000","last_undegraded":"2024-09-10T05:12:04.956547+0000","last_fullsized":"2024-09-10T05:12:04.956547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:03.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961705+0000","last_change":"2024-09-10T05:11:29.732068+0000","last_active":"2024-09-10T05:12:04.961705+0000","last_peered":"2024-09-10T05:12:04.961705+0000","last_clean":"2024-09-10T05:12:04.961705+0000","last_became_active":"2024-09-10T05:11:29.731780+0000","last_became_peered":"2024-09-10T05:11:29.731780+0000","last_unstale":"2024-09-10T05:12:04.961705+0000","last_undegraded":"2024-09-10T05:12:04.961705+0000","last_fullsized":"2024-09-10T05:12:04.961705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:47.912310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954517+0000","last_change":"2024-09-10T05:11:27.732925+0000","last_active":"2024-09-10T05:12:04.954517+0000","last_peered":"2024-09-10T05:12:04.954517+0000","last_clean":"2024-09-10T05:12:04.954517+0000","last_became_active":"2024-09-10T05:11:27.732573+0000","last_became_peered":"2024-09-10T05:11:27.732573+0000","last_unstale":"2024-09-10T05:12:04.954517+0000","last_undegraded":"2024-09-10T05:12:04.954517+0000","last_fullsized":"2024-09-10T05:12:04.954517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:48.014510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:05.900569+0000","last_change":"2024-09-10T05:12:04.965872+0000","last_active":"2024-09-10T05:12:05.900569+0000","last_peered":"2024-09-10T05:12:05.900569+0000","last_clean":"2024-09-10T05:12:05.900569+0000","last_became_active":"2024-09-10T05:12:04.965494+0000","last_became_peered":"2024-09-10T05:12:04.965494+0000","last_unstale":"2024-09-10T05:12:05.900569+0000","last_undegraded":"2024-09-10T05:12:05.900569+0000","last_fullsized":"2024-09-10T05:12:05.900569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:04.430595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959616+0000","last_change":"2024-09-10T05:11:33.745608+0000","last_active":"2024-09-10T05:12:04.959616+0000","last_peered":"2024-09-10T05:12:04.959616+0000","last_clean":"2024-09-10T05:12:04.959616+0000","last_became_active":"2024-09-10T05:11:33.745336+0000","last_became_peered":"2024-09-10T05:11:33.745336+0000","last_unstale":"2024-09-10T05:12:04.959616+0000","last_undegraded":"2024-09-10T05:12:04.959616+0000","last_fullsized":"2024-09-10T05:12:04.959616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:41.078775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'282","reported_seq":415,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.421973+0000","last_change":"2024-09-10T05:11:35.752548+0000","last_active":"2024-09-10T05:14:36.421973+0000","last_peered":"2024-09-10T05:14:36.421973+0000","last_clean":"2024-09-10T05:14:36.421973+0000","last_became_active":"2024-09-10T05:11:35.752290+0000","last_became_peered":"2024-09-10T05:11:35.752290+0000","last_unstale":"2024-09-10T05:14:36.421973+0000","last_undegraded":"2024-09-10T05:14:36.421973+0000","last_fullsized":"2024-09-10T05:14:36.421973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.244961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959825+0000","last_change":"2024-09-10T05:11:37.759873+0000","last_active":"2024-09-10T05:12:04.959825+0000","last_peered":"2024-09-10T05:12:04.959825+0000","last_clean":"2024-09-10T05:12:04.959825+0000","last_became_active":"2024-09-10T05:11:37.759311+0000","last_became_peered":"2024-09-10T05:11:37.759311+0000","last_unstale":"2024-09-10T05:12:04.959825+0000","last_undegraded":"2024-09-10T05:12:04.959825+0000","last_fullsized":"2024-09-10T05:12:04.959825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:37.479923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.383082+0000","last_change":"2024-09-10T05:11:29.724315+0000","last_active":"2024-09-10T05:14:36.383082+0000","last_peered":"2024-09-10T05:14:36.383082+0000","last_clean":"2024-09-10T05:14:36.383082+0000","last_became_active":"2024-09-10T05:11:29.723919+0000","last_became_peered":"2024-09-10T05:11:29.723919+0000","last_unstale":"2024-09-10T05:14:36.383082+0000","last_undegraded":"2024-09-10T05:14:36.383082+0000","last_fullsized":"2024-09-10T05:14:36.383082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:04.172142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957233+0000","last_change":"2024-09-10T05:11:27.720680+0000","last_active":"2024-09-10T05:12:04.957233+0000","last_peered":"2024-09-10T05:12:04.957233+0000","last_clean":"2024-09-10T05:12:04.957233+0000","last_became_active":"2024-09-10T05:11:27.719835+0000","last_became_peered":"2024-09-10T05:11:27.719835+0000","last_unstale":"2024-09-10T05:12:04.957233+0000","last_undegraded":"2024-09-10T05:12:04.957233+0000","last_fullsized":"2024-09-10T05:12:04.957233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962693+0000","last_change":"2024-09-10T05:11:31.737694+0000","last_active":"2024-09-10T05:12:04.962693+0000","last_peered":"2024-09-10T05:12:04.962693+0000","last_clean":"2024-09-10T05:12:04.962693+0000","last_became_active":"2024-09-10T05:11:31.737411+0000","last_became_peered":"2024-09-10T05:11:31.737411+0000","last_unstale":"2024-09-10T05:12:04.962693+0000","last_undegraded":"2024-09-10T05:12:04.962693+0000","last_fullsized":"2024-09-10T05:12:04.962693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:48.673581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'36","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.259091+0000","last_change":"2024-09-10T05:11:33.745209+0000","last_active":"2024-09-10T05:13:34.259091+0000","last_peered":"2024-09-10T05:13:34.259091+0000","last_clean":"2024-09-10T05:13:34.259091+0000","last_became_active":"2024-09-10T05:11:33.744920+0000","last_became_peered":"2024-09-10T05:11:33.744920+0000","last_unstale":"2024-09-10T05:13:34.259091+0000","last_undegraded":"2024-09-10T05:13:34.259091+0000","last_fullsized":"2024-09-10T05:13:34.259091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:36.085525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'282","reported_seq":424,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.420466+0000","last_change":"2024-09-10T05:11:35.748524+0000","last_active":"2024-09-10T05:14:36.420466+0000","last_peered":"2024-09-10T05:14:36.420466+0000","last_clean":"2024-09-10T05:14:36.420466+0000","last_became_active":"2024-09-10T05:11:35.748328+0000","last_became_peered":"2024-09-10T05:11:35.748328+0000","last_unstale":"2024-09-10T05:14:36.420466+0000","last_undegraded":"2024-09-10T05:14:36.420466+0000","last_fullsized":"2024-09-10T05:14:36.420466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:39.020754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'7","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116685+0000","last_change":"2024-09-10T05:11:29.736309+0000","last_active":"2024-09-10T05:14:36.116685+0000","last_peered":"2024-09-10T05:14:36.116685+0000","last_clean":"2024-09-10T05:14:36.116685+0000","last_became_active":"2024-09-10T05:11:29.735799+0000","last_became_peered":"2024-09-10T05:11:29.735799+0000","last_unstale":"2024-09-10T05:14:36.116685+0000","last_undegraded":"2024-09-10T05:14:36.116685+0000","last_fullsized":"2024-09-10T05:14:36.116685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:38.598374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962727+0000","last_change":"2024-09-10T05:11:27.721631+0000","last_active":"2024-09-10T05:12:04.962727+0000","last_peered":"2024-09-10T05:12:04.962727+0000","last_clean":"2024-09-10T05:12:04.962727+0000","last_became_active":"2024-09-10T05:11:27.716318+0000","last_became_peered":"2024-09-10T05:11:27.716318+0000","last_unstale":"2024-09-10T05:12:04.962727+0000","last_undegraded":"2024-09-10T05:12:04.962727+0000","last_fullsized":"2024-09-10T05:12:04.962727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:40.603860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958076+0000","last_change":"2024-09-10T05:11:31.735274+0000","last_active":"2024-09-10T05:12:04.958076+0000","last_peered":"2024-09-10T05:12:04.958076+0000","last_clean":"2024-09-10T05:12:04.958076+0000","last_became_active":"2024-09-10T05:11:31.734975+0000","last_became_peered":"2024-09-10T05:11:31.734975+0000","last_unstale":"2024-09-10T05:12:04.958076+0000","last_undegraded":"2024-09-10T05:12:04.958076+0000","last_fullsized":"2024-09-10T05:12:04.958076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:45.105200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'47","reported_seq":101,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.270154+0000","last_change":"2024-09-10T05:11:33.746845+0000","last_active":"2024-09-10T05:13:34.270154+0000","last_peered":"2024-09-10T05:13:34.270154+0000","last_clean":"2024-09-10T05:13:34.270154+0000","last_became_active":"2024-09-10T05:11:33.746522+0000","last_became_peered":"2024-09-10T05:11:33.746522+0000","last_unstale":"2024-09-10T05:13:34.270154+0000","last_undegraded":"2024-09-10T05:13:34.270154+0000","last_fullsized":"2024-09-10T05:13:34.270154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:43.397048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957524+0000","last_change":"2024-09-10T05:11:35.746098+0000","last_active":"2024-09-10T05:12:04.957524+0000","last_peered":"2024-09-10T05:12:04.957524+0000","last_clean":"2024-09-10T05:12:04.957524+0000","last_became_active":"2024-09-10T05:11:35.745840+0000","last_became_peered":"2024-09-10T05:11:35.745840+0000","last_unstale":"2024-09-10T05:12:04.957524+0000","last_undegraded":"2024-09-10T05:12:04.957524+0000","last_fullsized":"2024-09-10T05:12:04.957524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:48.168086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.970146+0000","last_change":"2024-09-10T05:11:37.754850+0000","last_active":"2024-09-10T05:12:51.970146+0000","last_peered":"2024-09-10T05:12:51.970146+0000","last_clean":"2024-09-10T05:12:51.970146+0000","last_became_active":"2024-09-10T05:11:37.754562+0000","last_became_peered":"2024-09-10T05:11:37.754562+0000","last_unstale":"2024-09-10T05:12:51.970146+0000","last_undegraded":"2024-09-10T05:12:51.970146+0000","last_fullsized":"2024-09-10T05:12:51.970146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:27.172242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.199301+0000","last_change":"2024-09-10T05:11:29.721603+0000","last_active":"2024-09-10T05:14:36.199301+0000","last_peered":"2024-09-10T05:14:36.199301+0000","last_clean":"2024-09-10T05:14:36.199301+0000","last_became_active":"2024-09-10T05:11:29.721292+0000","last_became_peered":"2024-09-10T05:11:29.721292+0000","last_unstale":"2024-09-10T05:14:36.199301+0000","last_undegraded":"2024-09-10T05:14:36.199301+0000","last_fullsized":"2024-09-10T05:14:36.199301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.549609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.324967+0000","last_change":"2024-09-10T05:11:27.728236+0000","last_active":"2024-09-10T05:14:36.324967+0000","last_peered":"2024-09-10T05:14:36.324967+0000","last_clean":"2024-09-10T05:14:36.324967+0000","last_became_active":"2024-09-10T05:11:27.726419+0000","last_became_peered":"2024-09-10T05:11:27.726419+0000","last_unstale":"2024-09-10T05:14:36.324967+0000","last_undegraded":"2024-09-10T05:14:36.324967+0000","last_fullsized":"2024-09-10T05:14:36.324967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:45.107412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956724+0000","last_change":"2024-09-10T05:11:31.732240+0000","last_active":"2024-09-10T05:12:04.956724+0000","last_peered":"2024-09-10T05:12:04.956724+0000","last_clean":"2024-09-10T05:12:04.956724+0000","last_became_active":"2024-09-10T05:11:31.732017+0000","last_became_peered":"2024-09-10T05:11:31.732017+0000","last_unstale":"2024-09-10T05:12:04.956724+0000","last_undegraded":"2024-09-10T05:12:04.956724+0000","last_fullsized":"2024-09-10T05:12:04.956724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:35.116886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'37","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:50.916771+0000","last_change":"2024-09-10T05:11:33.747704+0000","last_active":"2024-09-10T05:13:50.916771+0000","last_peered":"2024-09-10T05:13:50.916771+0000","last_clean":"2024-09-10T05:13:50.916771+0000","last_became_active":"2024-09-10T05:11:33.747334+0000","last_became_peered":"2024-09-10T05:11:33.747334+0000","last_unstale":"2024-09-10T05:13:50.916771+0000","last_undegraded":"2024-09-10T05:13:50.916771+0000","last_fullsized":"2024-09-10T05:13:50.916771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:02.895443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956478+0000","last_change":"2024-09-10T05:11:35.753755+0000","last_active":"2024-09-10T05:12:04.956478+0000","last_peered":"2024-09-10T05:12:04.956478+0000","last_clean":"2024-09-10T05:12:04.956478+0000","last_became_active":"2024-09-10T05:11:35.753453+0000","last_became_peered":"2024-09-10T05:11:35.753453+0000","last_unstale":"2024-09-10T05:12:04.956478+0000","last_undegraded":"2024-09-10T05:12:04.956478+0000","last_fullsized":"2024-09-10T05:12:04.956478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:03.592621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:46.437159+0000","last_change":"2024-09-10T05:11:37.758133+0000","last_active":"2024-09-10T05:12:46.437159+0000","last_peered":"2024-09-10T05:12:46.437159+0000","last_clean":"2024-09-10T05:12:46.437159+0000","last_became_active":"2024-09-10T05:11:37.757307+0000","last_became_peered":"2024-09-10T05:11:37.757307+0000","last_unstale":"2024-09-10T05:12:46.437159+0000","last_undegraded":"2024-09-10T05:12:46.437159+0000","last_fullsized":"2024-09-10T05:12:46.437159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:15.800062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958765+0000","last_change":"2024-09-10T05:11:29.722984+0000","last_active":"2024-09-10T05:12:04.958765+0000","last_peered":"2024-09-10T05:12:04.958765+0000","last_clean":"2024-09-10T05:12:04.958765+0000","last_became_active":"2024-09-10T05:11:29.722719+0000","last_became_peered":"2024-09-10T05:11:29.722719+0000","last_unstale":"2024-09-10T05:12:04.958765+0000","last_undegraded":"2024-09-10T05:12:04.958765+0000","last_fullsized":"2024-09-10T05:12:04.958765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:12.408667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.656125+0000","last_change":"2024-09-10T05:11:27.722920+0000","last_active":"2024-09-10T05:13:35.656125+0000","last_peered":"2024-09-10T05:13:35.656125+0000","last_clean":"2024-09-10T05:13:35.656125+0000","last_became_active":"2024-09-10T05:11:27.722553+0000","last_became_peered":"2024-09-10T05:11:27.722553+0000","last_unstale":"2024-09-10T05:13:35.656125+0000","last_undegraded":"2024-09-10T05:13:35.656125+0000","last_fullsized":"2024-09-10T05:13:35.656125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:26.252530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'4","reported_seq":227,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.313246+0000","last_change":"2024-09-10T05:11:31.734260+0000","last_active":"2024-09-10T05:13:35.313246+0000","last_peered":"2024-09-10T05:13:35.313246+0000","last_clean":"2024-09-10T05:13:35.313246+0000","last_became_active":"2024-09-10T05:11:31.733822+0000","last_became_peered":"2024-09-10T05:11:31.733822+0000","last_unstale":"2024-09-10T05:13:35.313246+0000","last_undegraded":"2024-09-10T05:13:35.313246+0000","last_fullsized":"2024-09-10T05:13:35.313246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:41.836144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'48","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.272006+0000","last_change":"2024-09-10T05:11:33.748247+0000","last_active":"2024-09-10T05:13:34.272006+0000","last_peered":"2024-09-10T05:13:34.272006+0000","last_clean":"2024-09-10T05:13:34.272006+0000","last_became_active":"2024-09-10T05:11:33.747938+0000","last_became_peered":"2024-09-10T05:11:33.747938+0000","last_unstale":"2024-09-10T05:13:34.272006+0000","last_undegraded":"2024-09-10T05:13:34.272006+0000","last_fullsized":"2024-09-10T05:13:34.272006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:53.311224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'282","reported_seq":348,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.587512+0000","last_change":"2024-09-10T05:11:35.754114+0000","last_active":"2024-09-10T05:14:36.587512+0000","last_peered":"2024-09-10T05:14:36.587512+0000","last_clean":"2024-09-10T05:14:36.587512+0000","last_became_active":"2024-09-10T05:11:35.753663+0000","last_became_peered":"2024-09-10T05:11:35.753663+0000","last_unstale":"2024-09-10T05:14:36.587512+0000","last_undegraded":"2024-09-10T05:14:36.587512+0000","last_fullsized":"2024-09-10T05:14:36.587512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.071659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.125804+0000","last_change":"2024-09-10T05:11:37.755275+0000","last_active":"2024-09-10T05:14:36.125804+0000","last_peered":"2024-09-10T05:14:36.125804+0000","last_clean":"2024-09-10T05:14:36.125804+0000","last_became_active":"2024-09-10T05:11:37.754959+0000","last_became_peered":"2024-09-10T05:11:37.754959+0000","last_unstale":"2024-09-10T05:14:36.125804+0000","last_undegraded":"2024-09-10T05:14:36.125804+0000","last_fullsized":"2024-09-10T05:14:36.125804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:34:33.810681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'17","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:45.915314+0000","last_change":"2024-09-10T05:11:29.722535+0000","last_active":"2024-09-10T05:13:45.915314+0000","last_peered":"2024-09-10T05:13:45.915314+0000","last_clean":"2024-09-10T05:13:45.915314+0000","last_became_active":"2024-09-10T05:11:29.722267+0000","last_became_peered":"2024-09-10T05:11:29.722267+0000","last_unstale":"2024-09-10T05:13:45.915314+0000","last_undegraded":"2024-09-10T05:13:45.915314+0000","last_fullsized":"2024-09-10T05:13:45.915314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:18.707927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.334065+0000","last_change":"2024-09-10T05:11:27.732198+0000","last_active":"2024-09-10T05:14:36.334065+0000","last_peered":"2024-09-10T05:14:36.334065+0000","last_clean":"2024-09-10T05:14:36.334065+0000","last_became_active":"2024-09-10T05:11:27.731909+0000","last_became_peered":"2024-09-10T05:11:27.731909+0000","last_unstale":"2024-09-10T05:14:36.334065+0000","last_undegraded":"2024-09-10T05:14:36.334065+0000","last_fullsized":"2024-09-10T05:14:36.334065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:44.836107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957106+0000","last_change":"2024-09-10T05:11:31.733054+0000","last_active":"2024-09-10T05:12:04.957106+0000","last_peered":"2024-09-10T05:12:04.957106+0000","last_clean":"2024-09-10T05:12:04.957106+0000","last_became_active":"2024-09-10T05:11:31.732807+0000","last_became_peered":"2024-09-10T05:11:31.732807+0000","last_unstale":"2024-09-10T05:12:04.957106+0000","last_undegraded":"2024-09-10T05:12:04.957106+0000","last_fullsized":"2024-09-10T05:12:04.957106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:45.290579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'66","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.273739+0000","last_change":"2024-09-10T05:11:33.747177+0000","last_active":"2024-09-10T05:13:34.273739+0000","last_peered":"2024-09-10T05:13:34.273739+0000","last_clean":"2024-09-10T05:13:34.273739+0000","last_became_active":"2024-09-10T05:11:33.745449+0000","last_became_peered":"2024-09-10T05:11:33.745449+0000","last_unstale":"2024-09-10T05:13:34.273739+0000","last_undegraded":"2024-09-10T05:13:34.273739+0000","last_fullsized":"2024-09-10T05:13:34.273739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:08.744407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956380+0000","last_change":"2024-09-10T05:11:35.748171+0000","last_active":"2024-09-10T05:12:04.956380+0000","last_peered":"2024-09-10T05:12:04.956380+0000","last_clean":"2024-09-10T05:12:04.956380+0000","last_became_active":"2024-09-10T05:11:35.747913+0000","last_became_peered":"2024-09-10T05:11:35.747913+0000","last_unstale":"2024-09-10T05:12:04.956380+0000","last_undegraded":"2024-09-10T05:12:04.956380+0000","last_fullsized":"2024-09-10T05:12:04.956380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:43.800560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'20","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.564815+0000","last_change":"2024-09-10T05:11:37.755327+0000","last_active":"2024-09-10T05:14:36.564815+0000","last_peered":"2024-09-10T05:14:36.564815+0000","last_clean":"2024-09-10T05:14:36.564815+0000","last_became_active":"2024-09-10T05:11:37.754915+0000","last_became_peered":"2024-09-10T05:11:37.754915+0000","last_unstale":"2024-09-10T05:14:36.564815+0000","last_undegraded":"2024-09-10T05:14:36.564815+0000","last_fullsized":"2024-09-10T05:14:36.564815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:57.393330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'14","reported_seq":78,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107522+0000","last_change":"2024-09-10T05:11:29.728158+0000","last_active":"2024-09-10T05:14:36.107522+0000","last_peered":"2024-09-10T05:14:36.107522+0000","last_clean":"2024-09-10T05:14:36.107522+0000","last_became_active":"2024-09-10T05:11:29.727349+0000","last_became_peered":"2024-09-10T05:11:29.727349+0000","last_unstale":"2024-09-10T05:14:36.107522+0000","last_undegraded":"2024-09-10T05:14:36.107522+0000","last_fullsized":"2024-09-10T05:14:36.107522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.550005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957300+0000","last_change":"2024-09-10T05:11:27.718217+0000","last_active":"2024-09-10T05:12:04.957300+0000","last_peered":"2024-09-10T05:12:04.957300+0000","last_clean":"2024-09-10T05:12:04.957300+0000","last_became_active":"2024-09-10T05:11:27.717887+0000","last_became_peered":"2024-09-10T05:11:27.717887+0000","last_unstale":"2024-09-10T05:12:04.957300+0000","last_undegraded":"2024-09-10T05:12:04.957300+0000","last_fullsized":"2024-09-10T05:12:04.957300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:12.698794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959422+0000","last_change":"2024-09-10T05:11:31.735674+0000","last_active":"2024-09-10T05:12:04.959422+0000","last_peered":"2024-09-10T05:12:04.959422+0000","last_clean":"2024-09-10T05:12:04.959422+0000","last_became_active":"2024-09-10T05:11:31.735386+0000","last_became_peered":"2024-09-10T05:11:31.735386+0000","last_unstale":"2024-09-10T05:12:04.959422+0000","last_undegraded":"2024-09-10T05:12:04.959422+0000","last_fullsized":"2024-09-10T05:12:04.959422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:05.541110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'38","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.253218+0000","last_change":"2024-09-10T05:11:33.744354+0000","last_active":"2024-09-10T05:13:34.253218+0000","last_peered":"2024-09-10T05:13:34.253218+0000","last_clean":"2024-09-10T05:13:34.253218+0000","last_became_active":"2024-09-10T05:11:33.744026+0000","last_became_peered":"2024-09-10T05:11:33.744026+0000","last_unstale":"2024-09-10T05:13:34.253218+0000","last_undegraded":"2024-09-10T05:13:34.253218+0000","last_fullsized":"2024-09-10T05:13:34.253218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.017634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960608+0000","last_change":"2024-09-10T05:11:35.749447+0000","last_active":"2024-09-10T05:12:04.960608+0000","last_peered":"2024-09-10T05:12:04.960608+0000","last_clean":"2024-09-10T05:12:04.960608+0000","last_became_active":"2024-09-10T05:11:35.748874+0000","last_became_peered":"2024-09-10T05:11:35.748874+0000","last_unstale":"2024-09-10T05:12:04.960608+0000","last_undegraded":"2024-09-10T05:12:04.960608+0000","last_fullsized":"2024-09-10T05:12:04.960608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:09.658936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'9","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.113777+0000","last_change":"2024-09-10T05:11:37.768186+0000","last_active":"2024-09-10T05:14:36.113777+0000","last_peered":"2024-09-10T05:14:36.113777+0000","last_clean":"2024-09-10T05:14:36.113777+0000","last_became_active":"2024-09-10T05:11:37.767895+0000","last_became_peered":"2024-09-10T05:11:37.767895+0000","last_unstale":"2024-09-10T05:14:36.113777+0000","last_undegraded":"2024-09-10T05:14:36.113777+0000","last_fullsized":"2024-09-10T05:14:36.113777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:10.944772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'16","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604812+0000","last_change":"2024-09-10T05:11:29.734119+0000","last_active":"2024-09-10T05:13:32.604812+0000","last_peered":"2024-09-10T05:13:32.604812+0000","last_clean":"2024-09-10T05:13:32.604812+0000","last_became_active":"2024-09-10T05:11:29.733870+0000","last_became_peered":"2024-09-10T05:11:29.733870+0000","last_unstale":"2024-09-10T05:13:32.604812+0000","last_undegraded":"2024-09-10T05:13:32.604812+0000","last_fullsized":"2024-09-10T05:13:32.604812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:25:17.874072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956901+0000","last_change":"2024-09-10T05:11:27.726184+0000","last_active":"2024-09-10T05:12:04.956901+0000","last_peered":"2024-09-10T05:12:04.956901+0000","last_clean":"2024-09-10T05:12:04.956901+0000","last_became_active":"2024-09-10T05:11:27.725852+0000","last_became_peered":"2024-09-10T05:11:27.725852+0000","last_unstale":"2024-09-10T05:12:04.956901+0000","last_undegraded":"2024-09-10T05:12:04.956901+0000","last_fullsized":"2024-09-10T05:12:04.956901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:25.585863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957204+0000","last_change":"2024-09-10T05:11:31.734106+0000","last_active":"2024-09-10T05:12:04.957204+0000","last_peered":"2024-09-10T05:12:04.957204+0000","last_clean":"2024-09-10T05:12:04.957204+0000","last_became_active":"2024-09-10T05:11:31.733756+0000","last_became_peered":"2024-09-10T05:11:31.733756+0000","last_unstale":"2024-09-10T05:12:04.957204+0000","last_undegraded":"2024-09-10T05:12:04.957204+0000","last_fullsized":"2024-09-10T05:12:04.957204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:20.576939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'37","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:50.916277+0000","last_change":"2024-09-10T05:11:33.742119+0000","last_active":"2024-09-10T05:13:50.916277+0000","last_peered":"2024-09-10T05:13:50.916277+0000","last_clean":"2024-09-10T05:13:50.916277+0000","last_became_active":"2024-09-10T05:11:33.741848+0000","last_became_peered":"2024-09-10T05:11:33.741848+0000","last_unstale":"2024-09-10T05:13:50.916277+0000","last_undegraded":"2024-09-10T05:13:50.916277+0000","last_fullsized":"2024-09-10T05:13:50.916277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:58.109463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'282","reported_seq":452,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.569053+0000","last_change":"2024-09-10T05:11:35.752932+0000","last_active":"2024-09-10T05:14:36.569053+0000","last_peered":"2024-09-10T05:14:36.569053+0000","last_clean":"2024-09-10T05:14:36.569053+0000","last_became_active":"2024-09-10T05:11:35.752511+0000","last_became_peered":"2024-09-10T05:11:35.752511+0000","last_unstale":"2024-09-10T05:14:36.569053+0000","last_undegraded":"2024-09-10T05:14:36.569053+0000","last_fullsized":"2024-09-10T05:14:36.569053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:09.522467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'14","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:43.909368+0000","last_change":"2024-09-10T05:11:37.758779+0000","last_active":"2024-09-10T05:13:43.909368+0000","last_peered":"2024-09-10T05:13:43.909368+0000","last_clean":"2024-09-10T05:13:43.909368+0000","last_became_active":"2024-09-10T05:11:37.758381+0000","last_became_peered":"2024-09-10T05:11:37.758381+0000","last_unstale":"2024-09-10T05:13:43.909368+0000","last_undegraded":"2024-09-10T05:13:43.909368+0000","last_fullsized":"2024-09-10T05:13:43.909368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:32.090333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'14","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417408+0000","last_change":"2024-09-10T05:11:29.722434+0000","last_active":"2024-09-10T05:14:36.417408+0000","last_peered":"2024-09-10T05:14:36.417408+0000","last_clean":"2024-09-10T05:14:36.417408+0000","last_became_active":"2024-09-10T05:11:29.722170+0000","last_became_peered":"2024-09-10T05:11:29.722170+0000","last_unstale":"2024-09-10T05:14:36.417408+0000","last_undegraded":"2024-09-10T05:14:36.417408+0000","last_fullsized":"2024-09-10T05:14:36.417408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.550005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.331217+0000","last_change":"2024-09-10T05:11:27.735604+0000","last_active":"2024-09-10T05:14:36.331217+0000","last_peered":"2024-09-10T05:14:36.331217+0000","last_clean":"2024-09-10T05:14:36.331217+0000","last_became_active":"2024-09-10T05:11:27.732591+0000","last_became_peered":"2024-09-10T05:11:27.732591+0000","last_unstale":"2024-09-10T05:14:36.331217+0000","last_undegraded":"2024-09-10T05:14:36.331217+0000","last_fullsized":"2024-09-10T05:14:36.331217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:31.318349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":414,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.322657+0000","last_change":"2024-09-10T05:11:31.735002+0000","last_active":"2024-09-10T05:13:35.322657+0000","last_peered":"2024-09-10T05:13:35.322657+0000","last_clean":"2024-09-10T05:13:35.322657+0000","last_became_active":"2024-09-10T05:11:31.734714+0000","last_became_peered":"2024-09-10T05:11:31.734714+0000","last_unstale":"2024-09-10T05:13:35.322657+0000","last_undegraded":"2024-09-10T05:13:35.322657+0000","last_fullsized":"2024-09-10T05:13:35.322657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:15.409455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958372+0000","last_change":"2024-09-10T05:11:33.747604+0000","last_active":"2024-09-10T05:12:04.958372+0000","last_peered":"2024-09-10T05:12:04.958372+0000","last_clean":"2024-09-10T05:12:04.958372+0000","last_became_active":"2024-09-10T05:11:33.747376+0000","last_became_peered":"2024-09-10T05:11:33.747376+0000","last_unstale":"2024-09-10T05:12:04.958372+0000","last_undegraded":"2024-09-10T05:12:04.958372+0000","last_fullsized":"2024-09-10T05:12:04.958372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:06.584551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'282","reported_seq":463,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.578120+0000","last_change":"2024-09-10T05:11:35.751653+0000","last_active":"2024-09-10T05:14:36.578120+0000","last_peered":"2024-09-10T05:14:36.578120+0000","last_clean":"2024-09-10T05:14:36.578120+0000","last_became_active":"2024-09-10T05:11:35.751352+0000","last_became_peered":"2024-09-10T05:11:35.751352+0000","last_unstale":"2024-09-10T05:14:36.578120+0000","last_undegraded":"2024-09-10T05:14:36.578120+0000","last_fullsized":"2024-09-10T05:14:36.578120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:50.857756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.203681+0000","last_change":"2024-09-10T05:11:37.757022+0000","last_active":"2024-09-10T05:14:36.203681+0000","last_peered":"2024-09-10T05:14:36.203681+0000","last_clean":"2024-09-10T05:14:36.203681+0000","last_became_active":"2024-09-10T05:11:37.756734+0000","last_became_peered":"2024-09-10T05:11:37.756734+0000","last_unstale":"2024-09-10T05:14:36.203681+0000","last_undegraded":"2024-09-10T05:14:36.203681+0000","last_fullsized":"2024-09-10T05:14:36.203681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:18.190348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'24","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382763+0000","last_change":"2024-09-10T05:11:29.735311+0000","last_active":"2024-09-10T05:14:36.382763+0000","last_peered":"2024-09-10T05:14:36.382763+0000","last_clean":"2024-09-10T05:14:36.382763+0000","last_became_active":"2024-09-10T05:11:29.735032+0000","last_became_peered":"2024-09-10T05:11:29.735032+0000","last_unstale":"2024-09-10T05:14:36.382763+0000","last_undegraded":"2024-09-10T05:14:36.382763+0000","last_fullsized":"2024-09-10T05:14:36.382763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:36.894039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914802+0000","last_change":"2024-09-10T05:11:27.734962+0000","last_active":"2024-09-10T05:13:40.914802+0000","last_peered":"2024-09-10T05:13:40.914802+0000","last_clean":"2024-09-10T05:13:40.914802+0000","last_became_active":"2024-09-10T05:11:27.734204+0000","last_became_peered":"2024-09-10T05:11:27.734204+0000","last_unstale":"2024-09-10T05:13:40.914802+0000","last_undegraded":"2024-09-10T05:13:40.914802+0000","last_fullsized":"2024-09-10T05:13:40.914802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:06.500114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962223+0000","last_change":"2024-09-10T05:11:31.737418+0000","last_active":"2024-09-10T05:12:04.962223+0000","last_peered":"2024-09-10T05:12:04.962223+0000","last_clean":"2024-09-10T05:12:04.962223+0000","last_became_active":"2024-09-10T05:11:31.736841+0000","last_became_peered":"2024-09-10T05:11:31.736841+0000","last_unstale":"2024-09-10T05:12:04.962223+0000","last_undegraded":"2024-09-10T05:12:04.962223+0000","last_fullsized":"2024-09-10T05:12:04.962223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:39.906395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'39","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.266836+0000","last_change":"2024-09-10T05:11:33.744918+0000","last_active":"2024-09-10T05:13:34.266836+0000","last_peered":"2024-09-10T05:13:34.266836+0000","last_clean":"2024-09-10T05:13:34.266836+0000","last_became_active":"2024-09-10T05:11:33.744394+0000","last_became_peered":"2024-09-10T05:11:33.744394+0000","last_unstale":"2024-09-10T05:13:34.266836+0000","last_undegraded":"2024-09-10T05:13:34.266836+0000","last_fullsized":"2024-09-10T05:13:34.266836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:42.791441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959396+0000","last_change":"2024-09-10T05:11:35.750802+0000","last_active":"2024-09-10T05:12:04.959396+0000","last_peered":"2024-09-10T05:12:04.959396+0000","last_clean":"2024-09-10T05:12:04.959396+0000","last_became_active":"2024-09-10T05:11:35.750450+0000","last_became_peered":"2024-09-10T05:11:35.750450+0000","last_unstale":"2024-09-10T05:12:04.959396+0000","last_undegraded":"2024-09-10T05:12:04.959396+0000","last_fullsized":"2024-09-10T05:12:04.959396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:00.422593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'6","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.453623+0000","last_change":"2024-09-10T05:11:37.757621+0000","last_active":"2024-09-10T05:14:36.453623+0000","last_peered":"2024-09-10T05:14:36.453623+0000","last_clean":"2024-09-10T05:14:36.453623+0000","last_became_active":"2024-09-10T05:11:37.757289+0000","last_became_peered":"2024-09-10T05:11:37.757289+0000","last_unstale":"2024-09-10T05:14:36.453623+0000","last_undegraded":"2024-09-10T05:14:36.453623+0000","last_fullsized":"2024-09-10T05:14:36.453623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:57.261211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'8","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417687+0000","last_change":"2024-09-10T05:11:29.734971+0000","last_active":"2024-09-10T05:14:36.417687+0000","last_peered":"2024-09-10T05:14:36.417687+0000","last_clean":"2024-09-10T05:14:36.417687+0000","last_became_active":"2024-09-10T05:11:29.734367+0000","last_became_peered":"2024-09-10T05:11:29.734367+0000","last_unstale":"2024-09-10T05:14:36.417687+0000","last_undegraded":"2024-09-10T05:14:36.417687+0000","last_fullsized":"2024-09-10T05:14:36.417687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:48.993029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957132+0000","last_change":"2024-09-10T05:11:14.294244+0000","last_active":"2024-09-10T05:12:04.957132+0000","last_peered":"2024-09-10T05:12:04.957132+0000","last_clean":"2024-09-10T05:12:04.957132+0000","last_became_active":"2024-09-10T05:11:14.293121+0000","last_became_peered":"2024-09-10T05:11:14.293121+0000","last_unstale":"2024-09-10T05:12:04.957132+0000","last_undegraded":"2024-09-10T05:12:04.957132+0000","last_fullsized":"2024-09-10T05:12:04.957132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:12.494055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:12.494055+0000","last_clean_scrub_stamp":"2024-09-10T05:11:12.494055+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:00.347397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955461+0000","last_change":"2024-09-10T05:11:18.533277+0000","last_active":"2024-09-10T05:12:04.955461+0000","last_peered":"2024-09-10T05:12:04.955461+0000","last_clean":"2024-09-10T05:12:04.955461+0000","last_became_active":"2024-09-10T05:11:16.531926+0000","last_became_peered":"2024-09-10T05:11:16.531926+0000","last_unstale":"2024-09-10T05:12:04.955461+0000","last_undegraded":"2024-09-10T05:12:04.955461+0000","last_fullsized":"2024-09-10T05:12:04.955461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:44.106335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121101,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955445+0000","last_change":"2024-09-10T05:11:27.736386+0000","last_active":"2024-09-10T05:12:04.955445+0000","last_peered":"2024-09-10T05:12:04.955445+0000","last_clean":"2024-09-10T05:12:04.955445+0000","last_became_active":"2024-09-10T05:11:27.735941+0000","last_became_peered":"2024-09-10T05:11:27.735941+0000","last_unstale":"2024-09-10T05:12:04.955445+0000","last_undegraded":"2024-09-10T05:12:04.955445+0000","last_fullsized":"2024-09-10T05:12:04.955445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:05.735103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960299+0000","last_change":"2024-09-10T05:11:31.736397+0000","last_active":"2024-09-10T05:12:04.960299+0000","last_peered":"2024-09-10T05:12:04.960299+0000","last_clean":"2024-09-10T05:12:04.960299+0000","last_became_active":"2024-09-10T05:11:31.736104+0000","last_became_peered":"2024-09-10T05:11:31.736104+0000","last_unstale":"2024-09-10T05:12:04.960299+0000","last_undegraded":"2024-09-10T05:12:04.960299+0000","last_fullsized":"2024-09-10T05:12:04.960299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:58.631203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'85","reported_seq":161,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.278155+0000","last_change":"2024-09-10T05:11:33.744321+0000","last_active":"2024-09-10T05:13:34.278155+0000","last_peered":"2024-09-10T05:13:34.278155+0000","last_clean":"2024-09-10T05:13:34.278155+0000","last_became_active":"2024-09-10T05:11:33.743933+0000","last_became_peered":"2024-09-10T05:11:33.743933+0000","last_unstale":"2024-09-10T05:13:34.278155+0000","last_undegraded":"2024-09-10T05:13:34.278155+0000","last_fullsized":"2024-09-10T05:13:34.278155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:30.903532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957924+0000","last_change":"2024-09-10T05:11:35.750549+0000","last_active":"2024-09-10T05:12:04.957924+0000","last_peered":"2024-09-10T05:12:04.957924+0000","last_clean":"2024-09-10T05:12:04.957924+0000","last_became_active":"2024-09-10T05:11:35.750248+0000","last_became_peered":"2024-09-10T05:11:35.750248+0000","last_unstale":"2024-09-10T05:12:04.957924+0000","last_undegraded":"2024-09-10T05:12:04.957924+0000","last_fullsized":"2024-09-10T05:12:04.957924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:19.363818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'85","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.427998+0000","last_change":"2024-09-10T05:11:37.755526+0000","last_active":"2024-09-10T05:14:36.427998+0000","last_peered":"2024-09-10T05:14:36.427998+0000","last_clean":"2024-09-10T05:14:36.427998+0000","last_became_active":"2024-09-10T05:11:37.755239+0000","last_became_peered":"2024-09-10T05:11:37.755239+0000","last_unstale":"2024-09-10T05:14:36.427998+0000","last_undegraded":"2024-09-10T05:14:36.427998+0000","last_fullsized":"2024-09-10T05:14:36.427998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:13.536289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.387697+0000","last_change":"2024-09-10T05:11:29.732838+0000","last_active":"2024-09-10T05:14:36.387697+0000","last_peered":"2024-09-10T05:14:36.387697+0000","last_clean":"2024-09-10T05:14:36.387697+0000","last_became_active":"2024-09-10T05:11:29.732560+0000","last_became_peered":"2024-09-10T05:11:29.732560+0000","last_unstale":"2024-09-10T05:14:36.387697+0000","last_undegraded":"2024-09-10T05:14:36.387697+0000","last_fullsized":"2024-09-10T05:14:36.387697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:38.766836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954364+0000","last_change":"2024-09-10T05:11:18.532549+0000","last_active":"2024-09-10T05:12:04.954364+0000","last_peered":"2024-09-10T05:12:04.954364+0000","last_clean":"2024-09-10T05:12:04.954364+0000","last_became_active":"2024-09-10T05:11:16.531911+0000","last_became_peered":"2024-09-10T05:11:16.531911+0000","last_unstale":"2024-09-10T05:12:04.954364+0000","last_undegraded":"2024-09-10T05:12:04.954364+0000","last_fullsized":"2024-09-10T05:12:04.954364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:51:16.716892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039105900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.649449+0000","last_change":"2024-09-10T05:11:27.713561+0000","last_active":"2024-09-10T05:12:09.649449+0000","last_peered":"2024-09-10T05:12:09.649449+0000","last_clean":"2024-09-10T05:12:09.649449+0000","last_became_active":"2024-09-10T05:11:27.713026+0000","last_became_peered":"2024-09-10T05:11:27.713026+0000","last_unstale":"2024-09-10T05:12:09.649449+0000","last_undegraded":"2024-09-10T05:12:09.649449+0000","last_fullsized":"2024-09-10T05:12:09.649449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:55.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961506+0000","last_change":"2024-09-10T05:11:31.738104+0000","last_active":"2024-09-10T05:12:04.961506+0000","last_peered":"2024-09-10T05:12:04.961506+0000","last_clean":"2024-09-10T05:12:04.961506+0000","last_became_active":"2024-09-10T05:11:31.737199+0000","last_became_peered":"2024-09-10T05:11:31.737199+0000","last_unstale":"2024-09-10T05:12:04.961506+0000","last_undegraded":"2024-09-10T05:12:04.961506+0000","last_fullsized":"2024-09-10T05:12:04.961506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:08.807684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'281","reported_seq":490,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813328+0000","last_change":"2024-09-10T05:11:33.744372+0000","last_active":"2024-09-10T05:14:31.813328+0000","last_peered":"2024-09-10T05:14:31.813328+0000","last_clean":"2024-09-10T05:14:31.813328+0000","last_became_active":"2024-09-10T05:11:33.744103+0000","last_became_peered":"2024-09-10T05:11:33.744103+0000","last_unstale":"2024-09-10T05:14:31.813328+0000","last_undegraded":"2024-09-10T05:14:31.813328+0000","last_fullsized":"2024-09-10T05:14:31.813328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:33.869492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":372,"num_read_kb":371,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956847+0000","last_change":"2024-09-10T05:11:35.749117+0000","last_active":"2024-09-10T05:12:04.956847+0000","last_peered":"2024-09-10T05:12:04.956847+0000","last_clean":"2024-09-10T05:12:04.956847+0000","last_became_active":"2024-09-10T05:11:35.748767+0000","last_became_peered":"2024-09-10T05:11:35.748767+0000","last_unstale":"2024-09-10T05:12:04.956847+0000","last_undegraded":"2024-09-10T05:12:04.956847+0000","last_fullsized":"2024-09-10T05:12:04.956847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:02.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.966773+0000","last_change":"2024-09-10T05:11:37.758407+0000","last_active":"2024-09-10T05:12:51.966773+0000","last_peered":"2024-09-10T05:12:51.966773+0000","last_clean":"2024-09-10T05:12:51.966773+0000","last_became_active":"2024-09-10T05:11:37.758114+0000","last_became_peered":"2024-09-10T05:11:37.758114+0000","last_unstale":"2024-09-10T05:12:51.966773+0000","last_undegraded":"2024-09-10T05:12:51.966773+0000","last_fullsized":"2024-09-10T05:12:51.966773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:43.659998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'14","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417308+0000","last_change":"2024-09-10T05:11:29.724542+0000","last_active":"2024-09-10T05:14:36.417308+0000","last_peered":"2024-09-10T05:14:36.417308+0000","last_clean":"2024-09-10T05:14:36.417308+0000","last_became_active":"2024-09-10T05:11:29.723609+0000","last_became_peered":"2024-09-10T05:11:29.723609+0000","last_unstale":"2024-09-10T05:14:36.417308+0000","last_undegraded":"2024-09-10T05:14:36.417308+0000","last_fullsized":"2024-09-10T05:14:36.417308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:37.264959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956636+0000","last_change":"2024-09-10T05:11:18.530458+0000","last_active":"2024-09-10T05:12:04.956636+0000","last_peered":"2024-09-10T05:12:04.956636+0000","last_clean":"2024-09-10T05:12:04.956636+0000","last_became_active":"2024-09-10T05:11:16.530448+0000","last_became_peered":"2024-09-10T05:11:16.530448+0000","last_unstale":"2024-09-10T05:12:04.956636+0000","last_undegraded":"2024-09-10T05:12:04.956636+0000","last_fullsized":"2024-09-10T05:12:04.956636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:12.102135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036982300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.027950+0000","last_change":"2024-09-10T05:11:27.715078+0000","last_active":"2024-09-10T05:14:36.027950+0000","last_peered":"2024-09-10T05:14:36.027950+0000","last_clean":"2024-09-10T05:14:36.027950+0000","last_became_active":"2024-09-10T05:11:27.714299+0000","last_became_peered":"2024-09-10T05:11:27.714299+0000","last_unstale":"2024-09-10T05:14:36.027950+0000","last_undegraded":"2024-09-10T05:14:36.027950+0000","last_fullsized":"2024-09-10T05:14:36.027950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:12.065688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963356+0000","last_change":"2024-09-10T05:11:31.731588+0000","last_active":"2024-09-10T05:12:04.963356+0000","last_peered":"2024-09-10T05:12:04.963356+0000","last_clean":"2024-09-10T05:12:04.963356+0000","last_became_active":"2024-09-10T05:11:31.730978+0000","last_became_peered":"2024-09-10T05:11:31.730978+0000","last_unstale":"2024-09-10T05:12:04.963356+0000","last_undegraded":"2024-09-10T05:12:04.963356+0000","last_fullsized":"2024-09-10T05:12:04.963356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:07.052816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'17","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813393+0000","last_change":"2024-09-10T05:11:33.746382+0000","last_active":"2024-09-10T05:14:31.813393+0000","last_peered":"2024-09-10T05:14:31.813393+0000","last_clean":"2024-09-10T05:14:31.813393+0000","last_became_active":"2024-09-10T05:11:33.746102+0000","last_became_peered":"2024-09-10T05:11:33.746102+0000","last_unstale":"2024-09-10T05:14:31.813393+0000","last_undegraded":"2024-09-10T05:14:31.813393+0000","last_fullsized":"2024-09-10T05:14:31.813393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:53.746336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957971+0000","last_change":"2024-09-10T05:11:35.753872+0000","last_active":"2024-09-10T05:12:04.957971+0000","last_peered":"2024-09-10T05:12:04.957971+0000","last_clean":"2024-09-10T05:12:04.957971+0000","last_became_active":"2024-09-10T05:11:35.753342+0000","last_became_peered":"2024-09-10T05:11:35.753342+0000","last_unstale":"2024-09-10T05:12:04.957971+0000","last_undegraded":"2024-09-10T05:12:04.957971+0000","last_fullsized":"2024-09-10T05:12:04.957971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:37.752504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955113+0000","last_change":"2024-09-10T05:11:37.769011+0000","last_active":"2024-09-10T05:12:04.955113+0000","last_peered":"2024-09-10T05:12:04.955113+0000","last_clean":"2024-09-10T05:12:04.955113+0000","last_became_active":"2024-09-10T05:11:37.767788+0000","last_became_peered":"2024-09-10T05:11:37.767788+0000","last_unstale":"2024-09-10T05:12:04.955113+0000","last_undegraded":"2024-09-10T05:12:04.955113+0000","last_fullsized":"2024-09-10T05:12:04.955113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:55.792983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'6","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417182+0000","last_change":"2024-09-10T05:11:29.727352+0000","last_active":"2024-09-10T05:14:36.417182+0000","last_peered":"2024-09-10T05:14:36.417182+0000","last_clean":"2024-09-10T05:14:36.417182+0000","last_became_active":"2024-09-10T05:11:29.727022+0000","last_became_peered":"2024-09-10T05:11:29.727022+0000","last_unstale":"2024-09-10T05:14:36.417182+0000","last_undegraded":"2024-09-10T05:14:36.417182+0000","last_fullsized":"2024-09-10T05:14:36.417182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:07.042493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955161+0000","last_change":"2024-09-10T05:11:18.533201+0000","last_active":"2024-09-10T05:12:04.955161+0000","last_peered":"2024-09-10T05:12:04.955161+0000","last_clean":"2024-09-10T05:12:04.955161+0000","last_became_active":"2024-09-10T05:11:16.530756+0000","last_became_peered":"2024-09-10T05:11:16.530756+0000","last_unstale":"2024-09-10T05:12:04.955161+0000","last_undegraded":"2024-09-10T05:12:04.955161+0000","last_fullsized":"2024-09-10T05:12:04.955161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:46.741517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047784,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960447+0000","last_change":"2024-09-10T05:11:27.722242+0000","last_active":"2024-09-10T05:12:04.960447+0000","last_peered":"2024-09-10T05:12:04.960447+0000","last_clean":"2024-09-10T05:12:04.960447+0000","last_became_active":"2024-09-10T05:11:27.718333+0000","last_became_peered":"2024-09-10T05:11:27.718333+0000","last_unstale":"2024-09-10T05:12:04.960447+0000","last_undegraded":"2024-09-10T05:12:04.960447+0000","last_fullsized":"2024-09-10T05:12:04.960447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:32.972378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:05.900504+0000","last_change":"2024-09-10T05:12:04.965299+0000","last_active":"2024-09-10T05:12:05.900504+0000","last_peered":"2024-09-10T05:12:05.900504+0000","last_clean":"2024-09-10T05:12:05.900504+0000","last_became_active":"2024-09-10T05:12:04.964996+0000","last_became_peered":"2024-09-10T05:12:04.964996+0000","last_unstale":"2024-09-10T05:12:05.900504+0000","last_undegraded":"2024-09-10T05:12:05.900504+0000","last_fullsized":"2024-09-10T05:12:05.900504+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:02.241258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"37'13","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.691724+0000","last_change":"2024-09-10T05:11:33.743920+0000","last_active":"2024-09-10T05:14:35.691724+0000","last_peered":"2024-09-10T05:14:35.691724+0000","last_clean":"2024-09-10T05:14:35.691724+0000","last_became_active":"2024-09-10T05:11:33.743292+0000","last_became_peered":"2024-09-10T05:11:33.743292+0000","last_unstale":"2024-09-10T05:14:35.691724+0000","last_undegraded":"2024-09-10T05:14:35.691724+0000","last_fullsized":"2024-09-10T05:14:35.691724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:18.442235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960791+0000","last_change":"2024-09-10T05:11:35.752348+0000","last_active":"2024-09-10T05:12:04.960791+0000","last_peered":"2024-09-10T05:12:04.960791+0000","last_clean":"2024-09-10T05:12:04.960791+0000","last_became_active":"2024-09-10T05:11:35.751982+0000","last_became_peered":"2024-09-10T05:11:35.751982+0000","last_unstale":"2024-09-10T05:12:04.960791+0000","last_undegraded":"2024-09-10T05:12:04.960791+0000","last_fullsized":"2024-09-10T05:12:04.960791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:53.013137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.434600+0000","last_change":"2024-09-10T05:11:37.762596+0000","last_active":"2024-09-10T05:13:35.434600+0000","last_peered":"2024-09-10T05:13:35.434600+0000","last_clean":"2024-09-10T05:13:35.434600+0000","last_became_active":"2024-09-10T05:11:37.762327+0000","last_became_peered":"2024-09-10T05:11:37.762327+0000","last_unstale":"2024-09-10T05:13:35.434600+0000","last_undegraded":"2024-09-10T05:13:35.434600+0000","last_fullsized":"2024-09-10T05:13:35.434600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:33.354245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'16","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339389+0000","last_change":"2024-09-10T05:11:29.731028+0000","last_active":"2024-09-10T05:14:36.339389+0000","last_peered":"2024-09-10T05:14:36.339389+0000","last_clean":"2024-09-10T05:14:36.339389+0000","last_became_active":"2024-09-10T05:11:29.730589+0000","last_became_peered":"2024-09-10T05:11:29.730589+0000","last_unstale":"2024-09-10T05:14:36.339389+0000","last_undegraded":"2024-09-10T05:14:36.339389+0000","last_fullsized":"2024-09-10T05:14:36.339389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:05.100041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959159+0000","last_change":"2024-09-10T05:11:27.718564+0000","last_active":"2024-09-10T05:12:04.959159+0000","last_peered":"2024-09-10T05:12:04.959159+0000","last_clean":"2024-09-10T05:12:04.959159+0000","last_became_active":"2024-09-10T05:11:27.716023+0000","last_became_peered":"2024-09-10T05:11:27.716023+0000","last_unstale":"2024-09-10T05:12:04.959159+0000","last_undegraded":"2024-09-10T05:12:04.959159+0000","last_fullsized":"2024-09-10T05:12:04.959159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:47:35.592580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957535+0000","last_change":"2024-09-10T05:11:18.534946+0000","last_active":"2024-09-10T05:12:04.957535+0000","last_peered":"2024-09-10T05:12:04.957535+0000","last_clean":"2024-09-10T05:12:04.957535+0000","last_became_active":"2024-09-10T05:11:16.532795+0000","last_became_peered":"2024-09-10T05:11:16.532795+0000","last_unstale":"2024-09-10T05:12:04.957535+0000","last_undegraded":"2024-09-10T05:12:04.957535+0000","last_fullsized":"2024-09-10T05:12:04.957535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:22.750871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060128199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:38.908572+0000","last_change":"2024-09-10T05:11:31.734963+0000","last_active":"2024-09-10T05:13:38.908572+0000","last_peered":"2024-09-10T05:13:38.908572+0000","last_clean":"2024-09-10T05:13:38.908572+0000","last_became_active":"2024-09-10T05:11:31.734707+0000","last_became_peered":"2024-09-10T05:11:31.734707+0000","last_unstale":"2024-09-10T05:13:38.908572+0000","last_undegraded":"2024-09-10T05:13:38.908572+0000","last_fullsized":"2024-09-10T05:13:38.908572+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:00.334943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'73","reported_seq":145,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.279404+0000","last_change":"2024-09-10T05:11:33.743569+0000","last_active":"2024-09-10T05:13:34.279404+0000","last_peered":"2024-09-10T05:13:34.279404+0000","last_clean":"2024-09-10T05:13:34.279404+0000","last_became_active":"2024-09-10T05:11:33.743238+0000","last_became_peered":"2024-09-10T05:11:33.743238+0000","last_unstale":"2024-09-10T05:13:34.279404+0000","last_undegraded":"2024-09-10T05:13:34.279404+0000","last_fullsized":"2024-09-10T05:13:34.279404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:26.759194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957685+0000","last_change":"2024-09-10T05:11:35.751255+0000","last_active":"2024-09-10T05:12:04.957685+0000","last_peered":"2024-09-10T05:12:04.957685+0000","last_clean":"2024-09-10T05:12:04.957685+0000","last_became_active":"2024-09-10T05:11:35.750830+0000","last_became_peered":"2024-09-10T05:11:35.750830+0000","last_unstale":"2024-09-10T05:12:04.957685+0000","last_undegraded":"2024-09-10T05:12:04.957685+0000","last_fullsized":"2024-09-10T05:12:04.957685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:07.959084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.612283+0000","last_change":"2024-09-10T05:11:37.759212+0000","last_active":"2024-09-10T05:13:35.612283+0000","last_peered":"2024-09-10T05:13:35.612283+0000","last_clean":"2024-09-10T05:13:35.612283+0000","last_became_active":"2024-09-10T05:11:37.758971+0000","last_became_peered":"2024-09-10T05:11:37.758971+0000","last_unstale":"2024-09-10T05:13:35.612283+0000","last_undegraded":"2024-09-10T05:13:35.612283+0000","last_fullsized":"2024-09-10T05:13:35.612283+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:10.652277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'14","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116914+0000","last_change":"2024-09-10T05:11:29.730327+0000","last_active":"2024-09-10T05:14:36.116914+0000","last_peered":"2024-09-10T05:14:36.116914+0000","last_clean":"2024-09-10T05:14:36.116914+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:14:36.116914+0000","last_undegraded":"2024-09-10T05:14:36.116914+0000","last_fullsized":"2024-09-10T05:14:36.116914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:07.743055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958331+0000","last_change":"2024-09-10T05:11:27.719090+0000","last_active":"2024-09-10T05:12:04.958331+0000","last_peered":"2024-09-10T05:12:04.958331+0000","last_clean":"2024-09-10T05:12:04.958331+0000","last_became_active":"2024-09-10T05:11:27.718756+0000","last_became_peered":"2024-09-10T05:11:27.718756+0000","last_unstale":"2024-09-10T05:12:04.958331+0000","last_undegraded":"2024-09-10T05:12:04.958331+0000","last_fullsized":"2024-09-10T05:12:04.958331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:48.332632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957276+0000","last_change":"2024-09-10T05:11:18.532627+0000","last_active":"2024-09-10T05:12:04.957276+0000","last_peered":"2024-09-10T05:12:04.957276+0000","last_clean":"2024-09-10T05:12:04.957276+0000","last_became_active":"2024-09-10T05:11:16.530746+0000","last_became_peered":"2024-09-10T05:11:16.530746+0000","last_unstale":"2024-09-10T05:12:04.957276+0000","last_undegraded":"2024-09-10T05:12:04.957276+0000","last_fullsized":"2024-09-10T05:12:04.957276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:33.333497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048256999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955118+0000","last_change":"2024-09-10T05:11:31.734598+0000","last_active":"2024-09-10T05:12:04.955118+0000","last_peered":"2024-09-10T05:12:04.955118+0000","last_clean":"2024-09-10T05:12:04.955118+0000","last_became_active":"2024-09-10T05:11:31.734333+0000","last_became_peered":"2024-09-10T05:11:31.734333+0000","last_unstale":"2024-09-10T05:12:04.955118+0000","last_undegraded":"2024-09-10T05:12:04.955118+0000","last_fullsized":"2024-09-10T05:12:04.955118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:04.362140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958360+0000","last_change":"2024-09-10T05:11:33.744326+0000","last_active":"2024-09-10T05:12:04.958360+0000","last_peered":"2024-09-10T05:12:04.958360+0000","last_clean":"2024-09-10T05:12:04.958360+0000","last_became_active":"2024-09-10T05:11:33.744011+0000","last_became_peered":"2024-09-10T05:11:33.744011+0000","last_unstale":"2024-09-10T05:12:04.958360+0000","last_undegraded":"2024-09-10T05:12:04.958360+0000","last_fullsized":"2024-09-10T05:12:04.958360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:25:21.898677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'282","reported_seq":346,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813409+0000","last_change":"2024-09-10T05:11:35.743851+0000","last_active":"2024-09-10T05:14:31.813409+0000","last_peered":"2024-09-10T05:14:31.813409+0000","last_clean":"2024-09-10T05:14:31.813409+0000","last_became_active":"2024-09-10T05:11:35.743571+0000","last_became_peered":"2024-09-10T05:11:35.743571+0000","last_unstale":"2024-09-10T05:14:31.813409+0000","last_undegraded":"2024-09-10T05:14:31.813409+0000","last_fullsized":"2024-09-10T05:14:31.813409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.416572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.602302+0000","last_change":"2024-09-10T05:11:37.764931+0000","last_active":"2024-09-10T05:13:32.602302+0000","last_peered":"2024-09-10T05:13:32.602302+0000","last_clean":"2024-09-10T05:13:32.602302+0000","last_became_active":"2024-09-10T05:11:37.764657+0000","last_became_peered":"2024-09-10T05:11:37.764657+0000","last_unstale":"2024-09-10T05:13:32.602302+0000","last_undegraded":"2024-09-10T05:13:32.602302+0000","last_fullsized":"2024-09-10T05:13:32.602302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:33.836899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382938+0000","last_change":"2024-09-10T05:11:29.735974+0000","last_active":"2024-09-10T05:14:36.382938+0000","last_peered":"2024-09-10T05:14:36.382938+0000","last_clean":"2024-09-10T05:14:36.382938+0000","last_became_active":"2024-09-10T05:11:29.734731+0000","last_became_peered":"2024-09-10T05:11:29.734731+0000","last_unstale":"2024-09-10T05:14:36.382938+0000","last_undegraded":"2024-09-10T05:14:36.382938+0000","last_fullsized":"2024-09-10T05:14:36.382938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:47.453260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961339+0000","last_change":"2024-09-10T05:11:27.723646+0000","last_active":"2024-09-10T05:12:04.961339+0000","last_peered":"2024-09-10T05:12:04.961339+0000","last_clean":"2024-09-10T05:12:04.961339+0000","last_became_active":"2024-09-10T05:11:27.723268+0000","last_became_peered":"2024-09-10T05:11:27.723268+0000","last_unstale":"2024-09-10T05:12:04.961339+0000","last_undegraded":"2024-09-10T05:12:04.961339+0000","last_fullsized":"2024-09-10T05:12:04.961339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:31.006213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958152+0000","last_change":"2024-09-10T05:11:18.534977+0000","last_active":"2024-09-10T05:12:04.958152+0000","last_peered":"2024-09-10T05:12:04.958152+0000","last_clean":"2024-09-10T05:12:04.958152+0000","last_became_active":"2024-09-10T05:11:16.531550+0000","last_became_peered":"2024-09-10T05:11:16.531550+0000","last_unstale":"2024-09-10T05:12:04.958152+0000","last_undegraded":"2024-09-10T05:12:04.958152+0000","last_fullsized":"2024-09-10T05:12:04.958152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:22.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063503699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955664+0000","last_change":"2024-09-10T05:11:31.734677+0000","last_active":"2024-09-10T05:12:04.955664+0000","last_peered":"2024-09-10T05:12:04.955664+0000","last_clean":"2024-09-10T05:12:04.955664+0000","last_became_active":"2024-09-10T05:11:31.734310+0000","last_became_peered":"2024-09-10T05:11:31.734310+0000","last_unstale":"2024-09-10T05:12:04.955664+0000","last_undegraded":"2024-09-10T05:12:04.955664+0000","last_fullsized":"2024-09-10T05:12:04.955664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:04.152181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'17","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.669838+0000","last_change":"2024-09-10T05:11:33.748918+0000","last_active":"2024-09-10T05:12:09.669838+0000","last_peered":"2024-09-10T05:12:09.669838+0000","last_clean":"2024-09-10T05:12:09.669838+0000","last_became_active":"2024-09-10T05:11:33.748603+0000","last_became_peered":"2024-09-10T05:11:33.748603+0000","last_unstale":"2024-09-10T05:12:09.669838+0000","last_undegraded":"2024-09-10T05:12:09.669838+0000","last_fullsized":"2024-09-10T05:12:09.669838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:30.495078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'282","reported_seq":389,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.565579+0000","last_change":"2024-09-10T05:11:35.746066+0000","last_active":"2024-09-10T05:14:36.565579+0000","last_peered":"2024-09-10T05:14:36.565579+0000","last_clean":"2024-09-10T05:14:36.565579+0000","last_became_active":"2024-09-10T05:11:35.745807+0000","last_became_peered":"2024-09-10T05:11:35.745807+0000","last_unstale":"2024-09-10T05:14:36.565579+0000","last_undegraded":"2024-09-10T05:14:36.565579+0000","last_fullsized":"2024-09-10T05:14:36.565579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:15.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960007+0000","last_change":"2024-09-10T05:11:37.762669+0000","last_active":"2024-09-10T05:12:04.960007+0000","last_peered":"2024-09-10T05:12:04.960007+0000","last_clean":"2024-09-10T05:12:04.960007+0000","last_became_active":"2024-09-10T05:11:37.762407+0000","last_became_peered":"2024-09-10T05:11:37.762407+0000","last_unstale":"2024-09-10T05:12:04.960007+0000","last_undegraded":"2024-09-10T05:12:04.960007+0000","last_fullsized":"2024-09-10T05:12:04.960007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:01.260628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.199374+0000","last_change":"2024-09-10T05:11:29.730717+0000","last_active":"2024-09-10T05:14:36.199374+0000","last_peered":"2024-09-10T05:14:36.199374+0000","last_clean":"2024-09-10T05:14:36.199374+0000","last_became_active":"2024-09-10T05:11:29.730285+0000","last_became_peered":"2024-09-10T05:11:29.730285+0000","last_unstale":"2024-09-10T05:14:36.199374+0000","last_undegraded":"2024-09-10T05:14:36.199374+0000","last_fullsized":"2024-09-10T05:14:36.199374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:27.593815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914614+0000","last_change":"2024-09-10T05:11:27.731410+0000","last_active":"2024-09-10T05:13:40.914614+0000","last_peered":"2024-09-10T05:13:40.914614+0000","last_clean":"2024-09-10T05:13:40.914614+0000","last_became_active":"2024-09-10T05:11:27.731108+0000","last_became_peered":"2024-09-10T05:11:27.731108+0000","last_unstale":"2024-09-10T05:13:40.914614+0000","last_undegraded":"2024-09-10T05:13:40.914614+0000","last_fullsized":"2024-09-10T05:13:40.914614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:36.345654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960717+0000","last_change":"2024-09-10T05:11:18.533507+0000","last_active":"2024-09-10T05:12:04.960717+0000","last_peered":"2024-09-10T05:12:04.960717+0000","last_clean":"2024-09-10T05:12:04.960717+0000","last_became_active":"2024-09-10T05:11:16.531468+0000","last_became_peered":"2024-09-10T05:11:16.531468+0000","last_unstale":"2024-09-10T05:12:04.960717+0000","last_undegraded":"2024-09-10T05:12:04.960717+0000","last_fullsized":"2024-09-10T05:12:04.960717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:30:18.685084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001329722,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:31.733033+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:31.732753+0000","last_became_peered":"2024-09-10T05:11:31.732753+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:51.417779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'88","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.264512+0000","last_change":"2024-09-10T05:11:33.744480+0000","last_active":"2024-09-10T05:13:34.264512+0000","last_peered":"2024-09-10T05:13:34.264512+0000","last_clean":"2024-09-10T05:13:34.264512+0000","last_became_active":"2024-09-10T05:11:33.744217+0000","last_became_peered":"2024-09-10T05:11:33.744217+0000","last_unstale":"2024-09-10T05:13:34.264512+0000","last_undegraded":"2024-09-10T05:13:34.264512+0000","last_fullsized":"2024-09-10T05:13:34.264512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:27.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957339+0000","last_change":"2024-09-10T05:11:35.748212+0000","last_active":"2024-09-10T05:12:04.957339+0000","last_peered":"2024-09-10T05:12:04.957339+0000","last_clean":"2024-09-10T05:12:04.957339+0000","last_became_active":"2024-09-10T05:11:35.747924+0000","last_became_peered":"2024-09-10T05:11:35.747924+0000","last_unstale":"2024-09-10T05:12:04.957339+0000","last_undegraded":"2024-09-10T05:12:04.957339+0000","last_fullsized":"2024-09-10T05:12:04.957339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:15.162433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961201+0000","last_change":"2024-09-10T05:11:37.758521+0000","last_active":"2024-09-10T05:12:04.961201+0000","last_peered":"2024-09-10T05:12:04.961201+0000","last_clean":"2024-09-10T05:12:04.961201+0000","last_became_active":"2024-09-10T05:11:37.757947+0000","last_became_peered":"2024-09-10T05:11:37.757947+0000","last_unstale":"2024-09-10T05:12:04.961201+0000","last_undegraded":"2024-09-10T05:12:04.961201+0000","last_fullsized":"2024-09-10T05:12:04.961201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:42.540458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:52.143036+0000","last_change":"2024-09-10T05:11:37.759509+0000","last_active":"2024-09-10T05:12:52.143036+0000","last_peered":"2024-09-10T05:12:52.143036+0000","last_clean":"2024-09-10T05:12:52.143036+0000","last_became_active":"2024-09-10T05:11:37.759217+0000","last_became_peered":"2024-09-10T05:11:37.759217+0000","last_unstale":"2024-09-10T05:12:52.143036+0000","last_undegraded":"2024-09-10T05:12:52.143036+0000","last_fullsized":"2024-09-10T05:12:52.143036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:30.264676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'12","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116908+0000","last_change":"2024-09-10T05:11:29.730421+0000","last_active":"2024-09-10T05:14:36.116908+0000","last_peered":"2024-09-10T05:14:36.116908+0000","last_clean":"2024-09-10T05:14:36.116908+0000","last_became_active":"2024-09-10T05:11:29.730105+0000","last_became_peered":"2024-09-10T05:11:29.730105+0000","last_unstale":"2024-09-10T05:14:36.116908+0000","last_undegraded":"2024-09-10T05:14:36.116908+0000","last_fullsized":"2024-09-10T05:14:36.116908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:52.776885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:50.916828+0000","last_change":"2024-09-10T05:11:27.732124+0000","last_active":"2024-09-10T05:13:50.916828+0000","last_peered":"2024-09-10T05:13:50.916828+0000","last_clean":"2024-09-10T05:13:50.916828+0000","last_became_active":"2024-09-10T05:11:27.731634+0000","last_became_peered":"2024-09-10T05:11:27.731634+0000","last_unstale":"2024-09-10T05:13:50.916828+0000","last_undegraded":"2024-09-10T05:13:50.916828+0000","last_fullsized":"2024-09-10T05:13:50.916828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:55.962255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.970384+0000","last_change":"2024-09-10T05:12:04.967896+0000","last_active":"2024-09-10T05:12:04.970384+0000","last_peered":"2024-09-10T05:12:04.970384+0000","last_clean":"2024-09-10T05:12:04.970384+0000","last_became_active":"2024-09-10T05:12:04.967513+0000","last_became_peered":"2024-09-10T05:12:04.967513+0000","last_unstale":"2024-09-10T05:12:04.970384+0000","last_undegraded":"2024-09-10T05:12:04.970384+0000","last_fullsized":"2024-09-10T05:12:04.970384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:00.790327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.680527+0000","last_change":"2024-09-10T05:11:33.745631+0000","last_active":"2024-09-10T05:13:35.680527+0000","last_peered":"2024-09-10T05:13:35.680527+0000","last_clean":"2024-09-10T05:13:35.680527+0000","last_became_active":"2024-09-10T05:11:33.745347+0000","last_became_peered":"2024-09-10T05:11:33.745347+0000","last_unstale":"2024-09-10T05:13:35.680527+0000","last_undegraded":"2024-09-10T05:13:35.680527+0000","last_fullsized":"2024-09-10T05:13:35.680527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:36.538308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954872+0000","last_change":"2024-09-10T05:11:35.754614+0000","last_active":"2024-09-10T05:12:04.954872+0000","last_peered":"2024-09-10T05:12:04.954872+0000","last_clean":"2024-09-10T05:12:04.954872+0000","last_became_active":"2024-09-10T05:11:35.754318+0000","last_became_peered":"2024-09-10T05:11:35.754318+0000","last_unstale":"2024-09-10T05:12:04.954872+0000","last_undegraded":"2024-09-10T05:12:04.954872+0000","last_fullsized":"2024-09-10T05:12:04.954872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:32.929275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:33.971128+0000","last_change":"2024-09-10T05:11:37.760662+0000","last_active":"2024-09-10T05:13:33.971128+0000","last_peered":"2024-09-10T05:13:33.971128+0000","last_clean":"2024-09-10T05:13:33.971128+0000","last_became_active":"2024-09-10T05:11:37.760471+0000","last_became_peered":"2024-09-10T05:11:37.760471+0000","last_unstale":"2024-09-10T05:13:33.971128+0000","last_undegraded":"2024-09-10T05:13:33.971128+0000","last_fullsized":"2024-09-10T05:13:33.971128+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:16.361621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.346649+0000","last_change":"2024-09-10T05:11:29.727844+0000","last_active":"2024-09-10T05:14:36.346649+0000","last_peered":"2024-09-10T05:14:36.346649+0000","last_clean":"2024-09-10T05:14:36.346649+0000","last_became_active":"2024-09-10T05:11:29.727550+0000","last_became_peered":"2024-09-10T05:11:29.727550+0000","last_unstale":"2024-09-10T05:14:36.346649+0000","last_undegraded":"2024-09-10T05:14:36.346649+0000","last_fullsized":"2024-09-10T05:14:36.346649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:05.037792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563704+0000","last_change":"2024-09-10T05:11:27.724954+0000","last_active":"2024-09-10T05:12:08.563704+0000","last_peered":"2024-09-10T05:12:08.563704+0000","last_clean":"2024-09-10T05:12:08.563704+0000","last_became_active":"2024-09-10T05:11:27.724637+0000","last_became_peered":"2024-09-10T05:11:27.724637+0000","last_unstale":"2024-09-10T05:12:08.563704+0000","last_undegraded":"2024-09-10T05:12:08.563704+0000","last_fullsized":"2024-09-10T05:12:08.563704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:06.669117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956587+0000","last_change":"2024-09-10T05:11:31.737152+0000","last_active":"2024-09-10T05:12:04.956587+0000","last_peered":"2024-09-10T05:12:04.956587+0000","last_clean":"2024-09-10T05:12:04.956587+0000","last_became_active":"2024-09-10T05:11:31.736758+0000","last_became_peered":"2024-09-10T05:11:31.736758+0000","last_unstale":"2024-09-10T05:12:04.956587+0000","last_undegraded":"2024-09-10T05:12:04.956587+0000","last_fullsized":"2024-09-10T05:12:04.956587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:07.236386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'6","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.711356+0000","last_change":"2024-09-10T05:11:33.742432+0000","last_active":"2024-09-10T05:14:35.711356+0000","last_peered":"2024-09-10T05:14:35.711356+0000","last_clean":"2024-09-10T05:14:35.711356+0000","last_became_active":"2024-09-10T05:11:33.742039+0000","last_became_peered":"2024-09-10T05:11:33.742039+0000","last_unstale":"2024-09-10T05:14:35.711356+0000","last_undegraded":"2024-09-10T05:14:35.711356+0000","last_fullsized":"2024-09-10T05:14:35.711356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:31.077478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956813+0000","last_change":"2024-09-10T05:11:35.751536+0000","last_active":"2024-09-10T05:12:04.956813+0000","last_peered":"2024-09-10T05:12:04.956813+0000","last_clean":"2024-09-10T05:12:04.956813+0000","last_became_active":"2024-09-10T05:11:35.751244+0000","last_became_peered":"2024-09-10T05:11:35.751244+0000","last_unstale":"2024-09-10T05:12:04.956813+0000","last_undegraded":"2024-09-10T05:12:04.956813+0000","last_fullsized":"2024-09-10T05:12:04.956813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.673711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.676093+0000","last_change":"2024-09-10T05:11:37.755735+0000","last_active":"2024-09-10T05:13:35.676093+0000","last_peered":"2024-09-10T05:13:35.676093+0000","last_clean":"2024-09-10T05:13:35.676093+0000","last_became_active":"2024-09-10T05:11:37.755533+0000","last_became_peered":"2024-09-10T05:11:37.755533+0000","last_unstale":"2024-09-10T05:13:35.676093+0000","last_undegraded":"2024-09-10T05:13:35.676093+0000","last_fullsized":"2024-09-10T05:13:35.676093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:37.895455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604904+0000","last_change":"2024-09-10T05:11:29.727735+0000","last_active":"2024-09-10T05:13:32.604904+0000","last_peered":"2024-09-10T05:13:32.604904+0000","last_clean":"2024-09-10T05:13:32.604904+0000","last_became_active":"2024-09-10T05:11:29.727400+0000","last_became_peered":"2024-09-10T05:11:29.727400+0000","last_unstale":"2024-09-10T05:13:32.604904+0000","last_undegraded":"2024-09-10T05:13:32.604904+0000","last_fullsized":"2024-09-10T05:13:32.604904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:52.691912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.328244+0000","last_change":"2024-09-10T05:11:27.728450+0000","last_active":"2024-09-10T05:14:36.328244+0000","last_peered":"2024-09-10T05:14:36.328244+0000","last_clean":"2024-09-10T05:14:36.328244+0000","last_became_active":"2024-09-10T05:11:27.727561+0000","last_became_peered":"2024-09-10T05:11:27.727561+0000","last_unstale":"2024-09-10T05:14:36.328244+0000","last_undegraded":"2024-09-10T05:14:36.328244+0000","last_fullsized":"2024-09-10T05:14:36.328244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:09.173780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"28'1","reported_seq":219,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.322927+0000","last_change":"2024-09-10T05:11:31.734288+0000","last_active":"2024-09-10T05:13:35.322927+0000","last_peered":"2024-09-10T05:13:35.322927+0000","last_clean":"2024-09-10T05:13:35.322927+0000","last_became_active":"2024-09-10T05:11:31.733793+0000","last_became_peered":"2024-09-10T05:11:31.733793+0000","last_unstale":"2024-09-10T05:13:35.322927+0000","last_undegraded":"2024-09-10T05:13:35.322927+0000","last_fullsized":"2024-09-10T05:13:35.322927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:15.305550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'42","reported_seq":102,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.349250+0000","last_change":"2024-09-10T05:11:33.744948+0000","last_active":"2024-09-10T05:14:36.349250+0000","last_peered":"2024-09-10T05:14:36.349250+0000","last_clean":"2024-09-10T05:14:36.349250+0000","last_became_active":"2024-09-10T05:11:33.744634+0000","last_became_peered":"2024-09-10T05:11:33.744634+0000","last_unstale":"2024-09-10T05:14:36.349250+0000","last_undegraded":"2024-09-10T05:14:36.349250+0000","last_fullsized":"2024-09-10T05:14:36.349250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:09.908383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959076+0000","last_change":"2024-09-10T05:11:35.748666+0000","last_active":"2024-09-10T05:12:04.959076+0000","last_peered":"2024-09-10T05:12:04.959076+0000","last_clean":"2024-09-10T05:12:04.959076+0000","last_became_active":"2024-09-10T05:11:35.748406+0000","last_became_peered":"2024-09-10T05:11:35.748406+0000","last_unstale":"2024-09-10T05:12:04.959076+0000","last_undegraded":"2024-09-10T05:12:04.959076+0000","last_fullsized":"2024-09-10T05:12:04.959076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:01.833099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.370496+0000","last_change":"2024-09-10T05:11:37.765627+0000","last_active":"2024-09-10T05:14:36.370496+0000","last_peered":"2024-09-10T05:14:36.370496+0000","last_clean":"2024-09-10T05:14:36.370496+0000","last_became_active":"2024-09-10T05:11:37.765188+0000","last_became_peered":"2024-09-10T05:11:37.765188+0000","last_unstale":"2024-09-10T05:14:36.370496+0000","last_undegraded":"2024-09-10T05:14:36.370496+0000","last_fullsized":"2024-09-10T05:14:36.370496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:35.729959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954466+0000","last_change":"2024-09-10T05:11:29.736060+0000","last_active":"2024-09-10T05:12:04.954466+0000","last_peered":"2024-09-10T05:12:04.954466+0000","last_clean":"2024-09-10T05:12:04.954466+0000","last_became_active":"2024-09-10T05:11:29.735101+0000","last_became_peered":"2024-09-10T05:11:29.735101+0000","last_unstale":"2024-09-10T05:12:04.954466+0000","last_undegraded":"2024-09-10T05:12:04.954466+0000","last_fullsized":"2024-09-10T05:12:04.954466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:46.282001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962997+0000","last_change":"2024-09-10T05:11:27.716910+0000","last_active":"2024-09-10T05:12:04.962997+0000","last_peered":"2024-09-10T05:12:04.962997+0000","last_clean":"2024-09-10T05:12:04.962997+0000","last_became_active":"2024-09-10T05:11:27.715729+0000","last_became_peered":"2024-09-10T05:11:27.715729+0000","last_unstale":"2024-09-10T05:12:04.962997+0000","last_undegraded":"2024-09-10T05:12:04.962997+0000","last_fullsized":"2024-09-10T05:12:04.962997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:34.486986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954515+0000","last_change":"2024-09-10T05:11:31.732767+0000","last_active":"2024-09-10T05:12:04.954515+0000","last_peered":"2024-09-10T05:12:04.954515+0000","last_clean":"2024-09-10T05:12:04.954515+0000","last_became_active":"2024-09-10T05:11:31.732476+0000","last_became_peered":"2024-09-10T05:11:31.732476+0000","last_unstale":"2024-09-10T05:12:04.954515+0000","last_undegraded":"2024-09-10T05:12:04.954515+0000","last_fullsized":"2024-09-10T05:12:04.954515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:22.178149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'31","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.255150+0000","last_change":"2024-09-10T05:11:33.742425+0000","last_active":"2024-09-10T05:13:34.255150+0000","last_peered":"2024-09-10T05:13:34.255150+0000","last_clean":"2024-09-10T05:13:34.255150+0000","last_became_active":"2024-09-10T05:11:33.740483+0000","last_became_peered":"2024-09-10T05:11:33.740483+0000","last_unstale":"2024-09-10T05:13:34.255150+0000","last_undegraded":"2024-09-10T05:13:34.255150+0000","last_fullsized":"2024-09-10T05:13:34.255150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:21.633618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960060+0000","last_change":"2024-09-10T05:11:35.746206+0000","last_active":"2024-09-10T05:12:04.960060+0000","last_peered":"2024-09-10T05:12:04.960060+0000","last_clean":"2024-09-10T05:12:04.960060+0000","last_became_active":"2024-09-10T05:11:35.745886+0000","last_became_peered":"2024-09-10T05:11:35.745886+0000","last_unstale":"2024-09-10T05:12:04.960060+0000","last_undegraded":"2024-09-10T05:12:04.960060+0000","last_fullsized":"2024-09-10T05:12:04.960060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:38.963303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.109858+0000","last_change":"2024-09-10T05:11:29.732079+0000","last_active":"2024-09-10T05:14:36.109858+0000","last_peered":"2024-09-10T05:14:36.109858+0000","last_clean":"2024-09-10T05:14:36.109858+0000","last_became_active":"2024-09-10T05:11:29.731824+0000","last_became_peered":"2024-09-10T05:11:29.731824+0000","last_unstale":"2024-09-10T05:14:36.109858+0000","last_undegraded":"2024-09-10T05:14:36.109858+0000","last_fullsized":"2024-09-10T05:14:36.109858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:53.060402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954430+0000","last_change":"2024-09-10T05:11:27.735230+0000","last_active":"2024-09-10T05:12:04.954430+0000","last_peered":"2024-09-10T05:12:04.954430+0000","last_clean":"2024-09-10T05:12:04.954430+0000","last_became_active":"2024-09-10T05:11:27.734652+0000","last_became_peered":"2024-09-10T05:11:27.734652+0000","last_unstale":"2024-09-10T05:12:04.954430+0000","last_undegraded":"2024-09-10T05:12:04.954430+0000","last_fullsized":"2024-09-10T05:12:04.954430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:41.386631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959243+0000","last_change":"2024-09-10T05:11:31.735122+0000","last_active":"2024-09-10T05:12:04.959243+0000","last_peered":"2024-09-10T05:12:04.959243+0000","last_clean":"2024-09-10T05:12:04.959243+0000","last_became_active":"2024-09-10T05:11:31.734774+0000","last_became_peered":"2024-09-10T05:11:31.734774+0000","last_unstale":"2024-09-10T05:12:04.959243+0000","last_undegraded":"2024-09-10T05:12:04.959243+0000","last_fullsized":"2024-09-10T05:12:04.959243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:38.074776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'60","reported_seq":123,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.276849+0000","last_change":"2024-09-10T05:11:33.741409+0000","last_active":"2024-09-10T05:13:34.276849+0000","last_peered":"2024-09-10T05:13:34.276849+0000","last_clean":"2024-09-10T05:13:34.276849+0000","last_became_active":"2024-09-10T05:11:33.741136+0000","last_became_peered":"2024-09-10T05:11:33.741136+0000","last_unstale":"2024-09-10T05:13:34.276849+0000","last_undegraded":"2024-09-10T05:13:34.276849+0000","last_fullsized":"2024-09-10T05:13:34.276849+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:48.815209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958544+0000","last_change":"2024-09-10T05:11:35.746094+0000","last_active":"2024-09-10T05:12:04.958544+0000","last_peered":"2024-09-10T05:12:04.958544+0000","last_clean":"2024-09-10T05:12:04.958544+0000","last_became_active":"2024-09-10T05:11:35.745795+0000","last_became_peered":"2024-09-10T05:11:35.745795+0000","last_unstale":"2024-09-10T05:12:04.958544+0000","last_undegraded":"2024-09-10T05:12:04.958544+0000","last_fullsized":"2024-09-10T05:12:04.958544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:43.698313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.609239+0000","last_change":"2024-09-10T05:11:37.758689+0000","last_active":"2024-09-10T05:13:35.609239+0000","last_peered":"2024-09-10T05:13:35.609239+0000","last_clean":"2024-09-10T05:13:35.609239+0000","last_became_active":"2024-09-10T05:11:37.758360+0000","last_became_peered":"2024-09-10T05:11:37.758360+0000","last_unstale":"2024-09-10T05:13:35.609239+0000","last_undegraded":"2024-09-10T05:13:35.609239+0000","last_fullsized":"2024-09-10T05:13:35.609239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:10.895588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'9","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.423853+0000","last_change":"2024-09-10T05:11:29.725587+0000","last_active":"2024-09-10T05:14:36.423853+0000","last_peered":"2024-09-10T05:14:36.423853+0000","last_clean":"2024-09-10T05:14:36.423853+0000","last_became_active":"2024-09-10T05:11:29.723722+0000","last_became_peered":"2024-09-10T05:11:29.723722+0000","last_unstale":"2024-09-10T05:14:36.423853+0000","last_undegraded":"2024-09-10T05:14:36.423853+0000","last_fullsized":"2024-09-10T05:14:36.423853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:27.494677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957932+0000","last_change":"2024-09-10T05:11:27.728290+0000","last_active":"2024-09-10T05:12:04.957932+0000","last_peered":"2024-09-10T05:12:04.957932+0000","last_clean":"2024-09-10T05:12:04.957932+0000","last_became_active":"2024-09-10T05:11:27.727770+0000","last_became_peered":"2024-09-10T05:11:27.727770+0000","last_unstale":"2024-09-10T05:12:04.957932+0000","last_undegraded":"2024-09-10T05:12:04.957932+0000","last_fullsized":"2024-09-10T05:12:04.957932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:49.547692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962377+0000","last_change":"2024-09-10T05:11:31.728930+0000","last_active":"2024-09-10T05:12:04.962377+0000","last_peered":"2024-09-10T05:12:04.962377+0000","last_clean":"2024-09-10T05:12:04.962377+0000","last_became_active":"2024-09-10T05:11:31.728653+0000","last_became_peered":"2024-09-10T05:11:31.728653+0000","last_unstale":"2024-09-10T05:12:04.962377+0000","last_undegraded":"2024-09-10T05:12:04.962377+0000","last_fullsized":"2024-09-10T05:12:04.962377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:11:50.575895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.256106+0000","last_change":"2024-09-10T05:11:33.743527+0000","last_active":"2024-09-10T05:13:34.256106+0000","last_peered":"2024-09-10T05:13:34.256106+0000","last_clean":"2024-09-10T05:13:34.256106+0000","last_became_active":"2024-09-10T05:11:33.743048+0000","last_became_peered":"2024-09-10T05:11:33.743048+0000","last_unstale":"2024-09-10T05:13:34.256106+0000","last_undegraded":"2024-09-10T05:13:34.256106+0000","last_fullsized":"2024-09-10T05:13:34.256106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:52:59.505330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960230+0000","last_change":"2024-09-10T05:11:35.753237+0000","last_active":"2024-09-10T05:12:04.960230+0000","last_peered":"2024-09-10T05:12:04.960230+0000","last_clean":"2024-09-10T05:12:04.960230+0000","last_became_active":"2024-09-10T05:11:35.752971+0000","last_became_peered":"2024-09-10T05:11:35.752971+0000","last_unstale":"2024-09-10T05:12:04.960230+0000","last_undegraded":"2024-09-10T05:12:04.960230+0000","last_fullsized":"2024-09-10T05:12:04.960230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:16.416535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954464+0000","last_change":"2024-09-10T05:11:37.768354+0000","last_active":"2024-09-10T05:12:04.954464+0000","last_peered":"2024-09-10T05:12:04.954464+0000","last_clean":"2024-09-10T05:12:04.954464+0000","last_became_active":"2024-09-10T05:11:37.768036+0000","last_became_peered":"2024-09-10T05:11:37.768036+0000","last_unstale":"2024-09-10T05:12:04.954464+0000","last_undegraded":"2024-09-10T05:12:04.954464+0000","last_fullsized":"2024-09-10T05:12:04.954464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:28.716788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'3","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.210570+0000","last_change":"2024-09-10T05:11:29.735292+0000","last_active":"2024-09-10T05:14:36.210570+0000","last_peered":"2024-09-10T05:14:36.210570+0000","last_clean":"2024-09-10T05:14:36.210570+0000","last_became_active":"2024-09-10T05:11:29.734714+0000","last_became_peered":"2024-09-10T05:11:29.734714+0000","last_unstale":"2024-09-10T05:14:36.210570+0000","last_undegraded":"2024-09-10T05:14:36.210570+0000","last_fullsized":"2024-09-10T05:14:36.210570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:28.419157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.564082+0000","last_change":"2024-09-10T05:11:27.718573+0000","last_active":"2024-09-10T05:12:08.564082+0000","last_peered":"2024-09-10T05:12:08.564082+0000","last_clean":"2024-09-10T05:12:08.564082+0000","last_became_active":"2024-09-10T05:11:27.718251+0000","last_became_peered":"2024-09-10T05:11:27.718251+0000","last_unstale":"2024-09-10T05:12:08.564082+0000","last_undegraded":"2024-09-10T05:12:08.564082+0000","last_fullsized":"2024-09-10T05:12:08.564082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:05.213355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958875+0000","last_change":"2024-09-10T05:11:31.728291+0000","last_active":"2024-09-10T05:12:04.958875+0000","last_peered":"2024-09-10T05:12:04.958875+0000","last_clean":"2024-09-10T05:12:04.958875+0000","last_became_active":"2024-09-10T05:11:31.727998+0000","last_became_peered":"2024-09-10T05:11:31.727998+0000","last_unstale":"2024-09-10T05:12:04.958875+0000","last_undegraded":"2024-09-10T05:12:04.958875+0000","last_fullsized":"2024-09-10T05:12:04.958875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:33.243917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'38","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.274731+0000","last_change":"2024-09-10T05:11:33.742831+0000","last_active":"2024-09-10T05:13:34.274731+0000","last_peered":"2024-09-10T05:13:34.274731+0000","last_clean":"2024-09-10T05:13:34.274731+0000","last_became_active":"2024-09-10T05:11:33.742594+0000","last_became_peered":"2024-09-10T05:11:33.742594+0000","last_unstale":"2024-09-10T05:13:34.274731+0000","last_undegraded":"2024-09-10T05:13:34.274731+0000","last_fullsized":"2024-09-10T05:13:34.274731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:54.003296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957834+0000","last_change":"2024-09-10T05:11:35.748750+0000","last_active":"2024-09-10T05:12:04.957834+0000","last_peered":"2024-09-10T05:12:04.957834+0000","last_clean":"2024-09-10T05:12:04.957834+0000","last_became_active":"2024-09-10T05:11:35.748464+0000","last_became_peered":"2024-09-10T05:11:35.748464+0000","last_unstale":"2024-09-10T05:12:04.957834+0000","last_undegraded":"2024-09-10T05:12:04.957834+0000","last_fullsized":"2024-09-10T05:12:04.957834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:02:44.003459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.674549+0000","last_change":"2024-09-10T05:11:37.768552+0000","last_active":"2024-09-10T05:13:35.674549+0000","last_peered":"2024-09-10T05:13:35.674549+0000","last_clean":"2024-09-10T05:13:35.674549+0000","last_became_active":"2024-09-10T05:11:37.768248+0000","last_became_peered":"2024-09-10T05:11:37.768248+0000","last_unstale":"2024-09-10T05:13:35.674549+0000","last_undegraded":"2024-09-10T05:13:35.674549+0000","last_fullsized":"2024-09-10T05:13:35.674549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:47.039216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.109389+0000","last_change":"2024-09-10T05:11:29.727709+0000","last_active":"2024-09-10T05:14:36.109389+0000","last_peered":"2024-09-10T05:14:36.109389+0000","last_clean":"2024-09-10T05:14:36.109389+0000","last_became_active":"2024-09-10T05:11:29.727038+0000","last_became_peered":"2024-09-10T05:11:29.727038+0000","last_unstale":"2024-09-10T05:14:36.109389+0000","last_undegraded":"2024-09-10T05:14:36.109389+0000","last_fullsized":"2024-09-10T05:14:36.109389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.472157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:52.134013+0000","last_change":"2024-09-10T05:11:27.734905+0000","last_active":"2024-09-10T05:12:52.134013+0000","last_peered":"2024-09-10T05:12:52.134013+0000","last_clean":"2024-09-10T05:12:52.134013+0000","last_became_active":"2024-09-10T05:11:27.733320+0000","last_became_peered":"2024-09-10T05:11:27.733320+0000","last_unstale":"2024-09-10T05:12:52.134013+0000","last_undegraded":"2024-09-10T05:12:52.134013+0000","last_fullsized":"2024-09-10T05:12:52.134013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:27.826216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961436+0000","last_change":"2024-09-10T05:11:31.734989+0000","last_active":"2024-09-10T05:12:04.961436+0000","last_peered":"2024-09-10T05:12:04.961436+0000","last_clean":"2024-09-10T05:12:04.961436+0000","last_became_active":"2024-09-10T05:11:31.734684+0000","last_became_peered":"2024-09-10T05:11:31.734684+0000","last_unstale":"2024-09-10T05:12:04.961436+0000","last_undegraded":"2024-09-10T05:12:04.961436+0000","last_fullsized":"2024-09-10T05:12:04.961436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:16.215982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962397+0000","last_change":"2024-09-10T05:11:33.748823+0000","last_active":"2024-09-10T05:12:04.962397+0000","last_peered":"2024-09-10T05:12:04.962397+0000","last_clean":"2024-09-10T05:12:04.962397+0000","last_became_active":"2024-09-10T05:11:33.748547+0000","last_became_peered":"2024-09-10T05:11:33.748547+0000","last_unstale":"2024-09-10T05:12:04.962397+0000","last_undegraded":"2024-09-10T05:12:04.962397+0000","last_fullsized":"2024-09-10T05:12:04.962397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:00.711618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'282","reported_seq":366,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813472+0000","last_change":"2024-09-10T05:11:35.751082+0000","last_active":"2024-09-10T05:14:31.813472+0000","last_peered":"2024-09-10T05:14:31.813472+0000","last_clean":"2024-09-10T05:14:31.813472+0000","last_became_active":"2024-09-10T05:11:35.750761+0000","last_became_peered":"2024-09-10T05:11:35.750761+0000","last_unstale":"2024-09-10T05:14:31.813472+0000","last_undegraded":"2024-09-10T05:14:31.813472+0000","last_fullsized":"2024-09-10T05:14:31.813472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:35.877712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954021+0000","last_change":"2024-09-10T05:11:37.768088+0000","last_active":"2024-09-10T05:12:04.954021+0000","last_peered":"2024-09-10T05:12:04.954021+0000","last_clean":"2024-09-10T05:12:04.954021+0000","last_became_active":"2024-09-10T05:11:37.767816+0000","last_became_peered":"2024-09-10T05:11:37.767816+0000","last_unstale":"2024-09-10T05:12:04.954021+0000","last_undegraded":"2024-09-10T05:12:04.954021+0000","last_fullsized":"2024-09-10T05:12:04.954021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:32.684488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'5","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:00.917755+0000","last_change":"2024-09-10T05:11:29.720521+0000","last_active":"2024-09-10T05:14:00.917755+0000","last_peered":"2024-09-10T05:14:00.917755+0000","last_clean":"2024-09-10T05:14:00.917755+0000","last_became_active":"2024-09-10T05:11:29.720243+0000","last_became_peered":"2024-09-10T05:11:29.720243+0000","last_unstale":"2024-09-10T05:14:00.917755+0000","last_undegraded":"2024-09-10T05:14:00.917755+0000","last_fullsized":"2024-09-10T05:14:00.917755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:46.844060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960785+0000","last_change":"2024-09-10T05:11:27.723954+0000","last_active":"2024-09-10T05:12:04.960785+0000","last_peered":"2024-09-10T05:12:04.960785+0000","last_clean":"2024-09-10T05:12:04.960785+0000","last_became_active":"2024-09-10T05:11:27.723630+0000","last_became_peered":"2024-09-10T05:11:27.723630+0000","last_unstale":"2024-09-10T05:12:04.960785+0000","last_undegraded":"2024-09-10T05:12:04.960785+0000","last_fullsized":"2024-09-10T05:12:04.960785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:03.159929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961835+0000","last_change":"2024-09-10T05:11:31.737893+0000","last_active":"2024-09-10T05:12:04.961835+0000","last_peered":"2024-09-10T05:12:04.961835+0000","last_clean":"2024-09-10T05:12:04.961835+0000","last_became_active":"2024-09-10T05:11:31.737547+0000","last_became_peered":"2024-09-10T05:11:31.737547+0000","last_unstale":"2024-09-10T05:12:04.961835+0000","last_undegraded":"2024-09-10T05:12:04.961835+0000","last_fullsized":"2024-09-10T05:12:04.961835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:48.181735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'60","reported_seq":130,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.246813+0000","last_change":"2024-09-10T05:11:33.740808+0000","last_active":"2024-09-10T05:13:34.246813+0000","last_peered":"2024-09-10T05:13:34.246813+0000","last_clean":"2024-09-10T05:13:34.246813+0000","last_became_active":"2024-09-10T05:11:33.740489+0000","last_became_peered":"2024-09-10T05:11:33.740489+0000","last_unstale":"2024-09-10T05:13:34.246813+0000","last_undegraded":"2024-09-10T05:13:34.246813+0000","last_fullsized":"2024-09-10T05:13:34.246813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:04.031528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956220+0000","last_change":"2024-09-10T05:11:35.754168+0000","last_active":"2024-09-10T05:12:04.956220+0000","last_peered":"2024-09-10T05:12:04.956220+0000","last_clean":"2024-09-10T05:12:04.956220+0000","last_became_active":"2024-09-10T05:11:35.753856+0000","last_became_peered":"2024-09-10T05:11:35.753856+0000","last_unstale":"2024-09-10T05:12:04.956220+0000","last_undegraded":"2024-09-10T05:12:04.956220+0000","last_fullsized":"2024-09-10T05:12:04.956220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:03.169802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.439500+0000","last_change":"2024-09-10T05:11:37.758619+0000","last_active":"2024-09-10T05:12:09.439500+0000","last_peered":"2024-09-10T05:12:09.439500+0000","last_clean":"2024-09-10T05:12:09.439500+0000","last_became_active":"2024-09-10T05:11:37.758332+0000","last_became_peered":"2024-09-10T05:11:37.758332+0000","last_unstale":"2024-09-10T05:12:09.439500+0000","last_undegraded":"2024-09-10T05:12:09.439500+0000","last_fullsized":"2024-09-10T05:12:09.439500+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:34:24.838165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.678085+0000","last_change":"2024-09-10T05:11:29.722215+0000","last_active":"2024-09-10T05:13:35.678085+0000","last_peered":"2024-09-10T05:13:35.678085+0000","last_clean":"2024-09-10T05:13:35.678085+0000","last_became_active":"2024-09-10T05:11:29.721899+0000","last_became_peered":"2024-09-10T05:11:29.721899+0000","last_unstale":"2024-09-10T05:13:35.678085+0000","last_undegraded":"2024-09-10T05:13:35.678085+0000","last_fullsized":"2024-09-10T05:13:35.678085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:49.705056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957373+0000","last_change":"2024-09-10T05:11:27.733809+0000","last_active":"2024-09-10T05:12:04.957373+0000","last_peered":"2024-09-10T05:12:04.957373+0000","last_clean":"2024-09-10T05:12:04.957373+0000","last_became_active":"2024-09-10T05:11:27.733451+0000","last_became_peered":"2024-09-10T05:11:27.733451+0000","last_unstale":"2024-09-10T05:12:04.957373+0000","last_undegraded":"2024-09-10T05:12:04.957373+0000","last_fullsized":"2024-09-10T05:12:04.957373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:50.768933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961145+0000","last_change":"2024-09-10T05:11:31.736009+0000","last_active":"2024-09-10T05:12:04.961145+0000","last_peered":"2024-09-10T05:12:04.961145+0000","last_clean":"2024-09-10T05:12:04.961145+0000","last_became_active":"2024-09-10T05:11:31.735565+0000","last_became_peered":"2024-09-10T05:11:31.735565+0000","last_unstale":"2024-09-10T05:12:04.961145+0000","last_undegraded":"2024-09-10T05:12:04.961145+0000","last_fullsized":"2024-09-10T05:12:04.961145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:10.523091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'36","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.247976+0000","last_change":"2024-09-10T05:11:33.742997+0000","last_active":"2024-09-10T05:13:34.247976+0000","last_peered":"2024-09-10T05:13:34.247976+0000","last_clean":"2024-09-10T05:13:34.247976+0000","last_became_active":"2024-09-10T05:11:33.742656+0000","last_became_peered":"2024-09-10T05:11:33.742656+0000","last_unstale":"2024-09-10T05:13:34.247976+0000","last_undegraded":"2024-09-10T05:13:34.247976+0000","last_fullsized":"2024-09-10T05:13:34.247976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:28.611407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954236+0000","last_change":"2024-09-10T05:11:35.751391+0000","last_active":"2024-09-10T05:12:04.954236+0000","last_peered":"2024-09-10T05:12:04.954236+0000","last_clean":"2024-09-10T05:12:04.954236+0000","last_became_active":"2024-09-10T05:11:35.750960+0000","last_became_peered":"2024-09-10T05:11:35.750960+0000","last_unstale":"2024-09-10T05:12:04.954236+0000","last_undegraded":"2024-09-10T05:12:04.954236+0000","last_fullsized":"2024-09-10T05:12:04.954236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:07.690221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.959775+0000","last_change":"2024-09-10T05:11:37.768897+0000","last_active":"2024-09-10T05:12:51.959775+0000","last_peered":"2024-09-10T05:12:51.959775+0000","last_clean":"2024-09-10T05:12:51.959775+0000","last_became_active":"2024-09-10T05:11:37.768559+0000","last_became_peered":"2024-09-10T05:11:37.768559+0000","last_unstale":"2024-09-10T05:12:51.959775+0000","last_undegraded":"2024-09-10T05:12:51.959775+0000","last_fullsized":"2024-09-10T05:12:51.959775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:41.676922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'5","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.207817+0000","last_change":"2024-09-10T05:11:29.735124+0000","last_active":"2024-09-10T05:14:36.207817+0000","last_peered":"2024-09-10T05:14:36.207817+0000","last_clean":"2024-09-10T05:14:36.207817+0000","last_became_active":"2024-09-10T05:11:29.732703+0000","last_became_peered":"2024-09-10T05:11:29.732703+0000","last_unstale":"2024-09-10T05:14:36.207817+0000","last_undegraded":"2024-09-10T05:14:36.207817+0000","last_fullsized":"2024-09-10T05:14:36.207817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:46.587126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563575+0000","last_change":"2024-09-10T05:11:27.714395+0000","last_active":"2024-09-10T05:12:08.563575+0000","last_peered":"2024-09-10T05:12:08.563575+0000","last_clean":"2024-09-10T05:12:08.563575+0000","last_became_active":"2024-09-10T05:11:27.713416+0000","last_became_peered":"2024-09-10T05:11:27.713416+0000","last_unstale":"2024-09-10T05:12:08.563575+0000","last_undegraded":"2024-09-10T05:12:08.563575+0000","last_fullsized":"2024-09-10T05:12:08.563575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:50.330893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958275+0000","last_change":"2024-09-10T05:11:31.736882+0000","last_active":"2024-09-10T05:12:04.958275+0000","last_peered":"2024-09-10T05:12:04.958275+0000","last_clean":"2024-09-10T05:12:04.958275+0000","last_became_active":"2024-09-10T05:11:31.736540+0000","last_became_peered":"2024-09-10T05:11:31.736540+0000","last_unstale":"2024-09-10T05:12:04.958275+0000","last_undegraded":"2024-09-10T05:12:04.958275+0000","last_fullsized":"2024-09-10T05:12:04.958275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:34.452648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.272847+0000","last_change":"2024-09-10T05:11:33.743575+0000","last_active":"2024-09-10T05:13:34.272847+0000","last_peered":"2024-09-10T05:13:34.272847+0000","last_clean":"2024-09-10T05:13:34.272847+0000","last_became_active":"2024-09-10T05:11:33.743207+0000","last_became_peered":"2024-09-10T05:11:33.743207+0000","last_unstale":"2024-09-10T05:13:34.272847+0000","last_undegraded":"2024-09-10T05:13:34.272847+0000","last_fullsized":"2024-09-10T05:13:34.272847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:19.732970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:35.753328+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:35.753001+0000","last_became_peered":"2024-09-10T05:11:35.753001+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:19.217985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.480743+0000","last_change":"2024-09-10T05:11:37.767945+0000","last_active":"2024-09-10T05:14:36.480743+0000","last_peered":"2024-09-10T05:14:36.480743+0000","last_clean":"2024-09-10T05:14:36.480743+0000","last_became_active":"2024-09-10T05:11:37.767649+0000","last_became_peered":"2024-09-10T05:11:37.767649+0000","last_unstale":"2024-09-10T05:14:36.480743+0000","last_undegraded":"2024-09-10T05:14:36.480743+0000","last_fullsized":"2024-09-10T05:14:36.480743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:47.436935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'4","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382235+0000","last_change":"2024-09-10T05:11:29.718957+0000","last_active":"2024-09-10T05:14:36.382235+0000","last_peered":"2024-09-10T05:14:36.382235+0000","last_clean":"2024-09-10T05:14:36.382235+0000","last_became_active":"2024-09-10T05:11:29.718689+0000","last_became_peered":"2024-09-10T05:11:29.718689+0000","last_unstale":"2024-09-10T05:14:36.382235+0000","last_undegraded":"2024-09-10T05:14:36.382235+0000","last_fullsized":"2024-09-10T05:14:36.382235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.549609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963087+0000","last_change":"2024-09-10T05:11:27.716440+0000","last_active":"2024-09-10T05:12:04.963087+0000","last_peered":"2024-09-10T05:12:04.963087+0000","last_clean":"2024-09-10T05:12:04.963087+0000","last_became_active":"2024-09-10T05:11:27.716073+0000","last_became_peered":"2024-09-10T05:11:27.716073+0000","last_unstale":"2024-09-10T05:12:04.963087+0000","last_undegraded":"2024-09-10T05:12:04.963087+0000","last_fullsized":"2024-09-10T05:12:04.963087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:12:23.620289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'2","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.968798+0000","last_change":"2024-09-10T05:11:31.736020+0000","last_active":"2024-09-10T05:13:32.968798+0000","last_peered":"2024-09-10T05:13:32.968798+0000","last_clean":"2024-09-10T05:13:32.968798+0000","last_became_active":"2024-09-10T05:11:31.735726+0000","last_became_peered":"2024-09-10T05:11:31.735726+0000","last_unstale":"2024-09-10T05:13:32.968798+0000","last_undegraded":"2024-09-10T05:13:32.968798+0000","last_fullsized":"2024-09-10T05:13:32.968798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:49.251341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'44","reported_seq":101,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.696786+0000","last_change":"2024-09-10T05:11:33.748407+0000","last_active":"2024-09-10T05:14:35.696786+0000","last_peered":"2024-09-10T05:14:35.696786+0000","last_clean":"2024-09-10T05:14:35.696786+0000","last_became_active":"2024-09-10T05:11:33.748120+0000","last_became_peered":"2024-09-10T05:11:33.748120+0000","last_unstale":"2024-09-10T05:14:35.696786+0000","last_undegraded":"2024-09-10T05:14:35.696786+0000","last_fullsized":"2024-09-10T05:14:35.696786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:46:20.643301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956794+0000","last_change":"2024-09-10T05:11:35.753972+0000","last_active":"2024-09-10T05:12:04.956794+0000","last_peered":"2024-09-10T05:12:04.956794+0000","last_clean":"2024-09-10T05:12:04.956794+0000","last_became_active":"2024-09-10T05:11:35.753437+0000","last_became_peered":"2024-09-10T05:11:35.753437+0000","last_unstale":"2024-09-10T05:12:04.956794+0000","last_undegraded":"2024-09-10T05:12:04.956794+0000","last_fullsized":"2024-09-10T05:12:04.956794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:06.887746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'10","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.285208+0000","last_change":"2024-09-10T05:11:37.765397+0000","last_active":"2024-09-10T05:13:34.285208+0000","last_peered":"2024-09-10T05:13:34.285208+0000","last_clean":"2024-09-10T05:13:34.285208+0000","last_became_active":"2024-09-10T05:11:37.765102+0000","last_became_peered":"2024-09-10T05:11:37.765102+0000","last_unstale":"2024-09-10T05:13:34.285208+0000","last_undegraded":"2024-09-10T05:13:34.285208+0000","last_fullsized":"2024-09-10T05:13:34.285208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:41.297084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":67,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'7","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914653+0000","last_change":"2024-09-10T05:11:29.729956+0000","last_active":"2024-09-10T05:13:40.914653+0000","last_peered":"2024-09-10T05:13:40.914653+0000","last_clean":"2024-09-10T05:13:40.914653+0000","last_became_active":"2024-09-10T05:11:29.729468+0000","last_became_peered":"2024-09-10T05:11:29.729468+0000","last_unstale":"2024-09-10T05:13:40.914653+0000","last_undegraded":"2024-09-10T05:13:40.914653+0000","last_fullsized":"2024-09-10T05:13:40.914653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:28.277156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956207+0000","last_change":"2024-09-10T05:11:27.706911+0000","last_active":"2024-09-10T05:12:04.956207+0000","last_peered":"2024-09-10T05:12:04.956207+0000","last_clean":"2024-09-10T05:12:04.956207+0000","last_became_active":"2024-09-10T05:11:27.706484+0000","last_became_peered":"2024-09-10T05:11:27.706484+0000","last_unstale":"2024-09-10T05:12:04.956207+0000","last_undegraded":"2024-09-10T05:12:04.956207+0000","last_fullsized":"2024-09-10T05:12:04.956207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:43.266234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'11","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:38.908717+0000","last_change":"2024-09-10T05:11:29.729314+0000","last_active":"2024-09-10T05:13:38.908717+0000","last_peered":"2024-09-10T05:13:38.908717+0000","last_clean":"2024-09-10T05:13:38.908717+0000","last_became_active":"2024-09-10T05:11:29.729019+0000","last_became_peered":"2024-09-10T05:11:29.729019+0000","last_unstale":"2024-09-10T05:13:38.908717+0000","last_undegraded":"2024-09-10T05:13:38.908717+0000","last_fullsized":"2024-09-10T05:13:38.908717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:42.589634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563597+0000","last_change":"2024-09-10T05:11:27.715436+0000","last_active":"2024-09-10T05:12:08.563597+0000","last_peered":"2024-09-10T05:12:08.563597+0000","last_clean":"2024-09-10T05:12:08.563597+0000","last_became_active":"2024-09-10T05:11:27.714487+0000","last_became_peered":"2024-09-10T05:11:27.714487+0000","last_unstale":"2024-09-10T05:12:08.563597+0000","last_undegraded":"2024-09-10T05:12:08.563597+0000","last_fullsized":"2024-09-10T05:12:08.563597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:29:45.038701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'2","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.666946+0000","last_change":"2024-09-10T05:11:29.729634+0000","last_active":"2024-09-10T05:12:09.666946+0000","last_peered":"2024-09-10T05:12:09.666946+0000","last_clean":"2024-09-10T05:12:09.666946+0000","last_became_active":"2024-09-10T05:11:29.729359+0000","last_became_peered":"2024-09-10T05:11:29.729359+0000","last_unstale":"2024-09-10T05:12:09.666946+0000","last_undegraded":"2024-09-10T05:12:09.666946+0000","last_fullsized":"2024-09-10T05:12:09.666946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:52.814750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955280+0000","last_change":"2024-09-10T05:11:27.731218+0000","last_active":"2024-09-10T05:12:04.955280+0000","last_peered":"2024-09-10T05:12:04.955280+0000","last_clean":"2024-09-10T05:12:04.955280+0000","last_became_active":"2024-09-10T05:11:27.730905+0000","last_became_peered":"2024-09-10T05:11:27.730905+0000","last_unstale":"2024-09-10T05:12:04.955280+0000","last_undegraded":"2024-09-10T05:12:04.955280+0000","last_fullsized":"2024-09-10T05:12:04.955280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:16.699974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604649+0000","last_change":"2024-09-10T05:11:29.727742+0000","last_active":"2024-09-10T05:13:32.604649+0000","last_peered":"2024-09-10T05:13:32.604649+0000","last_clean":"2024-09-10T05:13:32.604649+0000","last_became_active":"2024-09-10T05:11:29.727454+0000","last_became_peered":"2024-09-10T05:11:29.727454+0000","last_unstale":"2024-09-10T05:13:32.604649+0000","last_undegraded":"2024-09-10T05:13:32.604649+0000","last_fullsized":"2024-09-10T05:13:32.604649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:22.898915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957634+0000","last_change":"2024-09-10T05:11:27.714363+0000","last_active":"2024-09-10T05:12:04.957634+0000","last_peered":"2024-09-10T05:12:04.957634+0000","last_clean":"2024-09-10T05:12:04.957634+0000","last_became_active":"2024-09-10T05:11:27.713962+0000","last_became_peered":"2024-09-10T05:11:27.713962+0000","last_unstale":"2024-09-10T05:12:04.957634+0000","last_undegraded":"2024-09-10T05:12:04.957634+0000","last_fullsized":"2024-09-10T05:12:04.957634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:40.639981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'8","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.093386+0000","last_change":"2024-09-10T05:11:29.725511+0000","last_active":"2024-09-10T05:12:09.093386+0000","last_peered":"2024-09-10T05:12:09.093386+0000","last_clean":"2024-09-10T05:12:09.093386+0000","last_became_active":"2024-09-10T05:11:29.725099+0000","last_became_peered":"2024-09-10T05:11:29.725099+0000","last_unstale":"2024-09-10T05:12:09.093386+0000","last_undegraded":"2024-09-10T05:12:09.093386+0000","last_fullsized":"2024-09-10T05:12:09.093386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:14.626560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.652457+0000","last_change":"2024-09-10T05:11:27.719263+0000","last_active":"2024-09-10T05:12:09.652457+0000","last_peered":"2024-09-10T05:12:09.652457+0000","last_clean":"2024-09-10T05:12:09.652457+0000","last_became_active":"2024-09-10T05:11:27.718926+0000","last_became_peered":"2024-09-10T05:11:27.718926+0000","last_unstale":"2024-09-10T05:12:09.652457+0000","last_undegraded":"2024-09-10T05:12:09.652457+0000","last_fullsized":"2024-09-10T05:12:09.652457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:49.254771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'8","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107871+0000","last_change":"2024-09-10T05:12:04.978547+0000","last_active":"2024-09-10T05:14:36.107871+0000","last_peered":"2024-09-10T05:14:36.107871+0000","last_clean":"2024-09-10T05:14:36.107871+0000","last_became_active":"2024-09-10T05:12:04.964750+0000","last_became_peered":"2024-09-10T05:12:04.964750+0000","last_unstale":"2024-09-10T05:14:36.107871+0000","last_undegraded":"2024-09-10T05:14:36.107871+0000","last_fullsized":"2024-09-10T05:14:36.107871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:49.286618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960405+0000","last_change":"2024-09-10T05:11:27.718699+0000","last_active":"2024-09-10T05:12:04.960405+0000","last_peered":"2024-09-10T05:12:04.960405+0000","last_clean":"2024-09-10T05:12:04.960405+0000","last_became_active":"2024-09-10T05:11:27.718282+0000","last_became_peered":"2024-09-10T05:11:27.718282+0000","last_unstale":"2024-09-10T05:12:04.960405+0000","last_undegraded":"2024-09-10T05:12:04.960405+0000","last_fullsized":"2024-09-10T05:12:04.960405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:53.391299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.672364+0000","last_change":"2024-09-10T05:11:29.723846+0000","last_active":"2024-09-10T05:13:35.672364+0000","last_peered":"2024-09-10T05:13:35.672364+0000","last_clean":"2024-09-10T05:13:35.672364+0000","last_became_active":"2024-09-10T05:11:29.723387+0000","last_became_peered":"2024-09-10T05:11:29.723387+0000","last_unstale":"2024-09-10T05:13:35.672364+0000","last_undegraded":"2024-09-10T05:13:35.672364+0000","last_fullsized":"2024-09-10T05:13:35.672364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:05.820538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.964122+0000","last_change":"2024-09-10T05:11:27.727938+0000","last_active":"2024-09-10T05:12:04.964122+0000","last_peered":"2024-09-10T05:12:04.964122+0000","last_clean":"2024-09-10T05:12:04.964122+0000","last_became_active":"2024-09-10T05:11:27.724815+0000","last_became_peered":"2024-09-10T05:11:27.724815+0000","last_unstale":"2024-09-10T05:12:04.964122+0000","last_undegraded":"2024-09-10T05:12:04.964122+0000","last_fullsized":"2024-09-10T05:12:04.964122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:20.919577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957830+0000","last_change":"2024-09-10T05:11:29.724062+0000","last_active":"2024-09-10T05:12:04.957830+0000","last_peered":"2024-09-10T05:12:04.957830+0000","last_clean":"2024-09-10T05:12:04.957830+0000","last_became_active":"2024-09-10T05:11:29.723469+0000","last_became_peered":"2024-09-10T05:11:29.723469+0000","last_unstale":"2024-09-10T05:12:04.957830+0000","last_undegraded":"2024-09-10T05:12:04.957830+0000","last_fullsized":"2024-09-10T05:12:04.957830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:43.394583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958230+0000","last_change":"2024-09-10T05:11:27.715191+0000","last_active":"2024-09-10T05:12:04.958230+0000","last_peered":"2024-09-10T05:12:04.958230+0000","last_clean":"2024-09-10T05:12:04.958230+0000","last_became_active":"2024-09-10T05:11:27.714348+0000","last_became_peered":"2024-09-10T05:11:27.714348+0000","last_unstale":"2024-09-10T05:12:04.958230+0000","last_undegraded":"2024-09-10T05:12:04.958230+0000","last_fullsized":"2024-09-10T05:12:04.958230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:36.911942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'8","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417269+0000","last_change":"2024-09-10T05:11:29.730574+0000","last_active":"2024-09-10T05:14:36.417269+0000","last_peered":"2024-09-10T05:14:36.417269+0000","last_clean":"2024-09-10T05:14:36.417269+0000","last_became_active":"2024-09-10T05:11:29.729148+0000","last_became_peered":"2024-09-10T05:11:29.729148+0000","last_unstale":"2024-09-10T05:14:36.417269+0000","last_undegraded":"2024-09-10T05:14:36.417269+0000","last_fullsized":"2024-09-10T05:14:36.417269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:31.976539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914792+0000","last_change":"2024-09-10T05:11:27.735462+0000","last_active":"2024-09-10T05:13:40.914792+0000","last_peered":"2024-09-10T05:13:40.914792+0000","last_clean":"2024-09-10T05:13:40.914792+0000","last_became_active":"2024-09-10T05:11:27.735159+0000","last_became_peered":"2024-09-10T05:11:27.735159+0000","last_unstale":"2024-09-10T05:13:40.914792+0000","last_undegraded":"2024-09-10T05:13:40.914792+0000","last_fullsized":"2024-09-10T05:13:40.914792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:01:53.516341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'12","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339364+0000","last_change":"2024-09-10T05:11:29.729754+0000","last_active":"2024-09-10T05:14:36.339364+0000","last_peered":"2024-09-10T05:14:36.339364+0000","last_clean":"2024-09-10T05:14:36.339364+0000","last_became_active":"2024-09-10T05:11:29.729476+0000","last_became_peered":"2024-09-10T05:11:29.729476+0000","last_unstale":"2024-09-10T05:14:36.339364+0000","last_undegraded":"2024-09-10T05:14:36.339364+0000","last_fullsized":"2024-09-10T05:14:36.339364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:48.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956653+0000","last_change":"2024-09-10T05:11:27.716160+0000","last_active":"2024-09-10T05:12:04.956653+0000","last_peered":"2024-09-10T05:12:04.956653+0000","last_clean":"2024-09-10T05:12:04.956653+0000","last_became_active":"2024-09-10T05:11:27.715014+0000","last_became_peered":"2024-09-10T05:11:27.715014+0000","last_unstale":"2024-09-10T05:12:04.956653+0000","last_undegraded":"2024-09-10T05:12:04.956653+0000","last_fullsized":"2024-09-10T05:12:04.956653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:48.498486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'1","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:43.909553+0000","last_change":"2024-09-10T05:11:29.725420+0000","last_active":"2024-09-10T05:13:43.909553+0000","last_peered":"2024-09-10T05:13:43.909553+0000","last_clean":"2024-09-10T05:13:43.909553+0000","last_became_active":"2024-09-10T05:11:29.725047+0000","last_became_peered":"2024-09-10T05:11:29.725047+0000","last_unstale":"2024-09-10T05:13:43.909553+0000","last_undegraded":"2024-09-10T05:13:43.909553+0000","last_fullsized":"2024-09-10T05:13:43.909553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:53.902350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:45.915269+0000","last_change":"2024-09-10T05:11:27.728591+0000","last_active":"2024-09-10T05:13:45.915269+0000","last_peered":"2024-09-10T05:13:45.915269+0000","last_clean":"2024-09-10T05:13:45.915269+0000","last_became_active":"2024-09-10T05:11:27.728257+0000","last_became_peered":"2024-09-10T05:11:27.728257+0000","last_unstale":"2024-09-10T05:13:45.915269+0000","last_undegraded":"2024-09-10T05:13:45.915269+0000","last_fullsized":"2024-09-10T05:13:45.915269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:47:35.592580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960390+0000","last_change":"2024-09-10T05:11:29.722459+0000","last_active":"2024-09-10T05:12:04.960390+0000","last_peered":"2024-09-10T05:12:04.960390+0000","last_clean":"2024-09-10T05:12:04.960390+0000","last_became_active":"2024-09-10T05:11:29.721826+0000","last_became_peered":"2024-09-10T05:11:29.721826+0000","last_unstale":"2024-09-10T05:12:04.960390+0000","last_undegraded":"2024-09-10T05:12:04.960390+0000","last_fullsized":"2024-09-10T05:12:04.960390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:28.260482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958963+0000","last_change":"2024-09-10T05:11:27.730887+0000","last_active":"2024-09-10T05:12:04.958963+0000","last_peered":"2024-09-10T05:12:04.958963+0000","last_clean":"2024-09-10T05:12:04.958963+0000","last_became_active":"2024-09-10T05:11:27.730469+0000","last_became_peered":"2024-09-10T05:11:27.730469+0000","last_unstale":"2024-09-10T05:12:04.958963+0000","last_undegraded":"2024-09-10T05:12:04.958963+0000","last_fullsized":"2024-09-10T05:12:04.958963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:27.305881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'18","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339133+0000","last_change":"2024-09-10T05:12:04.973395+0000","last_active":"2024-09-10T05:14:36.339133+0000","last_peered":"2024-09-10T05:14:36.339133+0000","last_clean":"2024-09-10T05:14:36.339133+0000","last_became_active":"2024-09-10T05:12:04.965056+0000","last_became_peered":"2024-09-10T05:12:04.965056+0000","last_unstale":"2024-09-10T05:14:36.339133+0000","last_undegraded":"2024-09-10T05:14:36.339133+0000","last_fullsized":"2024-09-10T05:14:36.339133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:32.513703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563177+0000","last_change":"2024-09-10T05:11:27.722461+0000","last_active":"2024-09-10T05:12:08.563177+0000","last_peered":"2024-09-10T05:12:08.563177+0000","last_clean":"2024-09-10T05:12:08.563177+0000","last_became_active":"2024-09-10T05:11:27.722079+0000","last_became_peered":"2024-09-10T05:11:27.722079+0000","last_unstale":"2024-09-10T05:12:08.563177+0000","last_undegraded":"2024-09-10T05:12:08.563177+0000","last_fullsized":"2024-09-10T05:12:08.563177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:24.585536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'16","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107152+0000","last_change":"2024-09-10T05:11:29.734175+0000","last_active":"2024-09-10T05:14:36.107152+0000","last_peered":"2024-09-10T05:14:36.107152+0000","last_clean":"2024-09-10T05:14:36.107152+0000","last_became_active":"2024-09-10T05:11:29.733895+0000","last_became_peered":"2024-09-10T05:11:29.733895+0000","last_unstale":"2024-09-10T05:14:36.107152+0000","last_undegraded":"2024-09-10T05:14:36.107152+0000","last_fullsized":"2024-09-10T05:14:36.107152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:03.526086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961663+0000","last_change":"2024-09-10T05:11:27.736117+0000","last_active":"2024-09-10T05:12:04.961663+0000","last_peered":"2024-09-10T05:12:04.961663+0000","last_clean":"2024-09-10T05:12:04.961663+0000","last_became_active":"2024-09-10T05:11:27.735801+0000","last_became_peered":"2024-09-10T05:11:27.735801+0000","last_unstale":"2024-09-10T05:12:04.961663+0000","last_undegraded":"2024-09-10T05:12:04.961663+0000","last_fullsized":"2024-09-10T05:12:04.961663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:23.542052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.202329+0000","last_change":"2024-09-10T05:11:29.735884+0000","last_active":"2024-09-10T05:14:36.202329+0000","last_peered":"2024-09-10T05:14:36.202329+0000","last_clean":"2024-09-10T05:14:36.202329+0000","last_became_active":"2024-09-10T05:11:29.735555+0000","last_became_peered":"2024-09-10T05:11:29.735555+0000","last_unstale":"2024-09-10T05:14:36.202329+0000","last_undegraded":"2024-09-10T05:14:36.202329+0000","last_fullsized":"2024-09-10T05:14:36.202329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:40:54.995716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.964581+0000","last_change":"2024-09-10T05:11:27.727651+0000","last_active":"2024-09-10T05:12:04.964581+0000","last_peered":"2024-09-10T05:12:04.964581+0000","last_clean":"2024-09-10T05:12:04.964581+0000","last_became_active":"2024-09-10T05:11:27.723820+0000","last_became_peered":"2024-09-10T05:11:27.723820+0000","last_unstale":"2024-09-10T05:12:04.964581+0000","last_undegraded":"2024-09-10T05:12:04.964581+0000","last_fullsized":"2024-09-10T05:12:04.964581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:01:27.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.394391+0000","last_change":"2024-09-10T05:11:29.724350+0000","last_active":"2024-09-10T05:14:36.394391+0000","last_peered":"2024-09-10T05:14:36.394391+0000","last_clean":"2024-09-10T05:14:36.394391+0000","last_became_active":"2024-09-10T05:11:29.723816+0000","last_became_peered":"2024-09-10T05:11:29.723816+0000","last_unstale":"2024-09-10T05:14:36.394391+0000","last_undegraded":"2024-09-10T05:14:36.394391+0000","last_fullsized":"2024-09-10T05:14:36.394391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:33.014166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960833+0000","last_change":"2024-09-10T05:11:27.736745+0000","last_active":"2024-09-10T05:12:04.960833+0000","last_peered":"2024-09-10T05:12:04.960833+0000","last_clean":"2024-09-10T05:12:04.960833+0000","last_became_active":"2024-09-10T05:11:27.736370+0000","last_became_peered":"2024-09-10T05:11:27.736370+0000","last_unstale":"2024-09-10T05:12:04.960833+0000","last_undegraded":"2024-09-10T05:12:04.960833+0000","last_fullsized":"2024-09-10T05:12:04.960833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:18.893074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.411415+0000","last_change":"2024-09-10T05:11:27.731505+0000","last_active":"2024-09-10T05:14:36.411415+0000","last_peered":"2024-09-10T05:14:36.411415+0000","last_clean":"2024-09-10T05:14:36.411415+0000","last_became_active":"2024-09-10T05:11:27.731202+0000","last_became_peered":"2024-09-10T05:11:27.731202+0000","last_unstale":"2024-09-10T05:14:36.411415+0000","last_undegraded":"2024-09-10T05:14:36.411415+0000","last_fullsized":"2024-09-10T05:14:36.411415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:19.541656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.383073+0000","last_change":"2024-09-10T05:11:29.723977+0000","last_active":"2024-09-10T05:14:36.383073+0000","last_peered":"2024-09-10T05:14:36.383073+0000","last_clean":"2024-09-10T05:14:36.383073+0000","last_became_active":"2024-09-10T05:11:29.723467+0000","last_became_peered":"2024-09-10T05:11:29.723467+0000","last_unstale":"2024-09-10T05:14:36.383073+0000","last_undegraded":"2024-09-10T05:14:36.383073+0000","last_fullsized":"2024-09-10T05:14:36.383073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:38:33.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957046+0000","last_change":"2024-09-10T05:11:27.715255+0000","last_active":"2024-09-10T05:12:04.957046+0000","last_peered":"2024-09-10T05:12:04.957046+0000","last_clean":"2024-09-10T05:12:04.957046+0000","last_became_active":"2024-09-10T05:11:27.713659+0000","last_became_peered":"2024-09-10T05:11:27.713659+0000","last_unstale":"2024-09-10T05:12:04.957046+0000","last_undegraded":"2024-09-10T05:12:04.957046+0000","last_fullsized":"2024-09-10T05:12:04.957046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:40.253443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'10","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417292+0000","last_change":"2024-09-10T05:12:04.964980+0000","last_active":"2024-09-10T05:14:36.417292+0000","last_peered":"2024-09-10T05:14:36.417292+0000","last_clean":"2024-09-10T05:14:36.417292+0000","last_became_active":"2024-09-10T05:12:04.964552+0000","last_became_peered":"2024-09-10T05:12:04.964552+0000","last_unstale":"2024-09-10T05:14:36.417292+0000","last_undegraded":"2024-09-10T05:14:36.417292+0000","last_fullsized":"2024-09-10T05:14:36.417292+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:49.445729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1473,"ondisk_log_size":1473,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640301,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48508,"kb_used_data":9004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323332,"statfs":{"total":96636764160,"available":96587091968,"internally_reserved":0,"allocated":9220096,"data_stored":8873071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48964,"kb_used_data":13620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322876,"statfs":{"total":96636764160,"available":96586625024,"internally_reserved":0,"allocated":13946880,"data_stored":13657600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44888,"kb_used_data":9544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326952,"statfs":{"total":96636764160,"available":96590798848,"internally_reserved":0,"allocated":9773056,"data_stored":9462501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48164,"kb_used_data":8660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323676,"statfs":{"total":96636764160,"available":96587444224,"internally_reserved":0,"allocated":8867840,"data_stored":8550766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:14:43.874 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T05:14:43.874 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:14:44.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.000+0000 7ff409de2640 1 Processor -- start 2024-09-10T05:14:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.001+0000 7ff409de2640 1 -- start start 2024-09-10T05:14:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.001+0000 7ff409de2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff404114190 0x7ff404114570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.001+0000 7ff409de2640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4041155b0 con 0x7ff404114ab0 2024-09-10T05:14:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.001+0000 7ff409de2640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7ff404116380 con 0x7ff404114190 2024-09-10T05:14:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.001+0000 7ff4037fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff404114190 0x7ff404114570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.001+0000 7ff402ffd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff404114ab0 0x7ff4041253b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40890/0 (socket says 172.21.15.139:40890) 2024-09-10T05:14:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.001+0000 7ff4037fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff404114190 0x7ff404114570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34676/0 (socket says 172.21.15.139:34676) 2024-09-10T05:14:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.001+0000 7ff402ffd640 1 -- 172.21.15.139:0/3518425684 learned_addr learned my addr 172.21.15.139:0/3518425684 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.001+0000 7ff4037fe640 1 -- 172.21.15.139:0/3518425684 >> v1:172.21.15.139:6789/0 conn(0x7ff404114ab0 legacy=0x7ff4041253b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.001+0000 7ff4037fe640 1 -- 172.21.15.139:0/3518425684 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4040735e0 con 0x7ff404114190 2024-09-10T05:14:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.001+0000 7ff4027fc640 1 -- 172.21.15.139:0/3518425684 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767295480 0 0) 0x7ff4041155b0 con 0x7ff404114ab0 2024-09-10T05:14:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.002+0000 7ff4037fe640 1 --2- 172.21.15.139:0/3518425684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff404114190 0x7ff404114570 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009dc0 tx=0x7ff3f402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f63b138f683c41a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.002+0000 7ff4027fc640 1 -- 172.21.15.139:0/3518425684 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3f4007670 con 0x7ff404114190 2024-09-10T05:14:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.002+0000 7ff4027fc640 1 -- 172.21.15.139:0/3518425684 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f4007810 con 0x7ff404114190 2024-09-10T05:14:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.002+0000 7ff4027fc640 1 -- 172.21.15.139:0/3518425684 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3f4007b10 con 0x7ff404114190 2024-09-10T05:14:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.003+0000 7ff409de2640 1 -- 172.21.15.139:0/3518425684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff404114190 msgr2=0x7ff404114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.003+0000 7ff409de2640 1 --2- 172.21.15.139:0/3518425684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff404114190 0x7ff404114570 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009dc0 tx=0x7ff3f402a730 comp rx=0 tx=0).stop 2024-09-10T05:14:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.003+0000 7ff409de2640 1 -- 172.21.15.139:0/3518425684 shutdown_connections 2024-09-10T05:14:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.003+0000 7ff409de2640 1 --2- 172.21.15.139:0/3518425684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff404114190 0x7ff404114570 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.003+0000 7ff409de2640 1 -- 172.21.15.139:0/3518425684 >> 172.21.15.139:0/3518425684 conn(0x7ff40406f300 msgr2=0x7ff404071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:44.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.003+0000 7ff409de2640 1 -- 172.21.15.139:0/3518425684 shutdown_connections 2024-09-10T05:14:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.003+0000 7ff409de2640 1 -- 172.21.15.139:0/3518425684 wait complete. 2024-09-10T05:14:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.004+0000 7ff409de2640 1 Processor -- start 2024-09-10T05:14:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.004+0000 7ff409de2640 1 -- start start 2024-09-10T05:14:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.004+0000 7ff409de2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff404114190 0x7ff4041195b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.004+0000 7ff409de2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff404114ec0 con 0x7ff404114190 2024-09-10T05:14:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.004+0000 7ff4037fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff404114190 0x7ff4041195b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.004+0000 7ff4037fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff404114190 0x7ff4041195b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34684/0 (socket says 172.21.15.139:34684) 2024-09-10T05:14:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.004+0000 7ff4037fe640 1 -- 172.21.15.139:0/2094507851 learned_addr learned my addr 172.21.15.139:0/2094507851 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.005+0000 7ff4037fe640 1 -- 172.21.15.139:0/2094507851 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40411aff0 con 0x7ff404114190 2024-09-10T05:14:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.005+0000 7ff4037fe640 1 --2- 172.21.15.139:0/2094507851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff404114190 0x7ff4041195b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009dc0 tx=0x7ff3f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.005+0000 7ff3fbfff640 1 -- 172.21.15.139:0/2094507851 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3f4040070 con 0x7ff404114190 2024-09-10T05:14:44.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.005+0000 7ff3fbfff640 1 -- 172.21.15.139:0/2094507851 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f4031a90 con 0x7ff404114190 2024-09-10T05:14:44.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.005+0000 7ff409de2640 1 -- 172.21.15.139:0/2094507851 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40411c830 con 0x7ff404114190 2024-09-10T05:14:44.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.005+0000 7ff3fbfff640 1 -- 172.21.15.139:0/2094507851 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3f4031d90 con 0x7ff404114190 2024-09-10T05:14:44.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.005+0000 7ff409de2640 1 -- 172.21.15.139:0/2094507851 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff404119af0 con 0x7ff404114190 2024-09-10T05:14:44.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.006+0000 7ff3fbfff640 1 -- 172.21.15.139:0/2094507851 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff3f4039040 con 0x7ff404114190 2024-09-10T05:14:44.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.006+0000 7ff409de2640 1 -- 172.21.15.139:0/2094507851 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff40411ab50 con 0x7ff404114190 2024-09-10T05:14:44.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.006+0000 7ff3fbfff640 1 --2- 172.21.15.139:0/2094507851 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff3e403de90 0x7ff3e4040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:44.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.006+0000 7ff3fbfff640 1 -- 172.21.15.139:0/2094507851 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7ff3f4074890 con 0x7ff404114190 2024-09-10T05:14:44.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.006+0000 7ff402ffd640 1 --2- 172.21.15.139:0/2094507851 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff3e403de90 0x7ff3e4040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:44.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.007+0000 7ff402ffd640 1 --2- 172.21.15.139:0/2094507851 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff3e403de90 0x7ff3e4040350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec000c00 tx=0x7ff3ec0078d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:44.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.010+0000 7ff3fbfff640 1 -- 172.21.15.139:0/2094507851 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7ff3f403cc70 con 0x7ff404114190 2024-09-10T05:14:44.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.183+0000 7ff409de2640 1 -- 172.21.15.139:0/2094507851 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff404129990 con 0x7ff3e403de90 2024-09-10T05:14:44.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.193+0000 7ff3fbfff640 1 -- 172.21.15.139:0/2094507851 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665786 (secure 0 0 0) 0x7ff404129990 con 0x7ff3e403de90 2024-09-10T05:14:44.203 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:14:44.208 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-10T05:14:44.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.198+0000 7ff409de2640 1 -- 172.21.15.139:0/2094507851 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff3e403de90 msgr2=0x7ff3e4040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:44.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.198+0000 7ff409de2640 1 --2- 172.21.15.139:0/2094507851 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff3e403de90 0x7ff3e4040350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec000c00 tx=0x7ff3ec0078d0 comp rx=0 tx=0).stop 2024-09-10T05:14:44.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.198+0000 7ff409de2640 1 -- 172.21.15.139:0/2094507851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff404114190 msgr2=0x7ff4041195b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:44.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.198+0000 7ff409de2640 1 --2- 172.21.15.139:0/2094507851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff404114190 0x7ff4041195b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009dc0 tx=0x7ff3f4004a40 comp rx=0 tx=0).stop 2024-09-10T05:14:44.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.198+0000 7ff409de2640 1 -- 172.21.15.139:0/2094507851 shutdown_connections 2024-09-10T05:14:44.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.198+0000 7ff409de2640 1 --2- 172.21.15.139:0/2094507851 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff3e403de90 0x7ff3e4040350 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:44.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.198+0000 7ff409de2640 1 --2- 172.21.15.139:0/2094507851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff404114190 0x7ff4041195b0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:44.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.198+0000 7ff409de2640 1 -- 172.21.15.139:0/2094507851 >> 172.21.15.139:0/2094507851 conn(0x7ff40406f300 msgr2=0x7ff404129ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:44.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.198+0000 7ff409de2640 1 -- 172.21.15.139:0/2094507851 shutdown_connections 2024-09-10T05:14:44.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.198+0000 7ff409de2640 1 -- 172.21.15.139:0/2094507851 wait complete. 2024-09-10T05:14:44.212 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-10T05:14:43.939254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22218513,"num_objects":260,"num_object_clones":0,"num_object_copies":526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":5264,"num_read_kb":4813,"num_write":2255,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4663,"ondisk_log_size":4663,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182332,"kb_used_data":32632,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377305028,"statfs":{"total":386547056640,"available":386360348672,"internally_reserved":0,"allocated":33415168,"data_stored":32153619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21617384,"num_objects":8,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":569,"num_read_kb":523,"num_write":399,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003880"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962470+0000","last_change":"2024-09-10T05:11:27.721757+0000","last_active":"2024-09-10T05:12:04.962470+0000","last_peered":"2024-09-10T05:12:04.962470+0000","last_clean":"2024-09-10T05:12:04.962470+0000","last_became_active":"2024-09-10T05:11:27.716775+0000","last_became_peered":"2024-09-10T05:11:27.716775+0000","last_unstale":"2024-09-10T05:12:04.962470+0000","last_undegraded":"2024-09-10T05:12:04.962470+0000","last_fullsized":"2024-09-10T05:12:04.962470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:21.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.438467+0000","last_change":"2024-09-10T05:11:29.733870+0000","last_active":"2024-09-10T05:12:09.438467+0000","last_peered":"2024-09-10T05:12:09.438467+0000","last_clean":"2024-09-10T05:12:09.438467+0000","last_became_active":"2024-09-10T05:11:29.733565+0000","last_became_peered":"2024-09-10T05:11:29.733565+0000","last_unstale":"2024-09-10T05:12:09.438467+0000","last_undegraded":"2024-09-10T05:12:09.438467+0000","last_fullsized":"2024-09-10T05:12:09.438467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:13.290526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958456+0000","last_change":"2024-09-10T05:11:27.715287+0000","last_active":"2024-09-10T05:12:04.958456+0000","last_peered":"2024-09-10T05:12:04.958456+0000","last_clean":"2024-09-10T05:12:04.958456+0000","last_became_active":"2024-09-10T05:11:27.713698+0000","last_became_peered":"2024-09-10T05:11:27.713698+0000","last_unstale":"2024-09-10T05:12:04.958456+0000","last_undegraded":"2024-09-10T05:12:04.958456+0000","last_fullsized":"2024-09-10T05:12:04.958456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:11.833568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'10","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417350+0000","last_change":"2024-09-10T05:11:29.728909+0000","last_active":"2024-09-10T05:14:36.417350+0000","last_peered":"2024-09-10T05:14:36.417350+0000","last_clean":"2024-09-10T05:14:36.417350+0000","last_became_active":"2024-09-10T05:11:29.728621+0000","last_became_peered":"2024-09-10T05:11:29.728621+0000","last_unstale":"2024-09-10T05:14:36.417350+0000","last_undegraded":"2024-09-10T05:14:36.417350+0000","last_fullsized":"2024-09-10T05:14:36.417350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:44.019015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"37'3","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.091200+0000","last_change":"2024-09-10T05:11:27.734457+0000","last_active":"2024-09-10T05:14:36.091200+0000","last_peered":"2024-09-10T05:14:36.091200+0000","last_clean":"2024-09-10T05:14:36.091200+0000","last_became_active":"2024-09-10T05:11:27.733147+0000","last_became_peered":"2024-09-10T05:11:27.733147+0000","last_unstale":"2024-09-10T05:14:36.091200+0000","last_undegraded":"2024-09-10T05:14:36.091200+0000","last_fullsized":"2024-09-10T05:14:36.091200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:03.092088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339232+0000","last_change":"2024-09-10T05:11:29.728946+0000","last_active":"2024-09-10T05:14:36.339232+0000","last_peered":"2024-09-10T05:14:36.339232+0000","last_clean":"2024-09-10T05:14:36.339232+0000","last_became_active":"2024-09-10T05:11:29.728696+0000","last_became_peered":"2024-09-10T05:11:29.728696+0000","last_unstale":"2024-09-10T05:14:36.339232+0000","last_undegraded":"2024-09-10T05:14:36.339232+0000","last_fullsized":"2024-09-10T05:14:36.339232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:06.277517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958649+0000","last_change":"2024-09-10T05:11:27.724506+0000","last_active":"2024-09-10T05:12:04.958649+0000","last_peered":"2024-09-10T05:12:04.958649+0000","last_clean":"2024-09-10T05:12:04.958649+0000","last_became_active":"2024-09-10T05:11:27.722701+0000","last_became_peered":"2024-09-10T05:11:27.722701+0000","last_unstale":"2024-09-10T05:12:04.958649+0000","last_undegraded":"2024-09-10T05:12:04.958649+0000","last_fullsized":"2024-09-10T05:12:04.958649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:36.792228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'21","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.346432+0000","last_change":"2024-09-10T05:11:29.732128+0000","last_active":"2024-09-10T05:14:36.346432+0000","last_peered":"2024-09-10T05:14:36.346432+0000","last_clean":"2024-09-10T05:14:36.346432+0000","last_became_active":"2024-09-10T05:11:29.731850+0000","last_became_peered":"2024-09-10T05:11:29.731850+0000","last_unstale":"2024-09-10T05:14:36.346432+0000","last_undegraded":"2024-09-10T05:14:36.346432+0000","last_fullsized":"2024-09-10T05:14:36.346432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:29.844887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956059+0000","last_change":"2024-09-10T05:11:27.733926+0000","last_active":"2024-09-10T05:12:04.956059+0000","last_peered":"2024-09-10T05:12:04.956059+0000","last_clean":"2024-09-10T05:12:04.956059+0000","last_became_active":"2024-09-10T05:11:27.732922+0000","last_became_peered":"2024-09-10T05:11:27.732922+0000","last_unstale":"2024-09-10T05:12:04.956059+0000","last_undegraded":"2024-09-10T05:12:04.956059+0000","last_fullsized":"2024-09-10T05:12:04.956059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:10.400715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960102+0000","last_change":"2024-09-10T05:11:29.722746+0000","last_active":"2024-09-10T05:12:04.960102+0000","last_peered":"2024-09-10T05:12:04.960102+0000","last_clean":"2024-09-10T05:12:04.960102+0000","last_became_active":"2024-09-10T05:11:29.722189+0000","last_became_peered":"2024-09-10T05:11:29.722189+0000","last_unstale":"2024-09-10T05:12:04.960102+0000","last_undegraded":"2024-09-10T05:12:04.960102+0000","last_fullsized":"2024-09-10T05:12:04.960102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:20.901027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.655335+0000","last_change":"2024-09-10T05:11:27.706947+0000","last_active":"2024-09-10T05:12:09.655335+0000","last_peered":"2024-09-10T05:12:09.655335+0000","last_clean":"2024-09-10T05:12:09.655335+0000","last_became_active":"2024-09-10T05:11:27.706559+0000","last_became_peered":"2024-09-10T05:11:27.706559+0000","last_unstale":"2024-09-10T05:12:09.655335+0000","last_undegraded":"2024-09-10T05:12:09.655335+0000","last_fullsized":"2024-09-10T05:12:09.655335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:12.536123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957220+0000","last_change":"2024-09-10T05:11:29.730769+0000","last_active":"2024-09-10T05:12:04.957220+0000","last_peered":"2024-09-10T05:12:04.957220+0000","last_clean":"2024-09-10T05:12:04.957220+0000","last_became_active":"2024-09-10T05:11:29.730492+0000","last_became_peered":"2024-09-10T05:11:29.730492+0000","last_unstale":"2024-09-10T05:12:04.957220+0000","last_undegraded":"2024-09-10T05:12:04.957220+0000","last_fullsized":"2024-09-10T05:12:04.957220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:36.538972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954889+0000","last_change":"2024-09-10T05:11:27.718698+0000","last_active":"2024-09-10T05:12:04.954889+0000","last_peered":"2024-09-10T05:12:04.954889+0000","last_clean":"2024-09-10T05:12:04.954889+0000","last_became_active":"2024-09-10T05:11:27.718363+0000","last_became_peered":"2024-09-10T05:11:27.718363+0000","last_unstale":"2024-09-10T05:12:04.954889+0000","last_undegraded":"2024-09-10T05:12:04.954889+0000","last_fullsized":"2024-09-10T05:12:04.954889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:56.809195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417284+0000","last_change":"2024-09-10T05:11:29.727171+0000","last_active":"2024-09-10T05:14:36.417284+0000","last_peered":"2024-09-10T05:14:36.417284+0000","last_clean":"2024-09-10T05:14:36.417284+0000","last_became_active":"2024-09-10T05:11:29.726884+0000","last_became_peered":"2024-09-10T05:11:29.726884+0000","last_unstale":"2024-09-10T05:14:36.417284+0000","last_undegraded":"2024-09-10T05:14:36.417284+0000","last_fullsized":"2024-09-10T05:14:36.417284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:28.260482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.646405+0000","last_change":"2024-09-10T05:11:27.719213+0000","last_active":"2024-09-10T05:12:09.646405+0000","last_peered":"2024-09-10T05:12:09.646405+0000","last_clean":"2024-09-10T05:12:09.646405+0000","last_became_active":"2024-09-10T05:11:27.718868+0000","last_became_peered":"2024-09-10T05:11:27.718868+0000","last_unstale":"2024-09-10T05:12:09.646405+0000","last_undegraded":"2024-09-10T05:12:09.646405+0000","last_fullsized":"2024-09-10T05:12:09.646405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:27.106277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.093231+0000","last_change":"2024-09-10T05:11:29.723967+0000","last_active":"2024-09-10T05:12:09.093231+0000","last_peered":"2024-09-10T05:12:09.093231+0000","last_clean":"2024-09-10T05:12:09.093231+0000","last_became_active":"2024-09-10T05:11:29.723497+0000","last_became_peered":"2024-09-10T05:11:29.723497+0000","last_unstale":"2024-09-10T05:12:09.093231+0000","last_undegraded":"2024-09-10T05:12:09.093231+0000","last_fullsized":"2024-09-10T05:12:09.093231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:35.779331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'5","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.208052+0000","last_change":"2024-09-10T05:11:29.727785+0000","last_active":"2024-09-10T05:14:36.208052+0000","last_peered":"2024-09-10T05:14:36.208052+0000","last_clean":"2024-09-10T05:14:36.208052+0000","last_became_active":"2024-09-10T05:11:29.727536+0000","last_became_peered":"2024-09-10T05:11:29.727536+0000","last_unstale":"2024-09-10T05:14:36.208052+0000","last_undegraded":"2024-09-10T05:14:36.208052+0000","last_fullsized":"2024-09-10T05:14:36.208052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:01.849780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.517983+0000","last_change":"2024-09-10T05:11:27.728861+0000","last_active":"2024-09-10T05:13:35.517983+0000","last_peered":"2024-09-10T05:13:35.517983+0000","last_clean":"2024-09-10T05:13:35.517983+0000","last_became_active":"2024-09-10T05:11:27.728114+0000","last_became_peered":"2024-09-10T05:11:27.728114+0000","last_unstale":"2024-09-10T05:13:35.517983+0000","last_undegraded":"2024-09-10T05:13:35.517983+0000","last_fullsized":"2024-09-10T05:13:35.517983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.559031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.202264+0000","last_change":"2024-09-10T05:11:29.733110+0000","last_active":"2024-09-10T05:14:36.202264+0000","last_peered":"2024-09-10T05:14:36.202264+0000","last_clean":"2024-09-10T05:14:36.202264+0000","last_became_active":"2024-09-10T05:11:29.732864+0000","last_became_peered":"2024-09-10T05:11:29.732864+0000","last_unstale":"2024-09-10T05:14:36.202264+0000","last_undegraded":"2024-09-10T05:14:36.202264+0000","last_fullsized":"2024-09-10T05:14:36.202264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:27.593815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.964231+0000","last_change":"2024-09-10T05:11:27.707811+0000","last_active":"2024-09-10T05:12:04.964231+0000","last_peered":"2024-09-10T05:12:04.964231+0000","last_clean":"2024-09-10T05:12:04.964231+0000","last_became_active":"2024-09-10T05:11:27.706698+0000","last_became_peered":"2024-09-10T05:11:27.706698+0000","last_unstale":"2024-09-10T05:12:04.964231+0000","last_undegraded":"2024-09-10T05:12:04.964231+0000","last_fullsized":"2024-09-10T05:12:04.964231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.559031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'10","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.963001+0000","last_change":"2024-09-10T05:11:29.732128+0000","last_active":"2024-09-10T05:12:51.963001+0000","last_peered":"2024-09-10T05:12:51.963001+0000","last_clean":"2024-09-10T05:12:51.963001+0000","last_became_active":"2024-09-10T05:11:29.731842+0000","last_became_peered":"2024-09-10T05:11:29.731842+0000","last_unstale":"2024-09-10T05:12:51.963001+0000","last_undegraded":"2024-09-10T05:12:51.963001+0000","last_fullsized":"2024-09-10T05:12:51.963001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:54.021671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960653+0000","last_change":"2024-09-10T05:11:27.719633+0000","last_active":"2024-09-10T05:12:04.960653+0000","last_peered":"2024-09-10T05:12:04.960653+0000","last_clean":"2024-09-10T05:12:04.960653+0000","last_became_active":"2024-09-10T05:11:27.719257+0000","last_became_peered":"2024-09-10T05:11:27.719257+0000","last_unstale":"2024-09-10T05:12:04.960653+0000","last_undegraded":"2024-09-10T05:12:04.960653+0000","last_fullsized":"2024-09-10T05:12:04.960653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:49.735409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339173+0000","last_change":"2024-09-10T05:12:04.976749+0000","last_active":"2024-09-10T05:14:36.339173+0000","last_peered":"2024-09-10T05:14:36.339173+0000","last_clean":"2024-09-10T05:14:36.339173+0000","last_became_active":"2024-09-10T05:12:04.967642+0000","last_became_peered":"2024-09-10T05:12:04.967642+0000","last_unstale":"2024-09-10T05:14:36.339173+0000","last_undegraded":"2024-09-10T05:14:36.339173+0000","last_fullsized":"2024-09-10T05:14:36.339173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:14.879637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"37'3","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.952834+0000","last_change":"2024-09-10T05:11:27.724754+0000","last_active":"2024-09-10T05:12:51.952834+0000","last_peered":"2024-09-10T05:12:51.952834+0000","last_clean":"2024-09-10T05:12:51.952834+0000","last_became_active":"2024-09-10T05:11:27.724439+0000","last_became_peered":"2024-09-10T05:11:27.724439+0000","last_unstale":"2024-09-10T05:12:51.952834+0000","last_undegraded":"2024-09-10T05:12:51.952834+0000","last_fullsized":"2024-09-10T05:12:51.952834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:46:03.289983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382409+0000","last_change":"2024-09-10T05:11:29.723195+0000","last_active":"2024-09-10T05:14:36.382409+0000","last_peered":"2024-09-10T05:14:36.382409+0000","last_clean":"2024-09-10T05:14:36.382409+0000","last_became_active":"2024-09-10T05:11:29.722894+0000","last_became_peered":"2024-09-10T05:11:29.722894+0000","last_unstale":"2024-09-10T05:14:36.382409+0000","last_undegraded":"2024-09-10T05:14:36.382409+0000","last_fullsized":"2024-09-10T05:14:36.382409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:16.388042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.985687+0000","last_change":"2024-09-10T05:11:27.716016+0000","last_active":"2024-09-10T05:14:35.985687+0000","last_peered":"2024-09-10T05:14:35.985687+0000","last_clean":"2024-09-10T05:14:35.985687+0000","last_became_active":"2024-09-10T05:11:27.714926+0000","last_became_peered":"2024-09-10T05:11:27.714926+0000","last_unstale":"2024-09-10T05:14:35.985687+0000","last_undegraded":"2024-09-10T05:14:35.985687+0000","last_fullsized":"2024-09-10T05:14:35.985687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:51.116402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.384792+0000","last_change":"2024-09-10T05:11:29.722979+0000","last_active":"2024-09-10T05:14:36.384792+0000","last_peered":"2024-09-10T05:14:36.384792+0000","last_clean":"2024-09-10T05:14:36.384792+0000","last_became_active":"2024-09-10T05:11:29.721876+0000","last_became_peered":"2024-09-10T05:11:29.721876+0000","last_unstale":"2024-09-10T05:14:36.384792+0000","last_undegraded":"2024-09-10T05:14:36.384792+0000","last_fullsized":"2024-09-10T05:14:36.384792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:11:48.560871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955723+0000","last_change":"2024-09-10T05:11:27.720509+0000","last_active":"2024-09-10T05:12:04.955723+0000","last_peered":"2024-09-10T05:12:04.955723+0000","last_clean":"2024-09-10T05:12:04.955723+0000","last_became_active":"2024-09-10T05:11:27.720197+0000","last_became_peered":"2024-09-10T05:11:27.720197+0000","last_unstale":"2024-09-10T05:12:04.955723+0000","last_undegraded":"2024-09-10T05:12:04.955723+0000","last_fullsized":"2024-09-10T05:12:04.955723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:14.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.361804+0000","last_change":"2024-09-10T05:11:37.763268+0000","last_active":"2024-09-10T05:14:36.361804+0000","last_peered":"2024-09-10T05:14:36.361804+0000","last_clean":"2024-09-10T05:14:36.361804+0000","last_became_active":"2024-09-10T05:11:37.763019+0000","last_became_peered":"2024-09-10T05:11:37.763019+0000","last_unstale":"2024-09-10T05:14:36.361804+0000","last_undegraded":"2024-09-10T05:14:36.361804+0000","last_fullsized":"2024-09-10T05:14:36.361804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:54.698085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:10.169121+0000","last_change":"2024-09-10T05:11:29.729685+0000","last_active":"2024-09-10T05:12:10.169121+0000","last_peered":"2024-09-10T05:12:10.169121+0000","last_clean":"2024-09-10T05:12:10.169121+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:12:10.169121+0000","last_undegraded":"2024-09-10T05:12:10.169121+0000","last_fullsized":"2024-09-10T05:12:10.169121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.365568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955666+0000","last_change":"2024-09-10T05:11:27.734206+0000","last_active":"2024-09-10T05:12:04.955666+0000","last_peered":"2024-09-10T05:12:04.955666+0000","last_clean":"2024-09-10T05:12:04.955666+0000","last_became_active":"2024-09-10T05:11:27.733612+0000","last_became_peered":"2024-09-10T05:11:27.733612+0000","last_unstale":"2024-09-10T05:12:04.955666+0000","last_undegraded":"2024-09-10T05:12:04.955666+0000","last_fullsized":"2024-09-10T05:12:04.955666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:47.697103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957082+0000","last_change":"2024-09-10T05:11:31.737509+0000","last_active":"2024-09-10T05:12:04.957082+0000","last_peered":"2024-09-10T05:12:04.957082+0000","last_clean":"2024-09-10T05:12:04.957082+0000","last_became_active":"2024-09-10T05:11:31.736788+0000","last_became_peered":"2024-09-10T05:11:31.736788+0000","last_unstale":"2024-09-10T05:12:04.957082+0000","last_undegraded":"2024-09-10T05:12:04.957082+0000","last_fullsized":"2024-09-10T05:12:04.957082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:26.107225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'44","reported_seq":99,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.265414+0000","last_change":"2024-09-10T05:11:33.746939+0000","last_active":"2024-09-10T05:13:34.265414+0000","last_peered":"2024-09-10T05:13:34.265414+0000","last_clean":"2024-09-10T05:13:34.265414+0000","last_became_active":"2024-09-10T05:11:33.746595+0000","last_became_peered":"2024-09-10T05:11:33.746595+0000","last_unstale":"2024-09-10T05:13:34.265414+0000","last_undegraded":"2024-09-10T05:13:34.265414+0000","last_fullsized":"2024-09-10T05:13:34.265414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:39.379252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963055+0000","last_change":"2024-09-10T05:11:35.746892+0000","last_active":"2024-09-10T05:12:04.963055+0000","last_peered":"2024-09-10T05:12:04.963055+0000","last_clean":"2024-09-10T05:12:04.963055+0000","last_became_active":"2024-09-10T05:11:35.746594+0000","last_became_peered":"2024-09-10T05:11:35.746594+0000","last_unstale":"2024-09-10T05:12:04.963055+0000","last_undegraded":"2024-09-10T05:12:04.963055+0000","last_fullsized":"2024-09-10T05:12:04.963055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:15.325826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.968440+0000","last_change":"2024-09-10T05:11:37.756768+0000","last_active":"2024-09-10T05:12:51.968440+0000","last_peered":"2024-09-10T05:12:51.968440+0000","last_clean":"2024-09-10T05:12:51.968440+0000","last_became_active":"2024-09-10T05:11:37.756495+0000","last_became_peered":"2024-09-10T05:11:37.756495+0000","last_unstale":"2024-09-10T05:12:51.968440+0000","last_undegraded":"2024-09-10T05:12:51.968440+0000","last_fullsized":"2024-09-10T05:12:51.968440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:13.070344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417430+0000","last_change":"2024-09-10T05:11:29.732574+0000","last_active":"2024-09-10T05:14:36.417430+0000","last_peered":"2024-09-10T05:14:36.417430+0000","last_clean":"2024-09-10T05:14:36.417430+0000","last_became_active":"2024-09-10T05:11:29.732267+0000","last_became_peered":"2024-09-10T05:11:29.732267+0000","last_unstale":"2024-09-10T05:14:36.417430+0000","last_undegraded":"2024-09-10T05:14:36.417430+0000","last_fullsized":"2024-09-10T05:14:36.417430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:00.006923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958078+0000","last_change":"2024-09-10T05:11:27.726953+0000","last_active":"2024-09-10T05:12:04.958078+0000","last_peered":"2024-09-10T05:12:04.958078+0000","last_clean":"2024-09-10T05:12:04.958078+0000","last_became_active":"2024-09-10T05:11:27.726599+0000","last_became_peered":"2024-09-10T05:11:27.726599+0000","last_unstale":"2024-09-10T05:12:04.958078+0000","last_undegraded":"2024-09-10T05:12:04.958078+0000","last_fullsized":"2024-09-10T05:12:04.958078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:37.354012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957165+0000","last_change":"2024-09-10T05:11:31.731495+0000","last_active":"2024-09-10T05:12:04.957165+0000","last_peered":"2024-09-10T05:12:04.957165+0000","last_clean":"2024-09-10T05:12:04.957165+0000","last_became_active":"2024-09-10T05:11:31.731231+0000","last_became_peered":"2024-09-10T05:11:31.731231+0000","last_unstale":"2024-09-10T05:12:04.957165+0000","last_undegraded":"2024-09-10T05:12:04.957165+0000","last_fullsized":"2024-09-10T05:12:04.957165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:09.451414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'13","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960893+0000","last_change":"2024-09-10T05:11:33.744170+0000","last_active":"2024-09-10T05:12:04.960893+0000","last_peered":"2024-09-10T05:12:04.960893+0000","last_clean":"2024-09-10T05:12:04.960893+0000","last_became_active":"2024-09-10T05:11:33.743847+0000","last_became_peered":"2024-09-10T05:11:33.743847+0000","last_unstale":"2024-09-10T05:12:04.960893+0000","last_undegraded":"2024-09-10T05:12:04.960893+0000","last_fullsized":"2024-09-10T05:12:04.960893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:57.085007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962494+0000","last_change":"2024-09-10T05:11:35.749895+0000","last_active":"2024-09-10T05:12:04.962494+0000","last_peered":"2024-09-10T05:12:04.962494+0000","last_clean":"2024-09-10T05:12:04.962494+0000","last_became_active":"2024-09-10T05:11:35.749634+0000","last_became_peered":"2024-09-10T05:11:35.749634+0000","last_unstale":"2024-09-10T05:12:04.962494+0000","last_undegraded":"2024-09-10T05:12:04.962494+0000","last_fullsized":"2024-09-10T05:12:04.962494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:01.486680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956547+0000","last_change":"2024-09-10T05:11:37.755426+0000","last_active":"2024-09-10T05:12:04.956547+0000","last_peered":"2024-09-10T05:12:04.956547+0000","last_clean":"2024-09-10T05:12:04.956547+0000","last_became_active":"2024-09-10T05:11:37.755078+0000","last_became_peered":"2024-09-10T05:11:37.755078+0000","last_unstale":"2024-09-10T05:12:04.956547+0000","last_undegraded":"2024-09-10T05:12:04.956547+0000","last_fullsized":"2024-09-10T05:12:04.956547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:03.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961705+0000","last_change":"2024-09-10T05:11:29.732068+0000","last_active":"2024-09-10T05:12:04.961705+0000","last_peered":"2024-09-10T05:12:04.961705+0000","last_clean":"2024-09-10T05:12:04.961705+0000","last_became_active":"2024-09-10T05:11:29.731780+0000","last_became_peered":"2024-09-10T05:11:29.731780+0000","last_unstale":"2024-09-10T05:12:04.961705+0000","last_undegraded":"2024-09-10T05:12:04.961705+0000","last_fullsized":"2024-09-10T05:12:04.961705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:47.912310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954517+0000","last_change":"2024-09-10T05:11:27.732925+0000","last_active":"2024-09-10T05:12:04.954517+0000","last_peered":"2024-09-10T05:12:04.954517+0000","last_clean":"2024-09-10T05:12:04.954517+0000","last_became_active":"2024-09-10T05:11:27.732573+0000","last_became_peered":"2024-09-10T05:11:27.732573+0000","last_unstale":"2024-09-10T05:12:04.954517+0000","last_undegraded":"2024-09-10T05:12:04.954517+0000","last_fullsized":"2024-09-10T05:12:04.954517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:48.014510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:05.900569+0000","last_change":"2024-09-10T05:12:04.965872+0000","last_active":"2024-09-10T05:12:05.900569+0000","last_peered":"2024-09-10T05:12:05.900569+0000","last_clean":"2024-09-10T05:12:05.900569+0000","last_became_active":"2024-09-10T05:12:04.965494+0000","last_became_peered":"2024-09-10T05:12:04.965494+0000","last_unstale":"2024-09-10T05:12:05.900569+0000","last_undegraded":"2024-09-10T05:12:05.900569+0000","last_fullsized":"2024-09-10T05:12:05.900569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:04.430595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959616+0000","last_change":"2024-09-10T05:11:33.745608+0000","last_active":"2024-09-10T05:12:04.959616+0000","last_peered":"2024-09-10T05:12:04.959616+0000","last_clean":"2024-09-10T05:12:04.959616+0000","last_became_active":"2024-09-10T05:11:33.745336+0000","last_became_peered":"2024-09-10T05:11:33.745336+0000","last_unstale":"2024-09-10T05:12:04.959616+0000","last_undegraded":"2024-09-10T05:12:04.959616+0000","last_fullsized":"2024-09-10T05:12:04.959616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:41.078775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'282","reported_seq":415,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.421973+0000","last_change":"2024-09-10T05:11:35.752548+0000","last_active":"2024-09-10T05:14:36.421973+0000","last_peered":"2024-09-10T05:14:36.421973+0000","last_clean":"2024-09-10T05:14:36.421973+0000","last_became_active":"2024-09-10T05:11:35.752290+0000","last_became_peered":"2024-09-10T05:11:35.752290+0000","last_unstale":"2024-09-10T05:14:36.421973+0000","last_undegraded":"2024-09-10T05:14:36.421973+0000","last_fullsized":"2024-09-10T05:14:36.421973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.244961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959825+0000","last_change":"2024-09-10T05:11:37.759873+0000","last_active":"2024-09-10T05:12:04.959825+0000","last_peered":"2024-09-10T05:12:04.959825+0000","last_clean":"2024-09-10T05:12:04.959825+0000","last_became_active":"2024-09-10T05:11:37.759311+0000","last_became_peered":"2024-09-10T05:11:37.759311+0000","last_unstale":"2024-09-10T05:12:04.959825+0000","last_undegraded":"2024-09-10T05:12:04.959825+0000","last_fullsized":"2024-09-10T05:12:04.959825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:37.479923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.383082+0000","last_change":"2024-09-10T05:11:29.724315+0000","last_active":"2024-09-10T05:14:36.383082+0000","last_peered":"2024-09-10T05:14:36.383082+0000","last_clean":"2024-09-10T05:14:36.383082+0000","last_became_active":"2024-09-10T05:11:29.723919+0000","last_became_peered":"2024-09-10T05:11:29.723919+0000","last_unstale":"2024-09-10T05:14:36.383082+0000","last_undegraded":"2024-09-10T05:14:36.383082+0000","last_fullsized":"2024-09-10T05:14:36.383082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:04.172142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957233+0000","last_change":"2024-09-10T05:11:27.720680+0000","last_active":"2024-09-10T05:12:04.957233+0000","last_peered":"2024-09-10T05:12:04.957233+0000","last_clean":"2024-09-10T05:12:04.957233+0000","last_became_active":"2024-09-10T05:11:27.719835+0000","last_became_peered":"2024-09-10T05:11:27.719835+0000","last_unstale":"2024-09-10T05:12:04.957233+0000","last_undegraded":"2024-09-10T05:12:04.957233+0000","last_fullsized":"2024-09-10T05:12:04.957233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962693+0000","last_change":"2024-09-10T05:11:31.737694+0000","last_active":"2024-09-10T05:12:04.962693+0000","last_peered":"2024-09-10T05:12:04.962693+0000","last_clean":"2024-09-10T05:12:04.962693+0000","last_became_active":"2024-09-10T05:11:31.737411+0000","last_became_peered":"2024-09-10T05:11:31.737411+0000","last_unstale":"2024-09-10T05:12:04.962693+0000","last_undegraded":"2024-09-10T05:12:04.962693+0000","last_fullsized":"2024-09-10T05:12:04.962693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:48.673581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'36","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.259091+0000","last_change":"2024-09-10T05:11:33.745209+0000","last_active":"2024-09-10T05:13:34.259091+0000","last_peered":"2024-09-10T05:13:34.259091+0000","last_clean":"2024-09-10T05:13:34.259091+0000","last_became_active":"2024-09-10T05:11:33.744920+0000","last_became_peered":"2024-09-10T05:11:33.744920+0000","last_unstale":"2024-09-10T05:13:34.259091+0000","last_undegraded":"2024-09-10T05:13:34.259091+0000","last_fullsized":"2024-09-10T05:13:34.259091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:36.085525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":427,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.010217+0000","last_change":"2024-09-10T05:11:35.748524+0000","last_active":"2024-09-10T05:14:43.010217+0000","last_peered":"2024-09-10T05:14:43.010217+0000","last_clean":"2024-09-10T05:14:43.010217+0000","last_became_active":"2024-09-10T05:11:35.748328+0000","last_became_peered":"2024-09-10T05:11:35.748328+0000","last_unstale":"2024-09-10T05:14:43.010217+0000","last_undegraded":"2024-09-10T05:14:43.010217+0000","last_fullsized":"2024-09-10T05:14:43.010217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:39.020754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'7","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116685+0000","last_change":"2024-09-10T05:11:29.736309+0000","last_active":"2024-09-10T05:14:36.116685+0000","last_peered":"2024-09-10T05:14:36.116685+0000","last_clean":"2024-09-10T05:14:36.116685+0000","last_became_active":"2024-09-10T05:11:29.735799+0000","last_became_peered":"2024-09-10T05:11:29.735799+0000","last_unstale":"2024-09-10T05:14:36.116685+0000","last_undegraded":"2024-09-10T05:14:36.116685+0000","last_fullsized":"2024-09-10T05:14:36.116685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:38.598374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962727+0000","last_change":"2024-09-10T05:11:27.721631+0000","last_active":"2024-09-10T05:12:04.962727+0000","last_peered":"2024-09-10T05:12:04.962727+0000","last_clean":"2024-09-10T05:12:04.962727+0000","last_became_active":"2024-09-10T05:11:27.716318+0000","last_became_peered":"2024-09-10T05:11:27.716318+0000","last_unstale":"2024-09-10T05:12:04.962727+0000","last_undegraded":"2024-09-10T05:12:04.962727+0000","last_fullsized":"2024-09-10T05:12:04.962727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:40.603860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958076+0000","last_change":"2024-09-10T05:11:31.735274+0000","last_active":"2024-09-10T05:12:04.958076+0000","last_peered":"2024-09-10T05:12:04.958076+0000","last_clean":"2024-09-10T05:12:04.958076+0000","last_became_active":"2024-09-10T05:11:31.734975+0000","last_became_peered":"2024-09-10T05:11:31.734975+0000","last_unstale":"2024-09-10T05:12:04.958076+0000","last_undegraded":"2024-09-10T05:12:04.958076+0000","last_fullsized":"2024-09-10T05:12:04.958076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:45.105200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'47","reported_seq":101,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.270154+0000","last_change":"2024-09-10T05:11:33.746845+0000","last_active":"2024-09-10T05:13:34.270154+0000","last_peered":"2024-09-10T05:13:34.270154+0000","last_clean":"2024-09-10T05:13:34.270154+0000","last_became_active":"2024-09-10T05:11:33.746522+0000","last_became_peered":"2024-09-10T05:11:33.746522+0000","last_unstale":"2024-09-10T05:13:34.270154+0000","last_undegraded":"2024-09-10T05:13:34.270154+0000","last_fullsized":"2024-09-10T05:13:34.270154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:43.397048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957524+0000","last_change":"2024-09-10T05:11:35.746098+0000","last_active":"2024-09-10T05:12:04.957524+0000","last_peered":"2024-09-10T05:12:04.957524+0000","last_clean":"2024-09-10T05:12:04.957524+0000","last_became_active":"2024-09-10T05:11:35.745840+0000","last_became_peered":"2024-09-10T05:11:35.745840+0000","last_unstale":"2024-09-10T05:12:04.957524+0000","last_undegraded":"2024-09-10T05:12:04.957524+0000","last_fullsized":"2024-09-10T05:12:04.957524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:48.168086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.970146+0000","last_change":"2024-09-10T05:11:37.754850+0000","last_active":"2024-09-10T05:12:51.970146+0000","last_peered":"2024-09-10T05:12:51.970146+0000","last_clean":"2024-09-10T05:12:51.970146+0000","last_became_active":"2024-09-10T05:11:37.754562+0000","last_became_peered":"2024-09-10T05:11:37.754562+0000","last_unstale":"2024-09-10T05:12:51.970146+0000","last_undegraded":"2024-09-10T05:12:51.970146+0000","last_fullsized":"2024-09-10T05:12:51.970146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:27.172242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.199301+0000","last_change":"2024-09-10T05:11:29.721603+0000","last_active":"2024-09-10T05:14:36.199301+0000","last_peered":"2024-09-10T05:14:36.199301+0000","last_clean":"2024-09-10T05:14:36.199301+0000","last_became_active":"2024-09-10T05:11:29.721292+0000","last_became_peered":"2024-09-10T05:11:29.721292+0000","last_unstale":"2024-09-10T05:14:36.199301+0000","last_undegraded":"2024-09-10T05:14:36.199301+0000","last_fullsized":"2024-09-10T05:14:36.199301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.549609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.324967+0000","last_change":"2024-09-10T05:11:27.728236+0000","last_active":"2024-09-10T05:14:36.324967+0000","last_peered":"2024-09-10T05:14:36.324967+0000","last_clean":"2024-09-10T05:14:36.324967+0000","last_became_active":"2024-09-10T05:11:27.726419+0000","last_became_peered":"2024-09-10T05:11:27.726419+0000","last_unstale":"2024-09-10T05:14:36.324967+0000","last_undegraded":"2024-09-10T05:14:36.324967+0000","last_fullsized":"2024-09-10T05:14:36.324967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:45.107412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956724+0000","last_change":"2024-09-10T05:11:31.732240+0000","last_active":"2024-09-10T05:12:04.956724+0000","last_peered":"2024-09-10T05:12:04.956724+0000","last_clean":"2024-09-10T05:12:04.956724+0000","last_became_active":"2024-09-10T05:11:31.732017+0000","last_became_peered":"2024-09-10T05:11:31.732017+0000","last_unstale":"2024-09-10T05:12:04.956724+0000","last_undegraded":"2024-09-10T05:12:04.956724+0000","last_fullsized":"2024-09-10T05:12:04.956724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:35.116886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'37","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:50.916771+0000","last_change":"2024-09-10T05:11:33.747704+0000","last_active":"2024-09-10T05:13:50.916771+0000","last_peered":"2024-09-10T05:13:50.916771+0000","last_clean":"2024-09-10T05:13:50.916771+0000","last_became_active":"2024-09-10T05:11:33.747334+0000","last_became_peered":"2024-09-10T05:11:33.747334+0000","last_unstale":"2024-09-10T05:13:50.916771+0000","last_undegraded":"2024-09-10T05:13:50.916771+0000","last_fullsized":"2024-09-10T05:13:50.916771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:02.895443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956478+0000","last_change":"2024-09-10T05:11:35.753755+0000","last_active":"2024-09-10T05:12:04.956478+0000","last_peered":"2024-09-10T05:12:04.956478+0000","last_clean":"2024-09-10T05:12:04.956478+0000","last_became_active":"2024-09-10T05:11:35.753453+0000","last_became_peered":"2024-09-10T05:11:35.753453+0000","last_unstale":"2024-09-10T05:12:04.956478+0000","last_undegraded":"2024-09-10T05:12:04.956478+0000","last_fullsized":"2024-09-10T05:12:04.956478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:03.592621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:46.437159+0000","last_change":"2024-09-10T05:11:37.758133+0000","last_active":"2024-09-10T05:12:46.437159+0000","last_peered":"2024-09-10T05:12:46.437159+0000","last_clean":"2024-09-10T05:12:46.437159+0000","last_became_active":"2024-09-10T05:11:37.757307+0000","last_became_peered":"2024-09-10T05:11:37.757307+0000","last_unstale":"2024-09-10T05:12:46.437159+0000","last_undegraded":"2024-09-10T05:12:46.437159+0000","last_fullsized":"2024-09-10T05:12:46.437159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:15.800062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958765+0000","last_change":"2024-09-10T05:11:29.722984+0000","last_active":"2024-09-10T05:12:04.958765+0000","last_peered":"2024-09-10T05:12:04.958765+0000","last_clean":"2024-09-10T05:12:04.958765+0000","last_became_active":"2024-09-10T05:11:29.722719+0000","last_became_peered":"2024-09-10T05:11:29.722719+0000","last_unstale":"2024-09-10T05:12:04.958765+0000","last_undegraded":"2024-09-10T05:12:04.958765+0000","last_fullsized":"2024-09-10T05:12:04.958765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:12.408667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.656125+0000","last_change":"2024-09-10T05:11:27.722920+0000","last_active":"2024-09-10T05:13:35.656125+0000","last_peered":"2024-09-10T05:13:35.656125+0000","last_clean":"2024-09-10T05:13:35.656125+0000","last_became_active":"2024-09-10T05:11:27.722553+0000","last_became_peered":"2024-09-10T05:11:27.722553+0000","last_unstale":"2024-09-10T05:13:35.656125+0000","last_undegraded":"2024-09-10T05:13:35.656125+0000","last_fullsized":"2024-09-10T05:13:35.656125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:26.252530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'4","reported_seq":229,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:42.977305+0000","last_change":"2024-09-10T05:11:31.734260+0000","last_active":"2024-09-10T05:14:42.977305+0000","last_peered":"2024-09-10T05:14:42.977305+0000","last_clean":"2024-09-10T05:14:42.977305+0000","last_became_active":"2024-09-10T05:11:31.733822+0000","last_became_peered":"2024-09-10T05:11:31.733822+0000","last_unstale":"2024-09-10T05:14:42.977305+0000","last_undegraded":"2024-09-10T05:14:42.977305+0000","last_fullsized":"2024-09-10T05:14:42.977305+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:41.836144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'48","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.272006+0000","last_change":"2024-09-10T05:11:33.748247+0000","last_active":"2024-09-10T05:13:34.272006+0000","last_peered":"2024-09-10T05:13:34.272006+0000","last_clean":"2024-09-10T05:13:34.272006+0000","last_became_active":"2024-09-10T05:11:33.747938+0000","last_became_peered":"2024-09-10T05:11:33.747938+0000","last_unstale":"2024-09-10T05:13:34.272006+0000","last_undegraded":"2024-09-10T05:13:34.272006+0000","last_fullsized":"2024-09-10T05:13:34.272006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:53.311224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":351,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.014451+0000","last_change":"2024-09-10T05:11:35.754114+0000","last_active":"2024-09-10T05:14:43.014451+0000","last_peered":"2024-09-10T05:14:43.014451+0000","last_clean":"2024-09-10T05:14:43.014451+0000","last_became_active":"2024-09-10T05:11:35.753663+0000","last_became_peered":"2024-09-10T05:11:35.753663+0000","last_unstale":"2024-09-10T05:14:43.014451+0000","last_undegraded":"2024-09-10T05:14:43.014451+0000","last_fullsized":"2024-09-10T05:14:43.014451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.071659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.125804+0000","last_change":"2024-09-10T05:11:37.755275+0000","last_active":"2024-09-10T05:14:36.125804+0000","last_peered":"2024-09-10T05:14:36.125804+0000","last_clean":"2024-09-10T05:14:36.125804+0000","last_became_active":"2024-09-10T05:11:37.754959+0000","last_became_peered":"2024-09-10T05:11:37.754959+0000","last_unstale":"2024-09-10T05:14:36.125804+0000","last_undegraded":"2024-09-10T05:14:36.125804+0000","last_fullsized":"2024-09-10T05:14:36.125804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:34:33.810681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'17","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:45.915314+0000","last_change":"2024-09-10T05:11:29.722535+0000","last_active":"2024-09-10T05:13:45.915314+0000","last_peered":"2024-09-10T05:13:45.915314+0000","last_clean":"2024-09-10T05:13:45.915314+0000","last_became_active":"2024-09-10T05:11:29.722267+0000","last_became_peered":"2024-09-10T05:11:29.722267+0000","last_unstale":"2024-09-10T05:13:45.915314+0000","last_undegraded":"2024-09-10T05:13:45.915314+0000","last_fullsized":"2024-09-10T05:13:45.915314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:18.707927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.334065+0000","last_change":"2024-09-10T05:11:27.732198+0000","last_active":"2024-09-10T05:14:36.334065+0000","last_peered":"2024-09-10T05:14:36.334065+0000","last_clean":"2024-09-10T05:14:36.334065+0000","last_became_active":"2024-09-10T05:11:27.731909+0000","last_became_peered":"2024-09-10T05:11:27.731909+0000","last_unstale":"2024-09-10T05:14:36.334065+0000","last_undegraded":"2024-09-10T05:14:36.334065+0000","last_fullsized":"2024-09-10T05:14:36.334065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:44.836107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957106+0000","last_change":"2024-09-10T05:11:31.733054+0000","last_active":"2024-09-10T05:12:04.957106+0000","last_peered":"2024-09-10T05:12:04.957106+0000","last_clean":"2024-09-10T05:12:04.957106+0000","last_became_active":"2024-09-10T05:11:31.732807+0000","last_became_peered":"2024-09-10T05:11:31.732807+0000","last_unstale":"2024-09-10T05:12:04.957106+0000","last_undegraded":"2024-09-10T05:12:04.957106+0000","last_fullsized":"2024-09-10T05:12:04.957106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:45.290579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'66","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.273739+0000","last_change":"2024-09-10T05:11:33.747177+0000","last_active":"2024-09-10T05:13:34.273739+0000","last_peered":"2024-09-10T05:13:34.273739+0000","last_clean":"2024-09-10T05:13:34.273739+0000","last_became_active":"2024-09-10T05:11:33.745449+0000","last_became_peered":"2024-09-10T05:11:33.745449+0000","last_unstale":"2024-09-10T05:13:34.273739+0000","last_undegraded":"2024-09-10T05:13:34.273739+0000","last_fullsized":"2024-09-10T05:13:34.273739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:08.744407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956380+0000","last_change":"2024-09-10T05:11:35.748171+0000","last_active":"2024-09-10T05:12:04.956380+0000","last_peered":"2024-09-10T05:12:04.956380+0000","last_clean":"2024-09-10T05:12:04.956380+0000","last_became_active":"2024-09-10T05:11:35.747913+0000","last_became_peered":"2024-09-10T05:11:35.747913+0000","last_unstale":"2024-09-10T05:12:04.956380+0000","last_undegraded":"2024-09-10T05:12:04.956380+0000","last_fullsized":"2024-09-10T05:12:04.956380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:43.800560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'20","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.564815+0000","last_change":"2024-09-10T05:11:37.755327+0000","last_active":"2024-09-10T05:14:36.564815+0000","last_peered":"2024-09-10T05:14:36.564815+0000","last_clean":"2024-09-10T05:14:36.564815+0000","last_became_active":"2024-09-10T05:11:37.754915+0000","last_became_peered":"2024-09-10T05:11:37.754915+0000","last_unstale":"2024-09-10T05:14:36.564815+0000","last_undegraded":"2024-09-10T05:14:36.564815+0000","last_fullsized":"2024-09-10T05:14:36.564815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:57.393330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'14","reported_seq":78,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107522+0000","last_change":"2024-09-10T05:11:29.728158+0000","last_active":"2024-09-10T05:14:36.107522+0000","last_peered":"2024-09-10T05:14:36.107522+0000","last_clean":"2024-09-10T05:14:36.107522+0000","last_became_active":"2024-09-10T05:11:29.727349+0000","last_became_peered":"2024-09-10T05:11:29.727349+0000","last_unstale":"2024-09-10T05:14:36.107522+0000","last_undegraded":"2024-09-10T05:14:36.107522+0000","last_fullsized":"2024-09-10T05:14:36.107522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.550005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957300+0000","last_change":"2024-09-10T05:11:27.718217+0000","last_active":"2024-09-10T05:12:04.957300+0000","last_peered":"2024-09-10T05:12:04.957300+0000","last_clean":"2024-09-10T05:12:04.957300+0000","last_became_active":"2024-09-10T05:11:27.717887+0000","last_became_peered":"2024-09-10T05:11:27.717887+0000","last_unstale":"2024-09-10T05:12:04.957300+0000","last_undegraded":"2024-09-10T05:12:04.957300+0000","last_fullsized":"2024-09-10T05:12:04.957300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:12.698794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959422+0000","last_change":"2024-09-10T05:11:31.735674+0000","last_active":"2024-09-10T05:12:04.959422+0000","last_peered":"2024-09-10T05:12:04.959422+0000","last_clean":"2024-09-10T05:12:04.959422+0000","last_became_active":"2024-09-10T05:11:31.735386+0000","last_became_peered":"2024-09-10T05:11:31.735386+0000","last_unstale":"2024-09-10T05:12:04.959422+0000","last_undegraded":"2024-09-10T05:12:04.959422+0000","last_fullsized":"2024-09-10T05:12:04.959422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:05.541110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'38","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.253218+0000","last_change":"2024-09-10T05:11:33.744354+0000","last_active":"2024-09-10T05:13:34.253218+0000","last_peered":"2024-09-10T05:13:34.253218+0000","last_clean":"2024-09-10T05:13:34.253218+0000","last_became_active":"2024-09-10T05:11:33.744026+0000","last_became_peered":"2024-09-10T05:11:33.744026+0000","last_unstale":"2024-09-10T05:13:34.253218+0000","last_undegraded":"2024-09-10T05:13:34.253218+0000","last_fullsized":"2024-09-10T05:13:34.253218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.017634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960608+0000","last_change":"2024-09-10T05:11:35.749447+0000","last_active":"2024-09-10T05:12:04.960608+0000","last_peered":"2024-09-10T05:12:04.960608+0000","last_clean":"2024-09-10T05:12:04.960608+0000","last_became_active":"2024-09-10T05:11:35.748874+0000","last_became_peered":"2024-09-10T05:11:35.748874+0000","last_unstale":"2024-09-10T05:12:04.960608+0000","last_undegraded":"2024-09-10T05:12:04.960608+0000","last_fullsized":"2024-09-10T05:12:04.960608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:09.658936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'9","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.113777+0000","last_change":"2024-09-10T05:11:37.768186+0000","last_active":"2024-09-10T05:14:36.113777+0000","last_peered":"2024-09-10T05:14:36.113777+0000","last_clean":"2024-09-10T05:14:36.113777+0000","last_became_active":"2024-09-10T05:11:37.767895+0000","last_became_peered":"2024-09-10T05:11:37.767895+0000","last_unstale":"2024-09-10T05:14:36.113777+0000","last_undegraded":"2024-09-10T05:14:36.113777+0000","last_fullsized":"2024-09-10T05:14:36.113777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:10.944772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'16","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604812+0000","last_change":"2024-09-10T05:11:29.734119+0000","last_active":"2024-09-10T05:13:32.604812+0000","last_peered":"2024-09-10T05:13:32.604812+0000","last_clean":"2024-09-10T05:13:32.604812+0000","last_became_active":"2024-09-10T05:11:29.733870+0000","last_became_peered":"2024-09-10T05:11:29.733870+0000","last_unstale":"2024-09-10T05:13:32.604812+0000","last_undegraded":"2024-09-10T05:13:32.604812+0000","last_fullsized":"2024-09-10T05:13:32.604812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:25:17.874072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956901+0000","last_change":"2024-09-10T05:11:27.726184+0000","last_active":"2024-09-10T05:12:04.956901+0000","last_peered":"2024-09-10T05:12:04.956901+0000","last_clean":"2024-09-10T05:12:04.956901+0000","last_became_active":"2024-09-10T05:11:27.725852+0000","last_became_peered":"2024-09-10T05:11:27.725852+0000","last_unstale":"2024-09-10T05:12:04.956901+0000","last_undegraded":"2024-09-10T05:12:04.956901+0000","last_fullsized":"2024-09-10T05:12:04.956901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:25.585863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957204+0000","last_change":"2024-09-10T05:11:31.734106+0000","last_active":"2024-09-10T05:12:04.957204+0000","last_peered":"2024-09-10T05:12:04.957204+0000","last_clean":"2024-09-10T05:12:04.957204+0000","last_became_active":"2024-09-10T05:11:31.733756+0000","last_became_peered":"2024-09-10T05:11:31.733756+0000","last_unstale":"2024-09-10T05:12:04.957204+0000","last_undegraded":"2024-09-10T05:12:04.957204+0000","last_fullsized":"2024-09-10T05:12:04.957204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:20.576939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'37","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:50.916277+0000","last_change":"2024-09-10T05:11:33.742119+0000","last_active":"2024-09-10T05:13:50.916277+0000","last_peered":"2024-09-10T05:13:50.916277+0000","last_clean":"2024-09-10T05:13:50.916277+0000","last_became_active":"2024-09-10T05:11:33.741848+0000","last_became_peered":"2024-09-10T05:11:33.741848+0000","last_unstale":"2024-09-10T05:13:50.916277+0000","last_undegraded":"2024-09-10T05:13:50.916277+0000","last_fullsized":"2024-09-10T05:13:50.916277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:58.109463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'282","reported_seq":452,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.569053+0000","last_change":"2024-09-10T05:11:35.752932+0000","last_active":"2024-09-10T05:14:36.569053+0000","last_peered":"2024-09-10T05:14:36.569053+0000","last_clean":"2024-09-10T05:14:36.569053+0000","last_became_active":"2024-09-10T05:11:35.752511+0000","last_became_peered":"2024-09-10T05:11:35.752511+0000","last_unstale":"2024-09-10T05:14:36.569053+0000","last_undegraded":"2024-09-10T05:14:36.569053+0000","last_fullsized":"2024-09-10T05:14:36.569053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:09.522467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'14","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:43.909368+0000","last_change":"2024-09-10T05:11:37.758779+0000","last_active":"2024-09-10T05:13:43.909368+0000","last_peered":"2024-09-10T05:13:43.909368+0000","last_clean":"2024-09-10T05:13:43.909368+0000","last_became_active":"2024-09-10T05:11:37.758381+0000","last_became_peered":"2024-09-10T05:11:37.758381+0000","last_unstale":"2024-09-10T05:13:43.909368+0000","last_undegraded":"2024-09-10T05:13:43.909368+0000","last_fullsized":"2024-09-10T05:13:43.909368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:32.090333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'14","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417408+0000","last_change":"2024-09-10T05:11:29.722434+0000","last_active":"2024-09-10T05:14:36.417408+0000","last_peered":"2024-09-10T05:14:36.417408+0000","last_clean":"2024-09-10T05:14:36.417408+0000","last_became_active":"2024-09-10T05:11:29.722170+0000","last_became_peered":"2024-09-10T05:11:29.722170+0000","last_unstale":"2024-09-10T05:14:36.417408+0000","last_undegraded":"2024-09-10T05:14:36.417408+0000","last_fullsized":"2024-09-10T05:14:36.417408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.550005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.331217+0000","last_change":"2024-09-10T05:11:27.735604+0000","last_active":"2024-09-10T05:14:36.331217+0000","last_peered":"2024-09-10T05:14:36.331217+0000","last_clean":"2024-09-10T05:14:36.331217+0000","last_became_active":"2024-09-10T05:11:27.732591+0000","last_became_peered":"2024-09-10T05:11:27.732591+0000","last_unstale":"2024-09-10T05:14:36.331217+0000","last_undegraded":"2024-09-10T05:14:36.331217+0000","last_fullsized":"2024-09-10T05:14:36.331217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:31.318349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":414,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.322657+0000","last_change":"2024-09-10T05:11:31.735002+0000","last_active":"2024-09-10T05:13:35.322657+0000","last_peered":"2024-09-10T05:13:35.322657+0000","last_clean":"2024-09-10T05:13:35.322657+0000","last_became_active":"2024-09-10T05:11:31.734714+0000","last_became_peered":"2024-09-10T05:11:31.734714+0000","last_unstale":"2024-09-10T05:13:35.322657+0000","last_undegraded":"2024-09-10T05:13:35.322657+0000","last_fullsized":"2024-09-10T05:13:35.322657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:15.409455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958372+0000","last_change":"2024-09-10T05:11:33.747604+0000","last_active":"2024-09-10T05:12:04.958372+0000","last_peered":"2024-09-10T05:12:04.958372+0000","last_clean":"2024-09-10T05:12:04.958372+0000","last_became_active":"2024-09-10T05:11:33.747376+0000","last_became_peered":"2024-09-10T05:11:33.747376+0000","last_unstale":"2024-09-10T05:12:04.958372+0000","last_undegraded":"2024-09-10T05:12:04.958372+0000","last_fullsized":"2024-09-10T05:12:04.958372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:06.584551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'282","reported_seq":463,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.578120+0000","last_change":"2024-09-10T05:11:35.751653+0000","last_active":"2024-09-10T05:14:36.578120+0000","last_peered":"2024-09-10T05:14:36.578120+0000","last_clean":"2024-09-10T05:14:36.578120+0000","last_became_active":"2024-09-10T05:11:35.751352+0000","last_became_peered":"2024-09-10T05:11:35.751352+0000","last_unstale":"2024-09-10T05:14:36.578120+0000","last_undegraded":"2024-09-10T05:14:36.578120+0000","last_fullsized":"2024-09-10T05:14:36.578120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:50.857756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.203681+0000","last_change":"2024-09-10T05:11:37.757022+0000","last_active":"2024-09-10T05:14:36.203681+0000","last_peered":"2024-09-10T05:14:36.203681+0000","last_clean":"2024-09-10T05:14:36.203681+0000","last_became_active":"2024-09-10T05:11:37.756734+0000","last_became_peered":"2024-09-10T05:11:37.756734+0000","last_unstale":"2024-09-10T05:14:36.203681+0000","last_undegraded":"2024-09-10T05:14:36.203681+0000","last_fullsized":"2024-09-10T05:14:36.203681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:18.190348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'24","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382763+0000","last_change":"2024-09-10T05:11:29.735311+0000","last_active":"2024-09-10T05:14:36.382763+0000","last_peered":"2024-09-10T05:14:36.382763+0000","last_clean":"2024-09-10T05:14:36.382763+0000","last_became_active":"2024-09-10T05:11:29.735032+0000","last_became_peered":"2024-09-10T05:11:29.735032+0000","last_unstale":"2024-09-10T05:14:36.382763+0000","last_undegraded":"2024-09-10T05:14:36.382763+0000","last_fullsized":"2024-09-10T05:14:36.382763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:36.894039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914802+0000","last_change":"2024-09-10T05:11:27.734962+0000","last_active":"2024-09-10T05:13:40.914802+0000","last_peered":"2024-09-10T05:13:40.914802+0000","last_clean":"2024-09-10T05:13:40.914802+0000","last_became_active":"2024-09-10T05:11:27.734204+0000","last_became_peered":"2024-09-10T05:11:27.734204+0000","last_unstale":"2024-09-10T05:13:40.914802+0000","last_undegraded":"2024-09-10T05:13:40.914802+0000","last_fullsized":"2024-09-10T05:13:40.914802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:06.500114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962223+0000","last_change":"2024-09-10T05:11:31.737418+0000","last_active":"2024-09-10T05:12:04.962223+0000","last_peered":"2024-09-10T05:12:04.962223+0000","last_clean":"2024-09-10T05:12:04.962223+0000","last_became_active":"2024-09-10T05:11:31.736841+0000","last_became_peered":"2024-09-10T05:11:31.736841+0000","last_unstale":"2024-09-10T05:12:04.962223+0000","last_undegraded":"2024-09-10T05:12:04.962223+0000","last_fullsized":"2024-09-10T05:12:04.962223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:39.906395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'39","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.266836+0000","last_change":"2024-09-10T05:11:33.744918+0000","last_active":"2024-09-10T05:13:34.266836+0000","last_peered":"2024-09-10T05:13:34.266836+0000","last_clean":"2024-09-10T05:13:34.266836+0000","last_became_active":"2024-09-10T05:11:33.744394+0000","last_became_peered":"2024-09-10T05:11:33.744394+0000","last_unstale":"2024-09-10T05:13:34.266836+0000","last_undegraded":"2024-09-10T05:13:34.266836+0000","last_fullsized":"2024-09-10T05:13:34.266836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:42.791441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959396+0000","last_change":"2024-09-10T05:11:35.750802+0000","last_active":"2024-09-10T05:12:04.959396+0000","last_peered":"2024-09-10T05:12:04.959396+0000","last_clean":"2024-09-10T05:12:04.959396+0000","last_became_active":"2024-09-10T05:11:35.750450+0000","last_became_peered":"2024-09-10T05:11:35.750450+0000","last_unstale":"2024-09-10T05:12:04.959396+0000","last_undegraded":"2024-09-10T05:12:04.959396+0000","last_fullsized":"2024-09-10T05:12:04.959396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:00.422593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'6","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.453623+0000","last_change":"2024-09-10T05:11:37.757621+0000","last_active":"2024-09-10T05:14:36.453623+0000","last_peered":"2024-09-10T05:14:36.453623+0000","last_clean":"2024-09-10T05:14:36.453623+0000","last_became_active":"2024-09-10T05:11:37.757289+0000","last_became_peered":"2024-09-10T05:11:37.757289+0000","last_unstale":"2024-09-10T05:14:36.453623+0000","last_undegraded":"2024-09-10T05:14:36.453623+0000","last_fullsized":"2024-09-10T05:14:36.453623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:57.261211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'8","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417687+0000","last_change":"2024-09-10T05:11:29.734971+0000","last_active":"2024-09-10T05:14:36.417687+0000","last_peered":"2024-09-10T05:14:36.417687+0000","last_clean":"2024-09-10T05:14:36.417687+0000","last_became_active":"2024-09-10T05:11:29.734367+0000","last_became_peered":"2024-09-10T05:11:29.734367+0000","last_unstale":"2024-09-10T05:14:36.417687+0000","last_undegraded":"2024-09-10T05:14:36.417687+0000","last_fullsized":"2024-09-10T05:14:36.417687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:48.993029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957132+0000","last_change":"2024-09-10T05:11:14.294244+0000","last_active":"2024-09-10T05:12:04.957132+0000","last_peered":"2024-09-10T05:12:04.957132+0000","last_clean":"2024-09-10T05:12:04.957132+0000","last_became_active":"2024-09-10T05:11:14.293121+0000","last_became_peered":"2024-09-10T05:11:14.293121+0000","last_unstale":"2024-09-10T05:12:04.957132+0000","last_undegraded":"2024-09-10T05:12:04.957132+0000","last_fullsized":"2024-09-10T05:12:04.957132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:12.494055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:12.494055+0000","last_clean_scrub_stamp":"2024-09-10T05:11:12.494055+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:00.347397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955461+0000","last_change":"2024-09-10T05:11:18.533277+0000","last_active":"2024-09-10T05:12:04.955461+0000","last_peered":"2024-09-10T05:12:04.955461+0000","last_clean":"2024-09-10T05:12:04.955461+0000","last_became_active":"2024-09-10T05:11:16.531926+0000","last_became_peered":"2024-09-10T05:11:16.531926+0000","last_unstale":"2024-09-10T05:12:04.955461+0000","last_undegraded":"2024-09-10T05:12:04.955461+0000","last_fullsized":"2024-09-10T05:12:04.955461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:44.106335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121101,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955445+0000","last_change":"2024-09-10T05:11:27.736386+0000","last_active":"2024-09-10T05:12:04.955445+0000","last_peered":"2024-09-10T05:12:04.955445+0000","last_clean":"2024-09-10T05:12:04.955445+0000","last_became_active":"2024-09-10T05:11:27.735941+0000","last_became_peered":"2024-09-10T05:11:27.735941+0000","last_unstale":"2024-09-10T05:12:04.955445+0000","last_undegraded":"2024-09-10T05:12:04.955445+0000","last_fullsized":"2024-09-10T05:12:04.955445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:05.735103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960299+0000","last_change":"2024-09-10T05:11:31.736397+0000","last_active":"2024-09-10T05:12:04.960299+0000","last_peered":"2024-09-10T05:12:04.960299+0000","last_clean":"2024-09-10T05:12:04.960299+0000","last_became_active":"2024-09-10T05:11:31.736104+0000","last_became_peered":"2024-09-10T05:11:31.736104+0000","last_unstale":"2024-09-10T05:12:04.960299+0000","last_undegraded":"2024-09-10T05:12:04.960299+0000","last_fullsized":"2024-09-10T05:12:04.960299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:58.631203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'85","reported_seq":161,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.278155+0000","last_change":"2024-09-10T05:11:33.744321+0000","last_active":"2024-09-10T05:13:34.278155+0000","last_peered":"2024-09-10T05:13:34.278155+0000","last_clean":"2024-09-10T05:13:34.278155+0000","last_became_active":"2024-09-10T05:11:33.743933+0000","last_became_peered":"2024-09-10T05:11:33.743933+0000","last_unstale":"2024-09-10T05:13:34.278155+0000","last_undegraded":"2024-09-10T05:13:34.278155+0000","last_fullsized":"2024-09-10T05:13:34.278155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:30.903532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957924+0000","last_change":"2024-09-10T05:11:35.750549+0000","last_active":"2024-09-10T05:12:04.957924+0000","last_peered":"2024-09-10T05:12:04.957924+0000","last_clean":"2024-09-10T05:12:04.957924+0000","last_became_active":"2024-09-10T05:11:35.750248+0000","last_became_peered":"2024-09-10T05:11:35.750248+0000","last_unstale":"2024-09-10T05:12:04.957924+0000","last_undegraded":"2024-09-10T05:12:04.957924+0000","last_fullsized":"2024-09-10T05:12:04.957924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:19.363818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'85","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.427998+0000","last_change":"2024-09-10T05:11:37.755526+0000","last_active":"2024-09-10T05:14:36.427998+0000","last_peered":"2024-09-10T05:14:36.427998+0000","last_clean":"2024-09-10T05:14:36.427998+0000","last_became_active":"2024-09-10T05:11:37.755239+0000","last_became_peered":"2024-09-10T05:11:37.755239+0000","last_unstale":"2024-09-10T05:14:36.427998+0000","last_undegraded":"2024-09-10T05:14:36.427998+0000","last_fullsized":"2024-09-10T05:14:36.427998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:13.536289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.387697+0000","last_change":"2024-09-10T05:11:29.732838+0000","last_active":"2024-09-10T05:14:36.387697+0000","last_peered":"2024-09-10T05:14:36.387697+0000","last_clean":"2024-09-10T05:14:36.387697+0000","last_became_active":"2024-09-10T05:11:29.732560+0000","last_became_peered":"2024-09-10T05:11:29.732560+0000","last_unstale":"2024-09-10T05:14:36.387697+0000","last_undegraded":"2024-09-10T05:14:36.387697+0000","last_fullsized":"2024-09-10T05:14:36.387697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:38.766836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954364+0000","last_change":"2024-09-10T05:11:18.532549+0000","last_active":"2024-09-10T05:12:04.954364+0000","last_peered":"2024-09-10T05:12:04.954364+0000","last_clean":"2024-09-10T05:12:04.954364+0000","last_became_active":"2024-09-10T05:11:16.531911+0000","last_became_peered":"2024-09-10T05:11:16.531911+0000","last_unstale":"2024-09-10T05:12:04.954364+0000","last_undegraded":"2024-09-10T05:12:04.954364+0000","last_fullsized":"2024-09-10T05:12:04.954364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:51:16.716892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039105900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.649449+0000","last_change":"2024-09-10T05:11:27.713561+0000","last_active":"2024-09-10T05:12:09.649449+0000","last_peered":"2024-09-10T05:12:09.649449+0000","last_clean":"2024-09-10T05:12:09.649449+0000","last_became_active":"2024-09-10T05:11:27.713026+0000","last_became_peered":"2024-09-10T05:11:27.713026+0000","last_unstale":"2024-09-10T05:12:09.649449+0000","last_undegraded":"2024-09-10T05:12:09.649449+0000","last_fullsized":"2024-09-10T05:12:09.649449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:55.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961506+0000","last_change":"2024-09-10T05:11:31.738104+0000","last_active":"2024-09-10T05:12:04.961506+0000","last_peered":"2024-09-10T05:12:04.961506+0000","last_clean":"2024-09-10T05:12:04.961506+0000","last_became_active":"2024-09-10T05:11:31.737199+0000","last_became_peered":"2024-09-10T05:11:31.737199+0000","last_unstale":"2024-09-10T05:12:04.961506+0000","last_undegraded":"2024-09-10T05:12:04.961506+0000","last_fullsized":"2024-09-10T05:12:04.961506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:08.807684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'281","reported_seq":490,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813328+0000","last_change":"2024-09-10T05:11:33.744372+0000","last_active":"2024-09-10T05:14:31.813328+0000","last_peered":"2024-09-10T05:14:31.813328+0000","last_clean":"2024-09-10T05:14:31.813328+0000","last_became_active":"2024-09-10T05:11:33.744103+0000","last_became_peered":"2024-09-10T05:11:33.744103+0000","last_unstale":"2024-09-10T05:14:31.813328+0000","last_undegraded":"2024-09-10T05:14:31.813328+0000","last_fullsized":"2024-09-10T05:14:31.813328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:33.869492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":372,"num_read_kb":371,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956847+0000","last_change":"2024-09-10T05:11:35.749117+0000","last_active":"2024-09-10T05:12:04.956847+0000","last_peered":"2024-09-10T05:12:04.956847+0000","last_clean":"2024-09-10T05:12:04.956847+0000","last_became_active":"2024-09-10T05:11:35.748767+0000","last_became_peered":"2024-09-10T05:11:35.748767+0000","last_unstale":"2024-09-10T05:12:04.956847+0000","last_undegraded":"2024-09-10T05:12:04.956847+0000","last_fullsized":"2024-09-10T05:12:04.956847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:02.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.966773+0000","last_change":"2024-09-10T05:11:37.758407+0000","last_active":"2024-09-10T05:12:51.966773+0000","last_peered":"2024-09-10T05:12:51.966773+0000","last_clean":"2024-09-10T05:12:51.966773+0000","last_became_active":"2024-09-10T05:11:37.758114+0000","last_became_peered":"2024-09-10T05:11:37.758114+0000","last_unstale":"2024-09-10T05:12:51.966773+0000","last_undegraded":"2024-09-10T05:12:51.966773+0000","last_fullsized":"2024-09-10T05:12:51.966773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:43.659998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'14","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417308+0000","last_change":"2024-09-10T05:11:29.724542+0000","last_active":"2024-09-10T05:14:36.417308+0000","last_peered":"2024-09-10T05:14:36.417308+0000","last_clean":"2024-09-10T05:14:36.417308+0000","last_became_active":"2024-09-10T05:11:29.723609+0000","last_became_peered":"2024-09-10T05:11:29.723609+0000","last_unstale":"2024-09-10T05:14:36.417308+0000","last_undegraded":"2024-09-10T05:14:36.417308+0000","last_fullsized":"2024-09-10T05:14:36.417308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:37.264959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956636+0000","last_change":"2024-09-10T05:11:18.530458+0000","last_active":"2024-09-10T05:12:04.956636+0000","last_peered":"2024-09-10T05:12:04.956636+0000","last_clean":"2024-09-10T05:12:04.956636+0000","last_became_active":"2024-09-10T05:11:16.530448+0000","last_became_peered":"2024-09-10T05:11:16.530448+0000","last_unstale":"2024-09-10T05:12:04.956636+0000","last_undegraded":"2024-09-10T05:12:04.956636+0000","last_fullsized":"2024-09-10T05:12:04.956636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:12.102135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036982300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.027950+0000","last_change":"2024-09-10T05:11:27.715078+0000","last_active":"2024-09-10T05:14:36.027950+0000","last_peered":"2024-09-10T05:14:36.027950+0000","last_clean":"2024-09-10T05:14:36.027950+0000","last_became_active":"2024-09-10T05:11:27.714299+0000","last_became_peered":"2024-09-10T05:11:27.714299+0000","last_unstale":"2024-09-10T05:14:36.027950+0000","last_undegraded":"2024-09-10T05:14:36.027950+0000","last_fullsized":"2024-09-10T05:14:36.027950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:12.065688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963356+0000","last_change":"2024-09-10T05:11:31.731588+0000","last_active":"2024-09-10T05:12:04.963356+0000","last_peered":"2024-09-10T05:12:04.963356+0000","last_clean":"2024-09-10T05:12:04.963356+0000","last_became_active":"2024-09-10T05:11:31.730978+0000","last_became_peered":"2024-09-10T05:11:31.730978+0000","last_unstale":"2024-09-10T05:12:04.963356+0000","last_undegraded":"2024-09-10T05:12:04.963356+0000","last_fullsized":"2024-09-10T05:12:04.963356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:07.052816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'17","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813393+0000","last_change":"2024-09-10T05:11:33.746382+0000","last_active":"2024-09-10T05:14:31.813393+0000","last_peered":"2024-09-10T05:14:31.813393+0000","last_clean":"2024-09-10T05:14:31.813393+0000","last_became_active":"2024-09-10T05:11:33.746102+0000","last_became_peered":"2024-09-10T05:11:33.746102+0000","last_unstale":"2024-09-10T05:14:31.813393+0000","last_undegraded":"2024-09-10T05:14:31.813393+0000","last_fullsized":"2024-09-10T05:14:31.813393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:53.746336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957971+0000","last_change":"2024-09-10T05:11:35.753872+0000","last_active":"2024-09-10T05:12:04.957971+0000","last_peered":"2024-09-10T05:12:04.957971+0000","last_clean":"2024-09-10T05:12:04.957971+0000","last_became_active":"2024-09-10T05:11:35.753342+0000","last_became_peered":"2024-09-10T05:11:35.753342+0000","last_unstale":"2024-09-10T05:12:04.957971+0000","last_undegraded":"2024-09-10T05:12:04.957971+0000","last_fullsized":"2024-09-10T05:12:04.957971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:37.752504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955113+0000","last_change":"2024-09-10T05:11:37.769011+0000","last_active":"2024-09-10T05:12:04.955113+0000","last_peered":"2024-09-10T05:12:04.955113+0000","last_clean":"2024-09-10T05:12:04.955113+0000","last_became_active":"2024-09-10T05:11:37.767788+0000","last_became_peered":"2024-09-10T05:11:37.767788+0000","last_unstale":"2024-09-10T05:12:04.955113+0000","last_undegraded":"2024-09-10T05:12:04.955113+0000","last_fullsized":"2024-09-10T05:12:04.955113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:55.792983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'6","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417182+0000","last_change":"2024-09-10T05:11:29.727352+0000","last_active":"2024-09-10T05:14:36.417182+0000","last_peered":"2024-09-10T05:14:36.417182+0000","last_clean":"2024-09-10T05:14:36.417182+0000","last_became_active":"2024-09-10T05:11:29.727022+0000","last_became_peered":"2024-09-10T05:11:29.727022+0000","last_unstale":"2024-09-10T05:14:36.417182+0000","last_undegraded":"2024-09-10T05:14:36.417182+0000","last_fullsized":"2024-09-10T05:14:36.417182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:07.042493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955161+0000","last_change":"2024-09-10T05:11:18.533201+0000","last_active":"2024-09-10T05:12:04.955161+0000","last_peered":"2024-09-10T05:12:04.955161+0000","last_clean":"2024-09-10T05:12:04.955161+0000","last_became_active":"2024-09-10T05:11:16.530756+0000","last_became_peered":"2024-09-10T05:11:16.530756+0000","last_unstale":"2024-09-10T05:12:04.955161+0000","last_undegraded":"2024-09-10T05:12:04.955161+0000","last_fullsized":"2024-09-10T05:12:04.955161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:46.741517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047784,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960447+0000","last_change":"2024-09-10T05:11:27.722242+0000","last_active":"2024-09-10T05:12:04.960447+0000","last_peered":"2024-09-10T05:12:04.960447+0000","last_clean":"2024-09-10T05:12:04.960447+0000","last_became_active":"2024-09-10T05:11:27.718333+0000","last_became_peered":"2024-09-10T05:11:27.718333+0000","last_unstale":"2024-09-10T05:12:04.960447+0000","last_undegraded":"2024-09-10T05:12:04.960447+0000","last_fullsized":"2024-09-10T05:12:04.960447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:32.972378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:05.900504+0000","last_change":"2024-09-10T05:12:04.965299+0000","last_active":"2024-09-10T05:12:05.900504+0000","last_peered":"2024-09-10T05:12:05.900504+0000","last_clean":"2024-09-10T05:12:05.900504+0000","last_became_active":"2024-09-10T05:12:04.964996+0000","last_became_peered":"2024-09-10T05:12:04.964996+0000","last_unstale":"2024-09-10T05:12:05.900504+0000","last_undegraded":"2024-09-10T05:12:05.900504+0000","last_fullsized":"2024-09-10T05:12:05.900504+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:02.241258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"37'13","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.691724+0000","last_change":"2024-09-10T05:11:33.743920+0000","last_active":"2024-09-10T05:14:35.691724+0000","last_peered":"2024-09-10T05:14:35.691724+0000","last_clean":"2024-09-10T05:14:35.691724+0000","last_became_active":"2024-09-10T05:11:33.743292+0000","last_became_peered":"2024-09-10T05:11:33.743292+0000","last_unstale":"2024-09-10T05:14:35.691724+0000","last_undegraded":"2024-09-10T05:14:35.691724+0000","last_fullsized":"2024-09-10T05:14:35.691724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:18.442235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960791+0000","last_change":"2024-09-10T05:11:35.752348+0000","last_active":"2024-09-10T05:12:04.960791+0000","last_peered":"2024-09-10T05:12:04.960791+0000","last_clean":"2024-09-10T05:12:04.960791+0000","last_became_active":"2024-09-10T05:11:35.751982+0000","last_became_peered":"2024-09-10T05:11:35.751982+0000","last_unstale":"2024-09-10T05:12:04.960791+0000","last_undegraded":"2024-09-10T05:12:04.960791+0000","last_fullsized":"2024-09-10T05:12:04.960791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:53.013137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.434600+0000","last_change":"2024-09-10T05:11:37.762596+0000","last_active":"2024-09-10T05:13:35.434600+0000","last_peered":"2024-09-10T05:13:35.434600+0000","last_clean":"2024-09-10T05:13:35.434600+0000","last_became_active":"2024-09-10T05:11:37.762327+0000","last_became_peered":"2024-09-10T05:11:37.762327+0000","last_unstale":"2024-09-10T05:13:35.434600+0000","last_undegraded":"2024-09-10T05:13:35.434600+0000","last_fullsized":"2024-09-10T05:13:35.434600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:33.354245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'16","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339389+0000","last_change":"2024-09-10T05:11:29.731028+0000","last_active":"2024-09-10T05:14:36.339389+0000","last_peered":"2024-09-10T05:14:36.339389+0000","last_clean":"2024-09-10T05:14:36.339389+0000","last_became_active":"2024-09-10T05:11:29.730589+0000","last_became_peered":"2024-09-10T05:11:29.730589+0000","last_unstale":"2024-09-10T05:14:36.339389+0000","last_undegraded":"2024-09-10T05:14:36.339389+0000","last_fullsized":"2024-09-10T05:14:36.339389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:05.100041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959159+0000","last_change":"2024-09-10T05:11:27.718564+0000","last_active":"2024-09-10T05:12:04.959159+0000","last_peered":"2024-09-10T05:12:04.959159+0000","last_clean":"2024-09-10T05:12:04.959159+0000","last_became_active":"2024-09-10T05:11:27.716023+0000","last_became_peered":"2024-09-10T05:11:27.716023+0000","last_unstale":"2024-09-10T05:12:04.959159+0000","last_undegraded":"2024-09-10T05:12:04.959159+0000","last_fullsized":"2024-09-10T05:12:04.959159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:47:35.592580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957535+0000","last_change":"2024-09-10T05:11:18.534946+0000","last_active":"2024-09-10T05:12:04.957535+0000","last_peered":"2024-09-10T05:12:04.957535+0000","last_clean":"2024-09-10T05:12:04.957535+0000","last_became_active":"2024-09-10T05:11:16.532795+0000","last_became_peered":"2024-09-10T05:11:16.532795+0000","last_unstale":"2024-09-10T05:12:04.957535+0000","last_undegraded":"2024-09-10T05:12:04.957535+0000","last_fullsized":"2024-09-10T05:12:04.957535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:22.750871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060128199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.586967+0000","last_change":"2024-09-10T05:11:31.734963+0000","last_active":"2024-09-10T05:14:36.586967+0000","last_peered":"2024-09-10T05:14:36.586967+0000","last_clean":"2024-09-10T05:14:36.586967+0000","last_became_active":"2024-09-10T05:11:31.734707+0000","last_became_peered":"2024-09-10T05:11:31.734707+0000","last_unstale":"2024-09-10T05:14:36.586967+0000","last_undegraded":"2024-09-10T05:14:36.586967+0000","last_fullsized":"2024-09-10T05:14:36.586967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:00.334943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'79","reported_seq":159,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.120784+0000","last_change":"2024-09-10T05:11:33.743569+0000","last_active":"2024-09-10T05:14:43.120784+0000","last_peered":"2024-09-10T05:14:43.120784+0000","last_clean":"2024-09-10T05:14:43.120784+0000","last_became_active":"2024-09-10T05:11:33.743238+0000","last_became_peered":"2024-09-10T05:11:33.743238+0000","last_unstale":"2024-09-10T05:14:43.120784+0000","last_undegraded":"2024-09-10T05:14:43.120784+0000","last_fullsized":"2024-09-10T05:14:43.120784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:26.759194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957685+0000","last_change":"2024-09-10T05:11:35.751255+0000","last_active":"2024-09-10T05:12:04.957685+0000","last_peered":"2024-09-10T05:12:04.957685+0000","last_clean":"2024-09-10T05:12:04.957685+0000","last_became_active":"2024-09-10T05:11:35.750830+0000","last_became_peered":"2024-09-10T05:11:35.750830+0000","last_unstale":"2024-09-10T05:12:04.957685+0000","last_undegraded":"2024-09-10T05:12:04.957685+0000","last_fullsized":"2024-09-10T05:12:04.957685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:07.959084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.612283+0000","last_change":"2024-09-10T05:11:37.759212+0000","last_active":"2024-09-10T05:13:35.612283+0000","last_peered":"2024-09-10T05:13:35.612283+0000","last_clean":"2024-09-10T05:13:35.612283+0000","last_became_active":"2024-09-10T05:11:37.758971+0000","last_became_peered":"2024-09-10T05:11:37.758971+0000","last_unstale":"2024-09-10T05:13:35.612283+0000","last_undegraded":"2024-09-10T05:13:35.612283+0000","last_fullsized":"2024-09-10T05:13:35.612283+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:10.652277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'14","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116914+0000","last_change":"2024-09-10T05:11:29.730327+0000","last_active":"2024-09-10T05:14:36.116914+0000","last_peered":"2024-09-10T05:14:36.116914+0000","last_clean":"2024-09-10T05:14:36.116914+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:14:36.116914+0000","last_undegraded":"2024-09-10T05:14:36.116914+0000","last_fullsized":"2024-09-10T05:14:36.116914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:07.743055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958331+0000","last_change":"2024-09-10T05:11:27.719090+0000","last_active":"2024-09-10T05:12:04.958331+0000","last_peered":"2024-09-10T05:12:04.958331+0000","last_clean":"2024-09-10T05:12:04.958331+0000","last_became_active":"2024-09-10T05:11:27.718756+0000","last_became_peered":"2024-09-10T05:11:27.718756+0000","last_unstale":"2024-09-10T05:12:04.958331+0000","last_undegraded":"2024-09-10T05:12:04.958331+0000","last_fullsized":"2024-09-10T05:12:04.958331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:48.332632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957276+0000","last_change":"2024-09-10T05:11:18.532627+0000","last_active":"2024-09-10T05:12:04.957276+0000","last_peered":"2024-09-10T05:12:04.957276+0000","last_clean":"2024-09-10T05:12:04.957276+0000","last_became_active":"2024-09-10T05:11:16.530746+0000","last_became_peered":"2024-09-10T05:11:16.530746+0000","last_unstale":"2024-09-10T05:12:04.957276+0000","last_undegraded":"2024-09-10T05:12:04.957276+0000","last_fullsized":"2024-09-10T05:12:04.957276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:33.333497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048256999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955118+0000","last_change":"2024-09-10T05:11:31.734598+0000","last_active":"2024-09-10T05:12:04.955118+0000","last_peered":"2024-09-10T05:12:04.955118+0000","last_clean":"2024-09-10T05:12:04.955118+0000","last_became_active":"2024-09-10T05:11:31.734333+0000","last_became_peered":"2024-09-10T05:11:31.734333+0000","last_unstale":"2024-09-10T05:12:04.955118+0000","last_undegraded":"2024-09-10T05:12:04.955118+0000","last_fullsized":"2024-09-10T05:12:04.955118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:04.362140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958360+0000","last_change":"2024-09-10T05:11:33.744326+0000","last_active":"2024-09-10T05:12:04.958360+0000","last_peered":"2024-09-10T05:12:04.958360+0000","last_clean":"2024-09-10T05:12:04.958360+0000","last_became_active":"2024-09-10T05:11:33.744011+0000","last_became_peered":"2024-09-10T05:11:33.744011+0000","last_unstale":"2024-09-10T05:12:04.958360+0000","last_undegraded":"2024-09-10T05:12:04.958360+0000","last_fullsized":"2024-09-10T05:12:04.958360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:25:21.898677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'282","reported_seq":346,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813409+0000","last_change":"2024-09-10T05:11:35.743851+0000","last_active":"2024-09-10T05:14:31.813409+0000","last_peered":"2024-09-10T05:14:31.813409+0000","last_clean":"2024-09-10T05:14:31.813409+0000","last_became_active":"2024-09-10T05:11:35.743571+0000","last_became_peered":"2024-09-10T05:11:35.743571+0000","last_unstale":"2024-09-10T05:14:31.813409+0000","last_undegraded":"2024-09-10T05:14:31.813409+0000","last_fullsized":"2024-09-10T05:14:31.813409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.416572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.602302+0000","last_change":"2024-09-10T05:11:37.764931+0000","last_active":"2024-09-10T05:13:32.602302+0000","last_peered":"2024-09-10T05:13:32.602302+0000","last_clean":"2024-09-10T05:13:32.602302+0000","last_became_active":"2024-09-10T05:11:37.764657+0000","last_became_peered":"2024-09-10T05:11:37.764657+0000","last_unstale":"2024-09-10T05:13:32.602302+0000","last_undegraded":"2024-09-10T05:13:32.602302+0000","last_fullsized":"2024-09-10T05:13:32.602302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:33.836899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382938+0000","last_change":"2024-09-10T05:11:29.735974+0000","last_active":"2024-09-10T05:14:36.382938+0000","last_peered":"2024-09-10T05:14:36.382938+0000","last_clean":"2024-09-10T05:14:36.382938+0000","last_became_active":"2024-09-10T05:11:29.734731+0000","last_became_peered":"2024-09-10T05:11:29.734731+0000","last_unstale":"2024-09-10T05:14:36.382938+0000","last_undegraded":"2024-09-10T05:14:36.382938+0000","last_fullsized":"2024-09-10T05:14:36.382938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:47.453260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961339+0000","last_change":"2024-09-10T05:11:27.723646+0000","last_active":"2024-09-10T05:12:04.961339+0000","last_peered":"2024-09-10T05:12:04.961339+0000","last_clean":"2024-09-10T05:12:04.961339+0000","last_became_active":"2024-09-10T05:11:27.723268+0000","last_became_peered":"2024-09-10T05:11:27.723268+0000","last_unstale":"2024-09-10T05:12:04.961339+0000","last_undegraded":"2024-09-10T05:12:04.961339+0000","last_fullsized":"2024-09-10T05:12:04.961339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:31.006213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958152+0000","last_change":"2024-09-10T05:11:18.534977+0000","last_active":"2024-09-10T05:12:04.958152+0000","last_peered":"2024-09-10T05:12:04.958152+0000","last_clean":"2024-09-10T05:12:04.958152+0000","last_became_active":"2024-09-10T05:11:16.531550+0000","last_became_peered":"2024-09-10T05:11:16.531550+0000","last_unstale":"2024-09-10T05:12:04.958152+0000","last_undegraded":"2024-09-10T05:12:04.958152+0000","last_fullsized":"2024-09-10T05:12:04.958152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:22.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063503699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955664+0000","last_change":"2024-09-10T05:11:31.734677+0000","last_active":"2024-09-10T05:12:04.955664+0000","last_peered":"2024-09-10T05:12:04.955664+0000","last_clean":"2024-09-10T05:12:04.955664+0000","last_became_active":"2024-09-10T05:11:31.734310+0000","last_became_peered":"2024-09-10T05:11:31.734310+0000","last_unstale":"2024-09-10T05:12:04.955664+0000","last_undegraded":"2024-09-10T05:12:04.955664+0000","last_fullsized":"2024-09-10T05:12:04.955664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:04.152181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'17","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.669838+0000","last_change":"2024-09-10T05:11:33.748918+0000","last_active":"2024-09-10T05:12:09.669838+0000","last_peered":"2024-09-10T05:12:09.669838+0000","last_clean":"2024-09-10T05:12:09.669838+0000","last_became_active":"2024-09-10T05:11:33.748603+0000","last_became_peered":"2024-09-10T05:11:33.748603+0000","last_unstale":"2024-09-10T05:12:09.669838+0000","last_undegraded":"2024-09-10T05:12:09.669838+0000","last_fullsized":"2024-09-10T05:12:09.669838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:30.495078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":392,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.009007+0000","last_change":"2024-09-10T05:11:35.746066+0000","last_active":"2024-09-10T05:14:43.009007+0000","last_peered":"2024-09-10T05:14:43.009007+0000","last_clean":"2024-09-10T05:14:43.009007+0000","last_became_active":"2024-09-10T05:11:35.745807+0000","last_became_peered":"2024-09-10T05:11:35.745807+0000","last_unstale":"2024-09-10T05:14:43.009007+0000","last_undegraded":"2024-09-10T05:14:43.009007+0000","last_fullsized":"2024-09-10T05:14:43.009007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:15.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960007+0000","last_change":"2024-09-10T05:11:37.762669+0000","last_active":"2024-09-10T05:12:04.960007+0000","last_peered":"2024-09-10T05:12:04.960007+0000","last_clean":"2024-09-10T05:12:04.960007+0000","last_became_active":"2024-09-10T05:11:37.762407+0000","last_became_peered":"2024-09-10T05:11:37.762407+0000","last_unstale":"2024-09-10T05:12:04.960007+0000","last_undegraded":"2024-09-10T05:12:04.960007+0000","last_fullsized":"2024-09-10T05:12:04.960007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:01.260628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.199374+0000","last_change":"2024-09-10T05:11:29.730717+0000","last_active":"2024-09-10T05:14:36.199374+0000","last_peered":"2024-09-10T05:14:36.199374+0000","last_clean":"2024-09-10T05:14:36.199374+0000","last_became_active":"2024-09-10T05:11:29.730285+0000","last_became_peered":"2024-09-10T05:11:29.730285+0000","last_unstale":"2024-09-10T05:14:36.199374+0000","last_undegraded":"2024-09-10T05:14:36.199374+0000","last_fullsized":"2024-09-10T05:14:36.199374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:27.593815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914614+0000","last_change":"2024-09-10T05:11:27.731410+0000","last_active":"2024-09-10T05:13:40.914614+0000","last_peered":"2024-09-10T05:13:40.914614+0000","last_clean":"2024-09-10T05:13:40.914614+0000","last_became_active":"2024-09-10T05:11:27.731108+0000","last_became_peered":"2024-09-10T05:11:27.731108+0000","last_unstale":"2024-09-10T05:13:40.914614+0000","last_undegraded":"2024-09-10T05:13:40.914614+0000","last_fullsized":"2024-09-10T05:13:40.914614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:36.345654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960717+0000","last_change":"2024-09-10T05:11:18.533507+0000","last_active":"2024-09-10T05:12:04.960717+0000","last_peered":"2024-09-10T05:12:04.960717+0000","last_clean":"2024-09-10T05:12:04.960717+0000","last_became_active":"2024-09-10T05:11:16.531468+0000","last_became_peered":"2024-09-10T05:11:16.531468+0000","last_unstale":"2024-09-10T05:12:04.960717+0000","last_undegraded":"2024-09-10T05:12:04.960717+0000","last_fullsized":"2024-09-10T05:12:04.960717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:30:18.685084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001329722,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:31.733033+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:31.732753+0000","last_became_peered":"2024-09-10T05:11:31.732753+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:51.417779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'88","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.264512+0000","last_change":"2024-09-10T05:11:33.744480+0000","last_active":"2024-09-10T05:13:34.264512+0000","last_peered":"2024-09-10T05:13:34.264512+0000","last_clean":"2024-09-10T05:13:34.264512+0000","last_became_active":"2024-09-10T05:11:33.744217+0000","last_became_peered":"2024-09-10T05:11:33.744217+0000","last_unstale":"2024-09-10T05:13:34.264512+0000","last_undegraded":"2024-09-10T05:13:34.264512+0000","last_fullsized":"2024-09-10T05:13:34.264512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:27.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957339+0000","last_change":"2024-09-10T05:11:35.748212+0000","last_active":"2024-09-10T05:12:04.957339+0000","last_peered":"2024-09-10T05:12:04.957339+0000","last_clean":"2024-09-10T05:12:04.957339+0000","last_became_active":"2024-09-10T05:11:35.747924+0000","last_became_peered":"2024-09-10T05:11:35.747924+0000","last_unstale":"2024-09-10T05:12:04.957339+0000","last_undegraded":"2024-09-10T05:12:04.957339+0000","last_fullsized":"2024-09-10T05:12:04.957339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:15.162433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961201+0000","last_change":"2024-09-10T05:11:37.758521+0000","last_active":"2024-09-10T05:12:04.961201+0000","last_peered":"2024-09-10T05:12:04.961201+0000","last_clean":"2024-09-10T05:12:04.961201+0000","last_became_active":"2024-09-10T05:11:37.757947+0000","last_became_peered":"2024-09-10T05:11:37.757947+0000","last_unstale":"2024-09-10T05:12:04.961201+0000","last_undegraded":"2024-09-10T05:12:04.961201+0000","last_fullsized":"2024-09-10T05:12:04.961201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:42.540458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:52.143036+0000","last_change":"2024-09-10T05:11:37.759509+0000","last_active":"2024-09-10T05:12:52.143036+0000","last_peered":"2024-09-10T05:12:52.143036+0000","last_clean":"2024-09-10T05:12:52.143036+0000","last_became_active":"2024-09-10T05:11:37.759217+0000","last_became_peered":"2024-09-10T05:11:37.759217+0000","last_unstale":"2024-09-10T05:12:52.143036+0000","last_undegraded":"2024-09-10T05:12:52.143036+0000","last_fullsized":"2024-09-10T05:12:52.143036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:30.264676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'12","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116908+0000","last_change":"2024-09-10T05:11:29.730421+0000","last_active":"2024-09-10T05:14:36.116908+0000","last_peered":"2024-09-10T05:14:36.116908+0000","last_clean":"2024-09-10T05:14:36.116908+0000","last_became_active":"2024-09-10T05:11:29.730105+0000","last_became_peered":"2024-09-10T05:11:29.730105+0000","last_unstale":"2024-09-10T05:14:36.116908+0000","last_undegraded":"2024-09-10T05:14:36.116908+0000","last_fullsized":"2024-09-10T05:14:36.116908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:52.776885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:50.916828+0000","last_change":"2024-09-10T05:11:27.732124+0000","last_active":"2024-09-10T05:13:50.916828+0000","last_peered":"2024-09-10T05:13:50.916828+0000","last_clean":"2024-09-10T05:13:50.916828+0000","last_became_active":"2024-09-10T05:11:27.731634+0000","last_became_peered":"2024-09-10T05:11:27.731634+0000","last_unstale":"2024-09-10T05:13:50.916828+0000","last_undegraded":"2024-09-10T05:13:50.916828+0000","last_fullsized":"2024-09-10T05:13:50.916828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:55.962255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.970384+0000","last_change":"2024-09-10T05:12:04.967896+0000","last_active":"2024-09-10T05:12:04.970384+0000","last_peered":"2024-09-10T05:12:04.970384+0000","last_clean":"2024-09-10T05:12:04.970384+0000","last_became_active":"2024-09-10T05:12:04.967513+0000","last_became_peered":"2024-09-10T05:12:04.967513+0000","last_unstale":"2024-09-10T05:12:04.970384+0000","last_undegraded":"2024-09-10T05:12:04.970384+0000","last_fullsized":"2024-09-10T05:12:04.970384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:00.790327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.680527+0000","last_change":"2024-09-10T05:11:33.745631+0000","last_active":"2024-09-10T05:13:35.680527+0000","last_peered":"2024-09-10T05:13:35.680527+0000","last_clean":"2024-09-10T05:13:35.680527+0000","last_became_active":"2024-09-10T05:11:33.745347+0000","last_became_peered":"2024-09-10T05:11:33.745347+0000","last_unstale":"2024-09-10T05:13:35.680527+0000","last_undegraded":"2024-09-10T05:13:35.680527+0000","last_fullsized":"2024-09-10T05:13:35.680527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:36.538308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954872+0000","last_change":"2024-09-10T05:11:35.754614+0000","last_active":"2024-09-10T05:12:04.954872+0000","last_peered":"2024-09-10T05:12:04.954872+0000","last_clean":"2024-09-10T05:12:04.954872+0000","last_became_active":"2024-09-10T05:11:35.754318+0000","last_became_peered":"2024-09-10T05:11:35.754318+0000","last_unstale":"2024-09-10T05:12:04.954872+0000","last_undegraded":"2024-09-10T05:12:04.954872+0000","last_fullsized":"2024-09-10T05:12:04.954872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:32.929275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:33.971128+0000","last_change":"2024-09-10T05:11:37.760662+0000","last_active":"2024-09-10T05:13:33.971128+0000","last_peered":"2024-09-10T05:13:33.971128+0000","last_clean":"2024-09-10T05:13:33.971128+0000","last_became_active":"2024-09-10T05:11:37.760471+0000","last_became_peered":"2024-09-10T05:11:37.760471+0000","last_unstale":"2024-09-10T05:13:33.971128+0000","last_undegraded":"2024-09-10T05:13:33.971128+0000","last_fullsized":"2024-09-10T05:13:33.971128+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:16.361621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.346649+0000","last_change":"2024-09-10T05:11:29.727844+0000","last_active":"2024-09-10T05:14:36.346649+0000","last_peered":"2024-09-10T05:14:36.346649+0000","last_clean":"2024-09-10T05:14:36.346649+0000","last_became_active":"2024-09-10T05:11:29.727550+0000","last_became_peered":"2024-09-10T05:11:29.727550+0000","last_unstale":"2024-09-10T05:14:36.346649+0000","last_undegraded":"2024-09-10T05:14:36.346649+0000","last_fullsized":"2024-09-10T05:14:36.346649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:05.037792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563704+0000","last_change":"2024-09-10T05:11:27.724954+0000","last_active":"2024-09-10T05:12:08.563704+0000","last_peered":"2024-09-10T05:12:08.563704+0000","last_clean":"2024-09-10T05:12:08.563704+0000","last_became_active":"2024-09-10T05:11:27.724637+0000","last_became_peered":"2024-09-10T05:11:27.724637+0000","last_unstale":"2024-09-10T05:12:08.563704+0000","last_undegraded":"2024-09-10T05:12:08.563704+0000","last_fullsized":"2024-09-10T05:12:08.563704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:06.669117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956587+0000","last_change":"2024-09-10T05:11:31.737152+0000","last_active":"2024-09-10T05:12:04.956587+0000","last_peered":"2024-09-10T05:12:04.956587+0000","last_clean":"2024-09-10T05:12:04.956587+0000","last_became_active":"2024-09-10T05:11:31.736758+0000","last_became_peered":"2024-09-10T05:11:31.736758+0000","last_unstale":"2024-09-10T05:12:04.956587+0000","last_undegraded":"2024-09-10T05:12:04.956587+0000","last_fullsized":"2024-09-10T05:12:04.956587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:07.236386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'6","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.711356+0000","last_change":"2024-09-10T05:11:33.742432+0000","last_active":"2024-09-10T05:14:35.711356+0000","last_peered":"2024-09-10T05:14:35.711356+0000","last_clean":"2024-09-10T05:14:35.711356+0000","last_became_active":"2024-09-10T05:11:33.742039+0000","last_became_peered":"2024-09-10T05:11:33.742039+0000","last_unstale":"2024-09-10T05:14:35.711356+0000","last_undegraded":"2024-09-10T05:14:35.711356+0000","last_fullsized":"2024-09-10T05:14:35.711356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:31.077478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956813+0000","last_change":"2024-09-10T05:11:35.751536+0000","last_active":"2024-09-10T05:12:04.956813+0000","last_peered":"2024-09-10T05:12:04.956813+0000","last_clean":"2024-09-10T05:12:04.956813+0000","last_became_active":"2024-09-10T05:11:35.751244+0000","last_became_peered":"2024-09-10T05:11:35.751244+0000","last_unstale":"2024-09-10T05:12:04.956813+0000","last_undegraded":"2024-09-10T05:12:04.956813+0000","last_fullsized":"2024-09-10T05:12:04.956813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.673711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.676093+0000","last_change":"2024-09-10T05:11:37.755735+0000","last_active":"2024-09-10T05:13:35.676093+0000","last_peered":"2024-09-10T05:13:35.676093+0000","last_clean":"2024-09-10T05:13:35.676093+0000","last_became_active":"2024-09-10T05:11:37.755533+0000","last_became_peered":"2024-09-10T05:11:37.755533+0000","last_unstale":"2024-09-10T05:13:35.676093+0000","last_undegraded":"2024-09-10T05:13:35.676093+0000","last_fullsized":"2024-09-10T05:13:35.676093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:37.895455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604904+0000","last_change":"2024-09-10T05:11:29.727735+0000","last_active":"2024-09-10T05:13:32.604904+0000","last_peered":"2024-09-10T05:13:32.604904+0000","last_clean":"2024-09-10T05:13:32.604904+0000","last_became_active":"2024-09-10T05:11:29.727400+0000","last_became_peered":"2024-09-10T05:11:29.727400+0000","last_unstale":"2024-09-10T05:13:32.604904+0000","last_undegraded":"2024-09-10T05:13:32.604904+0000","last_fullsized":"2024-09-10T05:13:32.604904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:52.691912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.328244+0000","last_change":"2024-09-10T05:11:27.728450+0000","last_active":"2024-09-10T05:14:36.328244+0000","last_peered":"2024-09-10T05:14:36.328244+0000","last_clean":"2024-09-10T05:14:36.328244+0000","last_became_active":"2024-09-10T05:11:27.727561+0000","last_became_peered":"2024-09-10T05:11:27.727561+0000","last_unstale":"2024-09-10T05:14:36.328244+0000","last_undegraded":"2024-09-10T05:14:36.328244+0000","last_fullsized":"2024-09-10T05:14:36.328244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:09.173780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"28'1","reported_seq":219,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.322927+0000","last_change":"2024-09-10T05:11:31.734288+0000","last_active":"2024-09-10T05:13:35.322927+0000","last_peered":"2024-09-10T05:13:35.322927+0000","last_clean":"2024-09-10T05:13:35.322927+0000","last_became_active":"2024-09-10T05:11:31.733793+0000","last_became_peered":"2024-09-10T05:11:31.733793+0000","last_unstale":"2024-09-10T05:13:35.322927+0000","last_undegraded":"2024-09-10T05:13:35.322927+0000","last_fullsized":"2024-09-10T05:13:35.322927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:15.305550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'45","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.063098+0000","last_change":"2024-09-10T05:11:33.744948+0000","last_active":"2024-09-10T05:14:43.063098+0000","last_peered":"2024-09-10T05:14:43.063098+0000","last_clean":"2024-09-10T05:14:43.063098+0000","last_became_active":"2024-09-10T05:11:33.744634+0000","last_became_peered":"2024-09-10T05:11:33.744634+0000","last_unstale":"2024-09-10T05:14:43.063098+0000","last_undegraded":"2024-09-10T05:14:43.063098+0000","last_fullsized":"2024-09-10T05:14:43.063098+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:09.908383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959076+0000","last_change":"2024-09-10T05:11:35.748666+0000","last_active":"2024-09-10T05:12:04.959076+0000","last_peered":"2024-09-10T05:12:04.959076+0000","last_clean":"2024-09-10T05:12:04.959076+0000","last_became_active":"2024-09-10T05:11:35.748406+0000","last_became_peered":"2024-09-10T05:11:35.748406+0000","last_unstale":"2024-09-10T05:12:04.959076+0000","last_undegraded":"2024-09-10T05:12:04.959076+0000","last_fullsized":"2024-09-10T05:12:04.959076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:01.833099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.370496+0000","last_change":"2024-09-10T05:11:37.765627+0000","last_active":"2024-09-10T05:14:36.370496+0000","last_peered":"2024-09-10T05:14:36.370496+0000","last_clean":"2024-09-10T05:14:36.370496+0000","last_became_active":"2024-09-10T05:11:37.765188+0000","last_became_peered":"2024-09-10T05:11:37.765188+0000","last_unstale":"2024-09-10T05:14:36.370496+0000","last_undegraded":"2024-09-10T05:14:36.370496+0000","last_fullsized":"2024-09-10T05:14:36.370496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:35.729959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954466+0000","last_change":"2024-09-10T05:11:29.736060+0000","last_active":"2024-09-10T05:12:04.954466+0000","last_peered":"2024-09-10T05:12:04.954466+0000","last_clean":"2024-09-10T05:12:04.954466+0000","last_became_active":"2024-09-10T05:11:29.735101+0000","last_became_peered":"2024-09-10T05:11:29.735101+0000","last_unstale":"2024-09-10T05:12:04.954466+0000","last_undegraded":"2024-09-10T05:12:04.954466+0000","last_fullsized":"2024-09-10T05:12:04.954466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:46.282001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962997+0000","last_change":"2024-09-10T05:11:27.716910+0000","last_active":"2024-09-10T05:12:04.962997+0000","last_peered":"2024-09-10T05:12:04.962997+0000","last_clean":"2024-09-10T05:12:04.962997+0000","last_became_active":"2024-09-10T05:11:27.715729+0000","last_became_peered":"2024-09-10T05:11:27.715729+0000","last_unstale":"2024-09-10T05:12:04.962997+0000","last_undegraded":"2024-09-10T05:12:04.962997+0000","last_fullsized":"2024-09-10T05:12:04.962997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:34.486986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954515+0000","last_change":"2024-09-10T05:11:31.732767+0000","last_active":"2024-09-10T05:12:04.954515+0000","last_peered":"2024-09-10T05:12:04.954515+0000","last_clean":"2024-09-10T05:12:04.954515+0000","last_became_active":"2024-09-10T05:11:31.732476+0000","last_became_peered":"2024-09-10T05:11:31.732476+0000","last_unstale":"2024-09-10T05:12:04.954515+0000","last_undegraded":"2024-09-10T05:12:04.954515+0000","last_fullsized":"2024-09-10T05:12:04.954515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:22.178149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'31","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.255150+0000","last_change":"2024-09-10T05:11:33.742425+0000","last_active":"2024-09-10T05:13:34.255150+0000","last_peered":"2024-09-10T05:13:34.255150+0000","last_clean":"2024-09-10T05:13:34.255150+0000","last_became_active":"2024-09-10T05:11:33.740483+0000","last_became_peered":"2024-09-10T05:11:33.740483+0000","last_unstale":"2024-09-10T05:13:34.255150+0000","last_undegraded":"2024-09-10T05:13:34.255150+0000","last_fullsized":"2024-09-10T05:13:34.255150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:21.633618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960060+0000","last_change":"2024-09-10T05:11:35.746206+0000","last_active":"2024-09-10T05:12:04.960060+0000","last_peered":"2024-09-10T05:12:04.960060+0000","last_clean":"2024-09-10T05:12:04.960060+0000","last_became_active":"2024-09-10T05:11:35.745886+0000","last_became_peered":"2024-09-10T05:11:35.745886+0000","last_unstale":"2024-09-10T05:12:04.960060+0000","last_undegraded":"2024-09-10T05:12:04.960060+0000","last_fullsized":"2024-09-10T05:12:04.960060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:38.963303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.109858+0000","last_change":"2024-09-10T05:11:29.732079+0000","last_active":"2024-09-10T05:14:36.109858+0000","last_peered":"2024-09-10T05:14:36.109858+0000","last_clean":"2024-09-10T05:14:36.109858+0000","last_became_active":"2024-09-10T05:11:29.731824+0000","last_became_peered":"2024-09-10T05:11:29.731824+0000","last_unstale":"2024-09-10T05:14:36.109858+0000","last_undegraded":"2024-09-10T05:14:36.109858+0000","last_fullsized":"2024-09-10T05:14:36.109858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:53.060402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954430+0000","last_change":"2024-09-10T05:11:27.735230+0000","last_active":"2024-09-10T05:12:04.954430+0000","last_peered":"2024-09-10T05:12:04.954430+0000","last_clean":"2024-09-10T05:12:04.954430+0000","last_became_active":"2024-09-10T05:11:27.734652+0000","last_became_peered":"2024-09-10T05:11:27.734652+0000","last_unstale":"2024-09-10T05:12:04.954430+0000","last_undegraded":"2024-09-10T05:12:04.954430+0000","last_fullsized":"2024-09-10T05:12:04.954430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:41.386631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959243+0000","last_change":"2024-09-10T05:11:31.735122+0000","last_active":"2024-09-10T05:12:04.959243+0000","last_peered":"2024-09-10T05:12:04.959243+0000","last_clean":"2024-09-10T05:12:04.959243+0000","last_became_active":"2024-09-10T05:11:31.734774+0000","last_became_peered":"2024-09-10T05:11:31.734774+0000","last_unstale":"2024-09-10T05:12:04.959243+0000","last_undegraded":"2024-09-10T05:12:04.959243+0000","last_fullsized":"2024-09-10T05:12:04.959243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:38.074776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'66","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.157107+0000","last_change":"2024-09-10T05:11:33.741409+0000","last_active":"2024-09-10T05:14:43.157107+0000","last_peered":"2024-09-10T05:14:43.157107+0000","last_clean":"2024-09-10T05:14:43.157107+0000","last_became_active":"2024-09-10T05:11:33.741136+0000","last_became_peered":"2024-09-10T05:11:33.741136+0000","last_unstale":"2024-09-10T05:14:43.157107+0000","last_undegraded":"2024-09-10T05:14:43.157107+0000","last_fullsized":"2024-09-10T05:14:43.157107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:48.815209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958544+0000","last_change":"2024-09-10T05:11:35.746094+0000","last_active":"2024-09-10T05:12:04.958544+0000","last_peered":"2024-09-10T05:12:04.958544+0000","last_clean":"2024-09-10T05:12:04.958544+0000","last_became_active":"2024-09-10T05:11:35.745795+0000","last_became_peered":"2024-09-10T05:11:35.745795+0000","last_unstale":"2024-09-10T05:12:04.958544+0000","last_undegraded":"2024-09-10T05:12:04.958544+0000","last_fullsized":"2024-09-10T05:12:04.958544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:43.698313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.609239+0000","last_change":"2024-09-10T05:11:37.758689+0000","last_active":"2024-09-10T05:13:35.609239+0000","last_peered":"2024-09-10T05:13:35.609239+0000","last_clean":"2024-09-10T05:13:35.609239+0000","last_became_active":"2024-09-10T05:11:37.758360+0000","last_became_peered":"2024-09-10T05:11:37.758360+0000","last_unstale":"2024-09-10T05:13:35.609239+0000","last_undegraded":"2024-09-10T05:13:35.609239+0000","last_fullsized":"2024-09-10T05:13:35.609239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:10.895588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'9","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.423853+0000","last_change":"2024-09-10T05:11:29.725587+0000","last_active":"2024-09-10T05:14:36.423853+0000","last_peered":"2024-09-10T05:14:36.423853+0000","last_clean":"2024-09-10T05:14:36.423853+0000","last_became_active":"2024-09-10T05:11:29.723722+0000","last_became_peered":"2024-09-10T05:11:29.723722+0000","last_unstale":"2024-09-10T05:14:36.423853+0000","last_undegraded":"2024-09-10T05:14:36.423853+0000","last_fullsized":"2024-09-10T05:14:36.423853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:27.494677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957932+0000","last_change":"2024-09-10T05:11:27.728290+0000","last_active":"2024-09-10T05:12:04.957932+0000","last_peered":"2024-09-10T05:12:04.957932+0000","last_clean":"2024-09-10T05:12:04.957932+0000","last_became_active":"2024-09-10T05:11:27.727770+0000","last_became_peered":"2024-09-10T05:11:27.727770+0000","last_unstale":"2024-09-10T05:12:04.957932+0000","last_undegraded":"2024-09-10T05:12:04.957932+0000","last_fullsized":"2024-09-10T05:12:04.957932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:49.547692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962377+0000","last_change":"2024-09-10T05:11:31.728930+0000","last_active":"2024-09-10T05:12:04.962377+0000","last_peered":"2024-09-10T05:12:04.962377+0000","last_clean":"2024-09-10T05:12:04.962377+0000","last_became_active":"2024-09-10T05:11:31.728653+0000","last_became_peered":"2024-09-10T05:11:31.728653+0000","last_unstale":"2024-09-10T05:12:04.962377+0000","last_undegraded":"2024-09-10T05:12:04.962377+0000","last_fullsized":"2024-09-10T05:12:04.962377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:11:50.575895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.256106+0000","last_change":"2024-09-10T05:11:33.743527+0000","last_active":"2024-09-10T05:13:34.256106+0000","last_peered":"2024-09-10T05:13:34.256106+0000","last_clean":"2024-09-10T05:13:34.256106+0000","last_became_active":"2024-09-10T05:11:33.743048+0000","last_became_peered":"2024-09-10T05:11:33.743048+0000","last_unstale":"2024-09-10T05:13:34.256106+0000","last_undegraded":"2024-09-10T05:13:34.256106+0000","last_fullsized":"2024-09-10T05:13:34.256106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:52:59.505330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960230+0000","last_change":"2024-09-10T05:11:35.753237+0000","last_active":"2024-09-10T05:12:04.960230+0000","last_peered":"2024-09-10T05:12:04.960230+0000","last_clean":"2024-09-10T05:12:04.960230+0000","last_became_active":"2024-09-10T05:11:35.752971+0000","last_became_peered":"2024-09-10T05:11:35.752971+0000","last_unstale":"2024-09-10T05:12:04.960230+0000","last_undegraded":"2024-09-10T05:12:04.960230+0000","last_fullsized":"2024-09-10T05:12:04.960230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:16.416535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954464+0000","last_change":"2024-09-10T05:11:37.768354+0000","last_active":"2024-09-10T05:12:04.954464+0000","last_peered":"2024-09-10T05:12:04.954464+0000","last_clean":"2024-09-10T05:12:04.954464+0000","last_became_active":"2024-09-10T05:11:37.768036+0000","last_became_peered":"2024-09-10T05:11:37.768036+0000","last_unstale":"2024-09-10T05:12:04.954464+0000","last_undegraded":"2024-09-10T05:12:04.954464+0000","last_fullsized":"2024-09-10T05:12:04.954464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:28.716788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'3","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.210570+0000","last_change":"2024-09-10T05:11:29.735292+0000","last_active":"2024-09-10T05:14:36.210570+0000","last_peered":"2024-09-10T05:14:36.210570+0000","last_clean":"2024-09-10T05:14:36.210570+0000","last_became_active":"2024-09-10T05:11:29.734714+0000","last_became_peered":"2024-09-10T05:11:29.734714+0000","last_unstale":"2024-09-10T05:14:36.210570+0000","last_undegraded":"2024-09-10T05:14:36.210570+0000","last_fullsized":"2024-09-10T05:14:36.210570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:28.419157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.564082+0000","last_change":"2024-09-10T05:11:27.718573+0000","last_active":"2024-09-10T05:12:08.564082+0000","last_peered":"2024-09-10T05:12:08.564082+0000","last_clean":"2024-09-10T05:12:08.564082+0000","last_became_active":"2024-09-10T05:11:27.718251+0000","last_became_peered":"2024-09-10T05:11:27.718251+0000","last_unstale":"2024-09-10T05:12:08.564082+0000","last_undegraded":"2024-09-10T05:12:08.564082+0000","last_fullsized":"2024-09-10T05:12:08.564082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:05.213355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958875+0000","last_change":"2024-09-10T05:11:31.728291+0000","last_active":"2024-09-10T05:12:04.958875+0000","last_peered":"2024-09-10T05:12:04.958875+0000","last_clean":"2024-09-10T05:12:04.958875+0000","last_became_active":"2024-09-10T05:11:31.727998+0000","last_became_peered":"2024-09-10T05:11:31.727998+0000","last_unstale":"2024-09-10T05:12:04.958875+0000","last_undegraded":"2024-09-10T05:12:04.958875+0000","last_fullsized":"2024-09-10T05:12:04.958875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:33.243917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'41","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.107513+0000","last_change":"2024-09-10T05:11:33.742831+0000","last_active":"2024-09-10T05:14:43.107513+0000","last_peered":"2024-09-10T05:14:43.107513+0000","last_clean":"2024-09-10T05:14:43.107513+0000","last_became_active":"2024-09-10T05:11:33.742594+0000","last_became_peered":"2024-09-10T05:11:33.742594+0000","last_unstale":"2024-09-10T05:14:43.107513+0000","last_undegraded":"2024-09-10T05:14:43.107513+0000","last_fullsized":"2024-09-10T05:14:43.107513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:54.003296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957834+0000","last_change":"2024-09-10T05:11:35.748750+0000","last_active":"2024-09-10T05:12:04.957834+0000","last_peered":"2024-09-10T05:12:04.957834+0000","last_clean":"2024-09-10T05:12:04.957834+0000","last_became_active":"2024-09-10T05:11:35.748464+0000","last_became_peered":"2024-09-10T05:11:35.748464+0000","last_unstale":"2024-09-10T05:12:04.957834+0000","last_undegraded":"2024-09-10T05:12:04.957834+0000","last_fullsized":"2024-09-10T05:12:04.957834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:02:44.003459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.674549+0000","last_change":"2024-09-10T05:11:37.768552+0000","last_active":"2024-09-10T05:13:35.674549+0000","last_peered":"2024-09-10T05:13:35.674549+0000","last_clean":"2024-09-10T05:13:35.674549+0000","last_became_active":"2024-09-10T05:11:37.768248+0000","last_became_peered":"2024-09-10T05:11:37.768248+0000","last_unstale":"2024-09-10T05:13:35.674549+0000","last_undegraded":"2024-09-10T05:13:35.674549+0000","last_fullsized":"2024-09-10T05:13:35.674549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:47.039216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.109389+0000","last_change":"2024-09-10T05:11:29.727709+0000","last_active":"2024-09-10T05:14:36.109389+0000","last_peered":"2024-09-10T05:14:36.109389+0000","last_clean":"2024-09-10T05:14:36.109389+0000","last_became_active":"2024-09-10T05:11:29.727038+0000","last_became_peered":"2024-09-10T05:11:29.727038+0000","last_unstale":"2024-09-10T05:14:36.109389+0000","last_undegraded":"2024-09-10T05:14:36.109389+0000","last_fullsized":"2024-09-10T05:14:36.109389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.472157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:52.134013+0000","last_change":"2024-09-10T05:11:27.734905+0000","last_active":"2024-09-10T05:12:52.134013+0000","last_peered":"2024-09-10T05:12:52.134013+0000","last_clean":"2024-09-10T05:12:52.134013+0000","last_became_active":"2024-09-10T05:11:27.733320+0000","last_became_peered":"2024-09-10T05:11:27.733320+0000","last_unstale":"2024-09-10T05:12:52.134013+0000","last_undegraded":"2024-09-10T05:12:52.134013+0000","last_fullsized":"2024-09-10T05:12:52.134013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:27.826216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961436+0000","last_change":"2024-09-10T05:11:31.734989+0000","last_active":"2024-09-10T05:12:04.961436+0000","last_peered":"2024-09-10T05:12:04.961436+0000","last_clean":"2024-09-10T05:12:04.961436+0000","last_became_active":"2024-09-10T05:11:31.734684+0000","last_became_peered":"2024-09-10T05:11:31.734684+0000","last_unstale":"2024-09-10T05:12:04.961436+0000","last_undegraded":"2024-09-10T05:12:04.961436+0000","last_fullsized":"2024-09-10T05:12:04.961436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:16.215982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962397+0000","last_change":"2024-09-10T05:11:33.748823+0000","last_active":"2024-09-10T05:12:04.962397+0000","last_peered":"2024-09-10T05:12:04.962397+0000","last_clean":"2024-09-10T05:12:04.962397+0000","last_became_active":"2024-09-10T05:11:33.748547+0000","last_became_peered":"2024-09-10T05:11:33.748547+0000","last_unstale":"2024-09-10T05:12:04.962397+0000","last_undegraded":"2024-09-10T05:12:04.962397+0000","last_fullsized":"2024-09-10T05:12:04.962397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:00.711618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'282","reported_seq":366,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813472+0000","last_change":"2024-09-10T05:11:35.751082+0000","last_active":"2024-09-10T05:14:31.813472+0000","last_peered":"2024-09-10T05:14:31.813472+0000","last_clean":"2024-09-10T05:14:31.813472+0000","last_became_active":"2024-09-10T05:11:35.750761+0000","last_became_peered":"2024-09-10T05:11:35.750761+0000","last_unstale":"2024-09-10T05:14:31.813472+0000","last_undegraded":"2024-09-10T05:14:31.813472+0000","last_fullsized":"2024-09-10T05:14:31.813472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:35.877712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954021+0000","last_change":"2024-09-10T05:11:37.768088+0000","last_active":"2024-09-10T05:12:04.954021+0000","last_peered":"2024-09-10T05:12:04.954021+0000","last_clean":"2024-09-10T05:12:04.954021+0000","last_became_active":"2024-09-10T05:11:37.767816+0000","last_became_peered":"2024-09-10T05:11:37.767816+0000","last_unstale":"2024-09-10T05:12:04.954021+0000","last_undegraded":"2024-09-10T05:12:04.954021+0000","last_fullsized":"2024-09-10T05:12:04.954021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:32.684488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'5","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:00.917755+0000","last_change":"2024-09-10T05:11:29.720521+0000","last_active":"2024-09-10T05:14:00.917755+0000","last_peered":"2024-09-10T05:14:00.917755+0000","last_clean":"2024-09-10T05:14:00.917755+0000","last_became_active":"2024-09-10T05:11:29.720243+0000","last_became_peered":"2024-09-10T05:11:29.720243+0000","last_unstale":"2024-09-10T05:14:00.917755+0000","last_undegraded":"2024-09-10T05:14:00.917755+0000","last_fullsized":"2024-09-10T05:14:00.917755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:46.844060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960785+0000","last_change":"2024-09-10T05:11:27.723954+0000","last_active":"2024-09-10T05:12:04.960785+0000","last_peered":"2024-09-10T05:12:04.960785+0000","last_clean":"2024-09-10T05:12:04.960785+0000","last_became_active":"2024-09-10T05:11:27.723630+0000","last_became_peered":"2024-09-10T05:11:27.723630+0000","last_unstale":"2024-09-10T05:12:04.960785+0000","last_undegraded":"2024-09-10T05:12:04.960785+0000","last_fullsized":"2024-09-10T05:12:04.960785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:03.159929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961835+0000","last_change":"2024-09-10T05:11:31.737893+0000","last_active":"2024-09-10T05:12:04.961835+0000","last_peered":"2024-09-10T05:12:04.961835+0000","last_clean":"2024-09-10T05:12:04.961835+0000","last_became_active":"2024-09-10T05:11:31.737547+0000","last_became_peered":"2024-09-10T05:11:31.737547+0000","last_unstale":"2024-09-10T05:12:04.961835+0000","last_undegraded":"2024-09-10T05:12:04.961835+0000","last_fullsized":"2024-09-10T05:12:04.961835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:48.181735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'60","reported_seq":130,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.246813+0000","last_change":"2024-09-10T05:11:33.740808+0000","last_active":"2024-09-10T05:13:34.246813+0000","last_peered":"2024-09-10T05:13:34.246813+0000","last_clean":"2024-09-10T05:13:34.246813+0000","last_became_active":"2024-09-10T05:11:33.740489+0000","last_became_peered":"2024-09-10T05:11:33.740489+0000","last_unstale":"2024-09-10T05:13:34.246813+0000","last_undegraded":"2024-09-10T05:13:34.246813+0000","last_fullsized":"2024-09-10T05:13:34.246813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:04.031528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956220+0000","last_change":"2024-09-10T05:11:35.754168+0000","last_active":"2024-09-10T05:12:04.956220+0000","last_peered":"2024-09-10T05:12:04.956220+0000","last_clean":"2024-09-10T05:12:04.956220+0000","last_became_active":"2024-09-10T05:11:35.753856+0000","last_became_peered":"2024-09-10T05:11:35.753856+0000","last_unstale":"2024-09-10T05:12:04.956220+0000","last_undegraded":"2024-09-10T05:12:04.956220+0000","last_fullsized":"2024-09-10T05:12:04.956220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:03.169802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.439500+0000","last_change":"2024-09-10T05:11:37.758619+0000","last_active":"2024-09-10T05:12:09.439500+0000","last_peered":"2024-09-10T05:12:09.439500+0000","last_clean":"2024-09-10T05:12:09.439500+0000","last_became_active":"2024-09-10T05:11:37.758332+0000","last_became_peered":"2024-09-10T05:11:37.758332+0000","last_unstale":"2024-09-10T05:12:09.439500+0000","last_undegraded":"2024-09-10T05:12:09.439500+0000","last_fullsized":"2024-09-10T05:12:09.439500+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:34:24.838165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.678085+0000","last_change":"2024-09-10T05:11:29.722215+0000","last_active":"2024-09-10T05:13:35.678085+0000","last_peered":"2024-09-10T05:13:35.678085+0000","last_clean":"2024-09-10T05:13:35.678085+0000","last_became_active":"2024-09-10T05:11:29.721899+0000","last_became_peered":"2024-09-10T05:11:29.721899+0000","last_unstale":"2024-09-10T05:13:35.678085+0000","last_undegraded":"2024-09-10T05:13:35.678085+0000","last_fullsized":"2024-09-10T05:13:35.678085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:49.705056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957373+0000","last_change":"2024-09-10T05:11:27.733809+0000","last_active":"2024-09-10T05:12:04.957373+0000","last_peered":"2024-09-10T05:12:04.957373+0000","last_clean":"2024-09-10T05:12:04.957373+0000","last_became_active":"2024-09-10T05:11:27.733451+0000","last_became_peered":"2024-09-10T05:11:27.733451+0000","last_unstale":"2024-09-10T05:12:04.957373+0000","last_undegraded":"2024-09-10T05:12:04.957373+0000","last_fullsized":"2024-09-10T05:12:04.957373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:50.768933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961145+0000","last_change":"2024-09-10T05:11:31.736009+0000","last_active":"2024-09-10T05:12:04.961145+0000","last_peered":"2024-09-10T05:12:04.961145+0000","last_clean":"2024-09-10T05:12:04.961145+0000","last_became_active":"2024-09-10T05:11:31.735565+0000","last_became_peered":"2024-09-10T05:11:31.735565+0000","last_unstale":"2024-09-10T05:12:04.961145+0000","last_undegraded":"2024-09-10T05:12:04.961145+0000","last_fullsized":"2024-09-10T05:12:04.961145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:10.523091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'39","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.138877+0000","last_change":"2024-09-10T05:11:33.742997+0000","last_active":"2024-09-10T05:14:43.138877+0000","last_peered":"2024-09-10T05:14:43.138877+0000","last_clean":"2024-09-10T05:14:43.138877+0000","last_became_active":"2024-09-10T05:11:33.742656+0000","last_became_peered":"2024-09-10T05:11:33.742656+0000","last_unstale":"2024-09-10T05:14:43.138877+0000","last_undegraded":"2024-09-10T05:14:43.138877+0000","last_fullsized":"2024-09-10T05:14:43.138877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:28.611407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954236+0000","last_change":"2024-09-10T05:11:35.751391+0000","last_active":"2024-09-10T05:12:04.954236+0000","last_peered":"2024-09-10T05:12:04.954236+0000","last_clean":"2024-09-10T05:12:04.954236+0000","last_became_active":"2024-09-10T05:11:35.750960+0000","last_became_peered":"2024-09-10T05:11:35.750960+0000","last_unstale":"2024-09-10T05:12:04.954236+0000","last_undegraded":"2024-09-10T05:12:04.954236+0000","last_fullsized":"2024-09-10T05:12:04.954236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:07.690221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.959775+0000","last_change":"2024-09-10T05:11:37.768897+0000","last_active":"2024-09-10T05:12:51.959775+0000","last_peered":"2024-09-10T05:12:51.959775+0000","last_clean":"2024-09-10T05:12:51.959775+0000","last_became_active":"2024-09-10T05:11:37.768559+0000","last_became_peered":"2024-09-10T05:11:37.768559+0000","last_unstale":"2024-09-10T05:12:51.959775+0000","last_undegraded":"2024-09-10T05:12:51.959775+0000","last_fullsized":"2024-09-10T05:12:51.959775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:41.676922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'5","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.207817+0000","last_change":"2024-09-10T05:11:29.735124+0000","last_active":"2024-09-10T05:14:36.207817+0000","last_peered":"2024-09-10T05:14:36.207817+0000","last_clean":"2024-09-10T05:14:36.207817+0000","last_became_active":"2024-09-10T05:11:29.732703+0000","last_became_peered":"2024-09-10T05:11:29.732703+0000","last_unstale":"2024-09-10T05:14:36.207817+0000","last_undegraded":"2024-09-10T05:14:36.207817+0000","last_fullsized":"2024-09-10T05:14:36.207817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:46.587126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563575+0000","last_change":"2024-09-10T05:11:27.714395+0000","last_active":"2024-09-10T05:12:08.563575+0000","last_peered":"2024-09-10T05:12:08.563575+0000","last_clean":"2024-09-10T05:12:08.563575+0000","last_became_active":"2024-09-10T05:11:27.713416+0000","last_became_peered":"2024-09-10T05:11:27.713416+0000","last_unstale":"2024-09-10T05:12:08.563575+0000","last_undegraded":"2024-09-10T05:12:08.563575+0000","last_fullsized":"2024-09-10T05:12:08.563575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:50.330893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958275+0000","last_change":"2024-09-10T05:11:31.736882+0000","last_active":"2024-09-10T05:12:04.958275+0000","last_peered":"2024-09-10T05:12:04.958275+0000","last_clean":"2024-09-10T05:12:04.958275+0000","last_became_active":"2024-09-10T05:11:31.736540+0000","last_became_peered":"2024-09-10T05:11:31.736540+0000","last_unstale":"2024-09-10T05:12:04.958275+0000","last_undegraded":"2024-09-10T05:12:04.958275+0000","last_fullsized":"2024-09-10T05:12:04.958275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:34.452648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.272847+0000","last_change":"2024-09-10T05:11:33.743575+0000","last_active":"2024-09-10T05:13:34.272847+0000","last_peered":"2024-09-10T05:13:34.272847+0000","last_clean":"2024-09-10T05:13:34.272847+0000","last_became_active":"2024-09-10T05:11:33.743207+0000","last_became_peered":"2024-09-10T05:11:33.743207+0000","last_unstale":"2024-09-10T05:13:34.272847+0000","last_undegraded":"2024-09-10T05:13:34.272847+0000","last_fullsized":"2024-09-10T05:13:34.272847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:19.732970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:35.753328+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:35.753001+0000","last_became_peered":"2024-09-10T05:11:35.753001+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:19.217985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.480743+0000","last_change":"2024-09-10T05:11:37.767945+0000","last_active":"2024-09-10T05:14:36.480743+0000","last_peered":"2024-09-10T05:14:36.480743+0000","last_clean":"2024-09-10T05:14:36.480743+0000","last_became_active":"2024-09-10T05:11:37.767649+0000","last_became_peered":"2024-09-10T05:11:37.767649+0000","last_unstale":"2024-09-10T05:14:36.480743+0000","last_undegraded":"2024-09-10T05:14:36.480743+0000","last_fullsized":"2024-09-10T05:14:36.480743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:47.436935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'4","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382235+0000","last_change":"2024-09-10T05:11:29.718957+0000","last_active":"2024-09-10T05:14:36.382235+0000","last_peered":"2024-09-10T05:14:36.382235+0000","last_clean":"2024-09-10T05:14:36.382235+0000","last_became_active":"2024-09-10T05:11:29.718689+0000","last_became_peered":"2024-09-10T05:11:29.718689+0000","last_unstale":"2024-09-10T05:14:36.382235+0000","last_undegraded":"2024-09-10T05:14:36.382235+0000","last_fullsized":"2024-09-10T05:14:36.382235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.549609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963087+0000","last_change":"2024-09-10T05:11:27.716440+0000","last_active":"2024-09-10T05:12:04.963087+0000","last_peered":"2024-09-10T05:12:04.963087+0000","last_clean":"2024-09-10T05:12:04.963087+0000","last_became_active":"2024-09-10T05:11:27.716073+0000","last_became_peered":"2024-09-10T05:11:27.716073+0000","last_unstale":"2024-09-10T05:12:04.963087+0000","last_undegraded":"2024-09-10T05:12:04.963087+0000","last_fullsized":"2024-09-10T05:12:04.963087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:12:23.620289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'2","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.968798+0000","last_change":"2024-09-10T05:11:31.736020+0000","last_active":"2024-09-10T05:13:32.968798+0000","last_peered":"2024-09-10T05:13:32.968798+0000","last_clean":"2024-09-10T05:13:32.968798+0000","last_became_active":"2024-09-10T05:11:31.735726+0000","last_became_peered":"2024-09-10T05:11:31.735726+0000","last_unstale":"2024-09-10T05:13:32.968798+0000","last_undegraded":"2024-09-10T05:13:32.968798+0000","last_fullsized":"2024-09-10T05:13:32.968798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:49.251341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'44","reported_seq":101,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.696786+0000","last_change":"2024-09-10T05:11:33.748407+0000","last_active":"2024-09-10T05:14:35.696786+0000","last_peered":"2024-09-10T05:14:35.696786+0000","last_clean":"2024-09-10T05:14:35.696786+0000","last_became_active":"2024-09-10T05:11:33.748120+0000","last_became_peered":"2024-09-10T05:11:33.748120+0000","last_unstale":"2024-09-10T05:14:35.696786+0000","last_undegraded":"2024-09-10T05:14:35.696786+0000","last_fullsized":"2024-09-10T05:14:35.696786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:46:20.643301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956794+0000","last_change":"2024-09-10T05:11:35.753972+0000","last_active":"2024-09-10T05:12:04.956794+0000","last_peered":"2024-09-10T05:12:04.956794+0000","last_clean":"2024-09-10T05:12:04.956794+0000","last_became_active":"2024-09-10T05:11:35.753437+0000","last_became_peered":"2024-09-10T05:11:35.753437+0000","last_unstale":"2024-09-10T05:12:04.956794+0000","last_undegraded":"2024-09-10T05:12:04.956794+0000","last_fullsized":"2024-09-10T05:12:04.956794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:06.887746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'10","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.285208+0000","last_change":"2024-09-10T05:11:37.765397+0000","last_active":"2024-09-10T05:13:34.285208+0000","last_peered":"2024-09-10T05:13:34.285208+0000","last_clean":"2024-09-10T05:13:34.285208+0000","last_became_active":"2024-09-10T05:11:37.765102+0000","last_became_peered":"2024-09-10T05:11:37.765102+0000","last_unstale":"2024-09-10T05:13:34.285208+0000","last_undegraded":"2024-09-10T05:13:34.285208+0000","last_fullsized":"2024-09-10T05:13:34.285208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:41.297084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":67,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'7","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914653+0000","last_change":"2024-09-10T05:11:29.729956+0000","last_active":"2024-09-10T05:13:40.914653+0000","last_peered":"2024-09-10T05:13:40.914653+0000","last_clean":"2024-09-10T05:13:40.914653+0000","last_became_active":"2024-09-10T05:11:29.729468+0000","last_became_peered":"2024-09-10T05:11:29.729468+0000","last_unstale":"2024-09-10T05:13:40.914653+0000","last_undegraded":"2024-09-10T05:13:40.914653+0000","last_fullsized":"2024-09-10T05:13:40.914653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:28.277156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956207+0000","last_change":"2024-09-10T05:11:27.706911+0000","last_active":"2024-09-10T05:12:04.956207+0000","last_peered":"2024-09-10T05:12:04.956207+0000","last_clean":"2024-09-10T05:12:04.956207+0000","last_became_active":"2024-09-10T05:11:27.706484+0000","last_became_peered":"2024-09-10T05:11:27.706484+0000","last_unstale":"2024-09-10T05:12:04.956207+0000","last_undegraded":"2024-09-10T05:12:04.956207+0000","last_fullsized":"2024-09-10T05:12:04.956207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:43.266234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'11","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:38.908717+0000","last_change":"2024-09-10T05:11:29.729314+0000","last_active":"2024-09-10T05:13:38.908717+0000","last_peered":"2024-09-10T05:13:38.908717+0000","last_clean":"2024-09-10T05:13:38.908717+0000","last_became_active":"2024-09-10T05:11:29.729019+0000","last_became_peered":"2024-09-10T05:11:29.729019+0000","last_unstale":"2024-09-10T05:13:38.908717+0000","last_undegraded":"2024-09-10T05:13:38.908717+0000","last_fullsized":"2024-09-10T05:13:38.908717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:42.589634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563597+0000","last_change":"2024-09-10T05:11:27.715436+0000","last_active":"2024-09-10T05:12:08.563597+0000","last_peered":"2024-09-10T05:12:08.563597+0000","last_clean":"2024-09-10T05:12:08.563597+0000","last_became_active":"2024-09-10T05:11:27.714487+0000","last_became_peered":"2024-09-10T05:11:27.714487+0000","last_unstale":"2024-09-10T05:12:08.563597+0000","last_undegraded":"2024-09-10T05:12:08.563597+0000","last_fullsized":"2024-09-10T05:12:08.563597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:29:45.038701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'2","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.666946+0000","last_change":"2024-09-10T05:11:29.729634+0000","last_active":"2024-09-10T05:12:09.666946+0000","last_peered":"2024-09-10T05:12:09.666946+0000","last_clean":"2024-09-10T05:12:09.666946+0000","last_became_active":"2024-09-10T05:11:29.729359+0000","last_became_peered":"2024-09-10T05:11:29.729359+0000","last_unstale":"2024-09-10T05:12:09.666946+0000","last_undegraded":"2024-09-10T05:12:09.666946+0000","last_fullsized":"2024-09-10T05:12:09.666946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:52.814750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955280+0000","last_change":"2024-09-10T05:11:27.731218+0000","last_active":"2024-09-10T05:12:04.955280+0000","last_peered":"2024-09-10T05:12:04.955280+0000","last_clean":"2024-09-10T05:12:04.955280+0000","last_became_active":"2024-09-10T05:11:27.730905+0000","last_became_peered":"2024-09-10T05:11:27.730905+0000","last_unstale":"2024-09-10T05:12:04.955280+0000","last_undegraded":"2024-09-10T05:12:04.955280+0000","last_fullsized":"2024-09-10T05:12:04.955280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:16.699974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604649+0000","last_change":"2024-09-10T05:11:29.727742+0000","last_active":"2024-09-10T05:13:32.604649+0000","last_peered":"2024-09-10T05:13:32.604649+0000","last_clean":"2024-09-10T05:13:32.604649+0000","last_became_active":"2024-09-10T05:11:29.727454+0000","last_became_peered":"2024-09-10T05:11:29.727454+0000","last_unstale":"2024-09-10T05:13:32.604649+0000","last_undegraded":"2024-09-10T05:13:32.604649+0000","last_fullsized":"2024-09-10T05:13:32.604649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:22.898915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957634+0000","last_change":"2024-09-10T05:11:27.714363+0000","last_active":"2024-09-10T05:12:04.957634+0000","last_peered":"2024-09-10T05:12:04.957634+0000","last_clean":"2024-09-10T05:12:04.957634+0000","last_became_active":"2024-09-10T05:11:27.713962+0000","last_became_peered":"2024-09-10T05:11:27.713962+0000","last_unstale":"2024-09-10T05:12:04.957634+0000","last_undegraded":"2024-09-10T05:12:04.957634+0000","last_fullsized":"2024-09-10T05:12:04.957634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:40.639981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'8","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.093386+0000","last_change":"2024-09-10T05:11:29.725511+0000","last_active":"2024-09-10T05:12:09.093386+0000","last_peered":"2024-09-10T05:12:09.093386+0000","last_clean":"2024-09-10T05:12:09.093386+0000","last_became_active":"2024-09-10T05:11:29.725099+0000","last_became_peered":"2024-09-10T05:11:29.725099+0000","last_unstale":"2024-09-10T05:12:09.093386+0000","last_undegraded":"2024-09-10T05:12:09.093386+0000","last_fullsized":"2024-09-10T05:12:09.093386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:14.626560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.652457+0000","last_change":"2024-09-10T05:11:27.719263+0000","last_active":"2024-09-10T05:12:09.652457+0000","last_peered":"2024-09-10T05:12:09.652457+0000","last_clean":"2024-09-10T05:12:09.652457+0000","last_became_active":"2024-09-10T05:11:27.718926+0000","last_became_peered":"2024-09-10T05:11:27.718926+0000","last_unstale":"2024-09-10T05:12:09.652457+0000","last_undegraded":"2024-09-10T05:12:09.652457+0000","last_fullsized":"2024-09-10T05:12:09.652457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:49.254771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'8","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107871+0000","last_change":"2024-09-10T05:12:04.978547+0000","last_active":"2024-09-10T05:14:36.107871+0000","last_peered":"2024-09-10T05:14:36.107871+0000","last_clean":"2024-09-10T05:14:36.107871+0000","last_became_active":"2024-09-10T05:12:04.964750+0000","last_became_peered":"2024-09-10T05:12:04.964750+0000","last_unstale":"2024-09-10T05:14:36.107871+0000","last_undegraded":"2024-09-10T05:14:36.107871+0000","last_fullsized":"2024-09-10T05:14:36.107871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:49.286618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960405+0000","last_change":"2024-09-10T05:11:27.718699+0000","last_active":"2024-09-10T05:12:04.960405+0000","last_peered":"2024-09-10T05:12:04.960405+0000","last_clean":"2024-09-10T05:12:04.960405+0000","last_became_active":"2024-09-10T05:11:27.718282+0000","last_became_peered":"2024-09-10T05:11:27.718282+0000","last_unstale":"2024-09-10T05:12:04.960405+0000","last_undegraded":"2024-09-10T05:12:04.960405+0000","last_fullsized":"2024-09-10T05:12:04.960405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:53.391299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.672364+0000","last_change":"2024-09-10T05:11:29.723846+0000","last_active":"2024-09-10T05:13:35.672364+0000","last_peered":"2024-09-10T05:13:35.672364+0000","last_clean":"2024-09-10T05:13:35.672364+0000","last_became_active":"2024-09-10T05:11:29.723387+0000","last_became_peered":"2024-09-10T05:11:29.723387+0000","last_unstale":"2024-09-10T05:13:35.672364+0000","last_undegraded":"2024-09-10T05:13:35.672364+0000","last_fullsized":"2024-09-10T05:13:35.672364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:05.820538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.964122+0000","last_change":"2024-09-10T05:11:27.727938+0000","last_active":"2024-09-10T05:12:04.964122+0000","last_peered":"2024-09-10T05:12:04.964122+0000","last_clean":"2024-09-10T05:12:04.964122+0000","last_became_active":"2024-09-10T05:11:27.724815+0000","last_became_peered":"2024-09-10T05:11:27.724815+0000","last_unstale":"2024-09-10T05:12:04.964122+0000","last_undegraded":"2024-09-10T05:12:04.964122+0000","last_fullsized":"2024-09-10T05:12:04.964122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:20.919577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957830+0000","last_change":"2024-09-10T05:11:29.724062+0000","last_active":"2024-09-10T05:12:04.957830+0000","last_peered":"2024-09-10T05:12:04.957830+0000","last_clean":"2024-09-10T05:12:04.957830+0000","last_became_active":"2024-09-10T05:11:29.723469+0000","last_became_peered":"2024-09-10T05:11:29.723469+0000","last_unstale":"2024-09-10T05:12:04.957830+0000","last_undegraded":"2024-09-10T05:12:04.957830+0000","last_fullsized":"2024-09-10T05:12:04.957830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:43.394583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958230+0000","last_change":"2024-09-10T05:11:27.715191+0000","last_active":"2024-09-10T05:12:04.958230+0000","last_peered":"2024-09-10T05:12:04.958230+0000","last_clean":"2024-09-10T05:12:04.958230+0000","last_became_active":"2024-09-10T05:11:27.714348+0000","last_became_peered":"2024-09-10T05:11:27.714348+0000","last_unstale":"2024-09-10T05:12:04.958230+0000","last_undegraded":"2024-09-10T05:12:04.958230+0000","last_fullsized":"2024-09-10T05:12:04.958230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:36.911942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'8","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417269+0000","last_change":"2024-09-10T05:11:29.730574+0000","last_active":"2024-09-10T05:14:36.417269+0000","last_peered":"2024-09-10T05:14:36.417269+0000","last_clean":"2024-09-10T05:14:36.417269+0000","last_became_active":"2024-09-10T05:11:29.729148+0000","last_became_peered":"2024-09-10T05:11:29.729148+0000","last_unstale":"2024-09-10T05:14:36.417269+0000","last_undegraded":"2024-09-10T05:14:36.417269+0000","last_fullsized":"2024-09-10T05:14:36.417269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:31.976539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914792+0000","last_change":"2024-09-10T05:11:27.735462+0000","last_active":"2024-09-10T05:13:40.914792+0000","last_peered":"2024-09-10T05:13:40.914792+0000","last_clean":"2024-09-10T05:13:40.914792+0000","last_became_active":"2024-09-10T05:11:27.735159+0000","last_became_peered":"2024-09-10T05:11:27.735159+0000","last_unstale":"2024-09-10T05:13:40.914792+0000","last_undegraded":"2024-09-10T05:13:40.914792+0000","last_fullsized":"2024-09-10T05:13:40.914792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:01:53.516341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'12","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339364+0000","last_change":"2024-09-10T05:11:29.729754+0000","last_active":"2024-09-10T05:14:36.339364+0000","last_peered":"2024-09-10T05:14:36.339364+0000","last_clean":"2024-09-10T05:14:36.339364+0000","last_became_active":"2024-09-10T05:11:29.729476+0000","last_became_peered":"2024-09-10T05:11:29.729476+0000","last_unstale":"2024-09-10T05:14:36.339364+0000","last_undegraded":"2024-09-10T05:14:36.339364+0000","last_fullsized":"2024-09-10T05:14:36.339364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:48.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956653+0000","last_change":"2024-09-10T05:11:27.716160+0000","last_active":"2024-09-10T05:12:04.956653+0000","last_peered":"2024-09-10T05:12:04.956653+0000","last_clean":"2024-09-10T05:12:04.956653+0000","last_became_active":"2024-09-10T05:11:27.715014+0000","last_became_peered":"2024-09-10T05:11:27.715014+0000","last_unstale":"2024-09-10T05:12:04.956653+0000","last_undegraded":"2024-09-10T05:12:04.956653+0000","last_fullsized":"2024-09-10T05:12:04.956653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:48.498486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'1","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:43.909553+0000","last_change":"2024-09-10T05:11:29.725420+0000","last_active":"2024-09-10T05:13:43.909553+0000","last_peered":"2024-09-10T05:13:43.909553+0000","last_clean":"2024-09-10T05:13:43.909553+0000","last_became_active":"2024-09-10T05:11:29.725047+0000","last_became_peered":"2024-09-10T05:11:29.725047+0000","last_unstale":"2024-09-10T05:13:43.909553+0000","last_undegraded":"2024-09-10T05:13:43.909553+0000","last_fullsized":"2024-09-10T05:13:43.909553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:53.902350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'1","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:45.915269+0000","last_change":"2024-09-10T05:11:27.728591+0000","last_active":"2024-09-10T05:13:45.915269+0000","last_peered":"2024-09-10T05:13:45.915269+0000","last_clean":"2024-09-10T05:13:45.915269+0000","last_became_active":"2024-09-10T05:11:27.728257+0000","last_became_peered":"2024-09-10T05:11:27.728257+0000","last_unstale":"2024-09-10T05:13:45.915269+0000","last_undegraded":"2024-09-10T05:13:45.915269+0000","last_fullsized":"2024-09-10T05:13:45.915269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:47:35.592580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960390+0000","last_change":"2024-09-10T05:11:29.722459+0000","last_active":"2024-09-10T05:12:04.960390+0000","last_peered":"2024-09-10T05:12:04.960390+0000","last_clean":"2024-09-10T05:12:04.960390+0000","last_became_active":"2024-09-10T05:11:29.721826+0000","last_became_peered":"2024-09-10T05:11:29.721826+0000","last_unstale":"2024-09-10T05:12:04.960390+0000","last_undegraded":"2024-09-10T05:12:04.960390+0000","last_fullsized":"2024-09-10T05:12:04.960390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:28.260482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958963+0000","last_change":"2024-09-10T05:11:27.730887+0000","last_active":"2024-09-10T05:12:04.958963+0000","last_peered":"2024-09-10T05:12:04.958963+0000","last_clean":"2024-09-10T05:12:04.958963+0000","last_became_active":"2024-09-10T05:11:27.730469+0000","last_became_peered":"2024-09-10T05:11:27.730469+0000","last_unstale":"2024-09-10T05:12:04.958963+0000","last_undegraded":"2024-09-10T05:12:04.958963+0000","last_fullsized":"2024-09-10T05:12:04.958963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:27.305881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'18","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339133+0000","last_change":"2024-09-10T05:12:04.973395+0000","last_active":"2024-09-10T05:14:36.339133+0000","last_peered":"2024-09-10T05:14:36.339133+0000","last_clean":"2024-09-10T05:14:36.339133+0000","last_became_active":"2024-09-10T05:12:04.965056+0000","last_became_peered":"2024-09-10T05:12:04.965056+0000","last_unstale":"2024-09-10T05:14:36.339133+0000","last_undegraded":"2024-09-10T05:14:36.339133+0000","last_fullsized":"2024-09-10T05:14:36.339133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:32.513703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563177+0000","last_change":"2024-09-10T05:11:27.722461+0000","last_active":"2024-09-10T05:12:08.563177+0000","last_peered":"2024-09-10T05:12:08.563177+0000","last_clean":"2024-09-10T05:12:08.563177+0000","last_became_active":"2024-09-10T05:11:27.722079+0000","last_became_peered":"2024-09-10T05:11:27.722079+0000","last_unstale":"2024-09-10T05:12:08.563177+0000","last_undegraded":"2024-09-10T05:12:08.563177+0000","last_fullsized":"2024-09-10T05:12:08.563177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:24.585536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'16","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107152+0000","last_change":"2024-09-10T05:11:29.734175+0000","last_active":"2024-09-10T05:14:36.107152+0000","last_peered":"2024-09-10T05:14:36.107152+0000","last_clean":"2024-09-10T05:14:36.107152+0000","last_became_active":"2024-09-10T05:11:29.733895+0000","last_became_peered":"2024-09-10T05:11:29.733895+0000","last_unstale":"2024-09-10T05:14:36.107152+0000","last_undegraded":"2024-09-10T05:14:36.107152+0000","last_fullsized":"2024-09-10T05:14:36.107152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:03.526086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961663+0000","last_change":"2024-09-10T05:11:27.736117+0000","last_active":"2024-09-10T05:12:04.961663+0000","last_peered":"2024-09-10T05:12:04.961663+0000","last_clean":"2024-09-10T05:12:04.961663+0000","last_became_active":"2024-09-10T05:11:27.735801+0000","last_became_peered":"2024-09-10T05:11:27.735801+0000","last_unstale":"2024-09-10T05:12:04.961663+0000","last_undegraded":"2024-09-10T05:12:04.961663+0000","last_fullsized":"2024-09-10T05:12:04.961663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:23.542052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.202329+0000","last_change":"2024-09-10T05:11:29.735884+0000","last_active":"2024-09-10T05:14:36.202329+0000","last_peered":"2024-09-10T05:14:36.202329+0000","last_clean":"2024-09-10T05:14:36.202329+0000","last_became_active":"2024-09-10T05:11:29.735555+0000","last_became_peered":"2024-09-10T05:11:29.735555+0000","last_unstale":"2024-09-10T05:14:36.202329+0000","last_undegraded":"2024-09-10T05:14:36.202329+0000","last_fullsized":"2024-09-10T05:14:36.202329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:40:54.995716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.964581+0000","last_change":"2024-09-10T05:11:27.727651+0000","last_active":"2024-09-10T05:12:04.964581+0000","last_peered":"2024-09-10T05:12:04.964581+0000","last_clean":"2024-09-10T05:12:04.964581+0000","last_became_active":"2024-09-10T05:11:27.723820+0000","last_became_peered":"2024-09-10T05:11:27.723820+0000","last_unstale":"2024-09-10T05:12:04.964581+0000","last_undegraded":"2024-09-10T05:12:04.964581+0000","last_fullsized":"2024-09-10T05:12:04.964581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:01:27.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.394391+0000","last_change":"2024-09-10T05:11:29.724350+0000","last_active":"2024-09-10T05:14:36.394391+0000","last_peered":"2024-09-10T05:14:36.394391+0000","last_clean":"2024-09-10T05:14:36.394391+0000","last_became_active":"2024-09-10T05:11:29.723816+0000","last_became_peered":"2024-09-10T05:11:29.723816+0000","last_unstale":"2024-09-10T05:14:36.394391+0000","last_undegraded":"2024-09-10T05:14:36.394391+0000","last_fullsized":"2024-09-10T05:14:36.394391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:33.014166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960833+0000","last_change":"2024-09-10T05:11:27.736745+0000","last_active":"2024-09-10T05:12:04.960833+0000","last_peered":"2024-09-10T05:12:04.960833+0000","last_clean":"2024-09-10T05:12:04.960833+0000","last_became_active":"2024-09-10T05:11:27.736370+0000","last_became_peered":"2024-09-10T05:11:27.736370+0000","last_unstale":"2024-09-10T05:12:04.960833+0000","last_undegraded":"2024-09-10T05:12:04.960833+0000","last_fullsized":"2024-09-10T05:12:04.960833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:18.893074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.411415+0000","last_change":"2024-09-10T05:11:27.731505+0000","last_active":"2024-09-10T05:14:36.411415+0000","last_peered":"2024-09-10T05:14:36.411415+0000","last_clean":"2024-09-10T05:14:36.411415+0000","last_became_active":"2024-09-10T05:11:27.731202+0000","last_became_peered":"2024-09-10T05:11:27.731202+0000","last_unstale":"2024-09-10T05:14:36.411415+0000","last_undegraded":"2024-09-10T05:14:36.411415+0000","last_fullsized":"2024-09-10T05:14:36.411415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:19.541656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.383073+0000","last_change":"2024-09-10T05:11:29.723977+0000","last_active":"2024-09-10T05:14:36.383073+0000","last_peered":"2024-09-10T05:14:36.383073+0000","last_clean":"2024-09-10T05:14:36.383073+0000","last_became_active":"2024-09-10T05:11:29.723467+0000","last_became_peered":"2024-09-10T05:11:29.723467+0000","last_unstale":"2024-09-10T05:14:36.383073+0000","last_undegraded":"2024-09-10T05:14:36.383073+0000","last_fullsized":"2024-09-10T05:14:36.383073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:38:33.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957046+0000","last_change":"2024-09-10T05:11:27.715255+0000","last_active":"2024-09-10T05:12:04.957046+0000","last_peered":"2024-09-10T05:12:04.957046+0000","last_clean":"2024-09-10T05:12:04.957046+0000","last_became_active":"2024-09-10T05:11:27.713659+0000","last_became_peered":"2024-09-10T05:11:27.713659+0000","last_unstale":"2024-09-10T05:12:04.957046+0000","last_undegraded":"2024-09-10T05:12:04.957046+0000","last_fullsized":"2024-09-10T05:12:04.957046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:40.253443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'10","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417292+0000","last_change":"2024-09-10T05:12:04.964980+0000","last_active":"2024-09-10T05:14:36.417292+0000","last_peered":"2024-09-10T05:14:36.417292+0000","last_clean":"2024-09-10T05:14:36.417292+0000","last_became_active":"2024-09-10T05:12:04.964552+0000","last_became_peered":"2024-09-10T05:12:04.964552+0000","last_unstale":"2024-09-10T05:14:36.417292+0000","last_undegraded":"2024-09-10T05:14:36.417292+0000","last_fullsized":"2024-09-10T05:14:36.417292+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:49.445729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1732,"num_read_kb":1486,"num_write":737,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1494,"ondisk_log_size":1494,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":21611392,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":87,"num_write":310,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30330880,"data_stored":30330880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640301,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48508,"kb_used_data":9004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323332,"statfs":{"total":96636764160,"available":96587091968,"internally_reserved":0,"allocated":9220096,"data_stored":8873071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48964,"kb_used_data":13620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322876,"statfs":{"total":96636764160,"available":96586625024,"internally_reserved":0,"allocated":13946880,"data_stored":13657600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44888,"kb_used_data":9544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326952,"statfs":{"total":96636764160,"available":96590798848,"internally_reserved":0,"allocated":9773056,"data_stored":9462501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":475136,"data_stored":160447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:14:44.221 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:14:44.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.348+0000 7f8724dcd640 1 Processor -- start 2024-09-10T05:14:44.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.348+0000 7f8724dcd640 1 -- start start 2024-09-10T05:14:44.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.349+0000 7f8724dcd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8720129d80 0x7f872012a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:44.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.349+0000 7f8724dcd640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872006dc00 con 0x7f872012a6a0 2024-09-10T05:14:44.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.349+0000 7f8724dcd640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f87201299c0 con 0x7f8720129d80 2024-09-10T05:14:44.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.349+0000 7f871e59c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8720129d80 0x7f872012a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:44.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.349+0000 7f871dd9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f872012a6a0 0x7f8720110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40904/0 (socket says 172.21.15.139:40904) 2024-09-10T05:14:44.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.349+0000 7f871dd9b640 1 -- 172.21.15.139:0/1193536176 learned_addr learned my addr 172.21.15.139:0/1193536176 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:44.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.350+0000 7f871e59c640 1 -- 172.21.15.139:0/1193536176 >> v1:172.21.15.139:6789/0 conn(0x7f872012a6a0 legacy=0x7f8720110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:44.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.350+0000 7f871e59c640 1 -- 172.21.15.139:0/1193536176 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8720114d20 con 0x7f8720129d80 2024-09-10T05:14:44.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.350+0000 7f871e59c640 1 --2- 172.21.15.139:0/1193536176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8720129d80 0x7f872012a160 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8718009d90 tx=0x7f871802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d9b7efa8121009 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:44.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.350+0000 7f871d59a640 1 -- 172.21.15.139:0/1193536176 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8718007670 con 0x7f8720129d80 2024-09-10T05:14:44.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.350+0000 7f871d59a640 1 -- 172.21.15.139:0/1193536176 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8718007810 con 0x7f8720129d80 2024-09-10T05:14:44.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.350+0000 7f871d59a640 1 -- 172.21.15.139:0/1193536176 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8718007b10 con 0x7f8720129d80 2024-09-10T05:14:44.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.351+0000 7f8724dcd640 1 -- 172.21.15.139:0/1193536176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8720129d80 msgr2=0x7f872012a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:44.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.351+0000 7f8724dcd640 1 --2- 172.21.15.139:0/1193536176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8720129d80 0x7f872012a160 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8718009d90 tx=0x7f871802a660 comp rx=0 tx=0).stop 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.351+0000 7f8724dcd640 1 -- 172.21.15.139:0/1193536176 shutdown_connections 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.351+0000 7f8724dcd640 1 --2- 172.21.15.139:0/1193536176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8720129d80 0x7f872012a160 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.351+0000 7f8724dcd640 1 -- 172.21.15.139:0/1193536176 >> 172.21.15.139:0/1193536176 conn(0x7f8720070850 msgr2=0x7f8720072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.351+0000 7f8724dcd640 1 -- 172.21.15.139:0/1193536176 shutdown_connections 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.351+0000 7f8724dcd640 1 -- 172.21.15.139:0/1193536176 wait complete. 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.352+0000 7f8724dcd640 1 Processor -- start 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.352+0000 7f8724dcd640 1 -- start start 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.352+0000 7f8724dcd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8720129d80 0x7f87201bed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.352+0000 7f8724dcd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8720114940 con 0x7f8720129d80 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.352+0000 7f871e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8720129d80 0x7f87201bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.352+0000 7f871e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8720129d80 0x7f87201bed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34696/0 (socket says 172.21.15.139:34696) 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.352+0000 7f871e59c640 1 -- 172.21.15.139:0/2709812268 learned_addr learned my addr 172.21.15.139:0/2709812268 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:44.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.353+0000 7f871e59c640 1 -- 172.21.15.139:0/2709812268 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872011de40 con 0x7f8720129d80 2024-09-10T05:14:44.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.353+0000 7f871e59c640 1 --2- 172.21.15.139:0/2709812268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8720129d80 0x7f87201bed50 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f8718009d90 tx=0x7f8718004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:44.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.353+0000 7f8716ffd640 1 -- 172.21.15.139:0/2709812268 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8718040070 con 0x7f8720129d80 2024-09-10T05:14:44.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.353+0000 7f8716ffd640 1 -- 172.21.15.139:0/2709812268 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8718031a90 con 0x7f8720129d80 2024-09-10T05:14:44.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.353+0000 7f8724dcd640 1 -- 172.21.15.139:0/2709812268 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87201bf290 con 0x7f8720129d80 2024-09-10T05:14:44.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.353+0000 7f8716ffd640 1 -- 172.21.15.139:0/2709812268 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8718031d70 con 0x7f8720129d80 2024-09-10T05:14:44.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.353+0000 7f8724dcd640 1 -- 172.21.15.139:0/2709812268 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87201bf750 con 0x7f8720129d80 2024-09-10T05:14:44.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.354+0000 7f8716ffd640 1 -- 172.21.15.139:0/2709812268 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f8718039040 con 0x7f8720129d80 2024-09-10T05:14:44.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.354+0000 7f8716ffd640 1 --2- 172.21.15.139:0/2709812268 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f870003de90 0x7f8700040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:44.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.354+0000 7f8724dcd640 1 -- 172.21.15.139:0/2709812268 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f872011cad0 con 0x7f8720129d80 2024-09-10T05:14:44.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.354+0000 7f8716ffd640 1 -- 172.21.15.139:0/2709812268 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f871802ae00 con 0x7f8720129d80 2024-09-10T05:14:44.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.354+0000 7f871dd9b640 1 --2- 172.21.15.139:0/2709812268 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f870003de90 0x7f8700040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:44.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.355+0000 7f871dd9b640 1 --2- 172.21.15.139:0/2709812268 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f870003de90 0x7f8700040350 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8708007fd0 tx=0x7f8708007aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:44.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.359+0000 7f8716ffd640 1 -- 172.21.15.139:0/2709812268 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f87180303a0 con 0x7f8720129d80 2024-09-10T05:14:44.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.532+0000 7f8724dcd640 1 -- 172.21.15.139:0/2709812268 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f872011e2c0 con 0x7f8720129d80 2024-09-10T05:14:44.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.533+0000 7f8716ffd640 1 -- 172.21.15.139:0/2709812268 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+21202 (secure 0 0 0) 0x7f87180443c0 con 0x7f8720129d80 2024-09-10T05:14:44.536 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:14:44.536 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":37,"fsid":"3465d198-8f8d-4e0c-ba83-88b13d9b49be","created":"2024-09-10T05:10:59.697360+0000","modified":"2024-09-10T05:12:04.951046+0000","last_up_change":"2024-09-10T05:11:10.486612+0000","last_in_change":"2024-09-10T05:11:00.751464+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:11:11.892255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T05:11:15.200669+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T05:11:25.694386+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T05:11:28.015593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T05:11:30.018460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T05:11:31.800097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T05:11:33.753904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T05:11:35.823566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66219d18-2e08-4bf8-9271-bfaf3e270982","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6801","nonce":2915567440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6803","nonce":2915567440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6807","nonce":2915567440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2915567440},{"type":"v1","addr":"172.21.15.139:6805","nonce":2915567440}]},"public_addr":"172.21.15.139:6801/2915567440","cluster_addr":"172.21.15.139:6803/2915567440","heartbeat_back_addr":"172.21.15.139:6807/2915567440","heartbeat_front_addr":"172.21.15.139:6805/2915567440","state":["exists","up"]},{"osd":1,"uuid":"c8cf450e-b552-4e11-aa38-83613145105d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6803","nonce":3487349558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6805","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6807","nonce":3487349558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6815","nonce":3487349558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3487349558},{"type":"v1","addr":"172.21.15.192:6811","nonce":3487349558}]},"public_addr":"172.21.15.192:6803/3487349558","cluster_addr":"172.21.15.192:6807/3487349558","heartbeat_back_addr":"172.21.15.192:6815/3487349558","heartbeat_front_addr":"172.21.15.192:6811/3487349558","state":["exists","up"]},{"osd":2,"uuid":"7e53ce5e-92fc-4417-b675-a20d8b740415","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6801","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6802","nonce":2435677948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6806","nonce":2435677948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6813","nonce":2435677948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":2435677948},{"type":"v1","addr":"172.21.15.192:6810","nonce":2435677948}]},"public_addr":"172.21.15.192:6802/2435677948","cluster_addr":"172.21.15.192:6806/2435677948","heartbeat_back_addr":"172.21.15.192:6813/2435677948","heartbeat_front_addr":"172.21.15.192:6810/2435677948","state":["exists","up"]},{"osd":3,"uuid":"c4099f78-d4fa-41cd-a4c4-2aa56d3d1e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6817","nonce":1620624472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6819","nonce":1620624472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6823","nonce":1620624472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1620624472},{"type":"v1","addr":"172.21.15.192:6821","nonce":1620624472}]},"public_addr":"172.21.15.192:6817/1620624472","cluster_addr":"172.21.15.192:6819/1620624472","heartbeat_back_addr":"172.21.15.192:6823/1620624472","heartbeat_front_addr":"172.21.15.192:6821/1620624472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:06.174920+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:07.342107+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:07.381356+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:11:07.499864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":2}]},{"pgid":"4.36","mappings":[{"from":3,"to":0}]},{"pgid":"5.5","mappings":[{"from":0,"to":2}]},{"pgid":"5.12","mappings":[{"from":0,"to":2}]},{"pgid":"5.17","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:14:44.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.536+0000 7f8724dcd640 1 -- 172.21.15.139:0/2709812268 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f870003de90 msgr2=0x7f8700040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:44.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.536+0000 7f8724dcd640 1 --2- 172.21.15.139:0/2709812268 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f870003de90 0x7f8700040350 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8708007fd0 tx=0x7f8708007aa0 comp rx=0 tx=0).stop 2024-09-10T05:14:44.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.536+0000 7f8724dcd640 1 -- 172.21.15.139:0/2709812268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8720129d80 msgr2=0x7f87201bed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:44.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.536+0000 7f8724dcd640 1 --2- 172.21.15.139:0/2709812268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8720129d80 0x7f87201bed50 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f8718009d90 tx=0x7f8718004a40 comp rx=0 tx=0).stop 2024-09-10T05:14:44.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.536+0000 7f8724dcd640 1 -- 172.21.15.139:0/2709812268 shutdown_connections 2024-09-10T05:14:44.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.536+0000 7f8724dcd640 1 --2- 172.21.15.139:0/2709812268 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f870003de90 0x7f8700040350 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:44.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.536+0000 7f8724dcd640 1 --2- 172.21.15.139:0/2709812268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8720129d80 0x7f87201bed50 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:44.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.536+0000 7f8724dcd640 1 -- 172.21.15.139:0/2709812268 >> 172.21.15.139:0/2709812268 conn(0x7f8720070850 msgr2=0x7f8720126310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:44.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.536+0000 7f8724dcd640 1 -- 172.21.15.139:0/2709812268 shutdown_connections 2024-09-10T05:14:44.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:44.536+0000 7f8724dcd640 1 -- 172.21.15.139:0/2709812268 wait complete. 2024-09-10T05:14:45.549 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T05:14:45.549 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:14:45.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.661+0000 7fc3e3f84640 1 Processor -- start 2024-09-10T05:14:45.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.661+0000 7fc3e3f84640 1 -- start start 2024-09-10T05:14:45.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.662+0000 7fc3e3f84640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc3dc12b670 0x7fc3dc12ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:45.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.662+0000 7fc3e3f84640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3dc113000 con 0x7fc3dc12bf90 2024-09-10T05:14:45.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.662+0000 7fc3e3f84640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fc3dc112820 con 0x7fc3dc12b670 2024-09-10T05:14:45.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.662+0000 7fc3e1d20640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc3dc12b670 0x7fc3dc12ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:45.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.662+0000 7fc3e151f640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc3dc12bf90 0x7fc3dc1280f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40916/0 (socket says 172.21.15.139:40916) 2024-09-10T05:14:45.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.662+0000 7fc3e151f640 1 -- 172.21.15.139:0/126558974 learned_addr learned my addr 172.21.15.139:0/126558974 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:45.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.662+0000 7fc3e1d20640 1 -- 172.21.15.139:0/126558974 >> v1:172.21.15.139:6789/0 conn(0x7fc3dc12bf90 legacy=0x7fc3dc1280f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:45.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.662+0000 7fc3e1d20640 1 -- 172.21.15.139:0/126558974 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3dc06dbb0 con 0x7fc3dc12b670 2024-09-10T05:14:45.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.663+0000 7fc3e1d20640 1 --2- 172.21.15.139:0/126558974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3dc12b670 0x7fc3dc12ba50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009720 tx=0x7fc3d802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dc74972d65adeb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:45.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.663+0000 7fc3e0d1e640 1 -- 172.21.15.139:0/126558974 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3d8037070 con 0x7fc3dc12b670 2024-09-10T05:14:45.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.663+0000 7fc3e0d1e640 1 -- 172.21.15.139:0/126558974 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d802ad90 con 0x7fc3dc12b670 2024-09-10T05:14:45.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.663+0000 7fc3e0d1e640 1 -- 172.21.15.139:0/126558974 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3d8032590 con 0x7fc3dc12b670 2024-09-10T05:14:45.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.663+0000 7fc3e3f84640 1 -- 172.21.15.139:0/126558974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3dc12b670 msgr2=0x7fc3dc12ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:45.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.663+0000 7fc3e3f84640 1 --2- 172.21.15.139:0/126558974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3dc12b670 0x7fc3dc12ba50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009720 tx=0x7fc3d802a110 comp rx=0 tx=0).stop 2024-09-10T05:14:45.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.663+0000 7fc3e3f84640 1 -- 172.21.15.139:0/126558974 shutdown_connections 2024-09-10T05:14:45.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.663+0000 7fc3e3f84640 1 --2- 172.21.15.139:0/126558974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3dc12b670 0x7fc3dc12ba50 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:45.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.663+0000 7fc3e3f84640 1 -- 172.21.15.139:0/126558974 >> 172.21.15.139:0/126558974 conn(0x7fc3dc070210 msgr2=0x7fc3dc072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:45.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.664+0000 7fc3e3f84640 1 -- 172.21.15.139:0/126558974 shutdown_connections 2024-09-10T05:14:45.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.664+0000 7fc3e3f84640 1 -- 172.21.15.139:0/126558974 wait complete. 2024-09-10T05:14:45.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.664+0000 7fc3e3f84640 1 Processor -- start 2024-09-10T05:14:45.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.664+0000 7fc3e3f84640 1 -- start start 2024-09-10T05:14:45.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.665+0000 7fc3e3f84640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3dc12b670 0x7fc3dc1c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.665+0000 7fc3e3f84640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc128980 con 0x7fc3dc12b670 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.665+0000 7fc3e1d20640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3dc12b670 0x7fc3dc1c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.665+0000 7fc3e1d20640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3dc12b670 0x7fc3dc1c1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34712/0 (socket says 172.21.15.139:34712) 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.665+0000 7fc3e1d20640 1 -- 172.21.15.139:0/1653325365 learned_addr learned my addr 172.21.15.139:0/1653325365 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.665+0000 7fc3e1d20640 1 -- 172.21.15.139:0/1653325365 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3dc125130 con 0x7fc3dc12b670 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.665+0000 7fc3e1d20640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3dc12b670 0x7fc3dc1c1fe0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009840 tx=0x7fc3d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.665+0000 7fc3d27fc640 1 -- 172.21.15.139:0/1653325365 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3d8041070 con 0x7fc3dc12b670 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.665+0000 7fc3d27fc640 1 -- 172.21.15.139:0/1653325365 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d803c460 con 0x7fc3dc12b670 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.665+0000 7fc3e3f84640 1 -- 172.21.15.139:0/1653325365 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3dc116bb0 con 0x7fc3dc12b670 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.665+0000 7fc3d27fc640 1 -- 172.21.15.139:0/1653325365 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3d8037040 con 0x7fc3dc12b670 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.666+0000 7fc3e3f84640 1 -- 172.21.15.139:0/1653325365 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3dc116620 con 0x7fc3dc12b670 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.666+0000 7fc3e3f84640 1 -- 172.21.15.139:0/1653325365 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc3dc12ba50 con 0x7fc3dc12b670 2024-09-10T05:14:45.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.666+0000 7fc3d27fc640 1 -- 172.21.15.139:0/1653325365 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc3d8044070 con 0x7fc3dc12b670 2024-09-10T05:14:45.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.667+0000 7fc3d27fc640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc3c003de90 0x7fc3c0040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:45.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.667+0000 7fc3d27fc640 1 -- 172.21.15.139:0/1653325365 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc3d8073770 con 0x7fc3dc12b670 2024-09-10T05:14:45.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.667+0000 7fc3d27fc640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x7fc3c004a290 0x7fc3c004c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:45.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.667+0000 7fc3d27fc640 1 -- 172.21.15.139:0/1653325365 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3d8041e70 con 0x7fc3c004a290 2024-09-10T05:14:45.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.667+0000 7fc3d27fc640 1 -- 172.21.15.139:0/1653325365 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc3d807a050 con 0x7fc3dc12b670 2024-09-10T05:14:45.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.667+0000 7fc3e2521640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x7fc3c004a290 0x7fc3c004c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:45.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.667+0000 7fc3e151f640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc3c003de90 0x7fc3c0040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:45.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.667+0000 7fc3e2521640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x7fc3c004a290 0x7fc3c004c730 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:45.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.667+0000 7fc3e151f640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc3c003de90 0x7fc3c0040350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc007fd0 tx=0x7fc3cc007aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:45.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.668+0000 7fc3d27fc640 1 -- 172.21.15.139:0/1653325365 <== osd.0 v2:172.21.15.139:6800/2915567440 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3d8041e70 con 0x7fc3c004a290 2024-09-10T05:14:45.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.680+0000 7fc3e3f84640 1 -- 172.21.15.139:0/1653325365 --> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc3dc12bf90 con 0x7fc3c004a290 2024-09-10T05:14:45.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.680+0000 7fc3d27fc640 1 -- 172.21.15.139:0/1653325365 <== osd.0 v2:172.21.15.139:6800/2915567440 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc3dc12bf90 con 0x7fc3c004a290 2024-09-10T05:14:45.683 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-10T05:14:45.683 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:14:45.683 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-10T05:14:45.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 -- 172.21.15.139:0/1653325365 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x7fc3c004a290 msgr2=0x7fc3c004c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:45.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x7fc3c004a290 0x7fc3c004c730 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:45.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 -- 172.21.15.139:0/1653325365 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc3c003de90 msgr2=0x7fc3c0040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:45.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc3c003de90 0x7fc3c0040350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc007fd0 tx=0x7fc3cc007aa0 comp rx=0 tx=0).stop 2024-09-10T05:14:45.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 -- 172.21.15.139:0/1653325365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3dc12b670 msgr2=0x7fc3dc1c1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:45.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3dc12b670 0x7fc3dc1c1fe0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009840 tx=0x7fc3d80046c0 comp rx=0 tx=0).stop 2024-09-10T05:14:45.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 -- 172.21.15.139:0/1653325365 shutdown_connections 2024-09-10T05:14:45.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.139:6800/2915567440,v1:172.21.15.139:6801/2915567440] conn(0x7fc3c004a290 0x7fc3c004c730 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:45.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc3c003de90 0x7fc3c0040350 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:45.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 --2- 172.21.15.139:0/1653325365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3dc12b670 0x7fc3dc1c1fe0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:45.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 -- 172.21.15.139:0/1653325365 >> 172.21.15.139:0/1653325365 conn(0x7fc3dc070210 msgr2=0x7fc3dc12a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:45.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 -- 172.21.15.139:0/1653325365 shutdown_connections 2024-09-10T05:14:45.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.681+0000 7fc3e3f84640 1 -- 172.21.15.139:0/1653325365 wait complete. 2024-09-10T05:14:45.693 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T05:14:45.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.789+0000 7f9c496f7640 1 Processor -- start 2024-09-10T05:14:45.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.789+0000 7f9c496f7640 1 -- start start 2024-09-10T05:14:45.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.789+0000 7f9c496f7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9c4409ecd0 0x7f9c441314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:45.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.789+0000 7f9c496f7640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c44073050 con 0x7f9c44071d10 2024-09-10T05:14:45.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.789+0000 7f9c496f7640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f9c44073600 con 0x7f9c4409ecd0 2024-09-10T05:14:45.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.789+0000 7f9c427fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9c4409ecd0 0x7f9c441314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:45.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.789+0000 7f9c42ffd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f9c44071d10 0x7f9c440720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40922/0 (socket says 172.21.15.139:40922) 2024-09-10T05:14:45.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.789+0000 7f9c42ffd640 1 -- 172.21.15.139:0/4034448133 learned_addr learned my addr 172.21.15.139:0/4034448133 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:45.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.790+0000 7f9c427fc640 1 -- 172.21.15.139:0/4034448133 >> v1:172.21.15.139:6789/0 conn(0x7f9c44071d10 legacy=0x7f9c440720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:45.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.790+0000 7f9c427fc640 1 -- 172.21.15.139:0/4034448133 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c440732f0 con 0x7f9c4409ecd0 2024-09-10T05:14:45.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.790+0000 7f9c427fc640 1 --2- 172.21.15.139:0/4034448133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c4409ecd0 0x7f9c441314d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009720 tx=0x7f9c3802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2748dd392444c912 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:45.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.790+0000 7f9c41ffb640 1 -- 172.21.15.139:0/4034448133 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c38037070 con 0x7f9c4409ecd0 2024-09-10T05:14:45.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.790+0000 7f9c41ffb640 1 -- 172.21.15.139:0/4034448133 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3802ad90 con 0x7f9c4409ecd0 2024-09-10T05:14:45.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.790+0000 7f9c41ffb640 1 -- 172.21.15.139:0/4034448133 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c38032590 con 0x7f9c4409ecd0 2024-09-10T05:14:45.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.791+0000 7f9c496f7640 1 -- 172.21.15.139:0/4034448133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c4409ecd0 msgr2=0x7f9c441314d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:45.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.791+0000 7f9c496f7640 1 --2- 172.21.15.139:0/4034448133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c4409ecd0 0x7f9c441314d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009720 tx=0x7f9c3802a110 comp rx=0 tx=0).stop 2024-09-10T05:14:45.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.791+0000 7f9c496f7640 1 -- 172.21.15.139:0/4034448133 shutdown_connections 2024-09-10T05:14:45.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.791+0000 7f9c496f7640 1 --2- 172.21.15.139:0/4034448133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c4409ecd0 0x7f9c441314d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:45.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.791+0000 7f9c496f7640 1 -- 172.21.15.139:0/4034448133 >> 172.21.15.139:0/4034448133 conn(0x7f9c4409c640 msgr2=0x7f9c4406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:45.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.791+0000 7f9c496f7640 1 -- 172.21.15.139:0/4034448133 shutdown_connections 2024-09-10T05:14:45.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.791+0000 7f9c496f7640 1 -- 172.21.15.139:0/4034448133 wait complete. 2024-09-10T05:14:45.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.792+0000 7f9c496f7640 1 Processor -- start 2024-09-10T05:14:45.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.792+0000 7f9c496f7640 1 -- start start 2024-09-10T05:14:45.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.792+0000 7f9c496f7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c44071d10 0x7f9c441148c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:45.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.792+0000 7f9c496f7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9c44072980 con 0x7f9c44071d10 2024-09-10T05:14:45.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.792+0000 7f9c42ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c44071d10 0x7f9c441148c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.792+0000 7f9c42ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c44071d10 0x7f9c441148c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34724/0 (socket says 172.21.15.139:34724) 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.792+0000 7f9c42ffd640 1 -- 172.21.15.139:0/697782113 learned_addr learned my addr 172.21.15.139:0/697782113 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.793+0000 7f9c42ffd640 1 -- 172.21.15.139:0/697782113 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c44117940 con 0x7f9c44071d10 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.793+0000 7f9c42ffd640 1 --2- 172.21.15.139:0/697782113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c44071d10 0x7f9c441148c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c480 tx=0x7f9c3400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.793+0000 7f9c2b7fe640 1 -- 172.21.15.139:0/697782113 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c34017070 con 0x7f9c44071d10 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.793+0000 7f9c2b7fe640 1 -- 172.21.15.139:0/697782113 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c34005c10 con 0x7f9c44071d10 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.793+0000 7f9c496f7640 1 -- 172.21.15.139:0/697782113 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c44117c70 con 0x7f9c44071d10 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.793+0000 7f9c2b7fe640 1 -- 172.21.15.139:0/697782113 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c34007070 con 0x7f9c44071d10 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.793+0000 7f9c496f7640 1 -- 172.21.15.139:0/697782113 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c44117300 con 0x7f9c44071d10 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.794+0000 7f9c2b7fe640 1 -- 172.21.15.139:0/697782113 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f9c3401a070 con 0x7f9c44071d10 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.794+0000 7f9c496f7640 1 -- 172.21.15.139:0/697782113 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c44116fc0 con 0x7f9c44071d10 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.794+0000 7f9c2b7fe640 1 --2- 172.21.15.139:0/697782113 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9c3003de90 0x7f9c30040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.794+0000 7f9c2b7fe640 1 -- 172.21.15.139:0/697782113 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9c34051f60 con 0x7f9c44071d10 2024-09-10T05:14:45.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.794+0000 7f9c427fc640 1 --2- 172.21.15.139:0/697782113 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9c3003de90 0x7f9c30040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:45.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.795+0000 7f9c427fc640 1 --2- 172.21.15.139:0/697782113 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9c3003de90 0x7f9c30040350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9c38034000 tx=0x7f9c3802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:45.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.799+0000 7f9c2b7fe640 1 -- 172.21.15.139:0/697782113 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f9c44116fc0 con 0x7f9c44071d10 2024-09-10T05:14:45.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.975+0000 7f9c496f7640 1 -- 172.21.15.139:0/697782113 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f9c440720f0 con 0x7f9c3003de90 2024-09-10T05:14:45.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.976+0000 7f9c2b7fe640 1 -- 172.21.15.139:0/697782113 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9c440720f0 con 0x7f9c3003de90 2024-09-10T05:14:45.978 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T05:14:45.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.978+0000 7f9c496f7640 1 -- 172.21.15.139:0/697782113 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9c3003de90 msgr2=0x7f9c30040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:45.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.978+0000 7f9c496f7640 1 --2- 172.21.15.139:0/697782113 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9c3003de90 0x7f9c30040350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9c38034000 tx=0x7f9c3802e000 comp rx=0 tx=0).stop 2024-09-10T05:14:45.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.979+0000 7f9c496f7640 1 -- 172.21.15.139:0/697782113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c44071d10 msgr2=0x7f9c441148c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:45.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.979+0000 7f9c496f7640 1 --2- 172.21.15.139:0/697782113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c44071d10 0x7f9c441148c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c480 tx=0x7f9c3400c940 comp rx=0 tx=0).stop 2024-09-10T05:14:45.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.979+0000 7f9c496f7640 1 -- 172.21.15.139:0/697782113 shutdown_connections 2024-09-10T05:14:45.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.979+0000 7f9c496f7640 1 --2- 172.21.15.139:0/697782113 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f9c3003de90 0x7f9c30040350 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:45.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.979+0000 7f9c496f7640 1 --2- 172.21.15.139:0/697782113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c44071d10 0x7f9c441148c0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:45.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.979+0000 7f9c496f7640 1 -- 172.21.15.139:0/697782113 >> 172.21.15.139:0/697782113 conn(0x7f9c4409c640 msgr2=0x7f9c4409d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:45.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.979+0000 7f9c496f7640 1 -- 172.21.15.139:0/697782113 shutdown_connections 2024-09-10T05:14:45.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:45.979+0000 7f9c496f7640 1 -- 172.21.15.139:0/697782113 wait complete. 2024-09-10T05:14:45.991 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T05:14:45.991 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:14:46.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.092+0000 7ff8c0964640 1 Processor -- start 2024-09-10T05:14:46.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.092+0000 7ff8c0964640 1 -- start start 2024-09-10T05:14:46.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.092+0000 7ff8c0964640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff8bc1235f0 0x7ff8bc1239d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.092+0000 7ff8c0964640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8bc0733d0 con 0x7ff8bc123f10 2024-09-10T05:14:46.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.092+0000 7ff8c0964640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7ff8bc114d60 con 0x7ff8bc1235f0 2024-09-10T05:14:46.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.092+0000 7ff8ba59c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff8bc1235f0 0x7ff8bc1239d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.092+0000 7ff8b1d9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff8bc123f10 0x7ff8bc110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40930/0 (socket says 172.21.15.139:40930) 2024-09-10T05:14:46.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.092+0000 7ff8b1d9b640 1 -- 172.21.15.139:0/2527115848 learned_addr learned my addr 172.21.15.139:0/2527115848 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:46.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.093+0000 7ff8ba59c640 1 -- 172.21.15.139:0/2527115848 >> v1:172.21.15.139:6789/0 conn(0x7ff8bc123f10 legacy=0x7ff8bc110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.093+0000 7ff8b9d9b640 1 -- 172.21.15.139:0/2527115848 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1270278749 0 0) 0x7ff8bc0733d0 con 0x7ff8bc123f10 2024-09-10T05:14:46.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.093+0000 7ff8ba59c640 1 -- 172.21.15.139:0/2527115848 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc0737b0 con 0x7ff8bc1235f0 2024-09-10T05:14:46.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.093+0000 7ff8ba59c640 1 --2- 172.21.15.139:0/2527115848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc1235f0 0x7ff8bc1239d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009720 tx=0x7ff8ac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73e61f7242d6552 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.093+0000 7ff8b9d9b640 1 -- 172.21.15.139:0/2527115848 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac037070 con 0x7ff8bc1235f0 2024-09-10T05:14:46.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.094+0000 7ff8b9d9b640 1 -- 172.21.15.139:0/2527115848 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac02ad90 con 0x7ff8bc1235f0 2024-09-10T05:14:46.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.094+0000 7ff8b9d9b640 1 -- 172.21.15.139:0/2527115848 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac032590 con 0x7ff8bc1235f0 2024-09-10T05:14:46.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.094+0000 7ff8c0964640 1 -- 172.21.15.139:0/2527115848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc1235f0 msgr2=0x7ff8bc1239d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.094+0000 7ff8c0964640 1 --2- 172.21.15.139:0/2527115848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc1235f0 0x7ff8bc1239d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009720 tx=0x7ff8ac02a110 comp rx=0 tx=0).stop 2024-09-10T05:14:46.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.094+0000 7ff8c0964640 1 -- 172.21.15.139:0/2527115848 shutdown_connections 2024-09-10T05:14:46.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.094+0000 7ff8c0964640 1 --2- 172.21.15.139:0/2527115848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc1235f0 0x7ff8bc1239d0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.094+0000 7ff8c0964640 1 -- 172.21.15.139:0/2527115848 >> 172.21.15.139:0/2527115848 conn(0x7ff8bc070210 msgr2=0x7ff8bc072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:46.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.094+0000 7ff8c0964640 1 -- 172.21.15.139:0/2527115848 shutdown_connections 2024-09-10T05:14:46.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.094+0000 7ff8c0964640 1 -- 172.21.15.139:0/2527115848 wait complete. 2024-09-10T05:14:46.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.095+0000 7ff8c0964640 1 Processor -- start 2024-09-10T05:14:46.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.095+0000 7ff8c0964640 1 -- start start 2024-09-10T05:14:46.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.096+0000 7ff8c0964640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc1235f0 0x7ff8bc1c2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.096+0000 7ff8c0964640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc114a80 con 0x7ff8bc1235f0 2024-09-10T05:14:46.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.096+0000 7ff8ba59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc1235f0 0x7ff8bc1c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.096+0000 7ff8ba59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc1235f0 0x7ff8bc1c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34752/0 (socket says 172.21.15.139:34752) 2024-09-10T05:14:46.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.096+0000 7ff8ba59c640 1 -- 172.21.15.139:0/494137465 learned_addr learned my addr 172.21.15.139:0/494137465 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:46.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.096+0000 7ff8ba59c640 1 -- 172.21.15.139:0/494137465 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc118ec0 con 0x7ff8bc1235f0 2024-09-10T05:14:46.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.096+0000 7ff8ba59c640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc1235f0 0x7ff8bc1c2010 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac035040 tx=0x7ff8ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.096+0000 7ff8b37fe640 1 -- 172.21.15.139:0/494137465 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac037040 con 0x7ff8bc1235f0 2024-09-10T05:14:46.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.096+0000 7ff8b37fe640 1 -- 172.21.15.139:0/494137465 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac004030 con 0x7ff8bc1235f0 2024-09-10T05:14:46.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.096+0000 7ff8c0964640 1 -- 172.21.15.139:0/494137465 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8bc118180 con 0x7ff8bc1235f0 2024-09-10T05:14:46.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.096+0000 7ff8b37fe640 1 -- 172.21.15.139:0/494137465 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac004310 con 0x7ff8bc1235f0 2024-09-10T05:14:46.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.096+0000 7ff8c0964640 1 -- 172.21.15.139:0/494137465 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8bc1187f0 con 0x7ff8bc1235f0 2024-09-10T05:14:46.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.097+0000 7ff8c0964640 1 -- 172.21.15.139:0/494137465 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff8bc127670 con 0x7ff8bc1235f0 2024-09-10T05:14:46.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.097+0000 7ff8b37fe640 1 -- 172.21.15.139:0/494137465 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7ff8ac03a040 con 0x7ff8bc1235f0 2024-09-10T05:14:46.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.097+0000 7ff8b37fe640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff89c03de90 0x7ff89c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.097+0000 7ff8b37fe640 1 -- 172.21.15.139:0/494137465 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7ff8ac073510 con 0x7ff8bc1235f0 2024-09-10T05:14:46.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.098+0000 7ff8b37fe640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x7ff89c04a290 0x7ff89c04c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.098+0000 7ff8b37fe640 1 -- 172.21.15.139:0/494137465 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8ac037e50 con 0x7ff89c04a290 2024-09-10T05:14:46.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.098+0000 7ff8b37fe640 1 -- 172.21.15.139:0/494137465 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff8ac07a050 con 0x7ff8bc1235f0 2024-09-10T05:14:46.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.098+0000 7ff8b1d9b640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff89c03de90 0x7ff89c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.098+0000 7ff8bad9d640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x7ff89c04a290 0x7ff89c04c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.098+0000 7ff8b1d9b640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff89c03de90 0x7ff89c040350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4000c00 tx=0x7ff8a40078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.098+0000 7ff8bad9d640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x7ff89c04a290 0x7ff89c04c730 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.099+0000 7ff8b37fe640 1 -- 172.21.15.139:0/494137465 <== osd.1 v2:172.21.15.192:6800/3487349558 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff8ac037e50 con 0x7ff89c04a290 2024-09-10T05:14:46.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.111+0000 7ff8c0964640 1 -- 172.21.15.139:0/494137465 --> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff8bc1119d0 con 0x7ff89c04a290 2024-09-10T05:14:46.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.112+0000 7ff8b37fe640 1 -- 172.21.15.139:0/494137465 <== osd.1 v2:172.21.15.192:6800/3487349558 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff8bc1119d0 con 0x7ff89c04a290 2024-09-10T05:14:46.114 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-10T05:14:46.114 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:14:46.114 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-10T05:14:46.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.112+0000 7ff8c0964640 1 -- 172.21.15.139:0/494137465 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x7ff89c04a290 msgr2=0x7ff89c04c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.112+0000 7ff8c0964640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x7ff89c04a290 0x7ff89c04c730 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.112+0000 7ff8c0964640 1 -- 172.21.15.139:0/494137465 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff89c03de90 msgr2=0x7ff89c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.112+0000 7ff8c0964640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff89c03de90 0x7ff89c040350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4000c00 tx=0x7ff8a40078f0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.112+0000 7ff8c0964640 1 -- 172.21.15.139:0/494137465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc1235f0 msgr2=0x7ff8bc1c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.112+0000 7ff8c0964640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc1235f0 0x7ff8bc1c2010 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac035040 tx=0x7ff8ac0046c0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.113+0000 7ff8c0964640 1 -- 172.21.15.139:0/494137465 shutdown_connections 2024-09-10T05:14:46.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.113+0000 7ff8c0964640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.192:6800/3487349558,v1:172.21.15.192:6803/3487349558] conn(0x7ff89c04a290 0x7ff89c04c730 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.113+0000 7ff8c0964640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7ff89c03de90 0x7ff89c040350 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.113+0000 7ff8c0964640 1 --2- 172.21.15.139:0/494137465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc1235f0 0x7ff8bc1c2010 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.113+0000 7ff8c0964640 1 -- 172.21.15.139:0/494137465 >> 172.21.15.139:0/494137465 conn(0x7ff8bc070210 msgr2=0x7ff8bc1228d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:46.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.113+0000 7ff8c0964640 1 -- 172.21.15.139:0/494137465 shutdown_connections 2024-09-10T05:14:46.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.113+0000 7ff8c0964640 1 -- 172.21.15.139:0/494137465 wait complete. 2024-09-10T05:14:46.125 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T05:14:46.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.220+0000 7f5a786b8640 1 Processor -- start 2024-09-10T05:14:46.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.220+0000 7f5a786b8640 1 -- start start 2024-09-10T05:14:46.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.220+0000 7f5a786b8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5a70071d10 0x7f5a700720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.220+0000 7f5a786b8640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a70073050 con 0x7f5a7009ecd0 2024-09-10T05:14:46.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.220+0000 7f5a786b8640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f5a70073600 con 0x7f5a70071d10 2024-09-10T05:14:46.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.221+0000 7f5a76454640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5a70071d10 0x7f5a700720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.221+0000 7f5a75c53640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f5a7009ecd0 0x7f5a70125760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40934/0 (socket says 172.21.15.139:40934) 2024-09-10T05:14:46.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.221+0000 7f5a75c53640 1 -- 172.21.15.139:0/1518604481 learned_addr learned my addr 172.21.15.139:0/1518604481 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:46.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.221+0000 7f5a76454640 1 -- 172.21.15.139:0/1518604481 >> v1:172.21.15.139:6789/0 conn(0x7f5a7009ecd0 legacy=0x7f5a70125760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.221+0000 7f5a76454640 1 -- 172.21.15.139:0/1518604481 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a700732f0 con 0x7f5a70071d10 2024-09-10T05:14:46.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.221+0000 7f5a75452640 1 -- 172.21.15.139:0/1518604481 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4031497330 0 0) 0x7f5a60001110 con 0x7f5a7009ecd0 2024-09-10T05:14:46.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.222+0000 7f5a76454640 1 --2- 172.21.15.139:0/1518604481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70071d10 0x7f5a700720f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00b9c0 tx=0x7f5a6c02c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5d70fc59d69b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.222+0000 7f5a75452640 1 -- 172.21.15.139:0/1518604481 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a6c031640 con 0x7f5a70071d10 2024-09-10T05:14:46.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.222+0000 7f5a75452640 1 -- 172.21.15.139:0/1518604481 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0317e0 con 0x7f5a70071d10 2024-09-10T05:14:46.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.222+0000 7f5a75452640 1 -- 172.21.15.139:0/1518604481 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a6c031ae0 con 0x7f5a70071d10 2024-09-10T05:14:46.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.222+0000 7f5a786b8640 1 -- 172.21.15.139:0/1518604481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70071d10 msgr2=0x7f5a700720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.222+0000 7f5a786b8640 1 --2- 172.21.15.139:0/1518604481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70071d10 0x7f5a700720f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00b9c0 tx=0x7f5a6c02c7e0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.222+0000 7f5a786b8640 1 -- 172.21.15.139:0/1518604481 shutdown_connections 2024-09-10T05:14:46.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.222+0000 7f5a786b8640 1 --2- 172.21.15.139:0/1518604481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70071d10 0x7f5a700720f0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.222+0000 7f5a786b8640 1 -- 172.21.15.139:0/1518604481 >> 172.21.15.139:0/1518604481 conn(0x7f5a7009c640 msgr2=0x7f5a7006ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:46.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.222+0000 7f5a786b8640 1 -- 172.21.15.139:0/1518604481 shutdown_connections 2024-09-10T05:14:46.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.222+0000 7f5a786b8640 1 -- 172.21.15.139:0/1518604481 wait complete. 2024-09-10T05:14:46.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.223+0000 7f5a786b8640 1 Processor -- start 2024-09-10T05:14:46.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.223+0000 7f5a786b8640 1 -- start start 2024-09-10T05:14:46.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.224+0000 7f5a786b8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70071d10 0x7f5a70116d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.224+0000 7f5a786b8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a700727b0 con 0x7f5a70071d10 2024-09-10T05:14:46.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.224+0000 7f5a76454640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70071d10 0x7f5a70116d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.224+0000 7f5a76454640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70071d10 0x7f5a70116d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34768/0 (socket says 172.21.15.139:34768) 2024-09-10T05:14:46.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.224+0000 7f5a76454640 1 -- 172.21.15.139:0/1758244468 learned_addr learned my addr 172.21.15.139:0/1758244468 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:46.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.224+0000 7f5a76454640 1 -- 172.21.15.139:0/1758244468 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a70119d30 con 0x7f5a70071d10 2024-09-10T05:14:46.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.224+0000 7f5a76454640 1 --2- 172.21.15.139:0/1758244468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70071d10 0x7f5a70116d40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c000c00 tx=0x7f5a6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.224+0000 7f5a66ffd640 1 -- 172.21.15.139:0/1758244468 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a6c033be0 con 0x7f5a70071d10 2024-09-10T05:14:46.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.224+0000 7f5a66ffd640 1 -- 172.21.15.139:0/1758244468 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c033da0 con 0x7f5a70071d10 2024-09-10T05:14:46.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.224+0000 7f5a66ffd640 1 -- 172.21.15.139:0/1758244468 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a6c03e590 con 0x7f5a70071d10 2024-09-10T05:14:46.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.224+0000 7f5a786b8640 1 -- 172.21.15.139:0/1758244468 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a70118c60 con 0x7f5a70071d10 2024-09-10T05:14:46.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.224+0000 7f5a786b8640 1 -- 172.21.15.139:0/1758244468 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a701194b0 con 0x7f5a70071d10 2024-09-10T05:14:46.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.225+0000 7f5a66ffd640 1 -- 172.21.15.139:0/1758244468 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5a6c03b040 con 0x7f5a70071d10 2024-09-10T05:14:46.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.225+0000 7f5a66ffd640 1 --2- 172.21.15.139:0/1758244468 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a5403de90 0x7f5a54040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.225+0000 7f5a786b8640 1 -- 172.21.15.139:0/1758244468 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7006ff30 con 0x7f5a70071d10 2024-09-10T05:14:46.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.225+0000 7f5a66ffd640 1 -- 172.21.15.139:0/1758244468 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5a6c076640 con 0x7f5a70071d10 2024-09-10T05:14:46.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.226+0000 7f5a75c53640 1 --2- 172.21.15.139:0/1758244468 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a5403de90 0x7f5a54040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.226+0000 7f5a75c53640 1 --2- 172.21.15.139:0/1758244468 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a5403de90 0x7f5a54040350 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5a60000c00 tx=0x7f5a60001250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.230+0000 7f5a66ffd640 1 -- 172.21.15.139:0/1758244468 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f5a7006ff30 con 0x7f5a70071d10 2024-09-10T05:14:46.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.407+0000 7f5a786b8640 1 -- 172.21.15.139:0/1758244468 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f5a701267a0 con 0x7f5a5403de90 2024-09-10T05:14:46.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.409+0000 7f5a66ffd640 1 -- 172.21.15.139:0/1758244468 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5a701267a0 con 0x7f5a5403de90 2024-09-10T05:14:46.410 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T05:14:46.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.411+0000 7f5a786b8640 1 -- 172.21.15.139:0/1758244468 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a5403de90 msgr2=0x7f5a54040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.411+0000 7f5a786b8640 1 --2- 172.21.15.139:0/1758244468 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a5403de90 0x7f5a54040350 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5a60000c00 tx=0x7f5a60001250 comp rx=0 tx=0).stop 2024-09-10T05:14:46.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.411+0000 7f5a786b8640 1 -- 172.21.15.139:0/1758244468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70071d10 msgr2=0x7f5a70116d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.411+0000 7f5a786b8640 1 --2- 172.21.15.139:0/1758244468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70071d10 0x7f5a70116d40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c000c00 tx=0x7f5a6c0046c0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.411+0000 7f5a786b8640 1 -- 172.21.15.139:0/1758244468 shutdown_connections 2024-09-10T05:14:46.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.411+0000 7f5a786b8640 1 --2- 172.21.15.139:0/1758244468 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f5a5403de90 0x7f5a54040350 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.411+0000 7f5a786b8640 1 --2- 172.21.15.139:0/1758244468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70071d10 0x7f5a70116d40 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.411+0000 7f5a786b8640 1 -- 172.21.15.139:0/1758244468 >> 172.21.15.139:0/1758244468 conn(0x7f5a7009c640 msgr2=0x7f5a701279a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:46.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.411+0000 7f5a786b8640 1 -- 172.21.15.139:0/1758244468 shutdown_connections 2024-09-10T05:14:46.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.411+0000 7f5a786b8640 1 -- 172.21.15.139:0/1758244468 wait complete. 2024-09-10T05:14:46.423 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T05:14:46.424 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:14:46.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.524+0000 7f20a6286640 1 Processor -- start 2024-09-10T05:14:46.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.524+0000 7f20a6286640 1 -- start start 2024-09-10T05:14:46.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.525+0000 7f20a6286640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f20a012d370 0x7f20a012d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.525+0000 7f20a6286640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a00733d0 con 0x7f20a01141c0 2024-09-10T05:14:46.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.525+0000 7f20a6286640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f20a012cfb0 con 0x7f20a012d370 2024-09-10T05:14:46.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.525+0000 7f209ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f20a012d370 0x7f20a012d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.525+0000 7f209f7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f20a01141c0 0x7f20a0110d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40944/0 (socket says 172.21.15.139:40944) 2024-09-10T05:14:46.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.525+0000 7f209f7fe640 1 -- 172.21.15.139:0/1418649967 learned_addr learned my addr 172.21.15.139:0/1418649967 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:46.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.525+0000 7f209ffff640 1 -- 172.21.15.139:0/1418649967 >> v1:172.21.15.139:6789/0 conn(0x7f20a01141c0 legacy=0x7f20a0110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.525+0000 7f209ffff640 1 -- 172.21.15.139:0/1418649967 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a00737e0 con 0x7f20a012d370 2024-09-10T05:14:46.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.525+0000 7f209effd640 1 -- 172.21.15.139:0/1418649967 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213735426 0 0) 0x7f20a00733d0 con 0x7f20a01141c0 2024-09-10T05:14:46.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.526+0000 7f209ffff640 1 --2- 172.21.15.139:0/1418649967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a012d370 0x7f20a012d750 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2090009720 tx=0x7f209002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33c815d05b3650c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.526+0000 7f209effd640 1 -- 172.21.15.139:0/1418649967 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2090037070 con 0x7f20a012d370 2024-09-10T05:14:46.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.526+0000 7f209effd640 1 -- 172.21.15.139:0/1418649967 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209002ad90 con 0x7f20a012d370 2024-09-10T05:14:46.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.526+0000 7f209effd640 1 -- 172.21.15.139:0/1418649967 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2090032590 con 0x7f20a012d370 2024-09-10T05:14:46.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.526+0000 7f20a6286640 1 -- 172.21.15.139:0/1418649967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a012d370 msgr2=0x7f20a012d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.526+0000 7f20a6286640 1 --2- 172.21.15.139:0/1418649967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a012d370 0x7f20a012d750 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2090009720 tx=0x7f209002a110 comp rx=0 tx=0).stop 2024-09-10T05:14:46.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.526+0000 7f20a6286640 1 -- 172.21.15.139:0/1418649967 shutdown_connections 2024-09-10T05:14:46.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.526+0000 7f20a6286640 1 --2- 172.21.15.139:0/1418649967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a012d370 0x7f20a012d750 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.526+0000 7f20a6286640 1 -- 172.21.15.139:0/1418649967 >> 172.21.15.139:0/1418649967 conn(0x7f20a0070210 msgr2=0x7f20a0072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:46.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.526+0000 7f20a6286640 1 -- 172.21.15.139:0/1418649967 shutdown_connections 2024-09-10T05:14:46.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.526+0000 7f20a6286640 1 -- 172.21.15.139:0/1418649967 wait complete. 2024-09-10T05:14:46.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.527+0000 7f20a6286640 1 Processor -- start 2024-09-10T05:14:46.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.527+0000 7f20a6286640 1 -- start start 2024-09-10T05:14:46.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.528+0000 7f20a6286640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a01141c0 0x7f20a01c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.528+0000 7f20a6286640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f20a012de10 con 0x7f20a01141c0 2024-09-10T05:14:46.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.528+0000 7f209ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a01141c0 0x7f20a01c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.528+0000 7f209ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a01141c0 0x7f20a01c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34792/0 (socket says 172.21.15.139:34792) 2024-09-10T05:14:46.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.528+0000 7f209ffff640 1 -- 172.21.15.139:0/1232954271 learned_addr learned my addr 172.21.15.139:0/1232954271 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:46.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.528+0000 7f209ffff640 1 -- 172.21.15.139:0/1232954271 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a0127700 con 0x7f20a01141c0 2024-09-10T05:14:46.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.528+0000 7f209ffff640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a01141c0 0x7f20a01c4020 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2090000c00 tx=0x7f20900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.528+0000 7f209cff9640 1 -- 172.21.15.139:0/1232954271 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2090041070 con 0x7f20a01141c0 2024-09-10T05:14:46.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.528+0000 7f209cff9640 1 -- 172.21.15.139:0/1232954271 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209003c590 con 0x7f20a01141c0 2024-09-10T05:14:46.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.528+0000 7f20a6286640 1 -- 172.21.15.139:0/1232954271 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a0113870 con 0x7f20a01141c0 2024-09-10T05:14:46.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.528+0000 7f209cff9640 1 -- 172.21.15.139:0/1232954271 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2090037040 con 0x7f20a01141c0 2024-09-10T05:14:46.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.528+0000 7f20a6286640 1 -- 172.21.15.139:0/1232954271 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a01c4560 con 0x7f20a01141c0 2024-09-10T05:14:46.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.529+0000 7f20a6286640 1 -- 172.21.15.139:0/1232954271 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f20a011c7b0 con 0x7f20a01141c0 2024-09-10T05:14:46.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.529+0000 7f209cff9640 1 -- 172.21.15.139:0/1232954271 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f2090044070 con 0x7f20a01141c0 2024-09-10T05:14:46.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.529+0000 7f209cff9640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f208c03de90 0x7f208c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.530+0000 7f209cff9640 1 -- 172.21.15.139:0/1232954271 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f20900735d0 con 0x7f20a01141c0 2024-09-10T05:14:46.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.530+0000 7f209cff9640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f208c04a2f0 0x7f208c04c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.530+0000 7f209cff9640 1 -- 172.21.15.139:0/1232954271 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f209002ad90 con 0x7f208c04a2f0 2024-09-10T05:14:46.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.530+0000 7f209cff9640 1 -- 172.21.15.139:0/1232954271 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f209007a050 con 0x7f20a01141c0 2024-09-10T05:14:46.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.530+0000 7f209f7fe640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f208c03de90 0x7f208c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.530+0000 7f20a4823640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f208c04a2f0 0x7f208c04c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.530+0000 7f20a4823640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f208c04a2f0 0x7f208c04c790 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.530+0000 7f209f7fe640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f208c03de90 0x7f208c040350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2094000c00 tx=0x7f20940078d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.531+0000 7f209cff9640 1 -- 172.21.15.139:0/1232954271 <== osd.2 v2:172.21.15.192:6801/2435677948 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f209002ad90 con 0x7f208c04a2f0 2024-09-10T05:14:46.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.543+0000 7f20a6286640 1 -- 172.21.15.139:0/1232954271 --> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f20a01118e0 con 0x7f208c04a2f0 2024-09-10T05:14:46.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f209cff9640 1 -- 172.21.15.139:0/1232954271 <== osd.2 v2:172.21.15.192:6801/2435677948 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f20a01118e0 con 0x7f208c04a2f0 2024-09-10T05:14:46.546 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-10T05:14:46.546 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:14:46.546 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-10T05:14:46.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 -- 172.21.15.139:0/1232954271 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f208c04a2f0 msgr2=0x7f208c04c790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f208c04a2f0 0x7f208c04c790 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 -- 172.21.15.139:0/1232954271 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f208c03de90 msgr2=0x7f208c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f208c03de90 0x7f208c040350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2094000c00 tx=0x7f20940078d0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 -- 172.21.15.139:0/1232954271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a01141c0 msgr2=0x7f20a01c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a01141c0 0x7f20a01c4020 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2090000c00 tx=0x7f20900046c0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 -- 172.21.15.139:0/1232954271 shutdown_connections 2024-09-10T05:14:46.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.192:6801/2435677948,v1:172.21.15.192:6802/2435677948] conn(0x7f208c04a2f0 0x7f208c04c790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f208c03de90 0x7f208c040350 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 --2- 172.21.15.139:0/1232954271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20a01141c0 0x7f20a01c4020 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 -- 172.21.15.139:0/1232954271 >> 172.21.15.139:0/1232954271 conn(0x7f20a0070210 msgr2=0x7f20a012c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:46.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 -- 172.21.15.139:0/1232954271 shutdown_connections 2024-09-10T05:14:46.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.544+0000 7f20a6286640 1 -- 172.21.15.139:0/1232954271 wait complete. 2024-09-10T05:14:46.557 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T05:14:46.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.652+0000 7fa160d44640 1 Processor -- start 2024-09-10T05:14:46.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.652+0000 7fa160d44640 1 -- start start 2024-09-10T05:14:46.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.653+0000 7fa160d44640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa15c071d10 0x7fa15c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.653+0000 7fa160d44640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15c073050 con 0x7fa15c09ecd0 2024-09-10T05:14:46.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.653+0000 7fa160d44640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fa15c073600 con 0x7fa15c071d10 2024-09-10T05:14:46.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.653+0000 7fa159d9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa15c09ecd0 0x7fa15c125760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40956/0 (socket says 172.21.15.139:40956) 2024-09-10T05:14:46.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.653+0000 7fa15a59c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa15c071d10 0x7fa15c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.653+0000 7fa159d9b640 1 -- 172.21.15.139:0/2292543716 learned_addr learned my addr 172.21.15.139:0/2292543716 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:46.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.653+0000 7fa15a59c640 1 -- 172.21.15.139:0/2292543716 >> v1:172.21.15.139:6789/0 conn(0x7fa15c09ecd0 legacy=0x7fa15c125760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.653+0000 7fa15959a640 1 -- 172.21.15.139:0/2292543716 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 553066441 0 0) 0x7fa150001110 con 0x7fa15c09ecd0 2024-09-10T05:14:46.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.653+0000 7fa15a59c640 1 -- 172.21.15.139:0/2292543716 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c0732f0 con 0x7fa15c071d10 2024-09-10T05:14:46.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.654+0000 7fa15a59c640 1 --2- 172.21.15.139:0/2292543716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa15c071d10 0x7fa15c0720f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009720 tx=0x7fa14c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1fb1182ecd014 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.654+0000 7fa15959a640 1 -- 172.21.15.139:0/2292543716 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa14c037070 con 0x7fa15c071d10 2024-09-10T05:14:46.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.654+0000 7fa15959a640 1 -- 172.21.15.139:0/2292543716 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa14c02ad90 con 0x7fa15c071d10 2024-09-10T05:14:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.654+0000 7fa15959a640 1 -- 172.21.15.139:0/2292543716 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa14c032590 con 0x7fa15c071d10 2024-09-10T05:14:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.654+0000 7fa160d44640 1 -- 172.21.15.139:0/2292543716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa15c071d10 msgr2=0x7fa15c0720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.654+0000 7fa160d44640 1 --2- 172.21.15.139:0/2292543716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa15c071d10 0x7fa15c0720f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009720 tx=0x7fa14c02a110 comp rx=0 tx=0).stop 2024-09-10T05:14:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.655+0000 7fa160d44640 1 -- 172.21.15.139:0/2292543716 shutdown_connections 2024-09-10T05:14:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.655+0000 7fa160d44640 1 --2- 172.21.15.139:0/2292543716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa15c071d10 0x7fa15c0720f0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.655+0000 7fa160d44640 1 -- 172.21.15.139:0/2292543716 >> 172.21.15.139:0/2292543716 conn(0x7fa15c09c640 msgr2=0x7fa15c06ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.655+0000 7fa160d44640 1 -- 172.21.15.139:0/2292543716 shutdown_connections 2024-09-10T05:14:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.655+0000 7fa160d44640 1 -- 172.21.15.139:0/2292543716 wait complete. 2024-09-10T05:14:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.655+0000 7fa160d44640 1 Processor -- start 2024-09-10T05:14:46.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.656+0000 7fa160d44640 1 -- start start 2024-09-10T05:14:46.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.656+0000 7fa160d44640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa15c071d10 0x7fa15c1168a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.656+0000 7fa160d44640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c0727b0 con 0x7fa15c071d10 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.656+0000 7fa15a59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa15c071d10 0x7fa15c1168a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.656+0000 7fa15a59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa15c071d10 0x7fa15c1168a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34808/0 (socket says 172.21.15.139:34808) 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.656+0000 7fa15a59c640 1 -- 172.21.15.139:0/3952011840 learned_addr learned my addr 172.21.15.139:0/3952011840 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.656+0000 7fa15a59c640 1 -- 172.21.15.139:0/3952011840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c11ce90 con 0x7fa15c071d10 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.656+0000 7fa15a59c640 1 --2- 172.21.15.139:0/3952011840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa15c071d10 0x7fa15c1168a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009720 tx=0x7fa14c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.657+0000 7fa14affd640 1 -- 172.21.15.139:0/3952011840 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa14c041070 con 0x7fa15c071d10 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.657+0000 7fa14affd640 1 -- 172.21.15.139:0/3952011840 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa14c03c460 con 0x7fa15c071d10 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.657+0000 7fa160d44640 1 -- 172.21.15.139:0/3952011840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15c117de0 con 0x7fa15c071d10 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.657+0000 7fa14affd640 1 -- 172.21.15.139:0/3952011840 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa14c037040 con 0x7fa15c071d10 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.657+0000 7fa160d44640 1 -- 172.21.15.139:0/3952011840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa15c11d240 con 0x7fa15c071d10 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.657+0000 7fa14affd640 1 -- 172.21.15.139:0/3952011840 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa14c044070 con 0x7fa15c071d10 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.657+0000 7fa160d44640 1 -- 172.21.15.139:0/3952011840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15c11d060 con 0x7fa15c071d10 2024-09-10T05:14:46.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.658+0000 7fa14affd640 1 --2- 172.21.15.139:0/3952011840 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa13c03dec0 0x7fa13c040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.658+0000 7fa14affd640 1 -- 172.21.15.139:0/3952011840 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fa14c073620 con 0x7fa15c071d10 2024-09-10T05:14:46.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.658+0000 7fa159d9b640 1 --2- 172.21.15.139:0/3952011840 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa13c03dec0 0x7fa13c040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.658+0000 7fa159d9b640 1 --2- 172.21.15.139:0/3952011840 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa13c03dec0 0x7fa13c040380 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa150000c00 tx=0x7fa150001250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.663+0000 7fa14affd640 1 -- 172.21.15.139:0/3952011840 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fa15c11d060 con 0x7fa15c071d10 2024-09-10T05:14:46.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.835+0000 7fa160d44640 1 -- 172.21.15.139:0/3952011840 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa15c0720f0 con 0x7fa13c03dec0 2024-09-10T05:14:46.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.837+0000 7fa14affd640 1 -- 172.21.15.139:0/3952011840 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa15c0720f0 con 0x7fa13c03dec0 2024-09-10T05:14:46.838 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T05:14:46.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.838+0000 7fa160d44640 1 -- 172.21.15.139:0/3952011840 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa13c03dec0 msgr2=0x7fa13c040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.838+0000 7fa160d44640 1 --2- 172.21.15.139:0/3952011840 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa13c03dec0 0x7fa13c040380 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa150000c00 tx=0x7fa150001250 comp rx=0 tx=0).stop 2024-09-10T05:14:46.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.838+0000 7fa160d44640 1 -- 172.21.15.139:0/3952011840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa15c071d10 msgr2=0x7fa15c1168a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.838+0000 7fa160d44640 1 --2- 172.21.15.139:0/3952011840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa15c071d10 0x7fa15c1168a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009720 tx=0x7fa14c0046c0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.838+0000 7fa160d44640 1 -- 172.21.15.139:0/3952011840 shutdown_connections 2024-09-10T05:14:46.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.838+0000 7fa160d44640 1 --2- 172.21.15.139:0/3952011840 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa13c03dec0 0x7fa13c040380 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.838+0000 7fa160d44640 1 --2- 172.21.15.139:0/3952011840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa15c071d10 0x7fa15c1168a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.838+0000 7fa160d44640 1 -- 172.21.15.139:0/3952011840 >> 172.21.15.139:0/3952011840 conn(0x7fa15c09c640 msgr2=0x7fa15c126980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:46.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.838+0000 7fa160d44640 1 -- 172.21.15.139:0/3952011840 shutdown_connections 2024-09-10T05:14:46.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.838+0000 7fa160d44640 1 -- 172.21.15.139:0/3952011840 wait complete. 2024-09-10T05:14:46.850 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T05:14:46.850 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:14:46.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.951+0000 7f7cb6ac6640 1 Processor -- start 2024-09-10T05:14:46.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.951+0000 7f7cb6ac6640 1 -- start start 2024-09-10T05:14:46.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.951+0000 7f7cb6ac6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7cb012b670 0x7f7cb012ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.951+0000 7f7cb6ac6640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb0113000 con 0x7f7cb012bf90 2024-09-10T05:14:46.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.951+0000 7f7cb6ac6640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f7cb0112820 con 0x7f7cb012b670 2024-09-10T05:14:46.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.951+0000 7f7cb4862640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7cb012b670 0x7f7cb012ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.951+0000 7f7caffff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f7cb012bf90 0x7f7cb01280f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40968/0 (socket says 172.21.15.139:40968) 2024-09-10T05:14:46.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.951+0000 7f7caffff640 1 -- 172.21.15.139:0/1399993278 learned_addr learned my addr 172.21.15.139:0/1399993278 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:46.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.952+0000 7f7cb4862640 1 -- 172.21.15.139:0/1399993278 >> v1:172.21.15.139:6789/0 conn(0x7f7cb012bf90 legacy=0x7f7cb01280f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.952+0000 7f7caf7fe640 1 -- 172.21.15.139:0/1399993278 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3880643945 0 0) 0x7f7cb0113000 con 0x7f7cb012bf90 2024-09-10T05:14:46.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.952+0000 7f7cb4862640 1 -- 172.21.15.139:0/1399993278 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb006dbb0 con 0x7f7cb012b670 2024-09-10T05:14:46.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.952+0000 7f7cb4862640 1 --2- 172.21.15.139:0/1399993278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb012b670 0x7f7cb012ba50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800a8c0 tx=0x7f7ca802b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c965d5b553cec464 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.952+0000 7f7caf7fe640 1 -- 172.21.15.139:0/1399993278 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca800b040 con 0x7f7cb012b670 2024-09-10T05:14:46.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.953+0000 7f7caf7fe640 1 -- 172.21.15.139:0/1399993278 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca8030640 con 0x7f7cb012b670 2024-09-10T05:14:46.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.953+0000 7f7caf7fe640 1 -- 172.21.15.139:0/1399993278 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca8030940 con 0x7f7cb012b670 2024-09-10T05:14:46.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.953+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/1399993278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb012b670 msgr2=0x7f7cb012ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.953+0000 7f7cb6ac6640 1 --2- 172.21.15.139:0/1399993278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb012b670 0x7f7cb012ba50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800a8c0 tx=0x7f7ca802b4d0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.953+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/1399993278 shutdown_connections 2024-09-10T05:14:46.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.953+0000 7f7cb6ac6640 1 --2- 172.21.15.139:0/1399993278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb012b670 0x7f7cb012ba50 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.953+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/1399993278 >> 172.21.15.139:0/1399993278 conn(0x7f7cb0070210 msgr2=0x7f7cb0072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:46.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.953+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/1399993278 shutdown_connections 2024-09-10T05:14:46.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.953+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/1399993278 wait complete. 2024-09-10T05:14:46.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.954+0000 7f7cb6ac6640 1 Processor -- start 2024-09-10T05:14:46.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.954+0000 7f7cb6ac6640 1 -- start start 2024-09-10T05:14:46.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.954+0000 7f7cb6ac6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb012b670 0x7f7cb0115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.954+0000 7f7cb6ac6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb00732e0 con 0x7f7cb012b670 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.954+0000 7f7cb4862640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb012b670 0x7f7cb0115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.955+0000 7f7cb4862640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb012b670 0x7f7cb0115d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34830/0 (socket says 172.21.15.139:34830) 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.955+0000 7f7cb4862640 1 -- 172.21.15.139:0/2255142488 learned_addr learned my addr 172.21.15.139:0/2255142488 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.955+0000 7f7cb4862640 1 -- 172.21.15.139:0/2255142488 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb0118f10 con 0x7f7cb012b670 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.955+0000 7f7cb4862640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb012b670 0x7f7cb0115d70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7ca802ba90 tx=0x7f7ca8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.955+0000 7f7cad7fa640 1 -- 172.21.15.139:0/2255142488 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca8040070 con 0x7f7cb012b670 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.955+0000 7f7cad7fa640 1 -- 172.21.15.139:0/2255142488 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca80339f0 con 0x7f7cb012b670 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.955+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/2255142488 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb0117670 con 0x7f7cb012b670 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.955+0000 7f7cad7fa640 1 -- 172.21.15.139:0/2255142488 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca8033cd0 con 0x7f7cb012b670 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.955+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/2255142488 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb01189f0 con 0x7f7cb012b670 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.956+0000 7f7cad7fa640 1 -- 172.21.15.139:0/2255142488 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7ca8043070 con 0x7f7cb012b670 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.956+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/2255142488 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7cb0125dc0 con 0x7f7cb012b670 2024-09-10T05:14:46.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.956+0000 7f7cad7fa640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7c9003de90 0x7f7c90040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.956+0000 7f7cad7fa640 1 -- 172.21.15.139:0/2255142488 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f7ca8073d50 con 0x7f7cb012b670 2024-09-10T05:14:46.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.956+0000 7f7cad7fa640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x7f7c9004a2f0 0x7f7c9004c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:46.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.956+0000 7f7cad7fa640 1 -- 172.21.15.139:0/2255142488 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ca8040e70 con 0x7f7c9004a2f0 2024-09-10T05:14:46.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.956+0000 7f7cad7fa640 1 -- 172.21.15.139:0/2255142488 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f7ca8076400 con 0x7f7cb012b670 2024-09-10T05:14:46.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.956+0000 7f7caffff640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7c9003de90 0x7f7c90040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.957+0000 7f7cb5063640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x7f7c9004a2f0 0x7f7c9004c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:46.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.957+0000 7f7caffff640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7c9003de90 0x7f7c90040350 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000f80 tx=0x7f7ca0001670 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.957+0000 7f7cb5063640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x7f7c9004a2f0 0x7f7c9004c790 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:46.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.958+0000 7f7cad7fa640 1 -- 172.21.15.139:0/2255142488 <== osd.3 v2:172.21.15.192:6816/1620624472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ca8040e70 con 0x7f7c9004a2f0 2024-09-10T05:14:46.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.970+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/2255142488 --> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7cb012ba50 con 0x7f7c9004a2f0 2024-09-10T05:14:46.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cad7fa640 1 -- 172.21.15.139:0/2255142488 <== osd.3 v2:172.21.15.192:6816/1620624472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7cb012ba50 con 0x7f7c9004a2f0 2024-09-10T05:14:46.973 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-10T05:14:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:14:46.973 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-10T05:14:46.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/2255142488 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x7f7c9004a2f0 msgr2=0x7f7c9004c790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x7f7c9004a2f0 0x7f7c9004c790 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/2255142488 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7c9003de90 msgr2=0x7f7c90040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7c9003de90 0x7f7c90040350 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000f80 tx=0x7f7ca0001670 comp rx=0 tx=0).stop 2024-09-10T05:14:46.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/2255142488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb012b670 msgr2=0x7f7cb0115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:46.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb012b670 0x7f7cb0115d70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7ca802ba90 tx=0x7f7ca8004730 comp rx=0 tx=0).stop 2024-09-10T05:14:46.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/2255142488 shutdown_connections 2024-09-10T05:14:46.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7c9003de90 0x7f7c90040350 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.192:6816/1620624472,v1:172.21.15.192:6817/1620624472] conn(0x7f7c9004a2f0 0x7f7c9004c790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 --2- 172.21.15.139:0/2255142488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb012b670 0x7f7cb0115d70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:46.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/2255142488 >> 172.21.15.139:0/2255142488 conn(0x7f7cb0070210 msgr2=0x7f7cb0129450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:46.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/2255142488 shutdown_connections 2024-09-10T05:14:46.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:46.971+0000 7f7cb6ac6640 1 -- 172.21.15.139:0/2255142488 wait complete. 2024-09-10T05:14:46.983 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T05:14:47.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.080+0000 7f7d5e5bb640 1 Processor -- start 2024-09-10T05:14:47.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.080+0000 7f7d5e5bb640 1 -- start start 2024-09-10T05:14:47.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.080+0000 7f7d5e5bb640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7d58070370 0x7f7d58070750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:47.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.080+0000 7f7d5e5bb640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d58071de0 con 0x7f7d5809ec40 2024-09-10T05:14:47.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.080+0000 7f7d5e5bb640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f7d5806dc30 con 0x7f7d58070370 2024-09-10T05:14:47.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.081+0000 7f7d57fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7d58070370 0x7f7d58070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:47.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.081+0000 7f7d577fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f7d5809ec40 0x7f7d58126960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40978/0 (socket says 172.21.15.139:40978) 2024-09-10T05:14:47.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.081+0000 7f7d577fe640 1 -- 172.21.15.139:0/755589595 learned_addr learned my addr 172.21.15.139:0/755589595 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:47.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.081+0000 7f7d57fff640 1 -- 172.21.15.139:0/755589595 >> v1:172.21.15.139:6789/0 conn(0x7f7d5809ec40 legacy=0x7f7d58126960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:47.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.081+0000 7f7d56ffd640 1 -- 172.21.15.139:0/755589595 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4155016417 0 0) 0x7f7d58071de0 con 0x7f7d5809ec40 2024-09-10T05:14:47.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.081+0000 7f7d57fff640 1 -- 172.21.15.139:0/755589595 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d580721e0 con 0x7f7d58070370 2024-09-10T05:14:47.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.081+0000 7f7d57fff640 1 --2- 172.21.15.139:0/755589595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d58070370 0x7f7d58070750 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009720 tx=0x7f7d4802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58918d8615b639b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:47.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.082+0000 7f7d56ffd640 1 -- 172.21.15.139:0/755589595 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d48037070 con 0x7f7d58070370 2024-09-10T05:14:47.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.082+0000 7f7d56ffd640 1 -- 172.21.15.139:0/755589595 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4802ae20 con 0x7f7d58070370 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.082+0000 7f7d56ffd640 1 -- 172.21.15.139:0/755589595 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d48032590 con 0x7f7d58070370 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.082+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/755589595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d58070370 msgr2=0x7f7d58070750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.082+0000 7f7d5e5bb640 1 --2- 172.21.15.139:0/755589595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d58070370 0x7f7d58070750 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009720 tx=0x7f7d4802a1a0 comp rx=0 tx=0).stop 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.082+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/755589595 shutdown_connections 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.082+0000 7f7d5e5bb640 1 --2- 172.21.15.139:0/755589595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d58070370 0x7f7d58070750 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.082+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/755589595 >> 172.21.15.139:0/755589595 conn(0x7f7d5809c640 msgr2=0x7f7d5806ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.082+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/755589595 shutdown_connections 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.082+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/755589595 wait complete. 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.083+0000 7f7d5e5bb640 1 Processor -- start 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.083+0000 7f7d5e5bb640 1 -- start start 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.083+0000 7f7d5e5bb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d58070370 0x7f7d58126320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.084+0000 7f7d5e5bb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58071020 con 0x7f7d58070370 2024-09-10T05:14:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.084+0000 7f7d57fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d58070370 0x7f7d58126320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:47.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.084+0000 7f7d57fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d58070370 0x7f7d58126320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34852/0 (socket says 172.21.15.139:34852) 2024-09-10T05:14:47.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.084+0000 7f7d57fff640 1 -- 172.21.15.139:0/1715227747 learned_addr learned my addr 172.21.15.139:0/1715227747 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:47.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.084+0000 7f7d57fff640 1 -- 172.21.15.139:0/1715227747 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5811e820 con 0x7f7d58070370 2024-09-10T05:14:47.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.084+0000 7f7d57fff640 1 --2- 172.21.15.139:0/1715227747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d58070370 0x7f7d58126320 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7d4802adf0 tx=0x7f7d480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:47.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.084+0000 7f7d54ff9640 1 -- 172.21.15.139:0/1715227747 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d48042070 con 0x7f7d58070370 2024-09-10T05:14:47.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.084+0000 7f7d54ff9640 1 -- 172.21.15.139:0/1715227747 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4803e590 con 0x7f7d58070370 2024-09-10T05:14:47.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.084+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/1715227747 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d58114680 con 0x7f7d58070370 2024-09-10T05:14:47.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.084+0000 7f7d54ff9640 1 -- 172.21.15.139:0/1715227747 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d48037040 con 0x7f7d58070370 2024-09-10T05:14:47.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.084+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/1715227747 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d58114b50 con 0x7f7d58070370 2024-09-10T05:14:47.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.085+0000 7f7d54ff9640 1 -- 172.21.15.139:0/1715227747 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f7d48045070 con 0x7f7d58070370 2024-09-10T05:14:47.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.085+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/1715227747 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d58116020 con 0x7f7d58070370 2024-09-10T05:14:47.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.085+0000 7f7d54ff9640 1 --2- 172.21.15.139:0/1715227747 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7d4403de90 0x7f7d44040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:47.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.085+0000 7f7d54ff9640 1 -- 172.21.15.139:0/1715227747 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f7d480735a0 con 0x7f7d58070370 2024-09-10T05:14:47.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.085+0000 7f7d577fe640 1 --2- 172.21.15.139:0/1715227747 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7d4403de90 0x7f7d44040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:47.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.086+0000 7f7d577fe640 1 --2- 172.21.15.139:0/1715227747 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7d4403de90 0x7f7d44040350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c000c00 tx=0x7f7d4c0078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:47.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.090+0000 7f7d54ff9640 1 -- 172.21.15.139:0/1715227747 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f7d4803e890 con 0x7f7d58070370 2024-09-10T05:14:47.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.263+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/1715227747 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f7d58127970 con 0x7f7d4403de90 2024-09-10T05:14:47.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.265+0000 7f7d54ff9640 1 -- 172.21.15.139:0/1715227747 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7d4c0058d0 con 0x7f7d4403de90 2024-09-10T05:14:47.266 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T05:14:47.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.266+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/1715227747 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7d4403de90 msgr2=0x7f7d44040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:47.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.266+0000 7f7d5e5bb640 1 --2- 172.21.15.139:0/1715227747 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7d4403de90 0x7f7d44040350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c000c00 tx=0x7f7d4c0078f0 comp rx=0 tx=0).stop 2024-09-10T05:14:47.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.266+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/1715227747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d58070370 msgr2=0x7f7d58126320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:47.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.266+0000 7f7d5e5bb640 1 --2- 172.21.15.139:0/1715227747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d58070370 0x7f7d58126320 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7d4802adf0 tx=0x7f7d480046c0 comp rx=0 tx=0).stop 2024-09-10T05:14:47.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.266+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/1715227747 shutdown_connections 2024-09-10T05:14:47.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.266+0000 7f7d5e5bb640 1 --2- 172.21.15.139:0/1715227747 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f7d4403de90 0x7f7d44040350 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:47.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.266+0000 7f7d5e5bb640 1 --2- 172.21.15.139:0/1715227747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d58070370 0x7f7d58126320 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:47.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.266+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/1715227747 >> 172.21.15.139:0/1715227747 conn(0x7f7d5809c640 msgr2=0x7f7d5809d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:47.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.266+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/1715227747 shutdown_connections 2024-09-10T05:14:47.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.266+0000 7f7d5e5bb640 1 -- 172.21.15.139:0/1715227747 wait complete. 2024-09-10T05:14:47.278 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:14:47.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.374+0000 7fc065198640 1 Processor -- start 2024-09-10T05:14:47.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.374+0000 7fc065198640 1 -- start start 2024-09-10T05:14:47.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.374+0000 7fc065198640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc060130270 0x7fc060132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:47.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.374+0000 7fc065198640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc06006dc00 con 0x7fc060129d80 2024-09-10T05:14:47.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.374+0000 7fc065198640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fc0601299c0 con 0x7fc060130270 2024-09-10T05:14:47.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.374+0000 7fc05e59c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc060130270 0x7fc060132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:47.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.374+0000 7fc05ed9d640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc060129d80 0x7fc06012a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40988/0 (socket says 172.21.15.139:40988) 2024-09-10T05:14:47.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.374+0000 7fc05ed9d640 1 -- 172.21.15.139:0/1674487774 learned_addr learned my addr 172.21.15.139:0/1674487774 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:14:47.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.374+0000 7fc05e59c640 1 -- 172.21.15.139:0/1674487774 >> v1:172.21.15.139:6789/0 conn(0x7fc060129d80 legacy=0x7fc06012a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:47.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.374+0000 7fc05dd9b640 1 -- 172.21.15.139:0/1674487774 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659052972 0 0) 0x7fc06006dc00 con 0x7fc060129d80 2024-09-10T05:14:47.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.375+0000 7fc05e59c640 1 -- 172.21.15.139:0/1674487774 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06012a870 con 0x7fc060130270 2024-09-10T05:14:47.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.375+0000 7fc05e59c640 1 --2- 172.21.15.139:0/1674487774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc060130270 0x7fc060132660 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc048009720 tx=0x7fc04802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e5a875d19985b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:47.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.375+0000 7fc05dd9b640 1 -- 172.21.15.139:0/1674487774 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc048037070 con 0x7fc060130270 2024-09-10T05:14:47.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.375+0000 7fc05dd9b640 1 -- 172.21.15.139:0/1674487774 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc04802ad90 con 0x7fc060130270 2024-09-10T05:14:47.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.375+0000 7fc05dd9b640 1 -- 172.21.15.139:0/1674487774 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc048032590 con 0x7fc060130270 2024-09-10T05:14:47.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.376+0000 7fc065198640 1 -- 172.21.15.139:0/1674487774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc060130270 msgr2=0x7fc060132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:47.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.376+0000 7fc065198640 1 --2- 172.21.15.139:0/1674487774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc060130270 0x7fc060132660 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc048009720 tx=0x7fc04802a110 comp rx=0 tx=0).stop 2024-09-10T05:14:47.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.376+0000 7fc065198640 1 -- 172.21.15.139:0/1674487774 shutdown_connections 2024-09-10T05:14:47.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.376+0000 7fc065198640 1 --2- 172.21.15.139:0/1674487774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc060130270 0x7fc060132660 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:47.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.376+0000 7fc065198640 1 -- 172.21.15.139:0/1674487774 >> 172.21.15.139:0/1674487774 conn(0x7fc060070850 msgr2=0x7fc060072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:47.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.376+0000 7fc065198640 1 -- 172.21.15.139:0/1674487774 shutdown_connections 2024-09-10T05:14:47.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.376+0000 7fc065198640 1 -- 172.21.15.139:0/1674487774 wait complete. 2024-09-10T05:14:47.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.377+0000 7fc065198640 1 Processor -- start 2024-09-10T05:14:47.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.377+0000 7fc065198640 1 -- start start 2024-09-10T05:14:47.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.377+0000 7fc065198640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc060129d80 0x7fc060115030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:47.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.377+0000 7fc065198640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc060073a10 con 0x7fc060129d80 2024-09-10T05:14:47.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.377+0000 7fc05ed9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc060129d80 0x7fc060115030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:47.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.377+0000 7fc05ed9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc060129d80 0x7fc060115030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34882/0 (socket says 172.21.15.139:34882) 2024-09-10T05:14:47.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.377+0000 7fc05ed9d640 1 -- 172.21.15.139:0/792203042 learned_addr learned my addr 172.21.15.139:0/792203042 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:14:47.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.378+0000 7fc05ed9d640 1 -- 172.21.15.139:0/792203042 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc060117300 con 0x7fc060129d80 2024-09-10T05:14:47.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.378+0000 7fc05ed9d640 1 --2- 172.21.15.139:0/792203042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc060129d80 0x7fc060115030 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc05000c3d0 tx=0x7fc05000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:47.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.378+0000 7fc0577fe640 1 -- 172.21.15.139:0/792203042 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0500074d0 con 0x7fc060129d80 2024-09-10T05:14:47.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.378+0000 7fc0577fe640 1 -- 172.21.15.139:0/792203042 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0500047e0 con 0x7fc060129d80 2024-09-10T05:14:47.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.378+0000 7fc065198640 1 -- 172.21.15.139:0/792203042 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc060116e00 con 0x7fc060129d80 2024-09-10T05:14:47.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.378+0000 7fc0577fe640 1 -- 172.21.15.139:0/792203042 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc050007670 con 0x7fc060129d80 2024-09-10T05:14:47.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.378+0000 7fc065198640 1 -- 172.21.15.139:0/792203042 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc060126930 con 0x7fc060129d80 2024-09-10T05:14:47.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.379+0000 7fc0577fe640 1 -- 172.21.15.139:0/792203042 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fc050011070 con 0x7fc060129d80 2024-09-10T05:14:47.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.379+0000 7fc065198640 1 -- 172.21.15.139:0/792203042 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc06012a160 con 0x7fc060129d80 2024-09-10T05:14:47.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.379+0000 7fc0577fe640 1 --2- 172.21.15.139:0/792203042 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc04003dec0 0x7fc040040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:14:47.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.379+0000 7fc0577fe640 1 -- 172.21.15.139:0/792203042 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc0500529b0 con 0x7fc060129d80 2024-09-10T05:14:47.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.380+0000 7fc05e59c640 1 --2- 172.21.15.139:0/792203042 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc04003dec0 0x7fc040040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:14:47.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.380+0000 7fc05e59c640 1 --2- 172.21.15.139:0/792203042 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc04003dec0 0x7fc040040380 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc048034000 tx=0x7fc04802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:14:47.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.384+0000 7fc0577fe640 1 -- 172.21.15.139:0/792203042 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fc050012dd0 con 0x7fc060129d80 2024-09-10T05:14:47.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.554+0000 7fc065198640 1 -- 172.21.15.139:0/792203042 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0601276b0 con 0x7fc04003dec0 2024-09-10T05:14:47.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.564+0000 7fc0577fe640 1 -- 172.21.15.139:0/792203042 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665675 (secure 0 0 0) 0x7fc048032740 con 0x7fc04003dec0 2024-09-10T05:14:47.573 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:14:47.578 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-10T05:14:47.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.569+0000 7fc065198640 1 -- 172.21.15.139:0/792203042 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc04003dec0 msgr2=0x7fc040040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:47.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.569+0000 7fc065198640 1 --2- 172.21.15.139:0/792203042 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc04003dec0 0x7fc040040380 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc048034000 tx=0x7fc04802e000 comp rx=0 tx=0).stop 2024-09-10T05:14:47.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.569+0000 7fc065198640 1 -- 172.21.15.139:0/792203042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc060129d80 msgr2=0x7fc060115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:14:47.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.569+0000 7fc065198640 1 --2- 172.21.15.139:0/792203042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc060129d80 0x7fc060115030 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc05000c3d0 tx=0x7fc05000c890 comp rx=0 tx=0).stop 2024-09-10T05:14:47.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.569+0000 7fc065198640 1 -- 172.21.15.139:0/792203042 shutdown_connections 2024-09-10T05:14:47.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.569+0000 7fc065198640 1 --2- 172.21.15.139:0/792203042 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fc04003dec0 0x7fc040040380 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:47.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.569+0000 7fc065198640 1 --2- 172.21.15.139:0/792203042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc060129d80 0x7fc060115030 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:14:47.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.569+0000 7fc065198640 1 -- 172.21.15.139:0/792203042 >> 172.21.15.139:0/792203042 conn(0x7fc060070850 msgr2=0x7fc0601b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:14:47.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.569+0000 7fc065198640 1 -- 172.21.15.139:0/792203042 shutdown_connections 2024-09-10T05:14:47.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:14:47.569+0000 7fc065198640 1 -- 172.21.15.139:0/792203042 wait complete. 2024-09-10T05:14:47.582 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-10T05:14:45.939725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5433,"num_read_kb":4987,"num_write":2313,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4762,"ondisk_log_size":4762,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152712,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334648,"statfs":{"total":386547056640,"available":386390679552,"internally_reserved":0,"allocated":3080192,"data_stored":1821028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4281,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":738,"num_read_kb":697,"num_write":457,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003525"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962470+0000","last_change":"2024-09-10T05:11:27.721757+0000","last_active":"2024-09-10T05:12:04.962470+0000","last_peered":"2024-09-10T05:12:04.962470+0000","last_clean":"2024-09-10T05:12:04.962470+0000","last_became_active":"2024-09-10T05:11:27.716775+0000","last_became_peered":"2024-09-10T05:11:27.716775+0000","last_unstale":"2024-09-10T05:12:04.962470+0000","last_undegraded":"2024-09-10T05:12:04.962470+0000","last_fullsized":"2024-09-10T05:12:04.962470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:21.106235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.438467+0000","last_change":"2024-09-10T05:11:29.733870+0000","last_active":"2024-09-10T05:12:09.438467+0000","last_peered":"2024-09-10T05:12:09.438467+0000","last_clean":"2024-09-10T05:12:09.438467+0000","last_became_active":"2024-09-10T05:11:29.733565+0000","last_became_peered":"2024-09-10T05:11:29.733565+0000","last_unstale":"2024-09-10T05:12:09.438467+0000","last_undegraded":"2024-09-10T05:12:09.438467+0000","last_fullsized":"2024-09-10T05:12:09.438467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:13.290526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958456+0000","last_change":"2024-09-10T05:11:27.715287+0000","last_active":"2024-09-10T05:12:04.958456+0000","last_peered":"2024-09-10T05:12:04.958456+0000","last_clean":"2024-09-10T05:12:04.958456+0000","last_became_active":"2024-09-10T05:11:27.713698+0000","last_became_peered":"2024-09-10T05:11:27.713698+0000","last_unstale":"2024-09-10T05:12:04.958456+0000","last_undegraded":"2024-09-10T05:12:04.958456+0000","last_fullsized":"2024-09-10T05:12:04.958456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:11.833568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'10","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417350+0000","last_change":"2024-09-10T05:11:29.728909+0000","last_active":"2024-09-10T05:14:36.417350+0000","last_peered":"2024-09-10T05:14:36.417350+0000","last_clean":"2024-09-10T05:14:36.417350+0000","last_became_active":"2024-09-10T05:11:29.728621+0000","last_became_peered":"2024-09-10T05:11:29.728621+0000","last_unstale":"2024-09-10T05:14:36.417350+0000","last_undegraded":"2024-09-10T05:14:36.417350+0000","last_fullsized":"2024-09-10T05:14:36.417350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:44.019015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.093692+0000","last_change":"2024-09-10T05:11:27.734457+0000","last_active":"2024-09-10T05:14:36.093692+0000","last_peered":"2024-09-10T05:14:36.093692+0000","last_clean":"2024-09-10T05:14:36.093692+0000","last_became_active":"2024-09-10T05:11:27.733147+0000","last_became_peered":"2024-09-10T05:11:27.733147+0000","last_unstale":"2024-09-10T05:14:36.093692+0000","last_undegraded":"2024-09-10T05:14:36.093692+0000","last_fullsized":"2024-09-10T05:14:36.093692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:03.092088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339232+0000","last_change":"2024-09-10T05:11:29.728946+0000","last_active":"2024-09-10T05:14:36.339232+0000","last_peered":"2024-09-10T05:14:36.339232+0000","last_clean":"2024-09-10T05:14:36.339232+0000","last_became_active":"2024-09-10T05:11:29.728696+0000","last_became_peered":"2024-09-10T05:11:29.728696+0000","last_unstale":"2024-09-10T05:14:36.339232+0000","last_undegraded":"2024-09-10T05:14:36.339232+0000","last_fullsized":"2024-09-10T05:14:36.339232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:06.277517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958649+0000","last_change":"2024-09-10T05:11:27.724506+0000","last_active":"2024-09-10T05:12:04.958649+0000","last_peered":"2024-09-10T05:12:04.958649+0000","last_clean":"2024-09-10T05:12:04.958649+0000","last_became_active":"2024-09-10T05:11:27.722701+0000","last_became_peered":"2024-09-10T05:11:27.722701+0000","last_unstale":"2024-09-10T05:12:04.958649+0000","last_undegraded":"2024-09-10T05:12:04.958649+0000","last_fullsized":"2024-09-10T05:12:04.958649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:36.792228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'21","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.346432+0000","last_change":"2024-09-10T05:11:29.732128+0000","last_active":"2024-09-10T05:14:36.346432+0000","last_peered":"2024-09-10T05:14:36.346432+0000","last_clean":"2024-09-10T05:14:36.346432+0000","last_became_active":"2024-09-10T05:11:29.731850+0000","last_became_peered":"2024-09-10T05:11:29.731850+0000","last_unstale":"2024-09-10T05:14:36.346432+0000","last_undegraded":"2024-09-10T05:14:36.346432+0000","last_fullsized":"2024-09-10T05:14:36.346432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:29.844887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956059+0000","last_change":"2024-09-10T05:11:27.733926+0000","last_active":"2024-09-10T05:12:04.956059+0000","last_peered":"2024-09-10T05:12:04.956059+0000","last_clean":"2024-09-10T05:12:04.956059+0000","last_became_active":"2024-09-10T05:11:27.732922+0000","last_became_peered":"2024-09-10T05:11:27.732922+0000","last_unstale":"2024-09-10T05:12:04.956059+0000","last_undegraded":"2024-09-10T05:12:04.956059+0000","last_fullsized":"2024-09-10T05:12:04.956059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:10.400715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960102+0000","last_change":"2024-09-10T05:11:29.722746+0000","last_active":"2024-09-10T05:12:04.960102+0000","last_peered":"2024-09-10T05:12:04.960102+0000","last_clean":"2024-09-10T05:12:04.960102+0000","last_became_active":"2024-09-10T05:11:29.722189+0000","last_became_peered":"2024-09-10T05:11:29.722189+0000","last_unstale":"2024-09-10T05:12:04.960102+0000","last_undegraded":"2024-09-10T05:12:04.960102+0000","last_fullsized":"2024-09-10T05:12:04.960102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:20.901027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.655335+0000","last_change":"2024-09-10T05:11:27.706947+0000","last_active":"2024-09-10T05:12:09.655335+0000","last_peered":"2024-09-10T05:12:09.655335+0000","last_clean":"2024-09-10T05:12:09.655335+0000","last_became_active":"2024-09-10T05:11:27.706559+0000","last_became_peered":"2024-09-10T05:11:27.706559+0000","last_unstale":"2024-09-10T05:12:09.655335+0000","last_undegraded":"2024-09-10T05:12:09.655335+0000","last_fullsized":"2024-09-10T05:12:09.655335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:12.536123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957220+0000","last_change":"2024-09-10T05:11:29.730769+0000","last_active":"2024-09-10T05:12:04.957220+0000","last_peered":"2024-09-10T05:12:04.957220+0000","last_clean":"2024-09-10T05:12:04.957220+0000","last_became_active":"2024-09-10T05:11:29.730492+0000","last_became_peered":"2024-09-10T05:11:29.730492+0000","last_unstale":"2024-09-10T05:12:04.957220+0000","last_undegraded":"2024-09-10T05:12:04.957220+0000","last_fullsized":"2024-09-10T05:12:04.957220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:36.538972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954889+0000","last_change":"2024-09-10T05:11:27.718698+0000","last_active":"2024-09-10T05:12:04.954889+0000","last_peered":"2024-09-10T05:12:04.954889+0000","last_clean":"2024-09-10T05:12:04.954889+0000","last_became_active":"2024-09-10T05:11:27.718363+0000","last_became_peered":"2024-09-10T05:11:27.718363+0000","last_unstale":"2024-09-10T05:12:04.954889+0000","last_undegraded":"2024-09-10T05:12:04.954889+0000","last_fullsized":"2024-09-10T05:12:04.954889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:56.809195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417284+0000","last_change":"2024-09-10T05:11:29.727171+0000","last_active":"2024-09-10T05:14:36.417284+0000","last_peered":"2024-09-10T05:14:36.417284+0000","last_clean":"2024-09-10T05:14:36.417284+0000","last_became_active":"2024-09-10T05:11:29.726884+0000","last_became_peered":"2024-09-10T05:11:29.726884+0000","last_unstale":"2024-09-10T05:14:36.417284+0000","last_undegraded":"2024-09-10T05:14:36.417284+0000","last_fullsized":"2024-09-10T05:14:36.417284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:28.260482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.646405+0000","last_change":"2024-09-10T05:11:27.719213+0000","last_active":"2024-09-10T05:12:09.646405+0000","last_peered":"2024-09-10T05:12:09.646405+0000","last_clean":"2024-09-10T05:12:09.646405+0000","last_became_active":"2024-09-10T05:11:27.718868+0000","last_became_peered":"2024-09-10T05:11:27.718868+0000","last_unstale":"2024-09-10T05:12:09.646405+0000","last_undegraded":"2024-09-10T05:12:09.646405+0000","last_fullsized":"2024-09-10T05:12:09.646405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:27.106277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.093231+0000","last_change":"2024-09-10T05:11:29.723967+0000","last_active":"2024-09-10T05:12:09.093231+0000","last_peered":"2024-09-10T05:12:09.093231+0000","last_clean":"2024-09-10T05:12:09.093231+0000","last_became_active":"2024-09-10T05:11:29.723497+0000","last_became_peered":"2024-09-10T05:11:29.723497+0000","last_unstale":"2024-09-10T05:12:09.093231+0000","last_undegraded":"2024-09-10T05:12:09.093231+0000","last_fullsized":"2024-09-10T05:12:09.093231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:35.779331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'5","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.208052+0000","last_change":"2024-09-10T05:11:29.727785+0000","last_active":"2024-09-10T05:14:36.208052+0000","last_peered":"2024-09-10T05:14:36.208052+0000","last_clean":"2024-09-10T05:14:36.208052+0000","last_became_active":"2024-09-10T05:11:29.727536+0000","last_became_peered":"2024-09-10T05:11:29.727536+0000","last_unstale":"2024-09-10T05:14:36.208052+0000","last_undegraded":"2024-09-10T05:14:36.208052+0000","last_fullsized":"2024-09-10T05:14:36.208052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:01.849780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.517983+0000","last_change":"2024-09-10T05:11:27.728861+0000","last_active":"2024-09-10T05:13:35.517983+0000","last_peered":"2024-09-10T05:13:35.517983+0000","last_clean":"2024-09-10T05:13:35.517983+0000","last_became_active":"2024-09-10T05:11:27.728114+0000","last_became_peered":"2024-09-10T05:11:27.728114+0000","last_unstale":"2024-09-10T05:13:35.517983+0000","last_undegraded":"2024-09-10T05:13:35.517983+0000","last_fullsized":"2024-09-10T05:13:35.517983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.559031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.202264+0000","last_change":"2024-09-10T05:11:29.733110+0000","last_active":"2024-09-10T05:14:36.202264+0000","last_peered":"2024-09-10T05:14:36.202264+0000","last_clean":"2024-09-10T05:14:36.202264+0000","last_became_active":"2024-09-10T05:11:29.732864+0000","last_became_peered":"2024-09-10T05:11:29.732864+0000","last_unstale":"2024-09-10T05:14:36.202264+0000","last_undegraded":"2024-09-10T05:14:36.202264+0000","last_fullsized":"2024-09-10T05:14:36.202264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:27.593815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.964231+0000","last_change":"2024-09-10T05:11:27.707811+0000","last_active":"2024-09-10T05:12:04.964231+0000","last_peered":"2024-09-10T05:12:04.964231+0000","last_clean":"2024-09-10T05:12:04.964231+0000","last_became_active":"2024-09-10T05:11:27.706698+0000","last_became_peered":"2024-09-10T05:11:27.706698+0000","last_unstale":"2024-09-10T05:12:04.964231+0000","last_undegraded":"2024-09-10T05:12:04.964231+0000","last_fullsized":"2024-09-10T05:12:04.964231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:46.559031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'10","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.963001+0000","last_change":"2024-09-10T05:11:29.732128+0000","last_active":"2024-09-10T05:12:51.963001+0000","last_peered":"2024-09-10T05:12:51.963001+0000","last_clean":"2024-09-10T05:12:51.963001+0000","last_became_active":"2024-09-10T05:11:29.731842+0000","last_became_peered":"2024-09-10T05:11:29.731842+0000","last_unstale":"2024-09-10T05:12:51.963001+0000","last_undegraded":"2024-09-10T05:12:51.963001+0000","last_fullsized":"2024-09-10T05:12:51.963001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:54.021671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960653+0000","last_change":"2024-09-10T05:11:27.719633+0000","last_active":"2024-09-10T05:12:04.960653+0000","last_peered":"2024-09-10T05:12:04.960653+0000","last_clean":"2024-09-10T05:12:04.960653+0000","last_became_active":"2024-09-10T05:11:27.719257+0000","last_became_peered":"2024-09-10T05:11:27.719257+0000","last_unstale":"2024-09-10T05:12:04.960653+0000","last_undegraded":"2024-09-10T05:12:04.960653+0000","last_fullsized":"2024-09-10T05:12:04.960653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:49.735409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339173+0000","last_change":"2024-09-10T05:12:04.976749+0000","last_active":"2024-09-10T05:14:36.339173+0000","last_peered":"2024-09-10T05:14:36.339173+0000","last_clean":"2024-09-10T05:14:36.339173+0000","last_became_active":"2024-09-10T05:12:04.967642+0000","last_became_peered":"2024-09-10T05:12:04.967642+0000","last_unstale":"2024-09-10T05:14:36.339173+0000","last_undegraded":"2024-09-10T05:14:36.339173+0000","last_fullsized":"2024-09-10T05:14:36.339173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:14.879637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"37'3","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.952834+0000","last_change":"2024-09-10T05:11:27.724754+0000","last_active":"2024-09-10T05:12:51.952834+0000","last_peered":"2024-09-10T05:12:51.952834+0000","last_clean":"2024-09-10T05:12:51.952834+0000","last_became_active":"2024-09-10T05:11:27.724439+0000","last_became_peered":"2024-09-10T05:11:27.724439+0000","last_unstale":"2024-09-10T05:12:51.952834+0000","last_undegraded":"2024-09-10T05:12:51.952834+0000","last_fullsized":"2024-09-10T05:12:51.952834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:46:03.289983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382409+0000","last_change":"2024-09-10T05:11:29.723195+0000","last_active":"2024-09-10T05:14:36.382409+0000","last_peered":"2024-09-10T05:14:36.382409+0000","last_clean":"2024-09-10T05:14:36.382409+0000","last_became_active":"2024-09-10T05:11:29.722894+0000","last_became_peered":"2024-09-10T05:11:29.722894+0000","last_unstale":"2024-09-10T05:14:36.382409+0000","last_undegraded":"2024-09-10T05:14:36.382409+0000","last_fullsized":"2024-09-10T05:14:36.382409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:16.388042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.985687+0000","last_change":"2024-09-10T05:11:27.716016+0000","last_active":"2024-09-10T05:14:35.985687+0000","last_peered":"2024-09-10T05:14:35.985687+0000","last_clean":"2024-09-10T05:14:35.985687+0000","last_became_active":"2024-09-10T05:11:27.714926+0000","last_became_peered":"2024-09-10T05:11:27.714926+0000","last_unstale":"2024-09-10T05:14:35.985687+0000","last_undegraded":"2024-09-10T05:14:35.985687+0000","last_fullsized":"2024-09-10T05:14:35.985687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:51.116402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.384792+0000","last_change":"2024-09-10T05:11:29.722979+0000","last_active":"2024-09-10T05:14:36.384792+0000","last_peered":"2024-09-10T05:14:36.384792+0000","last_clean":"2024-09-10T05:14:36.384792+0000","last_became_active":"2024-09-10T05:11:29.721876+0000","last_became_peered":"2024-09-10T05:11:29.721876+0000","last_unstale":"2024-09-10T05:14:36.384792+0000","last_undegraded":"2024-09-10T05:14:36.384792+0000","last_fullsized":"2024-09-10T05:14:36.384792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:11:48.560871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955723+0000","last_change":"2024-09-10T05:11:27.720509+0000","last_active":"2024-09-10T05:12:04.955723+0000","last_peered":"2024-09-10T05:12:04.955723+0000","last_clean":"2024-09-10T05:12:04.955723+0000","last_became_active":"2024-09-10T05:11:27.720197+0000","last_became_peered":"2024-09-10T05:11:27.720197+0000","last_unstale":"2024-09-10T05:12:04.955723+0000","last_undegraded":"2024-09-10T05:12:04.955723+0000","last_fullsized":"2024-09-10T05:12:04.955723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:14.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.361804+0000","last_change":"2024-09-10T05:11:37.763268+0000","last_active":"2024-09-10T05:14:36.361804+0000","last_peered":"2024-09-10T05:14:36.361804+0000","last_clean":"2024-09-10T05:14:36.361804+0000","last_became_active":"2024-09-10T05:11:37.763019+0000","last_became_peered":"2024-09-10T05:11:37.763019+0000","last_unstale":"2024-09-10T05:14:36.361804+0000","last_undegraded":"2024-09-10T05:14:36.361804+0000","last_fullsized":"2024-09-10T05:14:36.361804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:54.698085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:10.169121+0000","last_change":"2024-09-10T05:11:29.729685+0000","last_active":"2024-09-10T05:12:10.169121+0000","last_peered":"2024-09-10T05:12:10.169121+0000","last_clean":"2024-09-10T05:12:10.169121+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:12:10.169121+0000","last_undegraded":"2024-09-10T05:12:10.169121+0000","last_fullsized":"2024-09-10T05:12:10.169121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.365568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955666+0000","last_change":"2024-09-10T05:11:27.734206+0000","last_active":"2024-09-10T05:12:04.955666+0000","last_peered":"2024-09-10T05:12:04.955666+0000","last_clean":"2024-09-10T05:12:04.955666+0000","last_became_active":"2024-09-10T05:11:27.733612+0000","last_became_peered":"2024-09-10T05:11:27.733612+0000","last_unstale":"2024-09-10T05:12:04.955666+0000","last_undegraded":"2024-09-10T05:12:04.955666+0000","last_fullsized":"2024-09-10T05:12:04.955666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:47.697103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957082+0000","last_change":"2024-09-10T05:11:31.737509+0000","last_active":"2024-09-10T05:12:04.957082+0000","last_peered":"2024-09-10T05:12:04.957082+0000","last_clean":"2024-09-10T05:12:04.957082+0000","last_became_active":"2024-09-10T05:11:31.736788+0000","last_became_peered":"2024-09-10T05:11:31.736788+0000","last_unstale":"2024-09-10T05:12:04.957082+0000","last_undegraded":"2024-09-10T05:12:04.957082+0000","last_fullsized":"2024-09-10T05:12:04.957082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:26.107225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'47","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.081131+0000","last_change":"2024-09-10T05:11:33.746939+0000","last_active":"2024-09-10T05:14:43.081131+0000","last_peered":"2024-09-10T05:14:43.081131+0000","last_clean":"2024-09-10T05:14:43.081131+0000","last_became_active":"2024-09-10T05:11:33.746595+0000","last_became_peered":"2024-09-10T05:11:33.746595+0000","last_unstale":"2024-09-10T05:14:43.081131+0000","last_undegraded":"2024-09-10T05:14:43.081131+0000","last_fullsized":"2024-09-10T05:14:43.081131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:39.379252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963055+0000","last_change":"2024-09-10T05:11:35.746892+0000","last_active":"2024-09-10T05:12:04.963055+0000","last_peered":"2024-09-10T05:12:04.963055+0000","last_clean":"2024-09-10T05:12:04.963055+0000","last_became_active":"2024-09-10T05:11:35.746594+0000","last_became_peered":"2024-09-10T05:11:35.746594+0000","last_unstale":"2024-09-10T05:12:04.963055+0000","last_undegraded":"2024-09-10T05:12:04.963055+0000","last_fullsized":"2024-09-10T05:12:04.963055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:15.325826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.968440+0000","last_change":"2024-09-10T05:11:37.756768+0000","last_active":"2024-09-10T05:12:51.968440+0000","last_peered":"2024-09-10T05:12:51.968440+0000","last_clean":"2024-09-10T05:12:51.968440+0000","last_became_active":"2024-09-10T05:11:37.756495+0000","last_became_peered":"2024-09-10T05:11:37.756495+0000","last_unstale":"2024-09-10T05:12:51.968440+0000","last_undegraded":"2024-09-10T05:12:51.968440+0000","last_fullsized":"2024-09-10T05:12:51.968440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:13.070344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417430+0000","last_change":"2024-09-10T05:11:29.732574+0000","last_active":"2024-09-10T05:14:36.417430+0000","last_peered":"2024-09-10T05:14:36.417430+0000","last_clean":"2024-09-10T05:14:36.417430+0000","last_became_active":"2024-09-10T05:11:29.732267+0000","last_became_peered":"2024-09-10T05:11:29.732267+0000","last_unstale":"2024-09-10T05:14:36.417430+0000","last_undegraded":"2024-09-10T05:14:36.417430+0000","last_fullsized":"2024-09-10T05:14:36.417430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:00.006923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958078+0000","last_change":"2024-09-10T05:11:27.726953+0000","last_active":"2024-09-10T05:12:04.958078+0000","last_peered":"2024-09-10T05:12:04.958078+0000","last_clean":"2024-09-10T05:12:04.958078+0000","last_became_active":"2024-09-10T05:11:27.726599+0000","last_became_peered":"2024-09-10T05:11:27.726599+0000","last_unstale":"2024-09-10T05:12:04.958078+0000","last_undegraded":"2024-09-10T05:12:04.958078+0000","last_fullsized":"2024-09-10T05:12:04.958078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:37.354012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957165+0000","last_change":"2024-09-10T05:11:31.731495+0000","last_active":"2024-09-10T05:12:04.957165+0000","last_peered":"2024-09-10T05:12:04.957165+0000","last_clean":"2024-09-10T05:12:04.957165+0000","last_became_active":"2024-09-10T05:11:31.731231+0000","last_became_peered":"2024-09-10T05:11:31.731231+0000","last_unstale":"2024-09-10T05:12:04.957165+0000","last_undegraded":"2024-09-10T05:12:04.957165+0000","last_fullsized":"2024-09-10T05:12:04.957165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:09.451414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'13","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960893+0000","last_change":"2024-09-10T05:11:33.744170+0000","last_active":"2024-09-10T05:12:04.960893+0000","last_peered":"2024-09-10T05:12:04.960893+0000","last_clean":"2024-09-10T05:12:04.960893+0000","last_became_active":"2024-09-10T05:11:33.743847+0000","last_became_peered":"2024-09-10T05:11:33.743847+0000","last_unstale":"2024-09-10T05:12:04.960893+0000","last_undegraded":"2024-09-10T05:12:04.960893+0000","last_fullsized":"2024-09-10T05:12:04.960893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:57.085007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962494+0000","last_change":"2024-09-10T05:11:35.749895+0000","last_active":"2024-09-10T05:12:04.962494+0000","last_peered":"2024-09-10T05:12:04.962494+0000","last_clean":"2024-09-10T05:12:04.962494+0000","last_became_active":"2024-09-10T05:11:35.749634+0000","last_became_peered":"2024-09-10T05:11:35.749634+0000","last_unstale":"2024-09-10T05:12:04.962494+0000","last_undegraded":"2024-09-10T05:12:04.962494+0000","last_fullsized":"2024-09-10T05:12:04.962494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:01.486680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956547+0000","last_change":"2024-09-10T05:11:37.755426+0000","last_active":"2024-09-10T05:12:04.956547+0000","last_peered":"2024-09-10T05:12:04.956547+0000","last_clean":"2024-09-10T05:12:04.956547+0000","last_became_active":"2024-09-10T05:11:37.755078+0000","last_became_peered":"2024-09-10T05:11:37.755078+0000","last_unstale":"2024-09-10T05:12:04.956547+0000","last_undegraded":"2024-09-10T05:12:04.956547+0000","last_fullsized":"2024-09-10T05:12:04.956547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:03.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961705+0000","last_change":"2024-09-10T05:11:29.732068+0000","last_active":"2024-09-10T05:12:04.961705+0000","last_peered":"2024-09-10T05:12:04.961705+0000","last_clean":"2024-09-10T05:12:04.961705+0000","last_became_active":"2024-09-10T05:11:29.731780+0000","last_became_peered":"2024-09-10T05:11:29.731780+0000","last_unstale":"2024-09-10T05:12:04.961705+0000","last_undegraded":"2024-09-10T05:12:04.961705+0000","last_fullsized":"2024-09-10T05:12:04.961705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:47.912310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954517+0000","last_change":"2024-09-10T05:11:27.732925+0000","last_active":"2024-09-10T05:12:04.954517+0000","last_peered":"2024-09-10T05:12:04.954517+0000","last_clean":"2024-09-10T05:12:04.954517+0000","last_became_active":"2024-09-10T05:11:27.732573+0000","last_became_peered":"2024-09-10T05:11:27.732573+0000","last_unstale":"2024-09-10T05:12:04.954517+0000","last_undegraded":"2024-09-10T05:12:04.954517+0000","last_fullsized":"2024-09-10T05:12:04.954517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:48.014510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:05.900569+0000","last_change":"2024-09-10T05:12:04.965872+0000","last_active":"2024-09-10T05:12:05.900569+0000","last_peered":"2024-09-10T05:12:05.900569+0000","last_clean":"2024-09-10T05:12:05.900569+0000","last_became_active":"2024-09-10T05:12:04.965494+0000","last_became_peered":"2024-09-10T05:12:04.965494+0000","last_unstale":"2024-09-10T05:12:05.900569+0000","last_undegraded":"2024-09-10T05:12:05.900569+0000","last_fullsized":"2024-09-10T05:12:05.900569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:04.430595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959616+0000","last_change":"2024-09-10T05:11:33.745608+0000","last_active":"2024-09-10T05:12:04.959616+0000","last_peered":"2024-09-10T05:12:04.959616+0000","last_clean":"2024-09-10T05:12:04.959616+0000","last_became_active":"2024-09-10T05:11:33.745336+0000","last_became_peered":"2024-09-10T05:11:33.745336+0000","last_unstale":"2024-09-10T05:12:04.959616+0000","last_undegraded":"2024-09-10T05:12:04.959616+0000","last_fullsized":"2024-09-10T05:12:04.959616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:41.078775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'285","reported_seq":418,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.005466+0000","last_change":"2024-09-10T05:11:35.752548+0000","last_active":"2024-09-10T05:14:43.005466+0000","last_peered":"2024-09-10T05:14:43.005466+0000","last_clean":"2024-09-10T05:14:43.005466+0000","last_became_active":"2024-09-10T05:11:35.752290+0000","last_became_peered":"2024-09-10T05:11:35.752290+0000","last_unstale":"2024-09-10T05:14:43.005466+0000","last_undegraded":"2024-09-10T05:14:43.005466+0000","last_fullsized":"2024-09-10T05:14:43.005466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.244961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959825+0000","last_change":"2024-09-10T05:11:37.759873+0000","last_active":"2024-09-10T05:12:04.959825+0000","last_peered":"2024-09-10T05:12:04.959825+0000","last_clean":"2024-09-10T05:12:04.959825+0000","last_became_active":"2024-09-10T05:11:37.759311+0000","last_became_peered":"2024-09-10T05:11:37.759311+0000","last_unstale":"2024-09-10T05:12:04.959825+0000","last_undegraded":"2024-09-10T05:12:04.959825+0000","last_fullsized":"2024-09-10T05:12:04.959825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:37.479923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.383082+0000","last_change":"2024-09-10T05:11:29.724315+0000","last_active":"2024-09-10T05:14:36.383082+0000","last_peered":"2024-09-10T05:14:36.383082+0000","last_clean":"2024-09-10T05:14:36.383082+0000","last_became_active":"2024-09-10T05:11:29.723919+0000","last_became_peered":"2024-09-10T05:11:29.723919+0000","last_unstale":"2024-09-10T05:14:36.383082+0000","last_undegraded":"2024-09-10T05:14:36.383082+0000","last_fullsized":"2024-09-10T05:14:36.383082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:04.172142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957233+0000","last_change":"2024-09-10T05:11:27.720680+0000","last_active":"2024-09-10T05:12:04.957233+0000","last_peered":"2024-09-10T05:12:04.957233+0000","last_clean":"2024-09-10T05:12:04.957233+0000","last_became_active":"2024-09-10T05:11:27.719835+0000","last_became_peered":"2024-09-10T05:11:27.719835+0000","last_unstale":"2024-09-10T05:12:04.957233+0000","last_undegraded":"2024-09-10T05:12:04.957233+0000","last_fullsized":"2024-09-10T05:12:04.957233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.391212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962693+0000","last_change":"2024-09-10T05:11:31.737694+0000","last_active":"2024-09-10T05:12:04.962693+0000","last_peered":"2024-09-10T05:12:04.962693+0000","last_clean":"2024-09-10T05:12:04.962693+0000","last_became_active":"2024-09-10T05:11:31.737411+0000","last_became_peered":"2024-09-10T05:11:31.737411+0000","last_unstale":"2024-09-10T05:12:04.962693+0000","last_undegraded":"2024-09-10T05:12:04.962693+0000","last_fullsized":"2024-09-10T05:12:04.962693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:48.673581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'39","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.066217+0000","last_change":"2024-09-10T05:11:33.745209+0000","last_active":"2024-09-10T05:14:43.066217+0000","last_peered":"2024-09-10T05:14:43.066217+0000","last_clean":"2024-09-10T05:14:43.066217+0000","last_became_active":"2024-09-10T05:11:33.744920+0000","last_became_peered":"2024-09-10T05:11:33.744920+0000","last_unstale":"2024-09-10T05:14:43.066217+0000","last_undegraded":"2024-09-10T05:14:43.066217+0000","last_fullsized":"2024-09-10T05:14:43.066217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:36.085525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":427,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.010217+0000","last_change":"2024-09-10T05:11:35.748524+0000","last_active":"2024-09-10T05:14:43.010217+0000","last_peered":"2024-09-10T05:14:43.010217+0000","last_clean":"2024-09-10T05:14:43.010217+0000","last_became_active":"2024-09-10T05:11:35.748328+0000","last_became_peered":"2024-09-10T05:11:35.748328+0000","last_unstale":"2024-09-10T05:14:43.010217+0000","last_undegraded":"2024-09-10T05:14:43.010217+0000","last_fullsized":"2024-09-10T05:14:43.010217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:39.020754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'7","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116685+0000","last_change":"2024-09-10T05:11:29.736309+0000","last_active":"2024-09-10T05:14:36.116685+0000","last_peered":"2024-09-10T05:14:36.116685+0000","last_clean":"2024-09-10T05:14:36.116685+0000","last_became_active":"2024-09-10T05:11:29.735799+0000","last_became_peered":"2024-09-10T05:11:29.735799+0000","last_unstale":"2024-09-10T05:14:36.116685+0000","last_undegraded":"2024-09-10T05:14:36.116685+0000","last_fullsized":"2024-09-10T05:14:36.116685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:38.598374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962727+0000","last_change":"2024-09-10T05:11:27.721631+0000","last_active":"2024-09-10T05:12:04.962727+0000","last_peered":"2024-09-10T05:12:04.962727+0000","last_clean":"2024-09-10T05:12:04.962727+0000","last_became_active":"2024-09-10T05:11:27.716318+0000","last_became_peered":"2024-09-10T05:11:27.716318+0000","last_unstale":"2024-09-10T05:12:04.962727+0000","last_undegraded":"2024-09-10T05:12:04.962727+0000","last_fullsized":"2024-09-10T05:12:04.962727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:40.603860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958076+0000","last_change":"2024-09-10T05:11:31.735274+0000","last_active":"2024-09-10T05:12:04.958076+0000","last_peered":"2024-09-10T05:12:04.958076+0000","last_clean":"2024-09-10T05:12:04.958076+0000","last_became_active":"2024-09-10T05:11:31.734975+0000","last_became_peered":"2024-09-10T05:11:31.734975+0000","last_unstale":"2024-09-10T05:12:04.958076+0000","last_undegraded":"2024-09-10T05:12:04.958076+0000","last_fullsized":"2024-09-10T05:12:04.958076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:45.105200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'50","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.093054+0000","last_change":"2024-09-10T05:11:33.746845+0000","last_active":"2024-09-10T05:14:43.093054+0000","last_peered":"2024-09-10T05:14:43.093054+0000","last_clean":"2024-09-10T05:14:43.093054+0000","last_became_active":"2024-09-10T05:11:33.746522+0000","last_became_peered":"2024-09-10T05:11:33.746522+0000","last_unstale":"2024-09-10T05:14:43.093054+0000","last_undegraded":"2024-09-10T05:14:43.093054+0000","last_fullsized":"2024-09-10T05:14:43.093054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:43.397048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957524+0000","last_change":"2024-09-10T05:11:35.746098+0000","last_active":"2024-09-10T05:12:04.957524+0000","last_peered":"2024-09-10T05:12:04.957524+0000","last_clean":"2024-09-10T05:12:04.957524+0000","last_became_active":"2024-09-10T05:11:35.745840+0000","last_became_peered":"2024-09-10T05:11:35.745840+0000","last_unstale":"2024-09-10T05:12:04.957524+0000","last_undegraded":"2024-09-10T05:12:04.957524+0000","last_fullsized":"2024-09-10T05:12:04.957524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:48.168086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.970146+0000","last_change":"2024-09-10T05:11:37.754850+0000","last_active":"2024-09-10T05:12:51.970146+0000","last_peered":"2024-09-10T05:12:51.970146+0000","last_clean":"2024-09-10T05:12:51.970146+0000","last_became_active":"2024-09-10T05:11:37.754562+0000","last_became_peered":"2024-09-10T05:11:37.754562+0000","last_unstale":"2024-09-10T05:12:51.970146+0000","last_undegraded":"2024-09-10T05:12:51.970146+0000","last_fullsized":"2024-09-10T05:12:51.970146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:27.172242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.199301+0000","last_change":"2024-09-10T05:11:29.721603+0000","last_active":"2024-09-10T05:14:36.199301+0000","last_peered":"2024-09-10T05:14:36.199301+0000","last_clean":"2024-09-10T05:14:36.199301+0000","last_became_active":"2024-09-10T05:11:29.721292+0000","last_became_peered":"2024-09-10T05:11:29.721292+0000","last_unstale":"2024-09-10T05:14:36.199301+0000","last_undegraded":"2024-09-10T05:14:36.199301+0000","last_fullsized":"2024-09-10T05:14:36.199301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.549609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.324967+0000","last_change":"2024-09-10T05:11:27.728236+0000","last_active":"2024-09-10T05:14:36.324967+0000","last_peered":"2024-09-10T05:14:36.324967+0000","last_clean":"2024-09-10T05:14:36.324967+0000","last_became_active":"2024-09-10T05:11:27.726419+0000","last_became_peered":"2024-09-10T05:11:27.726419+0000","last_unstale":"2024-09-10T05:14:36.324967+0000","last_undegraded":"2024-09-10T05:14:36.324967+0000","last_fullsized":"2024-09-10T05:14:36.324967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:45.107412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956724+0000","last_change":"2024-09-10T05:11:31.732240+0000","last_active":"2024-09-10T05:12:04.956724+0000","last_peered":"2024-09-10T05:12:04.956724+0000","last_clean":"2024-09-10T05:12:04.956724+0000","last_became_active":"2024-09-10T05:11:31.732017+0000","last_became_peered":"2024-09-10T05:11:31.732017+0000","last_unstale":"2024-09-10T05:12:04.956724+0000","last_undegraded":"2024-09-10T05:12:04.956724+0000","last_fullsized":"2024-09-10T05:12:04.956724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:35.116886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'40","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.141661+0000","last_change":"2024-09-10T05:11:33.747704+0000","last_active":"2024-09-10T05:14:43.141661+0000","last_peered":"2024-09-10T05:14:43.141661+0000","last_clean":"2024-09-10T05:14:43.141661+0000","last_became_active":"2024-09-10T05:11:33.747334+0000","last_became_peered":"2024-09-10T05:11:33.747334+0000","last_unstale":"2024-09-10T05:14:43.141661+0000","last_undegraded":"2024-09-10T05:14:43.141661+0000","last_fullsized":"2024-09-10T05:14:43.141661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:02.895443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956478+0000","last_change":"2024-09-10T05:11:35.753755+0000","last_active":"2024-09-10T05:12:04.956478+0000","last_peered":"2024-09-10T05:12:04.956478+0000","last_clean":"2024-09-10T05:12:04.956478+0000","last_became_active":"2024-09-10T05:11:35.753453+0000","last_became_peered":"2024-09-10T05:11:35.753453+0000","last_unstale":"2024-09-10T05:12:04.956478+0000","last_undegraded":"2024-09-10T05:12:04.956478+0000","last_fullsized":"2024-09-10T05:12:04.956478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:03.592621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:46.437159+0000","last_change":"2024-09-10T05:11:37.758133+0000","last_active":"2024-09-10T05:12:46.437159+0000","last_peered":"2024-09-10T05:12:46.437159+0000","last_clean":"2024-09-10T05:12:46.437159+0000","last_became_active":"2024-09-10T05:11:37.757307+0000","last_became_peered":"2024-09-10T05:11:37.757307+0000","last_unstale":"2024-09-10T05:12:46.437159+0000","last_undegraded":"2024-09-10T05:12:46.437159+0000","last_fullsized":"2024-09-10T05:12:46.437159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:15.800062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958765+0000","last_change":"2024-09-10T05:11:29.722984+0000","last_active":"2024-09-10T05:12:04.958765+0000","last_peered":"2024-09-10T05:12:04.958765+0000","last_clean":"2024-09-10T05:12:04.958765+0000","last_became_active":"2024-09-10T05:11:29.722719+0000","last_became_peered":"2024-09-10T05:11:29.722719+0000","last_unstale":"2024-09-10T05:12:04.958765+0000","last_undegraded":"2024-09-10T05:12:04.958765+0000","last_fullsized":"2024-09-10T05:12:04.958765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:12.408667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.656125+0000","last_change":"2024-09-10T05:11:27.722920+0000","last_active":"2024-09-10T05:13:35.656125+0000","last_peered":"2024-09-10T05:13:35.656125+0000","last_clean":"2024-09-10T05:13:35.656125+0000","last_became_active":"2024-09-10T05:11:27.722553+0000","last_became_peered":"2024-09-10T05:11:27.722553+0000","last_unstale":"2024-09-10T05:13:35.656125+0000","last_undegraded":"2024-09-10T05:13:35.656125+0000","last_fullsized":"2024-09-10T05:13:35.656125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:26.252530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'4","reported_seq":229,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:42.977305+0000","last_change":"2024-09-10T05:11:31.734260+0000","last_active":"2024-09-10T05:14:42.977305+0000","last_peered":"2024-09-10T05:14:42.977305+0000","last_clean":"2024-09-10T05:14:42.977305+0000","last_became_active":"2024-09-10T05:11:31.733822+0000","last_became_peered":"2024-09-10T05:11:31.733822+0000","last_unstale":"2024-09-10T05:14:42.977305+0000","last_undegraded":"2024-09-10T05:14:42.977305+0000","last_fullsized":"2024-09-10T05:14:42.977305+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:41.836144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'51","reported_seq":113,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.098530+0000","last_change":"2024-09-10T05:11:33.748247+0000","last_active":"2024-09-10T05:14:43.098530+0000","last_peered":"2024-09-10T05:14:43.098530+0000","last_clean":"2024-09-10T05:14:43.098530+0000","last_became_active":"2024-09-10T05:11:33.747938+0000","last_became_peered":"2024-09-10T05:11:33.747938+0000","last_unstale":"2024-09-10T05:14:43.098530+0000","last_undegraded":"2024-09-10T05:14:43.098530+0000","last_fullsized":"2024-09-10T05:14:43.098530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:53.311224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":351,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.014451+0000","last_change":"2024-09-10T05:11:35.754114+0000","last_active":"2024-09-10T05:14:43.014451+0000","last_peered":"2024-09-10T05:14:43.014451+0000","last_clean":"2024-09-10T05:14:43.014451+0000","last_became_active":"2024-09-10T05:11:35.753663+0000","last_became_peered":"2024-09-10T05:11:35.753663+0000","last_unstale":"2024-09-10T05:14:43.014451+0000","last_undegraded":"2024-09-10T05:14:43.014451+0000","last_fullsized":"2024-09-10T05:14:43.014451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.071659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.125804+0000","last_change":"2024-09-10T05:11:37.755275+0000","last_active":"2024-09-10T05:14:36.125804+0000","last_peered":"2024-09-10T05:14:36.125804+0000","last_clean":"2024-09-10T05:14:36.125804+0000","last_became_active":"2024-09-10T05:11:37.754959+0000","last_became_peered":"2024-09-10T05:11:37.754959+0000","last_unstale":"2024-09-10T05:14:36.125804+0000","last_undegraded":"2024-09-10T05:14:36.125804+0000","last_fullsized":"2024-09-10T05:14:36.125804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:34:33.810681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'17","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:45.915314+0000","last_change":"2024-09-10T05:11:29.722535+0000","last_active":"2024-09-10T05:13:45.915314+0000","last_peered":"2024-09-10T05:13:45.915314+0000","last_clean":"2024-09-10T05:13:45.915314+0000","last_became_active":"2024-09-10T05:11:29.722267+0000","last_became_peered":"2024-09-10T05:11:29.722267+0000","last_unstale":"2024-09-10T05:13:45.915314+0000","last_undegraded":"2024-09-10T05:13:45.915314+0000","last_fullsized":"2024-09-10T05:13:45.915314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:18.707927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.334065+0000","last_change":"2024-09-10T05:11:27.732198+0000","last_active":"2024-09-10T05:14:36.334065+0000","last_peered":"2024-09-10T05:14:36.334065+0000","last_clean":"2024-09-10T05:14:36.334065+0000","last_became_active":"2024-09-10T05:11:27.731909+0000","last_became_peered":"2024-09-10T05:11:27.731909+0000","last_unstale":"2024-09-10T05:14:36.334065+0000","last_undegraded":"2024-09-10T05:14:36.334065+0000","last_fullsized":"2024-09-10T05:14:36.334065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:44.836107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957106+0000","last_change":"2024-09-10T05:11:31.733054+0000","last_active":"2024-09-10T05:12:04.957106+0000","last_peered":"2024-09-10T05:12:04.957106+0000","last_clean":"2024-09-10T05:12:04.957106+0000","last_became_active":"2024-09-10T05:11:31.732807+0000","last_became_peered":"2024-09-10T05:11:31.732807+0000","last_unstale":"2024-09-10T05:12:04.957106+0000","last_undegraded":"2024-09-10T05:12:04.957106+0000","last_fullsized":"2024-09-10T05:12:04.957106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:45.290579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'72","reported_seq":149,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.150182+0000","last_change":"2024-09-10T05:11:33.747177+0000","last_active":"2024-09-10T05:14:43.150182+0000","last_peered":"2024-09-10T05:14:43.150182+0000","last_clean":"2024-09-10T05:14:43.150182+0000","last_became_active":"2024-09-10T05:11:33.745449+0000","last_became_peered":"2024-09-10T05:11:33.745449+0000","last_unstale":"2024-09-10T05:14:43.150182+0000","last_undegraded":"2024-09-10T05:14:43.150182+0000","last_fullsized":"2024-09-10T05:14:43.150182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:08.744407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956380+0000","last_change":"2024-09-10T05:11:35.748171+0000","last_active":"2024-09-10T05:12:04.956380+0000","last_peered":"2024-09-10T05:12:04.956380+0000","last_clean":"2024-09-10T05:12:04.956380+0000","last_became_active":"2024-09-10T05:11:35.747913+0000","last_became_peered":"2024-09-10T05:11:35.747913+0000","last_unstale":"2024-09-10T05:12:04.956380+0000","last_undegraded":"2024-09-10T05:12:04.956380+0000","last_fullsized":"2024-09-10T05:12:04.956380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:43.800560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'20","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.564815+0000","last_change":"2024-09-10T05:11:37.755327+0000","last_active":"2024-09-10T05:14:36.564815+0000","last_peered":"2024-09-10T05:14:36.564815+0000","last_clean":"2024-09-10T05:14:36.564815+0000","last_became_active":"2024-09-10T05:11:37.754915+0000","last_became_peered":"2024-09-10T05:11:37.754915+0000","last_unstale":"2024-09-10T05:14:36.564815+0000","last_undegraded":"2024-09-10T05:14:36.564815+0000","last_fullsized":"2024-09-10T05:14:36.564815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:57.393330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'14","reported_seq":78,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107522+0000","last_change":"2024-09-10T05:11:29.728158+0000","last_active":"2024-09-10T05:14:36.107522+0000","last_peered":"2024-09-10T05:14:36.107522+0000","last_clean":"2024-09-10T05:14:36.107522+0000","last_became_active":"2024-09-10T05:11:29.727349+0000","last_became_peered":"2024-09-10T05:11:29.727349+0000","last_unstale":"2024-09-10T05:14:36.107522+0000","last_undegraded":"2024-09-10T05:14:36.107522+0000","last_fullsized":"2024-09-10T05:14:36.107522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.550005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957300+0000","last_change":"2024-09-10T05:11:27.718217+0000","last_active":"2024-09-10T05:12:04.957300+0000","last_peered":"2024-09-10T05:12:04.957300+0000","last_clean":"2024-09-10T05:12:04.957300+0000","last_became_active":"2024-09-10T05:11:27.717887+0000","last_became_peered":"2024-09-10T05:11:27.717887+0000","last_unstale":"2024-09-10T05:12:04.957300+0000","last_undegraded":"2024-09-10T05:12:04.957300+0000","last_fullsized":"2024-09-10T05:12:04.957300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:12.698794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959422+0000","last_change":"2024-09-10T05:11:31.735674+0000","last_active":"2024-09-10T05:12:04.959422+0000","last_peered":"2024-09-10T05:12:04.959422+0000","last_clean":"2024-09-10T05:12:04.959422+0000","last_became_active":"2024-09-10T05:11:31.735386+0000","last_became_peered":"2024-09-10T05:11:31.735386+0000","last_unstale":"2024-09-10T05:12:04.959422+0000","last_undegraded":"2024-09-10T05:12:04.959422+0000","last_fullsized":"2024-09-10T05:12:04.959422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:05.541110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'41","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.153199+0000","last_change":"2024-09-10T05:11:33.744354+0000","last_active":"2024-09-10T05:14:43.153199+0000","last_peered":"2024-09-10T05:14:43.153199+0000","last_clean":"2024-09-10T05:14:43.153199+0000","last_became_active":"2024-09-10T05:11:33.744026+0000","last_became_peered":"2024-09-10T05:11:33.744026+0000","last_unstale":"2024-09-10T05:14:43.153199+0000","last_undegraded":"2024-09-10T05:14:43.153199+0000","last_fullsized":"2024-09-10T05:14:43.153199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.017634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960608+0000","last_change":"2024-09-10T05:11:35.749447+0000","last_active":"2024-09-10T05:12:04.960608+0000","last_peered":"2024-09-10T05:12:04.960608+0000","last_clean":"2024-09-10T05:12:04.960608+0000","last_became_active":"2024-09-10T05:11:35.748874+0000","last_became_peered":"2024-09-10T05:11:35.748874+0000","last_unstale":"2024-09-10T05:12:04.960608+0000","last_undegraded":"2024-09-10T05:12:04.960608+0000","last_fullsized":"2024-09-10T05:12:04.960608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:09.658936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'9","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.113777+0000","last_change":"2024-09-10T05:11:37.768186+0000","last_active":"2024-09-10T05:14:36.113777+0000","last_peered":"2024-09-10T05:14:36.113777+0000","last_clean":"2024-09-10T05:14:36.113777+0000","last_became_active":"2024-09-10T05:11:37.767895+0000","last_became_peered":"2024-09-10T05:11:37.767895+0000","last_unstale":"2024-09-10T05:14:36.113777+0000","last_undegraded":"2024-09-10T05:14:36.113777+0000","last_fullsized":"2024-09-10T05:14:36.113777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:10.944772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'16","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604812+0000","last_change":"2024-09-10T05:11:29.734119+0000","last_active":"2024-09-10T05:13:32.604812+0000","last_peered":"2024-09-10T05:13:32.604812+0000","last_clean":"2024-09-10T05:13:32.604812+0000","last_became_active":"2024-09-10T05:11:29.733870+0000","last_became_peered":"2024-09-10T05:11:29.733870+0000","last_unstale":"2024-09-10T05:13:32.604812+0000","last_undegraded":"2024-09-10T05:13:32.604812+0000","last_fullsized":"2024-09-10T05:13:32.604812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:25:17.874072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956901+0000","last_change":"2024-09-10T05:11:27.726184+0000","last_active":"2024-09-10T05:12:04.956901+0000","last_peered":"2024-09-10T05:12:04.956901+0000","last_clean":"2024-09-10T05:12:04.956901+0000","last_became_active":"2024-09-10T05:11:27.725852+0000","last_became_peered":"2024-09-10T05:11:27.725852+0000","last_unstale":"2024-09-10T05:12:04.956901+0000","last_undegraded":"2024-09-10T05:12:04.956901+0000","last_fullsized":"2024-09-10T05:12:04.956901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:25.585863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957204+0000","last_change":"2024-09-10T05:11:31.734106+0000","last_active":"2024-09-10T05:12:04.957204+0000","last_peered":"2024-09-10T05:12:04.957204+0000","last_clean":"2024-09-10T05:12:04.957204+0000","last_became_active":"2024-09-10T05:11:31.733756+0000","last_became_peered":"2024-09-10T05:11:31.733756+0000","last_unstale":"2024-09-10T05:12:04.957204+0000","last_undegraded":"2024-09-10T05:12:04.957204+0000","last_fullsized":"2024-09-10T05:12:04.957204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:20.576939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'41","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.132623+0000","last_change":"2024-09-10T05:11:33.742119+0000","last_active":"2024-09-10T05:14:43.132623+0000","last_peered":"2024-09-10T05:14:43.132623+0000","last_clean":"2024-09-10T05:14:43.132623+0000","last_became_active":"2024-09-10T05:11:33.741848+0000","last_became_peered":"2024-09-10T05:11:33.741848+0000","last_unstale":"2024-09-10T05:14:43.132623+0000","last_undegraded":"2024-09-10T05:14:43.132623+0000","last_fullsized":"2024-09-10T05:14:43.132623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:58.109463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'285","reported_seq":455,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.006459+0000","last_change":"2024-09-10T05:11:35.752932+0000","last_active":"2024-09-10T05:14:43.006459+0000","last_peered":"2024-09-10T05:14:43.006459+0000","last_clean":"2024-09-10T05:14:43.006459+0000","last_became_active":"2024-09-10T05:11:35.752511+0000","last_became_peered":"2024-09-10T05:11:35.752511+0000","last_unstale":"2024-09-10T05:14:43.006459+0000","last_undegraded":"2024-09-10T05:14:43.006459+0000","last_fullsized":"2024-09-10T05:14:43.006459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:09.522467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'14","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:43.909368+0000","last_change":"2024-09-10T05:11:37.758779+0000","last_active":"2024-09-10T05:13:43.909368+0000","last_peered":"2024-09-10T05:13:43.909368+0000","last_clean":"2024-09-10T05:13:43.909368+0000","last_became_active":"2024-09-10T05:11:37.758381+0000","last_became_peered":"2024-09-10T05:11:37.758381+0000","last_unstale":"2024-09-10T05:13:43.909368+0000","last_undegraded":"2024-09-10T05:13:43.909368+0000","last_fullsized":"2024-09-10T05:13:43.909368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:32.090333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'14","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417408+0000","last_change":"2024-09-10T05:11:29.722434+0000","last_active":"2024-09-10T05:14:36.417408+0000","last_peered":"2024-09-10T05:14:36.417408+0000","last_clean":"2024-09-10T05:14:36.417408+0000","last_became_active":"2024-09-10T05:11:29.722170+0000","last_became_peered":"2024-09-10T05:11:29.722170+0000","last_unstale":"2024-09-10T05:14:36.417408+0000","last_undegraded":"2024-09-10T05:14:36.417408+0000","last_fullsized":"2024-09-10T05:14:36.417408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.550005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.331217+0000","last_change":"2024-09-10T05:11:27.735604+0000","last_active":"2024-09-10T05:14:36.331217+0000","last_peered":"2024-09-10T05:14:36.331217+0000","last_clean":"2024-09-10T05:14:36.331217+0000","last_became_active":"2024-09-10T05:11:27.732591+0000","last_became_peered":"2024-09-10T05:11:27.732591+0000","last_unstale":"2024-09-10T05:14:36.331217+0000","last_undegraded":"2024-09-10T05:14:36.331217+0000","last_fullsized":"2024-09-10T05:14:36.331217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:31.318349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":418,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:42.987475+0000","last_change":"2024-09-10T05:11:31.735002+0000","last_active":"2024-09-10T05:14:42.987475+0000","last_peered":"2024-09-10T05:14:42.987475+0000","last_clean":"2024-09-10T05:14:42.987475+0000","last_became_active":"2024-09-10T05:11:31.734714+0000","last_became_peered":"2024-09-10T05:11:31.734714+0000","last_unstale":"2024-09-10T05:14:42.987475+0000","last_undegraded":"2024-09-10T05:14:42.987475+0000","last_fullsized":"2024-09-10T05:14:42.987475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:15.409455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958372+0000","last_change":"2024-09-10T05:11:33.747604+0000","last_active":"2024-09-10T05:12:04.958372+0000","last_peered":"2024-09-10T05:12:04.958372+0000","last_clean":"2024-09-10T05:12:04.958372+0000","last_became_active":"2024-09-10T05:11:33.747376+0000","last_became_peered":"2024-09-10T05:11:33.747376+0000","last_unstale":"2024-09-10T05:12:04.958372+0000","last_undegraded":"2024-09-10T05:12:04.958372+0000","last_fullsized":"2024-09-10T05:12:04.958372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:06.584551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'285","reported_seq":466,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.007782+0000","last_change":"2024-09-10T05:11:35.751653+0000","last_active":"2024-09-10T05:14:43.007782+0000","last_peered":"2024-09-10T05:14:43.007782+0000","last_clean":"2024-09-10T05:14:43.007782+0000","last_became_active":"2024-09-10T05:11:35.751352+0000","last_became_peered":"2024-09-10T05:11:35.751352+0000","last_unstale":"2024-09-10T05:14:43.007782+0000","last_undegraded":"2024-09-10T05:14:43.007782+0000","last_fullsized":"2024-09-10T05:14:43.007782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:50.857756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.203681+0000","last_change":"2024-09-10T05:11:37.757022+0000","last_active":"2024-09-10T05:14:36.203681+0000","last_peered":"2024-09-10T05:14:36.203681+0000","last_clean":"2024-09-10T05:14:36.203681+0000","last_became_active":"2024-09-10T05:11:37.756734+0000","last_became_peered":"2024-09-10T05:11:37.756734+0000","last_unstale":"2024-09-10T05:14:36.203681+0000","last_undegraded":"2024-09-10T05:14:36.203681+0000","last_fullsized":"2024-09-10T05:14:36.203681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:18.190348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'24","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382763+0000","last_change":"2024-09-10T05:11:29.735311+0000","last_active":"2024-09-10T05:14:36.382763+0000","last_peered":"2024-09-10T05:14:36.382763+0000","last_clean":"2024-09-10T05:14:36.382763+0000","last_became_active":"2024-09-10T05:11:29.735032+0000","last_became_peered":"2024-09-10T05:11:29.735032+0000","last_unstale":"2024-09-10T05:14:36.382763+0000","last_undegraded":"2024-09-10T05:14:36.382763+0000","last_fullsized":"2024-09-10T05:14:36.382763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:36.894039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.992787+0000","last_change":"2024-09-10T05:11:27.734962+0000","last_active":"2024-09-10T05:14:35.992787+0000","last_peered":"2024-09-10T05:14:35.992787+0000","last_clean":"2024-09-10T05:14:35.992787+0000","last_became_active":"2024-09-10T05:11:27.734204+0000","last_became_peered":"2024-09-10T05:11:27.734204+0000","last_unstale":"2024-09-10T05:14:35.992787+0000","last_undegraded":"2024-09-10T05:14:35.992787+0000","last_fullsized":"2024-09-10T05:14:35.992787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:06.500114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962223+0000","last_change":"2024-09-10T05:11:31.737418+0000","last_active":"2024-09-10T05:12:04.962223+0000","last_peered":"2024-09-10T05:12:04.962223+0000","last_clean":"2024-09-10T05:12:04.962223+0000","last_became_active":"2024-09-10T05:11:31.736841+0000","last_became_peered":"2024-09-10T05:11:31.736841+0000","last_unstale":"2024-09-10T05:12:04.962223+0000","last_undegraded":"2024-09-10T05:12:04.962223+0000","last_fullsized":"2024-09-10T05:12:04.962223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:39.906395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'42","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.084121+0000","last_change":"2024-09-10T05:11:33.744918+0000","last_active":"2024-09-10T05:14:43.084121+0000","last_peered":"2024-09-10T05:14:43.084121+0000","last_clean":"2024-09-10T05:14:43.084121+0000","last_became_active":"2024-09-10T05:11:33.744394+0000","last_became_peered":"2024-09-10T05:11:33.744394+0000","last_unstale":"2024-09-10T05:14:43.084121+0000","last_undegraded":"2024-09-10T05:14:43.084121+0000","last_fullsized":"2024-09-10T05:14:43.084121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:42.791441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959396+0000","last_change":"2024-09-10T05:11:35.750802+0000","last_active":"2024-09-10T05:12:04.959396+0000","last_peered":"2024-09-10T05:12:04.959396+0000","last_clean":"2024-09-10T05:12:04.959396+0000","last_became_active":"2024-09-10T05:11:35.750450+0000","last_became_peered":"2024-09-10T05:11:35.750450+0000","last_unstale":"2024-09-10T05:12:04.959396+0000","last_undegraded":"2024-09-10T05:12:04.959396+0000","last_fullsized":"2024-09-10T05:12:04.959396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:00.422593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'6","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.453623+0000","last_change":"2024-09-10T05:11:37.757621+0000","last_active":"2024-09-10T05:14:36.453623+0000","last_peered":"2024-09-10T05:14:36.453623+0000","last_clean":"2024-09-10T05:14:36.453623+0000","last_became_active":"2024-09-10T05:11:37.757289+0000","last_became_peered":"2024-09-10T05:11:37.757289+0000","last_unstale":"2024-09-10T05:14:36.453623+0000","last_undegraded":"2024-09-10T05:14:36.453623+0000","last_fullsized":"2024-09-10T05:14:36.453623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:57.261211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'8","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417687+0000","last_change":"2024-09-10T05:11:29.734971+0000","last_active":"2024-09-10T05:14:36.417687+0000","last_peered":"2024-09-10T05:14:36.417687+0000","last_clean":"2024-09-10T05:14:36.417687+0000","last_became_active":"2024-09-10T05:11:29.734367+0000","last_became_peered":"2024-09-10T05:11:29.734367+0000","last_unstale":"2024-09-10T05:14:36.417687+0000","last_undegraded":"2024-09-10T05:14:36.417687+0000","last_fullsized":"2024-09-10T05:14:36.417687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:48.993029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957132+0000","last_change":"2024-09-10T05:11:14.294244+0000","last_active":"2024-09-10T05:12:04.957132+0000","last_peered":"2024-09-10T05:12:04.957132+0000","last_clean":"2024-09-10T05:12:04.957132+0000","last_became_active":"2024-09-10T05:11:14.293121+0000","last_became_peered":"2024-09-10T05:11:14.293121+0000","last_unstale":"2024-09-10T05:12:04.957132+0000","last_undegraded":"2024-09-10T05:12:04.957132+0000","last_fullsized":"2024-09-10T05:12:04.957132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:12.494055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:12.494055+0000","last_clean_scrub_stamp":"2024-09-10T05:11:12.494055+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:00.347397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955461+0000","last_change":"2024-09-10T05:11:18.533277+0000","last_active":"2024-09-10T05:12:04.955461+0000","last_peered":"2024-09-10T05:12:04.955461+0000","last_clean":"2024-09-10T05:12:04.955461+0000","last_became_active":"2024-09-10T05:11:16.531926+0000","last_became_peered":"2024-09-10T05:11:16.531926+0000","last_unstale":"2024-09-10T05:12:04.955461+0000","last_undegraded":"2024-09-10T05:12:04.955461+0000","last_fullsized":"2024-09-10T05:12:04.955461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:44.106335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121101,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955445+0000","last_change":"2024-09-10T05:11:27.736386+0000","last_active":"2024-09-10T05:12:04.955445+0000","last_peered":"2024-09-10T05:12:04.955445+0000","last_clean":"2024-09-10T05:12:04.955445+0000","last_became_active":"2024-09-10T05:11:27.735941+0000","last_became_peered":"2024-09-10T05:11:27.735941+0000","last_unstale":"2024-09-10T05:12:04.955445+0000","last_undegraded":"2024-09-10T05:12:04.955445+0000","last_fullsized":"2024-09-10T05:12:04.955445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:05.735103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960299+0000","last_change":"2024-09-10T05:11:31.736397+0000","last_active":"2024-09-10T05:12:04.960299+0000","last_peered":"2024-09-10T05:12:04.960299+0000","last_clean":"2024-09-10T05:12:04.960299+0000","last_became_active":"2024-09-10T05:11:31.736104+0000","last_became_peered":"2024-09-10T05:11:31.736104+0000","last_unstale":"2024-09-10T05:12:04.960299+0000","last_undegraded":"2024-09-10T05:12:04.960299+0000","last_fullsized":"2024-09-10T05:12:04.960299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:58.631203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'94","reported_seq":182,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.117691+0000","last_change":"2024-09-10T05:11:33.744321+0000","last_active":"2024-09-10T05:14:43.117691+0000","last_peered":"2024-09-10T05:14:43.117691+0000","last_clean":"2024-09-10T05:14:43.117691+0000","last_became_active":"2024-09-10T05:11:33.743933+0000","last_became_peered":"2024-09-10T05:11:33.743933+0000","last_unstale":"2024-09-10T05:14:43.117691+0000","last_undegraded":"2024-09-10T05:14:43.117691+0000","last_fullsized":"2024-09-10T05:14:43.117691+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:30.903532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957924+0000","last_change":"2024-09-10T05:11:35.750549+0000","last_active":"2024-09-10T05:12:04.957924+0000","last_peered":"2024-09-10T05:12:04.957924+0000","last_clean":"2024-09-10T05:12:04.957924+0000","last_became_active":"2024-09-10T05:11:35.750248+0000","last_became_peered":"2024-09-10T05:11:35.750248+0000","last_unstale":"2024-09-10T05:12:04.957924+0000","last_undegraded":"2024-09-10T05:12:04.957924+0000","last_fullsized":"2024-09-10T05:12:04.957924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:19.363818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'85","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.427998+0000","last_change":"2024-09-10T05:11:37.755526+0000","last_active":"2024-09-10T05:14:36.427998+0000","last_peered":"2024-09-10T05:14:36.427998+0000","last_clean":"2024-09-10T05:14:36.427998+0000","last_became_active":"2024-09-10T05:11:37.755239+0000","last_became_peered":"2024-09-10T05:11:37.755239+0000","last_unstale":"2024-09-10T05:14:36.427998+0000","last_undegraded":"2024-09-10T05:14:36.427998+0000","last_fullsized":"2024-09-10T05:14:36.427998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:13.536289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.387697+0000","last_change":"2024-09-10T05:11:29.732838+0000","last_active":"2024-09-10T05:14:36.387697+0000","last_peered":"2024-09-10T05:14:36.387697+0000","last_clean":"2024-09-10T05:14:36.387697+0000","last_became_active":"2024-09-10T05:11:29.732560+0000","last_became_peered":"2024-09-10T05:11:29.732560+0000","last_unstale":"2024-09-10T05:14:36.387697+0000","last_undegraded":"2024-09-10T05:14:36.387697+0000","last_fullsized":"2024-09-10T05:14:36.387697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:38.766836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954364+0000","last_change":"2024-09-10T05:11:18.532549+0000","last_active":"2024-09-10T05:12:04.954364+0000","last_peered":"2024-09-10T05:12:04.954364+0000","last_clean":"2024-09-10T05:12:04.954364+0000","last_became_active":"2024-09-10T05:11:16.531911+0000","last_became_peered":"2024-09-10T05:11:16.531911+0000","last_unstale":"2024-09-10T05:12:04.954364+0000","last_undegraded":"2024-09-10T05:12:04.954364+0000","last_fullsized":"2024-09-10T05:12:04.954364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:51:16.716892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039105900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.649449+0000","last_change":"2024-09-10T05:11:27.713561+0000","last_active":"2024-09-10T05:12:09.649449+0000","last_peered":"2024-09-10T05:12:09.649449+0000","last_clean":"2024-09-10T05:12:09.649449+0000","last_became_active":"2024-09-10T05:11:27.713026+0000","last_became_peered":"2024-09-10T05:11:27.713026+0000","last_unstale":"2024-09-10T05:12:09.649449+0000","last_undegraded":"2024-09-10T05:12:09.649449+0000","last_fullsized":"2024-09-10T05:12:09.649449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:55.542748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961506+0000","last_change":"2024-09-10T05:11:31.738104+0000","last_active":"2024-09-10T05:12:04.961506+0000","last_peered":"2024-09-10T05:12:04.961506+0000","last_clean":"2024-09-10T05:12:04.961506+0000","last_became_active":"2024-09-10T05:11:31.737199+0000","last_became_peered":"2024-09-10T05:11:31.737199+0000","last_unstale":"2024-09-10T05:12:04.961506+0000","last_undegraded":"2024-09-10T05:12:04.961506+0000","last_fullsized":"2024-09-10T05:12:04.961506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:08.807684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'292","reported_seq":514,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.145377+0000","last_change":"2024-09-10T05:11:33.744372+0000","last_active":"2024-09-10T05:14:43.145377+0000","last_peered":"2024-09-10T05:14:43.145377+0000","last_clean":"2024-09-10T05:14:43.145377+0000","last_became_active":"2024-09-10T05:11:33.744103+0000","last_became_peered":"2024-09-10T05:11:33.744103+0000","last_unstale":"2024-09-10T05:14:43.145377+0000","last_undegraded":"2024-09-10T05:14:43.145377+0000","last_fullsized":"2024-09-10T05:14:43.145377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:33.869492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":393,"num_read_kb":395,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956847+0000","last_change":"2024-09-10T05:11:35.749117+0000","last_active":"2024-09-10T05:12:04.956847+0000","last_peered":"2024-09-10T05:12:04.956847+0000","last_clean":"2024-09-10T05:12:04.956847+0000","last_became_active":"2024-09-10T05:11:35.748767+0000","last_became_peered":"2024-09-10T05:11:35.748767+0000","last_unstale":"2024-09-10T05:12:04.956847+0000","last_undegraded":"2024-09-10T05:12:04.956847+0000","last_fullsized":"2024-09-10T05:12:04.956847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:02.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.966773+0000","last_change":"2024-09-10T05:11:37.758407+0000","last_active":"2024-09-10T05:12:51.966773+0000","last_peered":"2024-09-10T05:12:51.966773+0000","last_clean":"2024-09-10T05:12:51.966773+0000","last_became_active":"2024-09-10T05:11:37.758114+0000","last_became_peered":"2024-09-10T05:11:37.758114+0000","last_unstale":"2024-09-10T05:12:51.966773+0000","last_undegraded":"2024-09-10T05:12:51.966773+0000","last_fullsized":"2024-09-10T05:12:51.966773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:43.659998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'14","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417308+0000","last_change":"2024-09-10T05:11:29.724542+0000","last_active":"2024-09-10T05:14:36.417308+0000","last_peered":"2024-09-10T05:14:36.417308+0000","last_clean":"2024-09-10T05:14:36.417308+0000","last_became_active":"2024-09-10T05:11:29.723609+0000","last_became_peered":"2024-09-10T05:11:29.723609+0000","last_unstale":"2024-09-10T05:14:36.417308+0000","last_undegraded":"2024-09-10T05:14:36.417308+0000","last_fullsized":"2024-09-10T05:14:36.417308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:37.264959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956636+0000","last_change":"2024-09-10T05:11:18.530458+0000","last_active":"2024-09-10T05:12:04.956636+0000","last_peered":"2024-09-10T05:12:04.956636+0000","last_clean":"2024-09-10T05:12:04.956636+0000","last_became_active":"2024-09-10T05:11:16.530448+0000","last_became_peered":"2024-09-10T05:11:16.530448+0000","last_unstale":"2024-09-10T05:12:04.956636+0000","last_undegraded":"2024-09-10T05:12:04.956636+0000","last_fullsized":"2024-09-10T05:12:04.956636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:12.102135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036982300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.027950+0000","last_change":"2024-09-10T05:11:27.715078+0000","last_active":"2024-09-10T05:14:36.027950+0000","last_peered":"2024-09-10T05:14:36.027950+0000","last_clean":"2024-09-10T05:14:36.027950+0000","last_became_active":"2024-09-10T05:11:27.714299+0000","last_became_peered":"2024-09-10T05:11:27.714299+0000","last_unstale":"2024-09-10T05:14:36.027950+0000","last_undegraded":"2024-09-10T05:14:36.027950+0000","last_fullsized":"2024-09-10T05:14:36.027950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:12.065688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963356+0000","last_change":"2024-09-10T05:11:31.731588+0000","last_active":"2024-09-10T05:12:04.963356+0000","last_peered":"2024-09-10T05:12:04.963356+0000","last_clean":"2024-09-10T05:12:04.963356+0000","last_became_active":"2024-09-10T05:11:31.730978+0000","last_became_peered":"2024-09-10T05:11:31.730978+0000","last_unstale":"2024-09-10T05:12:04.963356+0000","last_undegraded":"2024-09-10T05:12:04.963356+0000","last_fullsized":"2024-09-10T05:12:04.963356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:07.052816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'17","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813393+0000","last_change":"2024-09-10T05:11:33.746382+0000","last_active":"2024-09-10T05:14:31.813393+0000","last_peered":"2024-09-10T05:14:31.813393+0000","last_clean":"2024-09-10T05:14:31.813393+0000","last_became_active":"2024-09-10T05:11:33.746102+0000","last_became_peered":"2024-09-10T05:11:33.746102+0000","last_unstale":"2024-09-10T05:14:31.813393+0000","last_undegraded":"2024-09-10T05:14:31.813393+0000","last_fullsized":"2024-09-10T05:14:31.813393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:53.746336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957971+0000","last_change":"2024-09-10T05:11:35.753872+0000","last_active":"2024-09-10T05:12:04.957971+0000","last_peered":"2024-09-10T05:12:04.957971+0000","last_clean":"2024-09-10T05:12:04.957971+0000","last_became_active":"2024-09-10T05:11:35.753342+0000","last_became_peered":"2024-09-10T05:11:35.753342+0000","last_unstale":"2024-09-10T05:12:04.957971+0000","last_undegraded":"2024-09-10T05:12:04.957971+0000","last_fullsized":"2024-09-10T05:12:04.957971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:37.752504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955113+0000","last_change":"2024-09-10T05:11:37.769011+0000","last_active":"2024-09-10T05:12:04.955113+0000","last_peered":"2024-09-10T05:12:04.955113+0000","last_clean":"2024-09-10T05:12:04.955113+0000","last_became_active":"2024-09-10T05:11:37.767788+0000","last_became_peered":"2024-09-10T05:11:37.767788+0000","last_unstale":"2024-09-10T05:12:04.955113+0000","last_undegraded":"2024-09-10T05:12:04.955113+0000","last_fullsized":"2024-09-10T05:12:04.955113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:55.792983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'6","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417182+0000","last_change":"2024-09-10T05:11:29.727352+0000","last_active":"2024-09-10T05:14:36.417182+0000","last_peered":"2024-09-10T05:14:36.417182+0000","last_clean":"2024-09-10T05:14:36.417182+0000","last_became_active":"2024-09-10T05:11:29.727022+0000","last_became_peered":"2024-09-10T05:11:29.727022+0000","last_unstale":"2024-09-10T05:14:36.417182+0000","last_undegraded":"2024-09-10T05:14:36.417182+0000","last_fullsized":"2024-09-10T05:14:36.417182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:07.042493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955161+0000","last_change":"2024-09-10T05:11:18.533201+0000","last_active":"2024-09-10T05:12:04.955161+0000","last_peered":"2024-09-10T05:12:04.955161+0000","last_clean":"2024-09-10T05:12:04.955161+0000","last_became_active":"2024-09-10T05:11:16.530756+0000","last_became_peered":"2024-09-10T05:11:16.530756+0000","last_unstale":"2024-09-10T05:12:04.955161+0000","last_undegraded":"2024-09-10T05:12:04.955161+0000","last_fullsized":"2024-09-10T05:12:04.955161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:46.741517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047784,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960447+0000","last_change":"2024-09-10T05:11:27.722242+0000","last_active":"2024-09-10T05:12:04.960447+0000","last_peered":"2024-09-10T05:12:04.960447+0000","last_clean":"2024-09-10T05:12:04.960447+0000","last_became_active":"2024-09-10T05:11:27.718333+0000","last_became_peered":"2024-09-10T05:11:27.718333+0000","last_unstale":"2024-09-10T05:12:04.960447+0000","last_undegraded":"2024-09-10T05:12:04.960447+0000","last_fullsized":"2024-09-10T05:12:04.960447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:32.972378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:05.900504+0000","last_change":"2024-09-10T05:12:04.965299+0000","last_active":"2024-09-10T05:12:05.900504+0000","last_peered":"2024-09-10T05:12:05.900504+0000","last_clean":"2024-09-10T05:12:05.900504+0000","last_became_active":"2024-09-10T05:12:04.964996+0000","last_became_peered":"2024-09-10T05:12:04.964996+0000","last_unstale":"2024-09-10T05:12:05.900504+0000","last_undegraded":"2024-09-10T05:12:05.900504+0000","last_fullsized":"2024-09-10T05:12:05.900504+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:02.241258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"37'13","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.691724+0000","last_change":"2024-09-10T05:11:33.743920+0000","last_active":"2024-09-10T05:14:35.691724+0000","last_peered":"2024-09-10T05:14:35.691724+0000","last_clean":"2024-09-10T05:14:35.691724+0000","last_became_active":"2024-09-10T05:11:33.743292+0000","last_became_peered":"2024-09-10T05:11:33.743292+0000","last_unstale":"2024-09-10T05:14:35.691724+0000","last_undegraded":"2024-09-10T05:14:35.691724+0000","last_fullsized":"2024-09-10T05:14:35.691724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:18.442235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960791+0000","last_change":"2024-09-10T05:11:35.752348+0000","last_active":"2024-09-10T05:12:04.960791+0000","last_peered":"2024-09-10T05:12:04.960791+0000","last_clean":"2024-09-10T05:12:04.960791+0000","last_became_active":"2024-09-10T05:11:35.751982+0000","last_became_peered":"2024-09-10T05:11:35.751982+0000","last_unstale":"2024-09-10T05:12:04.960791+0000","last_undegraded":"2024-09-10T05:12:04.960791+0000","last_fullsized":"2024-09-10T05:12:04.960791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:53.013137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.434600+0000","last_change":"2024-09-10T05:11:37.762596+0000","last_active":"2024-09-10T05:13:35.434600+0000","last_peered":"2024-09-10T05:13:35.434600+0000","last_clean":"2024-09-10T05:13:35.434600+0000","last_became_active":"2024-09-10T05:11:37.762327+0000","last_became_peered":"2024-09-10T05:11:37.762327+0000","last_unstale":"2024-09-10T05:13:35.434600+0000","last_undegraded":"2024-09-10T05:13:35.434600+0000","last_fullsized":"2024-09-10T05:13:35.434600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:33.354245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'16","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339389+0000","last_change":"2024-09-10T05:11:29.731028+0000","last_active":"2024-09-10T05:14:36.339389+0000","last_peered":"2024-09-10T05:14:36.339389+0000","last_clean":"2024-09-10T05:14:36.339389+0000","last_became_active":"2024-09-10T05:11:29.730589+0000","last_became_peered":"2024-09-10T05:11:29.730589+0000","last_unstale":"2024-09-10T05:14:36.339389+0000","last_undegraded":"2024-09-10T05:14:36.339389+0000","last_fullsized":"2024-09-10T05:14:36.339389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:05.100041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959159+0000","last_change":"2024-09-10T05:11:27.718564+0000","last_active":"2024-09-10T05:12:04.959159+0000","last_peered":"2024-09-10T05:12:04.959159+0000","last_clean":"2024-09-10T05:12:04.959159+0000","last_became_active":"2024-09-10T05:11:27.716023+0000","last_became_peered":"2024-09-10T05:11:27.716023+0000","last_unstale":"2024-09-10T05:12:04.959159+0000","last_undegraded":"2024-09-10T05:12:04.959159+0000","last_fullsized":"2024-09-10T05:12:04.959159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:47:35.592580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957535+0000","last_change":"2024-09-10T05:11:18.534946+0000","last_active":"2024-09-10T05:12:04.957535+0000","last_peered":"2024-09-10T05:12:04.957535+0000","last_clean":"2024-09-10T05:12:04.957535+0000","last_became_active":"2024-09-10T05:11:16.532795+0000","last_became_peered":"2024-09-10T05:11:16.532795+0000","last_unstale":"2024-09-10T05:12:04.957535+0000","last_undegraded":"2024-09-10T05:12:04.957535+0000","last_fullsized":"2024-09-10T05:12:04.957535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:22.750871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060128199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.586967+0000","last_change":"2024-09-10T05:11:31.734963+0000","last_active":"2024-09-10T05:14:36.586967+0000","last_peered":"2024-09-10T05:14:36.586967+0000","last_clean":"2024-09-10T05:14:36.586967+0000","last_became_active":"2024-09-10T05:11:31.734707+0000","last_became_peered":"2024-09-10T05:11:31.734707+0000","last_unstale":"2024-09-10T05:14:36.586967+0000","last_undegraded":"2024-09-10T05:14:36.586967+0000","last_fullsized":"2024-09-10T05:14:36.586967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:00.334943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'79","reported_seq":159,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.120784+0000","last_change":"2024-09-10T05:11:33.743569+0000","last_active":"2024-09-10T05:14:43.120784+0000","last_peered":"2024-09-10T05:14:43.120784+0000","last_clean":"2024-09-10T05:14:43.120784+0000","last_became_active":"2024-09-10T05:11:33.743238+0000","last_became_peered":"2024-09-10T05:11:33.743238+0000","last_unstale":"2024-09-10T05:14:43.120784+0000","last_undegraded":"2024-09-10T05:14:43.120784+0000","last_fullsized":"2024-09-10T05:14:43.120784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:26.759194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957685+0000","last_change":"2024-09-10T05:11:35.751255+0000","last_active":"2024-09-10T05:12:04.957685+0000","last_peered":"2024-09-10T05:12:04.957685+0000","last_clean":"2024-09-10T05:12:04.957685+0000","last_became_active":"2024-09-10T05:11:35.750830+0000","last_became_peered":"2024-09-10T05:11:35.750830+0000","last_unstale":"2024-09-10T05:12:04.957685+0000","last_undegraded":"2024-09-10T05:12:04.957685+0000","last_fullsized":"2024-09-10T05:12:04.957685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:07.959084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.612283+0000","last_change":"2024-09-10T05:11:37.759212+0000","last_active":"2024-09-10T05:13:35.612283+0000","last_peered":"2024-09-10T05:13:35.612283+0000","last_clean":"2024-09-10T05:13:35.612283+0000","last_became_active":"2024-09-10T05:11:37.758971+0000","last_became_peered":"2024-09-10T05:11:37.758971+0000","last_unstale":"2024-09-10T05:13:35.612283+0000","last_undegraded":"2024-09-10T05:13:35.612283+0000","last_fullsized":"2024-09-10T05:13:35.612283+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:10.652277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'14","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116914+0000","last_change":"2024-09-10T05:11:29.730327+0000","last_active":"2024-09-10T05:14:36.116914+0000","last_peered":"2024-09-10T05:14:36.116914+0000","last_clean":"2024-09-10T05:14:36.116914+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:14:36.116914+0000","last_undegraded":"2024-09-10T05:14:36.116914+0000","last_fullsized":"2024-09-10T05:14:36.116914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:07.743055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958331+0000","last_change":"2024-09-10T05:11:27.719090+0000","last_active":"2024-09-10T05:12:04.958331+0000","last_peered":"2024-09-10T05:12:04.958331+0000","last_clean":"2024-09-10T05:12:04.958331+0000","last_became_active":"2024-09-10T05:11:27.718756+0000","last_became_peered":"2024-09-10T05:11:27.718756+0000","last_unstale":"2024-09-10T05:12:04.958331+0000","last_undegraded":"2024-09-10T05:12:04.958331+0000","last_fullsized":"2024-09-10T05:12:04.958331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:48.332632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957276+0000","last_change":"2024-09-10T05:11:18.532627+0000","last_active":"2024-09-10T05:12:04.957276+0000","last_peered":"2024-09-10T05:12:04.957276+0000","last_clean":"2024-09-10T05:12:04.957276+0000","last_became_active":"2024-09-10T05:11:16.530746+0000","last_became_peered":"2024-09-10T05:11:16.530746+0000","last_unstale":"2024-09-10T05:12:04.957276+0000","last_undegraded":"2024-09-10T05:12:04.957276+0000","last_fullsized":"2024-09-10T05:12:04.957276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:33.333497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048256999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955118+0000","last_change":"2024-09-10T05:11:31.734598+0000","last_active":"2024-09-10T05:12:04.955118+0000","last_peered":"2024-09-10T05:12:04.955118+0000","last_clean":"2024-09-10T05:12:04.955118+0000","last_became_active":"2024-09-10T05:11:31.734333+0000","last_became_peered":"2024-09-10T05:11:31.734333+0000","last_unstale":"2024-09-10T05:12:04.955118+0000","last_undegraded":"2024-09-10T05:12:04.955118+0000","last_fullsized":"2024-09-10T05:12:04.955118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:04.362140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958360+0000","last_change":"2024-09-10T05:11:33.744326+0000","last_active":"2024-09-10T05:12:04.958360+0000","last_peered":"2024-09-10T05:12:04.958360+0000","last_clean":"2024-09-10T05:12:04.958360+0000","last_became_active":"2024-09-10T05:11:33.744011+0000","last_became_peered":"2024-09-10T05:11:33.744011+0000","last_unstale":"2024-09-10T05:12:04.958360+0000","last_undegraded":"2024-09-10T05:12:04.958360+0000","last_fullsized":"2024-09-10T05:12:04.958360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:25:21.898677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'285","reported_seq":349,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.003922+0000","last_change":"2024-09-10T05:11:35.743851+0000","last_active":"2024-09-10T05:14:43.003922+0000","last_peered":"2024-09-10T05:14:43.003922+0000","last_clean":"2024-09-10T05:14:43.003922+0000","last_became_active":"2024-09-10T05:11:35.743571+0000","last_became_peered":"2024-09-10T05:11:35.743571+0000","last_unstale":"2024-09-10T05:14:43.003922+0000","last_undegraded":"2024-09-10T05:14:43.003922+0000","last_fullsized":"2024-09-10T05:14:43.003922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.416572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.602302+0000","last_change":"2024-09-10T05:11:37.764931+0000","last_active":"2024-09-10T05:13:32.602302+0000","last_peered":"2024-09-10T05:13:32.602302+0000","last_clean":"2024-09-10T05:13:32.602302+0000","last_became_active":"2024-09-10T05:11:37.764657+0000","last_became_peered":"2024-09-10T05:11:37.764657+0000","last_unstale":"2024-09-10T05:13:32.602302+0000","last_undegraded":"2024-09-10T05:13:32.602302+0000","last_fullsized":"2024-09-10T05:13:32.602302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:33.836899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382938+0000","last_change":"2024-09-10T05:11:29.735974+0000","last_active":"2024-09-10T05:14:36.382938+0000","last_peered":"2024-09-10T05:14:36.382938+0000","last_clean":"2024-09-10T05:14:36.382938+0000","last_became_active":"2024-09-10T05:11:29.734731+0000","last_became_peered":"2024-09-10T05:11:29.734731+0000","last_unstale":"2024-09-10T05:14:36.382938+0000","last_undegraded":"2024-09-10T05:14:36.382938+0000","last_fullsized":"2024-09-10T05:14:36.382938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:47.453260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961339+0000","last_change":"2024-09-10T05:11:27.723646+0000","last_active":"2024-09-10T05:12:04.961339+0000","last_peered":"2024-09-10T05:12:04.961339+0000","last_clean":"2024-09-10T05:12:04.961339+0000","last_became_active":"2024-09-10T05:11:27.723268+0000","last_became_peered":"2024-09-10T05:11:27.723268+0000","last_unstale":"2024-09-10T05:12:04.961339+0000","last_undegraded":"2024-09-10T05:12:04.961339+0000","last_fullsized":"2024-09-10T05:12:04.961339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:31.006213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958152+0000","last_change":"2024-09-10T05:11:18.534977+0000","last_active":"2024-09-10T05:12:04.958152+0000","last_peered":"2024-09-10T05:12:04.958152+0000","last_clean":"2024-09-10T05:12:04.958152+0000","last_became_active":"2024-09-10T05:11:16.531550+0000","last_became_peered":"2024-09-10T05:11:16.531550+0000","last_unstale":"2024-09-10T05:12:04.958152+0000","last_undegraded":"2024-09-10T05:12:04.958152+0000","last_fullsized":"2024-09-10T05:12:04.958152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:22.160358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063503699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955664+0000","last_change":"2024-09-10T05:11:31.734677+0000","last_active":"2024-09-10T05:12:04.955664+0000","last_peered":"2024-09-10T05:12:04.955664+0000","last_clean":"2024-09-10T05:12:04.955664+0000","last_became_active":"2024-09-10T05:11:31.734310+0000","last_became_peered":"2024-09-10T05:11:31.734310+0000","last_unstale":"2024-09-10T05:12:04.955664+0000","last_undegraded":"2024-09-10T05:12:04.955664+0000","last_fullsized":"2024-09-10T05:12:04.955664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:04.152181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'17","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.669838+0000","last_change":"2024-09-10T05:11:33.748918+0000","last_active":"2024-09-10T05:12:09.669838+0000","last_peered":"2024-09-10T05:12:09.669838+0000","last_clean":"2024-09-10T05:12:09.669838+0000","last_became_active":"2024-09-10T05:11:33.748603+0000","last_became_peered":"2024-09-10T05:11:33.748603+0000","last_unstale":"2024-09-10T05:12:09.669838+0000","last_undegraded":"2024-09-10T05:12:09.669838+0000","last_fullsized":"2024-09-10T05:12:09.669838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:30.495078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":392,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.009007+0000","last_change":"2024-09-10T05:11:35.746066+0000","last_active":"2024-09-10T05:14:43.009007+0000","last_peered":"2024-09-10T05:14:43.009007+0000","last_clean":"2024-09-10T05:14:43.009007+0000","last_became_active":"2024-09-10T05:11:35.745807+0000","last_became_peered":"2024-09-10T05:11:35.745807+0000","last_unstale":"2024-09-10T05:14:43.009007+0000","last_undegraded":"2024-09-10T05:14:43.009007+0000","last_fullsized":"2024-09-10T05:14:43.009007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:15.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960007+0000","last_change":"2024-09-10T05:11:37.762669+0000","last_active":"2024-09-10T05:12:04.960007+0000","last_peered":"2024-09-10T05:12:04.960007+0000","last_clean":"2024-09-10T05:12:04.960007+0000","last_became_active":"2024-09-10T05:11:37.762407+0000","last_became_peered":"2024-09-10T05:11:37.762407+0000","last_unstale":"2024-09-10T05:12:04.960007+0000","last_undegraded":"2024-09-10T05:12:04.960007+0000","last_fullsized":"2024-09-10T05:12:04.960007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:01.260628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.199374+0000","last_change":"2024-09-10T05:11:29.730717+0000","last_active":"2024-09-10T05:14:36.199374+0000","last_peered":"2024-09-10T05:14:36.199374+0000","last_clean":"2024-09-10T05:14:36.199374+0000","last_became_active":"2024-09-10T05:11:29.730285+0000","last_became_peered":"2024-09-10T05:11:29.730285+0000","last_unstale":"2024-09-10T05:14:36.199374+0000","last_undegraded":"2024-09-10T05:14:36.199374+0000","last_fullsized":"2024-09-10T05:14:36.199374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:27.593815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.999868+0000","last_change":"2024-09-10T05:11:27.731410+0000","last_active":"2024-09-10T05:14:35.999868+0000","last_peered":"2024-09-10T05:14:35.999868+0000","last_clean":"2024-09-10T05:14:35.999868+0000","last_became_active":"2024-09-10T05:11:27.731108+0000","last_became_peered":"2024-09-10T05:11:27.731108+0000","last_unstale":"2024-09-10T05:14:35.999868+0000","last_undegraded":"2024-09-10T05:14:35.999868+0000","last_fullsized":"2024-09-10T05:14:35.999868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:36.345654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960717+0000","last_change":"2024-09-10T05:11:18.533507+0000","last_active":"2024-09-10T05:12:04.960717+0000","last_peered":"2024-09-10T05:12:04.960717+0000","last_clean":"2024-09-10T05:12:04.960717+0000","last_became_active":"2024-09-10T05:11:16.531468+0000","last_became_peered":"2024-09-10T05:11:16.531468+0000","last_unstale":"2024-09-10T05:12:04.960717+0000","last_undegraded":"2024-09-10T05:12:04.960717+0000","last_fullsized":"2024-09-10T05:12:04.960717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:15.517245+0000","last_clean_scrub_stamp":"2024-09-10T05:11:15.517245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:30:18.685084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001329722,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:31.733033+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:31.732753+0000","last_became_peered":"2024-09-10T05:11:31.732753+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:51.417779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'97","reported_seq":188,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.147368+0000","last_change":"2024-09-10T05:11:33.744480+0000","last_active":"2024-09-10T05:14:43.147368+0000","last_peered":"2024-09-10T05:14:43.147368+0000","last_clean":"2024-09-10T05:14:43.147368+0000","last_became_active":"2024-09-10T05:11:33.744217+0000","last_became_peered":"2024-09-10T05:11:33.744217+0000","last_unstale":"2024-09-10T05:14:43.147368+0000","last_undegraded":"2024-09-10T05:14:43.147368+0000","last_fullsized":"2024-09-10T05:14:43.147368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:27.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957339+0000","last_change":"2024-09-10T05:11:35.748212+0000","last_active":"2024-09-10T05:12:04.957339+0000","last_peered":"2024-09-10T05:12:04.957339+0000","last_clean":"2024-09-10T05:12:04.957339+0000","last_became_active":"2024-09-10T05:11:35.747924+0000","last_became_peered":"2024-09-10T05:11:35.747924+0000","last_unstale":"2024-09-10T05:12:04.957339+0000","last_undegraded":"2024-09-10T05:12:04.957339+0000","last_fullsized":"2024-09-10T05:12:04.957339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:15.162433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961201+0000","last_change":"2024-09-10T05:11:37.758521+0000","last_active":"2024-09-10T05:12:04.961201+0000","last_peered":"2024-09-10T05:12:04.961201+0000","last_clean":"2024-09-10T05:12:04.961201+0000","last_became_active":"2024-09-10T05:11:37.757947+0000","last_became_peered":"2024-09-10T05:11:37.757947+0000","last_unstale":"2024-09-10T05:12:04.961201+0000","last_undegraded":"2024-09-10T05:12:04.961201+0000","last_fullsized":"2024-09-10T05:12:04.961201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:42.540458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:52.143036+0000","last_change":"2024-09-10T05:11:37.759509+0000","last_active":"2024-09-10T05:12:52.143036+0000","last_peered":"2024-09-10T05:12:52.143036+0000","last_clean":"2024-09-10T05:12:52.143036+0000","last_became_active":"2024-09-10T05:11:37.759217+0000","last_became_peered":"2024-09-10T05:11:37.759217+0000","last_unstale":"2024-09-10T05:12:52.143036+0000","last_undegraded":"2024-09-10T05:12:52.143036+0000","last_fullsized":"2024-09-10T05:12:52.143036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:30.264676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'12","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116908+0000","last_change":"2024-09-10T05:11:29.730421+0000","last_active":"2024-09-10T05:14:36.116908+0000","last_peered":"2024-09-10T05:14:36.116908+0000","last_clean":"2024-09-10T05:14:36.116908+0000","last_became_active":"2024-09-10T05:11:29.730105+0000","last_became_peered":"2024-09-10T05:11:29.730105+0000","last_unstale":"2024-09-10T05:14:36.116908+0000","last_undegraded":"2024-09-10T05:14:36.116908+0000","last_fullsized":"2024-09-10T05:14:36.116908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:52.776885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.008196+0000","last_change":"2024-09-10T05:11:27.732124+0000","last_active":"2024-09-10T05:14:36.008196+0000","last_peered":"2024-09-10T05:14:36.008196+0000","last_clean":"2024-09-10T05:14:36.008196+0000","last_became_active":"2024-09-10T05:11:27.731634+0000","last_became_peered":"2024-09-10T05:11:27.731634+0000","last_unstale":"2024-09-10T05:14:36.008196+0000","last_undegraded":"2024-09-10T05:14:36.008196+0000","last_fullsized":"2024-09-10T05:14:36.008196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:55.962255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.970384+0000","last_change":"2024-09-10T05:12:04.967896+0000","last_active":"2024-09-10T05:12:04.970384+0000","last_peered":"2024-09-10T05:12:04.970384+0000","last_clean":"2024-09-10T05:12:04.970384+0000","last_became_active":"2024-09-10T05:12:04.967513+0000","last_became_peered":"2024-09-10T05:12:04.967513+0000","last_unstale":"2024-09-10T05:12:04.970384+0000","last_undegraded":"2024-09-10T05:12:04.970384+0000","last_fullsized":"2024-09-10T05:12:04.970384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:00.790327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'42","reported_seq":96,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.095775+0000","last_change":"2024-09-10T05:11:33.745631+0000","last_active":"2024-09-10T05:14:43.095775+0000","last_peered":"2024-09-10T05:14:43.095775+0000","last_clean":"2024-09-10T05:14:43.095775+0000","last_became_active":"2024-09-10T05:11:33.745347+0000","last_became_peered":"2024-09-10T05:11:33.745347+0000","last_unstale":"2024-09-10T05:14:43.095775+0000","last_undegraded":"2024-09-10T05:14:43.095775+0000","last_fullsized":"2024-09-10T05:14:43.095775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:36.538308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954872+0000","last_change":"2024-09-10T05:11:35.754614+0000","last_active":"2024-09-10T05:12:04.954872+0000","last_peered":"2024-09-10T05:12:04.954872+0000","last_clean":"2024-09-10T05:12:04.954872+0000","last_became_active":"2024-09-10T05:11:35.754318+0000","last_became_peered":"2024-09-10T05:11:35.754318+0000","last_unstale":"2024-09-10T05:12:04.954872+0000","last_undegraded":"2024-09-10T05:12:04.954872+0000","last_fullsized":"2024-09-10T05:12:04.954872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:32.929275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:33.971128+0000","last_change":"2024-09-10T05:11:37.760662+0000","last_active":"2024-09-10T05:13:33.971128+0000","last_peered":"2024-09-10T05:13:33.971128+0000","last_clean":"2024-09-10T05:13:33.971128+0000","last_became_active":"2024-09-10T05:11:37.760471+0000","last_became_peered":"2024-09-10T05:11:37.760471+0000","last_unstale":"2024-09-10T05:13:33.971128+0000","last_undegraded":"2024-09-10T05:13:33.971128+0000","last_fullsized":"2024-09-10T05:13:33.971128+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:16.361621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.346649+0000","last_change":"2024-09-10T05:11:29.727844+0000","last_active":"2024-09-10T05:14:36.346649+0000","last_peered":"2024-09-10T05:14:36.346649+0000","last_clean":"2024-09-10T05:14:36.346649+0000","last_became_active":"2024-09-10T05:11:29.727550+0000","last_became_peered":"2024-09-10T05:11:29.727550+0000","last_unstale":"2024-09-10T05:14:36.346649+0000","last_undegraded":"2024-09-10T05:14:36.346649+0000","last_fullsized":"2024-09-10T05:14:36.346649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:05.037792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563704+0000","last_change":"2024-09-10T05:11:27.724954+0000","last_active":"2024-09-10T05:12:08.563704+0000","last_peered":"2024-09-10T05:12:08.563704+0000","last_clean":"2024-09-10T05:12:08.563704+0000","last_became_active":"2024-09-10T05:11:27.724637+0000","last_became_peered":"2024-09-10T05:11:27.724637+0000","last_unstale":"2024-09-10T05:12:08.563704+0000","last_undegraded":"2024-09-10T05:12:08.563704+0000","last_fullsized":"2024-09-10T05:12:08.563704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:06.669117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956587+0000","last_change":"2024-09-10T05:11:31.737152+0000","last_active":"2024-09-10T05:12:04.956587+0000","last_peered":"2024-09-10T05:12:04.956587+0000","last_clean":"2024-09-10T05:12:04.956587+0000","last_became_active":"2024-09-10T05:11:31.736758+0000","last_became_peered":"2024-09-10T05:11:31.736758+0000","last_unstale":"2024-09-10T05:12:04.956587+0000","last_undegraded":"2024-09-10T05:12:04.956587+0000","last_fullsized":"2024-09-10T05:12:04.956587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:07.236386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'6","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.711356+0000","last_change":"2024-09-10T05:11:33.742432+0000","last_active":"2024-09-10T05:14:35.711356+0000","last_peered":"2024-09-10T05:14:35.711356+0000","last_clean":"2024-09-10T05:14:35.711356+0000","last_became_active":"2024-09-10T05:11:33.742039+0000","last_became_peered":"2024-09-10T05:11:33.742039+0000","last_unstale":"2024-09-10T05:14:35.711356+0000","last_undegraded":"2024-09-10T05:14:35.711356+0000","last_fullsized":"2024-09-10T05:14:35.711356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:31.077478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956813+0000","last_change":"2024-09-10T05:11:35.751536+0000","last_active":"2024-09-10T05:12:04.956813+0000","last_peered":"2024-09-10T05:12:04.956813+0000","last_clean":"2024-09-10T05:12:04.956813+0000","last_became_active":"2024-09-10T05:11:35.751244+0000","last_became_peered":"2024-09-10T05:11:35.751244+0000","last_unstale":"2024-09-10T05:12:04.956813+0000","last_undegraded":"2024-09-10T05:12:04.956813+0000","last_fullsized":"2024-09-10T05:12:04.956813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.673711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.676093+0000","last_change":"2024-09-10T05:11:37.755735+0000","last_active":"2024-09-10T05:13:35.676093+0000","last_peered":"2024-09-10T05:13:35.676093+0000","last_clean":"2024-09-10T05:13:35.676093+0000","last_became_active":"2024-09-10T05:11:37.755533+0000","last_became_peered":"2024-09-10T05:11:37.755533+0000","last_unstale":"2024-09-10T05:13:35.676093+0000","last_undegraded":"2024-09-10T05:13:35.676093+0000","last_fullsized":"2024-09-10T05:13:35.676093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:37.895455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604904+0000","last_change":"2024-09-10T05:11:29.727735+0000","last_active":"2024-09-10T05:13:32.604904+0000","last_peered":"2024-09-10T05:13:32.604904+0000","last_clean":"2024-09-10T05:13:32.604904+0000","last_became_active":"2024-09-10T05:11:29.727400+0000","last_became_peered":"2024-09-10T05:11:29.727400+0000","last_unstale":"2024-09-10T05:13:32.604904+0000","last_undegraded":"2024-09-10T05:13:32.604904+0000","last_fullsized":"2024-09-10T05:13:32.604904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:52.691912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.328244+0000","last_change":"2024-09-10T05:11:27.728450+0000","last_active":"2024-09-10T05:14:36.328244+0000","last_peered":"2024-09-10T05:14:36.328244+0000","last_clean":"2024-09-10T05:14:36.328244+0000","last_became_active":"2024-09-10T05:11:27.727561+0000","last_became_peered":"2024-09-10T05:11:27.727561+0000","last_unstale":"2024-09-10T05:14:36.328244+0000","last_undegraded":"2024-09-10T05:14:36.328244+0000","last_fullsized":"2024-09-10T05:14:36.328244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:09.173780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"28'1","reported_seq":221,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:42.978337+0000","last_change":"2024-09-10T05:11:31.734288+0000","last_active":"2024-09-10T05:14:42.978337+0000","last_peered":"2024-09-10T05:14:42.978337+0000","last_clean":"2024-09-10T05:14:42.978337+0000","last_became_active":"2024-09-10T05:11:31.733793+0000","last_became_peered":"2024-09-10T05:11:31.733793+0000","last_unstale":"2024-09-10T05:14:42.978337+0000","last_undegraded":"2024-09-10T05:14:42.978337+0000","last_fullsized":"2024-09-10T05:14:42.978337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:15.305550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'45","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.063098+0000","last_change":"2024-09-10T05:11:33.744948+0000","last_active":"2024-09-10T05:14:43.063098+0000","last_peered":"2024-09-10T05:14:43.063098+0000","last_clean":"2024-09-10T05:14:43.063098+0000","last_became_active":"2024-09-10T05:11:33.744634+0000","last_became_peered":"2024-09-10T05:11:33.744634+0000","last_unstale":"2024-09-10T05:14:43.063098+0000","last_undegraded":"2024-09-10T05:14:43.063098+0000","last_fullsized":"2024-09-10T05:14:43.063098+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:09.908383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959076+0000","last_change":"2024-09-10T05:11:35.748666+0000","last_active":"2024-09-10T05:12:04.959076+0000","last_peered":"2024-09-10T05:12:04.959076+0000","last_clean":"2024-09-10T05:12:04.959076+0000","last_became_active":"2024-09-10T05:11:35.748406+0000","last_became_peered":"2024-09-10T05:11:35.748406+0000","last_unstale":"2024-09-10T05:12:04.959076+0000","last_undegraded":"2024-09-10T05:12:04.959076+0000","last_fullsized":"2024-09-10T05:12:04.959076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:01.833099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.370496+0000","last_change":"2024-09-10T05:11:37.765627+0000","last_active":"2024-09-10T05:14:36.370496+0000","last_peered":"2024-09-10T05:14:36.370496+0000","last_clean":"2024-09-10T05:14:36.370496+0000","last_became_active":"2024-09-10T05:11:37.765188+0000","last_became_peered":"2024-09-10T05:11:37.765188+0000","last_unstale":"2024-09-10T05:14:36.370496+0000","last_undegraded":"2024-09-10T05:14:36.370496+0000","last_fullsized":"2024-09-10T05:14:36.370496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:35.729959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954466+0000","last_change":"2024-09-10T05:11:29.736060+0000","last_active":"2024-09-10T05:12:04.954466+0000","last_peered":"2024-09-10T05:12:04.954466+0000","last_clean":"2024-09-10T05:12:04.954466+0000","last_became_active":"2024-09-10T05:11:29.735101+0000","last_became_peered":"2024-09-10T05:11:29.735101+0000","last_unstale":"2024-09-10T05:12:04.954466+0000","last_undegraded":"2024-09-10T05:12:04.954466+0000","last_fullsized":"2024-09-10T05:12:04.954466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:46.282001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962997+0000","last_change":"2024-09-10T05:11:27.716910+0000","last_active":"2024-09-10T05:12:04.962997+0000","last_peered":"2024-09-10T05:12:04.962997+0000","last_clean":"2024-09-10T05:12:04.962997+0000","last_became_active":"2024-09-10T05:11:27.715729+0000","last_became_peered":"2024-09-10T05:11:27.715729+0000","last_unstale":"2024-09-10T05:12:04.962997+0000","last_undegraded":"2024-09-10T05:12:04.962997+0000","last_fullsized":"2024-09-10T05:12:04.962997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:34.486986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954515+0000","last_change":"2024-09-10T05:11:31.732767+0000","last_active":"2024-09-10T05:12:04.954515+0000","last_peered":"2024-09-10T05:12:04.954515+0000","last_clean":"2024-09-10T05:12:04.954515+0000","last_became_active":"2024-09-10T05:11:31.732476+0000","last_became_peered":"2024-09-10T05:11:31.732476+0000","last_unstale":"2024-09-10T05:12:04.954515+0000","last_undegraded":"2024-09-10T05:12:04.954515+0000","last_fullsized":"2024-09-10T05:12:04.954515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:22.178149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'34","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.054428+0000","last_change":"2024-09-10T05:11:33.742425+0000","last_active":"2024-09-10T05:14:43.054428+0000","last_peered":"2024-09-10T05:14:43.054428+0000","last_clean":"2024-09-10T05:14:43.054428+0000","last_became_active":"2024-09-10T05:11:33.740483+0000","last_became_peered":"2024-09-10T05:11:33.740483+0000","last_unstale":"2024-09-10T05:14:43.054428+0000","last_undegraded":"2024-09-10T05:14:43.054428+0000","last_fullsized":"2024-09-10T05:14:43.054428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:21.633618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960060+0000","last_change":"2024-09-10T05:11:35.746206+0000","last_active":"2024-09-10T05:12:04.960060+0000","last_peered":"2024-09-10T05:12:04.960060+0000","last_clean":"2024-09-10T05:12:04.960060+0000","last_became_active":"2024-09-10T05:11:35.745886+0000","last_became_peered":"2024-09-10T05:11:35.745886+0000","last_unstale":"2024-09-10T05:12:04.960060+0000","last_undegraded":"2024-09-10T05:12:04.960060+0000","last_fullsized":"2024-09-10T05:12:04.960060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:38.963303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.109858+0000","last_change":"2024-09-10T05:11:29.732079+0000","last_active":"2024-09-10T05:14:36.109858+0000","last_peered":"2024-09-10T05:14:36.109858+0000","last_clean":"2024-09-10T05:14:36.109858+0000","last_became_active":"2024-09-10T05:11:29.731824+0000","last_became_peered":"2024-09-10T05:11:29.731824+0000","last_unstale":"2024-09-10T05:14:36.109858+0000","last_undegraded":"2024-09-10T05:14:36.109858+0000","last_fullsized":"2024-09-10T05:14:36.109858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:53.060402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954430+0000","last_change":"2024-09-10T05:11:27.735230+0000","last_active":"2024-09-10T05:12:04.954430+0000","last_peered":"2024-09-10T05:12:04.954430+0000","last_clean":"2024-09-10T05:12:04.954430+0000","last_became_active":"2024-09-10T05:11:27.734652+0000","last_became_peered":"2024-09-10T05:11:27.734652+0000","last_unstale":"2024-09-10T05:12:04.954430+0000","last_undegraded":"2024-09-10T05:12:04.954430+0000","last_fullsized":"2024-09-10T05:12:04.954430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:41.386631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959243+0000","last_change":"2024-09-10T05:11:31.735122+0000","last_active":"2024-09-10T05:12:04.959243+0000","last_peered":"2024-09-10T05:12:04.959243+0000","last_clean":"2024-09-10T05:12:04.959243+0000","last_became_active":"2024-09-10T05:11:31.734774+0000","last_became_peered":"2024-09-10T05:11:31.734774+0000","last_unstale":"2024-09-10T05:12:04.959243+0000","last_undegraded":"2024-09-10T05:12:04.959243+0000","last_fullsized":"2024-09-10T05:12:04.959243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:38.074776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'66","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.157107+0000","last_change":"2024-09-10T05:11:33.741409+0000","last_active":"2024-09-10T05:14:43.157107+0000","last_peered":"2024-09-10T05:14:43.157107+0000","last_clean":"2024-09-10T05:14:43.157107+0000","last_became_active":"2024-09-10T05:11:33.741136+0000","last_became_peered":"2024-09-10T05:11:33.741136+0000","last_unstale":"2024-09-10T05:14:43.157107+0000","last_undegraded":"2024-09-10T05:14:43.157107+0000","last_fullsized":"2024-09-10T05:14:43.157107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:48.815209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958544+0000","last_change":"2024-09-10T05:11:35.746094+0000","last_active":"2024-09-10T05:12:04.958544+0000","last_peered":"2024-09-10T05:12:04.958544+0000","last_clean":"2024-09-10T05:12:04.958544+0000","last_became_active":"2024-09-10T05:11:35.745795+0000","last_became_peered":"2024-09-10T05:11:35.745795+0000","last_unstale":"2024-09-10T05:12:04.958544+0000","last_undegraded":"2024-09-10T05:12:04.958544+0000","last_fullsized":"2024-09-10T05:12:04.958544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:43.698313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.609239+0000","last_change":"2024-09-10T05:11:37.758689+0000","last_active":"2024-09-10T05:13:35.609239+0000","last_peered":"2024-09-10T05:13:35.609239+0000","last_clean":"2024-09-10T05:13:35.609239+0000","last_became_active":"2024-09-10T05:11:37.758360+0000","last_became_peered":"2024-09-10T05:11:37.758360+0000","last_unstale":"2024-09-10T05:13:35.609239+0000","last_undegraded":"2024-09-10T05:13:35.609239+0000","last_fullsized":"2024-09-10T05:13:35.609239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:10.895588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'9","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.423853+0000","last_change":"2024-09-10T05:11:29.725587+0000","last_active":"2024-09-10T05:14:36.423853+0000","last_peered":"2024-09-10T05:14:36.423853+0000","last_clean":"2024-09-10T05:14:36.423853+0000","last_became_active":"2024-09-10T05:11:29.723722+0000","last_became_peered":"2024-09-10T05:11:29.723722+0000","last_unstale":"2024-09-10T05:14:36.423853+0000","last_undegraded":"2024-09-10T05:14:36.423853+0000","last_fullsized":"2024-09-10T05:14:36.423853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:27.494677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957932+0000","last_change":"2024-09-10T05:11:27.728290+0000","last_active":"2024-09-10T05:12:04.957932+0000","last_peered":"2024-09-10T05:12:04.957932+0000","last_clean":"2024-09-10T05:12:04.957932+0000","last_became_active":"2024-09-10T05:11:27.727770+0000","last_became_peered":"2024-09-10T05:11:27.727770+0000","last_unstale":"2024-09-10T05:12:04.957932+0000","last_undegraded":"2024-09-10T05:12:04.957932+0000","last_fullsized":"2024-09-10T05:12:04.957932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:49.547692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962377+0000","last_change":"2024-09-10T05:11:31.728930+0000","last_active":"2024-09-10T05:12:04.962377+0000","last_peered":"2024-09-10T05:12:04.962377+0000","last_clean":"2024-09-10T05:12:04.962377+0000","last_became_active":"2024-09-10T05:11:31.728653+0000","last_became_peered":"2024-09-10T05:11:31.728653+0000","last_unstale":"2024-09-10T05:12:04.962377+0000","last_undegraded":"2024-09-10T05:12:04.962377+0000","last_fullsized":"2024-09-10T05:12:04.962377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:11:50.575895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.057351+0000","last_change":"2024-09-10T05:11:33.743527+0000","last_active":"2024-09-10T05:14:43.057351+0000","last_peered":"2024-09-10T05:14:43.057351+0000","last_clean":"2024-09-10T05:14:43.057351+0000","last_became_active":"2024-09-10T05:11:33.743048+0000","last_became_peered":"2024-09-10T05:11:33.743048+0000","last_unstale":"2024-09-10T05:14:43.057351+0000","last_undegraded":"2024-09-10T05:14:43.057351+0000","last_fullsized":"2024-09-10T05:14:43.057351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:52:59.505330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960230+0000","last_change":"2024-09-10T05:11:35.753237+0000","last_active":"2024-09-10T05:12:04.960230+0000","last_peered":"2024-09-10T05:12:04.960230+0000","last_clean":"2024-09-10T05:12:04.960230+0000","last_became_active":"2024-09-10T05:11:35.752971+0000","last_became_peered":"2024-09-10T05:11:35.752971+0000","last_unstale":"2024-09-10T05:12:04.960230+0000","last_undegraded":"2024-09-10T05:12:04.960230+0000","last_fullsized":"2024-09-10T05:12:04.960230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:16.416535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954464+0000","last_change":"2024-09-10T05:11:37.768354+0000","last_active":"2024-09-10T05:12:04.954464+0000","last_peered":"2024-09-10T05:12:04.954464+0000","last_clean":"2024-09-10T05:12:04.954464+0000","last_became_active":"2024-09-10T05:11:37.768036+0000","last_became_peered":"2024-09-10T05:11:37.768036+0000","last_unstale":"2024-09-10T05:12:04.954464+0000","last_undegraded":"2024-09-10T05:12:04.954464+0000","last_fullsized":"2024-09-10T05:12:04.954464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:28.716788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'3","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.210570+0000","last_change":"2024-09-10T05:11:29.735292+0000","last_active":"2024-09-10T05:14:36.210570+0000","last_peered":"2024-09-10T05:14:36.210570+0000","last_clean":"2024-09-10T05:14:36.210570+0000","last_became_active":"2024-09-10T05:11:29.734714+0000","last_became_peered":"2024-09-10T05:11:29.734714+0000","last_unstale":"2024-09-10T05:14:36.210570+0000","last_undegraded":"2024-09-10T05:14:36.210570+0000","last_fullsized":"2024-09-10T05:14:36.210570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:28.419157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.564082+0000","last_change":"2024-09-10T05:11:27.718573+0000","last_active":"2024-09-10T05:12:08.564082+0000","last_peered":"2024-09-10T05:12:08.564082+0000","last_clean":"2024-09-10T05:12:08.564082+0000","last_became_active":"2024-09-10T05:11:27.718251+0000","last_became_peered":"2024-09-10T05:11:27.718251+0000","last_unstale":"2024-09-10T05:12:08.564082+0000","last_undegraded":"2024-09-10T05:12:08.564082+0000","last_fullsized":"2024-09-10T05:12:08.564082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:05.213355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958875+0000","last_change":"2024-09-10T05:11:31.728291+0000","last_active":"2024-09-10T05:12:04.958875+0000","last_peered":"2024-09-10T05:12:04.958875+0000","last_clean":"2024-09-10T05:12:04.958875+0000","last_became_active":"2024-09-10T05:11:31.727998+0000","last_became_peered":"2024-09-10T05:11:31.727998+0000","last_unstale":"2024-09-10T05:12:04.958875+0000","last_undegraded":"2024-09-10T05:12:04.958875+0000","last_fullsized":"2024-09-10T05:12:04.958875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:33.243917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'41","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.107513+0000","last_change":"2024-09-10T05:11:33.742831+0000","last_active":"2024-09-10T05:14:43.107513+0000","last_peered":"2024-09-10T05:14:43.107513+0000","last_clean":"2024-09-10T05:14:43.107513+0000","last_became_active":"2024-09-10T05:11:33.742594+0000","last_became_peered":"2024-09-10T05:11:33.742594+0000","last_unstale":"2024-09-10T05:14:43.107513+0000","last_undegraded":"2024-09-10T05:14:43.107513+0000","last_fullsized":"2024-09-10T05:14:43.107513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:54.003296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957834+0000","last_change":"2024-09-10T05:11:35.748750+0000","last_active":"2024-09-10T05:12:04.957834+0000","last_peered":"2024-09-10T05:12:04.957834+0000","last_clean":"2024-09-10T05:12:04.957834+0000","last_became_active":"2024-09-10T05:11:35.748464+0000","last_became_peered":"2024-09-10T05:11:35.748464+0000","last_unstale":"2024-09-10T05:12:04.957834+0000","last_undegraded":"2024-09-10T05:12:04.957834+0000","last_fullsized":"2024-09-10T05:12:04.957834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:02:44.003459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.674549+0000","last_change":"2024-09-10T05:11:37.768552+0000","last_active":"2024-09-10T05:13:35.674549+0000","last_peered":"2024-09-10T05:13:35.674549+0000","last_clean":"2024-09-10T05:13:35.674549+0000","last_became_active":"2024-09-10T05:11:37.768248+0000","last_became_peered":"2024-09-10T05:11:37.768248+0000","last_unstale":"2024-09-10T05:13:35.674549+0000","last_undegraded":"2024-09-10T05:13:35.674549+0000","last_fullsized":"2024-09-10T05:13:35.674549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:47.039216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.109389+0000","last_change":"2024-09-10T05:11:29.727709+0000","last_active":"2024-09-10T05:14:36.109389+0000","last_peered":"2024-09-10T05:14:36.109389+0000","last_clean":"2024-09-10T05:14:36.109389+0000","last_became_active":"2024-09-10T05:11:29.727038+0000","last_became_peered":"2024-09-10T05:11:29.727038+0000","last_unstale":"2024-09-10T05:14:36.109389+0000","last_undegraded":"2024-09-10T05:14:36.109389+0000","last_fullsized":"2024-09-10T05:14:36.109389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.472157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:52.134013+0000","last_change":"2024-09-10T05:11:27.734905+0000","last_active":"2024-09-10T05:12:52.134013+0000","last_peered":"2024-09-10T05:12:52.134013+0000","last_clean":"2024-09-10T05:12:52.134013+0000","last_became_active":"2024-09-10T05:11:27.733320+0000","last_became_peered":"2024-09-10T05:11:27.733320+0000","last_unstale":"2024-09-10T05:12:52.134013+0000","last_undegraded":"2024-09-10T05:12:52.134013+0000","last_fullsized":"2024-09-10T05:12:52.134013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:27.826216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961436+0000","last_change":"2024-09-10T05:11:31.734989+0000","last_active":"2024-09-10T05:12:04.961436+0000","last_peered":"2024-09-10T05:12:04.961436+0000","last_clean":"2024-09-10T05:12:04.961436+0000","last_became_active":"2024-09-10T05:11:31.734684+0000","last_became_peered":"2024-09-10T05:11:31.734684+0000","last_unstale":"2024-09-10T05:12:04.961436+0000","last_undegraded":"2024-09-10T05:12:04.961436+0000","last_fullsized":"2024-09-10T05:12:04.961436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:16.215982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962397+0000","last_change":"2024-09-10T05:11:33.748823+0000","last_active":"2024-09-10T05:12:04.962397+0000","last_peered":"2024-09-10T05:12:04.962397+0000","last_clean":"2024-09-10T05:12:04.962397+0000","last_became_active":"2024-09-10T05:11:33.748547+0000","last_became_peered":"2024-09-10T05:11:33.748547+0000","last_unstale":"2024-09-10T05:12:04.962397+0000","last_undegraded":"2024-09-10T05:12:04.962397+0000","last_fullsized":"2024-09-10T05:12:04.962397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:00.711618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'285","reported_seq":369,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.002144+0000","last_change":"2024-09-10T05:11:35.751082+0000","last_active":"2024-09-10T05:14:43.002144+0000","last_peered":"2024-09-10T05:14:43.002144+0000","last_clean":"2024-09-10T05:14:43.002144+0000","last_became_active":"2024-09-10T05:11:35.750761+0000","last_became_peered":"2024-09-10T05:11:35.750761+0000","last_unstale":"2024-09-10T05:14:43.002144+0000","last_undegraded":"2024-09-10T05:14:43.002144+0000","last_fullsized":"2024-09-10T05:14:43.002144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:35.877712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954021+0000","last_change":"2024-09-10T05:11:37.768088+0000","last_active":"2024-09-10T05:12:04.954021+0000","last_peered":"2024-09-10T05:12:04.954021+0000","last_clean":"2024-09-10T05:12:04.954021+0000","last_became_active":"2024-09-10T05:11:37.767816+0000","last_became_peered":"2024-09-10T05:11:37.767816+0000","last_unstale":"2024-09-10T05:12:04.954021+0000","last_undegraded":"2024-09-10T05:12:04.954021+0000","last_fullsized":"2024-09-10T05:12:04.954021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:32.684488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'5","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:00.917755+0000","last_change":"2024-09-10T05:11:29.720521+0000","last_active":"2024-09-10T05:14:00.917755+0000","last_peered":"2024-09-10T05:14:00.917755+0000","last_clean":"2024-09-10T05:14:00.917755+0000","last_became_active":"2024-09-10T05:11:29.720243+0000","last_became_peered":"2024-09-10T05:11:29.720243+0000","last_unstale":"2024-09-10T05:14:00.917755+0000","last_undegraded":"2024-09-10T05:14:00.917755+0000","last_fullsized":"2024-09-10T05:14:00.917755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:46.844060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960785+0000","last_change":"2024-09-10T05:11:27.723954+0000","last_active":"2024-09-10T05:12:04.960785+0000","last_peered":"2024-09-10T05:12:04.960785+0000","last_clean":"2024-09-10T05:12:04.960785+0000","last_became_active":"2024-09-10T05:11:27.723630+0000","last_became_peered":"2024-09-10T05:11:27.723630+0000","last_unstale":"2024-09-10T05:12:04.960785+0000","last_undegraded":"2024-09-10T05:12:04.960785+0000","last_fullsized":"2024-09-10T05:12:04.960785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:03.159929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961835+0000","last_change":"2024-09-10T05:11:31.737893+0000","last_active":"2024-09-10T05:12:04.961835+0000","last_peered":"2024-09-10T05:12:04.961835+0000","last_clean":"2024-09-10T05:12:04.961835+0000","last_became_active":"2024-09-10T05:11:31.737547+0000","last_became_peered":"2024-09-10T05:11:31.737547+0000","last_unstale":"2024-09-10T05:12:04.961835+0000","last_undegraded":"2024-09-10T05:12:04.961835+0000","last_fullsized":"2024-09-10T05:12:04.961835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:48.181735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'63","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.135798+0000","last_change":"2024-09-10T05:11:33.740808+0000","last_active":"2024-09-10T05:14:43.135798+0000","last_peered":"2024-09-10T05:14:43.135798+0000","last_clean":"2024-09-10T05:14:43.135798+0000","last_became_active":"2024-09-10T05:11:33.740489+0000","last_became_peered":"2024-09-10T05:11:33.740489+0000","last_unstale":"2024-09-10T05:14:43.135798+0000","last_undegraded":"2024-09-10T05:14:43.135798+0000","last_fullsized":"2024-09-10T05:14:43.135798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:04.031528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956220+0000","last_change":"2024-09-10T05:11:35.754168+0000","last_active":"2024-09-10T05:12:04.956220+0000","last_peered":"2024-09-10T05:12:04.956220+0000","last_clean":"2024-09-10T05:12:04.956220+0000","last_became_active":"2024-09-10T05:11:35.753856+0000","last_became_peered":"2024-09-10T05:11:35.753856+0000","last_unstale":"2024-09-10T05:12:04.956220+0000","last_undegraded":"2024-09-10T05:12:04.956220+0000","last_fullsized":"2024-09-10T05:12:04.956220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:03.169802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.439500+0000","last_change":"2024-09-10T05:11:37.758619+0000","last_active":"2024-09-10T05:12:09.439500+0000","last_peered":"2024-09-10T05:12:09.439500+0000","last_clean":"2024-09-10T05:12:09.439500+0000","last_became_active":"2024-09-10T05:11:37.758332+0000","last_became_peered":"2024-09-10T05:11:37.758332+0000","last_unstale":"2024-09-10T05:12:09.439500+0000","last_undegraded":"2024-09-10T05:12:09.439500+0000","last_fullsized":"2024-09-10T05:12:09.439500+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:34:24.838165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.678085+0000","last_change":"2024-09-10T05:11:29.722215+0000","last_active":"2024-09-10T05:13:35.678085+0000","last_peered":"2024-09-10T05:13:35.678085+0000","last_clean":"2024-09-10T05:13:35.678085+0000","last_became_active":"2024-09-10T05:11:29.721899+0000","last_became_peered":"2024-09-10T05:11:29.721899+0000","last_unstale":"2024-09-10T05:13:35.678085+0000","last_undegraded":"2024-09-10T05:13:35.678085+0000","last_fullsized":"2024-09-10T05:13:35.678085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:49.705056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957373+0000","last_change":"2024-09-10T05:11:27.733809+0000","last_active":"2024-09-10T05:12:04.957373+0000","last_peered":"2024-09-10T05:12:04.957373+0000","last_clean":"2024-09-10T05:12:04.957373+0000","last_became_active":"2024-09-10T05:11:27.733451+0000","last_became_peered":"2024-09-10T05:11:27.733451+0000","last_unstale":"2024-09-10T05:12:04.957373+0000","last_undegraded":"2024-09-10T05:12:04.957373+0000","last_fullsized":"2024-09-10T05:12:04.957373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:50.768933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961145+0000","last_change":"2024-09-10T05:11:31.736009+0000","last_active":"2024-09-10T05:12:04.961145+0000","last_peered":"2024-09-10T05:12:04.961145+0000","last_clean":"2024-09-10T05:12:04.961145+0000","last_became_active":"2024-09-10T05:11:31.735565+0000","last_became_peered":"2024-09-10T05:11:31.735565+0000","last_unstale":"2024-09-10T05:12:04.961145+0000","last_undegraded":"2024-09-10T05:12:04.961145+0000","last_fullsized":"2024-09-10T05:12:04.961145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:10.523091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'39","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.138877+0000","last_change":"2024-09-10T05:11:33.742997+0000","last_active":"2024-09-10T05:14:43.138877+0000","last_peered":"2024-09-10T05:14:43.138877+0000","last_clean":"2024-09-10T05:14:43.138877+0000","last_became_active":"2024-09-10T05:11:33.742656+0000","last_became_peered":"2024-09-10T05:11:33.742656+0000","last_unstale":"2024-09-10T05:14:43.138877+0000","last_undegraded":"2024-09-10T05:14:43.138877+0000","last_fullsized":"2024-09-10T05:14:43.138877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:28.611407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954236+0000","last_change":"2024-09-10T05:11:35.751391+0000","last_active":"2024-09-10T05:12:04.954236+0000","last_peered":"2024-09-10T05:12:04.954236+0000","last_clean":"2024-09-10T05:12:04.954236+0000","last_became_active":"2024-09-10T05:11:35.750960+0000","last_became_peered":"2024-09-10T05:11:35.750960+0000","last_unstale":"2024-09-10T05:12:04.954236+0000","last_undegraded":"2024-09-10T05:12:04.954236+0000","last_fullsized":"2024-09-10T05:12:04.954236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:07.690221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.959775+0000","last_change":"2024-09-10T05:11:37.768897+0000","last_active":"2024-09-10T05:12:51.959775+0000","last_peered":"2024-09-10T05:12:51.959775+0000","last_clean":"2024-09-10T05:12:51.959775+0000","last_became_active":"2024-09-10T05:11:37.768559+0000","last_became_peered":"2024-09-10T05:11:37.768559+0000","last_unstale":"2024-09-10T05:12:51.959775+0000","last_undegraded":"2024-09-10T05:12:51.959775+0000","last_fullsized":"2024-09-10T05:12:51.959775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:41.676922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'5","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.207817+0000","last_change":"2024-09-10T05:11:29.735124+0000","last_active":"2024-09-10T05:14:36.207817+0000","last_peered":"2024-09-10T05:14:36.207817+0000","last_clean":"2024-09-10T05:14:36.207817+0000","last_became_active":"2024-09-10T05:11:29.732703+0000","last_became_peered":"2024-09-10T05:11:29.732703+0000","last_unstale":"2024-09-10T05:14:36.207817+0000","last_undegraded":"2024-09-10T05:14:36.207817+0000","last_fullsized":"2024-09-10T05:14:36.207817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:46.587126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563575+0000","last_change":"2024-09-10T05:11:27.714395+0000","last_active":"2024-09-10T05:12:08.563575+0000","last_peered":"2024-09-10T05:12:08.563575+0000","last_clean":"2024-09-10T05:12:08.563575+0000","last_became_active":"2024-09-10T05:11:27.713416+0000","last_became_peered":"2024-09-10T05:11:27.713416+0000","last_unstale":"2024-09-10T05:12:08.563575+0000","last_undegraded":"2024-09-10T05:12:08.563575+0000","last_fullsized":"2024-09-10T05:12:08.563575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:50.330893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958275+0000","last_change":"2024-09-10T05:11:31.736882+0000","last_active":"2024-09-10T05:12:04.958275+0000","last_peered":"2024-09-10T05:12:04.958275+0000","last_clean":"2024-09-10T05:12:04.958275+0000","last_became_active":"2024-09-10T05:11:31.736540+0000","last_became_peered":"2024-09-10T05:11:31.736540+0000","last_unstale":"2024-09-10T05:12:04.958275+0000","last_undegraded":"2024-09-10T05:12:04.958275+0000","last_fullsized":"2024-09-10T05:12:04.958275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:34.452648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'36","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.101381+0000","last_change":"2024-09-10T05:11:33.743575+0000","last_active":"2024-09-10T05:14:43.101381+0000","last_peered":"2024-09-10T05:14:43.101381+0000","last_clean":"2024-09-10T05:14:43.101381+0000","last_became_active":"2024-09-10T05:11:33.743207+0000","last_became_peered":"2024-09-10T05:11:33.743207+0000","last_unstale":"2024-09-10T05:14:43.101381+0000","last_undegraded":"2024-09-10T05:14:43.101381+0000","last_fullsized":"2024-09-10T05:14:43.101381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:19.732970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:35.753328+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:35.753001+0000","last_became_peered":"2024-09-10T05:11:35.753001+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:19.217985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.480743+0000","last_change":"2024-09-10T05:11:37.767945+0000","last_active":"2024-09-10T05:14:36.480743+0000","last_peered":"2024-09-10T05:14:36.480743+0000","last_clean":"2024-09-10T05:14:36.480743+0000","last_became_active":"2024-09-10T05:11:37.767649+0000","last_became_peered":"2024-09-10T05:11:37.767649+0000","last_unstale":"2024-09-10T05:14:36.480743+0000","last_undegraded":"2024-09-10T05:14:36.480743+0000","last_fullsized":"2024-09-10T05:14:36.480743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:47.436935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'4","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382235+0000","last_change":"2024-09-10T05:11:29.718957+0000","last_active":"2024-09-10T05:14:36.382235+0000","last_peered":"2024-09-10T05:14:36.382235+0000","last_clean":"2024-09-10T05:14:36.382235+0000","last_became_active":"2024-09-10T05:11:29.718689+0000","last_became_peered":"2024-09-10T05:11:29.718689+0000","last_unstale":"2024-09-10T05:14:36.382235+0000","last_undegraded":"2024-09-10T05:14:36.382235+0000","last_fullsized":"2024-09-10T05:14:36.382235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.549609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963087+0000","last_change":"2024-09-10T05:11:27.716440+0000","last_active":"2024-09-10T05:12:04.963087+0000","last_peered":"2024-09-10T05:12:04.963087+0000","last_clean":"2024-09-10T05:12:04.963087+0000","last_became_active":"2024-09-10T05:11:27.716073+0000","last_became_peered":"2024-09-10T05:11:27.716073+0000","last_unstale":"2024-09-10T05:12:04.963087+0000","last_undegraded":"2024-09-10T05:12:04.963087+0000","last_fullsized":"2024-09-10T05:12:04.963087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:12:23.620289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'2","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.968798+0000","last_change":"2024-09-10T05:11:31.736020+0000","last_active":"2024-09-10T05:13:32.968798+0000","last_peered":"2024-09-10T05:13:32.968798+0000","last_clean":"2024-09-10T05:13:32.968798+0000","last_became_active":"2024-09-10T05:11:31.735726+0000","last_became_peered":"2024-09-10T05:11:31.735726+0000","last_unstale":"2024-09-10T05:13:32.968798+0000","last_undegraded":"2024-09-10T05:13:32.968798+0000","last_fullsized":"2024-09-10T05:13:32.968798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:49.251341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'47","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.110530+0000","last_change":"2024-09-10T05:11:33.748407+0000","last_active":"2024-09-10T05:14:43.110530+0000","last_peered":"2024-09-10T05:14:43.110530+0000","last_clean":"2024-09-10T05:14:43.110530+0000","last_became_active":"2024-09-10T05:11:33.748120+0000","last_became_peered":"2024-09-10T05:11:33.748120+0000","last_unstale":"2024-09-10T05:14:43.110530+0000","last_undegraded":"2024-09-10T05:14:43.110530+0000","last_fullsized":"2024-09-10T05:14:43.110530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:46:20.643301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956794+0000","last_change":"2024-09-10T05:11:35.753972+0000","last_active":"2024-09-10T05:12:04.956794+0000","last_peered":"2024-09-10T05:12:04.956794+0000","last_clean":"2024-09-10T05:12:04.956794+0000","last_became_active":"2024-09-10T05:11:35.753437+0000","last_became_peered":"2024-09-10T05:11:35.753437+0000","last_unstale":"2024-09-10T05:12:04.956794+0000","last_undegraded":"2024-09-10T05:12:04.956794+0000","last_fullsized":"2024-09-10T05:12:04.956794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:06.887746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'10","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.285208+0000","last_change":"2024-09-10T05:11:37.765397+0000","last_active":"2024-09-10T05:13:34.285208+0000","last_peered":"2024-09-10T05:13:34.285208+0000","last_clean":"2024-09-10T05:13:34.285208+0000","last_became_active":"2024-09-10T05:11:37.765102+0000","last_became_peered":"2024-09-10T05:11:37.765102+0000","last_unstale":"2024-09-10T05:13:34.285208+0000","last_undegraded":"2024-09-10T05:13:34.285208+0000","last_fullsized":"2024-09-10T05:13:34.285208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:41.297084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":67,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'7","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914653+0000","last_change":"2024-09-10T05:11:29.729956+0000","last_active":"2024-09-10T05:13:40.914653+0000","last_peered":"2024-09-10T05:13:40.914653+0000","last_clean":"2024-09-10T05:13:40.914653+0000","last_became_active":"2024-09-10T05:11:29.729468+0000","last_became_peered":"2024-09-10T05:11:29.729468+0000","last_unstale":"2024-09-10T05:13:40.914653+0000","last_undegraded":"2024-09-10T05:13:40.914653+0000","last_fullsized":"2024-09-10T05:13:40.914653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:28.277156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956207+0000","last_change":"2024-09-10T05:11:27.706911+0000","last_active":"2024-09-10T05:12:04.956207+0000","last_peered":"2024-09-10T05:12:04.956207+0000","last_clean":"2024-09-10T05:12:04.956207+0000","last_became_active":"2024-09-10T05:11:27.706484+0000","last_became_peered":"2024-09-10T05:11:27.706484+0000","last_unstale":"2024-09-10T05:12:04.956207+0000","last_undegraded":"2024-09-10T05:12:04.956207+0000","last_fullsized":"2024-09-10T05:12:04.956207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:43.266234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'11","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:38.908717+0000","last_change":"2024-09-10T05:11:29.729314+0000","last_active":"2024-09-10T05:13:38.908717+0000","last_peered":"2024-09-10T05:13:38.908717+0000","last_clean":"2024-09-10T05:13:38.908717+0000","last_became_active":"2024-09-10T05:11:29.729019+0000","last_became_peered":"2024-09-10T05:11:29.729019+0000","last_unstale":"2024-09-10T05:13:38.908717+0000","last_undegraded":"2024-09-10T05:13:38.908717+0000","last_fullsized":"2024-09-10T05:13:38.908717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:42.589634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563597+0000","last_change":"2024-09-10T05:11:27.715436+0000","last_active":"2024-09-10T05:12:08.563597+0000","last_peered":"2024-09-10T05:12:08.563597+0000","last_clean":"2024-09-10T05:12:08.563597+0000","last_became_active":"2024-09-10T05:11:27.714487+0000","last_became_peered":"2024-09-10T05:11:27.714487+0000","last_unstale":"2024-09-10T05:12:08.563597+0000","last_undegraded":"2024-09-10T05:12:08.563597+0000","last_fullsized":"2024-09-10T05:12:08.563597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:29:45.038701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'2","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.666946+0000","last_change":"2024-09-10T05:11:29.729634+0000","last_active":"2024-09-10T05:12:09.666946+0000","last_peered":"2024-09-10T05:12:09.666946+0000","last_clean":"2024-09-10T05:12:09.666946+0000","last_became_active":"2024-09-10T05:11:29.729359+0000","last_became_peered":"2024-09-10T05:11:29.729359+0000","last_unstale":"2024-09-10T05:12:09.666946+0000","last_undegraded":"2024-09-10T05:12:09.666946+0000","last_fullsized":"2024-09-10T05:12:09.666946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:52.814750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955280+0000","last_change":"2024-09-10T05:11:27.731218+0000","last_active":"2024-09-10T05:12:04.955280+0000","last_peered":"2024-09-10T05:12:04.955280+0000","last_clean":"2024-09-10T05:12:04.955280+0000","last_became_active":"2024-09-10T05:11:27.730905+0000","last_became_peered":"2024-09-10T05:11:27.730905+0000","last_unstale":"2024-09-10T05:12:04.955280+0000","last_undegraded":"2024-09-10T05:12:04.955280+0000","last_fullsized":"2024-09-10T05:12:04.955280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:16.699974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604649+0000","last_change":"2024-09-10T05:11:29.727742+0000","last_active":"2024-09-10T05:13:32.604649+0000","last_peered":"2024-09-10T05:13:32.604649+0000","last_clean":"2024-09-10T05:13:32.604649+0000","last_became_active":"2024-09-10T05:11:29.727454+0000","last_became_peered":"2024-09-10T05:11:29.727454+0000","last_unstale":"2024-09-10T05:13:32.604649+0000","last_undegraded":"2024-09-10T05:13:32.604649+0000","last_fullsized":"2024-09-10T05:13:32.604649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:22.898915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957634+0000","last_change":"2024-09-10T05:11:27.714363+0000","last_active":"2024-09-10T05:12:04.957634+0000","last_peered":"2024-09-10T05:12:04.957634+0000","last_clean":"2024-09-10T05:12:04.957634+0000","last_became_active":"2024-09-10T05:11:27.713962+0000","last_became_peered":"2024-09-10T05:11:27.713962+0000","last_unstale":"2024-09-10T05:12:04.957634+0000","last_undegraded":"2024-09-10T05:12:04.957634+0000","last_fullsized":"2024-09-10T05:12:04.957634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:40.639981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'8","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.093386+0000","last_change":"2024-09-10T05:11:29.725511+0000","last_active":"2024-09-10T05:12:09.093386+0000","last_peered":"2024-09-10T05:12:09.093386+0000","last_clean":"2024-09-10T05:12:09.093386+0000","last_became_active":"2024-09-10T05:11:29.725099+0000","last_became_peered":"2024-09-10T05:11:29.725099+0000","last_unstale":"2024-09-10T05:12:09.093386+0000","last_undegraded":"2024-09-10T05:12:09.093386+0000","last_fullsized":"2024-09-10T05:12:09.093386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:14.626560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.652457+0000","last_change":"2024-09-10T05:11:27.719263+0000","last_active":"2024-09-10T05:12:09.652457+0000","last_peered":"2024-09-10T05:12:09.652457+0000","last_clean":"2024-09-10T05:12:09.652457+0000","last_became_active":"2024-09-10T05:11:27.718926+0000","last_became_peered":"2024-09-10T05:11:27.718926+0000","last_unstale":"2024-09-10T05:12:09.652457+0000","last_undegraded":"2024-09-10T05:12:09.652457+0000","last_fullsized":"2024-09-10T05:12:09.652457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:49.254771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'8","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107871+0000","last_change":"2024-09-10T05:12:04.978547+0000","last_active":"2024-09-10T05:14:36.107871+0000","last_peered":"2024-09-10T05:14:36.107871+0000","last_clean":"2024-09-10T05:14:36.107871+0000","last_became_active":"2024-09-10T05:12:04.964750+0000","last_became_peered":"2024-09-10T05:12:04.964750+0000","last_unstale":"2024-09-10T05:14:36.107871+0000","last_undegraded":"2024-09-10T05:14:36.107871+0000","last_fullsized":"2024-09-10T05:14:36.107871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:49.286618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960405+0000","last_change":"2024-09-10T05:11:27.718699+0000","last_active":"2024-09-10T05:12:04.960405+0000","last_peered":"2024-09-10T05:12:04.960405+0000","last_clean":"2024-09-10T05:12:04.960405+0000","last_became_active":"2024-09-10T05:11:27.718282+0000","last_became_peered":"2024-09-10T05:11:27.718282+0000","last_unstale":"2024-09-10T05:12:04.960405+0000","last_undegraded":"2024-09-10T05:12:04.960405+0000","last_fullsized":"2024-09-10T05:12:04.960405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:53.391299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.672364+0000","last_change":"2024-09-10T05:11:29.723846+0000","last_active":"2024-09-10T05:13:35.672364+0000","last_peered":"2024-09-10T05:13:35.672364+0000","last_clean":"2024-09-10T05:13:35.672364+0000","last_became_active":"2024-09-10T05:11:29.723387+0000","last_became_peered":"2024-09-10T05:11:29.723387+0000","last_unstale":"2024-09-10T05:13:35.672364+0000","last_undegraded":"2024-09-10T05:13:35.672364+0000","last_fullsized":"2024-09-10T05:13:35.672364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:05.820538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.964122+0000","last_change":"2024-09-10T05:11:27.727938+0000","last_active":"2024-09-10T05:12:04.964122+0000","last_peered":"2024-09-10T05:12:04.964122+0000","last_clean":"2024-09-10T05:12:04.964122+0000","last_became_active":"2024-09-10T05:11:27.724815+0000","last_became_peered":"2024-09-10T05:11:27.724815+0000","last_unstale":"2024-09-10T05:12:04.964122+0000","last_undegraded":"2024-09-10T05:12:04.964122+0000","last_fullsized":"2024-09-10T05:12:04.964122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:20.919577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957830+0000","last_change":"2024-09-10T05:11:29.724062+0000","last_active":"2024-09-10T05:12:04.957830+0000","last_peered":"2024-09-10T05:12:04.957830+0000","last_clean":"2024-09-10T05:12:04.957830+0000","last_became_active":"2024-09-10T05:11:29.723469+0000","last_became_peered":"2024-09-10T05:11:29.723469+0000","last_unstale":"2024-09-10T05:12:04.957830+0000","last_undegraded":"2024-09-10T05:12:04.957830+0000","last_fullsized":"2024-09-10T05:12:04.957830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:43.394583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958230+0000","last_change":"2024-09-10T05:11:27.715191+0000","last_active":"2024-09-10T05:12:04.958230+0000","last_peered":"2024-09-10T05:12:04.958230+0000","last_clean":"2024-09-10T05:12:04.958230+0000","last_became_active":"2024-09-10T05:11:27.714348+0000","last_became_peered":"2024-09-10T05:11:27.714348+0000","last_unstale":"2024-09-10T05:12:04.958230+0000","last_undegraded":"2024-09-10T05:12:04.958230+0000","last_fullsized":"2024-09-10T05:12:04.958230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:36.911942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'8","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417269+0000","last_change":"2024-09-10T05:11:29.730574+0000","last_active":"2024-09-10T05:14:36.417269+0000","last_peered":"2024-09-10T05:14:36.417269+0000","last_clean":"2024-09-10T05:14:36.417269+0000","last_became_active":"2024-09-10T05:11:29.729148+0000","last_became_peered":"2024-09-10T05:11:29.729148+0000","last_unstale":"2024-09-10T05:14:36.417269+0000","last_undegraded":"2024-09-10T05:14:36.417269+0000","last_fullsized":"2024-09-10T05:14:36.417269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:31.976539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.968420+0000","last_change":"2024-09-10T05:11:27.735462+0000","last_active":"2024-09-10T05:14:35.968420+0000","last_peered":"2024-09-10T05:14:35.968420+0000","last_clean":"2024-09-10T05:14:35.968420+0000","last_became_active":"2024-09-10T05:11:27.735159+0000","last_became_peered":"2024-09-10T05:11:27.735159+0000","last_unstale":"2024-09-10T05:14:35.968420+0000","last_undegraded":"2024-09-10T05:14:35.968420+0000","last_fullsized":"2024-09-10T05:14:35.968420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:01:53.516341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'12","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339364+0000","last_change":"2024-09-10T05:11:29.729754+0000","last_active":"2024-09-10T05:14:36.339364+0000","last_peered":"2024-09-10T05:14:36.339364+0000","last_clean":"2024-09-10T05:14:36.339364+0000","last_became_active":"2024-09-10T05:11:29.729476+0000","last_became_peered":"2024-09-10T05:11:29.729476+0000","last_unstale":"2024-09-10T05:14:36.339364+0000","last_undegraded":"2024-09-10T05:14:36.339364+0000","last_fullsized":"2024-09-10T05:14:36.339364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:48.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956653+0000","last_change":"2024-09-10T05:11:27.716160+0000","last_active":"2024-09-10T05:12:04.956653+0000","last_peered":"2024-09-10T05:12:04.956653+0000","last_clean":"2024-09-10T05:12:04.956653+0000","last_became_active":"2024-09-10T05:11:27.715014+0000","last_became_peered":"2024-09-10T05:11:27.715014+0000","last_unstale":"2024-09-10T05:12:04.956653+0000","last_undegraded":"2024-09-10T05:12:04.956653+0000","last_fullsized":"2024-09-10T05:12:04.956653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:48.498486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'1","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:43.909553+0000","last_change":"2024-09-10T05:11:29.725420+0000","last_active":"2024-09-10T05:13:43.909553+0000","last_peered":"2024-09-10T05:13:43.909553+0000","last_clean":"2024-09-10T05:13:43.909553+0000","last_became_active":"2024-09-10T05:11:29.725047+0000","last_became_peered":"2024-09-10T05:11:29.725047+0000","last_unstale":"2024-09-10T05:13:43.909553+0000","last_undegraded":"2024-09-10T05:13:43.909553+0000","last_fullsized":"2024-09-10T05:13:43.909553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:53.902350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.001716+0000","last_change":"2024-09-10T05:11:27.728591+0000","last_active":"2024-09-10T05:14:36.001716+0000","last_peered":"2024-09-10T05:14:36.001716+0000","last_clean":"2024-09-10T05:14:36.001716+0000","last_became_active":"2024-09-10T05:11:27.728257+0000","last_became_peered":"2024-09-10T05:11:27.728257+0000","last_unstale":"2024-09-10T05:14:36.001716+0000","last_undegraded":"2024-09-10T05:14:36.001716+0000","last_fullsized":"2024-09-10T05:14:36.001716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:47:35.592580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960390+0000","last_change":"2024-09-10T05:11:29.722459+0000","last_active":"2024-09-10T05:12:04.960390+0000","last_peered":"2024-09-10T05:12:04.960390+0000","last_clean":"2024-09-10T05:12:04.960390+0000","last_became_active":"2024-09-10T05:11:29.721826+0000","last_became_peered":"2024-09-10T05:11:29.721826+0000","last_unstale":"2024-09-10T05:12:04.960390+0000","last_undegraded":"2024-09-10T05:12:04.960390+0000","last_fullsized":"2024-09-10T05:12:04.960390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:28.260482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958963+0000","last_change":"2024-09-10T05:11:27.730887+0000","last_active":"2024-09-10T05:12:04.958963+0000","last_peered":"2024-09-10T05:12:04.958963+0000","last_clean":"2024-09-10T05:12:04.958963+0000","last_became_active":"2024-09-10T05:11:27.730469+0000","last_became_peered":"2024-09-10T05:11:27.730469+0000","last_unstale":"2024-09-10T05:12:04.958963+0000","last_undegraded":"2024-09-10T05:12:04.958963+0000","last_fullsized":"2024-09-10T05:12:04.958963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:27.305881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'18","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339133+0000","last_change":"2024-09-10T05:12:04.973395+0000","last_active":"2024-09-10T05:14:36.339133+0000","last_peered":"2024-09-10T05:14:36.339133+0000","last_clean":"2024-09-10T05:14:36.339133+0000","last_became_active":"2024-09-10T05:12:04.965056+0000","last_became_peered":"2024-09-10T05:12:04.965056+0000","last_unstale":"2024-09-10T05:14:36.339133+0000","last_undegraded":"2024-09-10T05:14:36.339133+0000","last_fullsized":"2024-09-10T05:14:36.339133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:32.513703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563177+0000","last_change":"2024-09-10T05:11:27.722461+0000","last_active":"2024-09-10T05:12:08.563177+0000","last_peered":"2024-09-10T05:12:08.563177+0000","last_clean":"2024-09-10T05:12:08.563177+0000","last_became_active":"2024-09-10T05:11:27.722079+0000","last_became_peered":"2024-09-10T05:11:27.722079+0000","last_unstale":"2024-09-10T05:12:08.563177+0000","last_undegraded":"2024-09-10T05:12:08.563177+0000","last_fullsized":"2024-09-10T05:12:08.563177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:24.585536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'16","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107152+0000","last_change":"2024-09-10T05:11:29.734175+0000","last_active":"2024-09-10T05:14:36.107152+0000","last_peered":"2024-09-10T05:14:36.107152+0000","last_clean":"2024-09-10T05:14:36.107152+0000","last_became_active":"2024-09-10T05:11:29.733895+0000","last_became_peered":"2024-09-10T05:11:29.733895+0000","last_unstale":"2024-09-10T05:14:36.107152+0000","last_undegraded":"2024-09-10T05:14:36.107152+0000","last_fullsized":"2024-09-10T05:14:36.107152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:03.526086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961663+0000","last_change":"2024-09-10T05:11:27.736117+0000","last_active":"2024-09-10T05:12:04.961663+0000","last_peered":"2024-09-10T05:12:04.961663+0000","last_clean":"2024-09-10T05:12:04.961663+0000","last_became_active":"2024-09-10T05:11:27.735801+0000","last_became_peered":"2024-09-10T05:11:27.735801+0000","last_unstale":"2024-09-10T05:12:04.961663+0000","last_undegraded":"2024-09-10T05:12:04.961663+0000","last_fullsized":"2024-09-10T05:12:04.961663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:23.542052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.202329+0000","last_change":"2024-09-10T05:11:29.735884+0000","last_active":"2024-09-10T05:14:36.202329+0000","last_peered":"2024-09-10T05:14:36.202329+0000","last_clean":"2024-09-10T05:14:36.202329+0000","last_became_active":"2024-09-10T05:11:29.735555+0000","last_became_peered":"2024-09-10T05:11:29.735555+0000","last_unstale":"2024-09-10T05:14:36.202329+0000","last_undegraded":"2024-09-10T05:14:36.202329+0000","last_fullsized":"2024-09-10T05:14:36.202329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:40:54.995716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.964581+0000","last_change":"2024-09-10T05:11:27.727651+0000","last_active":"2024-09-10T05:12:04.964581+0000","last_peered":"2024-09-10T05:12:04.964581+0000","last_clean":"2024-09-10T05:12:04.964581+0000","last_became_active":"2024-09-10T05:11:27.723820+0000","last_became_peered":"2024-09-10T05:11:27.723820+0000","last_unstale":"2024-09-10T05:12:04.964581+0000","last_undegraded":"2024-09-10T05:12:04.964581+0000","last_fullsized":"2024-09-10T05:12:04.964581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:01:27.248207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.394391+0000","last_change":"2024-09-10T05:11:29.724350+0000","last_active":"2024-09-10T05:14:36.394391+0000","last_peered":"2024-09-10T05:14:36.394391+0000","last_clean":"2024-09-10T05:14:36.394391+0000","last_became_active":"2024-09-10T05:11:29.723816+0000","last_became_peered":"2024-09-10T05:11:29.723816+0000","last_unstale":"2024-09-10T05:14:36.394391+0000","last_undegraded":"2024-09-10T05:14:36.394391+0000","last_fullsized":"2024-09-10T05:14:36.394391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:33.014166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960833+0000","last_change":"2024-09-10T05:11:27.736745+0000","last_active":"2024-09-10T05:12:04.960833+0000","last_peered":"2024-09-10T05:12:04.960833+0000","last_clean":"2024-09-10T05:12:04.960833+0000","last_became_active":"2024-09-10T05:11:27.736370+0000","last_became_peered":"2024-09-10T05:11:27.736370+0000","last_unstale":"2024-09-10T05:12:04.960833+0000","last_undegraded":"2024-09-10T05:12:04.960833+0000","last_fullsized":"2024-09-10T05:12:04.960833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:18.893074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.411415+0000","last_change":"2024-09-10T05:11:27.731505+0000","last_active":"2024-09-10T05:14:36.411415+0000","last_peered":"2024-09-10T05:14:36.411415+0000","last_clean":"2024-09-10T05:14:36.411415+0000","last_became_active":"2024-09-10T05:11:27.731202+0000","last_became_peered":"2024-09-10T05:11:27.731202+0000","last_unstale":"2024-09-10T05:14:36.411415+0000","last_undegraded":"2024-09-10T05:14:36.411415+0000","last_fullsized":"2024-09-10T05:14:36.411415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:19.541656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.383073+0000","last_change":"2024-09-10T05:11:29.723977+0000","last_active":"2024-09-10T05:14:36.383073+0000","last_peered":"2024-09-10T05:14:36.383073+0000","last_clean":"2024-09-10T05:14:36.383073+0000","last_became_active":"2024-09-10T05:11:29.723467+0000","last_became_peered":"2024-09-10T05:11:29.723467+0000","last_unstale":"2024-09-10T05:14:36.383073+0000","last_undegraded":"2024-09-10T05:14:36.383073+0000","last_fullsized":"2024-09-10T05:14:36.383073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:38:33.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957046+0000","last_change":"2024-09-10T05:11:27.715255+0000","last_active":"2024-09-10T05:12:04.957046+0000","last_peered":"2024-09-10T05:12:04.957046+0000","last_clean":"2024-09-10T05:12:04.957046+0000","last_became_active":"2024-09-10T05:11:27.713659+0000","last_became_peered":"2024-09-10T05:11:27.713659+0000","last_unstale":"2024-09-10T05:12:04.957046+0000","last_undegraded":"2024-09-10T05:12:04.957046+0000","last_fullsized":"2024-09-10T05:12:04.957046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:40.253443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'10","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417292+0000","last_change":"2024-09-10T05:12:04.964980+0000","last_active":"2024-09-10T05:14:36.417292+0000","last_peered":"2024-09-10T05:14:36.417292+0000","last_clean":"2024-09-10T05:14:36.417292+0000","last_became_active":"2024-09-10T05:12:04.964552+0000","last_became_peered":"2024-09-10T05:12:04.964552+0000","last_unstale":"2024-09-10T05:14:36.417292+0000","last_undegraded":"2024-09-10T05:14:36.417292+0000","last_fullsized":"2024-09-10T05:14:36.417292+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:49.445729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1572,"ondisk_log_size":1572,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640302,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":160879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640303,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1036288,"data_stored":749393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335460,"statfs":{"total":96636764160,"available":96599511040,"internally_reserved":0,"allocated":1060864,"data_stored":750309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":475136,"data_stored":160447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:14:47.593 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.593 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.593 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.593 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.593 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.593 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.593 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.593 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.594 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.594 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.594 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.594 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.594 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.594 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.594 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.594 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.594 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.594 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.595 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.595 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.595 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.595 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.595 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.595 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.595 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.595 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.595 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.596 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.596 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.596 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.596 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.596 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.596 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.596 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.596 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.596 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.597 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.597 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.597 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.597 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.597 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.597 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.597 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.597 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.597 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.598 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.598 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.598 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.598 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.598 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.598 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.598 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.598 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.598 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.599 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.599 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.599 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.599 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.599 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.599 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.599 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.599 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.599 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.599 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.600 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.600 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.600 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.600 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.600 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.600 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.600 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.600 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.600 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.601 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.601 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.601 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.601 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.601 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.601 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.601 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.601 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.601 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.602 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.602 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.602 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.602 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.602 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.602 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.602 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.602 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.602 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.603 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.603 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.603 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.603 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.603 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.603 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.603 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.603 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.604 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.604 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.604 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T05:11:12.494055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.604 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T05:11:15.517245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.604 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.604 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.604 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.604 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.605 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.605 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.605 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T05:11:15.517245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.605 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.605 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.605 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.605 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.605 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.605 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.606 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T05:11:15.517245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.606 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.606 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.606 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.606 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.606 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.606 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.606 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T05:11:15.517245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.606 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.606 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.607 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.607 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.607 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.607 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.607 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.607 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T05:11:15.517245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.607 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.607 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.607 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.608 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.608 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.608 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.608 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T05:11:15.517245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.608 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.608 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.608 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.608 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.608 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.609 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.609 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T05:11:15.517245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.609 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.609 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.609 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.609 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.609 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.609 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.609 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T05:11:15.517245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=15, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.610 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.610 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.610 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.610 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.610 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.610 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.610 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.610 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.610 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.611 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.611 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.611 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.611 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.611 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.611 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.611 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.611 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.611 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.612 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.612 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.612 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.612 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.612 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.612 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.612 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.612 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.613 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.613 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.613 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.613 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.613 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.613 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.613 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.613 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.613 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.614 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.614 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.614 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.614 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.614 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.614 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.615 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.615 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.615 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.615 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.616 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.616 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.616 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.616 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.616 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.616 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.616 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.616 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.617 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.617 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.617 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.617 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.617 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.617 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.618 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.618 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.618 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.618 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.618 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.618 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.618 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.619 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.619 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.619 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.619 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.619 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.619 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.620 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.620 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.620 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.620 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.620 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.620 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.620 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.621 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.621 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.621 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.621 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.621 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.621 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.621 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.621 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.622 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.622 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.622 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.622 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.622 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.622 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.622 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.622 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.623 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.623 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.623 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.623 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.623 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.623 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.623 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.623 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.624 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.624 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.624 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.624 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.624 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.624 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.624 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.624 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.625 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:14:47.625 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T05:15:07.626 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:15:07.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.736+0000 7fe0ce5f5640 1 Processor -- start 2024-09-10T05:15:07.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.736+0000 7fe0ce5f5640 1 -- start start 2024-09-10T05:15:07.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.737+0000 7fe0ce5f5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe0c8114190 0x7fe0c8114570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:15:07.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.737+0000 7fe0ce5f5640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c81155b0 con 0x7fe0c8114ab0 2024-09-10T05:15:07.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.737+0000 7fe0ce5f5640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fe0c8116380 con 0x7fe0c8114190 2024-09-10T05:15:07.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.737+0000 7fe0c7fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe0c8114190 0x7fe0c8114570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:15:07.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.737+0000 7fe0c77fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fe0c8114ab0 0x7fe0c81253b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45294/0 (socket says 172.21.15.139:45294) 2024-09-10T05:15:07.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.737+0000 7fe0c77fe640 1 -- 172.21.15.139:0/2183478182 learned_addr learned my addr 172.21.15.139:0/2183478182 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:15:07.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.738+0000 7fe0c7fff640 1 -- 172.21.15.139:0/2183478182 >> v1:172.21.15.139:6789/0 conn(0x7fe0c8114ab0 legacy=0x7fe0c81253b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:15:07.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.738+0000 7fe0c7fff640 1 -- 172.21.15.139:0/2183478182 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c80735e0 con 0x7fe0c8114190 2024-09-10T05:15:07.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.738+0000 7fe0c7fff640 1 --2- 172.21.15.139:0/2183478182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0c8114190 0x7fe0c8114570 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009750 tx=0x7fe0b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90fb27c46e2bca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:15:07.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.738+0000 7fe0c6ffd640 1 -- 172.21.15.139:0/2183478182 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0b8037070 con 0x7fe0c8114190 2024-09-10T05:15:07.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.739+0000 7fe0c6ffd640 1 -- 172.21.15.139:0/2183478182 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b802ae20 con 0x7fe0c8114190 2024-09-10T05:15:07.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.739+0000 7fe0c6ffd640 1 -- 172.21.15.139:0/2183478182 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0b8032590 con 0x7fe0c8114190 2024-09-10T05:15:07.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.739+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/2183478182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0c8114190 msgr2=0x7fe0c8114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:15:07.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.739+0000 7fe0ce5f5640 1 --2- 172.21.15.139:0/2183478182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0c8114190 0x7fe0c8114570 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009750 tx=0x7fe0b802a1e0 comp rx=0 tx=0).stop 2024-09-10T05:15:07.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.739+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/2183478182 shutdown_connections 2024-09-10T05:15:07.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.739+0000 7fe0ce5f5640 1 --2- 172.21.15.139:0/2183478182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0c8114190 0x7fe0c8114570 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:15:07.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.739+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/2183478182 >> 172.21.15.139:0/2183478182 conn(0x7fe0c806f300 msgr2=0x7fe0c8071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:15:07.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.739+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/2183478182 shutdown_connections 2024-09-10T05:15:07.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.739+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/2183478182 wait complete. 2024-09-10T05:15:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.740+0000 7fe0ce5f5640 1 Processor -- start 2024-09-10T05:15:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.740+0000 7fe0ce5f5640 1 -- start start 2024-09-10T05:15:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.741+0000 7fe0ce5f5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0c8114190 0x7fe0c81c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:15:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.741+0000 7fe0ce5f5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8114ec0 con 0x7fe0c8114190 2024-09-10T05:15:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.741+0000 7fe0c7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0c8114190 0x7fe0c81c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:15:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.741+0000 7fe0c7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0c8114190 0x7fe0c81c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60842/0 (socket says 172.21.15.139:60842) 2024-09-10T05:15:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.741+0000 7fe0c7fff640 1 -- 172.21.15.139:0/3516420494 learned_addr learned my addr 172.21.15.139:0/3516420494 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:15:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.741+0000 7fe0c7fff640 1 -- 172.21.15.139:0/3516420494 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c811cab0 con 0x7fe0c8114190 2024-09-10T05:15:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.741+0000 7fe0c7fff640 1 --2- 172.21.15.139:0/3516420494 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0c8114190 0x7fe0c81c4820 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe0b802a220 tx=0x7fe0b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:15:07.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.741+0000 7fe0c4ff9640 1 -- 172.21.15.139:0/3516420494 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0b8042070 con 0x7fe0c8114190 2024-09-10T05:15:07.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.741+0000 7fe0c4ff9640 1 -- 172.21.15.139:0/3516420494 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b803e590 con 0x7fe0c8114190 2024-09-10T05:15:07.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.741+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/3516420494 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c811ba80 con 0x7fe0c8114190 2024-09-10T05:15:07.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.741+0000 7fe0c4ff9640 1 -- 172.21.15.139:0/3516420494 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0b8037040 con 0x7fe0c8114190 2024-09-10T05:15:07.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.741+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/3516420494 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c811bf00 con 0x7fe0c8114190 2024-09-10T05:15:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.742+0000 7fe0c4ff9640 1 -- 172.21.15.139:0/3516420494 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fe0b8045070 con 0x7fe0c8114190 2024-09-10T05:15:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.742+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/3516420494 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c8129990 con 0x7fe0c8114190 2024-09-10T05:15:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.743+0000 7fe0c4ff9640 1 --2- 172.21.15.139:0/3516420494 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe0b403dec0 0x7fe0b4040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:15:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.743+0000 7fe0c4ff9640 1 -- 172.21.15.139:0/3516420494 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe0b8073550 con 0x7fe0c8114190 2024-09-10T05:15:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.743+0000 7fe0c77fe640 1 --2- 172.21.15.139:0/3516420494 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe0b403dec0 0x7fe0b4040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:15:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.744+0000 7fe0c77fe640 1 --2- 172.21.15.139:0/3516420494 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe0b403dec0 0x7fe0b4040380 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc007fd0 tx=0x7fe0bc007aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:15:07.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.747+0000 7fe0c4ff9640 1 -- 172.21.15.139:0/3516420494 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fe0c8129990 con 0x7fe0c8114190 2024-09-10T05:15:07.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.921+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/3516420494 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0c811b270 con 0x7fe0b403dec0 2024-09-10T05:15:07.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.931+0000 7fe0c4ff9640 1 -- 172.21.15.139:0/3516420494 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665754 (secure 0 0 0) 0x7fe0c811b270 con 0x7fe0b403dec0 2024-09-10T05:15:07.939 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:15:07.944 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-10T05:15:07.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.936+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/3516420494 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe0b403dec0 msgr2=0x7fe0b4040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:15:07.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.936+0000 7fe0ce5f5640 1 --2- 172.21.15.139:0/3516420494 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe0b403dec0 0x7fe0b4040380 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc007fd0 tx=0x7fe0bc007aa0 comp rx=0 tx=0).stop 2024-09-10T05:15:07.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.936+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/3516420494 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0c8114190 msgr2=0x7fe0c81c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:15:07.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.936+0000 7fe0ce5f5640 1 --2- 172.21.15.139:0/3516420494 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0c8114190 0x7fe0c81c4820 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe0b802a220 tx=0x7fe0b80046c0 comp rx=0 tx=0).stop 2024-09-10T05:15:07.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.936+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/3516420494 shutdown_connections 2024-09-10T05:15:07.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.936+0000 7fe0ce5f5640 1 --2- 172.21.15.139:0/3516420494 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fe0b403dec0 0x7fe0b4040380 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:15:07.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.936+0000 7fe0ce5f5640 1 --2- 172.21.15.139:0/3516420494 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0c8114190 0x7fe0c81c4820 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:15:07.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.936+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/3516420494 >> 172.21.15.139:0/3516420494 conn(0x7fe0c806f300 msgr2=0x7fe0c8128560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:15:07.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.936+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/3516420494 shutdown_connections 2024-09-10T05:15:07.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:07.936+0000 7fe0ce5f5640 1 -- 172.21.15.139:0/3516420494 wait complete. 2024-09-10T05:15:07.948 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-10T05:15:05.946364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5433,"num_read_kb":4987,"num_write":2313,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4766,"ondisk_log_size":4766,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152704,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334656,"statfs":{"total":386547056640,"available":386390687744,"internally_reserved":0,"allocated":3080192,"data_stored":1821028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004019"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.686212+0000","last_change":"2024-09-10T05:15:00.686212+0000","last_active":"2024-09-10T05:15:00.686212+0000","last_peered":"2024-09-10T05:15:00.686212+0000","last_clean":"2024-09-10T05:15:00.686212+0000","last_became_active":"2024-09-10T05:11:27.716775+0000","last_became_peered":"2024-09-10T05:11:27.716775+0000","last_unstale":"2024-09-10T05:15:00.686212+0000","last_undegraded":"2024-09-10T05:15:00.686212+0000","last_fullsized":"2024-09-10T05:15:00.686212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:00.686129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:00.686129+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.686129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.852215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.438467+0000","last_change":"2024-09-10T05:11:29.733870+0000","last_active":"2024-09-10T05:12:09.438467+0000","last_peered":"2024-09-10T05:12:09.438467+0000","last_clean":"2024-09-10T05:12:09.438467+0000","last_became_active":"2024-09-10T05:11:29.733565+0000","last_became_peered":"2024-09-10T05:11:29.733565+0000","last_unstale":"2024-09-10T05:12:09.438467+0000","last_undegraded":"2024-09-10T05:12:09.438467+0000","last_fullsized":"2024-09-10T05:12:09.438467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:13.290526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.473123+0000","last_change":"2024-09-10T05:15:00.473123+0000","last_active":"2024-09-10T05:15:00.473123+0000","last_peered":"2024-09-10T05:15:00.473123+0000","last_clean":"2024-09-10T05:15:00.473123+0000","last_became_active":"2024-09-10T05:11:27.713698+0000","last_became_peered":"2024-09-10T05:11:27.713698+0000","last_unstale":"2024-09-10T05:15:00.473123+0000","last_undegraded":"2024-09-10T05:15:00.473123+0000","last_fullsized":"2024-09-10T05:15:00.473123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:00.473021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:00.473021+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.473021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:20.018847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'10","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417350+0000","last_change":"2024-09-10T05:11:29.728909+0000","last_active":"2024-09-10T05:14:36.417350+0000","last_peered":"2024-09-10T05:14:36.417350+0000","last_clean":"2024-09-10T05:14:36.417350+0000","last_became_active":"2024-09-10T05:11:29.728621+0000","last_became_peered":"2024-09-10T05:11:29.728621+0000","last_unstale":"2024-09-10T05:14:36.417350+0000","last_undegraded":"2024-09-10T05:14:36.417350+0000","last_fullsized":"2024-09-10T05:14:36.417350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:44.019015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.093692+0000","last_change":"2024-09-10T05:11:27.734457+0000","last_active":"2024-09-10T05:14:36.093692+0000","last_peered":"2024-09-10T05:14:36.093692+0000","last_clean":"2024-09-10T05:14:36.093692+0000","last_became_active":"2024-09-10T05:11:27.733147+0000","last_became_peered":"2024-09-10T05:11:27.733147+0000","last_unstale":"2024-09-10T05:14:36.093692+0000","last_undegraded":"2024-09-10T05:14:36.093692+0000","last_fullsized":"2024-09-10T05:14:36.093692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:03.092088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339232+0000","last_change":"2024-09-10T05:11:29.728946+0000","last_active":"2024-09-10T05:14:36.339232+0000","last_peered":"2024-09-10T05:14:36.339232+0000","last_clean":"2024-09-10T05:14:36.339232+0000","last_became_active":"2024-09-10T05:11:29.728696+0000","last_became_peered":"2024-09-10T05:11:29.728696+0000","last_unstale":"2024-09-10T05:14:36.339232+0000","last_undegraded":"2024-09-10T05:14:36.339232+0000","last_fullsized":"2024-09-10T05:14:36.339232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:06.277517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.676818+0000","last_change":"2024-09-10T05:14:58.676818+0000","last_active":"2024-09-10T05:14:58.676818+0000","last_peered":"2024-09-10T05:14:58.676818+0000","last_clean":"2024-09-10T05:14:58.676818+0000","last_became_active":"2024-09-10T05:11:27.722701+0000","last_became_peered":"2024-09-10T05:11:27.722701+0000","last_unstale":"2024-09-10T05:14:58.676818+0000","last_undegraded":"2024-09-10T05:14:58.676818+0000","last_fullsized":"2024-09-10T05:14:58.676818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.676697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.676697+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.676697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:08.137298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'21","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.346432+0000","last_change":"2024-09-10T05:11:29.732128+0000","last_active":"2024-09-10T05:14:36.346432+0000","last_peered":"2024-09-10T05:14:36.346432+0000","last_clean":"2024-09-10T05:14:36.346432+0000","last_became_active":"2024-09-10T05:11:29.731850+0000","last_became_peered":"2024-09-10T05:11:29.731850+0000","last_unstale":"2024-09-10T05:14:36.346432+0000","last_undegraded":"2024-09-10T05:14:36.346432+0000","last_fullsized":"2024-09-10T05:14:36.346432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:29.844887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956059+0000","last_change":"2024-09-10T05:11:27.733926+0000","last_active":"2024-09-10T05:12:04.956059+0000","last_peered":"2024-09-10T05:12:04.956059+0000","last_clean":"2024-09-10T05:12:04.956059+0000","last_became_active":"2024-09-10T05:11:27.732922+0000","last_became_peered":"2024-09-10T05:11:27.732922+0000","last_unstale":"2024-09-10T05:12:04.956059+0000","last_undegraded":"2024-09-10T05:12:04.956059+0000","last_fullsized":"2024-09-10T05:12:04.956059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:10.400715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960102+0000","last_change":"2024-09-10T05:11:29.722746+0000","last_active":"2024-09-10T05:12:04.960102+0000","last_peered":"2024-09-10T05:12:04.960102+0000","last_clean":"2024-09-10T05:12:04.960102+0000","last_became_active":"2024-09-10T05:11:29.722189+0000","last_became_peered":"2024-09-10T05:11:29.722189+0000","last_unstale":"2024-09-10T05:12:04.960102+0000","last_undegraded":"2024-09-10T05:12:04.960102+0000","last_fullsized":"2024-09-10T05:12:04.960102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:20.901027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.707592+0000","last_change":"2024-09-10T05:14:57.707592+0000","last_active":"2024-09-10T05:14:57.707592+0000","last_peered":"2024-09-10T05:14:57.707592+0000","last_clean":"2024-09-10T05:14:57.707592+0000","last_became_active":"2024-09-10T05:11:27.706559+0000","last_became_peered":"2024-09-10T05:11:27.706559+0000","last_unstale":"2024-09-10T05:14:57.707592+0000","last_undegraded":"2024-09-10T05:14:57.707592+0000","last_fullsized":"2024-09-10T05:14:57.707592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:57.707507+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:57.707507+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.707507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:37.363037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957220+0000","last_change":"2024-09-10T05:11:29.730769+0000","last_active":"2024-09-10T05:12:04.957220+0000","last_peered":"2024-09-10T05:12:04.957220+0000","last_clean":"2024-09-10T05:12:04.957220+0000","last_became_active":"2024-09-10T05:11:29.730492+0000","last_became_peered":"2024-09-10T05:11:29.730492+0000","last_unstale":"2024-09-10T05:12:04.957220+0000","last_undegraded":"2024-09-10T05:12:04.957220+0000","last_fullsized":"2024-09-10T05:12:04.957220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:36.538972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954889+0000","last_change":"2024-09-10T05:11:27.718698+0000","last_active":"2024-09-10T05:12:04.954889+0000","last_peered":"2024-09-10T05:12:04.954889+0000","last_clean":"2024-09-10T05:12:04.954889+0000","last_became_active":"2024-09-10T05:11:27.718363+0000","last_became_peered":"2024-09-10T05:11:27.718363+0000","last_unstale":"2024-09-10T05:12:04.954889+0000","last_undegraded":"2024-09-10T05:12:04.954889+0000","last_fullsized":"2024-09-10T05:12:04.954889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:56.809195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417284+0000","last_change":"2024-09-10T05:11:29.727171+0000","last_active":"2024-09-10T05:14:36.417284+0000","last_peered":"2024-09-10T05:14:36.417284+0000","last_clean":"2024-09-10T05:14:36.417284+0000","last_became_active":"2024-09-10T05:11:29.726884+0000","last_became_peered":"2024-09-10T05:11:29.726884+0000","last_unstale":"2024-09-10T05:14:36.417284+0000","last_undegraded":"2024-09-10T05:14:36.417284+0000","last_fullsized":"2024-09-10T05:14:36.417284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:28.260482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.496721+0000","last_change":"2024-09-10T05:14:59.496721+0000","last_active":"2024-09-10T05:14:59.496721+0000","last_peered":"2024-09-10T05:14:59.496721+0000","last_clean":"2024-09-10T05:14:59.496721+0000","last_became_active":"2024-09-10T05:11:27.718868+0000","last_became_peered":"2024-09-10T05:11:27.718868+0000","last_unstale":"2024-09-10T05:14:59.496721+0000","last_undegraded":"2024-09-10T05:14:59.496721+0000","last_fullsized":"2024-09-10T05:14:59.496721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:59.496621+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:59.496621+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.496621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:59.831011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.093231+0000","last_change":"2024-09-10T05:11:29.723967+0000","last_active":"2024-09-10T05:12:09.093231+0000","last_peered":"2024-09-10T05:12:09.093231+0000","last_clean":"2024-09-10T05:12:09.093231+0000","last_became_active":"2024-09-10T05:11:29.723497+0000","last_became_peered":"2024-09-10T05:11:29.723497+0000","last_unstale":"2024-09-10T05:12:09.093231+0000","last_undegraded":"2024-09-10T05:12:09.093231+0000","last_fullsized":"2024-09-10T05:12:09.093231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:35.779331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'5","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.208052+0000","last_change":"2024-09-10T05:11:29.727785+0000","last_active":"2024-09-10T05:14:36.208052+0000","last_peered":"2024-09-10T05:14:36.208052+0000","last_clean":"2024-09-10T05:14:36.208052+0000","last_became_active":"2024-09-10T05:11:29.727536+0000","last_became_peered":"2024-09-10T05:11:29.727536+0000","last_unstale":"2024-09-10T05:14:36.208052+0000","last_undegraded":"2024-09-10T05:14:36.208052+0000","last_fullsized":"2024-09-10T05:14:36.208052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:01.849780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.476686+0000","last_change":"2024-09-10T05:14:59.476686+0000","last_active":"2024-09-10T05:14:59.476686+0000","last_peered":"2024-09-10T05:14:59.476686+0000","last_clean":"2024-09-10T05:14:59.476686+0000","last_became_active":"2024-09-10T05:11:27.728114+0000","last_became_peered":"2024-09-10T05:11:27.728114+0000","last_unstale":"2024-09-10T05:14:59.476686+0000","last_undegraded":"2024-09-10T05:14:59.476686+0000","last_fullsized":"2024-09-10T05:14:59.476686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:59.476601+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:59.476601+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.476601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:04.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.202264+0000","last_change":"2024-09-10T05:11:29.733110+0000","last_active":"2024-09-10T05:14:36.202264+0000","last_peered":"2024-09-10T05:14:36.202264+0000","last_clean":"2024-09-10T05:14:36.202264+0000","last_became_active":"2024-09-10T05:11:29.732864+0000","last_became_peered":"2024-09-10T05:11:29.732864+0000","last_unstale":"2024-09-10T05:14:36.202264+0000","last_undegraded":"2024-09-10T05:14:36.202264+0000","last_fullsized":"2024-09-10T05:14:36.202264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:27.593815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.645979+0000","last_change":"2024-09-10T05:15:02.645979+0000","last_active":"2024-09-10T05:15:02.645979+0000","last_peered":"2024-09-10T05:15:02.645979+0000","last_clean":"2024-09-10T05:15:02.645979+0000","last_became_active":"2024-09-10T05:11:27.706698+0000","last_became_peered":"2024-09-10T05:11:27.706698+0000","last_unstale":"2024-09-10T05:15:02.645979+0000","last_undegraded":"2024-09-10T05:15:02.645979+0000","last_fullsized":"2024-09-10T05:15:02.645979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:02.645892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:02.645892+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.645892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:35.605736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'10","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.963001+0000","last_change":"2024-09-10T05:11:29.732128+0000","last_active":"2024-09-10T05:12:51.963001+0000","last_peered":"2024-09-10T05:12:51.963001+0000","last_clean":"2024-09-10T05:12:51.963001+0000","last_became_active":"2024-09-10T05:11:29.731842+0000","last_became_peered":"2024-09-10T05:11:29.731842+0000","last_unstale":"2024-09-10T05:12:51.963001+0000","last_undegraded":"2024-09-10T05:12:51.963001+0000","last_fullsized":"2024-09-10T05:12:51.963001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:54.021671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.476461+0000","last_change":"2024-09-10T05:14:58.476461+0000","last_active":"2024-09-10T05:14:58.476461+0000","last_peered":"2024-09-10T05:14:58.476461+0000","last_clean":"2024-09-10T05:14:58.476461+0000","last_became_active":"2024-09-10T05:11:27.719257+0000","last_became_peered":"2024-09-10T05:11:27.719257+0000","last_unstale":"2024-09-10T05:14:58.476461+0000","last_undegraded":"2024-09-10T05:14:58.476461+0000","last_fullsized":"2024-09-10T05:14:58.476461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.476369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.476369+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.476369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:03.036373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339173+0000","last_change":"2024-09-10T05:12:04.976749+0000","last_active":"2024-09-10T05:14:36.339173+0000","last_peered":"2024-09-10T05:14:36.339173+0000","last_clean":"2024-09-10T05:14:36.339173+0000","last_became_active":"2024-09-10T05:12:04.967642+0000","last_became_peered":"2024-09-10T05:12:04.967642+0000","last_unstale":"2024-09-10T05:14:36.339173+0000","last_undegraded":"2024-09-10T05:14:36.339173+0000","last_fullsized":"2024-09-10T05:14:36.339173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:14.879637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"37'3","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.500764+0000","last_change":"2024-09-10T05:14:55.500764+0000","last_active":"2024-09-10T05:14:55.500764+0000","last_peered":"2024-09-10T05:14:55.500764+0000","last_clean":"2024-09-10T05:14:55.500764+0000","last_became_active":"2024-09-10T05:11:27.724439+0000","last_became_peered":"2024-09-10T05:11:27.724439+0000","last_unstale":"2024-09-10T05:14:55.500764+0000","last_undegraded":"2024-09-10T05:14:55.500764+0000","last_fullsized":"2024-09-10T05:14:55.500764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:14:55.500672+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:14:55.500672+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.500672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:26.970541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382409+0000","last_change":"2024-09-10T05:11:29.723195+0000","last_active":"2024-09-10T05:14:36.382409+0000","last_peered":"2024-09-10T05:14:36.382409+0000","last_clean":"2024-09-10T05:14:36.382409+0000","last_became_active":"2024-09-10T05:11:29.722894+0000","last_became_peered":"2024-09-10T05:11:29.722894+0000","last_unstale":"2024-09-10T05:14:36.382409+0000","last_undegraded":"2024-09-10T05:14:36.382409+0000","last_fullsized":"2024-09-10T05:14:36.382409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:16.388042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.985687+0000","last_change":"2024-09-10T05:11:27.716016+0000","last_active":"2024-09-10T05:14:35.985687+0000","last_peered":"2024-09-10T05:14:35.985687+0000","last_clean":"2024-09-10T05:14:35.985687+0000","last_became_active":"2024-09-10T05:11:27.714926+0000","last_became_peered":"2024-09-10T05:11:27.714926+0000","last_unstale":"2024-09-10T05:14:35.985687+0000","last_undegraded":"2024-09-10T05:14:35.985687+0000","last_fullsized":"2024-09-10T05:14:35.985687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:51.116402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.384792+0000","last_change":"2024-09-10T05:11:29.722979+0000","last_active":"2024-09-10T05:14:36.384792+0000","last_peered":"2024-09-10T05:14:36.384792+0000","last_clean":"2024-09-10T05:14:36.384792+0000","last_became_active":"2024-09-10T05:11:29.721876+0000","last_became_peered":"2024-09-10T05:11:29.721876+0000","last_unstale":"2024-09-10T05:14:36.384792+0000","last_undegraded":"2024-09-10T05:14:36.384792+0000","last_fullsized":"2024-09-10T05:14:36.384792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:11:48.560871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955723+0000","last_change":"2024-09-10T05:11:27.720509+0000","last_active":"2024-09-10T05:12:04.955723+0000","last_peered":"2024-09-10T05:12:04.955723+0000","last_clean":"2024-09-10T05:12:04.955723+0000","last_became_active":"2024-09-10T05:11:27.720197+0000","last_became_peered":"2024-09-10T05:11:27.720197+0000","last_unstale":"2024-09-10T05:12:04.955723+0000","last_undegraded":"2024-09-10T05:12:04.955723+0000","last_fullsized":"2024-09-10T05:12:04.955723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:14.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.361804+0000","last_change":"2024-09-10T05:11:37.763268+0000","last_active":"2024-09-10T05:14:36.361804+0000","last_peered":"2024-09-10T05:14:36.361804+0000","last_clean":"2024-09-10T05:14:36.361804+0000","last_became_active":"2024-09-10T05:11:37.763019+0000","last_became_peered":"2024-09-10T05:11:37.763019+0000","last_unstale":"2024-09-10T05:14:36.361804+0000","last_undegraded":"2024-09-10T05:14:36.361804+0000","last_fullsized":"2024-09-10T05:14:36.361804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:54.698085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:10.169121+0000","last_change":"2024-09-10T05:11:29.729685+0000","last_active":"2024-09-10T05:12:10.169121+0000","last_peered":"2024-09-10T05:12:10.169121+0000","last_clean":"2024-09-10T05:12:10.169121+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:12:10.169121+0000","last_undegraded":"2024-09-10T05:12:10.169121+0000","last_fullsized":"2024-09-10T05:12:10.169121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.365568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.908025+0000","last_change":"2024-09-10T05:14:59.908025+0000","last_active":"2024-09-10T05:14:59.908025+0000","last_peered":"2024-09-10T05:14:59.908025+0000","last_clean":"2024-09-10T05:14:59.908025+0000","last_became_active":"2024-09-10T05:11:27.733612+0000","last_became_peered":"2024-09-10T05:11:27.733612+0000","last_unstale":"2024-09-10T05:14:59.908025+0000","last_undegraded":"2024-09-10T05:14:59.908025+0000","last_fullsized":"2024-09-10T05:14:59.908025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:59.907936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:59.907936+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.907936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:14.244325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957082+0000","last_change":"2024-09-10T05:11:31.737509+0000","last_active":"2024-09-10T05:12:04.957082+0000","last_peered":"2024-09-10T05:12:04.957082+0000","last_clean":"2024-09-10T05:12:04.957082+0000","last_became_active":"2024-09-10T05:11:31.736788+0000","last_became_peered":"2024-09-10T05:11:31.736788+0000","last_unstale":"2024-09-10T05:12:04.957082+0000","last_undegraded":"2024-09-10T05:12:04.957082+0000","last_fullsized":"2024-09-10T05:12:04.957082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:26.107225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'47","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.081131+0000","last_change":"2024-09-10T05:11:33.746939+0000","last_active":"2024-09-10T05:14:43.081131+0000","last_peered":"2024-09-10T05:14:43.081131+0000","last_clean":"2024-09-10T05:14:43.081131+0000","last_became_active":"2024-09-10T05:11:33.746595+0000","last_became_peered":"2024-09-10T05:11:33.746595+0000","last_unstale":"2024-09-10T05:14:43.081131+0000","last_undegraded":"2024-09-10T05:14:43.081131+0000","last_fullsized":"2024-09-10T05:14:43.081131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:39.379252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963055+0000","last_change":"2024-09-10T05:11:35.746892+0000","last_active":"2024-09-10T05:12:04.963055+0000","last_peered":"2024-09-10T05:12:04.963055+0000","last_clean":"2024-09-10T05:12:04.963055+0000","last_became_active":"2024-09-10T05:11:35.746594+0000","last_became_peered":"2024-09-10T05:11:35.746594+0000","last_unstale":"2024-09-10T05:12:04.963055+0000","last_undegraded":"2024-09-10T05:12:04.963055+0000","last_fullsized":"2024-09-10T05:12:04.963055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:15.325826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.968440+0000","last_change":"2024-09-10T05:11:37.756768+0000","last_active":"2024-09-10T05:12:51.968440+0000","last_peered":"2024-09-10T05:12:51.968440+0000","last_clean":"2024-09-10T05:12:51.968440+0000","last_became_active":"2024-09-10T05:11:37.756495+0000","last_became_peered":"2024-09-10T05:11:37.756495+0000","last_unstale":"2024-09-10T05:12:51.968440+0000","last_undegraded":"2024-09-10T05:12:51.968440+0000","last_fullsized":"2024-09-10T05:12:51.968440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:13.070344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417430+0000","last_change":"2024-09-10T05:11:29.732574+0000","last_active":"2024-09-10T05:14:36.417430+0000","last_peered":"2024-09-10T05:14:36.417430+0000","last_clean":"2024-09-10T05:14:36.417430+0000","last_became_active":"2024-09-10T05:11:29.732267+0000","last_became_peered":"2024-09-10T05:11:29.732267+0000","last_unstale":"2024-09-10T05:14:36.417430+0000","last_undegraded":"2024-09-10T05:14:36.417430+0000","last_fullsized":"2024-09-10T05:14:36.417430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:00.006923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.746344+0000","last_change":"2024-09-10T05:14:52.746344+0000","last_active":"2024-09-10T05:14:52.746344+0000","last_peered":"2024-09-10T05:14:52.746344+0000","last_clean":"2024-09-10T05:14:52.746344+0000","last_became_active":"2024-09-10T05:11:27.726599+0000","last_became_peered":"2024-09-10T05:11:27.726599+0000","last_unstale":"2024-09-10T05:14:52.746344+0000","last_undegraded":"2024-09-10T05:14:52.746344+0000","last_fullsized":"2024-09-10T05:14:52.746344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.746259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.746259+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.746259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:50.519180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957165+0000","last_change":"2024-09-10T05:11:31.731495+0000","last_active":"2024-09-10T05:12:04.957165+0000","last_peered":"2024-09-10T05:12:04.957165+0000","last_clean":"2024-09-10T05:12:04.957165+0000","last_became_active":"2024-09-10T05:11:31.731231+0000","last_became_peered":"2024-09-10T05:11:31.731231+0000","last_unstale":"2024-09-10T05:12:04.957165+0000","last_undegraded":"2024-09-10T05:12:04.957165+0000","last_fullsized":"2024-09-10T05:12:04.957165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:09.451414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'13","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960893+0000","last_change":"2024-09-10T05:11:33.744170+0000","last_active":"2024-09-10T05:12:04.960893+0000","last_peered":"2024-09-10T05:12:04.960893+0000","last_clean":"2024-09-10T05:12:04.960893+0000","last_became_active":"2024-09-10T05:11:33.743847+0000","last_became_peered":"2024-09-10T05:11:33.743847+0000","last_unstale":"2024-09-10T05:12:04.960893+0000","last_undegraded":"2024-09-10T05:12:04.960893+0000","last_fullsized":"2024-09-10T05:12:04.960893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:57.085007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962494+0000","last_change":"2024-09-10T05:11:35.749895+0000","last_active":"2024-09-10T05:12:04.962494+0000","last_peered":"2024-09-10T05:12:04.962494+0000","last_clean":"2024-09-10T05:12:04.962494+0000","last_became_active":"2024-09-10T05:11:35.749634+0000","last_became_peered":"2024-09-10T05:11:35.749634+0000","last_unstale":"2024-09-10T05:12:04.962494+0000","last_undegraded":"2024-09-10T05:12:04.962494+0000","last_fullsized":"2024-09-10T05:12:04.962494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:01.486680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956547+0000","last_change":"2024-09-10T05:11:37.755426+0000","last_active":"2024-09-10T05:12:04.956547+0000","last_peered":"2024-09-10T05:12:04.956547+0000","last_clean":"2024-09-10T05:12:04.956547+0000","last_became_active":"2024-09-10T05:11:37.755078+0000","last_became_peered":"2024-09-10T05:11:37.755078+0000","last_unstale":"2024-09-10T05:12:04.956547+0000","last_undegraded":"2024-09-10T05:12:04.956547+0000","last_fullsized":"2024-09-10T05:12:04.956547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:03.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961705+0000","last_change":"2024-09-10T05:11:29.732068+0000","last_active":"2024-09-10T05:12:04.961705+0000","last_peered":"2024-09-10T05:12:04.961705+0000","last_clean":"2024-09-10T05:12:04.961705+0000","last_became_active":"2024-09-10T05:11:29.731780+0000","last_became_peered":"2024-09-10T05:11:29.731780+0000","last_unstale":"2024-09-10T05:12:04.961705+0000","last_undegraded":"2024-09-10T05:12:04.961705+0000","last_fullsized":"2024-09-10T05:12:04.961705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:47.912310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.998628+0000","last_change":"2024-09-10T05:15:01.998628+0000","last_active":"2024-09-10T05:15:01.998628+0000","last_peered":"2024-09-10T05:15:01.998628+0000","last_clean":"2024-09-10T05:15:01.998628+0000","last_became_active":"2024-09-10T05:11:27.732573+0000","last_became_peered":"2024-09-10T05:11:27.732573+0000","last_unstale":"2024-09-10T05:15:01.998628+0000","last_undegraded":"2024-09-10T05:15:01.998628+0000","last_fullsized":"2024-09-10T05:15:01.998628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:01.998527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:01.998527+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.998527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:38.110563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:05.900569+0000","last_change":"2024-09-10T05:12:04.965872+0000","last_active":"2024-09-10T05:12:05.900569+0000","last_peered":"2024-09-10T05:12:05.900569+0000","last_clean":"2024-09-10T05:12:05.900569+0000","last_became_active":"2024-09-10T05:12:04.965494+0000","last_became_peered":"2024-09-10T05:12:04.965494+0000","last_unstale":"2024-09-10T05:12:05.900569+0000","last_undegraded":"2024-09-10T05:12:05.900569+0000","last_fullsized":"2024-09-10T05:12:05.900569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:04.430595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959616+0000","last_change":"2024-09-10T05:11:33.745608+0000","last_active":"2024-09-10T05:12:04.959616+0000","last_peered":"2024-09-10T05:12:04.959616+0000","last_clean":"2024-09-10T05:12:04.959616+0000","last_became_active":"2024-09-10T05:11:33.745336+0000","last_became_peered":"2024-09-10T05:11:33.745336+0000","last_unstale":"2024-09-10T05:12:04.959616+0000","last_undegraded":"2024-09-10T05:12:04.959616+0000","last_fullsized":"2024-09-10T05:12:04.959616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:41.078775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'285","reported_seq":418,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.005466+0000","last_change":"2024-09-10T05:11:35.752548+0000","last_active":"2024-09-10T05:14:43.005466+0000","last_peered":"2024-09-10T05:14:43.005466+0000","last_clean":"2024-09-10T05:14:43.005466+0000","last_became_active":"2024-09-10T05:11:35.752290+0000","last_became_peered":"2024-09-10T05:11:35.752290+0000","last_unstale":"2024-09-10T05:14:43.005466+0000","last_undegraded":"2024-09-10T05:14:43.005466+0000","last_fullsized":"2024-09-10T05:14:43.005466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.244961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959825+0000","last_change":"2024-09-10T05:11:37.759873+0000","last_active":"2024-09-10T05:12:04.959825+0000","last_peered":"2024-09-10T05:12:04.959825+0000","last_clean":"2024-09-10T05:12:04.959825+0000","last_became_active":"2024-09-10T05:11:37.759311+0000","last_became_peered":"2024-09-10T05:11:37.759311+0000","last_unstale":"2024-09-10T05:12:04.959825+0000","last_undegraded":"2024-09-10T05:12:04.959825+0000","last_fullsized":"2024-09-10T05:12:04.959825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:37.479923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.383082+0000","last_change":"2024-09-10T05:11:29.724315+0000","last_active":"2024-09-10T05:14:36.383082+0000","last_peered":"2024-09-10T05:14:36.383082+0000","last_clean":"2024-09-10T05:14:36.383082+0000","last_became_active":"2024-09-10T05:11:29.723919+0000","last_became_peered":"2024-09-10T05:11:29.723919+0000","last_unstale":"2024-09-10T05:14:36.383082+0000","last_undegraded":"2024-09-10T05:14:36.383082+0000","last_fullsized":"2024-09-10T05:14:36.383082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:04.172142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.435128+0000","last_change":"2024-09-10T05:14:49.435128+0000","last_active":"2024-09-10T05:14:49.435128+0000","last_peered":"2024-09-10T05:14:49.435128+0000","last_clean":"2024-09-10T05:14:49.435128+0000","last_became_active":"2024-09-10T05:11:27.719835+0000","last_became_peered":"2024-09-10T05:11:27.719835+0000","last_unstale":"2024-09-10T05:14:49.435128+0000","last_undegraded":"2024-09-10T05:14:49.435128+0000","last_fullsized":"2024-09-10T05:14:49.435128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:49.435035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:49.435035+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.435035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:32.661631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962693+0000","last_change":"2024-09-10T05:11:31.737694+0000","last_active":"2024-09-10T05:12:04.962693+0000","last_peered":"2024-09-10T05:12:04.962693+0000","last_clean":"2024-09-10T05:12:04.962693+0000","last_became_active":"2024-09-10T05:11:31.737411+0000","last_became_peered":"2024-09-10T05:11:31.737411+0000","last_unstale":"2024-09-10T05:12:04.962693+0000","last_undegraded":"2024-09-10T05:12:04.962693+0000","last_fullsized":"2024-09-10T05:12:04.962693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:48.673581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'39","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.066217+0000","last_change":"2024-09-10T05:11:33.745209+0000","last_active":"2024-09-10T05:14:43.066217+0000","last_peered":"2024-09-10T05:14:43.066217+0000","last_clean":"2024-09-10T05:14:43.066217+0000","last_became_active":"2024-09-10T05:11:33.744920+0000","last_became_peered":"2024-09-10T05:11:33.744920+0000","last_unstale":"2024-09-10T05:14:43.066217+0000","last_undegraded":"2024-09-10T05:14:43.066217+0000","last_fullsized":"2024-09-10T05:14:43.066217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:36.085525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":427,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.010217+0000","last_change":"2024-09-10T05:11:35.748524+0000","last_active":"2024-09-10T05:14:43.010217+0000","last_peered":"2024-09-10T05:14:43.010217+0000","last_clean":"2024-09-10T05:14:43.010217+0000","last_became_active":"2024-09-10T05:11:35.748328+0000","last_became_peered":"2024-09-10T05:11:35.748328+0000","last_unstale":"2024-09-10T05:14:43.010217+0000","last_undegraded":"2024-09-10T05:14:43.010217+0000","last_fullsized":"2024-09-10T05:14:43.010217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:39.020754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'7","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116685+0000","last_change":"2024-09-10T05:11:29.736309+0000","last_active":"2024-09-10T05:14:36.116685+0000","last_peered":"2024-09-10T05:14:36.116685+0000","last_clean":"2024-09-10T05:14:36.116685+0000","last_became_active":"2024-09-10T05:11:29.735799+0000","last_became_peered":"2024-09-10T05:11:29.735799+0000","last_unstale":"2024-09-10T05:14:36.116685+0000","last_undegraded":"2024-09-10T05:14:36.116685+0000","last_fullsized":"2024-09-10T05:14:36.116685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:38.598374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.750206+0000","last_change":"2024-09-10T05:14:53.750206+0000","last_active":"2024-09-10T05:14:53.750206+0000","last_peered":"2024-09-10T05:14:53.750206+0000","last_clean":"2024-09-10T05:14:53.750206+0000","last_became_active":"2024-09-10T05:11:27.716318+0000","last_became_peered":"2024-09-10T05:11:27.716318+0000","last_unstale":"2024-09-10T05:14:53.750206+0000","last_undegraded":"2024-09-10T05:14:53.750206+0000","last_fullsized":"2024-09-10T05:14:53.750206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.750095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.750095+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.750095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:30.144747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958076+0000","last_change":"2024-09-10T05:11:31.735274+0000","last_active":"2024-09-10T05:12:04.958076+0000","last_peered":"2024-09-10T05:12:04.958076+0000","last_clean":"2024-09-10T05:12:04.958076+0000","last_became_active":"2024-09-10T05:11:31.734975+0000","last_became_peered":"2024-09-10T05:11:31.734975+0000","last_unstale":"2024-09-10T05:12:04.958076+0000","last_undegraded":"2024-09-10T05:12:04.958076+0000","last_fullsized":"2024-09-10T05:12:04.958076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:45.105200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'50","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.093054+0000","last_change":"2024-09-10T05:11:33.746845+0000","last_active":"2024-09-10T05:14:43.093054+0000","last_peered":"2024-09-10T05:14:43.093054+0000","last_clean":"2024-09-10T05:14:43.093054+0000","last_became_active":"2024-09-10T05:11:33.746522+0000","last_became_peered":"2024-09-10T05:11:33.746522+0000","last_unstale":"2024-09-10T05:14:43.093054+0000","last_undegraded":"2024-09-10T05:14:43.093054+0000","last_fullsized":"2024-09-10T05:14:43.093054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:43.397048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957524+0000","last_change":"2024-09-10T05:11:35.746098+0000","last_active":"2024-09-10T05:12:04.957524+0000","last_peered":"2024-09-10T05:12:04.957524+0000","last_clean":"2024-09-10T05:12:04.957524+0000","last_became_active":"2024-09-10T05:11:35.745840+0000","last_became_peered":"2024-09-10T05:11:35.745840+0000","last_unstale":"2024-09-10T05:12:04.957524+0000","last_undegraded":"2024-09-10T05:12:04.957524+0000","last_fullsized":"2024-09-10T05:12:04.957524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:48.168086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.970146+0000","last_change":"2024-09-10T05:11:37.754850+0000","last_active":"2024-09-10T05:12:51.970146+0000","last_peered":"2024-09-10T05:12:51.970146+0000","last_clean":"2024-09-10T05:12:51.970146+0000","last_became_active":"2024-09-10T05:11:37.754562+0000","last_became_peered":"2024-09-10T05:11:37.754562+0000","last_unstale":"2024-09-10T05:12:51.970146+0000","last_undegraded":"2024-09-10T05:12:51.970146+0000","last_fullsized":"2024-09-10T05:12:51.970146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:27.172242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.352861+0000","last_change":"2024-09-10T05:15:03.352861+0000","last_active":"2024-09-10T05:15:03.352861+0000","last_peered":"2024-09-10T05:15:03.352861+0000","last_clean":"2024-09-10T05:15:03.352861+0000","last_became_active":"2024-09-10T05:11:29.721292+0000","last_became_peered":"2024-09-10T05:11:29.721292+0000","last_unstale":"2024-09-10T05:15:03.352861+0000","last_undegraded":"2024-09-10T05:15:03.352861+0000","last_fullsized":"2024-09-10T05:15:03.352861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.352761+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.352761+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.352761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:39.971897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"37'6","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.706205+0000","last_change":"2024-09-10T05:14:50.706205+0000","last_active":"2024-09-10T05:14:50.706205+0000","last_peered":"2024-09-10T05:14:50.706205+0000","last_clean":"2024-09-10T05:14:50.706205+0000","last_became_active":"2024-09-10T05:11:27.726419+0000","last_became_peered":"2024-09-10T05:11:27.726419+0000","last_unstale":"2024-09-10T05:14:50.706205+0000","last_undegraded":"2024-09-10T05:14:50.706205+0000","last_fullsized":"2024-09-10T05:14:50.706205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:14:50.706120+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:14:50.706120+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.706120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:55:39.305300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956724+0000","last_change":"2024-09-10T05:11:31.732240+0000","last_active":"2024-09-10T05:12:04.956724+0000","last_peered":"2024-09-10T05:12:04.956724+0000","last_clean":"2024-09-10T05:12:04.956724+0000","last_became_active":"2024-09-10T05:11:31.732017+0000","last_became_peered":"2024-09-10T05:11:31.732017+0000","last_unstale":"2024-09-10T05:12:04.956724+0000","last_undegraded":"2024-09-10T05:12:04.956724+0000","last_fullsized":"2024-09-10T05:12:04.956724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:35.116886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'40","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.141661+0000","last_change":"2024-09-10T05:11:33.747704+0000","last_active":"2024-09-10T05:14:43.141661+0000","last_peered":"2024-09-10T05:14:43.141661+0000","last_clean":"2024-09-10T05:14:43.141661+0000","last_became_active":"2024-09-10T05:11:33.747334+0000","last_became_peered":"2024-09-10T05:11:33.747334+0000","last_unstale":"2024-09-10T05:14:43.141661+0000","last_undegraded":"2024-09-10T05:14:43.141661+0000","last_fullsized":"2024-09-10T05:14:43.141661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:02.895443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956478+0000","last_change":"2024-09-10T05:11:35.753755+0000","last_active":"2024-09-10T05:12:04.956478+0000","last_peered":"2024-09-10T05:12:04.956478+0000","last_clean":"2024-09-10T05:12:04.956478+0000","last_became_active":"2024-09-10T05:11:35.753453+0000","last_became_peered":"2024-09-10T05:11:35.753453+0000","last_unstale":"2024-09-10T05:12:04.956478+0000","last_undegraded":"2024-09-10T05:12:04.956478+0000","last_fullsized":"2024-09-10T05:12:04.956478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:03.592621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:46.437159+0000","last_change":"2024-09-10T05:11:37.758133+0000","last_active":"2024-09-10T05:12:46.437159+0000","last_peered":"2024-09-10T05:12:46.437159+0000","last_clean":"2024-09-10T05:12:46.437159+0000","last_became_active":"2024-09-10T05:11:37.757307+0000","last_became_peered":"2024-09-10T05:11:37.757307+0000","last_unstale":"2024-09-10T05:12:46.437159+0000","last_undegraded":"2024-09-10T05:12:46.437159+0000","last_fullsized":"2024-09-10T05:12:46.437159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:15.800062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.667460+0000","last_change":"2024-09-10T05:15:01.667460+0000","last_active":"2024-09-10T05:15:01.667460+0000","last_peered":"2024-09-10T05:15:01.667460+0000","last_clean":"2024-09-10T05:15:01.667460+0000","last_became_active":"2024-09-10T05:11:29.722719+0000","last_became_peered":"2024-09-10T05:11:29.722719+0000","last_unstale":"2024-09-10T05:15:01.667460+0000","last_undegraded":"2024-09-10T05:15:01.667460+0000","last_fullsized":"2024-09-10T05:15:01.667460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:01.667364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:01.667364+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.667364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:59.866263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.927325+0000","last_change":"2024-09-10T05:14:58.927325+0000","last_active":"2024-09-10T05:14:58.927325+0000","last_peered":"2024-09-10T05:14:58.927325+0000","last_clean":"2024-09-10T05:14:58.927325+0000","last_became_active":"2024-09-10T05:11:27.722553+0000","last_became_peered":"2024-09-10T05:11:27.722553+0000","last_unstale":"2024-09-10T05:14:58.927325+0000","last_undegraded":"2024-09-10T05:14:58.927325+0000","last_fullsized":"2024-09-10T05:14:58.927325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:58.927238+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:58.927238+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.927238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:40.559986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'4","reported_seq":229,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:42.977305+0000","last_change":"2024-09-10T05:11:31.734260+0000","last_active":"2024-09-10T05:14:42.977305+0000","last_peered":"2024-09-10T05:14:42.977305+0000","last_clean":"2024-09-10T05:14:42.977305+0000","last_became_active":"2024-09-10T05:11:31.733822+0000","last_became_peered":"2024-09-10T05:11:31.733822+0000","last_unstale":"2024-09-10T05:14:42.977305+0000","last_undegraded":"2024-09-10T05:14:42.977305+0000","last_fullsized":"2024-09-10T05:14:42.977305+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:41.836144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'51","reported_seq":113,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.098530+0000","last_change":"2024-09-10T05:11:33.748247+0000","last_active":"2024-09-10T05:14:43.098530+0000","last_peered":"2024-09-10T05:14:43.098530+0000","last_clean":"2024-09-10T05:14:43.098530+0000","last_became_active":"2024-09-10T05:11:33.747938+0000","last_became_peered":"2024-09-10T05:11:33.747938+0000","last_unstale":"2024-09-10T05:14:43.098530+0000","last_undegraded":"2024-09-10T05:14:43.098530+0000","last_fullsized":"2024-09-10T05:14:43.098530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:53.311224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":351,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.014451+0000","last_change":"2024-09-10T05:11:35.754114+0000","last_active":"2024-09-10T05:14:43.014451+0000","last_peered":"2024-09-10T05:14:43.014451+0000","last_clean":"2024-09-10T05:14:43.014451+0000","last_became_active":"2024-09-10T05:11:35.753663+0000","last_became_peered":"2024-09-10T05:11:35.753663+0000","last_unstale":"2024-09-10T05:14:43.014451+0000","last_undegraded":"2024-09-10T05:14:43.014451+0000","last_fullsized":"2024-09-10T05:14:43.014451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.071659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.125804+0000","last_change":"2024-09-10T05:11:37.755275+0000","last_active":"2024-09-10T05:14:36.125804+0000","last_peered":"2024-09-10T05:14:36.125804+0000","last_clean":"2024-09-10T05:14:36.125804+0000","last_became_active":"2024-09-10T05:11:37.754959+0000","last_became_peered":"2024-09-10T05:11:37.754959+0000","last_unstale":"2024-09-10T05:14:36.125804+0000","last_undegraded":"2024-09-10T05:14:36.125804+0000","last_fullsized":"2024-09-10T05:14:36.125804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:34:33.810681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'17","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.630437+0000","last_change":"2024-09-10T05:15:04.630437+0000","last_active":"2024-09-10T05:15:04.630437+0000","last_peered":"2024-09-10T05:15:04.630437+0000","last_clean":"2024-09-10T05:15:04.630437+0000","last_became_active":"2024-09-10T05:11:29.722267+0000","last_became_peered":"2024-09-10T05:11:29.722267+0000","last_unstale":"2024-09-10T05:15:04.630437+0000","last_undegraded":"2024-09-10T05:15:04.630437+0000","last_fullsized":"2024-09-10T05:15:04.630437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'17","last_scrub_stamp":"2024-09-10T05:15:04.630348+0000","last_deep_scrub":"37'17","last_deep_scrub_stamp":"2024-09-10T05:15:04.630348+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.630348+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:25.140187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'8","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.914417+0000","last_change":"2024-09-10T05:14:57.914417+0000","last_active":"2024-09-10T05:14:57.914417+0000","last_peered":"2024-09-10T05:14:57.914417+0000","last_clean":"2024-09-10T05:14:57.914417+0000","last_became_active":"2024-09-10T05:11:27.731909+0000","last_became_peered":"2024-09-10T05:11:27.731909+0000","last_unstale":"2024-09-10T05:14:57.914417+0000","last_undegraded":"2024-09-10T05:14:57.914417+0000","last_fullsized":"2024-09-10T05:14:57.914417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:14:57.914334+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:14:57.914334+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.914334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:28.529230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957106+0000","last_change":"2024-09-10T05:11:31.733054+0000","last_active":"2024-09-10T05:12:04.957106+0000","last_peered":"2024-09-10T05:12:04.957106+0000","last_clean":"2024-09-10T05:12:04.957106+0000","last_became_active":"2024-09-10T05:11:31.732807+0000","last_became_peered":"2024-09-10T05:11:31.732807+0000","last_unstale":"2024-09-10T05:12:04.957106+0000","last_undegraded":"2024-09-10T05:12:04.957106+0000","last_fullsized":"2024-09-10T05:12:04.957106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:45.290579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'72","reported_seq":149,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.150182+0000","last_change":"2024-09-10T05:11:33.747177+0000","last_active":"2024-09-10T05:14:43.150182+0000","last_peered":"2024-09-10T05:14:43.150182+0000","last_clean":"2024-09-10T05:14:43.150182+0000","last_became_active":"2024-09-10T05:11:33.745449+0000","last_became_peered":"2024-09-10T05:11:33.745449+0000","last_unstale":"2024-09-10T05:14:43.150182+0000","last_undegraded":"2024-09-10T05:14:43.150182+0000","last_fullsized":"2024-09-10T05:14:43.150182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:08.744407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956380+0000","last_change":"2024-09-10T05:11:35.748171+0000","last_active":"2024-09-10T05:12:04.956380+0000","last_peered":"2024-09-10T05:12:04.956380+0000","last_clean":"2024-09-10T05:12:04.956380+0000","last_became_active":"2024-09-10T05:11:35.747913+0000","last_became_peered":"2024-09-10T05:11:35.747913+0000","last_unstale":"2024-09-10T05:12:04.956380+0000","last_undegraded":"2024-09-10T05:12:04.956380+0000","last_fullsized":"2024-09-10T05:12:04.956380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:43.800560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'20","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.564815+0000","last_change":"2024-09-10T05:11:37.755327+0000","last_active":"2024-09-10T05:14:36.564815+0000","last_peered":"2024-09-10T05:14:36.564815+0000","last_clean":"2024-09-10T05:14:36.564815+0000","last_became_active":"2024-09-10T05:11:37.754915+0000","last_became_peered":"2024-09-10T05:11:37.754915+0000","last_unstale":"2024-09-10T05:14:36.564815+0000","last_undegraded":"2024-09-10T05:14:36.564815+0000","last_fullsized":"2024-09-10T05:14:36.564815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:57.393330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'14","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.379312+0000","last_change":"2024-09-10T05:15:02.379312+0000","last_active":"2024-09-10T05:15:02.379312+0000","last_peered":"2024-09-10T05:15:02.379312+0000","last_clean":"2024-09-10T05:15:02.379312+0000","last_became_active":"2024-09-10T05:11:29.727349+0000","last_became_peered":"2024-09-10T05:11:29.727349+0000","last_unstale":"2024-09-10T05:15:02.379312+0000","last_undegraded":"2024-09-10T05:15:02.379312+0000","last_fullsized":"2024-09-10T05:15:02.379312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:02.379225+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:02.379225+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.379225+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:14.485317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.470556+0000","last_change":"2024-09-10T05:14:51.470556+0000","last_active":"2024-09-10T05:14:51.470556+0000","last_peered":"2024-09-10T05:14:51.470556+0000","last_clean":"2024-09-10T05:14:51.470556+0000","last_became_active":"2024-09-10T05:11:27.717887+0000","last_became_peered":"2024-09-10T05:11:27.717887+0000","last_unstale":"2024-09-10T05:14:51.470556+0000","last_undegraded":"2024-09-10T05:14:51.470556+0000","last_fullsized":"2024-09-10T05:14:51.470556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:51.470452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:51.470452+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.470452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:41.087698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959422+0000","last_change":"2024-09-10T05:11:31.735674+0000","last_active":"2024-09-10T05:12:04.959422+0000","last_peered":"2024-09-10T05:12:04.959422+0000","last_clean":"2024-09-10T05:12:04.959422+0000","last_became_active":"2024-09-10T05:11:31.735386+0000","last_became_peered":"2024-09-10T05:11:31.735386+0000","last_unstale":"2024-09-10T05:12:04.959422+0000","last_undegraded":"2024-09-10T05:12:04.959422+0000","last_fullsized":"2024-09-10T05:12:04.959422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:05.541110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'41","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.153199+0000","last_change":"2024-09-10T05:11:33.744354+0000","last_active":"2024-09-10T05:14:43.153199+0000","last_peered":"2024-09-10T05:14:43.153199+0000","last_clean":"2024-09-10T05:14:43.153199+0000","last_became_active":"2024-09-10T05:11:33.744026+0000","last_became_peered":"2024-09-10T05:11:33.744026+0000","last_unstale":"2024-09-10T05:14:43.153199+0000","last_undegraded":"2024-09-10T05:14:43.153199+0000","last_fullsized":"2024-09-10T05:14:43.153199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.017634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960608+0000","last_change":"2024-09-10T05:11:35.749447+0000","last_active":"2024-09-10T05:12:04.960608+0000","last_peered":"2024-09-10T05:12:04.960608+0000","last_clean":"2024-09-10T05:12:04.960608+0000","last_became_active":"2024-09-10T05:11:35.748874+0000","last_became_peered":"2024-09-10T05:11:35.748874+0000","last_unstale":"2024-09-10T05:12:04.960608+0000","last_undegraded":"2024-09-10T05:12:04.960608+0000","last_fullsized":"2024-09-10T05:12:04.960608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:09.658936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'9","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.113777+0000","last_change":"2024-09-10T05:11:37.768186+0000","last_active":"2024-09-10T05:14:36.113777+0000","last_peered":"2024-09-10T05:14:36.113777+0000","last_clean":"2024-09-10T05:14:36.113777+0000","last_became_active":"2024-09-10T05:11:37.767895+0000","last_became_peered":"2024-09-10T05:11:37.767895+0000","last_unstale":"2024-09-10T05:14:36.113777+0000","last_undegraded":"2024-09-10T05:14:36.113777+0000","last_fullsized":"2024-09-10T05:14:36.113777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:10.944772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'16","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604812+0000","last_change":"2024-09-10T05:11:29.734119+0000","last_active":"2024-09-10T05:13:32.604812+0000","last_peered":"2024-09-10T05:13:32.604812+0000","last_clean":"2024-09-10T05:13:32.604812+0000","last_became_active":"2024-09-10T05:11:29.733870+0000","last_became_peered":"2024-09-10T05:11:29.733870+0000","last_unstale":"2024-09-10T05:13:32.604812+0000","last_undegraded":"2024-09-10T05:13:32.604812+0000","last_fullsized":"2024-09-10T05:13:32.604812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:25:17.874072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.937882+0000","last_change":"2024-09-10T05:14:56.937882+0000","last_active":"2024-09-10T05:14:56.937882+0000","last_peered":"2024-09-10T05:14:56.937882+0000","last_clean":"2024-09-10T05:14:56.937882+0000","last_became_active":"2024-09-10T05:11:27.725852+0000","last_became_peered":"2024-09-10T05:11:27.725852+0000","last_unstale":"2024-09-10T05:14:56.937882+0000","last_undegraded":"2024-09-10T05:14:56.937882+0000","last_fullsized":"2024-09-10T05:14:56.937882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:56.937795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:56.937795+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.937795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:18.007474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957204+0000","last_change":"2024-09-10T05:11:31.734106+0000","last_active":"2024-09-10T05:12:04.957204+0000","last_peered":"2024-09-10T05:12:04.957204+0000","last_clean":"2024-09-10T05:12:04.957204+0000","last_became_active":"2024-09-10T05:11:31.733756+0000","last_became_peered":"2024-09-10T05:11:31.733756+0000","last_unstale":"2024-09-10T05:12:04.957204+0000","last_undegraded":"2024-09-10T05:12:04.957204+0000","last_fullsized":"2024-09-10T05:12:04.957204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:20.576939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'41","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.132623+0000","last_change":"2024-09-10T05:11:33.742119+0000","last_active":"2024-09-10T05:14:43.132623+0000","last_peered":"2024-09-10T05:14:43.132623+0000","last_clean":"2024-09-10T05:14:43.132623+0000","last_became_active":"2024-09-10T05:11:33.741848+0000","last_became_peered":"2024-09-10T05:11:33.741848+0000","last_unstale":"2024-09-10T05:14:43.132623+0000","last_undegraded":"2024-09-10T05:14:43.132623+0000","last_fullsized":"2024-09-10T05:14:43.132623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:58.109463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'285","reported_seq":455,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.006459+0000","last_change":"2024-09-10T05:11:35.752932+0000","last_active":"2024-09-10T05:14:43.006459+0000","last_peered":"2024-09-10T05:14:43.006459+0000","last_clean":"2024-09-10T05:14:43.006459+0000","last_became_active":"2024-09-10T05:11:35.752511+0000","last_became_peered":"2024-09-10T05:11:35.752511+0000","last_unstale":"2024-09-10T05:14:43.006459+0000","last_undegraded":"2024-09-10T05:14:43.006459+0000","last_fullsized":"2024-09-10T05:14:43.006459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:09.522467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'14","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:43.909368+0000","last_change":"2024-09-10T05:11:37.758779+0000","last_active":"2024-09-10T05:13:43.909368+0000","last_peered":"2024-09-10T05:13:43.909368+0000","last_clean":"2024-09-10T05:13:43.909368+0000","last_became_active":"2024-09-10T05:11:37.758381+0000","last_became_peered":"2024-09-10T05:11:37.758381+0000","last_unstale":"2024-09-10T05:13:43.909368+0000","last_undegraded":"2024-09-10T05:13:43.909368+0000","last_fullsized":"2024-09-10T05:13:43.909368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:32.090333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'14","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.632091+0000","last_change":"2024-09-10T05:15:05.632091+0000","last_active":"2024-09-10T05:15:05.632091+0000","last_peered":"2024-09-10T05:15:05.632091+0000","last_clean":"2024-09-10T05:15:05.632091+0000","last_became_active":"2024-09-10T05:11:29.722170+0000","last_became_peered":"2024-09-10T05:11:29.722170+0000","last_unstale":"2024-09-10T05:15:05.632091+0000","last_undegraded":"2024-09-10T05:15:05.632091+0000","last_fullsized":"2024-09-10T05:15:05.632091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:05.632009+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:05.632009+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.632009+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:23.914770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.932355+0000","last_change":"2024-09-10T05:14:55.932355+0000","last_active":"2024-09-10T05:14:55.932355+0000","last_peered":"2024-09-10T05:14:55.932355+0000","last_clean":"2024-09-10T05:14:55.932355+0000","last_became_active":"2024-09-10T05:11:27.732591+0000","last_became_peered":"2024-09-10T05:11:27.732591+0000","last_unstale":"2024-09-10T05:14:55.932355+0000","last_undegraded":"2024-09-10T05:14:55.932355+0000","last_fullsized":"2024-09-10T05:14:55.932355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:55.932231+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:55.932231+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.932231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:54.606915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":418,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:42.987475+0000","last_change":"2024-09-10T05:11:31.735002+0000","last_active":"2024-09-10T05:14:42.987475+0000","last_peered":"2024-09-10T05:14:42.987475+0000","last_clean":"2024-09-10T05:14:42.987475+0000","last_became_active":"2024-09-10T05:11:31.734714+0000","last_became_peered":"2024-09-10T05:11:31.734714+0000","last_unstale":"2024-09-10T05:14:42.987475+0000","last_undegraded":"2024-09-10T05:14:42.987475+0000","last_fullsized":"2024-09-10T05:14:42.987475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:15.409455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958372+0000","last_change":"2024-09-10T05:11:33.747604+0000","last_active":"2024-09-10T05:12:04.958372+0000","last_peered":"2024-09-10T05:12:04.958372+0000","last_clean":"2024-09-10T05:12:04.958372+0000","last_became_active":"2024-09-10T05:11:33.747376+0000","last_became_peered":"2024-09-10T05:11:33.747376+0000","last_unstale":"2024-09-10T05:12:04.958372+0000","last_undegraded":"2024-09-10T05:12:04.958372+0000","last_fullsized":"2024-09-10T05:12:04.958372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:06.584551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'285","reported_seq":466,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.007782+0000","last_change":"2024-09-10T05:11:35.751653+0000","last_active":"2024-09-10T05:14:43.007782+0000","last_peered":"2024-09-10T05:14:43.007782+0000","last_clean":"2024-09-10T05:14:43.007782+0000","last_became_active":"2024-09-10T05:11:35.751352+0000","last_became_peered":"2024-09-10T05:11:35.751352+0000","last_unstale":"2024-09-10T05:14:43.007782+0000","last_undegraded":"2024-09-10T05:14:43.007782+0000","last_fullsized":"2024-09-10T05:14:43.007782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:50.857756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.203681+0000","last_change":"2024-09-10T05:11:37.757022+0000","last_active":"2024-09-10T05:14:36.203681+0000","last_peered":"2024-09-10T05:14:36.203681+0000","last_clean":"2024-09-10T05:14:36.203681+0000","last_became_active":"2024-09-10T05:11:37.756734+0000","last_became_peered":"2024-09-10T05:11:37.756734+0000","last_unstale":"2024-09-10T05:14:36.203681+0000","last_undegraded":"2024-09-10T05:14:36.203681+0000","last_fullsized":"2024-09-10T05:14:36.203681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:18.190348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'24","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.367487+0000","last_change":"2024-09-10T05:15:04.367487+0000","last_active":"2024-09-10T05:15:04.367487+0000","last_peered":"2024-09-10T05:15:04.367487+0000","last_clean":"2024-09-10T05:15:04.367487+0000","last_became_active":"2024-09-10T05:11:29.735032+0000","last_became_peered":"2024-09-10T05:11:29.735032+0000","last_unstale":"2024-09-10T05:15:04.367487+0000","last_undegraded":"2024-09-10T05:15:04.367487+0000","last_fullsized":"2024-09-10T05:15:04.367487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24","last_scrub_stamp":"2024-09-10T05:15:04.367405+0000","last_deep_scrub":"37'24","last_deep_scrub_stamp":"2024-09-10T05:15:04.367405+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.367405+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:35.414356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.972818+0000","last_change":"2024-09-10T05:14:54.972818+0000","last_active":"2024-09-10T05:14:54.972818+0000","last_peered":"2024-09-10T05:14:54.972818+0000","last_clean":"2024-09-10T05:14:54.972818+0000","last_became_active":"2024-09-10T05:11:27.734204+0000","last_became_peered":"2024-09-10T05:11:27.734204+0000","last_unstale":"2024-09-10T05:14:54.972818+0000","last_undegraded":"2024-09-10T05:14:54.972818+0000","last_fullsized":"2024-09-10T05:14:54.972818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:54.972735+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:54.972735+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.972735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:47.793245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962223+0000","last_change":"2024-09-10T05:11:31.737418+0000","last_active":"2024-09-10T05:12:04.962223+0000","last_peered":"2024-09-10T05:12:04.962223+0000","last_clean":"2024-09-10T05:12:04.962223+0000","last_became_active":"2024-09-10T05:11:31.736841+0000","last_became_peered":"2024-09-10T05:11:31.736841+0000","last_unstale":"2024-09-10T05:12:04.962223+0000","last_undegraded":"2024-09-10T05:12:04.962223+0000","last_fullsized":"2024-09-10T05:12:04.962223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:39.906395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'42","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.084121+0000","last_change":"2024-09-10T05:11:33.744918+0000","last_active":"2024-09-10T05:14:43.084121+0000","last_peered":"2024-09-10T05:14:43.084121+0000","last_clean":"2024-09-10T05:14:43.084121+0000","last_became_active":"2024-09-10T05:11:33.744394+0000","last_became_peered":"2024-09-10T05:11:33.744394+0000","last_unstale":"2024-09-10T05:14:43.084121+0000","last_undegraded":"2024-09-10T05:14:43.084121+0000","last_fullsized":"2024-09-10T05:14:43.084121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:42.791441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959396+0000","last_change":"2024-09-10T05:11:35.750802+0000","last_active":"2024-09-10T05:12:04.959396+0000","last_peered":"2024-09-10T05:12:04.959396+0000","last_clean":"2024-09-10T05:12:04.959396+0000","last_became_active":"2024-09-10T05:11:35.750450+0000","last_became_peered":"2024-09-10T05:11:35.750450+0000","last_unstale":"2024-09-10T05:12:04.959396+0000","last_undegraded":"2024-09-10T05:12:04.959396+0000","last_fullsized":"2024-09-10T05:12:04.959396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:00.422593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'6","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.453623+0000","last_change":"2024-09-10T05:11:37.757621+0000","last_active":"2024-09-10T05:14:36.453623+0000","last_peered":"2024-09-10T05:14:36.453623+0000","last_clean":"2024-09-10T05:14:36.453623+0000","last_became_active":"2024-09-10T05:11:37.757289+0000","last_became_peered":"2024-09-10T05:11:37.757289+0000","last_unstale":"2024-09-10T05:14:36.453623+0000","last_undegraded":"2024-09-10T05:14:36.453623+0000","last_fullsized":"2024-09-10T05:14:36.453623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:57.261211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'8","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417687+0000","last_change":"2024-09-10T05:11:29.734971+0000","last_active":"2024-09-10T05:14:36.417687+0000","last_peered":"2024-09-10T05:14:36.417687+0000","last_clean":"2024-09-10T05:14:36.417687+0000","last_became_active":"2024-09-10T05:11:29.734367+0000","last_became_peered":"2024-09-10T05:11:29.734367+0000","last_unstale":"2024-09-10T05:14:36.417687+0000","last_undegraded":"2024-09-10T05:14:36.417687+0000","last_fullsized":"2024-09-10T05:14:36.417687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:48.993029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":156,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:46.450393+0000","last_change":"2024-09-10T05:14:46.450393+0000","last_active":"2024-09-10T05:14:46.450393+0000","last_peered":"2024-09-10T05:14:46.450393+0000","last_clean":"2024-09-10T05:14:46.450393+0000","last_became_active":"2024-09-10T05:11:14.293121+0000","last_became_peered":"2024-09-10T05:11:14.293121+0000","last_unstale":"2024-09-10T05:14:46.450393+0000","last_undegraded":"2024-09-10T05:14:46.450393+0000","last_fullsized":"2024-09-10T05:14:46.450393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-10T05:14:46.450301+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-10T05:14:46.450301+0000","last_clean_scrub_stamp":"2024-09-10T05:14:46.450301+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:41.127694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.069657+0000","last_change":"2024-09-10T05:14:51.069657+0000","last_active":"2024-09-10T05:14:51.069657+0000","last_peered":"2024-09-10T05:14:51.069657+0000","last_clean":"2024-09-10T05:14:51.069657+0000","last_became_active":"2024-09-10T05:11:16.531926+0000","last_became_peered":"2024-09-10T05:11:16.531926+0000","last_unstale":"2024-09-10T05:14:51.069657+0000","last_undegraded":"2024-09-10T05:14:51.069657+0000","last_fullsized":"2024-09-10T05:14:51.069657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:51.069579+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:51.069579+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.069579+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:40.169755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001121101,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.034277+0000","last_change":"2024-09-10T05:14:52.034277+0000","last_active":"2024-09-10T05:14:52.034277+0000","last_peered":"2024-09-10T05:14:52.034277+0000","last_clean":"2024-09-10T05:14:52.034277+0000","last_became_active":"2024-09-10T05:11:27.735941+0000","last_became_peered":"2024-09-10T05:11:27.735941+0000","last_unstale":"2024-09-10T05:14:52.034277+0000","last_undegraded":"2024-09-10T05:14:52.034277+0000","last_fullsized":"2024-09-10T05:14:52.034277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.034181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.034181+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.034181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:53.640936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960299+0000","last_change":"2024-09-10T05:11:31.736397+0000","last_active":"2024-09-10T05:12:04.960299+0000","last_peered":"2024-09-10T05:12:04.960299+0000","last_clean":"2024-09-10T05:12:04.960299+0000","last_became_active":"2024-09-10T05:11:31.736104+0000","last_became_peered":"2024-09-10T05:11:31.736104+0000","last_unstale":"2024-09-10T05:12:04.960299+0000","last_undegraded":"2024-09-10T05:12:04.960299+0000","last_fullsized":"2024-09-10T05:12:04.960299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:58.631203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'94","reported_seq":182,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.117691+0000","last_change":"2024-09-10T05:11:33.744321+0000","last_active":"2024-09-10T05:14:43.117691+0000","last_peered":"2024-09-10T05:14:43.117691+0000","last_clean":"2024-09-10T05:14:43.117691+0000","last_became_active":"2024-09-10T05:11:33.743933+0000","last_became_peered":"2024-09-10T05:11:33.743933+0000","last_unstale":"2024-09-10T05:14:43.117691+0000","last_undegraded":"2024-09-10T05:14:43.117691+0000","last_fullsized":"2024-09-10T05:14:43.117691+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:30.903532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957924+0000","last_change":"2024-09-10T05:11:35.750549+0000","last_active":"2024-09-10T05:12:04.957924+0000","last_peered":"2024-09-10T05:12:04.957924+0000","last_clean":"2024-09-10T05:12:04.957924+0000","last_became_active":"2024-09-10T05:11:35.750248+0000","last_became_peered":"2024-09-10T05:11:35.750248+0000","last_unstale":"2024-09-10T05:12:04.957924+0000","last_undegraded":"2024-09-10T05:12:04.957924+0000","last_fullsized":"2024-09-10T05:12:04.957924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:19.363818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'85","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.427998+0000","last_change":"2024-09-10T05:11:37.755526+0000","last_active":"2024-09-10T05:14:36.427998+0000","last_peered":"2024-09-10T05:14:36.427998+0000","last_clean":"2024-09-10T05:14:36.427998+0000","last_became_active":"2024-09-10T05:11:37.755239+0000","last_became_peered":"2024-09-10T05:11:37.755239+0000","last_unstale":"2024-09-10T05:14:36.427998+0000","last_undegraded":"2024-09-10T05:14:36.427998+0000","last_fullsized":"2024-09-10T05:14:36.427998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:13.536289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.387697+0000","last_change":"2024-09-10T05:11:29.732838+0000","last_active":"2024-09-10T05:14:36.387697+0000","last_peered":"2024-09-10T05:14:36.387697+0000","last_clean":"2024-09-10T05:14:36.387697+0000","last_became_active":"2024-09-10T05:11:29.732560+0000","last_became_peered":"2024-09-10T05:11:29.732560+0000","last_unstale":"2024-09-10T05:14:36.387697+0000","last_undegraded":"2024-09-10T05:14:36.387697+0000","last_fullsized":"2024-09-10T05:14:36.387697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:38.766836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.116383+0000","last_change":"2024-09-10T05:14:48.116383+0000","last_active":"2024-09-10T05:14:48.116383+0000","last_peered":"2024-09-10T05:14:48.116383+0000","last_clean":"2024-09-10T05:14:48.116383+0000","last_became_active":"2024-09-10T05:11:16.531911+0000","last_became_peered":"2024-09-10T05:11:16.531911+0000","last_unstale":"2024-09-10T05:14:48.116383+0000","last_undegraded":"2024-09-10T05:14:48.116383+0000","last_fullsized":"2024-09-10T05:14:48.116383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.116290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.116290+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.116290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:40.342657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039105900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.545643+0000","last_change":"2024-09-10T05:14:48.545643+0000","last_active":"2024-09-10T05:14:48.545643+0000","last_peered":"2024-09-10T05:14:48.545643+0000","last_clean":"2024-09-10T05:14:48.545643+0000","last_became_active":"2024-09-10T05:11:27.713026+0000","last_became_peered":"2024-09-10T05:11:27.713026+0000","last_unstale":"2024-09-10T05:14:48.545643+0000","last_undegraded":"2024-09-10T05:14:48.545643+0000","last_fullsized":"2024-09-10T05:14:48.545643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:48.545569+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:48.545569+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.545569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:09.108323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961506+0000","last_change":"2024-09-10T05:11:31.738104+0000","last_active":"2024-09-10T05:12:04.961506+0000","last_peered":"2024-09-10T05:12:04.961506+0000","last_clean":"2024-09-10T05:12:04.961506+0000","last_became_active":"2024-09-10T05:11:31.737199+0000","last_became_peered":"2024-09-10T05:11:31.737199+0000","last_unstale":"2024-09-10T05:12:04.961506+0000","last_undegraded":"2024-09-10T05:12:04.961506+0000","last_fullsized":"2024-09-10T05:12:04.961506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:08.807684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'292","reported_seq":514,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.145377+0000","last_change":"2024-09-10T05:11:33.744372+0000","last_active":"2024-09-10T05:14:43.145377+0000","last_peered":"2024-09-10T05:14:43.145377+0000","last_clean":"2024-09-10T05:14:43.145377+0000","last_became_active":"2024-09-10T05:11:33.744103+0000","last_became_peered":"2024-09-10T05:11:33.744103+0000","last_unstale":"2024-09-10T05:14:43.145377+0000","last_undegraded":"2024-09-10T05:14:43.145377+0000","last_fullsized":"2024-09-10T05:14:43.145377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:33.869492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":393,"num_read_kb":395,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956847+0000","last_change":"2024-09-10T05:11:35.749117+0000","last_active":"2024-09-10T05:12:04.956847+0000","last_peered":"2024-09-10T05:12:04.956847+0000","last_clean":"2024-09-10T05:12:04.956847+0000","last_became_active":"2024-09-10T05:11:35.748767+0000","last_became_peered":"2024-09-10T05:11:35.748767+0000","last_unstale":"2024-09-10T05:12:04.956847+0000","last_undegraded":"2024-09-10T05:12:04.956847+0000","last_fullsized":"2024-09-10T05:12:04.956847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:02.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.966773+0000","last_change":"2024-09-10T05:11:37.758407+0000","last_active":"2024-09-10T05:12:51.966773+0000","last_peered":"2024-09-10T05:12:51.966773+0000","last_clean":"2024-09-10T05:12:51.966773+0000","last_became_active":"2024-09-10T05:11:37.758114+0000","last_became_peered":"2024-09-10T05:11:37.758114+0000","last_unstale":"2024-09-10T05:12:51.966773+0000","last_undegraded":"2024-09-10T05:12:51.966773+0000","last_fullsized":"2024-09-10T05:12:51.966773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:43.659998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'14","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.455496+0000","last_change":"2024-09-10T05:15:02.455496+0000","last_active":"2024-09-10T05:15:02.455496+0000","last_peered":"2024-09-10T05:15:02.455496+0000","last_clean":"2024-09-10T05:15:02.455496+0000","last_became_active":"2024-09-10T05:11:29.723609+0000","last_became_peered":"2024-09-10T05:11:29.723609+0000","last_unstale":"2024-09-10T05:15:02.455496+0000","last_undegraded":"2024-09-10T05:15:02.455496+0000","last_fullsized":"2024-09-10T05:15:02.455496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:02.455410+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:02.455410+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.455410+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:08.842470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.698433+0000","last_change":"2024-09-10T05:14:48.698433+0000","last_active":"2024-09-10T05:14:48.698433+0000","last_peered":"2024-09-10T05:14:48.698433+0000","last_clean":"2024-09-10T05:14:48.698433+0000","last_became_active":"2024-09-10T05:11:16.530448+0000","last_became_peered":"2024-09-10T05:11:16.530448+0000","last_unstale":"2024-09-10T05:14:48.698433+0000","last_undegraded":"2024-09-10T05:14:48.698433+0000","last_fullsized":"2024-09-10T05:14:48.698433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.698352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.698352+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.698352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:12.098710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036982300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'6","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.508513+0000","last_change":"2024-09-10T05:14:47.508513+0000","last_active":"2024-09-10T05:14:47.508513+0000","last_peered":"2024-09-10T05:14:47.508513+0000","last_clean":"2024-09-10T05:14:47.508513+0000","last_became_active":"2024-09-10T05:11:27.714299+0000","last_became_peered":"2024-09-10T05:11:27.714299+0000","last_unstale":"2024-09-10T05:14:47.508513+0000","last_undegraded":"2024-09-10T05:14:47.508513+0000","last_fullsized":"2024-09-10T05:14:47.508513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:14:47.508436+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:14:47.508436+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.508436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:06.719872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963356+0000","last_change":"2024-09-10T05:11:31.731588+0000","last_active":"2024-09-10T05:12:04.963356+0000","last_peered":"2024-09-10T05:12:04.963356+0000","last_clean":"2024-09-10T05:12:04.963356+0000","last_became_active":"2024-09-10T05:11:31.730978+0000","last_became_peered":"2024-09-10T05:11:31.730978+0000","last_unstale":"2024-09-10T05:12:04.963356+0000","last_undegraded":"2024-09-10T05:12:04.963356+0000","last_fullsized":"2024-09-10T05:12:04.963356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:07.052816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'17","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:31.813393+0000","last_change":"2024-09-10T05:11:33.746382+0000","last_active":"2024-09-10T05:14:31.813393+0000","last_peered":"2024-09-10T05:14:31.813393+0000","last_clean":"2024-09-10T05:14:31.813393+0000","last_became_active":"2024-09-10T05:11:33.746102+0000","last_became_peered":"2024-09-10T05:11:33.746102+0000","last_unstale":"2024-09-10T05:14:31.813393+0000","last_undegraded":"2024-09-10T05:14:31.813393+0000","last_fullsized":"2024-09-10T05:14:31.813393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:53.746336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957971+0000","last_change":"2024-09-10T05:11:35.753872+0000","last_active":"2024-09-10T05:12:04.957971+0000","last_peered":"2024-09-10T05:12:04.957971+0000","last_clean":"2024-09-10T05:12:04.957971+0000","last_became_active":"2024-09-10T05:11:35.753342+0000","last_became_peered":"2024-09-10T05:11:35.753342+0000","last_unstale":"2024-09-10T05:12:04.957971+0000","last_undegraded":"2024-09-10T05:12:04.957971+0000","last_fullsized":"2024-09-10T05:12:04.957971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:37.752504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955113+0000","last_change":"2024-09-10T05:11:37.769011+0000","last_active":"2024-09-10T05:12:04.955113+0000","last_peered":"2024-09-10T05:12:04.955113+0000","last_clean":"2024-09-10T05:12:04.955113+0000","last_became_active":"2024-09-10T05:11:37.767788+0000","last_became_peered":"2024-09-10T05:11:37.767788+0000","last_unstale":"2024-09-10T05:12:04.955113+0000","last_undegraded":"2024-09-10T05:12:04.955113+0000","last_fullsized":"2024-09-10T05:12:04.955113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:55.792983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.435853+0000","last_change":"2024-09-10T05:15:01.435853+0000","last_active":"2024-09-10T05:15:01.435853+0000","last_peered":"2024-09-10T05:15:01.435853+0000","last_clean":"2024-09-10T05:15:01.435853+0000","last_became_active":"2024-09-10T05:11:29.727022+0000","last_became_peered":"2024-09-10T05:11:29.727022+0000","last_unstale":"2024-09-10T05:15:01.435853+0000","last_undegraded":"2024-09-10T05:15:01.435853+0000","last_fullsized":"2024-09-10T05:15:01.435853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:01.435758+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:01.435758+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.435758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:15.080229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.096748+0000","last_change":"2024-09-10T05:14:49.096748+0000","last_active":"2024-09-10T05:14:49.096748+0000","last_peered":"2024-09-10T05:14:49.096748+0000","last_clean":"2024-09-10T05:14:49.096748+0000","last_became_active":"2024-09-10T05:11:16.530756+0000","last_became_peered":"2024-09-10T05:11:16.530756+0000","last_unstale":"2024-09-10T05:14:49.096748+0000","last_undegraded":"2024-09-10T05:14:49.096748+0000","last_fullsized":"2024-09-10T05:14:49.096748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:14:49.096654+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:14:49.096654+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.096654+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:56.602270+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001047784,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.744764+0000","last_change":"2024-09-10T05:14:47.744764+0000","last_active":"2024-09-10T05:14:47.744764+0000","last_peered":"2024-09-10T05:14:47.744764+0000","last_clean":"2024-09-10T05:14:47.744764+0000","last_became_active":"2024-09-10T05:11:27.718333+0000","last_became_peered":"2024-09-10T05:11:27.718333+0000","last_unstale":"2024-09-10T05:14:47.744764+0000","last_undegraded":"2024-09-10T05:14:47.744764+0000","last_fullsized":"2024-09-10T05:14:47.744764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:47.744665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:47.744665+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.744665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:14.527839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:05.900504+0000","last_change":"2024-09-10T05:12:04.965299+0000","last_active":"2024-09-10T05:12:05.900504+0000","last_peered":"2024-09-10T05:12:05.900504+0000","last_clean":"2024-09-10T05:12:05.900504+0000","last_became_active":"2024-09-10T05:12:04.964996+0000","last_became_peered":"2024-09-10T05:12:04.964996+0000","last_unstale":"2024-09-10T05:12:05.900504+0000","last_undegraded":"2024-09-10T05:12:05.900504+0000","last_fullsized":"2024-09-10T05:12:05.900504+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:02.241258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"37'13","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.691724+0000","last_change":"2024-09-10T05:11:33.743920+0000","last_active":"2024-09-10T05:14:35.691724+0000","last_peered":"2024-09-10T05:14:35.691724+0000","last_clean":"2024-09-10T05:14:35.691724+0000","last_became_active":"2024-09-10T05:11:33.743292+0000","last_became_peered":"2024-09-10T05:11:33.743292+0000","last_unstale":"2024-09-10T05:14:35.691724+0000","last_undegraded":"2024-09-10T05:14:35.691724+0000","last_fullsized":"2024-09-10T05:14:35.691724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:18.442235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960791+0000","last_change":"2024-09-10T05:11:35.752348+0000","last_active":"2024-09-10T05:12:04.960791+0000","last_peered":"2024-09-10T05:12:04.960791+0000","last_clean":"2024-09-10T05:12:04.960791+0000","last_became_active":"2024-09-10T05:11:35.751982+0000","last_became_peered":"2024-09-10T05:11:35.751982+0000","last_unstale":"2024-09-10T05:12:04.960791+0000","last_undegraded":"2024-09-10T05:12:04.960791+0000","last_fullsized":"2024-09-10T05:12:04.960791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:53.013137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.434600+0000","last_change":"2024-09-10T05:11:37.762596+0000","last_active":"2024-09-10T05:13:35.434600+0000","last_peered":"2024-09-10T05:13:35.434600+0000","last_clean":"2024-09-10T05:13:35.434600+0000","last_became_active":"2024-09-10T05:11:37.762327+0000","last_became_peered":"2024-09-10T05:11:37.762327+0000","last_unstale":"2024-09-10T05:13:35.434600+0000","last_undegraded":"2024-09-10T05:13:35.434600+0000","last_fullsized":"2024-09-10T05:13:35.434600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:33.354245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'16","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.437426+0000","last_change":"2024-09-10T05:15:00.437426+0000","last_active":"2024-09-10T05:15:00.437426+0000","last_peered":"2024-09-10T05:15:00.437426+0000","last_clean":"2024-09-10T05:15:00.437426+0000","last_became_active":"2024-09-10T05:11:29.730589+0000","last_became_peered":"2024-09-10T05:11:29.730589+0000","last_unstale":"2024-09-10T05:15:00.437426+0000","last_undegraded":"2024-09-10T05:15:00.437426+0000","last_fullsized":"2024-09-10T05:15:00.437426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:00.437305+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:00.437305+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.437305+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:23:10.739442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.660336+0000","last_change":"2024-09-10T05:14:49.660336+0000","last_active":"2024-09-10T05:14:49.660336+0000","last_peered":"2024-09-10T05:14:49.660336+0000","last_clean":"2024-09-10T05:14:49.660336+0000","last_became_active":"2024-09-10T05:11:27.716023+0000","last_became_peered":"2024-09-10T05:11:27.716023+0000","last_unstale":"2024-09-10T05:14:49.660336+0000","last_undegraded":"2024-09-10T05:14:49.660336+0000","last_fullsized":"2024-09-10T05:14:49.660336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:49.660254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:49.660254+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.660254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:37.581398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:46.486459+0000","last_change":"2024-09-10T05:14:46.486459+0000","last_active":"2024-09-10T05:14:46.486459+0000","last_peered":"2024-09-10T05:14:46.486459+0000","last_clean":"2024-09-10T05:14:46.486459+0000","last_became_active":"2024-09-10T05:11:16.532795+0000","last_became_peered":"2024-09-10T05:11:16.532795+0000","last_unstale":"2024-09-10T05:14:46.486459+0000","last_undegraded":"2024-09-10T05:14:46.486459+0000","last_fullsized":"2024-09-10T05:14:46.486459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:46.486390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:46.486390+0000","last_clean_scrub_stamp":"2024-09-10T05:14:46.486390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:24.690009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060128199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.586967+0000","last_change":"2024-09-10T05:11:31.734963+0000","last_active":"2024-09-10T05:14:36.586967+0000","last_peered":"2024-09-10T05:14:36.586967+0000","last_clean":"2024-09-10T05:14:36.586967+0000","last_became_active":"2024-09-10T05:11:31.734707+0000","last_became_peered":"2024-09-10T05:11:31.734707+0000","last_unstale":"2024-09-10T05:14:36.586967+0000","last_undegraded":"2024-09-10T05:14:36.586967+0000","last_fullsized":"2024-09-10T05:14:36.586967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:00.334943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'79","reported_seq":159,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.120784+0000","last_change":"2024-09-10T05:11:33.743569+0000","last_active":"2024-09-10T05:14:43.120784+0000","last_peered":"2024-09-10T05:14:43.120784+0000","last_clean":"2024-09-10T05:14:43.120784+0000","last_became_active":"2024-09-10T05:11:33.743238+0000","last_became_peered":"2024-09-10T05:11:33.743238+0000","last_unstale":"2024-09-10T05:14:43.120784+0000","last_undegraded":"2024-09-10T05:14:43.120784+0000","last_fullsized":"2024-09-10T05:14:43.120784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:26.759194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957685+0000","last_change":"2024-09-10T05:11:35.751255+0000","last_active":"2024-09-10T05:12:04.957685+0000","last_peered":"2024-09-10T05:12:04.957685+0000","last_clean":"2024-09-10T05:12:04.957685+0000","last_became_active":"2024-09-10T05:11:35.750830+0000","last_became_peered":"2024-09-10T05:11:35.750830+0000","last_unstale":"2024-09-10T05:12:04.957685+0000","last_undegraded":"2024-09-10T05:12:04.957685+0000","last_fullsized":"2024-09-10T05:12:04.957685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:07.959084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.612283+0000","last_change":"2024-09-10T05:11:37.759212+0000","last_active":"2024-09-10T05:13:35.612283+0000","last_peered":"2024-09-10T05:13:35.612283+0000","last_clean":"2024-09-10T05:13:35.612283+0000","last_became_active":"2024-09-10T05:11:37.758971+0000","last_became_peered":"2024-09-10T05:11:37.758971+0000","last_unstale":"2024-09-10T05:13:35.612283+0000","last_undegraded":"2024-09-10T05:13:35.612283+0000","last_fullsized":"2024-09-10T05:13:35.612283+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:10.652277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'14","reported_seq":90,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.389613+0000","last_change":"2024-09-10T05:15:01.389613+0000","last_active":"2024-09-10T05:15:01.389613+0000","last_peered":"2024-09-10T05:15:01.389613+0000","last_clean":"2024-09-10T05:15:01.389613+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:15:01.389613+0000","last_undegraded":"2024-09-10T05:15:01.389613+0000","last_fullsized":"2024-09-10T05:15:01.389613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:01.389524+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:01.389524+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.389524+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:15.262748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.500467+0000","last_change":"2024-09-10T05:14:50.500467+0000","last_active":"2024-09-10T05:14:50.500467+0000","last_peered":"2024-09-10T05:14:50.500467+0000","last_clean":"2024-09-10T05:14:50.500467+0000","last_became_active":"2024-09-10T05:11:27.718756+0000","last_became_peered":"2024-09-10T05:11:27.718756+0000","last_unstale":"2024-09-10T05:14:50.500467+0000","last_undegraded":"2024-09-10T05:14:50.500467+0000","last_fullsized":"2024-09-10T05:14:50.500467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.500341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.500341+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.500341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:21.655128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.083297+0000","last_change":"2024-09-10T05:14:50.083297+0000","last_active":"2024-09-10T05:14:50.083297+0000","last_peered":"2024-09-10T05:14:50.083297+0000","last_clean":"2024-09-10T05:14:50.083297+0000","last_became_active":"2024-09-10T05:11:16.530746+0000","last_became_peered":"2024-09-10T05:11:16.530746+0000","last_unstale":"2024-09-10T05:14:50.083297+0000","last_undegraded":"2024-09-10T05:14:50.083297+0000","last_fullsized":"2024-09-10T05:14:50.083297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.083200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.083200+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.083200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:05.779343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048256999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955118+0000","last_change":"2024-09-10T05:11:31.734598+0000","last_active":"2024-09-10T05:12:04.955118+0000","last_peered":"2024-09-10T05:12:04.955118+0000","last_clean":"2024-09-10T05:12:04.955118+0000","last_became_active":"2024-09-10T05:11:31.734333+0000","last_became_peered":"2024-09-10T05:11:31.734333+0000","last_unstale":"2024-09-10T05:12:04.955118+0000","last_undegraded":"2024-09-10T05:12:04.955118+0000","last_fullsized":"2024-09-10T05:12:04.955118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:04.362140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958360+0000","last_change":"2024-09-10T05:11:33.744326+0000","last_active":"2024-09-10T05:12:04.958360+0000","last_peered":"2024-09-10T05:12:04.958360+0000","last_clean":"2024-09-10T05:12:04.958360+0000","last_became_active":"2024-09-10T05:11:33.744011+0000","last_became_peered":"2024-09-10T05:11:33.744011+0000","last_unstale":"2024-09-10T05:12:04.958360+0000","last_undegraded":"2024-09-10T05:12:04.958360+0000","last_fullsized":"2024-09-10T05:12:04.958360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:25:21.898677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'285","reported_seq":349,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.003922+0000","last_change":"2024-09-10T05:11:35.743851+0000","last_active":"2024-09-10T05:14:43.003922+0000","last_peered":"2024-09-10T05:14:43.003922+0000","last_clean":"2024-09-10T05:14:43.003922+0000","last_became_active":"2024-09-10T05:11:35.743571+0000","last_became_peered":"2024-09-10T05:11:35.743571+0000","last_unstale":"2024-09-10T05:14:43.003922+0000","last_undegraded":"2024-09-10T05:14:43.003922+0000","last_fullsized":"2024-09-10T05:14:43.003922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.416572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.602302+0000","last_change":"2024-09-10T05:11:37.764931+0000","last_active":"2024-09-10T05:13:32.602302+0000","last_peered":"2024-09-10T05:13:32.602302+0000","last_clean":"2024-09-10T05:13:32.602302+0000","last_became_active":"2024-09-10T05:11:37.764657+0000","last_became_peered":"2024-09-10T05:11:37.764657+0000","last_unstale":"2024-09-10T05:13:32.602302+0000","last_undegraded":"2024-09-10T05:13:32.602302+0000","last_fullsized":"2024-09-10T05:13:32.602302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:33.836899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382938+0000","last_change":"2024-09-10T05:11:29.735974+0000","last_active":"2024-09-10T05:14:36.382938+0000","last_peered":"2024-09-10T05:14:36.382938+0000","last_clean":"2024-09-10T05:14:36.382938+0000","last_became_active":"2024-09-10T05:11:29.734731+0000","last_became_peered":"2024-09-10T05:11:29.734731+0000","last_unstale":"2024-09-10T05:14:36.382938+0000","last_undegraded":"2024-09-10T05:14:36.382938+0000","last_fullsized":"2024-09-10T05:14:36.382938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:47.453260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.997163+0000","last_change":"2024-09-10T05:14:53.997163+0000","last_active":"2024-09-10T05:14:53.997163+0000","last_peered":"2024-09-10T05:14:53.997163+0000","last_clean":"2024-09-10T05:14:53.997163+0000","last_became_active":"2024-09-10T05:11:27.723268+0000","last_became_peered":"2024-09-10T05:11:27.723268+0000","last_unstale":"2024-09-10T05:14:53.997163+0000","last_undegraded":"2024-09-10T05:14:53.997163+0000","last_fullsized":"2024-09-10T05:14:53.997163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.997077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.997077+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.997077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:30.512459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.499227+0000","last_change":"2024-09-10T05:14:53.499227+0000","last_active":"2024-09-10T05:14:53.499227+0000","last_peered":"2024-09-10T05:14:53.499227+0000","last_clean":"2024-09-10T05:14:53.499227+0000","last_became_active":"2024-09-10T05:11:16.531550+0000","last_became_peered":"2024-09-10T05:11:16.531550+0000","last_unstale":"2024-09-10T05:14:53.499227+0000","last_undegraded":"2024-09-10T05:14:53.499227+0000","last_fullsized":"2024-09-10T05:14:53.499227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.499101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.499101+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.499101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:59:02.083006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00063503699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955664+0000","last_change":"2024-09-10T05:11:31.734677+0000","last_active":"2024-09-10T05:12:04.955664+0000","last_peered":"2024-09-10T05:12:04.955664+0000","last_clean":"2024-09-10T05:12:04.955664+0000","last_became_active":"2024-09-10T05:11:31.734310+0000","last_became_peered":"2024-09-10T05:11:31.734310+0000","last_unstale":"2024-09-10T05:12:04.955664+0000","last_undegraded":"2024-09-10T05:12:04.955664+0000","last_fullsized":"2024-09-10T05:12:04.955664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:04.152181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'17","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.669838+0000","last_change":"2024-09-10T05:11:33.748918+0000","last_active":"2024-09-10T05:12:09.669838+0000","last_peered":"2024-09-10T05:12:09.669838+0000","last_clean":"2024-09-10T05:12:09.669838+0000","last_became_active":"2024-09-10T05:11:33.748603+0000","last_became_peered":"2024-09-10T05:11:33.748603+0000","last_unstale":"2024-09-10T05:12:09.669838+0000","last_undegraded":"2024-09-10T05:12:09.669838+0000","last_fullsized":"2024-09-10T05:12:09.669838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:30.495078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":392,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.009007+0000","last_change":"2024-09-10T05:11:35.746066+0000","last_active":"2024-09-10T05:14:43.009007+0000","last_peered":"2024-09-10T05:14:43.009007+0000","last_clean":"2024-09-10T05:14:43.009007+0000","last_became_active":"2024-09-10T05:11:35.745807+0000","last_became_peered":"2024-09-10T05:11:35.745807+0000","last_unstale":"2024-09-10T05:14:43.009007+0000","last_undegraded":"2024-09-10T05:14:43.009007+0000","last_fullsized":"2024-09-10T05:14:43.009007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:15.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960007+0000","last_change":"2024-09-10T05:11:37.762669+0000","last_active":"2024-09-10T05:12:04.960007+0000","last_peered":"2024-09-10T05:12:04.960007+0000","last_clean":"2024-09-10T05:12:04.960007+0000","last_became_active":"2024-09-10T05:11:37.762407+0000","last_became_peered":"2024-09-10T05:11:37.762407+0000","last_unstale":"2024-09-10T05:12:04.960007+0000","last_undegraded":"2024-09-10T05:12:04.960007+0000","last_fullsized":"2024-09-10T05:12:04.960007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:01.260628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.609389+0000","last_change":"2024-09-10T05:15:03.609389+0000","last_active":"2024-09-10T05:15:03.609389+0000","last_peered":"2024-09-10T05:15:03.609389+0000","last_clean":"2024-09-10T05:15:03.609389+0000","last_became_active":"2024-09-10T05:11:29.730285+0000","last_became_peered":"2024-09-10T05:11:29.730285+0000","last_unstale":"2024-09-10T05:15:03.609389+0000","last_undegraded":"2024-09-10T05:15:03.609389+0000","last_fullsized":"2024-09-10T05:15:03.609389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.609295+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.609295+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.609295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:48.096904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.429038+0000","last_change":"2024-09-10T05:14:47.429038+0000","last_active":"2024-09-10T05:14:47.429038+0000","last_peered":"2024-09-10T05:14:47.429038+0000","last_clean":"2024-09-10T05:14:47.429038+0000","last_became_active":"2024-09-10T05:11:27.731108+0000","last_became_peered":"2024-09-10T05:11:27.731108+0000","last_unstale":"2024-09-10T05:14:47.429038+0000","last_undegraded":"2024-09-10T05:14:47.429038+0000","last_fullsized":"2024-09-10T05:14:47.429038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:47.428954+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:47.428954+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.428954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:33.646520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.995705+0000","last_change":"2024-09-10T05:14:52.995705+0000","last_active":"2024-09-10T05:14:52.995705+0000","last_peered":"2024-09-10T05:14:52.995705+0000","last_clean":"2024-09-10T05:14:52.995705+0000","last_became_active":"2024-09-10T05:11:16.531468+0000","last_became_peered":"2024-09-10T05:11:16.531468+0000","last_unstale":"2024-09-10T05:14:52.995705+0000","last_undegraded":"2024-09-10T05:14:52.995705+0000","last_fullsized":"2024-09-10T05:14:52.995705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.995618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.995618+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.995618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:43.970590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001329722,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:31.733033+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:31.732753+0000","last_became_peered":"2024-09-10T05:11:31.732753+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:51.417779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'97","reported_seq":188,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.147368+0000","last_change":"2024-09-10T05:11:33.744480+0000","last_active":"2024-09-10T05:14:43.147368+0000","last_peered":"2024-09-10T05:14:43.147368+0000","last_clean":"2024-09-10T05:14:43.147368+0000","last_became_active":"2024-09-10T05:11:33.744217+0000","last_became_peered":"2024-09-10T05:11:33.744217+0000","last_unstale":"2024-09-10T05:14:43.147368+0000","last_undegraded":"2024-09-10T05:14:43.147368+0000","last_fullsized":"2024-09-10T05:14:43.147368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:27.251461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957339+0000","last_change":"2024-09-10T05:11:35.748212+0000","last_active":"2024-09-10T05:12:04.957339+0000","last_peered":"2024-09-10T05:12:04.957339+0000","last_clean":"2024-09-10T05:12:04.957339+0000","last_became_active":"2024-09-10T05:11:35.747924+0000","last_became_peered":"2024-09-10T05:11:35.747924+0000","last_unstale":"2024-09-10T05:12:04.957339+0000","last_undegraded":"2024-09-10T05:12:04.957339+0000","last_fullsized":"2024-09-10T05:12:04.957339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:15.162433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961201+0000","last_change":"2024-09-10T05:11:37.758521+0000","last_active":"2024-09-10T05:12:04.961201+0000","last_peered":"2024-09-10T05:12:04.961201+0000","last_clean":"2024-09-10T05:12:04.961201+0000","last_became_active":"2024-09-10T05:11:37.757947+0000","last_became_peered":"2024-09-10T05:11:37.757947+0000","last_unstale":"2024-09-10T05:12:04.961201+0000","last_undegraded":"2024-09-10T05:12:04.961201+0000","last_fullsized":"2024-09-10T05:12:04.961201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:42.540458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:52.143036+0000","last_change":"2024-09-10T05:11:37.759509+0000","last_active":"2024-09-10T05:12:52.143036+0000","last_peered":"2024-09-10T05:12:52.143036+0000","last_clean":"2024-09-10T05:12:52.143036+0000","last_became_active":"2024-09-10T05:11:37.759217+0000","last_became_peered":"2024-09-10T05:11:37.759217+0000","last_unstale":"2024-09-10T05:12:52.143036+0000","last_undegraded":"2024-09-10T05:12:52.143036+0000","last_fullsized":"2024-09-10T05:12:52.143036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:30.264676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'12","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.116908+0000","last_change":"2024-09-10T05:11:29.730421+0000","last_active":"2024-09-10T05:14:36.116908+0000","last_peered":"2024-09-10T05:14:36.116908+0000","last_clean":"2024-09-10T05:14:36.116908+0000","last_became_active":"2024-09-10T05:11:29.730105+0000","last_became_peered":"2024-09-10T05:11:29.730105+0000","last_unstale":"2024-09-10T05:14:36.116908+0000","last_undegraded":"2024-09-10T05:14:36.116908+0000","last_fullsized":"2024-09-10T05:14:36.116908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:52.776885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.953621+0000","last_change":"2024-09-10T05:15:00.953621+0000","last_active":"2024-09-10T05:15:00.953621+0000","last_peered":"2024-09-10T05:15:00.953621+0000","last_clean":"2024-09-10T05:15:00.953621+0000","last_became_active":"2024-09-10T05:11:27.731634+0000","last_became_peered":"2024-09-10T05:11:27.731634+0000","last_unstale":"2024-09-10T05:15:00.953621+0000","last_undegraded":"2024-09-10T05:15:00.953621+0000","last_fullsized":"2024-09-10T05:15:00.953621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:00.953536+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:00.953536+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.953536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.954553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.970384+0000","last_change":"2024-09-10T05:12:04.967896+0000","last_active":"2024-09-10T05:12:04.970384+0000","last_peered":"2024-09-10T05:12:04.970384+0000","last_clean":"2024-09-10T05:12:04.970384+0000","last_became_active":"2024-09-10T05:12:04.967513+0000","last_became_peered":"2024-09-10T05:12:04.967513+0000","last_unstale":"2024-09-10T05:12:04.970384+0000","last_undegraded":"2024-09-10T05:12:04.970384+0000","last_fullsized":"2024-09-10T05:12:04.970384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:00.790327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'42","reported_seq":96,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.095775+0000","last_change":"2024-09-10T05:11:33.745631+0000","last_active":"2024-09-10T05:14:43.095775+0000","last_peered":"2024-09-10T05:14:43.095775+0000","last_clean":"2024-09-10T05:14:43.095775+0000","last_became_active":"2024-09-10T05:11:33.745347+0000","last_became_peered":"2024-09-10T05:11:33.745347+0000","last_unstale":"2024-09-10T05:14:43.095775+0000","last_undegraded":"2024-09-10T05:14:43.095775+0000","last_fullsized":"2024-09-10T05:14:43.095775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:36.538308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954872+0000","last_change":"2024-09-10T05:11:35.754614+0000","last_active":"2024-09-10T05:12:04.954872+0000","last_peered":"2024-09-10T05:12:04.954872+0000","last_clean":"2024-09-10T05:12:04.954872+0000","last_became_active":"2024-09-10T05:11:35.754318+0000","last_became_peered":"2024-09-10T05:11:35.754318+0000","last_unstale":"2024-09-10T05:12:04.954872+0000","last_undegraded":"2024-09-10T05:12:04.954872+0000","last_fullsized":"2024-09-10T05:12:04.954872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:32.929275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:33.971128+0000","last_change":"2024-09-10T05:11:37.760662+0000","last_active":"2024-09-10T05:13:33.971128+0000","last_peered":"2024-09-10T05:13:33.971128+0000","last_clean":"2024-09-10T05:13:33.971128+0000","last_became_active":"2024-09-10T05:11:37.760471+0000","last_became_peered":"2024-09-10T05:11:37.760471+0000","last_unstale":"2024-09-10T05:13:33.971128+0000","last_undegraded":"2024-09-10T05:13:33.971128+0000","last_fullsized":"2024-09-10T05:13:33.971128+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:16.361621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.346649+0000","last_change":"2024-09-10T05:11:29.727844+0000","last_active":"2024-09-10T05:14:36.346649+0000","last_peered":"2024-09-10T05:14:36.346649+0000","last_clean":"2024-09-10T05:14:36.346649+0000","last_became_active":"2024-09-10T05:11:29.727550+0000","last_became_peered":"2024-09-10T05:11:29.727550+0000","last_unstale":"2024-09-10T05:14:36.346649+0000","last_undegraded":"2024-09-10T05:14:36.346649+0000","last_fullsized":"2024-09-10T05:14:36.346649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:05.037792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.731049+0000","last_change":"2024-09-10T05:14:51.731049+0000","last_active":"2024-09-10T05:14:51.731049+0000","last_peered":"2024-09-10T05:14:51.731049+0000","last_clean":"2024-09-10T05:14:51.731049+0000","last_became_active":"2024-09-10T05:11:27.724637+0000","last_became_peered":"2024-09-10T05:11:27.724637+0000","last_unstale":"2024-09-10T05:14:51.731049+0000","last_undegraded":"2024-09-10T05:14:51.731049+0000","last_fullsized":"2024-09-10T05:14:51.731049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:51.730965+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:51.730965+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.730965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:07.979601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956587+0000","last_change":"2024-09-10T05:11:31.737152+0000","last_active":"2024-09-10T05:12:04.956587+0000","last_peered":"2024-09-10T05:12:04.956587+0000","last_clean":"2024-09-10T05:12:04.956587+0000","last_became_active":"2024-09-10T05:11:31.736758+0000","last_became_peered":"2024-09-10T05:11:31.736758+0000","last_unstale":"2024-09-10T05:12:04.956587+0000","last_undegraded":"2024-09-10T05:12:04.956587+0000","last_fullsized":"2024-09-10T05:12:04.956587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:07.236386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'6","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.711356+0000","last_change":"2024-09-10T05:11:33.742432+0000","last_active":"2024-09-10T05:14:35.711356+0000","last_peered":"2024-09-10T05:14:35.711356+0000","last_clean":"2024-09-10T05:14:35.711356+0000","last_became_active":"2024-09-10T05:11:33.742039+0000","last_became_peered":"2024-09-10T05:11:33.742039+0000","last_unstale":"2024-09-10T05:14:35.711356+0000","last_undegraded":"2024-09-10T05:14:35.711356+0000","last_fullsized":"2024-09-10T05:14:35.711356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:31.077478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956813+0000","last_change":"2024-09-10T05:11:35.751536+0000","last_active":"2024-09-10T05:12:04.956813+0000","last_peered":"2024-09-10T05:12:04.956813+0000","last_clean":"2024-09-10T05:12:04.956813+0000","last_became_active":"2024-09-10T05:11:35.751244+0000","last_became_peered":"2024-09-10T05:11:35.751244+0000","last_unstale":"2024-09-10T05:12:04.956813+0000","last_undegraded":"2024-09-10T05:12:04.956813+0000","last_fullsized":"2024-09-10T05:12:04.956813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.673711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.676093+0000","last_change":"2024-09-10T05:11:37.755735+0000","last_active":"2024-09-10T05:13:35.676093+0000","last_peered":"2024-09-10T05:13:35.676093+0000","last_clean":"2024-09-10T05:13:35.676093+0000","last_became_active":"2024-09-10T05:11:37.755533+0000","last_became_peered":"2024-09-10T05:11:37.755533+0000","last_unstale":"2024-09-10T05:13:35.676093+0000","last_undegraded":"2024-09-10T05:13:35.676093+0000","last_fullsized":"2024-09-10T05:13:35.676093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:37.895455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604904+0000","last_change":"2024-09-10T05:11:29.727735+0000","last_active":"2024-09-10T05:13:32.604904+0000","last_peered":"2024-09-10T05:13:32.604904+0000","last_clean":"2024-09-10T05:13:32.604904+0000","last_became_active":"2024-09-10T05:11:29.727400+0000","last_became_peered":"2024-09-10T05:11:29.727400+0000","last_unstale":"2024-09-10T05:13:32.604904+0000","last_undegraded":"2024-09-10T05:13:32.604904+0000","last_fullsized":"2024-09-10T05:13:32.604904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:52.691912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.665768+0000","last_change":"2024-09-10T05:14:55.665768+0000","last_active":"2024-09-10T05:14:55.665768+0000","last_peered":"2024-09-10T05:14:55.665768+0000","last_clean":"2024-09-10T05:14:55.665768+0000","last_became_active":"2024-09-10T05:11:27.727561+0000","last_became_peered":"2024-09-10T05:11:27.727561+0000","last_unstale":"2024-09-10T05:14:55.665768+0000","last_undegraded":"2024-09-10T05:14:55.665768+0000","last_fullsized":"2024-09-10T05:14:55.665768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:55.665677+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:55.665677+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.665677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:14.595232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"28'1","reported_seq":221,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:42.978337+0000","last_change":"2024-09-10T05:11:31.734288+0000","last_active":"2024-09-10T05:14:42.978337+0000","last_peered":"2024-09-10T05:14:42.978337+0000","last_clean":"2024-09-10T05:14:42.978337+0000","last_became_active":"2024-09-10T05:11:31.733793+0000","last_became_peered":"2024-09-10T05:11:31.733793+0000","last_unstale":"2024-09-10T05:14:42.978337+0000","last_undegraded":"2024-09-10T05:14:42.978337+0000","last_fullsized":"2024-09-10T05:14:42.978337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:15.305550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'45","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.063098+0000","last_change":"2024-09-10T05:11:33.744948+0000","last_active":"2024-09-10T05:14:43.063098+0000","last_peered":"2024-09-10T05:14:43.063098+0000","last_clean":"2024-09-10T05:14:43.063098+0000","last_became_active":"2024-09-10T05:11:33.744634+0000","last_became_peered":"2024-09-10T05:11:33.744634+0000","last_unstale":"2024-09-10T05:14:43.063098+0000","last_undegraded":"2024-09-10T05:14:43.063098+0000","last_fullsized":"2024-09-10T05:14:43.063098+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:09.908383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959076+0000","last_change":"2024-09-10T05:11:35.748666+0000","last_active":"2024-09-10T05:12:04.959076+0000","last_peered":"2024-09-10T05:12:04.959076+0000","last_clean":"2024-09-10T05:12:04.959076+0000","last_became_active":"2024-09-10T05:11:35.748406+0000","last_became_peered":"2024-09-10T05:11:35.748406+0000","last_unstale":"2024-09-10T05:12:04.959076+0000","last_undegraded":"2024-09-10T05:12:04.959076+0000","last_fullsized":"2024-09-10T05:12:04.959076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:01.833099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.370496+0000","last_change":"2024-09-10T05:11:37.765627+0000","last_active":"2024-09-10T05:14:36.370496+0000","last_peered":"2024-09-10T05:14:36.370496+0000","last_clean":"2024-09-10T05:14:36.370496+0000","last_became_active":"2024-09-10T05:11:37.765188+0000","last_became_peered":"2024-09-10T05:11:37.765188+0000","last_unstale":"2024-09-10T05:14:36.370496+0000","last_undegraded":"2024-09-10T05:14:36.370496+0000","last_fullsized":"2024-09-10T05:14:36.370496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:35.729959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954466+0000","last_change":"2024-09-10T05:11:29.736060+0000","last_active":"2024-09-10T05:12:04.954466+0000","last_peered":"2024-09-10T05:12:04.954466+0000","last_clean":"2024-09-10T05:12:04.954466+0000","last_became_active":"2024-09-10T05:11:29.735101+0000","last_became_peered":"2024-09-10T05:11:29.735101+0000","last_unstale":"2024-09-10T05:12:04.954466+0000","last_undegraded":"2024-09-10T05:12:04.954466+0000","last_fullsized":"2024-09-10T05:12:04.954466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:46.282001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.411020+0000","last_change":"2024-09-10T05:14:50.411020+0000","last_active":"2024-09-10T05:14:50.411020+0000","last_peered":"2024-09-10T05:14:50.411020+0000","last_clean":"2024-09-10T05:14:50.411020+0000","last_became_active":"2024-09-10T05:11:27.715729+0000","last_became_peered":"2024-09-10T05:11:27.715729+0000","last_unstale":"2024-09-10T05:14:50.411020+0000","last_undegraded":"2024-09-10T05:14:50.411020+0000","last_fullsized":"2024-09-10T05:14:50.411020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.410933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.410933+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.410933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:35.070195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954515+0000","last_change":"2024-09-10T05:11:31.732767+0000","last_active":"2024-09-10T05:12:04.954515+0000","last_peered":"2024-09-10T05:12:04.954515+0000","last_clean":"2024-09-10T05:12:04.954515+0000","last_became_active":"2024-09-10T05:11:31.732476+0000","last_became_peered":"2024-09-10T05:11:31.732476+0000","last_unstale":"2024-09-10T05:12:04.954515+0000","last_undegraded":"2024-09-10T05:12:04.954515+0000","last_fullsized":"2024-09-10T05:12:04.954515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:22.178149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'34","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.054428+0000","last_change":"2024-09-10T05:11:33.742425+0000","last_active":"2024-09-10T05:14:43.054428+0000","last_peered":"2024-09-10T05:14:43.054428+0000","last_clean":"2024-09-10T05:14:43.054428+0000","last_became_active":"2024-09-10T05:11:33.740483+0000","last_became_peered":"2024-09-10T05:11:33.740483+0000","last_unstale":"2024-09-10T05:14:43.054428+0000","last_undegraded":"2024-09-10T05:14:43.054428+0000","last_fullsized":"2024-09-10T05:14:43.054428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:21.633618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960060+0000","last_change":"2024-09-10T05:11:35.746206+0000","last_active":"2024-09-10T05:12:04.960060+0000","last_peered":"2024-09-10T05:12:04.960060+0000","last_clean":"2024-09-10T05:12:04.960060+0000","last_became_active":"2024-09-10T05:11:35.745886+0000","last_became_peered":"2024-09-10T05:11:35.745886+0000","last_unstale":"2024-09-10T05:12:04.960060+0000","last_undegraded":"2024-09-10T05:12:04.960060+0000","last_fullsized":"2024-09-10T05:12:04.960060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:38.963303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.109858+0000","last_change":"2024-09-10T05:11:29.732079+0000","last_active":"2024-09-10T05:14:36.109858+0000","last_peered":"2024-09-10T05:14:36.109858+0000","last_clean":"2024-09-10T05:14:36.109858+0000","last_became_active":"2024-09-10T05:11:29.731824+0000","last_became_peered":"2024-09-10T05:11:29.731824+0000","last_unstale":"2024-09-10T05:14:36.109858+0000","last_undegraded":"2024-09-10T05:14:36.109858+0000","last_fullsized":"2024-09-10T05:14:36.109858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:53.060402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.955838+0000","last_change":"2024-09-10T05:15:02.955838+0000","last_active":"2024-09-10T05:15:02.955838+0000","last_peered":"2024-09-10T05:15:02.955838+0000","last_clean":"2024-09-10T05:15:02.955838+0000","last_became_active":"2024-09-10T05:11:27.734652+0000","last_became_peered":"2024-09-10T05:11:27.734652+0000","last_unstale":"2024-09-10T05:15:02.955838+0000","last_undegraded":"2024-09-10T05:15:02.955838+0000","last_fullsized":"2024-09-10T05:15:02.955838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:02.955753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:02.955753+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.955753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:03.026683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959243+0000","last_change":"2024-09-10T05:11:31.735122+0000","last_active":"2024-09-10T05:12:04.959243+0000","last_peered":"2024-09-10T05:12:04.959243+0000","last_clean":"2024-09-10T05:12:04.959243+0000","last_became_active":"2024-09-10T05:11:31.734774+0000","last_became_peered":"2024-09-10T05:11:31.734774+0000","last_unstale":"2024-09-10T05:12:04.959243+0000","last_undegraded":"2024-09-10T05:12:04.959243+0000","last_fullsized":"2024-09-10T05:12:04.959243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:38.074776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'66","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.157107+0000","last_change":"2024-09-10T05:11:33.741409+0000","last_active":"2024-09-10T05:14:43.157107+0000","last_peered":"2024-09-10T05:14:43.157107+0000","last_clean":"2024-09-10T05:14:43.157107+0000","last_became_active":"2024-09-10T05:11:33.741136+0000","last_became_peered":"2024-09-10T05:11:33.741136+0000","last_unstale":"2024-09-10T05:14:43.157107+0000","last_undegraded":"2024-09-10T05:14:43.157107+0000","last_fullsized":"2024-09-10T05:14:43.157107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:48.815209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958544+0000","last_change":"2024-09-10T05:11:35.746094+0000","last_active":"2024-09-10T05:12:04.958544+0000","last_peered":"2024-09-10T05:12:04.958544+0000","last_clean":"2024-09-10T05:12:04.958544+0000","last_became_active":"2024-09-10T05:11:35.745795+0000","last_became_peered":"2024-09-10T05:11:35.745795+0000","last_unstale":"2024-09-10T05:12:04.958544+0000","last_undegraded":"2024-09-10T05:12:04.958544+0000","last_fullsized":"2024-09-10T05:12:04.958544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:43.698313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.609239+0000","last_change":"2024-09-10T05:11:37.758689+0000","last_active":"2024-09-10T05:13:35.609239+0000","last_peered":"2024-09-10T05:13:35.609239+0000","last_clean":"2024-09-10T05:13:35.609239+0000","last_became_active":"2024-09-10T05:11:37.758360+0000","last_became_peered":"2024-09-10T05:11:37.758360+0000","last_unstale":"2024-09-10T05:13:35.609239+0000","last_undegraded":"2024-09-10T05:13:35.609239+0000","last_fullsized":"2024-09-10T05:13:35.609239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:10.895588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'9","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.423853+0000","last_change":"2024-09-10T05:11:29.725587+0000","last_active":"2024-09-10T05:14:36.423853+0000","last_peered":"2024-09-10T05:14:36.423853+0000","last_clean":"2024-09-10T05:14:36.423853+0000","last_became_active":"2024-09-10T05:11:29.723722+0000","last_became_peered":"2024-09-10T05:11:29.723722+0000","last_unstale":"2024-09-10T05:14:36.423853+0000","last_undegraded":"2024-09-10T05:14:36.423853+0000","last_fullsized":"2024-09-10T05:14:36.423853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:27.494677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.432455+0000","last_change":"2024-09-10T05:14:48.432455+0000","last_active":"2024-09-10T05:14:48.432455+0000","last_peered":"2024-09-10T05:14:48.432455+0000","last_clean":"2024-09-10T05:14:48.432455+0000","last_became_active":"2024-09-10T05:11:27.727770+0000","last_became_peered":"2024-09-10T05:11:27.727770+0000","last_unstale":"2024-09-10T05:14:48.432455+0000","last_undegraded":"2024-09-10T05:14:48.432455+0000","last_fullsized":"2024-09-10T05:14:48.432455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.432373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.432373+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.432373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:56.267844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962377+0000","last_change":"2024-09-10T05:11:31.728930+0000","last_active":"2024-09-10T05:12:04.962377+0000","last_peered":"2024-09-10T05:12:04.962377+0000","last_clean":"2024-09-10T05:12:04.962377+0000","last_became_active":"2024-09-10T05:11:31.728653+0000","last_became_peered":"2024-09-10T05:11:31.728653+0000","last_unstale":"2024-09-10T05:12:04.962377+0000","last_undegraded":"2024-09-10T05:12:04.962377+0000","last_fullsized":"2024-09-10T05:12:04.962377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:11:50.575895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.057351+0000","last_change":"2024-09-10T05:11:33.743527+0000","last_active":"2024-09-10T05:14:43.057351+0000","last_peered":"2024-09-10T05:14:43.057351+0000","last_clean":"2024-09-10T05:14:43.057351+0000","last_became_active":"2024-09-10T05:11:33.743048+0000","last_became_peered":"2024-09-10T05:11:33.743048+0000","last_unstale":"2024-09-10T05:14:43.057351+0000","last_undegraded":"2024-09-10T05:14:43.057351+0000","last_fullsized":"2024-09-10T05:14:43.057351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:52:59.505330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960230+0000","last_change":"2024-09-10T05:11:35.753237+0000","last_active":"2024-09-10T05:12:04.960230+0000","last_peered":"2024-09-10T05:12:04.960230+0000","last_clean":"2024-09-10T05:12:04.960230+0000","last_became_active":"2024-09-10T05:11:35.752971+0000","last_became_peered":"2024-09-10T05:11:35.752971+0000","last_unstale":"2024-09-10T05:12:04.960230+0000","last_undegraded":"2024-09-10T05:12:04.960230+0000","last_fullsized":"2024-09-10T05:12:04.960230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:16.416535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954464+0000","last_change":"2024-09-10T05:11:37.768354+0000","last_active":"2024-09-10T05:12:04.954464+0000","last_peered":"2024-09-10T05:12:04.954464+0000","last_clean":"2024-09-10T05:12:04.954464+0000","last_became_active":"2024-09-10T05:11:37.768036+0000","last_became_peered":"2024-09-10T05:11:37.768036+0000","last_unstale":"2024-09-10T05:12:04.954464+0000","last_undegraded":"2024-09-10T05:12:04.954464+0000","last_fullsized":"2024-09-10T05:12:04.954464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:28.716788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'3","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.210570+0000","last_change":"2024-09-10T05:11:29.735292+0000","last_active":"2024-09-10T05:14:36.210570+0000","last_peered":"2024-09-10T05:14:36.210570+0000","last_clean":"2024-09-10T05:14:36.210570+0000","last_became_active":"2024-09-10T05:11:29.734714+0000","last_became_peered":"2024-09-10T05:11:29.734714+0000","last_unstale":"2024-09-10T05:14:36.210570+0000","last_undegraded":"2024-09-10T05:14:36.210570+0000","last_fullsized":"2024-09-10T05:14:36.210570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:28.419157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.434007+0000","last_change":"2024-09-10T05:14:53.434007+0000","last_active":"2024-09-10T05:14:53.434007+0000","last_peered":"2024-09-10T05:14:53.434007+0000","last_clean":"2024-09-10T05:14:53.434007+0000","last_became_active":"2024-09-10T05:11:27.718251+0000","last_became_peered":"2024-09-10T05:11:27.718251+0000","last_unstale":"2024-09-10T05:14:53.434007+0000","last_undegraded":"2024-09-10T05:14:53.434007+0000","last_fullsized":"2024-09-10T05:14:53.434007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:53.433919+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:53.433919+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.433919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:36.001843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958875+0000","last_change":"2024-09-10T05:11:31.728291+0000","last_active":"2024-09-10T05:12:04.958875+0000","last_peered":"2024-09-10T05:12:04.958875+0000","last_clean":"2024-09-10T05:12:04.958875+0000","last_became_active":"2024-09-10T05:11:31.727998+0000","last_became_peered":"2024-09-10T05:11:31.727998+0000","last_unstale":"2024-09-10T05:12:04.958875+0000","last_undegraded":"2024-09-10T05:12:04.958875+0000","last_fullsized":"2024-09-10T05:12:04.958875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:33.243917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'41","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.107513+0000","last_change":"2024-09-10T05:11:33.742831+0000","last_active":"2024-09-10T05:14:43.107513+0000","last_peered":"2024-09-10T05:14:43.107513+0000","last_clean":"2024-09-10T05:14:43.107513+0000","last_became_active":"2024-09-10T05:11:33.742594+0000","last_became_peered":"2024-09-10T05:11:33.742594+0000","last_unstale":"2024-09-10T05:14:43.107513+0000","last_undegraded":"2024-09-10T05:14:43.107513+0000","last_fullsized":"2024-09-10T05:14:43.107513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:54.003296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957834+0000","last_change":"2024-09-10T05:11:35.748750+0000","last_active":"2024-09-10T05:12:04.957834+0000","last_peered":"2024-09-10T05:12:04.957834+0000","last_clean":"2024-09-10T05:12:04.957834+0000","last_became_active":"2024-09-10T05:11:35.748464+0000","last_became_peered":"2024-09-10T05:11:35.748464+0000","last_unstale":"2024-09-10T05:12:04.957834+0000","last_undegraded":"2024-09-10T05:12:04.957834+0000","last_fullsized":"2024-09-10T05:12:04.957834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:02:44.003459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.674549+0000","last_change":"2024-09-10T05:11:37.768552+0000","last_active":"2024-09-10T05:13:35.674549+0000","last_peered":"2024-09-10T05:13:35.674549+0000","last_clean":"2024-09-10T05:13:35.674549+0000","last_became_active":"2024-09-10T05:11:37.768248+0000","last_became_peered":"2024-09-10T05:11:37.768248+0000","last_unstale":"2024-09-10T05:13:35.674549+0000","last_undegraded":"2024-09-10T05:13:35.674549+0000","last_fullsized":"2024-09-10T05:13:35.674549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:47.039216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.466476+0000","last_change":"2024-09-10T05:15:03.466476+0000","last_active":"2024-09-10T05:15:03.466476+0000","last_peered":"2024-09-10T05:15:03.466476+0000","last_clean":"2024-09-10T05:15:03.466476+0000","last_became_active":"2024-09-10T05:11:29.727038+0000","last_became_peered":"2024-09-10T05:11:29.727038+0000","last_unstale":"2024-09-10T05:15:03.466476+0000","last_undegraded":"2024-09-10T05:15:03.466476+0000","last_fullsized":"2024-09-10T05:15:03.466476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:03.466382+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:03.466382+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.466382+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:51.671119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.996465+0000","last_change":"2024-09-10T05:15:03.996465+0000","last_active":"2024-09-10T05:15:03.996465+0000","last_peered":"2024-09-10T05:15:03.996465+0000","last_clean":"2024-09-10T05:15:03.996465+0000","last_became_active":"2024-09-10T05:11:27.733320+0000","last_became_peered":"2024-09-10T05:11:27.733320+0000","last_unstale":"2024-09-10T05:15:03.996465+0000","last_undegraded":"2024-09-10T05:15:03.996465+0000","last_fullsized":"2024-09-10T05:15:03.996465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.996375+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.996375+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.996375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:10:21.072269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961436+0000","last_change":"2024-09-10T05:11:31.734989+0000","last_active":"2024-09-10T05:12:04.961436+0000","last_peered":"2024-09-10T05:12:04.961436+0000","last_clean":"2024-09-10T05:12:04.961436+0000","last_became_active":"2024-09-10T05:11:31.734684+0000","last_became_peered":"2024-09-10T05:11:31.734684+0000","last_unstale":"2024-09-10T05:12:04.961436+0000","last_undegraded":"2024-09-10T05:12:04.961436+0000","last_fullsized":"2024-09-10T05:12:04.961436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:16.215982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962397+0000","last_change":"2024-09-10T05:11:33.748823+0000","last_active":"2024-09-10T05:12:04.962397+0000","last_peered":"2024-09-10T05:12:04.962397+0000","last_clean":"2024-09-10T05:12:04.962397+0000","last_became_active":"2024-09-10T05:11:33.748547+0000","last_became_peered":"2024-09-10T05:11:33.748547+0000","last_unstale":"2024-09-10T05:12:04.962397+0000","last_undegraded":"2024-09-10T05:12:04.962397+0000","last_fullsized":"2024-09-10T05:12:04.962397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:00.711618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'285","reported_seq":369,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.002144+0000","last_change":"2024-09-10T05:11:35.751082+0000","last_active":"2024-09-10T05:14:43.002144+0000","last_peered":"2024-09-10T05:14:43.002144+0000","last_clean":"2024-09-10T05:14:43.002144+0000","last_became_active":"2024-09-10T05:11:35.750761+0000","last_became_peered":"2024-09-10T05:11:35.750761+0000","last_unstale":"2024-09-10T05:14:43.002144+0000","last_undegraded":"2024-09-10T05:14:43.002144+0000","last_fullsized":"2024-09-10T05:14:43.002144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:35.877712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954021+0000","last_change":"2024-09-10T05:11:37.768088+0000","last_active":"2024-09-10T05:12:04.954021+0000","last_peered":"2024-09-10T05:12:04.954021+0000","last_clean":"2024-09-10T05:12:04.954021+0000","last_became_active":"2024-09-10T05:11:37.767816+0000","last_became_peered":"2024-09-10T05:11:37.767816+0000","last_unstale":"2024-09-10T05:12:04.954021+0000","last_undegraded":"2024-09-10T05:12:04.954021+0000","last_fullsized":"2024-09-10T05:12:04.954021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:32.684488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'5","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:00.917755+0000","last_change":"2024-09-10T05:11:29.720521+0000","last_active":"2024-09-10T05:14:00.917755+0000","last_peered":"2024-09-10T05:14:00.917755+0000","last_clean":"2024-09-10T05:14:00.917755+0000","last_became_active":"2024-09-10T05:11:29.720243+0000","last_became_peered":"2024-09-10T05:11:29.720243+0000","last_unstale":"2024-09-10T05:14:00.917755+0000","last_undegraded":"2024-09-10T05:14:00.917755+0000","last_fullsized":"2024-09-10T05:14:00.917755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:46.844060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.448490+0000","last_change":"2024-09-10T05:14:51.448490+0000","last_active":"2024-09-10T05:14:51.448490+0000","last_peered":"2024-09-10T05:14:51.448490+0000","last_clean":"2024-09-10T05:14:51.448490+0000","last_became_active":"2024-09-10T05:11:27.723630+0000","last_became_peered":"2024-09-10T05:11:27.723630+0000","last_unstale":"2024-09-10T05:14:51.448490+0000","last_undegraded":"2024-09-10T05:14:51.448490+0000","last_fullsized":"2024-09-10T05:14:51.448490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:51.448399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:51.448399+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.448399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:08.698148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961835+0000","last_change":"2024-09-10T05:11:31.737893+0000","last_active":"2024-09-10T05:12:04.961835+0000","last_peered":"2024-09-10T05:12:04.961835+0000","last_clean":"2024-09-10T05:12:04.961835+0000","last_became_active":"2024-09-10T05:11:31.737547+0000","last_became_peered":"2024-09-10T05:11:31.737547+0000","last_unstale":"2024-09-10T05:12:04.961835+0000","last_undegraded":"2024-09-10T05:12:04.961835+0000","last_fullsized":"2024-09-10T05:12:04.961835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:48.181735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'63","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.135798+0000","last_change":"2024-09-10T05:11:33.740808+0000","last_active":"2024-09-10T05:14:43.135798+0000","last_peered":"2024-09-10T05:14:43.135798+0000","last_clean":"2024-09-10T05:14:43.135798+0000","last_became_active":"2024-09-10T05:11:33.740489+0000","last_became_peered":"2024-09-10T05:11:33.740489+0000","last_unstale":"2024-09-10T05:14:43.135798+0000","last_undegraded":"2024-09-10T05:14:43.135798+0000","last_fullsized":"2024-09-10T05:14:43.135798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:04.031528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956220+0000","last_change":"2024-09-10T05:11:35.754168+0000","last_active":"2024-09-10T05:12:04.956220+0000","last_peered":"2024-09-10T05:12:04.956220+0000","last_clean":"2024-09-10T05:12:04.956220+0000","last_became_active":"2024-09-10T05:11:35.753856+0000","last_became_peered":"2024-09-10T05:11:35.753856+0000","last_unstale":"2024-09-10T05:12:04.956220+0000","last_undegraded":"2024-09-10T05:12:04.956220+0000","last_fullsized":"2024-09-10T05:12:04.956220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:03.169802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.439500+0000","last_change":"2024-09-10T05:11:37.758619+0000","last_active":"2024-09-10T05:12:09.439500+0000","last_peered":"2024-09-10T05:12:09.439500+0000","last_clean":"2024-09-10T05:12:09.439500+0000","last_became_active":"2024-09-10T05:11:37.758332+0000","last_became_peered":"2024-09-10T05:11:37.758332+0000","last_unstale":"2024-09-10T05:12:09.439500+0000","last_undegraded":"2024-09-10T05:12:09.439500+0000","last_fullsized":"2024-09-10T05:12:09.439500+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:34:24.838165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.678085+0000","last_change":"2024-09-10T05:11:29.722215+0000","last_active":"2024-09-10T05:13:35.678085+0000","last_peered":"2024-09-10T05:13:35.678085+0000","last_clean":"2024-09-10T05:13:35.678085+0000","last_became_active":"2024-09-10T05:11:29.721899+0000","last_became_peered":"2024-09-10T05:11:29.721899+0000","last_unstale":"2024-09-10T05:13:35.678085+0000","last_undegraded":"2024-09-10T05:13:35.678085+0000","last_fullsized":"2024-09-10T05:13:35.678085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:49.705056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.992028+0000","last_change":"2024-09-10T05:15:04.992028+0000","last_active":"2024-09-10T05:15:04.992028+0000","last_peered":"2024-09-10T05:15:04.992028+0000","last_clean":"2024-09-10T05:15:04.992028+0000","last_became_active":"2024-09-10T05:11:27.733451+0000","last_became_peered":"2024-09-10T05:11:27.733451+0000","last_unstale":"2024-09-10T05:15:04.992028+0000","last_undegraded":"2024-09-10T05:15:04.992028+0000","last_fullsized":"2024-09-10T05:15:04.992028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:04.991935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:04.991935+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.991935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:35.404102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961145+0000","last_change":"2024-09-10T05:11:31.736009+0000","last_active":"2024-09-10T05:12:04.961145+0000","last_peered":"2024-09-10T05:12:04.961145+0000","last_clean":"2024-09-10T05:12:04.961145+0000","last_became_active":"2024-09-10T05:11:31.735565+0000","last_became_peered":"2024-09-10T05:11:31.735565+0000","last_unstale":"2024-09-10T05:12:04.961145+0000","last_undegraded":"2024-09-10T05:12:04.961145+0000","last_fullsized":"2024-09-10T05:12:04.961145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:10.523091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'39","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.138877+0000","last_change":"2024-09-10T05:11:33.742997+0000","last_active":"2024-09-10T05:14:43.138877+0000","last_peered":"2024-09-10T05:14:43.138877+0000","last_clean":"2024-09-10T05:14:43.138877+0000","last_became_active":"2024-09-10T05:11:33.742656+0000","last_became_peered":"2024-09-10T05:11:33.742656+0000","last_unstale":"2024-09-10T05:14:43.138877+0000","last_undegraded":"2024-09-10T05:14:43.138877+0000","last_fullsized":"2024-09-10T05:14:43.138877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:28.611407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954236+0000","last_change":"2024-09-10T05:11:35.751391+0000","last_active":"2024-09-10T05:12:04.954236+0000","last_peered":"2024-09-10T05:12:04.954236+0000","last_clean":"2024-09-10T05:12:04.954236+0000","last_became_active":"2024-09-10T05:11:35.750960+0000","last_became_peered":"2024-09-10T05:11:35.750960+0000","last_unstale":"2024-09-10T05:12:04.954236+0000","last_undegraded":"2024-09-10T05:12:04.954236+0000","last_fullsized":"2024-09-10T05:12:04.954236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:07.690221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.959775+0000","last_change":"2024-09-10T05:11:37.768897+0000","last_active":"2024-09-10T05:12:51.959775+0000","last_peered":"2024-09-10T05:12:51.959775+0000","last_clean":"2024-09-10T05:12:51.959775+0000","last_became_active":"2024-09-10T05:11:37.768559+0000","last_became_peered":"2024-09-10T05:11:37.768559+0000","last_unstale":"2024-09-10T05:12:51.959775+0000","last_undegraded":"2024-09-10T05:12:51.959775+0000","last_fullsized":"2024-09-10T05:12:51.959775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:41.676922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'5","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.207817+0000","last_change":"2024-09-10T05:11:29.735124+0000","last_active":"2024-09-10T05:14:36.207817+0000","last_peered":"2024-09-10T05:14:36.207817+0000","last_clean":"2024-09-10T05:14:36.207817+0000","last_became_active":"2024-09-10T05:11:29.732703+0000","last_became_peered":"2024-09-10T05:11:29.732703+0000","last_unstale":"2024-09-10T05:14:36.207817+0000","last_undegraded":"2024-09-10T05:14:36.207817+0000","last_fullsized":"2024-09-10T05:14:36.207817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:46.587126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.494569+0000","last_change":"2024-09-10T05:14:56.494569+0000","last_active":"2024-09-10T05:14:56.494569+0000","last_peered":"2024-09-10T05:14:56.494569+0000","last_clean":"2024-09-10T05:14:56.494569+0000","last_became_active":"2024-09-10T05:11:27.713416+0000","last_became_peered":"2024-09-10T05:11:27.713416+0000","last_unstale":"2024-09-10T05:14:56.494569+0000","last_undegraded":"2024-09-10T05:14:56.494569+0000","last_fullsized":"2024-09-10T05:14:56.494569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:56.494480+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.494480+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.494480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:49.778320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958275+0000","last_change":"2024-09-10T05:11:31.736882+0000","last_active":"2024-09-10T05:12:04.958275+0000","last_peered":"2024-09-10T05:12:04.958275+0000","last_clean":"2024-09-10T05:12:04.958275+0000","last_became_active":"2024-09-10T05:11:31.736540+0000","last_became_peered":"2024-09-10T05:11:31.736540+0000","last_unstale":"2024-09-10T05:12:04.958275+0000","last_undegraded":"2024-09-10T05:12:04.958275+0000","last_fullsized":"2024-09-10T05:12:04.958275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:34.452648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'36","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.101381+0000","last_change":"2024-09-10T05:11:33.743575+0000","last_active":"2024-09-10T05:14:43.101381+0000","last_peered":"2024-09-10T05:14:43.101381+0000","last_clean":"2024-09-10T05:14:43.101381+0000","last_became_active":"2024-09-10T05:11:33.743207+0000","last_became_peered":"2024-09-10T05:11:33.743207+0000","last_unstale":"2024-09-10T05:14:43.101381+0000","last_undegraded":"2024-09-10T05:14:43.101381+0000","last_fullsized":"2024-09-10T05:14:43.101381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:19.732970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:35.753328+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:35.753001+0000","last_became_peered":"2024-09-10T05:11:35.753001+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:19.217985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.480743+0000","last_change":"2024-09-10T05:11:37.767945+0000","last_active":"2024-09-10T05:14:36.480743+0000","last_peered":"2024-09-10T05:14:36.480743+0000","last_clean":"2024-09-10T05:14:36.480743+0000","last_became_active":"2024-09-10T05:11:37.767649+0000","last_became_peered":"2024-09-10T05:11:37.767649+0000","last_unstale":"2024-09-10T05:14:36.480743+0000","last_undegraded":"2024-09-10T05:14:36.480743+0000","last_fullsized":"2024-09-10T05:14:36.480743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:47.436935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'4","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.382235+0000","last_change":"2024-09-10T05:11:29.718957+0000","last_active":"2024-09-10T05:14:36.382235+0000","last_peered":"2024-09-10T05:14:36.382235+0000","last_clean":"2024-09-10T05:14:36.382235+0000","last_became_active":"2024-09-10T05:11:29.718689+0000","last_became_peered":"2024-09-10T05:11:29.718689+0000","last_unstale":"2024-09-10T05:14:36.382235+0000","last_undegraded":"2024-09-10T05:14:36.382235+0000","last_fullsized":"2024-09-10T05:14:36.382235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.549609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.493473+0000","last_change":"2024-09-10T05:14:57.493473+0000","last_active":"2024-09-10T05:14:57.493473+0000","last_peered":"2024-09-10T05:14:57.493473+0000","last_clean":"2024-09-10T05:14:57.493473+0000","last_became_active":"2024-09-10T05:11:27.716073+0000","last_became_peered":"2024-09-10T05:11:27.716073+0000","last_unstale":"2024-09-10T05:14:57.493473+0000","last_undegraded":"2024-09-10T05:14:57.493473+0000","last_fullsized":"2024-09-10T05:14:57.493473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:57.493360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:57.493360+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.493360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:16.549263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'2","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.968798+0000","last_change":"2024-09-10T05:11:31.736020+0000","last_active":"2024-09-10T05:13:32.968798+0000","last_peered":"2024-09-10T05:13:32.968798+0000","last_clean":"2024-09-10T05:13:32.968798+0000","last_became_active":"2024-09-10T05:11:31.735726+0000","last_became_peered":"2024-09-10T05:11:31.735726+0000","last_unstale":"2024-09-10T05:13:32.968798+0000","last_undegraded":"2024-09-10T05:13:32.968798+0000","last_fullsized":"2024-09-10T05:13:32.968798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:49.251341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'47","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.110530+0000","last_change":"2024-09-10T05:11:33.748407+0000","last_active":"2024-09-10T05:14:43.110530+0000","last_peered":"2024-09-10T05:14:43.110530+0000","last_clean":"2024-09-10T05:14:43.110530+0000","last_became_active":"2024-09-10T05:11:33.748120+0000","last_became_peered":"2024-09-10T05:11:33.748120+0000","last_unstale":"2024-09-10T05:14:43.110530+0000","last_undegraded":"2024-09-10T05:14:43.110530+0000","last_fullsized":"2024-09-10T05:14:43.110530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:46:20.643301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956794+0000","last_change":"2024-09-10T05:11:35.753972+0000","last_active":"2024-09-10T05:12:04.956794+0000","last_peered":"2024-09-10T05:12:04.956794+0000","last_clean":"2024-09-10T05:12:04.956794+0000","last_became_active":"2024-09-10T05:11:35.753437+0000","last_became_peered":"2024-09-10T05:11:35.753437+0000","last_unstale":"2024-09-10T05:12:04.956794+0000","last_undegraded":"2024-09-10T05:12:04.956794+0000","last_fullsized":"2024-09-10T05:12:04.956794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:06.887746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'10","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.285208+0000","last_change":"2024-09-10T05:11:37.765397+0000","last_active":"2024-09-10T05:13:34.285208+0000","last_peered":"2024-09-10T05:13:34.285208+0000","last_clean":"2024-09-10T05:13:34.285208+0000","last_became_active":"2024-09-10T05:11:37.765102+0000","last_became_peered":"2024-09-10T05:11:37.765102+0000","last_unstale":"2024-09-10T05:13:34.285208+0000","last_undegraded":"2024-09-10T05:13:34.285208+0000","last_fullsized":"2024-09-10T05:13:34.285208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:41.297084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":67,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'7","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914653+0000","last_change":"2024-09-10T05:11:29.729956+0000","last_active":"2024-09-10T05:13:40.914653+0000","last_peered":"2024-09-10T05:13:40.914653+0000","last_clean":"2024-09-10T05:13:40.914653+0000","last_became_active":"2024-09-10T05:11:29.729468+0000","last_became_peered":"2024-09-10T05:11:29.729468+0000","last_unstale":"2024-09-10T05:13:40.914653+0000","last_undegraded":"2024-09-10T05:13:40.914653+0000","last_fullsized":"2024-09-10T05:13:40.914653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:28.277156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.709815+0000","last_change":"2024-09-10T05:14:54.709815+0000","last_active":"2024-09-10T05:14:54.709815+0000","last_peered":"2024-09-10T05:14:54.709815+0000","last_clean":"2024-09-10T05:14:54.709815+0000","last_became_active":"2024-09-10T05:11:27.706484+0000","last_became_peered":"2024-09-10T05:11:27.706484+0000","last_unstale":"2024-09-10T05:14:54.709815+0000","last_undegraded":"2024-09-10T05:14:54.709815+0000","last_fullsized":"2024-09-10T05:14:54.709815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:54.709723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:54.709723+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.709723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:58.926828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'11","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:38.908717+0000","last_change":"2024-09-10T05:11:29.729314+0000","last_active":"2024-09-10T05:13:38.908717+0000","last_peered":"2024-09-10T05:13:38.908717+0000","last_clean":"2024-09-10T05:13:38.908717+0000","last_became_active":"2024-09-10T05:11:29.729019+0000","last_became_peered":"2024-09-10T05:11:29.729019+0000","last_unstale":"2024-09-10T05:13:38.908717+0000","last_undegraded":"2024-09-10T05:13:38.908717+0000","last_fullsized":"2024-09-10T05:13:38.908717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:42.589634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.491464+0000","last_change":"2024-09-10T05:14:52.491464+0000","last_active":"2024-09-10T05:14:52.491464+0000","last_peered":"2024-09-10T05:14:52.491464+0000","last_clean":"2024-09-10T05:14:52.491464+0000","last_became_active":"2024-09-10T05:11:27.714487+0000","last_became_peered":"2024-09-10T05:11:27.714487+0000","last_unstale":"2024-09-10T05:14:52.491464+0000","last_undegraded":"2024-09-10T05:14:52.491464+0000","last_fullsized":"2024-09-10T05:14:52.491464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:52.491377+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:52.491377+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.491377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:49.460874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'2","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.666946+0000","last_change":"2024-09-10T05:11:29.729634+0000","last_active":"2024-09-10T05:12:09.666946+0000","last_peered":"2024-09-10T05:12:09.666946+0000","last_clean":"2024-09-10T05:12:09.666946+0000","last_became_active":"2024-09-10T05:11:29.729359+0000","last_became_peered":"2024-09-10T05:11:29.729359+0000","last_unstale":"2024-09-10T05:12:09.666946+0000","last_undegraded":"2024-09-10T05:12:09.666946+0000","last_fullsized":"2024-09-10T05:12:09.666946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:52.814750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955280+0000","last_change":"2024-09-10T05:11:27.731218+0000","last_active":"2024-09-10T05:12:04.955280+0000","last_peered":"2024-09-10T05:12:04.955280+0000","last_clean":"2024-09-10T05:12:04.955280+0000","last_became_active":"2024-09-10T05:11:27.730905+0000","last_became_peered":"2024-09-10T05:11:27.730905+0000","last_unstale":"2024-09-10T05:12:04.955280+0000","last_undegraded":"2024-09-10T05:12:04.955280+0000","last_fullsized":"2024-09-10T05:12:04.955280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:16.699974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.604649+0000","last_change":"2024-09-10T05:11:29.727742+0000","last_active":"2024-09-10T05:13:32.604649+0000","last_peered":"2024-09-10T05:13:32.604649+0000","last_clean":"2024-09-10T05:13:32.604649+0000","last_became_active":"2024-09-10T05:11:29.727454+0000","last_became_peered":"2024-09-10T05:11:29.727454+0000","last_unstale":"2024-09-10T05:13:32.604649+0000","last_undegraded":"2024-09-10T05:13:32.604649+0000","last_fullsized":"2024-09-10T05:13:32.604649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:22.898915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.503637+0000","last_change":"2024-09-10T05:14:54.503637+0000","last_active":"2024-09-10T05:14:54.503637+0000","last_peered":"2024-09-10T05:14:54.503637+0000","last_clean":"2024-09-10T05:14:54.503637+0000","last_became_active":"2024-09-10T05:11:27.713962+0000","last_became_peered":"2024-09-10T05:11:27.713962+0000","last_unstale":"2024-09-10T05:14:54.503637+0000","last_undegraded":"2024-09-10T05:14:54.503637+0000","last_fullsized":"2024-09-10T05:14:54.503637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:54.503543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:54.503543+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.503543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:36.529415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'8","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.093386+0000","last_change":"2024-09-10T05:11:29.725511+0000","last_active":"2024-09-10T05:12:09.093386+0000","last_peered":"2024-09-10T05:12:09.093386+0000","last_clean":"2024-09-10T05:12:09.093386+0000","last_became_active":"2024-09-10T05:11:29.725099+0000","last_became_peered":"2024-09-10T05:11:29.725099+0000","last_unstale":"2024-09-10T05:12:09.093386+0000","last_undegraded":"2024-09-10T05:12:09.093386+0000","last_fullsized":"2024-09-10T05:12:09.093386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:14.626560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.545597+0000","last_change":"2024-09-10T05:14:49.545597+0000","last_active":"2024-09-10T05:14:49.545597+0000","last_peered":"2024-09-10T05:14:49.545597+0000","last_clean":"2024-09-10T05:14:49.545597+0000","last_became_active":"2024-09-10T05:11:27.718926+0000","last_became_peered":"2024-09-10T05:11:27.718926+0000","last_unstale":"2024-09-10T05:14:49.545597+0000","last_undegraded":"2024-09-10T05:14:49.545597+0000","last_fullsized":"2024-09-10T05:14:49.545597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:49.545500+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:49.545500+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.545500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:57.641677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'8","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107871+0000","last_change":"2024-09-10T05:12:04.978547+0000","last_active":"2024-09-10T05:14:36.107871+0000","last_peered":"2024-09-10T05:14:36.107871+0000","last_clean":"2024-09-10T05:14:36.107871+0000","last_became_active":"2024-09-10T05:12:04.964750+0000","last_became_peered":"2024-09-10T05:12:04.964750+0000","last_unstale":"2024-09-10T05:14:36.107871+0000","last_undegraded":"2024-09-10T05:14:36.107871+0000","last_fullsized":"2024-09-10T05:14:36.107871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:49.286618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.416193+0000","last_change":"2024-09-10T05:14:52.416193+0000","last_active":"2024-09-10T05:14:52.416193+0000","last_peered":"2024-09-10T05:14:52.416193+0000","last_clean":"2024-09-10T05:14:52.416193+0000","last_became_active":"2024-09-10T05:11:27.718282+0000","last_became_peered":"2024-09-10T05:11:27.718282+0000","last_unstale":"2024-09-10T05:14:52.416193+0000","last_undegraded":"2024-09-10T05:14:52.416193+0000","last_fullsized":"2024-09-10T05:14:52.416193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.416097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.416097+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.416097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:11.180415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.672364+0000","last_change":"2024-09-10T05:11:29.723846+0000","last_active":"2024-09-10T05:13:35.672364+0000","last_peered":"2024-09-10T05:13:35.672364+0000","last_clean":"2024-09-10T05:13:35.672364+0000","last_became_active":"2024-09-10T05:11:29.723387+0000","last_became_peered":"2024-09-10T05:11:29.723387+0000","last_unstale":"2024-09-10T05:13:35.672364+0000","last_undegraded":"2024-09-10T05:13:35.672364+0000","last_fullsized":"2024-09-10T05:13:35.672364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:05.820538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.663822+0000","last_change":"2024-09-10T05:14:56.663822+0000","last_active":"2024-09-10T05:14:56.663822+0000","last_peered":"2024-09-10T05:14:56.663822+0000","last_clean":"2024-09-10T05:14:56.663822+0000","last_became_active":"2024-09-10T05:11:27.724815+0000","last_became_peered":"2024-09-10T05:11:27.724815+0000","last_unstale":"2024-09-10T05:14:56.663822+0000","last_undegraded":"2024-09-10T05:14:56.663822+0000","last_fullsized":"2024-09-10T05:14:56.663822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:14:56.663737+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.663737+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.663737+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:18.281662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'4","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.394073+0000","last_change":"2024-09-10T05:15:05.394073+0000","last_active":"2024-09-10T05:15:05.394073+0000","last_peered":"2024-09-10T05:15:05.394073+0000","last_clean":"2024-09-10T05:15:05.394073+0000","last_became_active":"2024-09-10T05:11:29.723469+0000","last_became_peered":"2024-09-10T05:11:29.723469+0000","last_unstale":"2024-09-10T05:15:05.394073+0000","last_undegraded":"2024-09-10T05:15:05.394073+0000","last_fullsized":"2024-09-10T05:15:05.394073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-10T05:15:05.393954+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-10T05:15:05.393954+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.393954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:38:36.032466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.489090+0000","last_change":"2024-09-10T05:14:55.489090+0000","last_active":"2024-09-10T05:14:55.489090+0000","last_peered":"2024-09-10T05:14:55.489090+0000","last_clean":"2024-09-10T05:14:55.489090+0000","last_became_active":"2024-09-10T05:11:27.714348+0000","last_became_peered":"2024-09-10T05:11:27.714348+0000","last_unstale":"2024-09-10T05:14:55.489090+0000","last_undegraded":"2024-09-10T05:14:55.489090+0000","last_fullsized":"2024-09-10T05:14:55.489090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:55.488990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:55.488990+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.488990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:10.435358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'8","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417269+0000","last_change":"2024-09-10T05:11:29.730574+0000","last_active":"2024-09-10T05:14:36.417269+0000","last_peered":"2024-09-10T05:14:36.417269+0000","last_clean":"2024-09-10T05:14:36.417269+0000","last_became_active":"2024-09-10T05:11:29.729148+0000","last_became_peered":"2024-09-10T05:11:29.729148+0000","last_unstale":"2024-09-10T05:14:36.417269+0000","last_undegraded":"2024-09-10T05:14:36.417269+0000","last_fullsized":"2024-09-10T05:14:36.417269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:31.976539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.968420+0000","last_change":"2024-09-10T05:11:27.735462+0000","last_active":"2024-09-10T05:14:35.968420+0000","last_peered":"2024-09-10T05:14:35.968420+0000","last_clean":"2024-09-10T05:14:35.968420+0000","last_became_active":"2024-09-10T05:11:27.735159+0000","last_became_peered":"2024-09-10T05:11:27.735159+0000","last_unstale":"2024-09-10T05:14:35.968420+0000","last_undegraded":"2024-09-10T05:14:35.968420+0000","last_fullsized":"2024-09-10T05:14:35.968420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:01:53.516341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'12","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339364+0000","last_change":"2024-09-10T05:11:29.729754+0000","last_active":"2024-09-10T05:14:36.339364+0000","last_peered":"2024-09-10T05:14:36.339364+0000","last_clean":"2024-09-10T05:14:36.339364+0000","last_became_active":"2024-09-10T05:11:29.729476+0000","last_became_peered":"2024-09-10T05:11:29.729476+0000","last_unstale":"2024-09-10T05:14:36.339364+0000","last_undegraded":"2024-09-10T05:14:36.339364+0000","last_fullsized":"2024-09-10T05:14:36.339364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:48.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.511867+0000","last_change":"2024-09-10T05:14:57.511867+0000","last_active":"2024-09-10T05:14:57.511867+0000","last_peered":"2024-09-10T05:14:57.511867+0000","last_clean":"2024-09-10T05:14:57.511867+0000","last_became_active":"2024-09-10T05:11:27.715014+0000","last_became_peered":"2024-09-10T05:11:27.715014+0000","last_unstale":"2024-09-10T05:14:57.511867+0000","last_undegraded":"2024-09-10T05:14:57.511867+0000","last_fullsized":"2024-09-10T05:14:57.511867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:57.511763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:57.511763+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.511763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:55.932537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'1","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:43.909553+0000","last_change":"2024-09-10T05:11:29.725420+0000","last_active":"2024-09-10T05:13:43.909553+0000","last_peered":"2024-09-10T05:13:43.909553+0000","last_clean":"2024-09-10T05:13:43.909553+0000","last_became_active":"2024-09-10T05:11:29.725047+0000","last_became_peered":"2024-09-10T05:11:29.725047+0000","last_unstale":"2024-09-10T05:13:43.909553+0000","last_undegraded":"2024-09-10T05:13:43.909553+0000","last_fullsized":"2024-09-10T05:13:43.909553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:53.902350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.482237+0000","last_change":"2024-09-10T05:14:54.482237+0000","last_active":"2024-09-10T05:14:54.482237+0000","last_peered":"2024-09-10T05:14:54.482237+0000","last_clean":"2024-09-10T05:14:54.482237+0000","last_became_active":"2024-09-10T05:11:27.728257+0000","last_became_peered":"2024-09-10T05:11:27.728257+0000","last_unstale":"2024-09-10T05:14:54.482237+0000","last_undegraded":"2024-09-10T05:14:54.482237+0000","last_fullsized":"2024-09-10T05:14:54.482237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:54.482153+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:54.482153+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.482153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:10.009942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960390+0000","last_change":"2024-09-10T05:11:29.722459+0000","last_active":"2024-09-10T05:12:04.960390+0000","last_peered":"2024-09-10T05:12:04.960390+0000","last_clean":"2024-09-10T05:12:04.960390+0000","last_became_active":"2024-09-10T05:11:29.721826+0000","last_became_peered":"2024-09-10T05:11:29.721826+0000","last_unstale":"2024-09-10T05:12:04.960390+0000","last_undegraded":"2024-09-10T05:12:04.960390+0000","last_fullsized":"2024-09-10T05:12:04.960390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:28.260482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.515429+0000","last_change":"2024-09-10T05:14:56.515429+0000","last_active":"2024-09-10T05:14:56.515429+0000","last_peered":"2024-09-10T05:14:56.515429+0000","last_clean":"2024-09-10T05:14:56.515429+0000","last_became_active":"2024-09-10T05:11:27.730469+0000","last_became_peered":"2024-09-10T05:11:27.730469+0000","last_unstale":"2024-09-10T05:14:56.515429+0000","last_undegraded":"2024-09-10T05:14:56.515429+0000","last_fullsized":"2024-09-10T05:14:56.515429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:14:56.515326+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.515326+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.515326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:20.046107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'18","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339133+0000","last_change":"2024-09-10T05:12:04.973395+0000","last_active":"2024-09-10T05:14:36.339133+0000","last_peered":"2024-09-10T05:14:36.339133+0000","last_clean":"2024-09-10T05:14:36.339133+0000","last_became_active":"2024-09-10T05:12:04.965056+0000","last_became_peered":"2024-09-10T05:12:04.965056+0000","last_unstale":"2024-09-10T05:14:36.339133+0000","last_undegraded":"2024-09-10T05:14:36.339133+0000","last_fullsized":"2024-09-10T05:14:36.339133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:32.513703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:08.563177+0000","last_change":"2024-09-10T05:11:27.722461+0000","last_active":"2024-09-10T05:12:08.563177+0000","last_peered":"2024-09-10T05:12:08.563177+0000","last_clean":"2024-09-10T05:12:08.563177+0000","last_became_active":"2024-09-10T05:11:27.722079+0000","last_became_peered":"2024-09-10T05:11:27.722079+0000","last_unstale":"2024-09-10T05:12:08.563177+0000","last_undegraded":"2024-09-10T05:12:08.563177+0000","last_fullsized":"2024-09-10T05:12:08.563177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:24.585536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'16","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.107152+0000","last_change":"2024-09-10T05:11:29.734175+0000","last_active":"2024-09-10T05:14:36.107152+0000","last_peered":"2024-09-10T05:14:36.107152+0000","last_clean":"2024-09-10T05:14:36.107152+0000","last_became_active":"2024-09-10T05:11:29.733895+0000","last_became_peered":"2024-09-10T05:11:29.733895+0000","last_unstale":"2024-09-10T05:14:36.107152+0000","last_undegraded":"2024-09-10T05:14:36.107152+0000","last_fullsized":"2024-09-10T05:14:36.107152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:03.526086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961663+0000","last_change":"2024-09-10T05:11:27.736117+0000","last_active":"2024-09-10T05:12:04.961663+0000","last_peered":"2024-09-10T05:12:04.961663+0000","last_clean":"2024-09-10T05:12:04.961663+0000","last_became_active":"2024-09-10T05:11:27.735801+0000","last_became_peered":"2024-09-10T05:11:27.735801+0000","last_unstale":"2024-09-10T05:12:04.961663+0000","last_undegraded":"2024-09-10T05:12:04.961663+0000","last_fullsized":"2024-09-10T05:12:04.961663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:23.542052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.202329+0000","last_change":"2024-09-10T05:11:29.735884+0000","last_active":"2024-09-10T05:14:36.202329+0000","last_peered":"2024-09-10T05:14:36.202329+0000","last_clean":"2024-09-10T05:14:36.202329+0000","last_became_active":"2024-09-10T05:11:29.735555+0000","last_became_peered":"2024-09-10T05:11:29.735555+0000","last_unstale":"2024-09-10T05:14:36.202329+0000","last_undegraded":"2024-09-10T05:14:36.202329+0000","last_fullsized":"2024-09-10T05:14:36.202329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:40:54.995716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.675684+0000","last_change":"2024-09-10T05:14:59.675684+0000","last_active":"2024-09-10T05:14:59.675684+0000","last_peered":"2024-09-10T05:14:59.675684+0000","last_clean":"2024-09-10T05:14:59.675684+0000","last_became_active":"2024-09-10T05:11:27.723820+0000","last_became_peered":"2024-09-10T05:11:27.723820+0000","last_unstale":"2024-09-10T05:14:59.675684+0000","last_undegraded":"2024-09-10T05:14:59.675684+0000","last_fullsized":"2024-09-10T05:14:59.675684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:59.675555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:59.675555+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.675555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:06.058468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.394391+0000","last_change":"2024-09-10T05:11:29.724350+0000","last_active":"2024-09-10T05:14:36.394391+0000","last_peered":"2024-09-10T05:14:36.394391+0000","last_clean":"2024-09-10T05:14:36.394391+0000","last_became_active":"2024-09-10T05:11:29.723816+0000","last_became_peered":"2024-09-10T05:11:29.723816+0000","last_unstale":"2024-09-10T05:14:36.394391+0000","last_undegraded":"2024-09-10T05:14:36.394391+0000","last_fullsized":"2024-09-10T05:14:36.394391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:33.014166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960833+0000","last_change":"2024-09-10T05:11:27.736745+0000","last_active":"2024-09-10T05:12:04.960833+0000","last_peered":"2024-09-10T05:12:04.960833+0000","last_clean":"2024-09-10T05:12:04.960833+0000","last_became_active":"2024-09-10T05:11:27.736370+0000","last_became_peered":"2024-09-10T05:11:27.736370+0000","last_unstale":"2024-09-10T05:12:04.960833+0000","last_undegraded":"2024-09-10T05:12:04.960833+0000","last_fullsized":"2024-09-10T05:12:04.960833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:18.893074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.411415+0000","last_change":"2024-09-10T05:11:27.731505+0000","last_active":"2024-09-10T05:14:36.411415+0000","last_peered":"2024-09-10T05:14:36.411415+0000","last_clean":"2024-09-10T05:14:36.411415+0000","last_became_active":"2024-09-10T05:11:27.731202+0000","last_became_peered":"2024-09-10T05:11:27.731202+0000","last_unstale":"2024-09-10T05:14:36.411415+0000","last_undegraded":"2024-09-10T05:14:36.411415+0000","last_fullsized":"2024-09-10T05:14:36.411415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:26.689598+0000","last_clean_scrub_stamp":"2024-09-10T05:11:26.689598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:19.541656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.383073+0000","last_change":"2024-09-10T05:11:29.723977+0000","last_active":"2024-09-10T05:14:36.383073+0000","last_peered":"2024-09-10T05:14:36.383073+0000","last_clean":"2024-09-10T05:14:36.383073+0000","last_became_active":"2024-09-10T05:11:29.723467+0000","last_became_peered":"2024-09-10T05:11:29.723467+0000","last_unstale":"2024-09-10T05:14:36.383073+0000","last_undegraded":"2024-09-10T05:14:36.383073+0000","last_fullsized":"2024-09-10T05:14:36.383073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:38:33.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.480235+0000","last_change":"2024-09-10T05:14:58.480235+0000","last_active":"2024-09-10T05:14:58.480235+0000","last_peered":"2024-09-10T05:14:58.480235+0000","last_clean":"2024-09-10T05:14:58.480235+0000","last_became_active":"2024-09-10T05:11:27.713659+0000","last_became_peered":"2024-09-10T05:11:27.713659+0000","last_unstale":"2024-09-10T05:14:58.480235+0000","last_undegraded":"2024-09-10T05:14:58.480235+0000","last_fullsized":"2024-09-10T05:14:58.480235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.480141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.480141+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.480141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:58.809531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'10","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417292+0000","last_change":"2024-09-10T05:12:04.964980+0000","last_active":"2024-09-10T05:14:36.417292+0000","last_peered":"2024-09-10T05:14:36.417292+0000","last_clean":"2024-09-10T05:14:36.417292+0000","last_became_active":"2024-09-10T05:12:04.964552+0000","last_became_peered":"2024-09-10T05:12:04.964552+0000","last_unstale":"2024-09-10T05:14:36.417292+0000","last_undegraded":"2024-09-10T05:14:36.417292+0000","last_fullsized":"2024-09-10T05:14:36.417292+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:49.445729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1572,"ondisk_log_size":1572,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640306,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":160879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640307,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335484,"statfs":{"total":96636764160,"available":96599535616,"internally_reserved":0,"allocated":1036288,"data_stored":749393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640307,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335460,"statfs":{"total":96636764160,"available":96599511040,"internally_reserved":0,"allocated":1060864,"data_stored":750309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39968,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331872,"statfs":{"total":96636764160,"available":96595836928,"internally_reserved":0,"allocated":475136,"data_stored":160447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:15:07.960 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.960 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.960 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.960 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.960 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.961 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.961 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.961 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.961 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.961 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.961 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.961 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.961 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.961 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.962 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.962 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.962 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.962 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.962 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.962 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.962 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.962 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.963 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.963 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.963 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.963 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.963 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.963 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.963 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.963 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.963 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.964 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.964 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.964 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.964 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.964 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.964 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.964 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.964 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.964 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.965 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.965 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.965 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.965 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.965 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.965 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.965 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.965 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.966 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.966 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.966 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.966 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.966 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.966 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.966 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.966 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.967 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.967 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.967 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.967 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.967 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.967 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.967 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.967 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.967 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.968 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.968 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.968 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.968 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.968 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.968 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.968 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.968 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.968 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.969 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.969 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.969 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.969 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.969 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.969 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.969 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.969 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.970 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.970 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.970 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.970 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.970 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.970 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.970 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.970 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.971 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.971 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.971 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.971 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.971 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.971 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.971 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.971 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.971 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.972 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.972 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.972 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.972 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.972 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.972 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.972 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.972 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.973 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.973 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.973 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.973 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.973 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.973 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.973 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.973 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.973 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.974 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.974 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.974 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.974 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.974 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.974 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.974 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.974 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.974 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.975 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.975 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.975 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.975 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.975 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.975 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.975 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.975 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.975 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.976 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.976 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.976 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.976 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.976 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.976 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.976 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.976 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.977 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.977 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.977 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.977 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.977 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.977 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.977 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.977 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.977 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.977 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.978 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.978 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.978 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.978 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.978 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.978 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.978 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.978 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.979 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.979 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.979 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.979 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.979 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.979 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.979 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.979 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.979 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.980 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.980 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.980 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.980 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.980 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.980 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.980 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.980 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.981 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.981 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.981 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.981 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.981 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.981 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.981 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.981 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.981 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.982 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.982 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T05:11:26.689598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.982 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.982 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:07.982 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T05:15:27.984 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:15:28.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.093+0000 7fb6d475d640 1 Processor -- start 2024-09-10T05:15:28.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.093+0000 7fb6d475d640 1 -- start start 2024-09-10T05:15:28.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.093+0000 7fb6d475d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb6cc130270 0x7fb6cc132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:15:28.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.093+0000 7fb6d475d640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6cc06dc00 con 0x7fb6cc129d80 2024-09-10T05:15:28.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.093+0000 7fb6d475d640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fb6cc1299c0 con 0x7fb6cc130270 2024-09-10T05:15:28.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.094+0000 7fb6d1cf8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb6cc130270 0x7fb6cc132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:15:28.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.094+0000 7fb6d24f9640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb6cc129d80 0x7fb6cc12a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:39304/0 (socket says 172.21.15.139:39304) 2024-09-10T05:15:28.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.094+0000 7fb6d1cf8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb6cc130270 0x7fb6cc132660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52752/0 (socket says 172.21.15.139:52752) 2024-09-10T05:15:28.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.094+0000 7fb6d24f9640 1 -- 172.21.15.139:0/3815187980 learned_addr learned my addr 172.21.15.139:0/3815187980 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:15:28.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.094+0000 7fb6d1cf8640 1 -- 172.21.15.139:0/3815187980 >> v1:172.21.15.139:6789/0 conn(0x7fb6cc129d80 legacy=0x7fb6cc12a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:15:28.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.094+0000 7fb6d1cf8640 1 -- 172.21.15.139:0/3815187980 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc12a870 con 0x7fb6cc130270 2024-09-10T05:15:28.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.094+0000 7fb6d14f7640 1 -- 172.21.15.139:0/3815187980 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1224872338 0 0) 0x7fb6cc06dc00 con 0x7fb6cc129d80 2024-09-10T05:15:28.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.095+0000 7fb6d1cf8640 1 --2- 172.21.15.139:0/3815187980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6cc130270 0x7fb6cc132660 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009720 tx=0x7fb6bc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e01a6020497716 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:15:28.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.095+0000 7fb6d14f7640 1 -- 172.21.15.139:0/3815187980 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6bc037070 con 0x7fb6cc130270 2024-09-10T05:15:28.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.095+0000 7fb6d14f7640 1 -- 172.21.15.139:0/3815187980 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6bc02ad90 con 0x7fb6cc130270 2024-09-10T05:15:28.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.095+0000 7fb6d14f7640 1 -- 172.21.15.139:0/3815187980 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6bc032590 con 0x7fb6cc130270 2024-09-10T05:15:28.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.095+0000 7fb6d475d640 1 -- 172.21.15.139:0/3815187980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6cc130270 msgr2=0x7fb6cc132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:15:28.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.095+0000 7fb6d475d640 1 --2- 172.21.15.139:0/3815187980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6cc130270 0x7fb6cc132660 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009720 tx=0x7fb6bc02a110 comp rx=0 tx=0).stop 2024-09-10T05:15:28.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.095+0000 7fb6d475d640 1 -- 172.21.15.139:0/3815187980 shutdown_connections 2024-09-10T05:15:28.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.095+0000 7fb6d475d640 1 --2- 172.21.15.139:0/3815187980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6cc130270 0x7fb6cc132660 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:15:28.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.095+0000 7fb6d475d640 1 -- 172.21.15.139:0/3815187980 >> 172.21.15.139:0/3815187980 conn(0x7fb6cc070850 msgr2=0x7fb6cc072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:15:28.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.095+0000 7fb6d475d640 1 -- 172.21.15.139:0/3815187980 shutdown_connections 2024-09-10T05:15:28.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.096+0000 7fb6d475d640 1 -- 172.21.15.139:0/3815187980 wait complete. 2024-09-10T05:15:28.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.096+0000 7fb6d475d640 1 Processor -- start 2024-09-10T05:15:28.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.096+0000 7fb6d475d640 1 -- start start 2024-09-10T05:15:28.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.097+0000 7fb6d475d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6cc129d80 0x7fb6cc1c0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:15:28.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.097+0000 7fb6d475d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc073a10 con 0x7fb6cc129d80 2024-09-10T05:15:28.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.097+0000 7fb6d24f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6cc129d80 0x7fb6cc1c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:15:28.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.097+0000 7fb6d24f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6cc129d80 0x7fb6cc1c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52766/0 (socket says 172.21.15.139:52766) 2024-09-10T05:15:28.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.097+0000 7fb6d24f9640 1 -- 172.21.15.139:0/1252720969 learned_addr learned my addr 172.21.15.139:0/1252720969 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:15:28.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.097+0000 7fb6d24f9640 1 -- 172.21.15.139:0/1252720969 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc1c09c0 con 0x7fb6cc129d80 2024-09-10T05:15:28.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.097+0000 7fb6d24f9640 1 --2- 172.21.15.139:0/1252720969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6cc129d80 0x7fb6cc1c0480 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb6c800c3d0 tx=0x7fb6c800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:15:28.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.097+0000 7fb6c2ffd640 1 -- 172.21.15.139:0/1252720969 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6c80074d0 con 0x7fb6cc129d80 2024-09-10T05:15:28.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.097+0000 7fb6c2ffd640 1 -- 172.21.15.139:0/1252720969 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c80047e0 con 0x7fb6cc129d80 2024-09-10T05:15:28.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.097+0000 7fb6d475d640 1 -- 172.21.15.139:0/1252720969 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6cc1c0bf0 con 0x7fb6cc129d80 2024-09-10T05:15:28.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.097+0000 7fb6c2ffd640 1 -- 172.21.15.139:0/1252720969 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6c8007670 con 0x7fb6cc129d80 2024-09-10T05:15:28.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.097+0000 7fb6d475d640 1 -- 172.21.15.139:0/1252720969 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6cc1c10c0 con 0x7fb6cc129d80 2024-09-10T05:15:28.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.099+0000 7fb6d475d640 1 -- 172.21.15.139:0/1252720969 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6cc11a6b0 con 0x7fb6cc129d80 2024-09-10T05:15:28.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.099+0000 7fb6c2ffd640 1 -- 172.21.15.139:0/1252720969 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fb6c8011070 con 0x7fb6cc129d80 2024-09-10T05:15:28.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.099+0000 7fb6c2ffd640 1 --2- 172.21.15.139:0/1252720969 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb6b003de90 0x7fb6b0040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:15:28.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.099+0000 7fb6c2ffd640 1 -- 172.21.15.139:0/1252720969 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fb6c80528d0 con 0x7fb6cc129d80 2024-09-10T05:15:28.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.099+0000 7fb6d1cf8640 1 --2- 172.21.15.139:0/1252720969 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb6b003de90 0x7fb6b0040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:15:28.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.100+0000 7fb6d1cf8640 1 --2- 172.21.15.139:0/1252720969 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb6b003de90 0x7fb6b0040350 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc034000 tx=0x7fb6bc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:15:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.103+0000 7fb6c2ffd640 1 -- 172.21.15.139:0/1252720969 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fb6c8010d70 con 0x7fb6cc129d80 2024-09-10T05:15:28.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.277+0000 7fb6d475d640 1 -- 172.21.15.139:0/1252720969 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6cc114640 con 0x7fb6b003de90 2024-09-10T05:15:28.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.288+0000 7fb6c2ffd640 1 -- 172.21.15.139:0/1252720969 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665913 (secure 0 0 0) 0x7fb6cc114640 con 0x7fb6b003de90 2024-09-10T05:15:28.297 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:15:28.302 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-10T05:15:28.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.292+0000 7fb6d475d640 1 -- 172.21.15.139:0/1252720969 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb6b003de90 msgr2=0x7fb6b0040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:15:28.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.292+0000 7fb6d475d640 1 --2- 172.21.15.139:0/1252720969 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb6b003de90 0x7fb6b0040350 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc034000 tx=0x7fb6bc02e000 comp rx=0 tx=0).stop 2024-09-10T05:15:28.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.292+0000 7fb6d475d640 1 -- 172.21.15.139:0/1252720969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6cc129d80 msgr2=0x7fb6cc1c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:15:28.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.292+0000 7fb6d475d640 1 --2- 172.21.15.139:0/1252720969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6cc129d80 0x7fb6cc1c0480 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb6c800c3d0 tx=0x7fb6c800c890 comp rx=0 tx=0).stop 2024-09-10T05:15:28.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.292+0000 7fb6d475d640 1 -- 172.21.15.139:0/1252720969 shutdown_connections 2024-09-10T05:15:28.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.292+0000 7fb6d475d640 1 --2- 172.21.15.139:0/1252720969 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fb6b003de90 0x7fb6b0040350 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:15:28.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.292+0000 7fb6d475d640 1 --2- 172.21.15.139:0/1252720969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6cc129d80 0x7fb6cc1c0480 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:15:28.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.292+0000 7fb6d475d640 1 -- 172.21.15.139:0/1252720969 >> 172.21.15.139:0/1252720969 conn(0x7fb6cc070850 msgr2=0x7fb6cc1282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:15:28.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.292+0000 7fb6d475d640 1 -- 172.21.15.139:0/1252720969 shutdown_connections 2024-09-10T05:15:28.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:28.292+0000 7fb6d475d640 1 -- 172.21.15.139:0/1252720969 wait complete. 2024-09-10T05:15:28.306 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-09-10T05:15:27.953964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5433,"num_read_kb":4987,"num_write":2313,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":630,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4831,"ondisk_log_size":4831,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156864,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330496,"statfs":{"total":386547056640,"available":386386427904,"internally_reserved":0,"allocated":3080192,"data_stored":1821028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":630,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004363"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.686212+0000","last_change":"2024-09-10T05:15:00.686212+0000","last_active":"2024-09-10T05:15:00.686212+0000","last_peered":"2024-09-10T05:15:00.686212+0000","last_clean":"2024-09-10T05:15:00.686212+0000","last_became_active":"2024-09-10T05:11:27.716775+0000","last_became_peered":"2024-09-10T05:11:27.716775+0000","last_unstale":"2024-09-10T05:15:00.686212+0000","last_undegraded":"2024-09-10T05:15:00.686212+0000","last_fullsized":"2024-09-10T05:15:00.686212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:00.686129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:00.686129+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.686129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.852215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.239534+0000","last_change":"2024-09-10T05:15:18.239534+0000","last_active":"2024-09-10T05:15:18.239534+0000","last_peered":"2024-09-10T05:15:18.239534+0000","last_clean":"2024-09-10T05:15:18.239534+0000","last_became_active":"2024-09-10T05:11:29.733565+0000","last_became_peered":"2024-09-10T05:11:29.733565+0000","last_unstale":"2024-09-10T05:15:18.239534+0000","last_undegraded":"2024-09-10T05:15:18.239534+0000","last_fullsized":"2024-09-10T05:15:18.239534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:18.239427+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:18.239427+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.239427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:47.176915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.473123+0000","last_change":"2024-09-10T05:15:00.473123+0000","last_active":"2024-09-10T05:15:00.473123+0000","last_peered":"2024-09-10T05:15:00.473123+0000","last_clean":"2024-09-10T05:15:00.473123+0000","last_became_active":"2024-09-10T05:11:27.713698+0000","last_became_peered":"2024-09-10T05:11:27.713698+0000","last_unstale":"2024-09-10T05:15:00.473123+0000","last_undegraded":"2024-09-10T05:15:00.473123+0000","last_fullsized":"2024-09-10T05:15:00.473123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:00.473021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:00.473021+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.473021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:20.018847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'10","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.417350+0000","last_change":"2024-09-10T05:11:29.728909+0000","last_active":"2024-09-10T05:14:36.417350+0000","last_peered":"2024-09-10T05:14:36.417350+0000","last_clean":"2024-09-10T05:14:36.417350+0000","last_became_active":"2024-09-10T05:11:29.728621+0000","last_became_peered":"2024-09-10T05:11:29.728621+0000","last_unstale":"2024-09-10T05:14:36.417350+0000","last_undegraded":"2024-09-10T05:14:36.417350+0000","last_fullsized":"2024-09-10T05:14:36.417350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:44.019015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.073781+0000","last_change":"2024-09-10T05:15:15.073781+0000","last_active":"2024-09-10T05:15:15.073781+0000","last_peered":"2024-09-10T05:15:15.073781+0000","last_clean":"2024-09-10T05:15:15.073781+0000","last_became_active":"2024-09-10T05:11:27.733147+0000","last_became_peered":"2024-09-10T05:11:27.733147+0000","last_unstale":"2024-09-10T05:15:15.073781+0000","last_undegraded":"2024-09-10T05:15:15.073781+0000","last_fullsized":"2024-09-10T05:15:15.073781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:15.073683+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:15.073683+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.073683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:55.579728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339232+0000","last_change":"2024-09-10T05:11:29.728946+0000","last_active":"2024-09-10T05:14:36.339232+0000","last_peered":"2024-09-10T05:14:36.339232+0000","last_clean":"2024-09-10T05:14:36.339232+0000","last_became_active":"2024-09-10T05:11:29.728696+0000","last_became_peered":"2024-09-10T05:11:29.728696+0000","last_unstale":"2024-09-10T05:14:36.339232+0000","last_undegraded":"2024-09-10T05:14:36.339232+0000","last_fullsized":"2024-09-10T05:14:36.339232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:06.277517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.676818+0000","last_change":"2024-09-10T05:14:58.676818+0000","last_active":"2024-09-10T05:14:58.676818+0000","last_peered":"2024-09-10T05:14:58.676818+0000","last_clean":"2024-09-10T05:14:58.676818+0000","last_became_active":"2024-09-10T05:11:27.722701+0000","last_became_peered":"2024-09-10T05:11:27.722701+0000","last_unstale":"2024-09-10T05:14:58.676818+0000","last_undegraded":"2024-09-10T05:14:58.676818+0000","last_fullsized":"2024-09-10T05:14:58.676818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.676697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.676697+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.676697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:08.137298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'21","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.346432+0000","last_change":"2024-09-10T05:11:29.732128+0000","last_active":"2024-09-10T05:14:36.346432+0000","last_peered":"2024-09-10T05:14:36.346432+0000","last_clean":"2024-09-10T05:14:36.346432+0000","last_became_active":"2024-09-10T05:11:29.731850+0000","last_became_peered":"2024-09-10T05:11:29.731850+0000","last_unstale":"2024-09-10T05:14:36.346432+0000","last_undegraded":"2024-09-10T05:14:36.346432+0000","last_fullsized":"2024-09-10T05:14:36.346432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:29.844887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.056519+0000","last_change":"2024-09-10T05:15:14.056519+0000","last_active":"2024-09-10T05:15:14.056519+0000","last_peered":"2024-09-10T05:15:14.056519+0000","last_clean":"2024-09-10T05:15:14.056519+0000","last_became_active":"2024-09-10T05:11:27.732922+0000","last_became_peered":"2024-09-10T05:11:27.732922+0000","last_unstale":"2024-09-10T05:15:14.056519+0000","last_undegraded":"2024-09-10T05:15:14.056519+0000","last_fullsized":"2024-09-10T05:15:14.056519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:14.056436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:14.056436+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.056436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:49.245406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.287941+0000","last_change":"2024-09-10T05:15:16.287941+0000","last_active":"2024-09-10T05:15:16.287941+0000","last_peered":"2024-09-10T05:15:16.287941+0000","last_clean":"2024-09-10T05:15:16.287941+0000","last_became_active":"2024-09-10T05:11:29.722189+0000","last_became_peered":"2024-09-10T05:11:29.722189+0000","last_unstale":"2024-09-10T05:15:16.287941+0000","last_undegraded":"2024-09-10T05:15:16.287941+0000","last_fullsized":"2024-09-10T05:15:16.287941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:16.287854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:16.287854+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.287854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.329858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.707592+0000","last_change":"2024-09-10T05:14:57.707592+0000","last_active":"2024-09-10T05:14:57.707592+0000","last_peered":"2024-09-10T05:14:57.707592+0000","last_clean":"2024-09-10T05:14:57.707592+0000","last_became_active":"2024-09-10T05:11:27.706559+0000","last_became_peered":"2024-09-10T05:11:27.706559+0000","last_unstale":"2024-09-10T05:14:57.707592+0000","last_undegraded":"2024-09-10T05:14:57.707592+0000","last_fullsized":"2024-09-10T05:14:57.707592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:57.707507+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:57.707507+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.707507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:37.363037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957220+0000","last_change":"2024-09-10T05:11:29.730769+0000","last_active":"2024-09-10T05:12:04.957220+0000","last_peered":"2024-09-10T05:12:04.957220+0000","last_clean":"2024-09-10T05:12:04.957220+0000","last_became_active":"2024-09-10T05:11:29.730492+0000","last_became_peered":"2024-09-10T05:11:29.730492+0000","last_unstale":"2024-09-10T05:12:04.957220+0000","last_undegraded":"2024-09-10T05:12:04.957220+0000","last_fullsized":"2024-09-10T05:12:04.957220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:36.538972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.012797+0000","last_change":"2024-09-10T05:15:13.012797+0000","last_active":"2024-09-10T05:15:13.012797+0000","last_peered":"2024-09-10T05:15:13.012797+0000","last_clean":"2024-09-10T05:15:13.012797+0000","last_became_active":"2024-09-10T05:11:27.718363+0000","last_became_peered":"2024-09-10T05:11:27.718363+0000","last_unstale":"2024-09-10T05:15:13.012797+0000","last_undegraded":"2024-09-10T05:15:13.012797+0000","last_fullsized":"2024-09-10T05:15:13.012797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:13.012701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:13.012701+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.012701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:59.217408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.739994+0000","last_change":"2024-09-10T05:15:13.739994+0000","last_active":"2024-09-10T05:15:13.739994+0000","last_peered":"2024-09-10T05:15:13.739994+0000","last_clean":"2024-09-10T05:15:13.739994+0000","last_became_active":"2024-09-10T05:11:29.726884+0000","last_became_peered":"2024-09-10T05:11:29.726884+0000","last_unstale":"2024-09-10T05:15:13.739994+0000","last_undegraded":"2024-09-10T05:15:13.739994+0000","last_fullsized":"2024-09-10T05:15:13.739994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:13.739888+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:13.739888+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.739888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:29.267677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.496721+0000","last_change":"2024-09-10T05:14:59.496721+0000","last_active":"2024-09-10T05:14:59.496721+0000","last_peered":"2024-09-10T05:14:59.496721+0000","last_clean":"2024-09-10T05:14:59.496721+0000","last_became_active":"2024-09-10T05:11:27.718868+0000","last_became_peered":"2024-09-10T05:11:27.718868+0000","last_unstale":"2024-09-10T05:14:59.496721+0000","last_undegraded":"2024-09-10T05:14:59.496721+0000","last_fullsized":"2024-09-10T05:14:59.496721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:59.496621+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:59.496621+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.496621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:59.831011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.725923+0000","last_change":"2024-09-10T05:15:11.725923+0000","last_active":"2024-09-10T05:15:11.725923+0000","last_peered":"2024-09-10T05:15:11.725923+0000","last_clean":"2024-09-10T05:15:11.725923+0000","last_became_active":"2024-09-10T05:11:29.723497+0000","last_became_peered":"2024-09-10T05:11:29.723497+0000","last_unstale":"2024-09-10T05:15:11.725923+0000","last_undegraded":"2024-09-10T05:15:11.725923+0000","last_fullsized":"2024-09-10T05:15:11.725923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:11.725827+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:11.725827+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.725827+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:27.991023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'5","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.208052+0000","last_change":"2024-09-10T05:11:29.727785+0000","last_active":"2024-09-10T05:14:36.208052+0000","last_peered":"2024-09-10T05:14:36.208052+0000","last_clean":"2024-09-10T05:14:36.208052+0000","last_became_active":"2024-09-10T05:11:29.727536+0000","last_became_peered":"2024-09-10T05:11:29.727536+0000","last_unstale":"2024-09-10T05:14:36.208052+0000","last_undegraded":"2024-09-10T05:14:36.208052+0000","last_fullsized":"2024-09-10T05:14:36.208052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:01.849780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.476686+0000","last_change":"2024-09-10T05:14:59.476686+0000","last_active":"2024-09-10T05:14:59.476686+0000","last_peered":"2024-09-10T05:14:59.476686+0000","last_clean":"2024-09-10T05:14:59.476686+0000","last_became_active":"2024-09-10T05:11:27.728114+0000","last_became_peered":"2024-09-10T05:11:27.728114+0000","last_unstale":"2024-09-10T05:14:59.476686+0000","last_undegraded":"2024-09-10T05:14:59.476686+0000","last_fullsized":"2024-09-10T05:14:59.476686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:59.476601+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:59.476601+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.476601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:04.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.247977+0000","last_change":"2024-09-10T05:15:14.247977+0000","last_active":"2024-09-10T05:15:14.247977+0000","last_peered":"2024-09-10T05:15:14.247977+0000","last_clean":"2024-09-10T05:15:14.247977+0000","last_became_active":"2024-09-10T05:11:29.732864+0000","last_became_peered":"2024-09-10T05:11:29.732864+0000","last_unstale":"2024-09-10T05:15:14.247977+0000","last_undegraded":"2024-09-10T05:15:14.247977+0000","last_fullsized":"2024-09-10T05:15:14.247977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:14.247889+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:14.247889+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.247889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:06.302257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.645979+0000","last_change":"2024-09-10T05:15:02.645979+0000","last_active":"2024-09-10T05:15:02.645979+0000","last_peered":"2024-09-10T05:15:02.645979+0000","last_clean":"2024-09-10T05:15:02.645979+0000","last_became_active":"2024-09-10T05:11:27.706698+0000","last_became_peered":"2024-09-10T05:11:27.706698+0000","last_unstale":"2024-09-10T05:15:02.645979+0000","last_undegraded":"2024-09-10T05:15:02.645979+0000","last_fullsized":"2024-09-10T05:15:02.645979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:02.645892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:02.645892+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.645892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:35.605736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'10","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.286808+0000","last_change":"2024-09-10T05:15:17.286808+0000","last_active":"2024-09-10T05:15:17.286808+0000","last_peered":"2024-09-10T05:15:17.286808+0000","last_clean":"2024-09-10T05:15:17.286808+0000","last_became_active":"2024-09-10T05:11:29.731842+0000","last_became_peered":"2024-09-10T05:11:29.731842+0000","last_unstale":"2024-09-10T05:15:17.286808+0000","last_undegraded":"2024-09-10T05:15:17.286808+0000","last_fullsized":"2024-09-10T05:15:17.286808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:15:17.286726+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:15:17.286726+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.286726+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:48.199975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.476461+0000","last_change":"2024-09-10T05:14:58.476461+0000","last_active":"2024-09-10T05:14:58.476461+0000","last_peered":"2024-09-10T05:14:58.476461+0000","last_clean":"2024-09-10T05:14:58.476461+0000","last_became_active":"2024-09-10T05:11:27.719257+0000","last_became_peered":"2024-09-10T05:11:27.719257+0000","last_unstale":"2024-09-10T05:14:58.476461+0000","last_undegraded":"2024-09-10T05:14:58.476461+0000","last_fullsized":"2024-09-10T05:14:58.476461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.476369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.476369+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.476369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:03.036373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.654931+0000","last_change":"2024-09-10T05:15:10.654931+0000","last_active":"2024-09-10T05:15:10.654931+0000","last_peered":"2024-09-10T05:15:10.654931+0000","last_clean":"2024-09-10T05:15:10.654931+0000","last_became_active":"2024-09-10T05:12:04.967642+0000","last_became_peered":"2024-09-10T05:12:04.967642+0000","last_unstale":"2024-09-10T05:15:10.654931+0000","last_undegraded":"2024-09-10T05:15:10.654931+0000","last_fullsized":"2024-09-10T05:15:10.654931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:10.654800+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:10.654800+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.654800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:19.179150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"37'3","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.500764+0000","last_change":"2024-09-10T05:14:55.500764+0000","last_active":"2024-09-10T05:14:55.500764+0000","last_peered":"2024-09-10T05:14:55.500764+0000","last_clean":"2024-09-10T05:14:55.500764+0000","last_became_active":"2024-09-10T05:11:27.724439+0000","last_became_peered":"2024-09-10T05:11:27.724439+0000","last_unstale":"2024-09-10T05:14:55.500764+0000","last_undegraded":"2024-09-10T05:14:55.500764+0000","last_fullsized":"2024-09-10T05:14:55.500764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:14:55.500672+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:14:55.500672+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.500672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:26.970541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.746780+0000","last_change":"2024-09-10T05:15:09.746780+0000","last_active":"2024-09-10T05:15:09.746780+0000","last_peered":"2024-09-10T05:15:09.746780+0000","last_clean":"2024-09-10T05:15:09.746780+0000","last_became_active":"2024-09-10T05:11:29.722894+0000","last_became_peered":"2024-09-10T05:11:29.722894+0000","last_unstale":"2024-09-10T05:15:09.746780+0000","last_undegraded":"2024-09-10T05:15:09.746780+0000","last_fullsized":"2024-09-10T05:15:09.746780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:09.746683+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:09.746683+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.746683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:47.372939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.710949+0000","last_change":"2024-09-10T05:15:16.710949+0000","last_active":"2024-09-10T05:15:16.710949+0000","last_peered":"2024-09-10T05:15:16.710949+0000","last_clean":"2024-09-10T05:15:16.710949+0000","last_became_active":"2024-09-10T05:11:27.714926+0000","last_became_peered":"2024-09-10T05:11:27.714926+0000","last_unstale":"2024-09-10T05:15:16.710949+0000","last_undegraded":"2024-09-10T05:15:16.710949+0000","last_fullsized":"2024-09-10T05:15:16.710949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:16.710850+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:16.710850+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.710850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:15.748556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.253244+0000","last_change":"2024-09-10T05:15:15.253244+0000","last_active":"2024-09-10T05:15:15.253244+0000","last_peered":"2024-09-10T05:15:15.253244+0000","last_clean":"2024-09-10T05:15:15.253244+0000","last_became_active":"2024-09-10T05:11:29.721876+0000","last_became_peered":"2024-09-10T05:11:29.721876+0000","last_unstale":"2024-09-10T05:15:15.253244+0000","last_undegraded":"2024-09-10T05:15:15.253244+0000","last_fullsized":"2024-09-10T05:15:15.253244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:15.253159+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:15.253159+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.253159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:20.248120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.060849+0000","last_change":"2024-09-10T05:15:12.060849+0000","last_active":"2024-09-10T05:15:12.060849+0000","last_peered":"2024-09-10T05:15:12.060849+0000","last_clean":"2024-09-10T05:15:12.060849+0000","last_became_active":"2024-09-10T05:11:27.720197+0000","last_became_peered":"2024-09-10T05:11:27.720197+0000","last_unstale":"2024-09-10T05:15:12.060849+0000","last_undegraded":"2024-09-10T05:15:12.060849+0000","last_fullsized":"2024-09-10T05:15:12.060849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:12.060756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:12.060756+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.060756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:16.632715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.361804+0000","last_change":"2024-09-10T05:11:37.763268+0000","last_active":"2024-09-10T05:14:36.361804+0000","last_peered":"2024-09-10T05:14:36.361804+0000","last_clean":"2024-09-10T05:14:36.361804+0000","last_became_active":"2024-09-10T05:11:37.763019+0000","last_became_peered":"2024-09-10T05:11:37.763019+0000","last_unstale":"2024-09-10T05:14:36.361804+0000","last_undegraded":"2024-09-10T05:14:36.361804+0000","last_fullsized":"2024-09-10T05:14:36.361804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:54.698085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.009597+0000","last_change":"2024-09-10T05:15:22.009597+0000","last_active":"2024-09-10T05:15:22.009597+0000","last_peered":"2024-09-10T05:15:22.009597+0000","last_clean":"2024-09-10T05:15:22.009597+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:15:22.009597+0000","last_undegraded":"2024-09-10T05:15:22.009597+0000","last_fullsized":"2024-09-10T05:15:22.009597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:22.009499+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:22.009499+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.009499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:02.796822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.908025+0000","last_change":"2024-09-10T05:14:59.908025+0000","last_active":"2024-09-10T05:14:59.908025+0000","last_peered":"2024-09-10T05:14:59.908025+0000","last_clean":"2024-09-10T05:14:59.908025+0000","last_became_active":"2024-09-10T05:11:27.733612+0000","last_became_peered":"2024-09-10T05:11:27.733612+0000","last_unstale":"2024-09-10T05:14:59.908025+0000","last_undegraded":"2024-09-10T05:14:59.908025+0000","last_fullsized":"2024-09-10T05:14:59.908025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:59.907936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:59.907936+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.907936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:14.244325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957082+0000","last_change":"2024-09-10T05:11:31.737509+0000","last_active":"2024-09-10T05:12:04.957082+0000","last_peered":"2024-09-10T05:12:04.957082+0000","last_clean":"2024-09-10T05:12:04.957082+0000","last_became_active":"2024-09-10T05:11:31.736788+0000","last_became_peered":"2024-09-10T05:11:31.736788+0000","last_unstale":"2024-09-10T05:12:04.957082+0000","last_undegraded":"2024-09-10T05:12:04.957082+0000","last_fullsized":"2024-09-10T05:12:04.957082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:26.107225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'47","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.081131+0000","last_change":"2024-09-10T05:11:33.746939+0000","last_active":"2024-09-10T05:14:43.081131+0000","last_peered":"2024-09-10T05:14:43.081131+0000","last_clean":"2024-09-10T05:14:43.081131+0000","last_became_active":"2024-09-10T05:11:33.746595+0000","last_became_peered":"2024-09-10T05:11:33.746595+0000","last_unstale":"2024-09-10T05:14:43.081131+0000","last_undegraded":"2024-09-10T05:14:43.081131+0000","last_fullsized":"2024-09-10T05:14:43.081131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:39.379252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.963055+0000","last_change":"2024-09-10T05:11:35.746892+0000","last_active":"2024-09-10T05:12:04.963055+0000","last_peered":"2024-09-10T05:12:04.963055+0000","last_clean":"2024-09-10T05:12:04.963055+0000","last_became_active":"2024-09-10T05:11:35.746594+0000","last_became_peered":"2024-09-10T05:11:35.746594+0000","last_unstale":"2024-09-10T05:12:04.963055+0000","last_undegraded":"2024-09-10T05:12:04.963055+0000","last_fullsized":"2024-09-10T05:12:04.963055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:15.325826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.968440+0000","last_change":"2024-09-10T05:11:37.756768+0000","last_active":"2024-09-10T05:12:51.968440+0000","last_peered":"2024-09-10T05:12:51.968440+0000","last_clean":"2024-09-10T05:12:51.968440+0000","last_became_active":"2024-09-10T05:11:37.756495+0000","last_became_peered":"2024-09-10T05:11:37.756495+0000","last_unstale":"2024-09-10T05:12:51.968440+0000","last_undegraded":"2024-09-10T05:12:51.968440+0000","last_fullsized":"2024-09-10T05:12:51.968440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:13.070344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.037012+0000","last_change":"2024-09-10T05:15:23.037012+0000","last_active":"2024-09-10T05:15:23.037012+0000","last_peered":"2024-09-10T05:15:23.037012+0000","last_clean":"2024-09-10T05:15:23.037012+0000","last_became_active":"2024-09-10T05:11:29.732267+0000","last_became_peered":"2024-09-10T05:11:29.732267+0000","last_unstale":"2024-09-10T05:15:23.037012+0000","last_undegraded":"2024-09-10T05:15:23.037012+0000","last_fullsized":"2024-09-10T05:15:23.037012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:23.036921+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:23.036921+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.036921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:21.103347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.746344+0000","last_change":"2024-09-10T05:14:52.746344+0000","last_active":"2024-09-10T05:14:52.746344+0000","last_peered":"2024-09-10T05:14:52.746344+0000","last_clean":"2024-09-10T05:14:52.746344+0000","last_became_active":"2024-09-10T05:11:27.726599+0000","last_became_peered":"2024-09-10T05:11:27.726599+0000","last_unstale":"2024-09-10T05:14:52.746344+0000","last_undegraded":"2024-09-10T05:14:52.746344+0000","last_fullsized":"2024-09-10T05:14:52.746344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.746259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.746259+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.746259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:50.519180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.670477+0000","last_change":"2024-09-10T05:15:20.670477+0000","last_active":"2024-09-10T05:15:20.670477+0000","last_peered":"2024-09-10T05:15:20.670477+0000","last_clean":"2024-09-10T05:15:20.670477+0000","last_became_active":"2024-09-10T05:11:31.731231+0000","last_became_peered":"2024-09-10T05:11:31.731231+0000","last_unstale":"2024-09-10T05:15:20.670477+0000","last_undegraded":"2024-09-10T05:15:20.670477+0000","last_fullsized":"2024-09-10T05:15:20.670477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:20.670391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:20.670391+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.670391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:50.967791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'13","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960893+0000","last_change":"2024-09-10T05:11:33.744170+0000","last_active":"2024-09-10T05:12:04.960893+0000","last_peered":"2024-09-10T05:12:04.960893+0000","last_clean":"2024-09-10T05:12:04.960893+0000","last_became_active":"2024-09-10T05:11:33.743847+0000","last_became_peered":"2024-09-10T05:11:33.743847+0000","last_unstale":"2024-09-10T05:12:04.960893+0000","last_undegraded":"2024-09-10T05:12:04.960893+0000","last_fullsized":"2024-09-10T05:12:04.960893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:57.085007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962494+0000","last_change":"2024-09-10T05:11:35.749895+0000","last_active":"2024-09-10T05:12:04.962494+0000","last_peered":"2024-09-10T05:12:04.962494+0000","last_clean":"2024-09-10T05:12:04.962494+0000","last_became_active":"2024-09-10T05:11:35.749634+0000","last_became_peered":"2024-09-10T05:11:35.749634+0000","last_unstale":"2024-09-10T05:12:04.962494+0000","last_undegraded":"2024-09-10T05:12:04.962494+0000","last_fullsized":"2024-09-10T05:12:04.962494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:01.486680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956547+0000","last_change":"2024-09-10T05:11:37.755426+0000","last_active":"2024-09-10T05:12:04.956547+0000","last_peered":"2024-09-10T05:12:04.956547+0000","last_clean":"2024-09-10T05:12:04.956547+0000","last_became_active":"2024-09-10T05:11:37.755078+0000","last_became_peered":"2024-09-10T05:11:37.755078+0000","last_unstale":"2024-09-10T05:12:04.956547+0000","last_undegraded":"2024-09-10T05:12:04.956547+0000","last_fullsized":"2024-09-10T05:12:04.956547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:03.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.007105+0000","last_change":"2024-09-10T05:15:24.007105+0000","last_active":"2024-09-10T05:15:24.007105+0000","last_peered":"2024-09-10T05:15:24.007105+0000","last_clean":"2024-09-10T05:15:24.007105+0000","last_became_active":"2024-09-10T05:11:29.731780+0000","last_became_peered":"2024-09-10T05:11:29.731780+0000","last_unstale":"2024-09-10T05:15:24.007105+0000","last_undegraded":"2024-09-10T05:15:24.007105+0000","last_fullsized":"2024-09-10T05:15:24.007105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:24.007017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:24.007017+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.007017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:45.996847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.998628+0000","last_change":"2024-09-10T05:15:01.998628+0000","last_active":"2024-09-10T05:15:01.998628+0000","last_peered":"2024-09-10T05:15:01.998628+0000","last_clean":"2024-09-10T05:15:01.998628+0000","last_became_active":"2024-09-10T05:11:27.732573+0000","last_became_peered":"2024-09-10T05:11:27.732573+0000","last_unstale":"2024-09-10T05:15:01.998628+0000","last_undegraded":"2024-09-10T05:15:01.998628+0000","last_fullsized":"2024-09-10T05:15:01.998628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:01.998527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:01.998527+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.998527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:38.110563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.728959+0000","last_change":"2024-09-10T05:15:16.728959+0000","last_active":"2024-09-10T05:15:16.728959+0000","last_peered":"2024-09-10T05:15:16.728959+0000","last_clean":"2024-09-10T05:15:16.728959+0000","last_became_active":"2024-09-10T05:12:04.965494+0000","last_became_peered":"2024-09-10T05:12:04.965494+0000","last_unstale":"2024-09-10T05:15:16.728959+0000","last_undegraded":"2024-09-10T05:15:16.728959+0000","last_fullsized":"2024-09-10T05:15:16.728959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:16.728878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:16.728878+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.728878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.784781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"35'22","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959616+0000","last_change":"2024-09-10T05:11:33.745608+0000","last_active":"2024-09-10T05:12:04.959616+0000","last_peered":"2024-09-10T05:12:04.959616+0000","last_clean":"2024-09-10T05:12:04.959616+0000","last_became_active":"2024-09-10T05:11:33.745336+0000","last_became_peered":"2024-09-10T05:11:33.745336+0000","last_unstale":"2024-09-10T05:12:04.959616+0000","last_undegraded":"2024-09-10T05:12:04.959616+0000","last_fullsized":"2024-09-10T05:12:04.959616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:41.078775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'285","reported_seq":418,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.005466+0000","last_change":"2024-09-10T05:11:35.752548+0000","last_active":"2024-09-10T05:14:43.005466+0000","last_peered":"2024-09-10T05:14:43.005466+0000","last_clean":"2024-09-10T05:14:43.005466+0000","last_became_active":"2024-09-10T05:11:35.752290+0000","last_became_peered":"2024-09-10T05:11:35.752290+0000","last_unstale":"2024-09-10T05:14:43.005466+0000","last_undegraded":"2024-09-10T05:14:43.005466+0000","last_fullsized":"2024-09-10T05:14:43.005466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.244961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959825+0000","last_change":"2024-09-10T05:11:37.759873+0000","last_active":"2024-09-10T05:12:04.959825+0000","last_peered":"2024-09-10T05:12:04.959825+0000","last_clean":"2024-09-10T05:12:04.959825+0000","last_became_active":"2024-09-10T05:11:37.759311+0000","last_became_peered":"2024-09-10T05:11:37.759311+0000","last_unstale":"2024-09-10T05:12:04.959825+0000","last_undegraded":"2024-09-10T05:12:04.959825+0000","last_fullsized":"2024-09-10T05:12:04.959825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:37.479923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.495305+0000","last_change":"2024-09-10T05:15:05.495305+0000","last_active":"2024-09-10T05:15:05.495305+0000","last_peered":"2024-09-10T05:15:05.495305+0000","last_clean":"2024-09-10T05:15:05.495305+0000","last_became_active":"2024-09-10T05:11:29.723919+0000","last_became_peered":"2024-09-10T05:11:29.723919+0000","last_unstale":"2024-09-10T05:15:05.495305+0000","last_undegraded":"2024-09-10T05:15:05.495305+0000","last_fullsized":"2024-09-10T05:15:05.495305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:05.495212+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:05.495212+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.495212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:47.310404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.435128+0000","last_change":"2024-09-10T05:14:49.435128+0000","last_active":"2024-09-10T05:14:49.435128+0000","last_peered":"2024-09-10T05:14:49.435128+0000","last_clean":"2024-09-10T05:14:49.435128+0000","last_became_active":"2024-09-10T05:11:27.719835+0000","last_became_peered":"2024-09-10T05:11:27.719835+0000","last_unstale":"2024-09-10T05:14:49.435128+0000","last_undegraded":"2024-09-10T05:14:49.435128+0000","last_fullsized":"2024-09-10T05:14:49.435128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:49.435035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:49.435035+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.435035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:32.661631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962693+0000","last_change":"2024-09-10T05:11:31.737694+0000","last_active":"2024-09-10T05:12:04.962693+0000","last_peered":"2024-09-10T05:12:04.962693+0000","last_clean":"2024-09-10T05:12:04.962693+0000","last_became_active":"2024-09-10T05:11:31.737411+0000","last_became_peered":"2024-09-10T05:11:31.737411+0000","last_unstale":"2024-09-10T05:12:04.962693+0000","last_undegraded":"2024-09-10T05:12:04.962693+0000","last_fullsized":"2024-09-10T05:12:04.962693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:48.673581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'39","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.066217+0000","last_change":"2024-09-10T05:11:33.745209+0000","last_active":"2024-09-10T05:14:43.066217+0000","last_peered":"2024-09-10T05:14:43.066217+0000","last_clean":"2024-09-10T05:14:43.066217+0000","last_became_active":"2024-09-10T05:11:33.744920+0000","last_became_peered":"2024-09-10T05:11:33.744920+0000","last_unstale":"2024-09-10T05:14:43.066217+0000","last_undegraded":"2024-09-10T05:14:43.066217+0000","last_fullsized":"2024-09-10T05:14:43.066217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:36.085525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":427,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.010217+0000","last_change":"2024-09-10T05:11:35.748524+0000","last_active":"2024-09-10T05:14:43.010217+0000","last_peered":"2024-09-10T05:14:43.010217+0000","last_clean":"2024-09-10T05:14:43.010217+0000","last_became_active":"2024-09-10T05:11:35.748328+0000","last_became_peered":"2024-09-10T05:11:35.748328+0000","last_unstale":"2024-09-10T05:14:43.010217+0000","last_undegraded":"2024-09-10T05:14:43.010217+0000","last_fullsized":"2024-09-10T05:14:43.010217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:39.020754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.072422+0000","last_change":"2024-09-10T05:15:19.072422+0000","last_active":"2024-09-10T05:15:19.072422+0000","last_peered":"2024-09-10T05:15:19.072422+0000","last_clean":"2024-09-10T05:15:19.072422+0000","last_became_active":"2024-09-10T05:11:29.735799+0000","last_became_peered":"2024-09-10T05:11:29.735799+0000","last_unstale":"2024-09-10T05:15:19.072422+0000","last_undegraded":"2024-09-10T05:15:19.072422+0000","last_fullsized":"2024-09-10T05:15:19.072422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:19.072304+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:19.072304+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.072304+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:47.414562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.750206+0000","last_change":"2024-09-10T05:14:53.750206+0000","last_active":"2024-09-10T05:14:53.750206+0000","last_peered":"2024-09-10T05:14:53.750206+0000","last_clean":"2024-09-10T05:14:53.750206+0000","last_became_active":"2024-09-10T05:11:27.716318+0000","last_became_peered":"2024-09-10T05:11:27.716318+0000","last_unstale":"2024-09-10T05:14:53.750206+0000","last_undegraded":"2024-09-10T05:14:53.750206+0000","last_fullsized":"2024-09-10T05:14:53.750206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.750095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.750095+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.750095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:30.144747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.283646+0000","last_change":"2024-09-10T05:15:21.283646+0000","last_active":"2024-09-10T05:15:21.283646+0000","last_peered":"2024-09-10T05:15:21.283646+0000","last_clean":"2024-09-10T05:15:21.283646+0000","last_became_active":"2024-09-10T05:11:31.734975+0000","last_became_peered":"2024-09-10T05:11:31.734975+0000","last_unstale":"2024-09-10T05:15:21.283646+0000","last_undegraded":"2024-09-10T05:15:21.283646+0000","last_fullsized":"2024-09-10T05:15:21.283646+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:21.283528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:21.283528+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.283528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:26.933150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'60","reported_seq":126,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.726852+0000","last_change":"2024-09-10T05:15:22.726852+0000","last_active":"2024-09-10T05:15:22.726852+0000","last_peered":"2024-09-10T05:15:22.726852+0000","last_clean":"2024-09-10T05:15:22.726852+0000","last_became_active":"2024-09-10T05:11:33.746522+0000","last_became_peered":"2024-09-10T05:11:33.746522+0000","last_unstale":"2024-09-10T05:15:22.726852+0000","last_undegraded":"2024-09-10T05:15:22.726852+0000","last_fullsized":"2024-09-10T05:15:22.726852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'60","last_scrub_stamp":"2024-09-10T05:15:22.726746+0000","last_deep_scrub":"37'60","last_deep_scrub_stamp":"2024-09-10T05:15:22.726746+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.726746+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:43:04.485808+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957524+0000","last_change":"2024-09-10T05:11:35.746098+0000","last_active":"2024-09-10T05:12:04.957524+0000","last_peered":"2024-09-10T05:12:04.957524+0000","last_clean":"2024-09-10T05:12:04.957524+0000","last_became_active":"2024-09-10T05:11:35.745840+0000","last_became_peered":"2024-09-10T05:11:35.745840+0000","last_unstale":"2024-09-10T05:12:04.957524+0000","last_undegraded":"2024-09-10T05:12:04.957524+0000","last_fullsized":"2024-09-10T05:12:04.957524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:48.168086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.970146+0000","last_change":"2024-09-10T05:11:37.754850+0000","last_active":"2024-09-10T05:12:51.970146+0000","last_peered":"2024-09-10T05:12:51.970146+0000","last_clean":"2024-09-10T05:12:51.970146+0000","last_became_active":"2024-09-10T05:11:37.754562+0000","last_became_peered":"2024-09-10T05:11:37.754562+0000","last_unstale":"2024-09-10T05:12:51.970146+0000","last_undegraded":"2024-09-10T05:12:51.970146+0000","last_fullsized":"2024-09-10T05:12:51.970146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:27.172242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.352861+0000","last_change":"2024-09-10T05:15:03.352861+0000","last_active":"2024-09-10T05:15:03.352861+0000","last_peered":"2024-09-10T05:15:03.352861+0000","last_clean":"2024-09-10T05:15:03.352861+0000","last_became_active":"2024-09-10T05:11:29.721292+0000","last_became_peered":"2024-09-10T05:11:29.721292+0000","last_unstale":"2024-09-10T05:15:03.352861+0000","last_undegraded":"2024-09-10T05:15:03.352861+0000","last_fullsized":"2024-09-10T05:15:03.352861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.352761+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.352761+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.352761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:39.971897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"37'6","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.706205+0000","last_change":"2024-09-10T05:14:50.706205+0000","last_active":"2024-09-10T05:14:50.706205+0000","last_peered":"2024-09-10T05:14:50.706205+0000","last_clean":"2024-09-10T05:14:50.706205+0000","last_became_active":"2024-09-10T05:11:27.726419+0000","last_became_peered":"2024-09-10T05:11:27.726419+0000","last_unstale":"2024-09-10T05:14:50.706205+0000","last_undegraded":"2024-09-10T05:14:50.706205+0000","last_fullsized":"2024-09-10T05:14:50.706205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:14:50.706120+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:14:50.706120+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.706120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:55:39.305300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.699611+0000","last_change":"2024-09-10T05:15:14.699611+0000","last_active":"2024-09-10T05:15:14.699611+0000","last_peered":"2024-09-10T05:15:14.699611+0000","last_clean":"2024-09-10T05:15:14.699611+0000","last_became_active":"2024-09-10T05:11:31.732017+0000","last_became_peered":"2024-09-10T05:11:31.732017+0000","last_unstale":"2024-09-10T05:15:14.699611+0000","last_undegraded":"2024-09-10T05:15:14.699611+0000","last_fullsized":"2024-09-10T05:15:14.699611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:14.699495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:14.699495+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.699495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:03.772467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'40","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.141661+0000","last_change":"2024-09-10T05:11:33.747704+0000","last_active":"2024-09-10T05:14:43.141661+0000","last_peered":"2024-09-10T05:14:43.141661+0000","last_clean":"2024-09-10T05:14:43.141661+0000","last_became_active":"2024-09-10T05:11:33.747334+0000","last_became_peered":"2024-09-10T05:11:33.747334+0000","last_unstale":"2024-09-10T05:14:43.141661+0000","last_undegraded":"2024-09-10T05:14:43.141661+0000","last_fullsized":"2024-09-10T05:14:43.141661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:02.895443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956478+0000","last_change":"2024-09-10T05:11:35.753755+0000","last_active":"2024-09-10T05:12:04.956478+0000","last_peered":"2024-09-10T05:12:04.956478+0000","last_clean":"2024-09-10T05:12:04.956478+0000","last_became_active":"2024-09-10T05:11:35.753453+0000","last_became_peered":"2024-09-10T05:11:35.753453+0000","last_unstale":"2024-09-10T05:12:04.956478+0000","last_undegraded":"2024-09-10T05:12:04.956478+0000","last_fullsized":"2024-09-10T05:12:04.956478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:03.592621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:46.437159+0000","last_change":"2024-09-10T05:11:37.758133+0000","last_active":"2024-09-10T05:12:46.437159+0000","last_peered":"2024-09-10T05:12:46.437159+0000","last_clean":"2024-09-10T05:12:46.437159+0000","last_became_active":"2024-09-10T05:11:37.757307+0000","last_became_peered":"2024-09-10T05:11:37.757307+0000","last_unstale":"2024-09-10T05:12:46.437159+0000","last_undegraded":"2024-09-10T05:12:46.437159+0000","last_fullsized":"2024-09-10T05:12:46.437159+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:15.800062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.667460+0000","last_change":"2024-09-10T05:15:01.667460+0000","last_active":"2024-09-10T05:15:01.667460+0000","last_peered":"2024-09-10T05:15:01.667460+0000","last_clean":"2024-09-10T05:15:01.667460+0000","last_became_active":"2024-09-10T05:11:29.722719+0000","last_became_peered":"2024-09-10T05:11:29.722719+0000","last_unstale":"2024-09-10T05:15:01.667460+0000","last_undegraded":"2024-09-10T05:15:01.667460+0000","last_fullsized":"2024-09-10T05:15:01.667460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:01.667364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:01.667364+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.667364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:59.866263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.927325+0000","last_change":"2024-09-10T05:14:58.927325+0000","last_active":"2024-09-10T05:14:58.927325+0000","last_peered":"2024-09-10T05:14:58.927325+0000","last_clean":"2024-09-10T05:14:58.927325+0000","last_became_active":"2024-09-10T05:11:27.722553+0000","last_became_peered":"2024-09-10T05:11:27.722553+0000","last_unstale":"2024-09-10T05:14:58.927325+0000","last_undegraded":"2024-09-10T05:14:58.927325+0000","last_fullsized":"2024-09-10T05:14:58.927325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:58.927238+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:58.927238+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.927238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:40.559986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'5","reported_seq":238,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.697159+0000","last_change":"2024-09-10T05:15:19.697159+0000","last_active":"2024-09-10T05:15:19.697159+0000","last_peered":"2024-09-10T05:15:19.697159+0000","last_clean":"2024-09-10T05:15:19.697159+0000","last_became_active":"2024-09-10T05:11:31.733822+0000","last_became_peered":"2024-09-10T05:11:31.733822+0000","last_unstale":"2024-09-10T05:15:19.697159+0000","last_undegraded":"2024-09-10T05:15:19.697159+0000","last_fullsized":"2024-09-10T05:15:19.697159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-10T05:15:19.697017+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-10T05:15:19.697017+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.697017+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:40.978284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'51","reported_seq":113,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.098530+0000","last_change":"2024-09-10T05:11:33.748247+0000","last_active":"2024-09-10T05:14:43.098530+0000","last_peered":"2024-09-10T05:14:43.098530+0000","last_clean":"2024-09-10T05:14:43.098530+0000","last_became_active":"2024-09-10T05:11:33.747938+0000","last_became_peered":"2024-09-10T05:11:33.747938+0000","last_unstale":"2024-09-10T05:14:43.098530+0000","last_undegraded":"2024-09-10T05:14:43.098530+0000","last_fullsized":"2024-09-10T05:14:43.098530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:53.311224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":351,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.014451+0000","last_change":"2024-09-10T05:11:35.754114+0000","last_active":"2024-09-10T05:14:43.014451+0000","last_peered":"2024-09-10T05:14:43.014451+0000","last_clean":"2024-09-10T05:14:43.014451+0000","last_became_active":"2024-09-10T05:11:35.753663+0000","last_became_peered":"2024-09-10T05:11:35.753663+0000","last_unstale":"2024-09-10T05:14:43.014451+0000","last_undegraded":"2024-09-10T05:14:43.014451+0000","last_fullsized":"2024-09-10T05:14:43.014451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.071659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.125804+0000","last_change":"2024-09-10T05:11:37.755275+0000","last_active":"2024-09-10T05:14:36.125804+0000","last_peered":"2024-09-10T05:14:36.125804+0000","last_clean":"2024-09-10T05:14:36.125804+0000","last_became_active":"2024-09-10T05:11:37.754959+0000","last_became_peered":"2024-09-10T05:11:37.754959+0000","last_unstale":"2024-09-10T05:14:36.125804+0000","last_undegraded":"2024-09-10T05:14:36.125804+0000","last_fullsized":"2024-09-10T05:14:36.125804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:34:33.810681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'17","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.630437+0000","last_change":"2024-09-10T05:15:04.630437+0000","last_active":"2024-09-10T05:15:04.630437+0000","last_peered":"2024-09-10T05:15:04.630437+0000","last_clean":"2024-09-10T05:15:04.630437+0000","last_became_active":"2024-09-10T05:11:29.722267+0000","last_became_peered":"2024-09-10T05:11:29.722267+0000","last_unstale":"2024-09-10T05:15:04.630437+0000","last_undegraded":"2024-09-10T05:15:04.630437+0000","last_fullsized":"2024-09-10T05:15:04.630437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'17","last_scrub_stamp":"2024-09-10T05:15:04.630348+0000","last_deep_scrub":"37'17","last_deep_scrub_stamp":"2024-09-10T05:15:04.630348+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.630348+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:25.140187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'8","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.914417+0000","last_change":"2024-09-10T05:14:57.914417+0000","last_active":"2024-09-10T05:14:57.914417+0000","last_peered":"2024-09-10T05:14:57.914417+0000","last_clean":"2024-09-10T05:14:57.914417+0000","last_became_active":"2024-09-10T05:11:27.731909+0000","last_became_peered":"2024-09-10T05:11:27.731909+0000","last_unstale":"2024-09-10T05:14:57.914417+0000","last_undegraded":"2024-09-10T05:14:57.914417+0000","last_fullsized":"2024-09-10T05:14:57.914417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:14:57.914334+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:14:57.914334+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.914334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:28.529230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.678760+0000","last_change":"2024-09-10T05:15:15.678760+0000","last_active":"2024-09-10T05:15:15.678760+0000","last_peered":"2024-09-10T05:15:15.678760+0000","last_clean":"2024-09-10T05:15:15.678760+0000","last_became_active":"2024-09-10T05:11:31.732807+0000","last_became_peered":"2024-09-10T05:11:31.732807+0000","last_unstale":"2024-09-10T05:15:15.678760+0000","last_undegraded":"2024-09-10T05:15:15.678760+0000","last_fullsized":"2024-09-10T05:15:15.678760+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:15.678675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:15.678675+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.678675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:44.860207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'72","reported_seq":149,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.150182+0000","last_change":"2024-09-10T05:11:33.747177+0000","last_active":"2024-09-10T05:14:43.150182+0000","last_peered":"2024-09-10T05:14:43.150182+0000","last_clean":"2024-09-10T05:14:43.150182+0000","last_became_active":"2024-09-10T05:11:33.745449+0000","last_became_peered":"2024-09-10T05:11:33.745449+0000","last_unstale":"2024-09-10T05:14:43.150182+0000","last_undegraded":"2024-09-10T05:14:43.150182+0000","last_fullsized":"2024-09-10T05:14:43.150182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:08.744407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956380+0000","last_change":"2024-09-10T05:11:35.748171+0000","last_active":"2024-09-10T05:12:04.956380+0000","last_peered":"2024-09-10T05:12:04.956380+0000","last_clean":"2024-09-10T05:12:04.956380+0000","last_became_active":"2024-09-10T05:11:35.747913+0000","last_became_peered":"2024-09-10T05:11:35.747913+0000","last_unstale":"2024-09-10T05:12:04.956380+0000","last_undegraded":"2024-09-10T05:12:04.956380+0000","last_fullsized":"2024-09-10T05:12:04.956380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:43.800560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'20","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.564815+0000","last_change":"2024-09-10T05:11:37.755327+0000","last_active":"2024-09-10T05:14:36.564815+0000","last_peered":"2024-09-10T05:14:36.564815+0000","last_clean":"2024-09-10T05:14:36.564815+0000","last_became_active":"2024-09-10T05:11:37.754915+0000","last_became_peered":"2024-09-10T05:11:37.754915+0000","last_unstale":"2024-09-10T05:14:36.564815+0000","last_undegraded":"2024-09-10T05:14:36.564815+0000","last_fullsized":"2024-09-10T05:14:36.564815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:57.393330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'14","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.379312+0000","last_change":"2024-09-10T05:15:02.379312+0000","last_active":"2024-09-10T05:15:02.379312+0000","last_peered":"2024-09-10T05:15:02.379312+0000","last_clean":"2024-09-10T05:15:02.379312+0000","last_became_active":"2024-09-10T05:11:29.727349+0000","last_became_peered":"2024-09-10T05:11:29.727349+0000","last_unstale":"2024-09-10T05:15:02.379312+0000","last_undegraded":"2024-09-10T05:15:02.379312+0000","last_fullsized":"2024-09-10T05:15:02.379312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:02.379225+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:02.379225+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.379225+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:14.485317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.470556+0000","last_change":"2024-09-10T05:14:51.470556+0000","last_active":"2024-09-10T05:14:51.470556+0000","last_peered":"2024-09-10T05:14:51.470556+0000","last_clean":"2024-09-10T05:14:51.470556+0000","last_became_active":"2024-09-10T05:11:27.717887+0000","last_became_peered":"2024-09-10T05:11:27.717887+0000","last_unstale":"2024-09-10T05:14:51.470556+0000","last_undegraded":"2024-09-10T05:14:51.470556+0000","last_fullsized":"2024-09-10T05:14:51.470556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:51.470452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:51.470452+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.470452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:41.087698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.704114+0000","last_change":"2024-09-10T05:15:14.704114+0000","last_active":"2024-09-10T05:15:14.704114+0000","last_peered":"2024-09-10T05:15:14.704114+0000","last_clean":"2024-09-10T05:15:14.704114+0000","last_became_active":"2024-09-10T05:11:31.735386+0000","last_became_peered":"2024-09-10T05:11:31.735386+0000","last_unstale":"2024-09-10T05:15:14.704114+0000","last_undegraded":"2024-09-10T05:15:14.704114+0000","last_fullsized":"2024-09-10T05:15:14.704114+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:14.704035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:14.704035+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.704035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:48.911727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'41","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.153199+0000","last_change":"2024-09-10T05:11:33.744354+0000","last_active":"2024-09-10T05:14:43.153199+0000","last_peered":"2024-09-10T05:14:43.153199+0000","last_clean":"2024-09-10T05:14:43.153199+0000","last_became_active":"2024-09-10T05:11:33.744026+0000","last_became_peered":"2024-09-10T05:11:33.744026+0000","last_unstale":"2024-09-10T05:14:43.153199+0000","last_undegraded":"2024-09-10T05:14:43.153199+0000","last_fullsized":"2024-09-10T05:14:43.153199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.017634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960608+0000","last_change":"2024-09-10T05:11:35.749447+0000","last_active":"2024-09-10T05:12:04.960608+0000","last_peered":"2024-09-10T05:12:04.960608+0000","last_clean":"2024-09-10T05:12:04.960608+0000","last_became_active":"2024-09-10T05:11:35.748874+0000","last_became_peered":"2024-09-10T05:11:35.748874+0000","last_unstale":"2024-09-10T05:12:04.960608+0000","last_undegraded":"2024-09-10T05:12:04.960608+0000","last_fullsized":"2024-09-10T05:12:04.960608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:09.658936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'9","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.113777+0000","last_change":"2024-09-10T05:11:37.768186+0000","last_active":"2024-09-10T05:14:36.113777+0000","last_peered":"2024-09-10T05:14:36.113777+0000","last_clean":"2024-09-10T05:14:36.113777+0000","last_became_active":"2024-09-10T05:11:37.767895+0000","last_became_peered":"2024-09-10T05:11:37.767895+0000","last_unstale":"2024-09-10T05:14:36.113777+0000","last_undegraded":"2024-09-10T05:14:36.113777+0000","last_fullsized":"2024-09-10T05:14:36.113777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:10.944772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'16","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.041594+0000","last_change":"2024-09-10T05:15:20.041594+0000","last_active":"2024-09-10T05:15:20.041594+0000","last_peered":"2024-09-10T05:15:20.041594+0000","last_clean":"2024-09-10T05:15:20.041594+0000","last_became_active":"2024-09-10T05:11:29.733870+0000","last_became_peered":"2024-09-10T05:11:29.733870+0000","last_unstale":"2024-09-10T05:15:20.041594+0000","last_undegraded":"2024-09-10T05:15:20.041594+0000","last_fullsized":"2024-09-10T05:15:20.041594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:20.041507+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:20.041507+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.041507+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:39:13.856170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.937882+0000","last_change":"2024-09-10T05:14:56.937882+0000","last_active":"2024-09-10T05:14:56.937882+0000","last_peered":"2024-09-10T05:14:56.937882+0000","last_clean":"2024-09-10T05:14:56.937882+0000","last_became_active":"2024-09-10T05:11:27.725852+0000","last_became_peered":"2024-09-10T05:11:27.725852+0000","last_unstale":"2024-09-10T05:14:56.937882+0000","last_undegraded":"2024-09-10T05:14:56.937882+0000","last_fullsized":"2024-09-10T05:14:56.937882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:56.937795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:56.937795+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.937795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:18.007474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.664914+0000","last_change":"2024-09-10T05:15:18.664914+0000","last_active":"2024-09-10T05:15:18.664914+0000","last_peered":"2024-09-10T05:15:18.664914+0000","last_clean":"2024-09-10T05:15:18.664914+0000","last_became_active":"2024-09-10T05:11:31.733756+0000","last_became_peered":"2024-09-10T05:11:31.733756+0000","last_unstale":"2024-09-10T05:15:18.664914+0000","last_undegraded":"2024-09-10T05:15:18.664914+0000","last_fullsized":"2024-09-10T05:15:18.664914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:18.664801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:18.664801+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.664801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:56.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'48","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.724473+0000","last_change":"2024-09-10T05:15:24.724473+0000","last_active":"2024-09-10T05:15:24.724473+0000","last_peered":"2024-09-10T05:15:24.724473+0000","last_clean":"2024-09-10T05:15:24.724473+0000","last_became_active":"2024-09-10T05:11:33.741848+0000","last_became_peered":"2024-09-10T05:11:33.741848+0000","last_unstale":"2024-09-10T05:15:24.724473+0000","last_undegraded":"2024-09-10T05:15:24.724473+0000","last_fullsized":"2024-09-10T05:15:24.724473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'48","last_scrub_stamp":"2024-09-10T05:15:24.724365+0000","last_deep_scrub":"37'48","last_deep_scrub_stamp":"2024-09-10T05:15:24.724365+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.724365+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:38:55.362877+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'285","reported_seq":455,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.006459+0000","last_change":"2024-09-10T05:11:35.752932+0000","last_active":"2024-09-10T05:14:43.006459+0000","last_peered":"2024-09-10T05:14:43.006459+0000","last_clean":"2024-09-10T05:14:43.006459+0000","last_became_active":"2024-09-10T05:11:35.752511+0000","last_became_peered":"2024-09-10T05:11:35.752511+0000","last_unstale":"2024-09-10T05:14:43.006459+0000","last_undegraded":"2024-09-10T05:14:43.006459+0000","last_fullsized":"2024-09-10T05:14:43.006459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:09.522467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'14","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:43.909368+0000","last_change":"2024-09-10T05:11:37.758779+0000","last_active":"2024-09-10T05:13:43.909368+0000","last_peered":"2024-09-10T05:13:43.909368+0000","last_clean":"2024-09-10T05:13:43.909368+0000","last_became_active":"2024-09-10T05:11:37.758381+0000","last_became_peered":"2024-09-10T05:11:37.758381+0000","last_unstale":"2024-09-10T05:13:43.909368+0000","last_undegraded":"2024-09-10T05:13:43.909368+0000","last_fullsized":"2024-09-10T05:13:43.909368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:32.090333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'14","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.632091+0000","last_change":"2024-09-10T05:15:05.632091+0000","last_active":"2024-09-10T05:15:05.632091+0000","last_peered":"2024-09-10T05:15:05.632091+0000","last_clean":"2024-09-10T05:15:05.632091+0000","last_became_active":"2024-09-10T05:11:29.722170+0000","last_became_peered":"2024-09-10T05:11:29.722170+0000","last_unstale":"2024-09-10T05:15:05.632091+0000","last_undegraded":"2024-09-10T05:15:05.632091+0000","last_fullsized":"2024-09-10T05:15:05.632091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:05.632009+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:05.632009+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.632009+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:23.914770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.932355+0000","last_change":"2024-09-10T05:14:55.932355+0000","last_active":"2024-09-10T05:14:55.932355+0000","last_peered":"2024-09-10T05:14:55.932355+0000","last_clean":"2024-09-10T05:14:55.932355+0000","last_became_active":"2024-09-10T05:11:27.732591+0000","last_became_peered":"2024-09-10T05:11:27.732591+0000","last_unstale":"2024-09-10T05:14:55.932355+0000","last_undegraded":"2024-09-10T05:14:55.932355+0000","last_fullsized":"2024-09-10T05:14:55.932355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:55.932231+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:55.932231+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.932231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:54.606915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'5","reported_seq":428,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.298554+0000","last_change":"2024-09-10T05:15:22.298554+0000","last_active":"2024-09-10T05:15:22.298554+0000","last_peered":"2024-09-10T05:15:22.298554+0000","last_clean":"2024-09-10T05:15:22.298554+0000","last_became_active":"2024-09-10T05:11:31.734714+0000","last_became_peered":"2024-09-10T05:11:31.734714+0000","last_unstale":"2024-09-10T05:15:22.298554+0000","last_undegraded":"2024-09-10T05:15:22.298554+0000","last_fullsized":"2024-09-10T05:15:22.298554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-10T05:15:22.298439+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-10T05:15:22.298439+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.298439+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:58.275665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958372+0000","last_change":"2024-09-10T05:11:33.747604+0000","last_active":"2024-09-10T05:12:04.958372+0000","last_peered":"2024-09-10T05:12:04.958372+0000","last_clean":"2024-09-10T05:12:04.958372+0000","last_became_active":"2024-09-10T05:11:33.747376+0000","last_became_peered":"2024-09-10T05:11:33.747376+0000","last_unstale":"2024-09-10T05:12:04.958372+0000","last_undegraded":"2024-09-10T05:12:04.958372+0000","last_fullsized":"2024-09-10T05:12:04.958372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:06.584551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'285","reported_seq":466,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.007782+0000","last_change":"2024-09-10T05:11:35.751653+0000","last_active":"2024-09-10T05:14:43.007782+0000","last_peered":"2024-09-10T05:14:43.007782+0000","last_clean":"2024-09-10T05:14:43.007782+0000","last_became_active":"2024-09-10T05:11:35.751352+0000","last_became_peered":"2024-09-10T05:11:35.751352+0000","last_unstale":"2024-09-10T05:14:43.007782+0000","last_undegraded":"2024-09-10T05:14:43.007782+0000","last_fullsized":"2024-09-10T05:14:43.007782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:50.857756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.203681+0000","last_change":"2024-09-10T05:11:37.757022+0000","last_active":"2024-09-10T05:14:36.203681+0000","last_peered":"2024-09-10T05:14:36.203681+0000","last_clean":"2024-09-10T05:14:36.203681+0000","last_became_active":"2024-09-10T05:11:37.756734+0000","last_became_peered":"2024-09-10T05:11:37.756734+0000","last_unstale":"2024-09-10T05:14:36.203681+0000","last_undegraded":"2024-09-10T05:14:36.203681+0000","last_fullsized":"2024-09-10T05:14:36.203681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:18.190348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'24","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.367487+0000","last_change":"2024-09-10T05:15:04.367487+0000","last_active":"2024-09-10T05:15:04.367487+0000","last_peered":"2024-09-10T05:15:04.367487+0000","last_clean":"2024-09-10T05:15:04.367487+0000","last_became_active":"2024-09-10T05:11:29.735032+0000","last_became_peered":"2024-09-10T05:11:29.735032+0000","last_unstale":"2024-09-10T05:15:04.367487+0000","last_undegraded":"2024-09-10T05:15:04.367487+0000","last_fullsized":"2024-09-10T05:15:04.367487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24","last_scrub_stamp":"2024-09-10T05:15:04.367405+0000","last_deep_scrub":"37'24","last_deep_scrub_stamp":"2024-09-10T05:15:04.367405+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.367405+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:35.414356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.972818+0000","last_change":"2024-09-10T05:14:54.972818+0000","last_active":"2024-09-10T05:14:54.972818+0000","last_peered":"2024-09-10T05:14:54.972818+0000","last_clean":"2024-09-10T05:14:54.972818+0000","last_became_active":"2024-09-10T05:11:27.734204+0000","last_became_peered":"2024-09-10T05:11:27.734204+0000","last_unstale":"2024-09-10T05:14:54.972818+0000","last_undegraded":"2024-09-10T05:14:54.972818+0000","last_fullsized":"2024-09-10T05:14:54.972818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:54.972735+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:54.972735+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.972735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:47.793245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962223+0000","last_change":"2024-09-10T05:11:31.737418+0000","last_active":"2024-09-10T05:12:04.962223+0000","last_peered":"2024-09-10T05:12:04.962223+0000","last_clean":"2024-09-10T05:12:04.962223+0000","last_became_active":"2024-09-10T05:11:31.736841+0000","last_became_peered":"2024-09-10T05:11:31.736841+0000","last_unstale":"2024-09-10T05:12:04.962223+0000","last_undegraded":"2024-09-10T05:12:04.962223+0000","last_fullsized":"2024-09-10T05:12:04.962223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:39.906395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'42","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.084121+0000","last_change":"2024-09-10T05:11:33.744918+0000","last_active":"2024-09-10T05:14:43.084121+0000","last_peered":"2024-09-10T05:14:43.084121+0000","last_clean":"2024-09-10T05:14:43.084121+0000","last_became_active":"2024-09-10T05:11:33.744394+0000","last_became_peered":"2024-09-10T05:11:33.744394+0000","last_unstale":"2024-09-10T05:14:43.084121+0000","last_undegraded":"2024-09-10T05:14:43.084121+0000","last_fullsized":"2024-09-10T05:14:43.084121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:42.791441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959396+0000","last_change":"2024-09-10T05:11:35.750802+0000","last_active":"2024-09-10T05:12:04.959396+0000","last_peered":"2024-09-10T05:12:04.959396+0000","last_clean":"2024-09-10T05:12:04.959396+0000","last_became_active":"2024-09-10T05:11:35.750450+0000","last_became_peered":"2024-09-10T05:11:35.750450+0000","last_unstale":"2024-09-10T05:12:04.959396+0000","last_undegraded":"2024-09-10T05:12:04.959396+0000","last_fullsized":"2024-09-10T05:12:04.959396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:00.422593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'6","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.453623+0000","last_change":"2024-09-10T05:11:37.757621+0000","last_active":"2024-09-10T05:14:36.453623+0000","last_peered":"2024-09-10T05:14:36.453623+0000","last_clean":"2024-09-10T05:14:36.453623+0000","last_became_active":"2024-09-10T05:11:37.757289+0000","last_became_peered":"2024-09-10T05:11:37.757289+0000","last_unstale":"2024-09-10T05:14:36.453623+0000","last_undegraded":"2024-09-10T05:14:36.453623+0000","last_fullsized":"2024-09-10T05:14:36.453623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:57.261211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'8","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.043718+0000","last_change":"2024-09-10T05:15:16.043718+0000","last_active":"2024-09-10T05:15:16.043718+0000","last_peered":"2024-09-10T05:15:16.043718+0000","last_clean":"2024-09-10T05:15:16.043718+0000","last_became_active":"2024-09-10T05:11:29.734367+0000","last_became_peered":"2024-09-10T05:11:29.734367+0000","last_unstale":"2024-09-10T05:15:16.043718+0000","last_undegraded":"2024-09-10T05:15:16.043718+0000","last_fullsized":"2024-09-10T05:15:16.043718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:16.043611+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:16.043611+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.043611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:32.661692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":157,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:46.450464+0000","last_change":"2024-09-10T05:14:46.450393+0000","last_active":"2024-09-10T05:14:46.450464+0000","last_peered":"2024-09-10T05:14:46.450464+0000","last_clean":"2024-09-10T05:14:46.450464+0000","last_became_active":"2024-09-10T05:11:14.293121+0000","last_became_peered":"2024-09-10T05:11:14.293121+0000","last_unstale":"2024-09-10T05:14:46.450464+0000","last_undegraded":"2024-09-10T05:14:46.450464+0000","last_fullsized":"2024-09-10T05:14:46.450464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-10T05:14:46.450301+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-10T05:14:46.450301+0000","last_clean_scrub_stamp":"2024-09-10T05:14:46.450301+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:41.127694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.069728+0000","last_change":"2024-09-10T05:14:51.069657+0000","last_active":"2024-09-10T05:14:51.069728+0000","last_peered":"2024-09-10T05:14:51.069728+0000","last_clean":"2024-09-10T05:14:51.069728+0000","last_became_active":"2024-09-10T05:11:16.531926+0000","last_became_peered":"2024-09-10T05:11:16.531926+0000","last_unstale":"2024-09-10T05:14:51.069728+0000","last_undegraded":"2024-09-10T05:14:51.069728+0000","last_fullsized":"2024-09-10T05:14:51.069728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:51.069579+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:51.069579+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.069579+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:40.169755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001121101,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.034277+0000","last_change":"2024-09-10T05:14:52.034277+0000","last_active":"2024-09-10T05:14:52.034277+0000","last_peered":"2024-09-10T05:14:52.034277+0000","last_clean":"2024-09-10T05:14:52.034277+0000","last_became_active":"2024-09-10T05:11:27.735941+0000","last_became_peered":"2024-09-10T05:11:27.735941+0000","last_unstale":"2024-09-10T05:14:52.034277+0000","last_undegraded":"2024-09-10T05:14:52.034277+0000","last_fullsized":"2024-09-10T05:14:52.034277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.034181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.034181+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.034181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:53.640936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.297566+0000","last_change":"2024-09-10T05:15:20.297566+0000","last_active":"2024-09-10T05:15:20.297566+0000","last_peered":"2024-09-10T05:15:20.297566+0000","last_clean":"2024-09-10T05:15:20.297566+0000","last_became_active":"2024-09-10T05:11:31.736104+0000","last_became_peered":"2024-09-10T05:11:31.736104+0000","last_unstale":"2024-09-10T05:15:20.297566+0000","last_undegraded":"2024-09-10T05:15:20.297566+0000","last_fullsized":"2024-09-10T05:15:20.297566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:20.297474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:20.297474+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.297474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:10.972123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'94","reported_seq":182,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.117691+0000","last_change":"2024-09-10T05:11:33.744321+0000","last_active":"2024-09-10T05:14:43.117691+0000","last_peered":"2024-09-10T05:14:43.117691+0000","last_clean":"2024-09-10T05:14:43.117691+0000","last_became_active":"2024-09-10T05:11:33.743933+0000","last_became_peered":"2024-09-10T05:11:33.743933+0000","last_unstale":"2024-09-10T05:14:43.117691+0000","last_undegraded":"2024-09-10T05:14:43.117691+0000","last_fullsized":"2024-09-10T05:14:43.117691+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:30.903532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957924+0000","last_change":"2024-09-10T05:11:35.750549+0000","last_active":"2024-09-10T05:12:04.957924+0000","last_peered":"2024-09-10T05:12:04.957924+0000","last_clean":"2024-09-10T05:12:04.957924+0000","last_became_active":"2024-09-10T05:11:35.750248+0000","last_became_peered":"2024-09-10T05:11:35.750248+0000","last_unstale":"2024-09-10T05:12:04.957924+0000","last_undegraded":"2024-09-10T05:12:04.957924+0000","last_fullsized":"2024-09-10T05:12:04.957924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:19.363818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'85","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.427998+0000","last_change":"2024-09-10T05:11:37.755526+0000","last_active":"2024-09-10T05:14:36.427998+0000","last_peered":"2024-09-10T05:14:36.427998+0000","last_clean":"2024-09-10T05:14:36.427998+0000","last_became_active":"2024-09-10T05:11:37.755239+0000","last_became_peered":"2024-09-10T05:11:37.755239+0000","last_unstale":"2024-09-10T05:14:36.427998+0000","last_undegraded":"2024-09-10T05:14:36.427998+0000","last_fullsized":"2024-09-10T05:14:36.427998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:13.536289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.100459+0000","last_change":"2024-09-10T05:15:18.100459+0000","last_active":"2024-09-10T05:15:18.100459+0000","last_peered":"2024-09-10T05:15:18.100459+0000","last_clean":"2024-09-10T05:15:18.100459+0000","last_became_active":"2024-09-10T05:11:29.732560+0000","last_became_peered":"2024-09-10T05:11:29.732560+0000","last_unstale":"2024-09-10T05:15:18.100459+0000","last_undegraded":"2024-09-10T05:15:18.100459+0000","last_fullsized":"2024-09-10T05:15:18.100459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:18.100314+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:18.100314+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.100314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:05.619104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.116452+0000","last_change":"2024-09-10T05:14:48.116383+0000","last_active":"2024-09-10T05:14:48.116452+0000","last_peered":"2024-09-10T05:14:48.116452+0000","last_clean":"2024-09-10T05:14:48.116452+0000","last_became_active":"2024-09-10T05:11:16.531911+0000","last_became_peered":"2024-09-10T05:11:16.531911+0000","last_unstale":"2024-09-10T05:14:48.116452+0000","last_undegraded":"2024-09-10T05:14:48.116452+0000","last_fullsized":"2024-09-10T05:14:48.116452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.116290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.116290+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.116290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:40.342657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039105900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.545643+0000","last_change":"2024-09-10T05:14:48.545643+0000","last_active":"2024-09-10T05:14:48.545643+0000","last_peered":"2024-09-10T05:14:48.545643+0000","last_clean":"2024-09-10T05:14:48.545643+0000","last_became_active":"2024-09-10T05:11:27.713026+0000","last_became_peered":"2024-09-10T05:11:27.713026+0000","last_unstale":"2024-09-10T05:14:48.545643+0000","last_undegraded":"2024-09-10T05:14:48.545643+0000","last_fullsized":"2024-09-10T05:14:48.545643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:48.545569+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:48.545569+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.545569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:09.108323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961506+0000","last_change":"2024-09-10T05:11:31.738104+0000","last_active":"2024-09-10T05:12:04.961506+0000","last_peered":"2024-09-10T05:12:04.961506+0000","last_clean":"2024-09-10T05:12:04.961506+0000","last_became_active":"2024-09-10T05:11:31.737199+0000","last_became_peered":"2024-09-10T05:11:31.737199+0000","last_unstale":"2024-09-10T05:12:04.961506+0000","last_undegraded":"2024-09-10T05:12:04.961506+0000","last_fullsized":"2024-09-10T05:12:04.961506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:59:08.807684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'292","reported_seq":514,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.145377+0000","last_change":"2024-09-10T05:11:33.744372+0000","last_active":"2024-09-10T05:14:43.145377+0000","last_peered":"2024-09-10T05:14:43.145377+0000","last_clean":"2024-09-10T05:14:43.145377+0000","last_became_active":"2024-09-10T05:11:33.744103+0000","last_became_peered":"2024-09-10T05:11:33.744103+0000","last_unstale":"2024-09-10T05:14:43.145377+0000","last_undegraded":"2024-09-10T05:14:43.145377+0000","last_fullsized":"2024-09-10T05:14:43.145377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:33.869492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":393,"num_read_kb":395,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956847+0000","last_change":"2024-09-10T05:11:35.749117+0000","last_active":"2024-09-10T05:12:04.956847+0000","last_peered":"2024-09-10T05:12:04.956847+0000","last_clean":"2024-09-10T05:12:04.956847+0000","last_became_active":"2024-09-10T05:11:35.748767+0000","last_became_peered":"2024-09-10T05:11:35.748767+0000","last_unstale":"2024-09-10T05:12:04.956847+0000","last_undegraded":"2024-09-10T05:12:04.956847+0000","last_fullsized":"2024-09-10T05:12:04.956847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:24:02.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.966773+0000","last_change":"2024-09-10T05:11:37.758407+0000","last_active":"2024-09-10T05:12:51.966773+0000","last_peered":"2024-09-10T05:12:51.966773+0000","last_clean":"2024-09-10T05:12:51.966773+0000","last_became_active":"2024-09-10T05:11:37.758114+0000","last_became_peered":"2024-09-10T05:11:37.758114+0000","last_unstale":"2024-09-10T05:12:51.966773+0000","last_undegraded":"2024-09-10T05:12:51.966773+0000","last_fullsized":"2024-09-10T05:12:51.966773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:43.659998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'14","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.455496+0000","last_change":"2024-09-10T05:15:02.455496+0000","last_active":"2024-09-10T05:15:02.455496+0000","last_peered":"2024-09-10T05:15:02.455496+0000","last_clean":"2024-09-10T05:15:02.455496+0000","last_became_active":"2024-09-10T05:11:29.723609+0000","last_became_peered":"2024-09-10T05:11:29.723609+0000","last_unstale":"2024-09-10T05:15:02.455496+0000","last_undegraded":"2024-09-10T05:15:02.455496+0000","last_fullsized":"2024-09-10T05:15:02.455496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:02.455410+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:02.455410+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.455410+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:08.842470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.698496+0000","last_change":"2024-09-10T05:14:48.698433+0000","last_active":"2024-09-10T05:14:48.698496+0000","last_peered":"2024-09-10T05:14:48.698496+0000","last_clean":"2024-09-10T05:14:48.698496+0000","last_became_active":"2024-09-10T05:11:16.530448+0000","last_became_peered":"2024-09-10T05:11:16.530448+0000","last_unstale":"2024-09-10T05:14:48.698496+0000","last_undegraded":"2024-09-10T05:14:48.698496+0000","last_fullsized":"2024-09-10T05:14:48.698496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.698352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.698352+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.698352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:12.098710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036982300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'6","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.508513+0000","last_change":"2024-09-10T05:14:47.508513+0000","last_active":"2024-09-10T05:14:47.508513+0000","last_peered":"2024-09-10T05:14:47.508513+0000","last_clean":"2024-09-10T05:14:47.508513+0000","last_became_active":"2024-09-10T05:11:27.714299+0000","last_became_peered":"2024-09-10T05:11:27.714299+0000","last_unstale":"2024-09-10T05:14:47.508513+0000","last_undegraded":"2024-09-10T05:14:47.508513+0000","last_fullsized":"2024-09-10T05:14:47.508513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:14:47.508436+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:14:47.508436+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.508436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:06.719872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.693954+0000","last_change":"2024-09-10T05:15:15.693954+0000","last_active":"2024-09-10T05:15:15.693954+0000","last_peered":"2024-09-10T05:15:15.693954+0000","last_clean":"2024-09-10T05:15:15.693954+0000","last_became_active":"2024-09-10T05:11:31.730978+0000","last_became_peered":"2024-09-10T05:11:31.730978+0000","last_unstale":"2024-09-10T05:15:15.693954+0000","last_undegraded":"2024-09-10T05:15:15.693954+0000","last_fullsized":"2024-09-10T05:15:15.693954+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:15.693862+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:15.693862+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.693862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:07.673571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'25","reported_seq":101,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.710054+0000","last_change":"2024-09-10T05:15:23.710054+0000","last_active":"2024-09-10T05:15:23.710054+0000","last_peered":"2024-09-10T05:15:23.710054+0000","last_clean":"2024-09-10T05:15:23.710054+0000","last_became_active":"2024-09-10T05:11:33.746102+0000","last_became_peered":"2024-09-10T05:11:33.746102+0000","last_unstale":"2024-09-10T05:15:23.710054+0000","last_undegraded":"2024-09-10T05:15:23.710054+0000","last_fullsized":"2024-09-10T05:15:23.710054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'25","last_scrub_stamp":"2024-09-10T05:15:23.709956+0000","last_deep_scrub":"37'25","last_deep_scrub_stamp":"2024-09-10T05:15:23.709956+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.709956+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:03.932613+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957971+0000","last_change":"2024-09-10T05:11:35.753872+0000","last_active":"2024-09-10T05:12:04.957971+0000","last_peered":"2024-09-10T05:12:04.957971+0000","last_clean":"2024-09-10T05:12:04.957971+0000","last_became_active":"2024-09-10T05:11:35.753342+0000","last_became_peered":"2024-09-10T05:11:35.753342+0000","last_unstale":"2024-09-10T05:12:04.957971+0000","last_undegraded":"2024-09-10T05:12:04.957971+0000","last_fullsized":"2024-09-10T05:12:04.957971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:37.752504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955113+0000","last_change":"2024-09-10T05:11:37.769011+0000","last_active":"2024-09-10T05:12:04.955113+0000","last_peered":"2024-09-10T05:12:04.955113+0000","last_clean":"2024-09-10T05:12:04.955113+0000","last_became_active":"2024-09-10T05:11:37.767788+0000","last_became_peered":"2024-09-10T05:11:37.767788+0000","last_unstale":"2024-09-10T05:12:04.955113+0000","last_undegraded":"2024-09-10T05:12:04.955113+0000","last_fullsized":"2024-09-10T05:12:04.955113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:55.792983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.435853+0000","last_change":"2024-09-10T05:15:01.435853+0000","last_active":"2024-09-10T05:15:01.435853+0000","last_peered":"2024-09-10T05:15:01.435853+0000","last_clean":"2024-09-10T05:15:01.435853+0000","last_became_active":"2024-09-10T05:11:29.727022+0000","last_became_peered":"2024-09-10T05:11:29.727022+0000","last_unstale":"2024-09-10T05:15:01.435853+0000","last_undegraded":"2024-09-10T05:15:01.435853+0000","last_fullsized":"2024-09-10T05:15:01.435853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:01.435758+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:01.435758+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.435758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:15.080229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.096802+0000","last_change":"2024-09-10T05:14:49.096748+0000","last_active":"2024-09-10T05:14:49.096802+0000","last_peered":"2024-09-10T05:14:49.096802+0000","last_clean":"2024-09-10T05:14:49.096802+0000","last_became_active":"2024-09-10T05:11:16.530756+0000","last_became_peered":"2024-09-10T05:11:16.530756+0000","last_unstale":"2024-09-10T05:14:49.096802+0000","last_undegraded":"2024-09-10T05:14:49.096802+0000","last_fullsized":"2024-09-10T05:14:49.096802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:14:49.096654+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:14:49.096654+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.096654+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:56.602270+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001047784,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.744764+0000","last_change":"2024-09-10T05:14:47.744764+0000","last_active":"2024-09-10T05:14:47.744764+0000","last_peered":"2024-09-10T05:14:47.744764+0000","last_clean":"2024-09-10T05:14:47.744764+0000","last_became_active":"2024-09-10T05:11:27.718333+0000","last_became_peered":"2024-09-10T05:11:27.718333+0000","last_unstale":"2024-09-10T05:14:47.744764+0000","last_undegraded":"2024-09-10T05:14:47.744764+0000","last_fullsized":"2024-09-10T05:14:47.744764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:47.744665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:47.744665+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.744665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:14.527839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.760190+0000","last_change":"2024-09-10T05:15:12.760190+0000","last_active":"2024-09-10T05:15:12.760190+0000","last_peered":"2024-09-10T05:15:12.760190+0000","last_clean":"2024-09-10T05:15:12.760190+0000","last_became_active":"2024-09-10T05:12:04.964996+0000","last_became_peered":"2024-09-10T05:12:04.964996+0000","last_unstale":"2024-09-10T05:15:12.760190+0000","last_undegraded":"2024-09-10T05:15:12.760190+0000","last_fullsized":"2024-09-10T05:15:12.760190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:12.760098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:12.760098+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.760098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:29.723294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"37'13","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.691724+0000","last_change":"2024-09-10T05:11:33.743920+0000","last_active":"2024-09-10T05:14:35.691724+0000","last_peered":"2024-09-10T05:14:35.691724+0000","last_clean":"2024-09-10T05:14:35.691724+0000","last_became_active":"2024-09-10T05:11:33.743292+0000","last_became_peered":"2024-09-10T05:11:33.743292+0000","last_unstale":"2024-09-10T05:14:35.691724+0000","last_undegraded":"2024-09-10T05:14:35.691724+0000","last_fullsized":"2024-09-10T05:14:35.691724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:18.442235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960791+0000","last_change":"2024-09-10T05:11:35.752348+0000","last_active":"2024-09-10T05:12:04.960791+0000","last_peered":"2024-09-10T05:12:04.960791+0000","last_clean":"2024-09-10T05:12:04.960791+0000","last_became_active":"2024-09-10T05:11:35.751982+0000","last_became_peered":"2024-09-10T05:11:35.751982+0000","last_unstale":"2024-09-10T05:12:04.960791+0000","last_undegraded":"2024-09-10T05:12:04.960791+0000","last_fullsized":"2024-09-10T05:12:04.960791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:53.013137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.434600+0000","last_change":"2024-09-10T05:11:37.762596+0000","last_active":"2024-09-10T05:13:35.434600+0000","last_peered":"2024-09-10T05:13:35.434600+0000","last_clean":"2024-09-10T05:13:35.434600+0000","last_became_active":"2024-09-10T05:11:37.762327+0000","last_became_peered":"2024-09-10T05:11:37.762327+0000","last_unstale":"2024-09-10T05:13:35.434600+0000","last_undegraded":"2024-09-10T05:13:35.434600+0000","last_fullsized":"2024-09-10T05:13:35.434600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:33.354245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'16","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.437426+0000","last_change":"2024-09-10T05:15:00.437426+0000","last_active":"2024-09-10T05:15:00.437426+0000","last_peered":"2024-09-10T05:15:00.437426+0000","last_clean":"2024-09-10T05:15:00.437426+0000","last_became_active":"2024-09-10T05:11:29.730589+0000","last_became_peered":"2024-09-10T05:11:29.730589+0000","last_unstale":"2024-09-10T05:15:00.437426+0000","last_undegraded":"2024-09-10T05:15:00.437426+0000","last_fullsized":"2024-09-10T05:15:00.437426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:00.437305+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:00.437305+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.437305+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:23:10.739442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.660336+0000","last_change":"2024-09-10T05:14:49.660336+0000","last_active":"2024-09-10T05:14:49.660336+0000","last_peered":"2024-09-10T05:14:49.660336+0000","last_clean":"2024-09-10T05:14:49.660336+0000","last_became_active":"2024-09-10T05:11:27.716023+0000","last_became_peered":"2024-09-10T05:11:27.716023+0000","last_unstale":"2024-09-10T05:14:49.660336+0000","last_undegraded":"2024-09-10T05:14:49.660336+0000","last_fullsized":"2024-09-10T05:14:49.660336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:49.660254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:49.660254+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.660254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:37.581398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:46.486459+0000","last_change":"2024-09-10T05:14:46.486459+0000","last_active":"2024-09-10T05:14:46.486459+0000","last_peered":"2024-09-10T05:14:46.486459+0000","last_clean":"2024-09-10T05:14:46.486459+0000","last_became_active":"2024-09-10T05:11:16.532795+0000","last_became_peered":"2024-09-10T05:11:16.532795+0000","last_unstale":"2024-09-10T05:14:46.486459+0000","last_undegraded":"2024-09-10T05:14:46.486459+0000","last_fullsized":"2024-09-10T05:14:46.486459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:46.486390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:46.486390+0000","last_clean_scrub_stamp":"2024-09-10T05:14:46.486390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:24.690009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060128199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.692271+0000","last_change":"2024-09-10T05:15:17.692271+0000","last_active":"2024-09-10T05:15:17.692271+0000","last_peered":"2024-09-10T05:15:17.692271+0000","last_clean":"2024-09-10T05:15:17.692271+0000","last_became_active":"2024-09-10T05:11:31.734707+0000","last_became_peered":"2024-09-10T05:11:31.734707+0000","last_unstale":"2024-09-10T05:15:17.692271+0000","last_undegraded":"2024-09-10T05:15:17.692271+0000","last_fullsized":"2024-09-10T05:15:17.692271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:17.692187+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:17.692187+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.692187+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:34:44.621445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'90","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.758130+0000","last_change":"2024-09-10T05:15:22.758130+0000","last_active":"2024-09-10T05:15:22.758130+0000","last_peered":"2024-09-10T05:15:22.758130+0000","last_clean":"2024-09-10T05:15:22.758130+0000","last_became_active":"2024-09-10T05:11:33.743238+0000","last_became_peered":"2024-09-10T05:11:33.743238+0000","last_unstale":"2024-09-10T05:15:22.758130+0000","last_undegraded":"2024-09-10T05:15:22.758130+0000","last_fullsized":"2024-09-10T05:15:22.758130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'90","last_scrub_stamp":"2024-09-10T05:15:22.758015+0000","last_deep_scrub":"37'90","last_deep_scrub_stamp":"2024-09-10T05:15:22.758015+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.758015+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:54:47.346297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957685+0000","last_change":"2024-09-10T05:11:35.751255+0000","last_active":"2024-09-10T05:12:04.957685+0000","last_peered":"2024-09-10T05:12:04.957685+0000","last_clean":"2024-09-10T05:12:04.957685+0000","last_became_active":"2024-09-10T05:11:35.750830+0000","last_became_peered":"2024-09-10T05:11:35.750830+0000","last_unstale":"2024-09-10T05:12:04.957685+0000","last_undegraded":"2024-09-10T05:12:04.957685+0000","last_fullsized":"2024-09-10T05:12:04.957685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:07.959084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.612283+0000","last_change":"2024-09-10T05:11:37.759212+0000","last_active":"2024-09-10T05:13:35.612283+0000","last_peered":"2024-09-10T05:13:35.612283+0000","last_clean":"2024-09-10T05:13:35.612283+0000","last_became_active":"2024-09-10T05:11:37.758971+0000","last_became_peered":"2024-09-10T05:11:37.758971+0000","last_unstale":"2024-09-10T05:13:35.612283+0000","last_undegraded":"2024-09-10T05:13:35.612283+0000","last_fullsized":"2024-09-10T05:13:35.612283+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:10.652277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'14","reported_seq":90,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.389613+0000","last_change":"2024-09-10T05:15:01.389613+0000","last_active":"2024-09-10T05:15:01.389613+0000","last_peered":"2024-09-10T05:15:01.389613+0000","last_clean":"2024-09-10T05:15:01.389613+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:15:01.389613+0000","last_undegraded":"2024-09-10T05:15:01.389613+0000","last_fullsized":"2024-09-10T05:15:01.389613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:01.389524+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:01.389524+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.389524+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:15.262748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.500467+0000","last_change":"2024-09-10T05:14:50.500467+0000","last_active":"2024-09-10T05:14:50.500467+0000","last_peered":"2024-09-10T05:14:50.500467+0000","last_clean":"2024-09-10T05:14:50.500467+0000","last_became_active":"2024-09-10T05:11:27.718756+0000","last_became_peered":"2024-09-10T05:11:27.718756+0000","last_unstale":"2024-09-10T05:14:50.500467+0000","last_undegraded":"2024-09-10T05:14:50.500467+0000","last_fullsized":"2024-09-10T05:14:50.500467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.500341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.500341+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.500341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:21.655128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.083367+0000","last_change":"2024-09-10T05:14:50.083297+0000","last_active":"2024-09-10T05:14:50.083367+0000","last_peered":"2024-09-10T05:14:50.083367+0000","last_clean":"2024-09-10T05:14:50.083367+0000","last_became_active":"2024-09-10T05:11:16.530746+0000","last_became_peered":"2024-09-10T05:11:16.530746+0000","last_unstale":"2024-09-10T05:14:50.083367+0000","last_undegraded":"2024-09-10T05:14:50.083367+0000","last_fullsized":"2024-09-10T05:14:50.083367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.083200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.083200+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.083200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:05.779343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048256999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955118+0000","last_change":"2024-09-10T05:11:31.734598+0000","last_active":"2024-09-10T05:12:04.955118+0000","last_peered":"2024-09-10T05:12:04.955118+0000","last_clean":"2024-09-10T05:12:04.955118+0000","last_became_active":"2024-09-10T05:11:31.734333+0000","last_became_peered":"2024-09-10T05:11:31.734333+0000","last_unstale":"2024-09-10T05:12:04.955118+0000","last_undegraded":"2024-09-10T05:12:04.955118+0000","last_fullsized":"2024-09-10T05:12:04.955118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:04.362140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'21","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958360+0000","last_change":"2024-09-10T05:11:33.744326+0000","last_active":"2024-09-10T05:12:04.958360+0000","last_peered":"2024-09-10T05:12:04.958360+0000","last_clean":"2024-09-10T05:12:04.958360+0000","last_became_active":"2024-09-10T05:11:33.744011+0000","last_became_peered":"2024-09-10T05:11:33.744011+0000","last_unstale":"2024-09-10T05:12:04.958360+0000","last_undegraded":"2024-09-10T05:12:04.958360+0000","last_fullsized":"2024-09-10T05:12:04.958360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:25:21.898677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'285","reported_seq":349,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.003922+0000","last_change":"2024-09-10T05:11:35.743851+0000","last_active":"2024-09-10T05:14:43.003922+0000","last_peered":"2024-09-10T05:14:43.003922+0000","last_clean":"2024-09-10T05:14:43.003922+0000","last_became_active":"2024-09-10T05:11:35.743571+0000","last_became_peered":"2024-09-10T05:11:35.743571+0000","last_unstale":"2024-09-10T05:14:43.003922+0000","last_undegraded":"2024-09-10T05:14:43.003922+0000","last_fullsized":"2024-09-10T05:14:43.003922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.416572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.602302+0000","last_change":"2024-09-10T05:11:37.764931+0000","last_active":"2024-09-10T05:13:32.602302+0000","last_peered":"2024-09-10T05:13:32.602302+0000","last_clean":"2024-09-10T05:13:32.602302+0000","last_became_active":"2024-09-10T05:11:37.764657+0000","last_became_peered":"2024-09-10T05:11:37.764657+0000","last_unstale":"2024-09-10T05:13:32.602302+0000","last_undegraded":"2024-09-10T05:13:32.602302+0000","last_fullsized":"2024-09-10T05:13:32.602302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:33.836899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.068949+0000","last_change":"2024-09-10T05:15:17.068949+0000","last_active":"2024-09-10T05:15:17.068949+0000","last_peered":"2024-09-10T05:15:17.068949+0000","last_clean":"2024-09-10T05:15:17.068949+0000","last_became_active":"2024-09-10T05:11:29.734731+0000","last_became_peered":"2024-09-10T05:11:29.734731+0000","last_unstale":"2024-09-10T05:15:17.068949+0000","last_undegraded":"2024-09-10T05:15:17.068949+0000","last_fullsized":"2024-09-10T05:15:17.068949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:17.068869+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:17.068869+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.068869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:24.980749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.997163+0000","last_change":"2024-09-10T05:14:53.997163+0000","last_active":"2024-09-10T05:14:53.997163+0000","last_peered":"2024-09-10T05:14:53.997163+0000","last_clean":"2024-09-10T05:14:53.997163+0000","last_became_active":"2024-09-10T05:11:27.723268+0000","last_became_peered":"2024-09-10T05:11:27.723268+0000","last_unstale":"2024-09-10T05:14:53.997163+0000","last_undegraded":"2024-09-10T05:14:53.997163+0000","last_fullsized":"2024-09-10T05:14:53.997163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.997077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.997077+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.997077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:30.512459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.499227+0000","last_change":"2024-09-10T05:14:53.499227+0000","last_active":"2024-09-10T05:14:53.499227+0000","last_peered":"2024-09-10T05:14:53.499227+0000","last_clean":"2024-09-10T05:14:53.499227+0000","last_became_active":"2024-09-10T05:11:16.531550+0000","last_became_peered":"2024-09-10T05:11:16.531550+0000","last_unstale":"2024-09-10T05:14:53.499227+0000","last_undegraded":"2024-09-10T05:14:53.499227+0000","last_fullsized":"2024-09-10T05:14:53.499227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.499101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.499101+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.499101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:59:02.083006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00063503699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955664+0000","last_change":"2024-09-10T05:11:31.734677+0000","last_active":"2024-09-10T05:12:04.955664+0000","last_peered":"2024-09-10T05:12:04.955664+0000","last_clean":"2024-09-10T05:12:04.955664+0000","last_became_active":"2024-09-10T05:11:31.734310+0000","last_became_peered":"2024-09-10T05:11:31.734310+0000","last_unstale":"2024-09-10T05:12:04.955664+0000","last_undegraded":"2024-09-10T05:12:04.955664+0000","last_fullsized":"2024-09-10T05:12:04.955664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:04.152181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'17","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.669838+0000","last_change":"2024-09-10T05:11:33.748918+0000","last_active":"2024-09-10T05:12:09.669838+0000","last_peered":"2024-09-10T05:12:09.669838+0000","last_clean":"2024-09-10T05:12:09.669838+0000","last_became_active":"2024-09-10T05:11:33.748603+0000","last_became_peered":"2024-09-10T05:11:33.748603+0000","last_unstale":"2024-09-10T05:12:09.669838+0000","last_undegraded":"2024-09-10T05:12:09.669838+0000","last_fullsized":"2024-09-10T05:12:09.669838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:30.495078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":392,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.009007+0000","last_change":"2024-09-10T05:11:35.746066+0000","last_active":"2024-09-10T05:14:43.009007+0000","last_peered":"2024-09-10T05:14:43.009007+0000","last_clean":"2024-09-10T05:14:43.009007+0000","last_became_active":"2024-09-10T05:11:35.745807+0000","last_became_peered":"2024-09-10T05:11:35.745807+0000","last_unstale":"2024-09-10T05:14:43.009007+0000","last_undegraded":"2024-09-10T05:14:43.009007+0000","last_fullsized":"2024-09-10T05:14:43.009007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:15.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960007+0000","last_change":"2024-09-10T05:11:37.762669+0000","last_active":"2024-09-10T05:12:04.960007+0000","last_peered":"2024-09-10T05:12:04.960007+0000","last_clean":"2024-09-10T05:12:04.960007+0000","last_became_active":"2024-09-10T05:11:37.762407+0000","last_became_peered":"2024-09-10T05:11:37.762407+0000","last_unstale":"2024-09-10T05:12:04.960007+0000","last_undegraded":"2024-09-10T05:12:04.960007+0000","last_fullsized":"2024-09-10T05:12:04.960007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:01.260628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.609389+0000","last_change":"2024-09-10T05:15:03.609389+0000","last_active":"2024-09-10T05:15:03.609389+0000","last_peered":"2024-09-10T05:15:03.609389+0000","last_clean":"2024-09-10T05:15:03.609389+0000","last_became_active":"2024-09-10T05:11:29.730285+0000","last_became_peered":"2024-09-10T05:11:29.730285+0000","last_unstale":"2024-09-10T05:15:03.609389+0000","last_undegraded":"2024-09-10T05:15:03.609389+0000","last_fullsized":"2024-09-10T05:15:03.609389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.609295+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.609295+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.609295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:48.096904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.429038+0000","last_change":"2024-09-10T05:14:47.429038+0000","last_active":"2024-09-10T05:14:47.429038+0000","last_peered":"2024-09-10T05:14:47.429038+0000","last_clean":"2024-09-10T05:14:47.429038+0000","last_became_active":"2024-09-10T05:11:27.731108+0000","last_became_peered":"2024-09-10T05:11:27.731108+0000","last_unstale":"2024-09-10T05:14:47.429038+0000","last_undegraded":"2024-09-10T05:14:47.429038+0000","last_fullsized":"2024-09-10T05:14:47.429038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:47.428954+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:47.428954+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.428954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:33.646520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.995705+0000","last_change":"2024-09-10T05:14:52.995705+0000","last_active":"2024-09-10T05:14:52.995705+0000","last_peered":"2024-09-10T05:14:52.995705+0000","last_clean":"2024-09-10T05:14:52.995705+0000","last_became_active":"2024-09-10T05:11:16.531468+0000","last_became_peered":"2024-09-10T05:11:16.531468+0000","last_unstale":"2024-09-10T05:14:52.995705+0000","last_undegraded":"2024-09-10T05:14:52.995705+0000","last_fullsized":"2024-09-10T05:14:52.995705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.995618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.995618+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.995618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:43.970590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001329722,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:31.733033+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:31.732753+0000","last_became_peered":"2024-09-10T05:11:31.732753+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:51.417779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'106","reported_seq":205,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.713723+0000","last_change":"2024-09-10T05:15:21.713723+0000","last_active":"2024-09-10T05:15:21.713723+0000","last_peered":"2024-09-10T05:15:21.713723+0000","last_clean":"2024-09-10T05:15:21.713723+0000","last_became_active":"2024-09-10T05:11:33.744217+0000","last_became_peered":"2024-09-10T05:11:33.744217+0000","last_unstale":"2024-09-10T05:15:21.713723+0000","last_undegraded":"2024-09-10T05:15:21.713723+0000","last_fullsized":"2024-09-10T05:15:21.713723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'106","last_scrub_stamp":"2024-09-10T05:15:21.713617+0000","last_deep_scrub":"37'106","last_deep_scrub_stamp":"2024-09-10T05:15:21.713617+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.713617+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:18.813436+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957339+0000","last_change":"2024-09-10T05:11:35.748212+0000","last_active":"2024-09-10T05:12:04.957339+0000","last_peered":"2024-09-10T05:12:04.957339+0000","last_clean":"2024-09-10T05:12:04.957339+0000","last_became_active":"2024-09-10T05:11:35.747924+0000","last_became_peered":"2024-09-10T05:11:35.747924+0000","last_unstale":"2024-09-10T05:12:04.957339+0000","last_undegraded":"2024-09-10T05:12:04.957339+0000","last_fullsized":"2024-09-10T05:12:04.957339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:15.162433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961201+0000","last_change":"2024-09-10T05:11:37.758521+0000","last_active":"2024-09-10T05:12:04.961201+0000","last_peered":"2024-09-10T05:12:04.961201+0000","last_clean":"2024-09-10T05:12:04.961201+0000","last_became_active":"2024-09-10T05:11:37.757947+0000","last_became_peered":"2024-09-10T05:11:37.757947+0000","last_unstale":"2024-09-10T05:12:04.961201+0000","last_undegraded":"2024-09-10T05:12:04.961201+0000","last_fullsized":"2024-09-10T05:12:04.961201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:42.540458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:52.143036+0000","last_change":"2024-09-10T05:11:37.759509+0000","last_active":"2024-09-10T05:12:52.143036+0000","last_peered":"2024-09-10T05:12:52.143036+0000","last_clean":"2024-09-10T05:12:52.143036+0000","last_became_active":"2024-09-10T05:11:37.759217+0000","last_became_peered":"2024-09-10T05:11:37.759217+0000","last_unstale":"2024-09-10T05:12:52.143036+0000","last_undegraded":"2024-09-10T05:12:52.143036+0000","last_fullsized":"2024-09-10T05:12:52.143036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:30.264676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'12","reported_seq":90,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:06.623135+0000","last_change":"2024-09-10T05:15:06.623135+0000","last_active":"2024-09-10T05:15:06.623135+0000","last_peered":"2024-09-10T05:15:06.623135+0000","last_clean":"2024-09-10T05:15:06.623135+0000","last_became_active":"2024-09-10T05:11:29.730105+0000","last_became_peered":"2024-09-10T05:11:29.730105+0000","last_unstale":"2024-09-10T05:15:06.623135+0000","last_undegraded":"2024-09-10T05:15:06.623135+0000","last_fullsized":"2024-09-10T05:15:06.623135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-10T05:15:06.623056+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-10T05:15:06.623056+0000","last_clean_scrub_stamp":"2024-09-10T05:15:06.623056+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:01.300449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.953621+0000","last_change":"2024-09-10T05:15:00.953621+0000","last_active":"2024-09-10T05:15:00.953621+0000","last_peered":"2024-09-10T05:15:00.953621+0000","last_clean":"2024-09-10T05:15:00.953621+0000","last_became_active":"2024-09-10T05:11:27.731634+0000","last_became_peered":"2024-09-10T05:11:27.731634+0000","last_unstale":"2024-09-10T05:15:00.953621+0000","last_undegraded":"2024-09-10T05:15:00.953621+0000","last_fullsized":"2024-09-10T05:15:00.953621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:00.953536+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:00.953536+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.953536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.954553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.266780+0000","last_change":"2024-09-10T05:15:23.266780+0000","last_active":"2024-09-10T05:15:23.266780+0000","last_peered":"2024-09-10T05:15:23.266780+0000","last_clean":"2024-09-10T05:15:23.266780+0000","last_became_active":"2024-09-10T05:12:04.967513+0000","last_became_peered":"2024-09-10T05:12:04.967513+0000","last_unstale":"2024-09-10T05:15:23.266780+0000","last_undegraded":"2024-09-10T05:15:23.266780+0000","last_fullsized":"2024-09-10T05:15:23.266780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:23.266688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:23.266688+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.266688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:14:49.877447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'42","reported_seq":96,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.095775+0000","last_change":"2024-09-10T05:11:33.745631+0000","last_active":"2024-09-10T05:14:43.095775+0000","last_peered":"2024-09-10T05:14:43.095775+0000","last_clean":"2024-09-10T05:14:43.095775+0000","last_became_active":"2024-09-10T05:11:33.745347+0000","last_became_peered":"2024-09-10T05:11:33.745347+0000","last_unstale":"2024-09-10T05:14:43.095775+0000","last_undegraded":"2024-09-10T05:14:43.095775+0000","last_fullsized":"2024-09-10T05:14:43.095775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:36.538308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954872+0000","last_change":"2024-09-10T05:11:35.754614+0000","last_active":"2024-09-10T05:12:04.954872+0000","last_peered":"2024-09-10T05:12:04.954872+0000","last_clean":"2024-09-10T05:12:04.954872+0000","last_became_active":"2024-09-10T05:11:35.754318+0000","last_became_peered":"2024-09-10T05:11:35.754318+0000","last_unstale":"2024-09-10T05:12:04.954872+0000","last_undegraded":"2024-09-10T05:12:04.954872+0000","last_fullsized":"2024-09-10T05:12:04.954872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:32.929275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:33.971128+0000","last_change":"2024-09-10T05:11:37.760662+0000","last_active":"2024-09-10T05:13:33.971128+0000","last_peered":"2024-09-10T05:13:33.971128+0000","last_clean":"2024-09-10T05:13:33.971128+0000","last_became_active":"2024-09-10T05:11:37.760471+0000","last_became_peered":"2024-09-10T05:11:37.760471+0000","last_unstale":"2024-09-10T05:13:33.971128+0000","last_undegraded":"2024-09-10T05:13:33.971128+0000","last_fullsized":"2024-09-10T05:13:33.971128+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:16.361621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:06.365828+0000","last_change":"2024-09-10T05:15:06.365828+0000","last_active":"2024-09-10T05:15:06.365828+0000","last_peered":"2024-09-10T05:15:06.365828+0000","last_clean":"2024-09-10T05:15:06.365828+0000","last_became_active":"2024-09-10T05:11:29.727550+0000","last_became_peered":"2024-09-10T05:11:29.727550+0000","last_unstale":"2024-09-10T05:15:06.365828+0000","last_undegraded":"2024-09-10T05:15:06.365828+0000","last_fullsized":"2024-09-10T05:15:06.365828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:06.365720+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:06.365720+0000","last_clean_scrub_stamp":"2024-09-10T05:15:06.365720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:23.986492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.731049+0000","last_change":"2024-09-10T05:14:51.731049+0000","last_active":"2024-09-10T05:14:51.731049+0000","last_peered":"2024-09-10T05:14:51.731049+0000","last_clean":"2024-09-10T05:14:51.731049+0000","last_became_active":"2024-09-10T05:11:27.724637+0000","last_became_peered":"2024-09-10T05:11:27.724637+0000","last_unstale":"2024-09-10T05:14:51.731049+0000","last_undegraded":"2024-09-10T05:14:51.731049+0000","last_fullsized":"2024-09-10T05:14:51.731049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:51.730965+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:51.730965+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.730965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:07.979601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956587+0000","last_change":"2024-09-10T05:11:31.737152+0000","last_active":"2024-09-10T05:12:04.956587+0000","last_peered":"2024-09-10T05:12:04.956587+0000","last_clean":"2024-09-10T05:12:04.956587+0000","last_became_active":"2024-09-10T05:11:31.736758+0000","last_became_peered":"2024-09-10T05:11:31.736758+0000","last_unstale":"2024-09-10T05:12:04.956587+0000","last_undegraded":"2024-09-10T05:12:04.956587+0000","last_fullsized":"2024-09-10T05:12:04.956587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:07.236386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'9","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.744425+0000","last_change":"2024-09-10T05:15:23.744425+0000","last_active":"2024-09-10T05:15:23.744425+0000","last_peered":"2024-09-10T05:15:23.744425+0000","last_clean":"2024-09-10T05:15:23.744425+0000","last_became_active":"2024-09-10T05:11:33.742039+0000","last_became_peered":"2024-09-10T05:11:33.742039+0000","last_unstale":"2024-09-10T05:15:23.744425+0000","last_undegraded":"2024-09-10T05:15:23.744425+0000","last_fullsized":"2024-09-10T05:15:23.744425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-10T05:15:23.744296+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-10T05:15:23.744296+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.744296+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:24:56.856947+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956813+0000","last_change":"2024-09-10T05:11:35.751536+0000","last_active":"2024-09-10T05:12:04.956813+0000","last_peered":"2024-09-10T05:12:04.956813+0000","last_clean":"2024-09-10T05:12:04.956813+0000","last_became_active":"2024-09-10T05:11:35.751244+0000","last_became_peered":"2024-09-10T05:11:35.751244+0000","last_unstale":"2024-09-10T05:12:04.956813+0000","last_undegraded":"2024-09-10T05:12:04.956813+0000","last_fullsized":"2024-09-10T05:12:04.956813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.673711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.676093+0000","last_change":"2024-09-10T05:11:37.755735+0000","last_active":"2024-09-10T05:13:35.676093+0000","last_peered":"2024-09-10T05:13:35.676093+0000","last_clean":"2024-09-10T05:13:35.676093+0000","last_became_active":"2024-09-10T05:11:37.755533+0000","last_became_peered":"2024-09-10T05:11:37.755533+0000","last_unstale":"2024-09-10T05:13:35.676093+0000","last_undegraded":"2024-09-10T05:13:35.676093+0000","last_fullsized":"2024-09-10T05:13:35.676093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:37.895455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.660492+0000","last_change":"2024-09-10T05:15:12.660492+0000","last_active":"2024-09-10T05:15:12.660492+0000","last_peered":"2024-09-10T05:15:12.660492+0000","last_clean":"2024-09-10T05:15:12.660492+0000","last_became_active":"2024-09-10T05:11:29.727400+0000","last_became_peered":"2024-09-10T05:11:29.727400+0000","last_unstale":"2024-09-10T05:15:12.660492+0000","last_undegraded":"2024-09-10T05:15:12.660492+0000","last_fullsized":"2024-09-10T05:15:12.660492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:12.660389+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:12.660389+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.660389+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:36.645663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.665768+0000","last_change":"2024-09-10T05:14:55.665768+0000","last_active":"2024-09-10T05:14:55.665768+0000","last_peered":"2024-09-10T05:14:55.665768+0000","last_clean":"2024-09-10T05:14:55.665768+0000","last_became_active":"2024-09-10T05:11:27.727561+0000","last_became_peered":"2024-09-10T05:11:27.727561+0000","last_unstale":"2024-09-10T05:14:55.665768+0000","last_undegraded":"2024-09-10T05:14:55.665768+0000","last_fullsized":"2024-09-10T05:14:55.665768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:55.665677+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:55.665677+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.665677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:14.595232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"37'2","reported_seq":230,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.691856+0000","last_change":"2024-09-10T05:15:17.691856+0000","last_active":"2024-09-10T05:15:17.691856+0000","last_peered":"2024-09-10T05:15:17.691856+0000","last_clean":"2024-09-10T05:15:17.691856+0000","last_became_active":"2024-09-10T05:11:31.733793+0000","last_became_peered":"2024-09-10T05:11:31.733793+0000","last_unstale":"2024-09-10T05:15:17.691856+0000","last_undegraded":"2024-09-10T05:15:17.691856+0000","last_fullsized":"2024-09-10T05:15:17.691856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:17.691774+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:17.691774+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.691774+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:00.262242+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'45","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.063098+0000","last_change":"2024-09-10T05:11:33.744948+0000","last_active":"2024-09-10T05:14:43.063098+0000","last_peered":"2024-09-10T05:14:43.063098+0000","last_clean":"2024-09-10T05:14:43.063098+0000","last_became_active":"2024-09-10T05:11:33.744634+0000","last_became_peered":"2024-09-10T05:11:33.744634+0000","last_unstale":"2024-09-10T05:14:43.063098+0000","last_undegraded":"2024-09-10T05:14:43.063098+0000","last_fullsized":"2024-09-10T05:14:43.063098+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:09.908383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.959076+0000","last_change":"2024-09-10T05:11:35.748666+0000","last_active":"2024-09-10T05:12:04.959076+0000","last_peered":"2024-09-10T05:12:04.959076+0000","last_clean":"2024-09-10T05:12:04.959076+0000","last_became_active":"2024-09-10T05:11:35.748406+0000","last_became_peered":"2024-09-10T05:11:35.748406+0000","last_unstale":"2024-09-10T05:12:04.959076+0000","last_undegraded":"2024-09-10T05:12:04.959076+0000","last_fullsized":"2024-09-10T05:12:04.959076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:01.833099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.370496+0000","last_change":"2024-09-10T05:11:37.765627+0000","last_active":"2024-09-10T05:14:36.370496+0000","last_peered":"2024-09-10T05:14:36.370496+0000","last_clean":"2024-09-10T05:14:36.370496+0000","last_became_active":"2024-09-10T05:11:37.765188+0000","last_became_peered":"2024-09-10T05:11:37.765188+0000","last_unstale":"2024-09-10T05:14:36.370496+0000","last_undegraded":"2024-09-10T05:14:36.370496+0000","last_fullsized":"2024-09-10T05:14:36.370496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:35.729959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.025498+0000","last_change":"2024-09-10T05:15:21.025498+0000","last_active":"2024-09-10T05:15:21.025498+0000","last_peered":"2024-09-10T05:15:21.025498+0000","last_clean":"2024-09-10T05:15:21.025498+0000","last_became_active":"2024-09-10T05:11:29.735101+0000","last_became_peered":"2024-09-10T05:11:29.735101+0000","last_unstale":"2024-09-10T05:15:21.025498+0000","last_undegraded":"2024-09-10T05:15:21.025498+0000","last_fullsized":"2024-09-10T05:15:21.025498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:21.025412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:21.025412+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.025412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:22.721305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.411020+0000","last_change":"2024-09-10T05:14:50.411020+0000","last_active":"2024-09-10T05:14:50.411020+0000","last_peered":"2024-09-10T05:14:50.411020+0000","last_clean":"2024-09-10T05:14:50.411020+0000","last_became_active":"2024-09-10T05:11:27.715729+0000","last_became_peered":"2024-09-10T05:11:27.715729+0000","last_unstale":"2024-09-10T05:14:50.411020+0000","last_undegraded":"2024-09-10T05:14:50.411020+0000","last_fullsized":"2024-09-10T05:14:50.411020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.410933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.410933+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.410933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:35.070195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954515+0000","last_change":"2024-09-10T05:11:31.732767+0000","last_active":"2024-09-10T05:12:04.954515+0000","last_peered":"2024-09-10T05:12:04.954515+0000","last_clean":"2024-09-10T05:12:04.954515+0000","last_became_active":"2024-09-10T05:11:31.732476+0000","last_became_peered":"2024-09-10T05:11:31.732476+0000","last_unstale":"2024-09-10T05:12:04.954515+0000","last_undegraded":"2024-09-10T05:12:04.954515+0000","last_fullsized":"2024-09-10T05:12:04.954515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:22.178149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'38","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:25.695074+0000","last_change":"2024-09-10T05:15:25.695074+0000","last_active":"2024-09-10T05:15:25.695074+0000","last_peered":"2024-09-10T05:15:25.695074+0000","last_clean":"2024-09-10T05:15:25.695074+0000","last_became_active":"2024-09-10T05:11:33.740483+0000","last_became_peered":"2024-09-10T05:11:33.740483+0000","last_unstale":"2024-09-10T05:15:25.695074+0000","last_undegraded":"2024-09-10T05:15:25.695074+0000","last_fullsized":"2024-09-10T05:15:25.695074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-10T05:15:25.694982+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-10T05:15:25.694982+0000","last_clean_scrub_stamp":"2024-09-10T05:15:25.694982+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:43.315754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960060+0000","last_change":"2024-09-10T05:11:35.746206+0000","last_active":"2024-09-10T05:12:04.960060+0000","last_peered":"2024-09-10T05:12:04.960060+0000","last_clean":"2024-09-10T05:12:04.960060+0000","last_became_active":"2024-09-10T05:11:35.745886+0000","last_became_peered":"2024-09-10T05:11:35.745886+0000","last_unstale":"2024-09-10T05:12:04.960060+0000","last_undegraded":"2024-09-10T05:12:04.960060+0000","last_fullsized":"2024-09-10T05:12:04.960060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:38.963303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.109858+0000","last_change":"2024-09-10T05:11:29.732079+0000","last_active":"2024-09-10T05:14:36.109858+0000","last_peered":"2024-09-10T05:14:36.109858+0000","last_clean":"2024-09-10T05:14:36.109858+0000","last_became_active":"2024-09-10T05:11:29.731824+0000","last_became_peered":"2024-09-10T05:11:29.731824+0000","last_unstale":"2024-09-10T05:14:36.109858+0000","last_undegraded":"2024-09-10T05:14:36.109858+0000","last_fullsized":"2024-09-10T05:14:36.109858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:53.060402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.955838+0000","last_change":"2024-09-10T05:15:02.955838+0000","last_active":"2024-09-10T05:15:02.955838+0000","last_peered":"2024-09-10T05:15:02.955838+0000","last_clean":"2024-09-10T05:15:02.955838+0000","last_became_active":"2024-09-10T05:11:27.734652+0000","last_became_peered":"2024-09-10T05:11:27.734652+0000","last_unstale":"2024-09-10T05:15:02.955838+0000","last_undegraded":"2024-09-10T05:15:02.955838+0000","last_fullsized":"2024-09-10T05:15:02.955838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:02.955753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:02.955753+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.955753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:03.026683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.707762+0000","last_change":"2024-09-10T05:15:21.707762+0000","last_active":"2024-09-10T05:15:21.707762+0000","last_peered":"2024-09-10T05:15:21.707762+0000","last_clean":"2024-09-10T05:15:21.707762+0000","last_became_active":"2024-09-10T05:11:31.734774+0000","last_became_peered":"2024-09-10T05:11:31.734774+0000","last_unstale":"2024-09-10T05:15:21.707762+0000","last_undegraded":"2024-09-10T05:15:21.707762+0000","last_fullsized":"2024-09-10T05:15:21.707762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:21.707674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:21.707674+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.707674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:24.042654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'66","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.157107+0000","last_change":"2024-09-10T05:11:33.741409+0000","last_active":"2024-09-10T05:14:43.157107+0000","last_peered":"2024-09-10T05:14:43.157107+0000","last_clean":"2024-09-10T05:14:43.157107+0000","last_became_active":"2024-09-10T05:11:33.741136+0000","last_became_peered":"2024-09-10T05:11:33.741136+0000","last_unstale":"2024-09-10T05:14:43.157107+0000","last_undegraded":"2024-09-10T05:14:43.157107+0000","last_fullsized":"2024-09-10T05:14:43.157107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:48.815209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958544+0000","last_change":"2024-09-10T05:11:35.746094+0000","last_active":"2024-09-10T05:12:04.958544+0000","last_peered":"2024-09-10T05:12:04.958544+0000","last_clean":"2024-09-10T05:12:04.958544+0000","last_became_active":"2024-09-10T05:11:35.745795+0000","last_became_peered":"2024-09-10T05:11:35.745795+0000","last_unstale":"2024-09-10T05:12:04.958544+0000","last_undegraded":"2024-09-10T05:12:04.958544+0000","last_fullsized":"2024-09-10T05:12:04.958544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:43.698313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.609239+0000","last_change":"2024-09-10T05:11:37.758689+0000","last_active":"2024-09-10T05:13:35.609239+0000","last_peered":"2024-09-10T05:13:35.609239+0000","last_clean":"2024-09-10T05:13:35.609239+0000","last_became_active":"2024-09-10T05:11:37.758360+0000","last_became_peered":"2024-09-10T05:11:37.758360+0000","last_unstale":"2024-09-10T05:13:35.609239+0000","last_undegraded":"2024-09-10T05:13:35.609239+0000","last_fullsized":"2024-09-10T05:13:35.609239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:10.895588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'9","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.487731+0000","last_change":"2024-09-10T05:15:04.487731+0000","last_active":"2024-09-10T05:15:04.487731+0000","last_peered":"2024-09-10T05:15:04.487731+0000","last_clean":"2024-09-10T05:15:04.487731+0000","last_became_active":"2024-09-10T05:11:29.723722+0000","last_became_peered":"2024-09-10T05:11:29.723722+0000","last_unstale":"2024-09-10T05:15:04.487731+0000","last_undegraded":"2024-09-10T05:15:04.487731+0000","last_fullsized":"2024-09-10T05:15:04.487731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-10T05:15:04.487622+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-10T05:15:04.487622+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.487622+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:01.563035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.432455+0000","last_change":"2024-09-10T05:14:48.432455+0000","last_active":"2024-09-10T05:14:48.432455+0000","last_peered":"2024-09-10T05:14:48.432455+0000","last_clean":"2024-09-10T05:14:48.432455+0000","last_became_active":"2024-09-10T05:11:27.727770+0000","last_became_peered":"2024-09-10T05:11:27.727770+0000","last_unstale":"2024-09-10T05:14:48.432455+0000","last_undegraded":"2024-09-10T05:14:48.432455+0000","last_fullsized":"2024-09-10T05:14:48.432455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.432373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.432373+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.432373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:56.267844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.739584+0000","last_change":"2024-09-10T05:15:19.739584+0000","last_active":"2024-09-10T05:15:19.739584+0000","last_peered":"2024-09-10T05:15:19.739584+0000","last_clean":"2024-09-10T05:15:19.739584+0000","last_became_active":"2024-09-10T05:11:31.728653+0000","last_became_peered":"2024-09-10T05:11:31.728653+0000","last_unstale":"2024-09-10T05:15:19.739584+0000","last_undegraded":"2024-09-10T05:15:19.739584+0000","last_fullsized":"2024-09-10T05:15:19.739584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:19.739465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:19.739465+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.739465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:10.896874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.057351+0000","last_change":"2024-09-10T05:11:33.743527+0000","last_active":"2024-09-10T05:14:43.057351+0000","last_peered":"2024-09-10T05:14:43.057351+0000","last_clean":"2024-09-10T05:14:43.057351+0000","last_became_active":"2024-09-10T05:11:33.743048+0000","last_became_peered":"2024-09-10T05:11:33.743048+0000","last_unstale":"2024-09-10T05:14:43.057351+0000","last_undegraded":"2024-09-10T05:14:43.057351+0000","last_fullsized":"2024-09-10T05:14:43.057351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:52:59.505330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960230+0000","last_change":"2024-09-10T05:11:35.753237+0000","last_active":"2024-09-10T05:12:04.960230+0000","last_peered":"2024-09-10T05:12:04.960230+0000","last_clean":"2024-09-10T05:12:04.960230+0000","last_became_active":"2024-09-10T05:11:35.752971+0000","last_became_peered":"2024-09-10T05:11:35.752971+0000","last_unstale":"2024-09-10T05:12:04.960230+0000","last_undegraded":"2024-09-10T05:12:04.960230+0000","last_fullsized":"2024-09-10T05:12:04.960230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:16.416535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954464+0000","last_change":"2024-09-10T05:11:37.768354+0000","last_active":"2024-09-10T05:12:04.954464+0000","last_peered":"2024-09-10T05:12:04.954464+0000","last_clean":"2024-09-10T05:12:04.954464+0000","last_became_active":"2024-09-10T05:11:37.768036+0000","last_became_peered":"2024-09-10T05:11:37.768036+0000","last_unstale":"2024-09-10T05:12:04.954464+0000","last_undegraded":"2024-09-10T05:12:04.954464+0000","last_fullsized":"2024-09-10T05:12:04.954464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:28.716788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'3","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.210570+0000","last_change":"2024-09-10T05:11:29.735292+0000","last_active":"2024-09-10T05:14:36.210570+0000","last_peered":"2024-09-10T05:14:36.210570+0000","last_clean":"2024-09-10T05:14:36.210570+0000","last_became_active":"2024-09-10T05:11:29.734714+0000","last_became_peered":"2024-09-10T05:11:29.734714+0000","last_unstale":"2024-09-10T05:14:36.210570+0000","last_undegraded":"2024-09-10T05:14:36.210570+0000","last_fullsized":"2024-09-10T05:14:36.210570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:28.419157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.434007+0000","last_change":"2024-09-10T05:14:53.434007+0000","last_active":"2024-09-10T05:14:53.434007+0000","last_peered":"2024-09-10T05:14:53.434007+0000","last_clean":"2024-09-10T05:14:53.434007+0000","last_became_active":"2024-09-10T05:11:27.718251+0000","last_became_peered":"2024-09-10T05:11:27.718251+0000","last_unstale":"2024-09-10T05:14:53.434007+0000","last_undegraded":"2024-09-10T05:14:53.434007+0000","last_fullsized":"2024-09-10T05:14:53.434007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:53.433919+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:53.433919+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.433919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:36.001843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.733593+0000","last_change":"2024-09-10T05:15:18.733593+0000","last_active":"2024-09-10T05:15:18.733593+0000","last_peered":"2024-09-10T05:15:18.733593+0000","last_clean":"2024-09-10T05:15:18.733593+0000","last_became_active":"2024-09-10T05:11:31.727998+0000","last_became_peered":"2024-09-10T05:11:31.727998+0000","last_unstale":"2024-09-10T05:15:18.733593+0000","last_undegraded":"2024-09-10T05:15:18.733593+0000","last_fullsized":"2024-09-10T05:15:18.733593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:18.733458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:18.733458+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.733458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:16.898611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'41","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.107513+0000","last_change":"2024-09-10T05:11:33.742831+0000","last_active":"2024-09-10T05:14:43.107513+0000","last_peered":"2024-09-10T05:14:43.107513+0000","last_clean":"2024-09-10T05:14:43.107513+0000","last_became_active":"2024-09-10T05:11:33.742594+0000","last_became_peered":"2024-09-10T05:11:33.742594+0000","last_unstale":"2024-09-10T05:14:43.107513+0000","last_undegraded":"2024-09-10T05:14:43.107513+0000","last_fullsized":"2024-09-10T05:14:43.107513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:54.003296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.957834+0000","last_change":"2024-09-10T05:11:35.748750+0000","last_active":"2024-09-10T05:12:04.957834+0000","last_peered":"2024-09-10T05:12:04.957834+0000","last_clean":"2024-09-10T05:12:04.957834+0000","last_became_active":"2024-09-10T05:11:35.748464+0000","last_became_peered":"2024-09-10T05:11:35.748464+0000","last_unstale":"2024-09-10T05:12:04.957834+0000","last_undegraded":"2024-09-10T05:12:04.957834+0000","last_fullsized":"2024-09-10T05:12:04.957834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:02:44.003459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.674549+0000","last_change":"2024-09-10T05:11:37.768552+0000","last_active":"2024-09-10T05:13:35.674549+0000","last_peered":"2024-09-10T05:13:35.674549+0000","last_clean":"2024-09-10T05:13:35.674549+0000","last_became_active":"2024-09-10T05:11:37.768248+0000","last_became_peered":"2024-09-10T05:11:37.768248+0000","last_unstale":"2024-09-10T05:13:35.674549+0000","last_undegraded":"2024-09-10T05:13:35.674549+0000","last_fullsized":"2024-09-10T05:13:35.674549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:47.039216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.466476+0000","last_change":"2024-09-10T05:15:03.466476+0000","last_active":"2024-09-10T05:15:03.466476+0000","last_peered":"2024-09-10T05:15:03.466476+0000","last_clean":"2024-09-10T05:15:03.466476+0000","last_became_active":"2024-09-10T05:11:29.727038+0000","last_became_peered":"2024-09-10T05:11:29.727038+0000","last_unstale":"2024-09-10T05:15:03.466476+0000","last_undegraded":"2024-09-10T05:15:03.466476+0000","last_fullsized":"2024-09-10T05:15:03.466476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:03.466382+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:03.466382+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.466382+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:51.671119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.996465+0000","last_change":"2024-09-10T05:15:03.996465+0000","last_active":"2024-09-10T05:15:03.996465+0000","last_peered":"2024-09-10T05:15:03.996465+0000","last_clean":"2024-09-10T05:15:03.996465+0000","last_became_active":"2024-09-10T05:11:27.733320+0000","last_became_peered":"2024-09-10T05:11:27.733320+0000","last_unstale":"2024-09-10T05:15:03.996465+0000","last_undegraded":"2024-09-10T05:15:03.996465+0000","last_fullsized":"2024-09-10T05:15:03.996465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.996375+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.996375+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.996375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:10:21.072269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961436+0000","last_change":"2024-09-10T05:11:31.734989+0000","last_active":"2024-09-10T05:12:04.961436+0000","last_peered":"2024-09-10T05:12:04.961436+0000","last_clean":"2024-09-10T05:12:04.961436+0000","last_became_active":"2024-09-10T05:11:31.734684+0000","last_became_peered":"2024-09-10T05:11:31.734684+0000","last_unstale":"2024-09-10T05:12:04.961436+0000","last_undegraded":"2024-09-10T05:12:04.961436+0000","last_fullsized":"2024-09-10T05:12:04.961436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:16.215982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.962397+0000","last_change":"2024-09-10T05:11:33.748823+0000","last_active":"2024-09-10T05:12:04.962397+0000","last_peered":"2024-09-10T05:12:04.962397+0000","last_clean":"2024-09-10T05:12:04.962397+0000","last_became_active":"2024-09-10T05:11:33.748547+0000","last_became_peered":"2024-09-10T05:11:33.748547+0000","last_unstale":"2024-09-10T05:12:04.962397+0000","last_undegraded":"2024-09-10T05:12:04.962397+0000","last_fullsized":"2024-09-10T05:12:04.962397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:00.711618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'285","reported_seq":369,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.002144+0000","last_change":"2024-09-10T05:11:35.751082+0000","last_active":"2024-09-10T05:14:43.002144+0000","last_peered":"2024-09-10T05:14:43.002144+0000","last_clean":"2024-09-10T05:14:43.002144+0000","last_became_active":"2024-09-10T05:11:35.750761+0000","last_became_peered":"2024-09-10T05:11:35.750761+0000","last_unstale":"2024-09-10T05:14:43.002144+0000","last_undegraded":"2024-09-10T05:14:43.002144+0000","last_fullsized":"2024-09-10T05:14:43.002144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:35.877712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954021+0000","last_change":"2024-09-10T05:11:37.768088+0000","last_active":"2024-09-10T05:12:04.954021+0000","last_peered":"2024-09-10T05:12:04.954021+0000","last_clean":"2024-09-10T05:12:04.954021+0000","last_became_active":"2024-09-10T05:11:37.767816+0000","last_became_peered":"2024-09-10T05:11:37.767816+0000","last_unstale":"2024-09-10T05:12:04.954021+0000","last_undegraded":"2024-09-10T05:12:04.954021+0000","last_fullsized":"2024-09-10T05:12:04.954021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:32.684488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.732045+0000","last_change":"2024-09-10T05:15:10.732045+0000","last_active":"2024-09-10T05:15:10.732045+0000","last_peered":"2024-09-10T05:15:10.732045+0000","last_clean":"2024-09-10T05:15:10.732045+0000","last_became_active":"2024-09-10T05:11:29.720243+0000","last_became_peered":"2024-09-10T05:11:29.720243+0000","last_unstale":"2024-09-10T05:15:10.732045+0000","last_undegraded":"2024-09-10T05:15:10.732045+0000","last_fullsized":"2024-09-10T05:15:10.732045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:10.731923+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:10.731923+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.731923+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:05.159738+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.448490+0000","last_change":"2024-09-10T05:14:51.448490+0000","last_active":"2024-09-10T05:14:51.448490+0000","last_peered":"2024-09-10T05:14:51.448490+0000","last_clean":"2024-09-10T05:14:51.448490+0000","last_became_active":"2024-09-10T05:11:27.723630+0000","last_became_peered":"2024-09-10T05:11:27.723630+0000","last_unstale":"2024-09-10T05:14:51.448490+0000","last_undegraded":"2024-09-10T05:14:51.448490+0000","last_fullsized":"2024-09-10T05:14:51.448490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:51.448399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:51.448399+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.448399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:08.698148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.961835+0000","last_change":"2024-09-10T05:11:31.737893+0000","last_active":"2024-09-10T05:12:04.961835+0000","last_peered":"2024-09-10T05:12:04.961835+0000","last_clean":"2024-09-10T05:12:04.961835+0000","last_became_active":"2024-09-10T05:11:31.737547+0000","last_became_peered":"2024-09-10T05:11:31.737547+0000","last_unstale":"2024-09-10T05:12:04.961835+0000","last_undegraded":"2024-09-10T05:12:04.961835+0000","last_fullsized":"2024-09-10T05:12:04.961835+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:30.712575+0000","last_clean_scrub_stamp":"2024-09-10T05:11:30.712575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:48.181735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'63","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.135798+0000","last_change":"2024-09-10T05:11:33.740808+0000","last_active":"2024-09-10T05:14:43.135798+0000","last_peered":"2024-09-10T05:14:43.135798+0000","last_clean":"2024-09-10T05:14:43.135798+0000","last_became_active":"2024-09-10T05:11:33.740489+0000","last_became_peered":"2024-09-10T05:11:33.740489+0000","last_unstale":"2024-09-10T05:14:43.135798+0000","last_undegraded":"2024-09-10T05:14:43.135798+0000","last_fullsized":"2024-09-10T05:14:43.135798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:04.031528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956220+0000","last_change":"2024-09-10T05:11:35.754168+0000","last_active":"2024-09-10T05:12:04.956220+0000","last_peered":"2024-09-10T05:12:04.956220+0000","last_clean":"2024-09-10T05:12:04.956220+0000","last_became_active":"2024-09-10T05:11:35.753856+0000","last_became_peered":"2024-09-10T05:11:35.753856+0000","last_unstale":"2024-09-10T05:12:04.956220+0000","last_undegraded":"2024-09-10T05:12:04.956220+0000","last_fullsized":"2024-09-10T05:12:04.956220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:03.169802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.439500+0000","last_change":"2024-09-10T05:11:37.758619+0000","last_active":"2024-09-10T05:12:09.439500+0000","last_peered":"2024-09-10T05:12:09.439500+0000","last_clean":"2024-09-10T05:12:09.439500+0000","last_became_active":"2024-09-10T05:11:37.758332+0000","last_became_peered":"2024-09-10T05:11:37.758332+0000","last_unstale":"2024-09-10T05:12:09.439500+0000","last_undegraded":"2024-09-10T05:12:09.439500+0000","last_fullsized":"2024-09-10T05:12:09.439500+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:34:24.838165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.713125+0000","last_change":"2024-09-10T05:15:08.713125+0000","last_active":"2024-09-10T05:15:08.713125+0000","last_peered":"2024-09-10T05:15:08.713125+0000","last_clean":"2024-09-10T05:15:08.713125+0000","last_became_active":"2024-09-10T05:11:29.721899+0000","last_became_peered":"2024-09-10T05:11:29.721899+0000","last_unstale":"2024-09-10T05:15:08.713125+0000","last_undegraded":"2024-09-10T05:15:08.713125+0000","last_fullsized":"2024-09-10T05:15:08.713125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:08.713028+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:08.713028+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.713028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:16.548499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.992028+0000","last_change":"2024-09-10T05:15:04.992028+0000","last_active":"2024-09-10T05:15:04.992028+0000","last_peered":"2024-09-10T05:15:04.992028+0000","last_clean":"2024-09-10T05:15:04.992028+0000","last_became_active":"2024-09-10T05:11:27.733451+0000","last_became_peered":"2024-09-10T05:11:27.733451+0000","last_unstale":"2024-09-10T05:15:04.992028+0000","last_undegraded":"2024-09-10T05:15:04.992028+0000","last_fullsized":"2024-09-10T05:15:04.992028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:04.991935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:04.991935+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.991935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:35.404102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.749996+0000","last_change":"2024-09-10T05:15:20.749996+0000","last_active":"2024-09-10T05:15:20.749996+0000","last_peered":"2024-09-10T05:15:20.749996+0000","last_clean":"2024-09-10T05:15:20.749996+0000","last_became_active":"2024-09-10T05:11:31.735565+0000","last_became_peered":"2024-09-10T05:11:31.735565+0000","last_unstale":"2024-09-10T05:15:20.749996+0000","last_undegraded":"2024-09-10T05:15:20.749996+0000","last_fullsized":"2024-09-10T05:15:20.749996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:20.749892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:20.749892+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.749892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:19.742771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'39","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.138877+0000","last_change":"2024-09-10T05:11:33.742997+0000","last_active":"2024-09-10T05:14:43.138877+0000","last_peered":"2024-09-10T05:14:43.138877+0000","last_clean":"2024-09-10T05:14:43.138877+0000","last_became_active":"2024-09-10T05:11:33.742656+0000","last_became_peered":"2024-09-10T05:11:33.742656+0000","last_unstale":"2024-09-10T05:14:43.138877+0000","last_undegraded":"2024-09-10T05:14:43.138877+0000","last_fullsized":"2024-09-10T05:14:43.138877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:28.611407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954236+0000","last_change":"2024-09-10T05:11:35.751391+0000","last_active":"2024-09-10T05:12:04.954236+0000","last_peered":"2024-09-10T05:12:04.954236+0000","last_clean":"2024-09-10T05:12:04.954236+0000","last_became_active":"2024-09-10T05:11:35.750960+0000","last_became_peered":"2024-09-10T05:11:35.750960+0000","last_unstale":"2024-09-10T05:12:04.954236+0000","last_undegraded":"2024-09-10T05:12:04.954236+0000","last_fullsized":"2024-09-10T05:12:04.954236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:07.690221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.959775+0000","last_change":"2024-09-10T05:11:37.768897+0000","last_active":"2024-09-10T05:12:51.959775+0000","last_peered":"2024-09-10T05:12:51.959775+0000","last_clean":"2024-09-10T05:12:51.959775+0000","last_became_active":"2024-09-10T05:11:37.768559+0000","last_became_peered":"2024-09-10T05:11:37.768559+0000","last_unstale":"2024-09-10T05:12:51.959775+0000","last_undegraded":"2024-09-10T05:12:51.959775+0000","last_fullsized":"2024-09-10T05:12:51.959775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:41.676922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.981935+0000","last_change":"2024-09-10T05:15:24.981935+0000","last_active":"2024-09-10T05:15:24.981935+0000","last_peered":"2024-09-10T05:15:24.981935+0000","last_clean":"2024-09-10T05:15:24.981935+0000","last_became_active":"2024-09-10T05:11:29.732703+0000","last_became_peered":"2024-09-10T05:11:29.732703+0000","last_unstale":"2024-09-10T05:15:24.981935+0000","last_undegraded":"2024-09-10T05:15:24.981935+0000","last_fullsized":"2024-09-10T05:15:24.981935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:24.981859+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:24.981859+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.981859+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:28.030709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.494569+0000","last_change":"2024-09-10T05:14:56.494569+0000","last_active":"2024-09-10T05:14:56.494569+0000","last_peered":"2024-09-10T05:14:56.494569+0000","last_clean":"2024-09-10T05:14:56.494569+0000","last_became_active":"2024-09-10T05:11:27.713416+0000","last_became_peered":"2024-09-10T05:11:27.713416+0000","last_unstale":"2024-09-10T05:14:56.494569+0000","last_undegraded":"2024-09-10T05:14:56.494569+0000","last_fullsized":"2024-09-10T05:14:56.494569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:56.494480+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.494480+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.494480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:49.778320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.315033+0000","last_change":"2024-09-10T05:15:24.315033+0000","last_active":"2024-09-10T05:15:24.315033+0000","last_peered":"2024-09-10T05:15:24.315033+0000","last_clean":"2024-09-10T05:15:24.315033+0000","last_became_active":"2024-09-10T05:11:31.736540+0000","last_became_peered":"2024-09-10T05:11:31.736540+0000","last_unstale":"2024-09-10T05:15:24.315033+0000","last_undegraded":"2024-09-10T05:15:24.315033+0000","last_fullsized":"2024-09-10T05:15:24.315033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:24.314941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:24.314941+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.314941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:23:29.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'36","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.101381+0000","last_change":"2024-09-10T05:11:33.743575+0000","last_active":"2024-09-10T05:14:43.101381+0000","last_peered":"2024-09-10T05:14:43.101381+0000","last_clean":"2024-09-10T05:14:43.101381+0000","last_became_active":"2024-09-10T05:11:33.743207+0000","last_became_peered":"2024-09-10T05:11:33.743207+0000","last_unstale":"2024-09-10T05:14:43.101381+0000","last_undegraded":"2024-09-10T05:14:43.101381+0000","last_fullsized":"2024-09-10T05:14:43.101381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:19.732970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:35.753328+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:35.753001+0000","last_became_peered":"2024-09-10T05:11:35.753001+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:19.217985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.480743+0000","last_change":"2024-09-10T05:11:37.767945+0000","last_active":"2024-09-10T05:14:36.480743+0000","last_peered":"2024-09-10T05:14:36.480743+0000","last_clean":"2024-09-10T05:14:36.480743+0000","last_became_active":"2024-09-10T05:11:37.767649+0000","last_became_peered":"2024-09-10T05:11:37.767649+0000","last_unstale":"2024-09-10T05:14:36.480743+0000","last_undegraded":"2024-09-10T05:14:36.480743+0000","last_fullsized":"2024-09-10T05:14:36.480743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:47.436935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.664923+0000","last_change":"2024-09-10T05:15:07.664923+0000","last_active":"2024-09-10T05:15:07.664923+0000","last_peered":"2024-09-10T05:15:07.664923+0000","last_clean":"2024-09-10T05:15:07.664923+0000","last_became_active":"2024-09-10T05:11:29.718689+0000","last_became_peered":"2024-09-10T05:11:29.718689+0000","last_unstale":"2024-09-10T05:15:07.664923+0000","last_undegraded":"2024-09-10T05:15:07.664923+0000","last_fullsized":"2024-09-10T05:15:07.664923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:07.664840+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:07.664840+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.664840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:53.882406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.493473+0000","last_change":"2024-09-10T05:14:57.493473+0000","last_active":"2024-09-10T05:14:57.493473+0000","last_peered":"2024-09-10T05:14:57.493473+0000","last_clean":"2024-09-10T05:14:57.493473+0000","last_became_active":"2024-09-10T05:11:27.716073+0000","last_became_peered":"2024-09-10T05:11:27.716073+0000","last_unstale":"2024-09-10T05:14:57.493473+0000","last_undegraded":"2024-09-10T05:14:57.493473+0000","last_fullsized":"2024-09-10T05:14:57.493473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:57.493360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:57.493360+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.493360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:16.549263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:25.285210+0000","last_change":"2024-09-10T05:15:25.285210+0000","last_active":"2024-09-10T05:15:25.285210+0000","last_peered":"2024-09-10T05:15:25.285210+0000","last_clean":"2024-09-10T05:15:25.285210+0000","last_became_active":"2024-09-10T05:11:31.735726+0000","last_became_peered":"2024-09-10T05:11:31.735726+0000","last_unstale":"2024-09-10T05:15:25.285210+0000","last_undegraded":"2024-09-10T05:15:25.285210+0000","last_fullsized":"2024-09-10T05:15:25.285210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:15:25.285128+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:15:25.285128+0000","last_clean_scrub_stamp":"2024-09-10T05:15:25.285128+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:58.121835+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'47","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.110530+0000","last_change":"2024-09-10T05:11:33.748407+0000","last_active":"2024-09-10T05:14:43.110530+0000","last_peered":"2024-09-10T05:14:43.110530+0000","last_clean":"2024-09-10T05:14:43.110530+0000","last_became_active":"2024-09-10T05:11:33.748120+0000","last_became_peered":"2024-09-10T05:11:33.748120+0000","last_unstale":"2024-09-10T05:14:43.110530+0000","last_undegraded":"2024-09-10T05:14:43.110530+0000","last_fullsized":"2024-09-10T05:14:43.110530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:46:20.643301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956794+0000","last_change":"2024-09-10T05:11:35.753972+0000","last_active":"2024-09-10T05:12:04.956794+0000","last_peered":"2024-09-10T05:12:04.956794+0000","last_clean":"2024-09-10T05:12:04.956794+0000","last_became_active":"2024-09-10T05:11:35.753437+0000","last_became_peered":"2024-09-10T05:11:35.753437+0000","last_unstale":"2024-09-10T05:12:04.956794+0000","last_undegraded":"2024-09-10T05:12:04.956794+0000","last_fullsized":"2024-09-10T05:12:04.956794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:06.887746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'10","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.285208+0000","last_change":"2024-09-10T05:11:37.765397+0000","last_active":"2024-09-10T05:13:34.285208+0000","last_peered":"2024-09-10T05:13:34.285208+0000","last_clean":"2024-09-10T05:13:34.285208+0000","last_became_active":"2024-09-10T05:11:37.765102+0000","last_became_peered":"2024-09-10T05:11:37.765102+0000","last_unstale":"2024-09-10T05:13:34.285208+0000","last_undegraded":"2024-09-10T05:13:34.285208+0000","last_fullsized":"2024-09-10T05:13:34.285208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:41.297084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":67,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.375108+0000","last_change":"2024-09-10T05:15:08.375108+0000","last_active":"2024-09-10T05:15:08.375108+0000","last_peered":"2024-09-10T05:15:08.375108+0000","last_clean":"2024-09-10T05:15:08.375108+0000","last_became_active":"2024-09-10T05:11:29.729468+0000","last_became_peered":"2024-09-10T05:11:29.729468+0000","last_unstale":"2024-09-10T05:15:08.375108+0000","last_undegraded":"2024-09-10T05:15:08.375108+0000","last_fullsized":"2024-09-10T05:15:08.375108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:08.375011+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:08.375011+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.375011+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:38.702635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.709815+0000","last_change":"2024-09-10T05:14:54.709815+0000","last_active":"2024-09-10T05:14:54.709815+0000","last_peered":"2024-09-10T05:14:54.709815+0000","last_clean":"2024-09-10T05:14:54.709815+0000","last_became_active":"2024-09-10T05:11:27.706484+0000","last_became_peered":"2024-09-10T05:11:27.706484+0000","last_unstale":"2024-09-10T05:14:54.709815+0000","last_undegraded":"2024-09-10T05:14:54.709815+0000","last_fullsized":"2024-09-10T05:14:54.709815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:54.709723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:54.709723+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.709723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:58.926828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'12","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.590666+0000","last_change":"2024-09-10T05:15:08.590666+0000","last_active":"2024-09-10T05:15:08.590666+0000","last_peered":"2024-09-10T05:15:08.590666+0000","last_clean":"2024-09-10T05:15:08.590666+0000","last_became_active":"2024-09-10T05:11:29.729019+0000","last_became_peered":"2024-09-10T05:11:29.729019+0000","last_unstale":"2024-09-10T05:15:08.590666+0000","last_undegraded":"2024-09-10T05:15:08.590666+0000","last_fullsized":"2024-09-10T05:15:08.590666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-10T05:15:08.590592+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-10T05:15:08.590592+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.590592+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:11.806872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.491464+0000","last_change":"2024-09-10T05:14:52.491464+0000","last_active":"2024-09-10T05:14:52.491464+0000","last_peered":"2024-09-10T05:14:52.491464+0000","last_clean":"2024-09-10T05:14:52.491464+0000","last_became_active":"2024-09-10T05:11:27.714487+0000","last_became_peered":"2024-09-10T05:11:27.714487+0000","last_unstale":"2024-09-10T05:14:52.491464+0000","last_undegraded":"2024-09-10T05:14:52.491464+0000","last_fullsized":"2024-09-10T05:14:52.491464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:52.491377+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:52.491377+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.491377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:49.460874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'2","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:09.666946+0000","last_change":"2024-09-10T05:11:29.729634+0000","last_active":"2024-09-10T05:12:09.666946+0000","last_peered":"2024-09-10T05:12:09.666946+0000","last_clean":"2024-09-10T05:12:09.666946+0000","last_became_active":"2024-09-10T05:11:29.729359+0000","last_became_peered":"2024-09-10T05:11:29.729359+0000","last_unstale":"2024-09-10T05:12:09.666946+0000","last_undegraded":"2024-09-10T05:12:09.666946+0000","last_fullsized":"2024-09-10T05:12:09.666946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:52.814750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.978001+0000","last_change":"2024-09-10T05:15:05.978001+0000","last_active":"2024-09-10T05:15:05.978001+0000","last_peered":"2024-09-10T05:15:05.978001+0000","last_clean":"2024-09-10T05:15:05.978001+0000","last_became_active":"2024-09-10T05:11:27.730905+0000","last_became_peered":"2024-09-10T05:11:27.730905+0000","last_unstale":"2024-09-10T05:15:05.978001+0000","last_undegraded":"2024-09-10T05:15:05.978001+0000","last_fullsized":"2024-09-10T05:15:05.978001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:05.977914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:05.977914+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.977914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:59.732683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.630650+0000","last_change":"2024-09-10T05:15:09.630650+0000","last_active":"2024-09-10T05:15:09.630650+0000","last_peered":"2024-09-10T05:15:09.630650+0000","last_clean":"2024-09-10T05:15:09.630650+0000","last_became_active":"2024-09-10T05:11:29.727454+0000","last_became_peered":"2024-09-10T05:11:29.727454+0000","last_unstale":"2024-09-10T05:15:09.630650+0000","last_undegraded":"2024-09-10T05:15:09.630650+0000","last_fullsized":"2024-09-10T05:15:09.630650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:09.630545+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:09.630545+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.630545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:42.825841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.503637+0000","last_change":"2024-09-10T05:14:54.503637+0000","last_active":"2024-09-10T05:14:54.503637+0000","last_peered":"2024-09-10T05:14:54.503637+0000","last_clean":"2024-09-10T05:14:54.503637+0000","last_became_active":"2024-09-10T05:11:27.713962+0000","last_became_peered":"2024-09-10T05:11:27.713962+0000","last_unstale":"2024-09-10T05:14:54.503637+0000","last_undegraded":"2024-09-10T05:14:54.503637+0000","last_fullsized":"2024-09-10T05:14:54.503637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:54.503543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:54.503543+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.503543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:36.529415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'8","reported_seq":78,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.551762+0000","last_change":"2024-09-10T05:15:07.551762+0000","last_active":"2024-09-10T05:15:07.551762+0000","last_peered":"2024-09-10T05:15:07.551762+0000","last_clean":"2024-09-10T05:15:07.551762+0000","last_became_active":"2024-09-10T05:11:29.725099+0000","last_became_peered":"2024-09-10T05:11:29.725099+0000","last_unstale":"2024-09-10T05:15:07.551762+0000","last_undegraded":"2024-09-10T05:15:07.551762+0000","last_fullsized":"2024-09-10T05:15:07.551762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:07.551648+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:07.551648+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.551648+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:16.567800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.545597+0000","last_change":"2024-09-10T05:14:49.545597+0000","last_active":"2024-09-10T05:14:49.545597+0000","last_peered":"2024-09-10T05:14:49.545597+0000","last_clean":"2024-09-10T05:14:49.545597+0000","last_became_active":"2024-09-10T05:11:27.718926+0000","last_became_peered":"2024-09-10T05:11:27.718926+0000","last_unstale":"2024-09-10T05:14:49.545597+0000","last_undegraded":"2024-09-10T05:14:49.545597+0000","last_fullsized":"2024-09-10T05:14:49.545597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:49.545500+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:49.545500+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.545500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:57.641677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'8","reported_seq":90,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.398282+0000","last_change":"2024-09-10T05:15:07.398282+0000","last_active":"2024-09-10T05:15:07.398282+0000","last_peered":"2024-09-10T05:15:07.398282+0000","last_clean":"2024-09-10T05:15:07.398282+0000","last_became_active":"2024-09-10T05:12:04.964750+0000","last_became_peered":"2024-09-10T05:12:04.964750+0000","last_unstale":"2024-09-10T05:15:07.398282+0000","last_undegraded":"2024-09-10T05:15:07.398282+0000","last_fullsized":"2024-09-10T05:15:07.398282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:07.398168+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:07.398168+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.398168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:10.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.416193+0000","last_change":"2024-09-10T05:14:52.416193+0000","last_active":"2024-09-10T05:14:52.416193+0000","last_peered":"2024-09-10T05:14:52.416193+0000","last_clean":"2024-09-10T05:14:52.416193+0000","last_became_active":"2024-09-10T05:11:27.718282+0000","last_became_peered":"2024-09-10T05:11:27.718282+0000","last_unstale":"2024-09-10T05:14:52.416193+0000","last_undegraded":"2024-09-10T05:14:52.416193+0000","last_fullsized":"2024-09-10T05:14:52.416193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.416097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.416097+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.416097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:11.180415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:06.501364+0000","last_change":"2024-09-10T05:15:06.501364+0000","last_active":"2024-09-10T05:15:06.501364+0000","last_peered":"2024-09-10T05:15:06.501364+0000","last_clean":"2024-09-10T05:15:06.501364+0000","last_became_active":"2024-09-10T05:11:29.723387+0000","last_became_peered":"2024-09-10T05:11:29.723387+0000","last_unstale":"2024-09-10T05:15:06.501364+0000","last_undegraded":"2024-09-10T05:15:06.501364+0000","last_fullsized":"2024-09-10T05:15:06.501364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:06.501241+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:06.501241+0000","last_clean_scrub_stamp":"2024-09-10T05:15:06.501241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:02.303540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.663822+0000","last_change":"2024-09-10T05:14:56.663822+0000","last_active":"2024-09-10T05:14:56.663822+0000","last_peered":"2024-09-10T05:14:56.663822+0000","last_clean":"2024-09-10T05:14:56.663822+0000","last_became_active":"2024-09-10T05:11:27.724815+0000","last_became_peered":"2024-09-10T05:11:27.724815+0000","last_unstale":"2024-09-10T05:14:56.663822+0000","last_undegraded":"2024-09-10T05:14:56.663822+0000","last_fullsized":"2024-09-10T05:14:56.663822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:14:56.663737+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.663737+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.663737+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:18.281662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'4","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.394073+0000","last_change":"2024-09-10T05:15:05.394073+0000","last_active":"2024-09-10T05:15:05.394073+0000","last_peered":"2024-09-10T05:15:05.394073+0000","last_clean":"2024-09-10T05:15:05.394073+0000","last_became_active":"2024-09-10T05:11:29.723469+0000","last_became_peered":"2024-09-10T05:11:29.723469+0000","last_unstale":"2024-09-10T05:15:05.394073+0000","last_undegraded":"2024-09-10T05:15:05.394073+0000","last_fullsized":"2024-09-10T05:15:05.394073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-10T05:15:05.393954+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-10T05:15:05.393954+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.393954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:38:36.032466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.489090+0000","last_change":"2024-09-10T05:14:55.489090+0000","last_active":"2024-09-10T05:14:55.489090+0000","last_peered":"2024-09-10T05:14:55.489090+0000","last_clean":"2024-09-10T05:14:55.489090+0000","last_became_active":"2024-09-10T05:11:27.714348+0000","last_became_peered":"2024-09-10T05:11:27.714348+0000","last_unstale":"2024-09-10T05:14:55.489090+0000","last_undegraded":"2024-09-10T05:14:55.489090+0000","last_fullsized":"2024-09-10T05:14:55.489090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:55.488990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:55.488990+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.488990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:10.435358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'8","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.268130+0000","last_change":"2024-09-10T05:15:13.268130+0000","last_active":"2024-09-10T05:15:13.268130+0000","last_peered":"2024-09-10T05:15:13.268130+0000","last_clean":"2024-09-10T05:15:13.268130+0000","last_became_active":"2024-09-10T05:11:29.729148+0000","last_became_peered":"2024-09-10T05:11:29.729148+0000","last_unstale":"2024-09-10T05:15:13.268130+0000","last_undegraded":"2024-09-10T05:15:13.268130+0000","last_fullsized":"2024-09-10T05:15:13.268130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:13.268020+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:13.268020+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.268020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:00.698029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.019917+0000","last_change":"2024-09-10T05:15:07.019917+0000","last_active":"2024-09-10T05:15:07.019917+0000","last_peered":"2024-09-10T05:15:07.019917+0000","last_clean":"2024-09-10T05:15:07.019917+0000","last_became_active":"2024-09-10T05:11:27.735159+0000","last_became_peered":"2024-09-10T05:11:27.735159+0000","last_unstale":"2024-09-10T05:15:07.019917+0000","last_undegraded":"2024-09-10T05:15:07.019917+0000","last_fullsized":"2024-09-10T05:15:07.019917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:07.019834+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:07.019834+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.019834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:09.595861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'12","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.339364+0000","last_change":"2024-09-10T05:11:29.729754+0000","last_active":"2024-09-10T05:14:36.339364+0000","last_peered":"2024-09-10T05:14:36.339364+0000","last_clean":"2024-09-10T05:14:36.339364+0000","last_became_active":"2024-09-10T05:11:29.729476+0000","last_became_peered":"2024-09-10T05:11:29.729476+0000","last_unstale":"2024-09-10T05:14:36.339364+0000","last_undegraded":"2024-09-10T05:14:36.339364+0000","last_fullsized":"2024-09-10T05:14:36.339364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:48.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.511867+0000","last_change":"2024-09-10T05:14:57.511867+0000","last_active":"2024-09-10T05:14:57.511867+0000","last_peered":"2024-09-10T05:14:57.511867+0000","last_clean":"2024-09-10T05:14:57.511867+0000","last_became_active":"2024-09-10T05:11:27.715014+0000","last_became_peered":"2024-09-10T05:11:27.715014+0000","last_unstale":"2024-09-10T05:14:57.511867+0000","last_undegraded":"2024-09-10T05:14:57.511867+0000","last_fullsized":"2024-09-10T05:14:57.511867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:57.511763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:57.511763+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.511763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:55.932537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.690109+0000","last_change":"2024-09-10T05:15:13.690109+0000","last_active":"2024-09-10T05:15:13.690109+0000","last_peered":"2024-09-10T05:15:13.690109+0000","last_clean":"2024-09-10T05:15:13.690109+0000","last_became_active":"2024-09-10T05:11:29.725047+0000","last_became_peered":"2024-09-10T05:11:29.725047+0000","last_unstale":"2024-09-10T05:15:13.690109+0000","last_undegraded":"2024-09-10T05:15:13.690109+0000","last_fullsized":"2024-09-10T05:15:13.690109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:13.690031+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:13.690031+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.690031+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:40.863292+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.482237+0000","last_change":"2024-09-10T05:14:54.482237+0000","last_active":"2024-09-10T05:14:54.482237+0000","last_peered":"2024-09-10T05:14:54.482237+0000","last_clean":"2024-09-10T05:14:54.482237+0000","last_became_active":"2024-09-10T05:11:27.728257+0000","last_became_peered":"2024-09-10T05:11:27.728257+0000","last_unstale":"2024-09-10T05:14:54.482237+0000","last_undegraded":"2024-09-10T05:14:54.482237+0000","last_fullsized":"2024-09-10T05:14:54.482237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:54.482153+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:54.482153+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.482153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:10.009942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.314698+0000","last_change":"2024-09-10T05:15:12.314698+0000","last_active":"2024-09-10T05:15:12.314698+0000","last_peered":"2024-09-10T05:15:12.314698+0000","last_clean":"2024-09-10T05:15:12.314698+0000","last_became_active":"2024-09-10T05:11:29.721826+0000","last_became_peered":"2024-09-10T05:11:29.721826+0000","last_unstale":"2024-09-10T05:15:12.314698+0000","last_undegraded":"2024-09-10T05:15:12.314698+0000","last_fullsized":"2024-09-10T05:15:12.314698+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:15:12.314615+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:15:12.314615+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.314615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:25:54.503608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.515429+0000","last_change":"2024-09-10T05:14:56.515429+0000","last_active":"2024-09-10T05:14:56.515429+0000","last_peered":"2024-09-10T05:14:56.515429+0000","last_clean":"2024-09-10T05:14:56.515429+0000","last_became_active":"2024-09-10T05:11:27.730469+0000","last_became_peered":"2024-09-10T05:11:27.730469+0000","last_unstale":"2024-09-10T05:14:56.515429+0000","last_undegraded":"2024-09-10T05:14:56.515429+0000","last_fullsized":"2024-09-10T05:14:56.515429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:14:56.515326+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.515326+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.515326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:20.046107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'18","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.342989+0000","last_change":"2024-09-10T05:15:11.342989+0000","last_active":"2024-09-10T05:15:11.342989+0000","last_peered":"2024-09-10T05:15:11.342989+0000","last_clean":"2024-09-10T05:15:11.342989+0000","last_became_active":"2024-09-10T05:12:04.965056+0000","last_became_peered":"2024-09-10T05:12:04.965056+0000","last_unstale":"2024-09-10T05:15:11.342989+0000","last_undegraded":"2024-09-10T05:15:11.342989+0000","last_fullsized":"2024-09-10T05:15:11.342989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-10T05:15:11.342907+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-10T05:15:11.342907+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.342907+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:55.366767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.012305+0000","last_change":"2024-09-10T05:15:08.012305+0000","last_active":"2024-09-10T05:15:08.012305+0000","last_peered":"2024-09-10T05:15:08.012305+0000","last_clean":"2024-09-10T05:15:08.012305+0000","last_became_active":"2024-09-10T05:11:27.722079+0000","last_became_peered":"2024-09-10T05:11:27.722079+0000","last_unstale":"2024-09-10T05:15:08.012305+0000","last_undegraded":"2024-09-10T05:15:08.012305+0000","last_fullsized":"2024-09-10T05:15:08.012305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:08.012205+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:08.012205+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.012205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:47.103635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'16","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.323651+0000","last_change":"2024-09-10T05:15:10.323651+0000","last_active":"2024-09-10T05:15:10.323651+0000","last_peered":"2024-09-10T05:15:10.323651+0000","last_clean":"2024-09-10T05:15:10.323651+0000","last_became_active":"2024-09-10T05:11:29.733895+0000","last_became_peered":"2024-09-10T05:11:29.733895+0000","last_unstale":"2024-09-10T05:15:10.323651+0000","last_undegraded":"2024-09-10T05:15:10.323651+0000","last_fullsized":"2024-09-10T05:15:10.323651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:10.323533+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:10.323533+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.323533+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:55.632072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.024782+0000","last_change":"2024-09-10T05:15:09.024782+0000","last_active":"2024-09-10T05:15:09.024782+0000","last_peered":"2024-09-10T05:15:09.024782+0000","last_clean":"2024-09-10T05:15:09.024782+0000","last_became_active":"2024-09-10T05:11:27.735801+0000","last_became_peered":"2024-09-10T05:11:27.735801+0000","last_unstale":"2024-09-10T05:15:09.024782+0000","last_undegraded":"2024-09-10T05:15:09.024782+0000","last_fullsized":"2024-09-10T05:15:09.024782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:15:09.024688+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:15:09.024688+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.024688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:45.203541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.202329+0000","last_change":"2024-09-10T05:11:29.735884+0000","last_active":"2024-09-10T05:14:36.202329+0000","last_peered":"2024-09-10T05:14:36.202329+0000","last_clean":"2024-09-10T05:14:36.202329+0000","last_became_active":"2024-09-10T05:11:29.735555+0000","last_became_peered":"2024-09-10T05:11:29.735555+0000","last_unstale":"2024-09-10T05:14:36.202329+0000","last_undegraded":"2024-09-10T05:14:36.202329+0000","last_fullsized":"2024-09-10T05:14:36.202329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:28.697551+0000","last_clean_scrub_stamp":"2024-09-10T05:11:28.697551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:40:54.995716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.675684+0000","last_change":"2024-09-10T05:14:59.675684+0000","last_active":"2024-09-10T05:14:59.675684+0000","last_peered":"2024-09-10T05:14:59.675684+0000","last_clean":"2024-09-10T05:14:59.675684+0000","last_became_active":"2024-09-10T05:11:27.723820+0000","last_became_peered":"2024-09-10T05:11:27.723820+0000","last_unstale":"2024-09-10T05:14:59.675684+0000","last_undegraded":"2024-09-10T05:14:59.675684+0000","last_fullsized":"2024-09-10T05:14:59.675684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:59.675555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:59.675555+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.675555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:06.058468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.371665+0000","last_change":"2024-09-10T05:15:09.371665+0000","last_active":"2024-09-10T05:15:09.371665+0000","last_peered":"2024-09-10T05:15:09.371665+0000","last_clean":"2024-09-10T05:15:09.371665+0000","last_became_active":"2024-09-10T05:11:29.723816+0000","last_became_peered":"2024-09-10T05:11:29.723816+0000","last_unstale":"2024-09-10T05:15:09.371665+0000","last_undegraded":"2024-09-10T05:15:09.371665+0000","last_fullsized":"2024-09-10T05:15:09.371665+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:09.371549+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:09.371549+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.371549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:50.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.054715+0000","last_change":"2024-09-10T05:15:11.054715+0000","last_active":"2024-09-10T05:15:11.054715+0000","last_peered":"2024-09-10T05:15:11.054715+0000","last_clean":"2024-09-10T05:15:11.054715+0000","last_became_active":"2024-09-10T05:11:27.736370+0000","last_became_peered":"2024-09-10T05:11:27.736370+0000","last_unstale":"2024-09-10T05:15:11.054715+0000","last_undegraded":"2024-09-10T05:15:11.054715+0000","last_fullsized":"2024-09-10T05:15:11.054715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:11.054610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:11.054610+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.054610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:14.341859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.066856+0000","last_change":"2024-09-10T05:15:10.066856+0000","last_active":"2024-09-10T05:15:10.066856+0000","last_peered":"2024-09-10T05:15:10.066856+0000","last_clean":"2024-09-10T05:15:10.066856+0000","last_became_active":"2024-09-10T05:11:27.731202+0000","last_became_peered":"2024-09-10T05:11:27.731202+0000","last_unstale":"2024-09-10T05:15:10.066856+0000","last_undegraded":"2024-09-10T05:15:10.066856+0000","last_fullsized":"2024-09-10T05:15:10.066856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:10.066744+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:10.066744+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.066744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:52.986117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.611484+0000","last_change":"2024-09-10T05:15:11.611484+0000","last_active":"2024-09-10T05:15:11.611484+0000","last_peered":"2024-09-10T05:15:11.611484+0000","last_clean":"2024-09-10T05:15:11.611484+0000","last_became_active":"2024-09-10T05:11:29.723467+0000","last_became_peered":"2024-09-10T05:11:29.723467+0000","last_unstale":"2024-09-10T05:15:11.611484+0000","last_undegraded":"2024-09-10T05:15:11.611484+0000","last_fullsized":"2024-09-10T05:15:11.611484+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:11.611402+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:11.611402+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.611402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:40.804159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.480235+0000","last_change":"2024-09-10T05:14:58.480235+0000","last_active":"2024-09-10T05:14:58.480235+0000","last_peered":"2024-09-10T05:14:58.480235+0000","last_clean":"2024-09-10T05:14:58.480235+0000","last_became_active":"2024-09-10T05:11:27.713659+0000","last_became_peered":"2024-09-10T05:11:27.713659+0000","last_unstale":"2024-09-10T05:14:58.480235+0000","last_undegraded":"2024-09-10T05:14:58.480235+0000","last_fullsized":"2024-09-10T05:14:58.480235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.480141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.480141+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.480141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:58.809531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'10","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.277001+0000","last_change":"2024-09-10T05:15:19.277001+0000","last_active":"2024-09-10T05:15:19.277001+0000","last_peered":"2024-09-10T05:15:19.277001+0000","last_clean":"2024-09-10T05:15:19.277001+0000","last_became_active":"2024-09-10T05:12:04.964552+0000","last_became_peered":"2024-09-10T05:12:04.964552+0000","last_unstale":"2024-09-10T05:15:19.277001+0000","last_undegraded":"2024-09-10T05:15:19.277001+0000","last_fullsized":"2024-09-10T05:15:19.277001+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:15:19.276901+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:15:19.276901+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.276901+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:58.105940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":630,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1624,"ondisk_log_size":1624,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":479,"ondisk_log_size":479,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640310,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":160879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640311,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":749393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640311,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335460,"statfs":{"total":96636764160,"available":96599511040,"internally_reserved":0,"allocated":1060864,"data_stored":750309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39968,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331872,"statfs":{"total":96636764160,"available":96595836928,"internally_reserved":0,"allocated":475136,"data_stored":160447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:15:28.316 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.316 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.316 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.317 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.317 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.317 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.317 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.317 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.317 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.317 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.318 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.318 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.318 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.318 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.318 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.318 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.318 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.318 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.318 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.319 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.319 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.319 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.319 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.319 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.319 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.319 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.319 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.319 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.320 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.320 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.320 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.320 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.320 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.320 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.320 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.320 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.320 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.321 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.321 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.321 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.321 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.321 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.321 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.321 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.321 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.322 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.322 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.322 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.322 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.322 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.322 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.322 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.322 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.323 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.323 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.323 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.323 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.323 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.323 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.323 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.323 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.324 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.324 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.324 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.324 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.324 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.324 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.324 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.324 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.325 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.325 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.325 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.325 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.325 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.325 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.325 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.325 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.326 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.326 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.326 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.326 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.326 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.326 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.326 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.326 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.326 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.327 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.327 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.327 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.327 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.327 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.327 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.327 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.327 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.328 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T05:11:30.712575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=30, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.328 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.328 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.328 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.328 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.328 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.328 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.328 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.328 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.329 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.329 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.329 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.329 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.329 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.329 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.329 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T05:11:28.697551+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=28, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:28.330 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T05:15:48.332 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:15:48.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.441+0000 7fa72369d640 1 Processor -- start 2024-09-10T05:15:48.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.441+0000 7fa72369d640 1 -- start start 2024-09-10T05:15:48.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.442+0000 7fa72369d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa71c112730 0x7fa71c112b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:15:48.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.442+0000 7fa72369d640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa71c06dc00 con 0x7fa71c113050 2024-09-10T05:15:48.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.442+0000 7fa72369d640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fa71c113c00 con 0x7fa71c112730 2024-09-10T05:15:48.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.442+0000 7fa721439640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa71c112730 0x7fa71c112b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:15:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.442+0000 7fa720c38640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa71c113050 0x7fa71c122180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:39606/0 (socket says 172.21.15.139:39606) 2024-09-10T05:15:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.442+0000 7fa720c38640 1 -- 172.21.15.139:0/990418856 learned_addr learned my addr 172.21.15.139:0/990418856 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:15:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.442+0000 7fa721439640 1 -- 172.21.15.139:0/990418856 >> v1:172.21.15.139:6789/0 conn(0x7fa71c113050 legacy=0x7fa71c122180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:15:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.442+0000 7fa721439640 1 -- 172.21.15.139:0/990418856 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71c073a70 con 0x7fa71c112730 2024-09-10T05:15:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.442+0000 7fa713fff640 1 -- 172.21.15.139:0/990418856 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481104898 0 0) 0x7fa71c06dc00 con 0x7fa71c113050 2024-09-10T05:15:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.443+0000 7fa721439640 1 --2- 172.21.15.139:0/990418856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa71c112730 0x7fa71c112b10 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa71800b9c0 tx=0x7fa71802c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddc36c8d1b31e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:15:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.443+0000 7fa713fff640 1 -- 172.21.15.139:0/990418856 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa718031640 con 0x7fa71c112730 2024-09-10T05:15:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.443+0000 7fa713fff640 1 -- 172.21.15.139:0/990418856 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7180317e0 con 0x7fa71c112730 2024-09-10T05:15:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.443+0000 7fa713fff640 1 -- 172.21.15.139:0/990418856 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa718031ae0 con 0x7fa71c112730 2024-09-10T05:15:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.444+0000 7fa72369d640 1 -- 172.21.15.139:0/990418856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa71c112730 msgr2=0x7fa71c112b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:15:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.444+0000 7fa72369d640 1 --2- 172.21.15.139:0/990418856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa71c112730 0x7fa71c112b10 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa71800b9c0 tx=0x7fa71802c7e0 comp rx=0 tx=0).stop 2024-09-10T05:15:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.444+0000 7fa72369d640 1 -- 172.21.15.139:0/990418856 shutdown_connections 2024-09-10T05:15:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.444+0000 7fa72369d640 1 --2- 172.21.15.139:0/990418856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa71c112730 0x7fa71c112b10 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:15:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.444+0000 7fa72369d640 1 -- 172.21.15.139:0/990418856 >> 172.21.15.139:0/990418856 conn(0x7fa71c070850 msgr2=0x7fa71c072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:15:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.444+0000 7fa72369d640 1 -- 172.21.15.139:0/990418856 shutdown_connections 2024-09-10T05:15:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.444+0000 7fa72369d640 1 -- 172.21.15.139:0/990418856 wait complete. 2024-09-10T05:15:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.445+0000 7fa72369d640 1 Processor -- start 2024-09-10T05:15:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.445+0000 7fa72369d640 1 -- start start 2024-09-10T05:15:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.445+0000 7fa72369d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa71c112730 0x7fa71c1187b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:15:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.445+0000 7fa72369d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c122a10 con 0x7fa71c112730 2024-09-10T05:15:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.445+0000 7fa721439640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa71c112730 0x7fa71c1187b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:15:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.445+0000 7fa721439640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa71c112730 0x7fa71c1187b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51876/0 (socket says 172.21.15.139:51876) 2024-09-10T05:15:48.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.445+0000 7fa721439640 1 -- 172.21.15.139:0/2422801486 learned_addr learned my addr 172.21.15.139:0/2422801486 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:15:48.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.445+0000 7fa721439640 1 -- 172.21.15.139:0/2422801486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71c11a130 con 0x7fa71c112730 2024-09-10T05:15:48.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.446+0000 7fa721439640 1 --2- 172.21.15.139:0/2422801486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa71c112730 0x7fa71c1187b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa71800b9c0 tx=0x7fa7180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:15:48.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.446+0000 7fa711ffb640 1 -- 172.21.15.139:0/2422801486 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa718041070 con 0x7fa71c112730 2024-09-10T05:15:48.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.446+0000 7fa711ffb640 1 -- 172.21.15.139:0/2422801486 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa718031cd0 con 0x7fa71c112730 2024-09-10T05:15:48.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.446+0000 7fa711ffb640 1 -- 172.21.15.139:0/2422801486 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa718031ae0 con 0x7fa71c112730 2024-09-10T05:15:48.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.446+0000 7fa72369d640 1 -- 172.21.15.139:0/2422801486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa71c11b260 con 0x7fa71c112730 2024-09-10T05:15:48.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.446+0000 7fa72369d640 1 -- 172.21.15.139:0/2422801486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa71c118cf0 con 0x7fa71c112730 2024-09-10T05:15:48.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.447+0000 7fa711ffb640 1 -- 172.21.15.139:0/2422801486 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fa718044070 con 0x7fa71c112730 2024-09-10T05:15:48.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.447+0000 7fa72369d640 1 -- 172.21.15.139:0/2422801486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa71c11ae10 con 0x7fa71c112730 2024-09-10T05:15:48.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.447+0000 7fa711ffb640 1 --2- 172.21.15.139:0/2422801486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa70003de10 0x7fa7000402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:15:48.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.447+0000 7fa711ffb640 1 -- 172.21.15.139:0/2422801486 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fa718073e80 con 0x7fa71c112730 2024-09-10T05:15:48.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.448+0000 7fa720c38640 1 --2- 172.21.15.139:0/2422801486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa70003de10 0x7fa7000402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:15:48.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.448+0000 7fa720c38640 1 --2- 172.21.15.139:0/2422801486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa70003de10 0x7fa7000402d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa70c000c00 tx=0x7fa70c0078d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:15:48.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.452+0000 7fa711ffb640 1 -- 172.21.15.139:0/2422801486 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fa718031720 con 0x7fa71c112730 2024-09-10T05:15:48.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.621+0000 7fa72369d640 1 -- 172.21.15.139:0/2422801486 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa71c126540 con 0x7fa70003de10 2024-09-10T05:15:48.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.632+0000 7fa711ffb640 1 -- 172.21.15.139:0/2422801486 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665936 (secure 0 0 0) 0x7fa70c0070d0 con 0x7fa70003de10 2024-09-10T05:15:48.641 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:15:48.646 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-10T05:15:48.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.636+0000 7fa72369d640 1 -- 172.21.15.139:0/2422801486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa70003de10 msgr2=0x7fa7000402d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:15:48.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.636+0000 7fa72369d640 1 --2- 172.21.15.139:0/2422801486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa70003de10 0x7fa7000402d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa70c000c00 tx=0x7fa70c0078d0 comp rx=0 tx=0).stop 2024-09-10T05:15:48.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.636+0000 7fa72369d640 1 -- 172.21.15.139:0/2422801486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa71c112730 msgr2=0x7fa71c1187b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:15:48.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.636+0000 7fa72369d640 1 --2- 172.21.15.139:0/2422801486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa71c112730 0x7fa71c1187b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa71800b9c0 tx=0x7fa7180046c0 comp rx=0 tx=0).stop 2024-09-10T05:15:48.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.636+0000 7fa72369d640 1 -- 172.21.15.139:0/2422801486 shutdown_connections 2024-09-10T05:15:48.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.637+0000 7fa72369d640 1 --2- 172.21.15.139:0/2422801486 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fa70003de10 0x7fa7000402d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:15:48.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.637+0000 7fa72369d640 1 --2- 172.21.15.139:0/2422801486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa71c112730 0x7fa71c1187b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:15:48.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.637+0000 7fa72369d640 1 -- 172.21.15.139:0/2422801486 >> 172.21.15.139:0/2422801486 conn(0x7fa71c070850 msgr2=0x7fa71c072420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:15:48.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.637+0000 7fa72369d640 1 -- 172.21.15.139:0/2422801486 shutdown_connections 2024-09-10T05:15:48.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:15:48.637+0000 7fa72369d640 1 -- 172.21.15.139:0/2422801486 wait complete. 2024-09-10T05:15:48.650 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-10T05:15:47.960780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5433,"num_read_kb":4987,"num_write":2313,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1685,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4936,"ondisk_log_size":4936,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165184,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322176,"statfs":{"total":386547056640,"available":386377908224,"internally_reserved":0,"allocated":3080192,"data_stored":1821028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004273"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.686266+0000","last_change":"2024-09-10T05:15:00.686212+0000","last_active":"2024-09-10T05:15:00.686266+0000","last_peered":"2024-09-10T05:15:00.686266+0000","last_clean":"2024-09-10T05:15:00.686266+0000","last_became_active":"2024-09-10T05:11:27.716775+0000","last_became_peered":"2024-09-10T05:11:27.716775+0000","last_unstale":"2024-09-10T05:15:00.686266+0000","last_undegraded":"2024-09-10T05:15:00.686266+0000","last_fullsized":"2024-09-10T05:15:00.686266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:00.686129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:00.686129+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.686129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.852215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.239534+0000","last_change":"2024-09-10T05:15:18.239534+0000","last_active":"2024-09-10T05:15:18.239534+0000","last_peered":"2024-09-10T05:15:18.239534+0000","last_clean":"2024-09-10T05:15:18.239534+0000","last_became_active":"2024-09-10T05:11:29.733565+0000","last_became_peered":"2024-09-10T05:11:29.733565+0000","last_unstale":"2024-09-10T05:15:18.239534+0000","last_undegraded":"2024-09-10T05:15:18.239534+0000","last_fullsized":"2024-09-10T05:15:18.239534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:18.239427+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:18.239427+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.239427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:47.176915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.473256+0000","last_change":"2024-09-10T05:15:00.473123+0000","last_active":"2024-09-10T05:15:00.473256+0000","last_peered":"2024-09-10T05:15:00.473256+0000","last_clean":"2024-09-10T05:15:00.473256+0000","last_became_active":"2024-09-10T05:11:27.713698+0000","last_became_peered":"2024-09-10T05:11:27.713698+0000","last_unstale":"2024-09-10T05:15:00.473256+0000","last_undegraded":"2024-09-10T05:15:00.473256+0000","last_fullsized":"2024-09-10T05:15:00.473256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:00.473021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:00.473021+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.473021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:20.018847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'10","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:31.924354+0000","last_change":"2024-09-10T05:15:31.924354+0000","last_active":"2024-09-10T05:15:31.924354+0000","last_peered":"2024-09-10T05:15:31.924354+0000","last_clean":"2024-09-10T05:15:31.924354+0000","last_became_active":"2024-09-10T05:11:29.728621+0000","last_became_peered":"2024-09-10T05:11:29.728621+0000","last_unstale":"2024-09-10T05:15:31.924354+0000","last_undegraded":"2024-09-10T05:15:31.924354+0000","last_fullsized":"2024-09-10T05:15:31.924354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:15:31.924269+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:15:31.924269+0000","last_clean_scrub_stamp":"2024-09-10T05:15:31.924269+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:41.446801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.073847+0000","last_change":"2024-09-10T05:15:15.073781+0000","last_active":"2024-09-10T05:15:15.073847+0000","last_peered":"2024-09-10T05:15:15.073847+0000","last_clean":"2024-09-10T05:15:15.073847+0000","last_became_active":"2024-09-10T05:11:27.733147+0000","last_became_peered":"2024-09-10T05:11:27.733147+0000","last_unstale":"2024-09-10T05:15:15.073847+0000","last_undegraded":"2024-09-10T05:15:15.073847+0000","last_fullsized":"2024-09-10T05:15:15.073847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:15.073683+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:15.073683+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.073683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:55.579728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:32.960484+0000","last_change":"2024-09-10T05:15:32.960484+0000","last_active":"2024-09-10T05:15:32.960484+0000","last_peered":"2024-09-10T05:15:32.960484+0000","last_clean":"2024-09-10T05:15:32.960484+0000","last_became_active":"2024-09-10T05:11:29.728696+0000","last_became_peered":"2024-09-10T05:11:29.728696+0000","last_unstale":"2024-09-10T05:15:32.960484+0000","last_undegraded":"2024-09-10T05:15:32.960484+0000","last_fullsized":"2024-09-10T05:15:32.960484+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:32.960388+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:32.960388+0000","last_clean_scrub_stamp":"2024-09-10T05:15:32.960388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:36.297564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.676875+0000","last_change":"2024-09-10T05:14:58.676818+0000","last_active":"2024-09-10T05:14:58.676875+0000","last_peered":"2024-09-10T05:14:58.676875+0000","last_clean":"2024-09-10T05:14:58.676875+0000","last_became_active":"2024-09-10T05:11:27.722701+0000","last_became_peered":"2024-09-10T05:11:27.722701+0000","last_unstale":"2024-09-10T05:14:58.676875+0000","last_undegraded":"2024-09-10T05:14:58.676875+0000","last_fullsized":"2024-09-10T05:14:58.676875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.676697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.676697+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.676697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:08.137298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'22","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.003330+0000","last_change":"2024-09-10T05:15:34.003330+0000","last_active":"2024-09-10T05:15:34.003330+0000","last_peered":"2024-09-10T05:15:34.003330+0000","last_clean":"2024-09-10T05:15:34.003330+0000","last_became_active":"2024-09-10T05:11:29.731850+0000","last_became_peered":"2024-09-10T05:11:29.731850+0000","last_unstale":"2024-09-10T05:15:34.003330+0000","last_undegraded":"2024-09-10T05:15:34.003330+0000","last_fullsized":"2024-09-10T05:15:34.003330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-10T05:15:34.003213+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-10T05:15:34.003213+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.003213+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:18.186667+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.056519+0000","last_change":"2024-09-10T05:15:14.056519+0000","last_active":"2024-09-10T05:15:14.056519+0000","last_peered":"2024-09-10T05:15:14.056519+0000","last_clean":"2024-09-10T05:15:14.056519+0000","last_became_active":"2024-09-10T05:11:27.732922+0000","last_became_peered":"2024-09-10T05:11:27.732922+0000","last_unstale":"2024-09-10T05:15:14.056519+0000","last_undegraded":"2024-09-10T05:15:14.056519+0000","last_fullsized":"2024-09-10T05:15:14.056519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:14.056436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:14.056436+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.056436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:49.245406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.288006+0000","last_change":"2024-09-10T05:15:16.287941+0000","last_active":"2024-09-10T05:15:16.288006+0000","last_peered":"2024-09-10T05:15:16.288006+0000","last_clean":"2024-09-10T05:15:16.288006+0000","last_became_active":"2024-09-10T05:11:29.722189+0000","last_became_peered":"2024-09-10T05:11:29.722189+0000","last_unstale":"2024-09-10T05:15:16.288006+0000","last_undegraded":"2024-09-10T05:15:16.288006+0000","last_fullsized":"2024-09-10T05:15:16.288006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:16.287854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:16.287854+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.287854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.329858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.707592+0000","last_change":"2024-09-10T05:14:57.707592+0000","last_active":"2024-09-10T05:14:57.707592+0000","last_peered":"2024-09-10T05:14:57.707592+0000","last_clean":"2024-09-10T05:14:57.707592+0000","last_became_active":"2024-09-10T05:11:27.706559+0000","last_became_peered":"2024-09-10T05:11:27.706559+0000","last_unstale":"2024-09-10T05:14:57.707592+0000","last_undegraded":"2024-09-10T05:14:57.707592+0000","last_fullsized":"2024-09-10T05:14:57.707592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:57.707507+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:57.707507+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.707507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:37.363037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:35.953580+0000","last_change":"2024-09-10T05:15:35.953519+0000","last_active":"2024-09-10T05:15:35.953580+0000","last_peered":"2024-09-10T05:15:35.953580+0000","last_clean":"2024-09-10T05:15:35.953580+0000","last_became_active":"2024-09-10T05:11:29.730492+0000","last_became_peered":"2024-09-10T05:11:29.730492+0000","last_unstale":"2024-09-10T05:15:35.953580+0000","last_undegraded":"2024-09-10T05:15:35.953580+0000","last_fullsized":"2024-09-10T05:15:35.953580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:35.953428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:35.953428+0000","last_clean_scrub_stamp":"2024-09-10T05:15:35.953428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:26.676535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.012797+0000","last_change":"2024-09-10T05:15:13.012797+0000","last_active":"2024-09-10T05:15:13.012797+0000","last_peered":"2024-09-10T05:15:13.012797+0000","last_clean":"2024-09-10T05:15:13.012797+0000","last_became_active":"2024-09-10T05:11:27.718363+0000","last_became_peered":"2024-09-10T05:11:27.718363+0000","last_unstale":"2024-09-10T05:15:13.012797+0000","last_undegraded":"2024-09-10T05:15:13.012797+0000","last_fullsized":"2024-09-10T05:15:13.012797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:13.012701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:13.012701+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.012701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:59.217408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.740078+0000","last_change":"2024-09-10T05:15:13.739994+0000","last_active":"2024-09-10T05:15:13.740078+0000","last_peered":"2024-09-10T05:15:13.740078+0000","last_clean":"2024-09-10T05:15:13.740078+0000","last_became_active":"2024-09-10T05:11:29.726884+0000","last_became_peered":"2024-09-10T05:11:29.726884+0000","last_unstale":"2024-09-10T05:15:13.740078+0000","last_undegraded":"2024-09-10T05:15:13.740078+0000","last_fullsized":"2024-09-10T05:15:13.740078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:13.739888+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:13.739888+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.739888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:29.267677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.496721+0000","last_change":"2024-09-10T05:14:59.496721+0000","last_active":"2024-09-10T05:14:59.496721+0000","last_peered":"2024-09-10T05:14:59.496721+0000","last_clean":"2024-09-10T05:14:59.496721+0000","last_became_active":"2024-09-10T05:11:27.718868+0000","last_became_peered":"2024-09-10T05:11:27.718868+0000","last_unstale":"2024-09-10T05:14:59.496721+0000","last_undegraded":"2024-09-10T05:14:59.496721+0000","last_fullsized":"2024-09-10T05:14:59.496721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:59.496621+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:59.496621+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.496621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:59.831011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.726027+0000","last_change":"2024-09-10T05:15:11.725923+0000","last_active":"2024-09-10T05:15:11.726027+0000","last_peered":"2024-09-10T05:15:11.726027+0000","last_clean":"2024-09-10T05:15:11.726027+0000","last_became_active":"2024-09-10T05:11:29.723497+0000","last_became_peered":"2024-09-10T05:11:29.723497+0000","last_unstale":"2024-09-10T05:15:11.726027+0000","last_undegraded":"2024-09-10T05:15:11.726027+0000","last_fullsized":"2024-09-10T05:15:11.726027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:11.725827+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:11.725827+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.725827+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:27.991023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:30.951922+0000","last_change":"2024-09-10T05:15:30.951922+0000","last_active":"2024-09-10T05:15:30.951922+0000","last_peered":"2024-09-10T05:15:30.951922+0000","last_clean":"2024-09-10T05:15:30.951922+0000","last_became_active":"2024-09-10T05:11:29.727536+0000","last_became_peered":"2024-09-10T05:11:29.727536+0000","last_unstale":"2024-09-10T05:15:30.951922+0000","last_undegraded":"2024-09-10T05:15:30.951922+0000","last_fullsized":"2024-09-10T05:15:30.951922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:30.951821+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:30.951821+0000","last_clean_scrub_stamp":"2024-09-10T05:15:30.951821+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:46.376233+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.476686+0000","last_change":"2024-09-10T05:14:59.476686+0000","last_active":"2024-09-10T05:14:59.476686+0000","last_peered":"2024-09-10T05:14:59.476686+0000","last_clean":"2024-09-10T05:14:59.476686+0000","last_became_active":"2024-09-10T05:11:27.728114+0000","last_became_peered":"2024-09-10T05:11:27.728114+0000","last_unstale":"2024-09-10T05:14:59.476686+0000","last_undegraded":"2024-09-10T05:14:59.476686+0000","last_fullsized":"2024-09-10T05:14:59.476686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:59.476601+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:59.476601+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.476601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:04.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.247977+0000","last_change":"2024-09-10T05:15:14.247977+0000","last_active":"2024-09-10T05:15:14.247977+0000","last_peered":"2024-09-10T05:15:14.247977+0000","last_clean":"2024-09-10T05:15:14.247977+0000","last_became_active":"2024-09-10T05:11:29.732864+0000","last_became_peered":"2024-09-10T05:11:29.732864+0000","last_unstale":"2024-09-10T05:15:14.247977+0000","last_undegraded":"2024-09-10T05:15:14.247977+0000","last_fullsized":"2024-09-10T05:15:14.247977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:14.247889+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:14.247889+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.247889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:06.302257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.645979+0000","last_change":"2024-09-10T05:15:02.645979+0000","last_active":"2024-09-10T05:15:02.645979+0000","last_peered":"2024-09-10T05:15:02.645979+0000","last_clean":"2024-09-10T05:15:02.645979+0000","last_became_active":"2024-09-10T05:11:27.706698+0000","last_became_peered":"2024-09-10T05:11:27.706698+0000","last_unstale":"2024-09-10T05:15:02.645979+0000","last_undegraded":"2024-09-10T05:15:02.645979+0000","last_fullsized":"2024-09-10T05:15:02.645979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:02.645892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:02.645892+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.645892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:35.605736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'10","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.286808+0000","last_change":"2024-09-10T05:15:17.286808+0000","last_active":"2024-09-10T05:15:17.286808+0000","last_peered":"2024-09-10T05:15:17.286808+0000","last_clean":"2024-09-10T05:15:17.286808+0000","last_became_active":"2024-09-10T05:11:29.731842+0000","last_became_peered":"2024-09-10T05:11:29.731842+0000","last_unstale":"2024-09-10T05:15:17.286808+0000","last_undegraded":"2024-09-10T05:15:17.286808+0000","last_fullsized":"2024-09-10T05:15:17.286808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:15:17.286726+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:15:17.286726+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.286726+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:48.199975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.476461+0000","last_change":"2024-09-10T05:14:58.476461+0000","last_active":"2024-09-10T05:14:58.476461+0000","last_peered":"2024-09-10T05:14:58.476461+0000","last_clean":"2024-09-10T05:14:58.476461+0000","last_became_active":"2024-09-10T05:11:27.719257+0000","last_became_peered":"2024-09-10T05:11:27.719257+0000","last_unstale":"2024-09-10T05:14:58.476461+0000","last_undegraded":"2024-09-10T05:14:58.476461+0000","last_fullsized":"2024-09-10T05:14:58.476461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.476369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.476369+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.476369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:03.036373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.654931+0000","last_change":"2024-09-10T05:15:10.654931+0000","last_active":"2024-09-10T05:15:10.654931+0000","last_peered":"2024-09-10T05:15:10.654931+0000","last_clean":"2024-09-10T05:15:10.654931+0000","last_became_active":"2024-09-10T05:12:04.967642+0000","last_became_peered":"2024-09-10T05:12:04.967642+0000","last_unstale":"2024-09-10T05:15:10.654931+0000","last_undegraded":"2024-09-10T05:15:10.654931+0000","last_fullsized":"2024-09-10T05:15:10.654931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:10.654800+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:10.654800+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.654800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:19.179150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"37'3","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.500764+0000","last_change":"2024-09-10T05:14:55.500764+0000","last_active":"2024-09-10T05:14:55.500764+0000","last_peered":"2024-09-10T05:14:55.500764+0000","last_clean":"2024-09-10T05:14:55.500764+0000","last_became_active":"2024-09-10T05:11:27.724439+0000","last_became_peered":"2024-09-10T05:11:27.724439+0000","last_unstale":"2024-09-10T05:14:55.500764+0000","last_undegraded":"2024-09-10T05:14:55.500764+0000","last_fullsized":"2024-09-10T05:14:55.500764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:14:55.500672+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:14:55.500672+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.500672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:26.970541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.746780+0000","last_change":"2024-09-10T05:15:09.746780+0000","last_active":"2024-09-10T05:15:09.746780+0000","last_peered":"2024-09-10T05:15:09.746780+0000","last_clean":"2024-09-10T05:15:09.746780+0000","last_became_active":"2024-09-10T05:11:29.722894+0000","last_became_peered":"2024-09-10T05:11:29.722894+0000","last_unstale":"2024-09-10T05:15:09.746780+0000","last_undegraded":"2024-09-10T05:15:09.746780+0000","last_fullsized":"2024-09-10T05:15:09.746780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:09.746683+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:09.746683+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.746683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:47.372939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.710949+0000","last_change":"2024-09-10T05:15:16.710949+0000","last_active":"2024-09-10T05:15:16.710949+0000","last_peered":"2024-09-10T05:15:16.710949+0000","last_clean":"2024-09-10T05:15:16.710949+0000","last_became_active":"2024-09-10T05:11:27.714926+0000","last_became_peered":"2024-09-10T05:11:27.714926+0000","last_unstale":"2024-09-10T05:15:16.710949+0000","last_undegraded":"2024-09-10T05:15:16.710949+0000","last_fullsized":"2024-09-10T05:15:16.710949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:16.710850+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:16.710850+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.710850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:15.748556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.253244+0000","last_change":"2024-09-10T05:15:15.253244+0000","last_active":"2024-09-10T05:15:15.253244+0000","last_peered":"2024-09-10T05:15:15.253244+0000","last_clean":"2024-09-10T05:15:15.253244+0000","last_became_active":"2024-09-10T05:11:29.721876+0000","last_became_peered":"2024-09-10T05:11:29.721876+0000","last_unstale":"2024-09-10T05:15:15.253244+0000","last_undegraded":"2024-09-10T05:15:15.253244+0000","last_fullsized":"2024-09-10T05:15:15.253244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:15.253159+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:15.253159+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.253159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:20.248120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.060849+0000","last_change":"2024-09-10T05:15:12.060849+0000","last_active":"2024-09-10T05:15:12.060849+0000","last_peered":"2024-09-10T05:15:12.060849+0000","last_clean":"2024-09-10T05:15:12.060849+0000","last_became_active":"2024-09-10T05:11:27.720197+0000","last_became_peered":"2024-09-10T05:11:27.720197+0000","last_unstale":"2024-09-10T05:15:12.060849+0000","last_undegraded":"2024-09-10T05:15:12.060849+0000","last_fullsized":"2024-09-10T05:15:12.060849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:12.060756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:12.060756+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.060756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:16.632715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.361804+0000","last_change":"2024-09-10T05:11:37.763268+0000","last_active":"2024-09-10T05:14:36.361804+0000","last_peered":"2024-09-10T05:14:36.361804+0000","last_clean":"2024-09-10T05:14:36.361804+0000","last_became_active":"2024-09-10T05:11:37.763019+0000","last_became_peered":"2024-09-10T05:11:37.763019+0000","last_unstale":"2024-09-10T05:14:36.361804+0000","last_undegraded":"2024-09-10T05:14:36.361804+0000","last_fullsized":"2024-09-10T05:14:36.361804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:54.698085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.009597+0000","last_change":"2024-09-10T05:15:22.009597+0000","last_active":"2024-09-10T05:15:22.009597+0000","last_peered":"2024-09-10T05:15:22.009597+0000","last_clean":"2024-09-10T05:15:22.009597+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:15:22.009597+0000","last_undegraded":"2024-09-10T05:15:22.009597+0000","last_fullsized":"2024-09-10T05:15:22.009597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:22.009499+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:22.009499+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.009499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:02.796822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.908025+0000","last_change":"2024-09-10T05:14:59.908025+0000","last_active":"2024-09-10T05:14:59.908025+0000","last_peered":"2024-09-10T05:14:59.908025+0000","last_clean":"2024-09-10T05:14:59.908025+0000","last_became_active":"2024-09-10T05:11:27.733612+0000","last_became_peered":"2024-09-10T05:11:27.733612+0000","last_unstale":"2024-09-10T05:14:59.908025+0000","last_undegraded":"2024-09-10T05:14:59.908025+0000","last_fullsized":"2024-09-10T05:14:59.908025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:59.907936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:59.907936+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.907936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:14.244325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:43.025760+0000","last_change":"2024-09-10T05:15:43.025760+0000","last_active":"2024-09-10T05:15:43.025760+0000","last_peered":"2024-09-10T05:15:43.025760+0000","last_clean":"2024-09-10T05:15:43.025760+0000","last_became_active":"2024-09-10T05:11:31.736788+0000","last_became_peered":"2024-09-10T05:11:31.736788+0000","last_unstale":"2024-09-10T05:15:43.025760+0000","last_undegraded":"2024-09-10T05:15:43.025760+0000","last_fullsized":"2024-09-10T05:15:43.025760+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:43.025669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:43.025669+0000","last_clean_scrub_stamp":"2024-09-10T05:15:43.025669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:43.646838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'47","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.081131+0000","last_change":"2024-09-10T05:11:33.746939+0000","last_active":"2024-09-10T05:14:43.081131+0000","last_peered":"2024-09-10T05:14:43.081131+0000","last_clean":"2024-09-10T05:14:43.081131+0000","last_became_active":"2024-09-10T05:11:33.746595+0000","last_became_peered":"2024-09-10T05:11:33.746595+0000","last_unstale":"2024-09-10T05:14:43.081131+0000","last_undegraded":"2024-09-10T05:14:43.081131+0000","last_fullsized":"2024-09-10T05:14:43.081131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:39.379252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:38.127688+0000","last_change":"2024-09-10T05:15:38.127688+0000","last_active":"2024-09-10T05:15:38.127688+0000","last_peered":"2024-09-10T05:15:38.127688+0000","last_clean":"2024-09-10T05:15:38.127688+0000","last_became_active":"2024-09-10T05:11:35.746594+0000","last_became_peered":"2024-09-10T05:11:35.746594+0000","last_unstale":"2024-09-10T05:15:38.127688+0000","last_undegraded":"2024-09-10T05:15:38.127688+0000","last_fullsized":"2024-09-10T05:15:38.127688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:38.127605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:38.127605+0000","last_clean_scrub_stamp":"2024-09-10T05:15:38.127605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:08.742502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.968440+0000","last_change":"2024-09-10T05:11:37.756768+0000","last_active":"2024-09-10T05:12:51.968440+0000","last_peered":"2024-09-10T05:12:51.968440+0000","last_clean":"2024-09-10T05:12:51.968440+0000","last_became_active":"2024-09-10T05:11:37.756495+0000","last_became_peered":"2024-09-10T05:11:37.756495+0000","last_unstale":"2024-09-10T05:12:51.968440+0000","last_undegraded":"2024-09-10T05:12:51.968440+0000","last_fullsized":"2024-09-10T05:12:51.968440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:13.070344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.037012+0000","last_change":"2024-09-10T05:15:23.037012+0000","last_active":"2024-09-10T05:15:23.037012+0000","last_peered":"2024-09-10T05:15:23.037012+0000","last_clean":"2024-09-10T05:15:23.037012+0000","last_became_active":"2024-09-10T05:11:29.732267+0000","last_became_peered":"2024-09-10T05:11:29.732267+0000","last_unstale":"2024-09-10T05:15:23.037012+0000","last_undegraded":"2024-09-10T05:15:23.037012+0000","last_fullsized":"2024-09-10T05:15:23.037012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:23.036921+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:23.036921+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.036921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:21.103347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.746344+0000","last_change":"2024-09-10T05:14:52.746344+0000","last_active":"2024-09-10T05:14:52.746344+0000","last_peered":"2024-09-10T05:14:52.746344+0000","last_clean":"2024-09-10T05:14:52.746344+0000","last_became_active":"2024-09-10T05:11:27.726599+0000","last_became_peered":"2024-09-10T05:11:27.726599+0000","last_unstale":"2024-09-10T05:14:52.746344+0000","last_undegraded":"2024-09-10T05:14:52.746344+0000","last_fullsized":"2024-09-10T05:14:52.746344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.746259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.746259+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.746259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:50.519180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.670477+0000","last_change":"2024-09-10T05:15:20.670477+0000","last_active":"2024-09-10T05:15:20.670477+0000","last_peered":"2024-09-10T05:15:20.670477+0000","last_clean":"2024-09-10T05:15:20.670477+0000","last_became_active":"2024-09-10T05:11:31.731231+0000","last_became_peered":"2024-09-10T05:11:31.731231+0000","last_unstale":"2024-09-10T05:15:20.670477+0000","last_undegraded":"2024-09-10T05:15:20.670477+0000","last_fullsized":"2024-09-10T05:15:20.670477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:20.670391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:20.670391+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.670391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:50.967791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"37'17","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:31.220968+0000","last_change":"2024-09-10T05:15:31.220968+0000","last_active":"2024-09-10T05:15:31.220968+0000","last_peered":"2024-09-10T05:15:31.220968+0000","last_clean":"2024-09-10T05:15:31.220968+0000","last_became_active":"2024-09-10T05:11:33.743847+0000","last_became_peered":"2024-09-10T05:11:33.743847+0000","last_unstale":"2024-09-10T05:15:31.220968+0000","last_undegraded":"2024-09-10T05:15:31.220968+0000","last_fullsized":"2024-09-10T05:15:31.220968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'17","last_scrub_stamp":"2024-09-10T05:15:31.220881+0000","last_deep_scrub":"37'17","last_deep_scrub_stamp":"2024-09-10T05:15:31.220881+0000","last_clean_scrub_stamp":"2024-09-10T05:15:31.220881+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:23.297965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:37.129655+0000","last_change":"2024-09-10T05:15:37.129655+0000","last_active":"2024-09-10T05:15:37.129655+0000","last_peered":"2024-09-10T05:15:37.129655+0000","last_clean":"2024-09-10T05:15:37.129655+0000","last_became_active":"2024-09-10T05:11:35.749634+0000","last_became_peered":"2024-09-10T05:11:35.749634+0000","last_unstale":"2024-09-10T05:15:37.129655+0000","last_undegraded":"2024-09-10T05:15:37.129655+0000","last_fullsized":"2024-09-10T05:15:37.129655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:37.129560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:37.129560+0000","last_clean_scrub_stamp":"2024-09-10T05:15:37.129560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:58.199238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.956547+0000","last_change":"2024-09-10T05:11:37.755426+0000","last_active":"2024-09-10T05:12:04.956547+0000","last_peered":"2024-09-10T05:12:04.956547+0000","last_clean":"2024-09-10T05:12:04.956547+0000","last_became_active":"2024-09-10T05:11:37.755078+0000","last_became_peered":"2024-09-10T05:11:37.755078+0000","last_unstale":"2024-09-10T05:12:04.956547+0000","last_undegraded":"2024-09-10T05:12:04.956547+0000","last_fullsized":"2024-09-10T05:12:04.956547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:03.701787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.007105+0000","last_change":"2024-09-10T05:15:24.007105+0000","last_active":"2024-09-10T05:15:24.007105+0000","last_peered":"2024-09-10T05:15:24.007105+0000","last_clean":"2024-09-10T05:15:24.007105+0000","last_became_active":"2024-09-10T05:11:29.731780+0000","last_became_peered":"2024-09-10T05:11:29.731780+0000","last_unstale":"2024-09-10T05:15:24.007105+0000","last_undegraded":"2024-09-10T05:15:24.007105+0000","last_fullsized":"2024-09-10T05:15:24.007105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:24.007017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:24.007017+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.007017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:45.996847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.998628+0000","last_change":"2024-09-10T05:15:01.998628+0000","last_active":"2024-09-10T05:15:01.998628+0000","last_peered":"2024-09-10T05:15:01.998628+0000","last_clean":"2024-09-10T05:15:01.998628+0000","last_became_active":"2024-09-10T05:11:27.732573+0000","last_became_peered":"2024-09-10T05:11:27.732573+0000","last_unstale":"2024-09-10T05:15:01.998628+0000","last_undegraded":"2024-09-10T05:15:01.998628+0000","last_fullsized":"2024-09-10T05:15:01.998628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:01.998527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:01.998527+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.998527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:38.110563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.728959+0000","last_change":"2024-09-10T05:15:16.728959+0000","last_active":"2024-09-10T05:15:16.728959+0000","last_peered":"2024-09-10T05:15:16.728959+0000","last_clean":"2024-09-10T05:15:16.728959+0000","last_became_active":"2024-09-10T05:12:04.965494+0000","last_became_peered":"2024-09-10T05:12:04.965494+0000","last_unstale":"2024-09-10T05:15:16.728959+0000","last_undegraded":"2024-09-10T05:15:16.728959+0000","last_fullsized":"2024-09-10T05:15:16.728959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:16.728878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:16.728878+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.728878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.784781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"37'29","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:26.675464+0000","last_change":"2024-09-10T05:15:26.675464+0000","last_active":"2024-09-10T05:15:26.675464+0000","last_peered":"2024-09-10T05:15:26.675464+0000","last_clean":"2024-09-10T05:15:26.675464+0000","last_became_active":"2024-09-10T05:11:33.745336+0000","last_became_peered":"2024-09-10T05:11:33.745336+0000","last_unstale":"2024-09-10T05:15:26.675464+0000","last_undegraded":"2024-09-10T05:15:26.675464+0000","last_fullsized":"2024-09-10T05:15:26.675464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'29","last_scrub_stamp":"2024-09-10T05:15:26.675347+0000","last_deep_scrub":"37'29","last_deep_scrub_stamp":"2024-09-10T05:15:26.675347+0000","last_clean_scrub_stamp":"2024-09-10T05:15:26.675347+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:29.397202+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'285","reported_seq":418,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.005466+0000","last_change":"2024-09-10T05:11:35.752548+0000","last_active":"2024-09-10T05:14:43.005466+0000","last_peered":"2024-09-10T05:14:43.005466+0000","last_clean":"2024-09-10T05:14:43.005466+0000","last_became_active":"2024-09-10T05:11:35.752290+0000","last_became_peered":"2024-09-10T05:11:35.752290+0000","last_unstale":"2024-09-10T05:14:43.005466+0000","last_undegraded":"2024-09-10T05:14:43.005466+0000","last_fullsized":"2024-09-10T05:14:43.005466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:58.244961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:39.761754+0000","last_change":"2024-09-10T05:15:39.761754+0000","last_active":"2024-09-10T05:15:39.761754+0000","last_peered":"2024-09-10T05:15:39.761754+0000","last_clean":"2024-09-10T05:15:39.761754+0000","last_became_active":"2024-09-10T05:11:37.759311+0000","last_became_peered":"2024-09-10T05:11:37.759311+0000","last_unstale":"2024-09-10T05:15:39.761754+0000","last_undegraded":"2024-09-10T05:15:39.761754+0000","last_fullsized":"2024-09-10T05:15:39.761754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:39.761663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:39.761663+0000","last_clean_scrub_stamp":"2024-09-10T05:15:39.761663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:30.436312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.495305+0000","last_change":"2024-09-10T05:15:05.495305+0000","last_active":"2024-09-10T05:15:05.495305+0000","last_peered":"2024-09-10T05:15:05.495305+0000","last_clean":"2024-09-10T05:15:05.495305+0000","last_became_active":"2024-09-10T05:11:29.723919+0000","last_became_peered":"2024-09-10T05:11:29.723919+0000","last_unstale":"2024-09-10T05:15:05.495305+0000","last_undegraded":"2024-09-10T05:15:05.495305+0000","last_fullsized":"2024-09-10T05:15:05.495305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:05.495212+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:05.495212+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.495212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:47.310404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.435128+0000","last_change":"2024-09-10T05:14:49.435128+0000","last_active":"2024-09-10T05:14:49.435128+0000","last_peered":"2024-09-10T05:14:49.435128+0000","last_clean":"2024-09-10T05:14:49.435128+0000","last_became_active":"2024-09-10T05:11:27.719835+0000","last_became_peered":"2024-09-10T05:11:27.719835+0000","last_unstale":"2024-09-10T05:14:49.435128+0000","last_undegraded":"2024-09-10T05:14:49.435128+0000","last_fullsized":"2024-09-10T05:14:49.435128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:49.435035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:49.435035+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.435035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:32.661631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:44.032974+0000","last_change":"2024-09-10T05:15:44.032974+0000","last_active":"2024-09-10T05:15:44.032974+0000","last_peered":"2024-09-10T05:15:44.032974+0000","last_clean":"2024-09-10T05:15:44.032974+0000","last_became_active":"2024-09-10T05:11:31.737411+0000","last_became_peered":"2024-09-10T05:11:31.737411+0000","last_unstale":"2024-09-10T05:15:44.032974+0000","last_undegraded":"2024-09-10T05:15:44.032974+0000","last_fullsized":"2024-09-10T05:15:44.032974+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:44.032888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:44.032888+0000","last_clean_scrub_stamp":"2024-09-10T05:15:44.032888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:02.424864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'44","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.681845+0000","last_change":"2024-09-10T05:15:27.681845+0000","last_active":"2024-09-10T05:15:27.681845+0000","last_peered":"2024-09-10T05:15:27.681845+0000","last_clean":"2024-09-10T05:15:27.681845+0000","last_became_active":"2024-09-10T05:11:33.744920+0000","last_became_peered":"2024-09-10T05:11:33.744920+0000","last_unstale":"2024-09-10T05:15:27.681845+0000","last_undegraded":"2024-09-10T05:15:27.681845+0000","last_fullsized":"2024-09-10T05:15:27.681845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'44","last_scrub_stamp":"2024-09-10T05:15:27.681741+0000","last_deep_scrub":"37'44","last_deep_scrub_stamp":"2024-09-10T05:15:27.681741+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.681741+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:58.009365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'286","reported_seq":436,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:36.610715+0000","last_change":"2024-09-10T05:15:36.610715+0000","last_active":"2024-09-10T05:15:36.610715+0000","last_peered":"2024-09-10T05:15:36.610715+0000","last_clean":"2024-09-10T05:15:36.610715+0000","last_became_active":"2024-09-10T05:11:35.748328+0000","last_became_peered":"2024-09-10T05:11:35.748328+0000","last_unstale":"2024-09-10T05:15:36.610715+0000","last_undegraded":"2024-09-10T05:15:36.610715+0000","last_fullsized":"2024-09-10T05:15:36.610715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:36.610628+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:36.610628+0000","last_clean_scrub_stamp":"2024-09-10T05:15:36.610628+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:59.554801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.072422+0000","last_change":"2024-09-10T05:15:19.072422+0000","last_active":"2024-09-10T05:15:19.072422+0000","last_peered":"2024-09-10T05:15:19.072422+0000","last_clean":"2024-09-10T05:15:19.072422+0000","last_became_active":"2024-09-10T05:11:29.735799+0000","last_became_peered":"2024-09-10T05:11:29.735799+0000","last_unstale":"2024-09-10T05:15:19.072422+0000","last_undegraded":"2024-09-10T05:15:19.072422+0000","last_fullsized":"2024-09-10T05:15:19.072422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:19.072304+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:19.072304+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.072304+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:47.414562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.750206+0000","last_change":"2024-09-10T05:14:53.750206+0000","last_active":"2024-09-10T05:14:53.750206+0000","last_peered":"2024-09-10T05:14:53.750206+0000","last_clean":"2024-09-10T05:14:53.750206+0000","last_became_active":"2024-09-10T05:11:27.716318+0000","last_became_peered":"2024-09-10T05:11:27.716318+0000","last_unstale":"2024-09-10T05:14:53.750206+0000","last_undegraded":"2024-09-10T05:14:53.750206+0000","last_fullsized":"2024-09-10T05:14:53.750206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.750095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.750095+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.750095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:30.144747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.283646+0000","last_change":"2024-09-10T05:15:21.283646+0000","last_active":"2024-09-10T05:15:21.283646+0000","last_peered":"2024-09-10T05:15:21.283646+0000","last_clean":"2024-09-10T05:15:21.283646+0000","last_became_active":"2024-09-10T05:11:31.734975+0000","last_became_peered":"2024-09-10T05:11:31.734975+0000","last_unstale":"2024-09-10T05:15:21.283646+0000","last_undegraded":"2024-09-10T05:15:21.283646+0000","last_fullsized":"2024-09-10T05:15:21.283646+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:21.283528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:21.283528+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.283528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:26.933150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'60","reported_seq":126,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.726852+0000","last_change":"2024-09-10T05:15:22.726852+0000","last_active":"2024-09-10T05:15:22.726852+0000","last_peered":"2024-09-10T05:15:22.726852+0000","last_clean":"2024-09-10T05:15:22.726852+0000","last_became_active":"2024-09-10T05:11:33.746522+0000","last_became_peered":"2024-09-10T05:11:33.746522+0000","last_unstale":"2024-09-10T05:15:22.726852+0000","last_undegraded":"2024-09-10T05:15:22.726852+0000","last_fullsized":"2024-09-10T05:15:22.726852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'60","last_scrub_stamp":"2024-09-10T05:15:22.726746+0000","last_deep_scrub":"37'60","last_deep_scrub_stamp":"2024-09-10T05:15:22.726746+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.726746+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:43:04.485808+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:35.565302+0000","last_change":"2024-09-10T05:15:35.565302+0000","last_active":"2024-09-10T05:15:35.565302+0000","last_peered":"2024-09-10T05:15:35.565302+0000","last_clean":"2024-09-10T05:15:35.565302+0000","last_became_active":"2024-09-10T05:11:35.745840+0000","last_became_peered":"2024-09-10T05:11:35.745840+0000","last_unstale":"2024-09-10T05:15:35.565302+0000","last_undegraded":"2024-09-10T05:15:35.565302+0000","last_fullsized":"2024-09-10T05:15:35.565302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:35.565219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:35.565219+0000","last_clean_scrub_stamp":"2024-09-10T05:15:35.565219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:26:21.749001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:36.705072+0000","last_change":"2024-09-10T05:15:36.705072+0000","last_active":"2024-09-10T05:15:36.705072+0000","last_peered":"2024-09-10T05:15:36.705072+0000","last_clean":"2024-09-10T05:15:36.705072+0000","last_became_active":"2024-09-10T05:11:37.754562+0000","last_became_peered":"2024-09-10T05:11:37.754562+0000","last_unstale":"2024-09-10T05:15:36.705072+0000","last_undegraded":"2024-09-10T05:15:36.705072+0000","last_fullsized":"2024-09-10T05:15:36.705072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:15:36.704960+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:15:36.704960+0000","last_clean_scrub_stamp":"2024-09-10T05:15:36.704960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:30.793914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.352861+0000","last_change":"2024-09-10T05:15:03.352861+0000","last_active":"2024-09-10T05:15:03.352861+0000","last_peered":"2024-09-10T05:15:03.352861+0000","last_clean":"2024-09-10T05:15:03.352861+0000","last_became_active":"2024-09-10T05:11:29.721292+0000","last_became_peered":"2024-09-10T05:11:29.721292+0000","last_unstale":"2024-09-10T05:15:03.352861+0000","last_undegraded":"2024-09-10T05:15:03.352861+0000","last_fullsized":"2024-09-10T05:15:03.352861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.352761+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.352761+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.352761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:39.971897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"37'6","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.706205+0000","last_change":"2024-09-10T05:14:50.706205+0000","last_active":"2024-09-10T05:14:50.706205+0000","last_peered":"2024-09-10T05:14:50.706205+0000","last_clean":"2024-09-10T05:14:50.706205+0000","last_became_active":"2024-09-10T05:11:27.726419+0000","last_became_peered":"2024-09-10T05:11:27.726419+0000","last_unstale":"2024-09-10T05:14:50.706205+0000","last_undegraded":"2024-09-10T05:14:50.706205+0000","last_fullsized":"2024-09-10T05:14:50.706205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:14:50.706120+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:14:50.706120+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.706120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:55:39.305300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.699611+0000","last_change":"2024-09-10T05:15:14.699611+0000","last_active":"2024-09-10T05:15:14.699611+0000","last_peered":"2024-09-10T05:15:14.699611+0000","last_clean":"2024-09-10T05:15:14.699611+0000","last_became_active":"2024-09-10T05:11:31.732017+0000","last_became_peered":"2024-09-10T05:11:31.732017+0000","last_unstale":"2024-09-10T05:15:14.699611+0000","last_undegraded":"2024-09-10T05:15:14.699611+0000","last_fullsized":"2024-09-10T05:15:14.699611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:14.699495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:14.699495+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.699495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:03.772467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'40","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.141661+0000","last_change":"2024-09-10T05:11:33.747704+0000","last_active":"2024-09-10T05:14:43.141661+0000","last_peered":"2024-09-10T05:14:43.141661+0000","last_clean":"2024-09-10T05:14:43.141661+0000","last_became_active":"2024-09-10T05:11:33.747334+0000","last_became_peered":"2024-09-10T05:11:33.747334+0000","last_unstale":"2024-09-10T05:14:43.141661+0000","last_undegraded":"2024-09-10T05:14:43.141661+0000","last_fullsized":"2024-09-10T05:14:43.141661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:02.895443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.594411+0000","last_change":"2024-09-10T05:15:34.594411+0000","last_active":"2024-09-10T05:15:34.594411+0000","last_peered":"2024-09-10T05:15:34.594411+0000","last_clean":"2024-09-10T05:15:34.594411+0000","last_became_active":"2024-09-10T05:11:35.753453+0000","last_became_peered":"2024-09-10T05:11:35.753453+0000","last_unstale":"2024-09-10T05:15:34.594411+0000","last_undegraded":"2024-09-10T05:15:34.594411+0000","last_fullsized":"2024-09-10T05:15:34.594411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:34.594319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:34.594319+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.594319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:42.002121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'4","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:40.141268+0000","last_change":"2024-09-10T05:15:40.141268+0000","last_active":"2024-09-10T05:15:40.141268+0000","last_peered":"2024-09-10T05:15:40.141268+0000","last_clean":"2024-09-10T05:15:40.141268+0000","last_became_active":"2024-09-10T05:11:37.757307+0000","last_became_peered":"2024-09-10T05:11:37.757307+0000","last_unstale":"2024-09-10T05:15:40.141268+0000","last_undegraded":"2024-09-10T05:15:40.141268+0000","last_fullsized":"2024-09-10T05:15:40.141268+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:40.141152+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:40.141152+0000","last_clean_scrub_stamp":"2024-09-10T05:15:40.141152+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:54.477540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.667460+0000","last_change":"2024-09-10T05:15:01.667460+0000","last_active":"2024-09-10T05:15:01.667460+0000","last_peered":"2024-09-10T05:15:01.667460+0000","last_clean":"2024-09-10T05:15:01.667460+0000","last_became_active":"2024-09-10T05:11:29.722719+0000","last_became_peered":"2024-09-10T05:11:29.722719+0000","last_unstale":"2024-09-10T05:15:01.667460+0000","last_undegraded":"2024-09-10T05:15:01.667460+0000","last_fullsized":"2024-09-10T05:15:01.667460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:01.667364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:01.667364+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.667364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:59.866263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.927325+0000","last_change":"2024-09-10T05:14:58.927325+0000","last_active":"2024-09-10T05:14:58.927325+0000","last_peered":"2024-09-10T05:14:58.927325+0000","last_clean":"2024-09-10T05:14:58.927325+0000","last_became_active":"2024-09-10T05:11:27.722553+0000","last_became_peered":"2024-09-10T05:11:27.722553+0000","last_unstale":"2024-09-10T05:14:58.927325+0000","last_undegraded":"2024-09-10T05:14:58.927325+0000","last_fullsized":"2024-09-10T05:14:58.927325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:58.927238+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:58.927238+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.927238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:40.559986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'5","reported_seq":238,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.697159+0000","last_change":"2024-09-10T05:15:19.697159+0000","last_active":"2024-09-10T05:15:19.697159+0000","last_peered":"2024-09-10T05:15:19.697159+0000","last_clean":"2024-09-10T05:15:19.697159+0000","last_became_active":"2024-09-10T05:11:31.733822+0000","last_became_peered":"2024-09-10T05:11:31.733822+0000","last_unstale":"2024-09-10T05:15:19.697159+0000","last_undegraded":"2024-09-10T05:15:19.697159+0000","last_fullsized":"2024-09-10T05:15:19.697159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-10T05:15:19.697017+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-10T05:15:19.697017+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.697017+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:40.978284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'51","reported_seq":113,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.098530+0000","last_change":"2024-09-10T05:11:33.748247+0000","last_active":"2024-09-10T05:14:43.098530+0000","last_peered":"2024-09-10T05:14:43.098530+0000","last_clean":"2024-09-10T05:14:43.098530+0000","last_became_active":"2024-09-10T05:11:33.747938+0000","last_became_peered":"2024-09-10T05:11:33.747938+0000","last_unstale":"2024-09-10T05:14:43.098530+0000","last_undegraded":"2024-09-10T05:14:43.098530+0000","last_fullsized":"2024-09-10T05:14:43.098530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:52:53.311224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'286","reported_seq":360,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:33.561944+0000","last_change":"2024-09-10T05:15:33.561944+0000","last_active":"2024-09-10T05:15:33.561944+0000","last_peered":"2024-09-10T05:15:33.561944+0000","last_clean":"2024-09-10T05:15:33.561944+0000","last_became_active":"2024-09-10T05:11:35.753663+0000","last_became_peered":"2024-09-10T05:11:35.753663+0000","last_unstale":"2024-09-10T05:15:33.561944+0000","last_undegraded":"2024-09-10T05:15:33.561944+0000","last_fullsized":"2024-09-10T05:15:33.561944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:33.561838+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:33.561838+0000","last_clean_scrub_stamp":"2024-09-10T05:15:33.561838+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:25.576672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:41.642778+0000","last_change":"2024-09-10T05:15:41.642778+0000","last_active":"2024-09-10T05:15:41.642778+0000","last_peered":"2024-09-10T05:15:41.642778+0000","last_clean":"2024-09-10T05:15:41.642778+0000","last_became_active":"2024-09-10T05:11:37.754959+0000","last_became_peered":"2024-09-10T05:11:37.754959+0000","last_unstale":"2024-09-10T05:15:41.642778+0000","last_undegraded":"2024-09-10T05:15:41.642778+0000","last_fullsized":"2024-09-10T05:15:41.642778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:41.642679+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:41.642679+0000","last_clean_scrub_stamp":"2024-09-10T05:15:41.642679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:33:20.364799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'17","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.630437+0000","last_change":"2024-09-10T05:15:04.630437+0000","last_active":"2024-09-10T05:15:04.630437+0000","last_peered":"2024-09-10T05:15:04.630437+0000","last_clean":"2024-09-10T05:15:04.630437+0000","last_became_active":"2024-09-10T05:11:29.722267+0000","last_became_peered":"2024-09-10T05:11:29.722267+0000","last_unstale":"2024-09-10T05:15:04.630437+0000","last_undegraded":"2024-09-10T05:15:04.630437+0000","last_fullsized":"2024-09-10T05:15:04.630437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'17","last_scrub_stamp":"2024-09-10T05:15:04.630348+0000","last_deep_scrub":"37'17","last_deep_scrub_stamp":"2024-09-10T05:15:04.630348+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.630348+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:25.140187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'8","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.914417+0000","last_change":"2024-09-10T05:14:57.914417+0000","last_active":"2024-09-10T05:14:57.914417+0000","last_peered":"2024-09-10T05:14:57.914417+0000","last_clean":"2024-09-10T05:14:57.914417+0000","last_became_active":"2024-09-10T05:11:27.731909+0000","last_became_peered":"2024-09-10T05:11:27.731909+0000","last_unstale":"2024-09-10T05:14:57.914417+0000","last_undegraded":"2024-09-10T05:14:57.914417+0000","last_fullsized":"2024-09-10T05:14:57.914417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:14:57.914334+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:14:57.914334+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.914334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:28.529230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.678760+0000","last_change":"2024-09-10T05:15:15.678760+0000","last_active":"2024-09-10T05:15:15.678760+0000","last_peered":"2024-09-10T05:15:15.678760+0000","last_clean":"2024-09-10T05:15:15.678760+0000","last_became_active":"2024-09-10T05:11:31.732807+0000","last_became_peered":"2024-09-10T05:11:31.732807+0000","last_unstale":"2024-09-10T05:15:15.678760+0000","last_undegraded":"2024-09-10T05:15:15.678760+0000","last_fullsized":"2024-09-10T05:15:15.678760+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:15.678675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:15.678675+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.678675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:44.860207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'72","reported_seq":149,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.150182+0000","last_change":"2024-09-10T05:11:33.747177+0000","last_active":"2024-09-10T05:14:43.150182+0000","last_peered":"2024-09-10T05:14:43.150182+0000","last_clean":"2024-09-10T05:14:43.150182+0000","last_became_active":"2024-09-10T05:11:33.745449+0000","last_became_peered":"2024-09-10T05:11:33.745449+0000","last_unstale":"2024-09-10T05:14:43.150182+0000","last_undegraded":"2024-09-10T05:14:43.150182+0000","last_fullsized":"2024-09-10T05:14:43.150182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:08.744407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:31.560828+0000","last_change":"2024-09-10T05:15:31.560828+0000","last_active":"2024-09-10T05:15:31.560828+0000","last_peered":"2024-09-10T05:15:31.560828+0000","last_clean":"2024-09-10T05:15:31.560828+0000","last_became_active":"2024-09-10T05:11:35.747913+0000","last_became_peered":"2024-09-10T05:11:35.747913+0000","last_unstale":"2024-09-10T05:15:31.560828+0000","last_undegraded":"2024-09-10T05:15:31.560828+0000","last_fullsized":"2024-09-10T05:15:31.560828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:31.560744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:31.560744+0000","last_clean_scrub_stamp":"2024-09-10T05:15:31.560744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:46.528586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'23","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:43.590312+0000","last_change":"2024-09-10T05:15:43.590312+0000","last_active":"2024-09-10T05:15:43.590312+0000","last_peered":"2024-09-10T05:15:43.590312+0000","last_clean":"2024-09-10T05:15:43.590312+0000","last_became_active":"2024-09-10T05:11:37.754915+0000","last_became_peered":"2024-09-10T05:11:37.754915+0000","last_unstale":"2024-09-10T05:15:43.590312+0000","last_undegraded":"2024-09-10T05:15:43.590312+0000","last_fullsized":"2024-09-10T05:15:43.590312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'23","last_scrub_stamp":"2024-09-10T05:15:43.590226+0000","last_deep_scrub":"37'23","last_deep_scrub_stamp":"2024-09-10T05:15:43.590226+0000","last_clean_scrub_stamp":"2024-09-10T05:15:43.590226+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:18.298302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'14","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.379312+0000","last_change":"2024-09-10T05:15:02.379312+0000","last_active":"2024-09-10T05:15:02.379312+0000","last_peered":"2024-09-10T05:15:02.379312+0000","last_clean":"2024-09-10T05:15:02.379312+0000","last_became_active":"2024-09-10T05:11:29.727349+0000","last_became_peered":"2024-09-10T05:11:29.727349+0000","last_unstale":"2024-09-10T05:15:02.379312+0000","last_undegraded":"2024-09-10T05:15:02.379312+0000","last_fullsized":"2024-09-10T05:15:02.379312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:02.379225+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:02.379225+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.379225+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:14.485317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.470556+0000","last_change":"2024-09-10T05:14:51.470556+0000","last_active":"2024-09-10T05:14:51.470556+0000","last_peered":"2024-09-10T05:14:51.470556+0000","last_clean":"2024-09-10T05:14:51.470556+0000","last_became_active":"2024-09-10T05:11:27.717887+0000","last_became_peered":"2024-09-10T05:11:27.717887+0000","last_unstale":"2024-09-10T05:14:51.470556+0000","last_undegraded":"2024-09-10T05:14:51.470556+0000","last_fullsized":"2024-09-10T05:14:51.470556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:51.470452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:51.470452+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.470452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:41.087698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.704114+0000","last_change":"2024-09-10T05:15:14.704114+0000","last_active":"2024-09-10T05:15:14.704114+0000","last_peered":"2024-09-10T05:15:14.704114+0000","last_clean":"2024-09-10T05:15:14.704114+0000","last_became_active":"2024-09-10T05:11:31.735386+0000","last_became_peered":"2024-09-10T05:11:31.735386+0000","last_unstale":"2024-09-10T05:15:14.704114+0000","last_undegraded":"2024-09-10T05:15:14.704114+0000","last_fullsized":"2024-09-10T05:15:14.704114+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:14.704035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:14.704035+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.704035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:48.911727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'47","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:32.179060+0000","last_change":"2024-09-10T05:15:32.179060+0000","last_active":"2024-09-10T05:15:32.179060+0000","last_peered":"2024-09-10T05:15:32.179060+0000","last_clean":"2024-09-10T05:15:32.179060+0000","last_became_active":"2024-09-10T05:11:33.744026+0000","last_became_peered":"2024-09-10T05:11:33.744026+0000","last_unstale":"2024-09-10T05:15:32.179060+0000","last_undegraded":"2024-09-10T05:15:32.179060+0000","last_fullsized":"2024-09-10T05:15:32.179060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'47","last_scrub_stamp":"2024-09-10T05:15:32.178957+0000","last_deep_scrub":"37'47","last_deep_scrub_stamp":"2024-09-10T05:15:32.178957+0000","last_clean_scrub_stamp":"2024-09-10T05:15:32.178957+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:27:26.704119+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960608+0000","last_change":"2024-09-10T05:11:35.749447+0000","last_active":"2024-09-10T05:12:04.960608+0000","last_peered":"2024-09-10T05:12:04.960608+0000","last_clean":"2024-09-10T05:12:04.960608+0000","last_became_active":"2024-09-10T05:11:35.748874+0000","last_became_peered":"2024-09-10T05:11:35.748874+0000","last_unstale":"2024-09-10T05:12:04.960608+0000","last_undegraded":"2024-09-10T05:12:04.960608+0000","last_fullsized":"2024-09-10T05:12:04.960608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:09.658936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'9","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.482284+0000","last_change":"2024-09-10T05:11:37.768186+0000","last_active":"2024-09-10T05:14:36.482284+0000","last_peered":"2024-09-10T05:14:36.482284+0000","last_clean":"2024-09-10T05:14:36.482284+0000","last_became_active":"2024-09-10T05:11:37.767895+0000","last_became_peered":"2024-09-10T05:11:37.767895+0000","last_unstale":"2024-09-10T05:14:36.482284+0000","last_undegraded":"2024-09-10T05:14:36.482284+0000","last_fullsized":"2024-09-10T05:14:36.482284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'16","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.041594+0000","last_change":"2024-09-10T05:15:20.041594+0000","last_active":"2024-09-10T05:15:20.041594+0000","last_peered":"2024-09-10T05:15:20.041594+0000","last_clean":"2024-09-10T05:15:20.041594+0000","last_became_active":"2024-09-10T05:11:29.733870+0000","last_became_peered":"2024-09-10T05:11:29.733870+0000","last_unstale":"2024-09-10T05:15:20.041594+0000","last_undegraded":"2024-09-10T05:15:20.041594+0000","last_fullsized":"2024-09-10T05:15:20.041594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:20.041507+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:20.041507+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.041507+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:39:13.856170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.937882+0000","last_change":"2024-09-10T05:14:56.937882+0000","last_active":"2024-09-10T05:14:56.937882+0000","last_peered":"2024-09-10T05:14:56.937882+0000","last_clean":"2024-09-10T05:14:56.937882+0000","last_became_active":"2024-09-10T05:11:27.725852+0000","last_became_peered":"2024-09-10T05:11:27.725852+0000","last_unstale":"2024-09-10T05:14:56.937882+0000","last_undegraded":"2024-09-10T05:14:56.937882+0000","last_fullsized":"2024-09-10T05:14:56.937882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:56.937795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:56.937795+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.937795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:18.007474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.664914+0000","last_change":"2024-09-10T05:15:18.664914+0000","last_active":"2024-09-10T05:15:18.664914+0000","last_peered":"2024-09-10T05:15:18.664914+0000","last_clean":"2024-09-10T05:15:18.664914+0000","last_became_active":"2024-09-10T05:11:31.733756+0000","last_became_peered":"2024-09-10T05:11:31.733756+0000","last_unstale":"2024-09-10T05:15:18.664914+0000","last_undegraded":"2024-09-10T05:15:18.664914+0000","last_fullsized":"2024-09-10T05:15:18.664914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:18.664801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:18.664801+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.664801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:56.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'48","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.724473+0000","last_change":"2024-09-10T05:15:24.724473+0000","last_active":"2024-09-10T05:15:24.724473+0000","last_peered":"2024-09-10T05:15:24.724473+0000","last_clean":"2024-09-10T05:15:24.724473+0000","last_became_active":"2024-09-10T05:11:33.741848+0000","last_became_peered":"2024-09-10T05:11:33.741848+0000","last_unstale":"2024-09-10T05:15:24.724473+0000","last_undegraded":"2024-09-10T05:15:24.724473+0000","last_fullsized":"2024-09-10T05:15:24.724473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'48","last_scrub_stamp":"2024-09-10T05:15:24.724365+0000","last_deep_scrub":"37'48","last_deep_scrub_stamp":"2024-09-10T05:15:24.724365+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.724365+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:38:55.362877+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'286","reported_seq":464,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:30.715629+0000","last_change":"2024-09-10T05:15:30.715629+0000","last_active":"2024-09-10T05:15:30.715629+0000","last_peered":"2024-09-10T05:15:30.715629+0000","last_clean":"2024-09-10T05:15:30.715629+0000","last_became_active":"2024-09-10T05:11:35.752511+0000","last_became_peered":"2024-09-10T05:11:35.752511+0000","last_unstale":"2024-09-10T05:15:30.715629+0000","last_undegraded":"2024-09-10T05:15:30.715629+0000","last_fullsized":"2024-09-10T05:15:30.715629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:30.715509+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:30.715509+0000","last_clean_scrub_stamp":"2024-09-10T05:15:30.715509+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:14.739369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'15","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:39.603185+0000","last_change":"2024-09-10T05:15:39.603185+0000","last_active":"2024-09-10T05:15:39.603185+0000","last_peered":"2024-09-10T05:15:39.603185+0000","last_clean":"2024-09-10T05:15:39.603185+0000","last_became_active":"2024-09-10T05:11:37.758381+0000","last_became_peered":"2024-09-10T05:11:37.758381+0000","last_unstale":"2024-09-10T05:15:39.603185+0000","last_undegraded":"2024-09-10T05:15:39.603185+0000","last_fullsized":"2024-09-10T05:15:39.603185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-10T05:15:39.603096+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-10T05:15:39.603096+0000","last_clean_scrub_stamp":"2024-09-10T05:15:39.603096+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:57.716844+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'14","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.632091+0000","last_change":"2024-09-10T05:15:05.632091+0000","last_active":"2024-09-10T05:15:05.632091+0000","last_peered":"2024-09-10T05:15:05.632091+0000","last_clean":"2024-09-10T05:15:05.632091+0000","last_became_active":"2024-09-10T05:11:29.722170+0000","last_became_peered":"2024-09-10T05:11:29.722170+0000","last_unstale":"2024-09-10T05:15:05.632091+0000","last_undegraded":"2024-09-10T05:15:05.632091+0000","last_fullsized":"2024-09-10T05:15:05.632091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:05.632009+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:05.632009+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.632009+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:23.914770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.932355+0000","last_change":"2024-09-10T05:14:55.932355+0000","last_active":"2024-09-10T05:14:55.932355+0000","last_peered":"2024-09-10T05:14:55.932355+0000","last_clean":"2024-09-10T05:14:55.932355+0000","last_became_active":"2024-09-10T05:11:27.732591+0000","last_became_peered":"2024-09-10T05:11:27.732591+0000","last_unstale":"2024-09-10T05:14:55.932355+0000","last_undegraded":"2024-09-10T05:14:55.932355+0000","last_fullsized":"2024-09-10T05:14:55.932355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:55.932231+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:55.932231+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.932231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:54.606915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'5","reported_seq":428,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.298554+0000","last_change":"2024-09-10T05:15:22.298554+0000","last_active":"2024-09-10T05:15:22.298554+0000","last_peered":"2024-09-10T05:15:22.298554+0000","last_clean":"2024-09-10T05:15:22.298554+0000","last_became_active":"2024-09-10T05:11:31.734714+0000","last_became_peered":"2024-09-10T05:11:31.734714+0000","last_unstale":"2024-09-10T05:15:22.298554+0000","last_undegraded":"2024-09-10T05:15:22.298554+0000","last_fullsized":"2024-09-10T05:15:22.298554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-10T05:15:22.298439+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-10T05:15:22.298439+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.298439+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:58.275665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.958372+0000","last_change":"2024-09-10T05:11:33.747604+0000","last_active":"2024-09-10T05:12:04.958372+0000","last_peered":"2024-09-10T05:12:04.958372+0000","last_clean":"2024-09-10T05:12:04.958372+0000","last_became_active":"2024-09-10T05:11:33.747376+0000","last_became_peered":"2024-09-10T05:11:33.747376+0000","last_unstale":"2024-09-10T05:12:04.958372+0000","last_undegraded":"2024-09-10T05:12:04.958372+0000","last_fullsized":"2024-09-10T05:12:04.958372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:06.584551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'286","reported_seq":475,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:35.144600+0000","last_change":"2024-09-10T05:15:35.144600+0000","last_active":"2024-09-10T05:15:35.144600+0000","last_peered":"2024-09-10T05:15:35.144600+0000","last_clean":"2024-09-10T05:15:35.144600+0000","last_became_active":"2024-09-10T05:11:35.751352+0000","last_became_peered":"2024-09-10T05:11:35.751352+0000","last_unstale":"2024-09-10T05:15:35.144600+0000","last_undegraded":"2024-09-10T05:15:35.144600+0000","last_fullsized":"2024-09-10T05:15:35.144600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:35.144513+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:35.144513+0000","last_clean_scrub_stamp":"2024-09-10T05:15:35.144513+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:18.378095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'6","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:35.734274+0000","last_change":"2024-09-10T05:15:35.734274+0000","last_active":"2024-09-10T05:15:35.734274+0000","last_peered":"2024-09-10T05:15:35.734274+0000","last_clean":"2024-09-10T05:15:35.734274+0000","last_became_active":"2024-09-10T05:11:37.756734+0000","last_became_peered":"2024-09-10T05:11:37.756734+0000","last_unstale":"2024-09-10T05:15:35.734274+0000","last_undegraded":"2024-09-10T05:15:35.734274+0000","last_fullsized":"2024-09-10T05:15:35.734274+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:35.734191+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:35.734191+0000","last_clean_scrub_stamp":"2024-09-10T05:15:35.734191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:58.776195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'24","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.367487+0000","last_change":"2024-09-10T05:15:04.367487+0000","last_active":"2024-09-10T05:15:04.367487+0000","last_peered":"2024-09-10T05:15:04.367487+0000","last_clean":"2024-09-10T05:15:04.367487+0000","last_became_active":"2024-09-10T05:11:29.735032+0000","last_became_peered":"2024-09-10T05:11:29.735032+0000","last_unstale":"2024-09-10T05:15:04.367487+0000","last_undegraded":"2024-09-10T05:15:04.367487+0000","last_fullsized":"2024-09-10T05:15:04.367487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24","last_scrub_stamp":"2024-09-10T05:15:04.367405+0000","last_deep_scrub":"37'24","last_deep_scrub_stamp":"2024-09-10T05:15:04.367405+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.367405+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:35.414356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.972818+0000","last_change":"2024-09-10T05:14:54.972818+0000","last_active":"2024-09-10T05:14:54.972818+0000","last_peered":"2024-09-10T05:14:54.972818+0000","last_clean":"2024-09-10T05:14:54.972818+0000","last_became_active":"2024-09-10T05:11:27.734204+0000","last_became_peered":"2024-09-10T05:11:27.734204+0000","last_unstale":"2024-09-10T05:14:54.972818+0000","last_undegraded":"2024-09-10T05:14:54.972818+0000","last_fullsized":"2024-09-10T05:14:54.972818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:54.972735+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:54.972735+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.972735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:47.793245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:41.049375+0000","last_change":"2024-09-10T05:15:41.049375+0000","last_active":"2024-09-10T05:15:41.049375+0000","last_peered":"2024-09-10T05:15:41.049375+0000","last_clean":"2024-09-10T05:15:41.049375+0000","last_became_active":"2024-09-10T05:11:31.736841+0000","last_became_peered":"2024-09-10T05:11:31.736841+0000","last_unstale":"2024-09-10T05:15:41.049375+0000","last_undegraded":"2024-09-10T05:15:41.049375+0000","last_fullsized":"2024-09-10T05:15:41.049375+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:41.049287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:41.049287+0000","last_clean_scrub_stamp":"2024-09-10T05:15:41.049287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:48.427927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'50","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:30.217359+0000","last_change":"2024-09-10T05:15:30.217359+0000","last_active":"2024-09-10T05:15:30.217359+0000","last_peered":"2024-09-10T05:15:30.217359+0000","last_clean":"2024-09-10T05:15:30.217359+0000","last_became_active":"2024-09-10T05:11:33.744394+0000","last_became_peered":"2024-09-10T05:11:33.744394+0000","last_unstale":"2024-09-10T05:15:30.217359+0000","last_undegraded":"2024-09-10T05:15:30.217359+0000","last_fullsized":"2024-09-10T05:15:30.217359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'50","last_scrub_stamp":"2024-09-10T05:15:30.217260+0000","last_deep_scrub":"37'50","last_deep_scrub_stamp":"2024-09-10T05:15:30.217260+0000","last_clean_scrub_stamp":"2024-09-10T05:15:30.217260+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:35.417233+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:28.645981+0000","last_change":"2024-09-10T05:15:28.645981+0000","last_active":"2024-09-10T05:15:28.645981+0000","last_peered":"2024-09-10T05:15:28.645981+0000","last_clean":"2024-09-10T05:15:28.645981+0000","last_became_active":"2024-09-10T05:11:35.750450+0000","last_became_peered":"2024-09-10T05:11:35.750450+0000","last_unstale":"2024-09-10T05:15:28.645981+0000","last_undegraded":"2024-09-10T05:15:28.645981+0000","last_fullsized":"2024-09-10T05:15:28.645981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:28.645895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:28.645895+0000","last_clean_scrub_stamp":"2024-09-10T05:15:28.645895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:09.716244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'7","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:41.109973+0000","last_change":"2024-09-10T05:15:41.109973+0000","last_active":"2024-09-10T05:15:41.109973+0000","last_peered":"2024-09-10T05:15:41.109973+0000","last_clean":"2024-09-10T05:15:41.109973+0000","last_became_active":"2024-09-10T05:11:37.757289+0000","last_became_peered":"2024-09-10T05:11:37.757289+0000","last_unstale":"2024-09-10T05:15:41.109973+0000","last_undegraded":"2024-09-10T05:15:41.109973+0000","last_fullsized":"2024-09-10T05:15:41.109973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-10T05:15:41.109884+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-10T05:15:41.109884+0000","last_clean_scrub_stamp":"2024-09-10T05:15:41.109884+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:06.110902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'8","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.043784+0000","last_change":"2024-09-10T05:15:16.043718+0000","last_active":"2024-09-10T05:15:16.043784+0000","last_peered":"2024-09-10T05:15:16.043784+0000","last_clean":"2024-09-10T05:15:16.043784+0000","last_became_active":"2024-09-10T05:11:29.734367+0000","last_became_peered":"2024-09-10T05:11:29.734367+0000","last_unstale":"2024-09-10T05:15:16.043784+0000","last_undegraded":"2024-09-10T05:15:16.043784+0000","last_fullsized":"2024-09-10T05:15:16.043784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:16.043611+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:16.043611+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.043611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:32.661692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":157,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:46.450464+0000","last_change":"2024-09-10T05:14:46.450393+0000","last_active":"2024-09-10T05:14:46.450464+0000","last_peered":"2024-09-10T05:14:46.450464+0000","last_clean":"2024-09-10T05:14:46.450464+0000","last_became_active":"2024-09-10T05:11:14.293121+0000","last_became_peered":"2024-09-10T05:11:14.293121+0000","last_unstale":"2024-09-10T05:14:46.450464+0000","last_undegraded":"2024-09-10T05:14:46.450464+0000","last_fullsized":"2024-09-10T05:14:46.450464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-10T05:14:46.450301+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-10T05:14:46.450301+0000","last_clean_scrub_stamp":"2024-09-10T05:14:46.450301+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:41.127694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.069728+0000","last_change":"2024-09-10T05:14:51.069657+0000","last_active":"2024-09-10T05:14:51.069728+0000","last_peered":"2024-09-10T05:14:51.069728+0000","last_clean":"2024-09-10T05:14:51.069728+0000","last_became_active":"2024-09-10T05:11:16.531926+0000","last_became_peered":"2024-09-10T05:11:16.531926+0000","last_unstale":"2024-09-10T05:14:51.069728+0000","last_undegraded":"2024-09-10T05:14:51.069728+0000","last_fullsized":"2024-09-10T05:14:51.069728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:51.069579+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:51.069579+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.069579+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:40.169755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001121101,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.034338+0000","last_change":"2024-09-10T05:14:52.034277+0000","last_active":"2024-09-10T05:14:52.034338+0000","last_peered":"2024-09-10T05:14:52.034338+0000","last_clean":"2024-09-10T05:14:52.034338+0000","last_became_active":"2024-09-10T05:11:27.735941+0000","last_became_peered":"2024-09-10T05:11:27.735941+0000","last_unstale":"2024-09-10T05:14:52.034338+0000","last_undegraded":"2024-09-10T05:14:52.034338+0000","last_fullsized":"2024-09-10T05:14:52.034338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.034181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.034181+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.034181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:53.640936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.297619+0000","last_change":"2024-09-10T05:15:20.297566+0000","last_active":"2024-09-10T05:15:20.297619+0000","last_peered":"2024-09-10T05:15:20.297619+0000","last_clean":"2024-09-10T05:15:20.297619+0000","last_became_active":"2024-09-10T05:11:31.736104+0000","last_became_peered":"2024-09-10T05:11:31.736104+0000","last_unstale":"2024-09-10T05:15:20.297619+0000","last_undegraded":"2024-09-10T05:15:20.297619+0000","last_fullsized":"2024-09-10T05:15:20.297619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:20.297474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:20.297474+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.297474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:10.972123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'94","reported_seq":182,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.117691+0000","last_change":"2024-09-10T05:11:33.744321+0000","last_active":"2024-09-10T05:14:43.117691+0000","last_peered":"2024-09-10T05:14:43.117691+0000","last_clean":"2024-09-10T05:14:43.117691+0000","last_became_active":"2024-09-10T05:11:33.743933+0000","last_became_peered":"2024-09-10T05:11:33.743933+0000","last_unstale":"2024-09-10T05:14:43.117691+0000","last_undegraded":"2024-09-10T05:14:43.117691+0000","last_fullsized":"2024-09-10T05:14:43.117691+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:30.903532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:30.587614+0000","last_change":"2024-09-10T05:15:30.587614+0000","last_active":"2024-09-10T05:15:30.587614+0000","last_peered":"2024-09-10T05:15:30.587614+0000","last_clean":"2024-09-10T05:15:30.587614+0000","last_became_active":"2024-09-10T05:11:35.750248+0000","last_became_peered":"2024-09-10T05:11:35.750248+0000","last_unstale":"2024-09-10T05:15:30.587614+0000","last_undegraded":"2024-09-10T05:15:30.587614+0000","last_fullsized":"2024-09-10T05:15:30.587614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:30.587529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:30.587529+0000","last_clean_scrub_stamp":"2024-09-10T05:15:30.587529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:38.060858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'85","reported_seq":175,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:38.717751+0000","last_change":"2024-09-10T05:15:38.717751+0000","last_active":"2024-09-10T05:15:38.717751+0000","last_peered":"2024-09-10T05:15:38.717751+0000","last_clean":"2024-09-10T05:15:38.717751+0000","last_became_active":"2024-09-10T05:11:37.755239+0000","last_became_peered":"2024-09-10T05:11:37.755239+0000","last_unstale":"2024-09-10T05:15:38.717751+0000","last_undegraded":"2024-09-10T05:15:38.717751+0000","last_fullsized":"2024-09-10T05:15:38.717751+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'85","last_scrub_stamp":"2024-09-10T05:15:38.717658+0000","last_deep_scrub":"37'85","last_deep_scrub_stamp":"2024-09-10T05:15:38.717658+0000","last_clean_scrub_stamp":"2024-09-10T05:15:38.717658+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:17.546697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.100459+0000","last_change":"2024-09-10T05:15:18.100459+0000","last_active":"2024-09-10T05:15:18.100459+0000","last_peered":"2024-09-10T05:15:18.100459+0000","last_clean":"2024-09-10T05:15:18.100459+0000","last_became_active":"2024-09-10T05:11:29.732560+0000","last_became_peered":"2024-09-10T05:11:29.732560+0000","last_unstale":"2024-09-10T05:15:18.100459+0000","last_undegraded":"2024-09-10T05:15:18.100459+0000","last_fullsized":"2024-09-10T05:15:18.100459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:18.100314+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:18.100314+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.100314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:05.619104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.116452+0000","last_change":"2024-09-10T05:14:48.116383+0000","last_active":"2024-09-10T05:14:48.116452+0000","last_peered":"2024-09-10T05:14:48.116452+0000","last_clean":"2024-09-10T05:14:48.116452+0000","last_became_active":"2024-09-10T05:11:16.531911+0000","last_became_peered":"2024-09-10T05:11:16.531911+0000","last_unstale":"2024-09-10T05:14:48.116452+0000","last_undegraded":"2024-09-10T05:14:48.116452+0000","last_fullsized":"2024-09-10T05:14:48.116452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.116290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.116290+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.116290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:40.342657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039105900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.545709+0000","last_change":"2024-09-10T05:14:48.545643+0000","last_active":"2024-09-10T05:14:48.545709+0000","last_peered":"2024-09-10T05:14:48.545709+0000","last_clean":"2024-09-10T05:14:48.545709+0000","last_became_active":"2024-09-10T05:11:27.713026+0000","last_became_peered":"2024-09-10T05:11:27.713026+0000","last_unstale":"2024-09-10T05:14:48.545709+0000","last_undegraded":"2024-09-10T05:14:48.545709+0000","last_fullsized":"2024-09-10T05:14:48.545709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:48.545569+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:48.545569+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.545569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:09.108323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:39.033339+0000","last_change":"2024-09-10T05:15:39.033339+0000","last_active":"2024-09-10T05:15:39.033339+0000","last_peered":"2024-09-10T05:15:39.033339+0000","last_clean":"2024-09-10T05:15:39.033339+0000","last_became_active":"2024-09-10T05:11:31.737199+0000","last_became_peered":"2024-09-10T05:11:31.737199+0000","last_unstale":"2024-09-10T05:15:39.033339+0000","last_undegraded":"2024-09-10T05:15:39.033339+0000","last_fullsized":"2024-09-10T05:15:39.033339+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:39.033234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:39.033234+0000","last_clean_scrub_stamp":"2024-09-10T05:15:39.033234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:00.913610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'303","reported_seq":534,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:29.204862+0000","last_change":"2024-09-10T05:15:29.204803+0000","last_active":"2024-09-10T05:15:29.204862+0000","last_peered":"2024-09-10T05:15:29.204862+0000","last_clean":"2024-09-10T05:15:29.204862+0000","last_became_active":"2024-09-10T05:11:33.744103+0000","last_became_peered":"2024-09-10T05:11:33.744103+0000","last_unstale":"2024-09-10T05:15:29.204862+0000","last_undegraded":"2024-09-10T05:15:29.204862+0000","last_fullsized":"2024-09-10T05:15:29.204862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'303","last_scrub_stamp":"2024-09-10T05:15:29.204689+0000","last_deep_scrub":"37'303","last_deep_scrub_stamp":"2024-09-10T05:15:29.204689+0000","last_clean_scrub_stamp":"2024-09-10T05:15:29.204689+0000","objects_scrubbed":11,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:40.315728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":393,"num_read_kb":395,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:40.914948+0000","last_change":"2024-09-10T05:11:35.749117+0000","last_active":"2024-09-10T05:13:40.914948+0000","last_peered":"2024-09-10T05:13:40.914948+0000","last_clean":"2024-09-10T05:13:40.914948+0000","last_became_active":"2024-09-10T05:11:35.748767+0000","last_became_peered":"2024-09-10T05:11:35.748767+0000","last_unstale":"2024-09-10T05:13:40.914948+0000","last_undegraded":"2024-09-10T05:13:40.914948+0000","last_fullsized":"2024-09-10T05:13:40.914948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:43.139042+0000","last_change":"2024-09-10T05:15:43.139042+0000","last_active":"2024-09-10T05:15:43.139042+0000","last_peered":"2024-09-10T05:15:43.139042+0000","last_clean":"2024-09-10T05:15:43.139042+0000","last_became_active":"2024-09-10T05:11:37.758114+0000","last_became_peered":"2024-09-10T05:11:37.758114+0000","last_unstale":"2024-09-10T05:15:43.139042+0000","last_undegraded":"2024-09-10T05:15:43.139042+0000","last_fullsized":"2024-09-10T05:15:43.139042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:15:43.138964+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:15:43.138964+0000","last_clean_scrub_stamp":"2024-09-10T05:15:43.138964+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:43.209895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'14","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.455496+0000","last_change":"2024-09-10T05:15:02.455496+0000","last_active":"2024-09-10T05:15:02.455496+0000","last_peered":"2024-09-10T05:15:02.455496+0000","last_clean":"2024-09-10T05:15:02.455496+0000","last_became_active":"2024-09-10T05:11:29.723609+0000","last_became_peered":"2024-09-10T05:11:29.723609+0000","last_unstale":"2024-09-10T05:15:02.455496+0000","last_undegraded":"2024-09-10T05:15:02.455496+0000","last_fullsized":"2024-09-10T05:15:02.455496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:02.455410+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:02.455410+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.455410+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:08.842470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.698496+0000","last_change":"2024-09-10T05:14:48.698433+0000","last_active":"2024-09-10T05:14:48.698496+0000","last_peered":"2024-09-10T05:14:48.698496+0000","last_clean":"2024-09-10T05:14:48.698496+0000","last_became_active":"2024-09-10T05:11:16.530448+0000","last_became_peered":"2024-09-10T05:11:16.530448+0000","last_unstale":"2024-09-10T05:14:48.698496+0000","last_undegraded":"2024-09-10T05:14:48.698496+0000","last_fullsized":"2024-09-10T05:14:48.698496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.698352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.698352+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.698352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:12.098710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036982300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.508575+0000","last_change":"2024-09-10T05:14:47.508513+0000","last_active":"2024-09-10T05:14:47.508575+0000","last_peered":"2024-09-10T05:14:47.508575+0000","last_clean":"2024-09-10T05:14:47.508575+0000","last_became_active":"2024-09-10T05:11:27.714299+0000","last_became_peered":"2024-09-10T05:11:27.714299+0000","last_unstale":"2024-09-10T05:14:47.508575+0000","last_undegraded":"2024-09-10T05:14:47.508575+0000","last_fullsized":"2024-09-10T05:14:47.508575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:14:47.508436+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:14:47.508436+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.508436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:06.719872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.693954+0000","last_change":"2024-09-10T05:15:15.693954+0000","last_active":"2024-09-10T05:15:15.693954+0000","last_peered":"2024-09-10T05:15:15.693954+0000","last_clean":"2024-09-10T05:15:15.693954+0000","last_became_active":"2024-09-10T05:11:31.730978+0000","last_became_peered":"2024-09-10T05:11:31.730978+0000","last_unstale":"2024-09-10T05:15:15.693954+0000","last_undegraded":"2024-09-10T05:15:15.693954+0000","last_fullsized":"2024-09-10T05:15:15.693954+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:15.693862+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:15.693862+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.693862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:07.673571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'25","reported_seq":102,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.710113+0000","last_change":"2024-09-10T05:15:23.710054+0000","last_active":"2024-09-10T05:15:23.710113+0000","last_peered":"2024-09-10T05:15:23.710113+0000","last_clean":"2024-09-10T05:15:23.710113+0000","last_became_active":"2024-09-10T05:11:33.746102+0000","last_became_peered":"2024-09-10T05:11:33.746102+0000","last_unstale":"2024-09-10T05:15:23.710113+0000","last_undegraded":"2024-09-10T05:15:23.710113+0000","last_fullsized":"2024-09-10T05:15:23.710113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'25","last_scrub_stamp":"2024-09-10T05:15:23.709956+0000","last_deep_scrub":"37'25","last_deep_scrub_stamp":"2024-09-10T05:15:23.709956+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.709956+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:03.932613+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:29.636086+0000","last_change":"2024-09-10T05:15:29.636086+0000","last_active":"2024-09-10T05:15:29.636086+0000","last_peered":"2024-09-10T05:15:29.636086+0000","last_clean":"2024-09-10T05:15:29.636086+0000","last_became_active":"2024-09-10T05:11:35.753342+0000","last_became_peered":"2024-09-10T05:11:35.753342+0000","last_unstale":"2024-09-10T05:15:29.636086+0000","last_undegraded":"2024-09-10T05:15:29.636086+0000","last_fullsized":"2024-09-10T05:15:29.636086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:29.635990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:29.635990+0000","last_clean_scrub_stamp":"2024-09-10T05:15:29.635990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:08.235675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955113+0000","last_change":"2024-09-10T05:11:37.769011+0000","last_active":"2024-09-10T05:12:04.955113+0000","last_peered":"2024-09-10T05:12:04.955113+0000","last_clean":"2024-09-10T05:12:04.955113+0000","last_became_active":"2024-09-10T05:11:37.767788+0000","last_became_peered":"2024-09-10T05:11:37.767788+0000","last_unstale":"2024-09-10T05:12:04.955113+0000","last_undegraded":"2024-09-10T05:12:04.955113+0000","last_fullsized":"2024-09-10T05:12:04.955113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:55.792983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.435961+0000","last_change":"2024-09-10T05:15:01.435853+0000","last_active":"2024-09-10T05:15:01.435961+0000","last_peered":"2024-09-10T05:15:01.435961+0000","last_clean":"2024-09-10T05:15:01.435961+0000","last_became_active":"2024-09-10T05:11:29.727022+0000","last_became_peered":"2024-09-10T05:11:29.727022+0000","last_unstale":"2024-09-10T05:15:01.435961+0000","last_undegraded":"2024-09-10T05:15:01.435961+0000","last_fullsized":"2024-09-10T05:15:01.435961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:01.435758+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:01.435758+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.435758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:15.080229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.096802+0000","last_change":"2024-09-10T05:14:49.096748+0000","last_active":"2024-09-10T05:14:49.096802+0000","last_peered":"2024-09-10T05:14:49.096802+0000","last_clean":"2024-09-10T05:14:49.096802+0000","last_became_active":"2024-09-10T05:11:16.530756+0000","last_became_peered":"2024-09-10T05:11:16.530756+0000","last_unstale":"2024-09-10T05:14:49.096802+0000","last_undegraded":"2024-09-10T05:14:49.096802+0000","last_fullsized":"2024-09-10T05:14:49.096802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:14:49.096654+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:14:49.096654+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.096654+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:56.602270+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001047784,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.744820+0000","last_change":"2024-09-10T05:14:47.744764+0000","last_active":"2024-09-10T05:14:47.744820+0000","last_peered":"2024-09-10T05:14:47.744820+0000","last_clean":"2024-09-10T05:14:47.744820+0000","last_became_active":"2024-09-10T05:11:27.718333+0000","last_became_peered":"2024-09-10T05:11:27.718333+0000","last_unstale":"2024-09-10T05:14:47.744820+0000","last_undegraded":"2024-09-10T05:14:47.744820+0000","last_fullsized":"2024-09-10T05:14:47.744820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:47.744665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:47.744665+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.744665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:14.527839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.760190+0000","last_change":"2024-09-10T05:15:12.760190+0000","last_active":"2024-09-10T05:15:12.760190+0000","last_peered":"2024-09-10T05:15:12.760190+0000","last_clean":"2024-09-10T05:15:12.760190+0000","last_became_active":"2024-09-10T05:12:04.964996+0000","last_became_peered":"2024-09-10T05:12:04.964996+0000","last_unstale":"2024-09-10T05:15:12.760190+0000","last_undegraded":"2024-09-10T05:15:12.760190+0000","last_fullsized":"2024-09-10T05:15:12.760190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:12.760098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:12.760098+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.760098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:29.723294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"37'13","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:35.691724+0000","last_change":"2024-09-10T05:11:33.743920+0000","last_active":"2024-09-10T05:14:35.691724+0000","last_peered":"2024-09-10T05:14:35.691724+0000","last_clean":"2024-09-10T05:14:35.691724+0000","last_became_active":"2024-09-10T05:11:33.743292+0000","last_became_peered":"2024-09-10T05:11:33.743292+0000","last_unstale":"2024-09-10T05:14:35.691724+0000","last_undegraded":"2024-09-10T05:14:35.691724+0000","last_fullsized":"2024-09-10T05:14:35.691724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:18.442235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.960791+0000","last_change":"2024-09-10T05:11:35.752348+0000","last_active":"2024-09-10T05:12:04.960791+0000","last_peered":"2024-09-10T05:12:04.960791+0000","last_clean":"2024-09-10T05:12:04.960791+0000","last_became_active":"2024-09-10T05:11:35.751982+0000","last_became_peered":"2024-09-10T05:11:35.751982+0000","last_unstale":"2024-09-10T05:12:04.960791+0000","last_undegraded":"2024-09-10T05:12:04.960791+0000","last_fullsized":"2024-09-10T05:12:04.960791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:53.013137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:42.135829+0000","last_change":"2024-09-10T05:15:42.135829+0000","last_active":"2024-09-10T05:15:42.135829+0000","last_peered":"2024-09-10T05:15:42.135829+0000","last_clean":"2024-09-10T05:15:42.135829+0000","last_became_active":"2024-09-10T05:11:37.762327+0000","last_became_peered":"2024-09-10T05:11:37.762327+0000","last_unstale":"2024-09-10T05:15:42.135829+0000","last_undegraded":"2024-09-10T05:15:42.135829+0000","last_fullsized":"2024-09-10T05:15:42.135829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:42.135733+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:42.135733+0000","last_clean_scrub_stamp":"2024-09-10T05:15:42.135733+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:18.247769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'16","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.437539+0000","last_change":"2024-09-10T05:15:00.437426+0000","last_active":"2024-09-10T05:15:00.437539+0000","last_peered":"2024-09-10T05:15:00.437539+0000","last_clean":"2024-09-10T05:15:00.437539+0000","last_became_active":"2024-09-10T05:11:29.730589+0000","last_became_peered":"2024-09-10T05:11:29.730589+0000","last_unstale":"2024-09-10T05:15:00.437539+0000","last_undegraded":"2024-09-10T05:15:00.437539+0000","last_fullsized":"2024-09-10T05:15:00.437539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:00.437305+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:00.437305+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.437305+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:23:10.739442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.660396+0000","last_change":"2024-09-10T05:14:49.660336+0000","last_active":"2024-09-10T05:14:49.660396+0000","last_peered":"2024-09-10T05:14:49.660396+0000","last_clean":"2024-09-10T05:14:49.660396+0000","last_became_active":"2024-09-10T05:11:27.716023+0000","last_became_peered":"2024-09-10T05:11:27.716023+0000","last_unstale":"2024-09-10T05:14:49.660396+0000","last_undegraded":"2024-09-10T05:14:49.660396+0000","last_fullsized":"2024-09-10T05:14:49.660396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:49.660254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:49.660254+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.660254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:37.581398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:46.486507+0000","last_change":"2024-09-10T05:14:46.486459+0000","last_active":"2024-09-10T05:14:46.486507+0000","last_peered":"2024-09-10T05:14:46.486507+0000","last_clean":"2024-09-10T05:14:46.486507+0000","last_became_active":"2024-09-10T05:11:16.532795+0000","last_became_peered":"2024-09-10T05:11:16.532795+0000","last_unstale":"2024-09-10T05:14:46.486507+0000","last_undegraded":"2024-09-10T05:14:46.486507+0000","last_fullsized":"2024-09-10T05:14:46.486507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:46.486390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:46.486390+0000","last_clean_scrub_stamp":"2024-09-10T05:14:46.486390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:24.690009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060128199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.692331+0000","last_change":"2024-09-10T05:15:17.692271+0000","last_active":"2024-09-10T05:15:17.692331+0000","last_peered":"2024-09-10T05:15:17.692331+0000","last_clean":"2024-09-10T05:15:17.692331+0000","last_became_active":"2024-09-10T05:11:31.734707+0000","last_became_peered":"2024-09-10T05:11:31.734707+0000","last_unstale":"2024-09-10T05:15:17.692331+0000","last_undegraded":"2024-09-10T05:15:17.692331+0000","last_fullsized":"2024-09-10T05:15:17.692331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:17.692187+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:17.692187+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.692187+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:34:44.621445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'90","reported_seq":179,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.758226+0000","last_change":"2024-09-10T05:15:22.758130+0000","last_active":"2024-09-10T05:15:22.758226+0000","last_peered":"2024-09-10T05:15:22.758226+0000","last_clean":"2024-09-10T05:15:22.758226+0000","last_became_active":"2024-09-10T05:11:33.743238+0000","last_became_peered":"2024-09-10T05:11:33.743238+0000","last_unstale":"2024-09-10T05:15:22.758226+0000","last_undegraded":"2024-09-10T05:15:22.758226+0000","last_fullsized":"2024-09-10T05:15:22.758226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'90","last_scrub_stamp":"2024-09-10T05:15:22.758015+0000","last_deep_scrub":"37'90","last_deep_scrub_stamp":"2024-09-10T05:15:22.758015+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.758015+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:54:47.346297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:29.688075+0000","last_change":"2024-09-10T05:15:29.688020+0000","last_active":"2024-09-10T05:15:29.688075+0000","last_peered":"2024-09-10T05:15:29.688075+0000","last_clean":"2024-09-10T05:15:29.688075+0000","last_became_active":"2024-09-10T05:11:35.750830+0000","last_became_peered":"2024-09-10T05:11:35.750830+0000","last_unstale":"2024-09-10T05:15:29.688075+0000","last_undegraded":"2024-09-10T05:15:29.688075+0000","last_fullsized":"2024-09-10T05:15:29.688075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:29.687940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:29.687940+0000","last_clean_scrub_stamp":"2024-09-10T05:15:29.687940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:14.996480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:42.597661+0000","last_change":"2024-09-10T05:15:42.597661+0000","last_active":"2024-09-10T05:15:42.597661+0000","last_peered":"2024-09-10T05:15:42.597661+0000","last_clean":"2024-09-10T05:15:42.597661+0000","last_became_active":"2024-09-10T05:11:37.758971+0000","last_became_peered":"2024-09-10T05:11:37.758971+0000","last_unstale":"2024-09-10T05:15:42.597661+0000","last_undegraded":"2024-09-10T05:15:42.597661+0000","last_fullsized":"2024-09-10T05:15:42.597661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-10T05:15:42.597524+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-10T05:15:42.597524+0000","last_clean_scrub_stamp":"2024-09-10T05:15:42.597524+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:11.776658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'14","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.389673+0000","last_change":"2024-09-10T05:15:01.389613+0000","last_active":"2024-09-10T05:15:01.389673+0000","last_peered":"2024-09-10T05:15:01.389673+0000","last_clean":"2024-09-10T05:15:01.389673+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:15:01.389673+0000","last_undegraded":"2024-09-10T05:15:01.389673+0000","last_fullsized":"2024-09-10T05:15:01.389673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:01.389524+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:01.389524+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.389524+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:15.262748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.500548+0000","last_change":"2024-09-10T05:14:50.500467+0000","last_active":"2024-09-10T05:14:50.500548+0000","last_peered":"2024-09-10T05:14:50.500548+0000","last_clean":"2024-09-10T05:14:50.500548+0000","last_became_active":"2024-09-10T05:11:27.718756+0000","last_became_peered":"2024-09-10T05:11:27.718756+0000","last_unstale":"2024-09-10T05:14:50.500548+0000","last_undegraded":"2024-09-10T05:14:50.500548+0000","last_fullsized":"2024-09-10T05:14:50.500548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.500341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.500341+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.500341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:21.655128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.083367+0000","last_change":"2024-09-10T05:14:50.083297+0000","last_active":"2024-09-10T05:14:50.083367+0000","last_peered":"2024-09-10T05:14:50.083367+0000","last_clean":"2024-09-10T05:14:50.083367+0000","last_became_active":"2024-09-10T05:11:16.530746+0000","last_became_peered":"2024-09-10T05:11:16.530746+0000","last_unstale":"2024-09-10T05:14:50.083367+0000","last_undegraded":"2024-09-10T05:14:50.083367+0000","last_fullsized":"2024-09-10T05:14:50.083367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.083200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.083200+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.083200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:05.779343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048256999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:38.012117+0000","last_change":"2024-09-10T05:15:38.012028+0000","last_active":"2024-09-10T05:15:38.012117+0000","last_peered":"2024-09-10T05:15:38.012117+0000","last_clean":"2024-09-10T05:15:38.012117+0000","last_became_active":"2024-09-10T05:11:31.734333+0000","last_became_peered":"2024-09-10T05:11:31.734333+0000","last_unstale":"2024-09-10T05:15:38.012117+0000","last_undegraded":"2024-09-10T05:15:38.012117+0000","last_fullsized":"2024-09-10T05:15:38.012117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:38.011934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:38.011934+0000","last_clean_scrub_stamp":"2024-09-10T05:15:38.011934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:40.284016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"37'29","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.269623+0000","last_change":"2024-09-10T05:15:27.269561+0000","last_active":"2024-09-10T05:15:27.269623+0000","last_peered":"2024-09-10T05:15:27.269623+0000","last_clean":"2024-09-10T05:15:27.269623+0000","last_became_active":"2024-09-10T05:11:33.744011+0000","last_became_peered":"2024-09-10T05:11:33.744011+0000","last_unstale":"2024-09-10T05:15:27.269623+0000","last_undegraded":"2024-09-10T05:15:27.269623+0000","last_fullsized":"2024-09-10T05:15:27.269623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'29","last_scrub_stamp":"2024-09-10T05:15:27.269468+0000","last_deep_scrub":"37'29","last_deep_scrub_stamp":"2024-09-10T05:15:27.269468+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.269468+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:28.915634+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'286","reported_seq":359,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.192783+0000","last_change":"2024-09-10T05:15:34.192731+0000","last_active":"2024-09-10T05:15:34.192783+0000","last_peered":"2024-09-10T05:15:34.192783+0000","last_clean":"2024-09-10T05:15:34.192783+0000","last_became_active":"2024-09-10T05:11:35.743571+0000","last_became_peered":"2024-09-10T05:11:35.743571+0000","last_unstale":"2024-09-10T05:15:34.192783+0000","last_undegraded":"2024-09-10T05:15:34.192783+0000","last_fullsized":"2024-09-10T05:15:34.192783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:34.192645+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:34.192645+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.192645+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:41.449001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.602302+0000","last_change":"2024-09-10T05:11:37.764931+0000","last_active":"2024-09-10T05:13:32.602302+0000","last_peered":"2024-09-10T05:13:32.602302+0000","last_clean":"2024-09-10T05:13:32.602302+0000","last_became_active":"2024-09-10T05:11:37.764657+0000","last_became_peered":"2024-09-10T05:11:37.764657+0000","last_unstale":"2024-09-10T05:13:32.602302+0000","last_undegraded":"2024-09-10T05:13:32.602302+0000","last_fullsized":"2024-09-10T05:13:32.602302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:33.836899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.069015+0000","last_change":"2024-09-10T05:15:17.068949+0000","last_active":"2024-09-10T05:15:17.069015+0000","last_peered":"2024-09-10T05:15:17.069015+0000","last_clean":"2024-09-10T05:15:17.069015+0000","last_became_active":"2024-09-10T05:11:29.734731+0000","last_became_peered":"2024-09-10T05:11:29.734731+0000","last_unstale":"2024-09-10T05:15:17.069015+0000","last_undegraded":"2024-09-10T05:15:17.069015+0000","last_fullsized":"2024-09-10T05:15:17.069015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:17.068869+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:17.068869+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.068869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:24.980749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.997163+0000","last_change":"2024-09-10T05:14:53.997163+0000","last_active":"2024-09-10T05:14:53.997163+0000","last_peered":"2024-09-10T05:14:53.997163+0000","last_clean":"2024-09-10T05:14:53.997163+0000","last_became_active":"2024-09-10T05:11:27.723268+0000","last_became_peered":"2024-09-10T05:11:27.723268+0000","last_unstale":"2024-09-10T05:14:53.997163+0000","last_undegraded":"2024-09-10T05:14:53.997163+0000","last_fullsized":"2024-09-10T05:14:53.997163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.997077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.997077+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.997077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:30.512459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.499303+0000","last_change":"2024-09-10T05:14:53.499227+0000","last_active":"2024-09-10T05:14:53.499303+0000","last_peered":"2024-09-10T05:14:53.499303+0000","last_clean":"2024-09-10T05:14:53.499303+0000","last_became_active":"2024-09-10T05:11:16.531550+0000","last_became_peered":"2024-09-10T05:11:16.531550+0000","last_unstale":"2024-09-10T05:14:53.499303+0000","last_undegraded":"2024-09-10T05:14:53.499303+0000","last_fullsized":"2024-09-10T05:14:53.499303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.499101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.499101+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.499101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:59:02.083006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00063503699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:36.995729+0000","last_change":"2024-09-10T05:15:36.995651+0000","last_active":"2024-09-10T05:15:36.995729+0000","last_peered":"2024-09-10T05:15:36.995729+0000","last_clean":"2024-09-10T05:15:36.995729+0000","last_became_active":"2024-09-10T05:11:31.734310+0000","last_became_peered":"2024-09-10T05:11:31.734310+0000","last_unstale":"2024-09-10T05:15:36.995729+0000","last_undegraded":"2024-09-10T05:15:36.995729+0000","last_fullsized":"2024-09-10T05:15:36.995729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:36.995574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:36.995574+0000","last_clean_scrub_stamp":"2024-09-10T05:15:36.995574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:51.268902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'23","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:45.041432+0000","last_change":"2024-09-10T05:15:45.041358+0000","last_active":"2024-09-10T05:15:45.041432+0000","last_peered":"2024-09-10T05:15:45.041432+0000","last_clean":"2024-09-10T05:15:45.041432+0000","last_became_active":"2024-09-10T05:11:33.748603+0000","last_became_peered":"2024-09-10T05:11:33.748603+0000","last_unstale":"2024-09-10T05:15:45.041432+0000","last_undegraded":"2024-09-10T05:15:45.041432+0000","last_fullsized":"2024-09-10T05:15:45.041432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'23","last_scrub_stamp":"2024-09-10T05:15:45.041266+0000","last_deep_scrub":"37'23","last_deep_scrub_stamp":"2024-09-10T05:15:45.041266+0000","last_clean_scrub_stamp":"2024-09-10T05:15:45.041266+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:23.170240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'286","reported_seq":401,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:32.599749+0000","last_change":"2024-09-10T05:15:32.599749+0000","last_active":"2024-09-10T05:15:32.599749+0000","last_peered":"2024-09-10T05:15:32.599749+0000","last_clean":"2024-09-10T05:15:32.599749+0000","last_became_active":"2024-09-10T05:11:35.745807+0000","last_became_peered":"2024-09-10T05:11:35.745807+0000","last_unstale":"2024-09-10T05:15:32.599749+0000","last_undegraded":"2024-09-10T05:15:32.599749+0000","last_fullsized":"2024-09-10T05:15:32.599749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:32.599633+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:32.599633+0000","last_clean_scrub_stamp":"2024-09-10T05:15:32.599633+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:25.495767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'3","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:44.152788+0000","last_change":"2024-09-10T05:15:44.152788+0000","last_active":"2024-09-10T05:15:44.152788+0000","last_peered":"2024-09-10T05:15:44.152788+0000","last_clean":"2024-09-10T05:15:44.152788+0000","last_became_active":"2024-09-10T05:11:37.762407+0000","last_became_peered":"2024-09-10T05:11:37.762407+0000","last_unstale":"2024-09-10T05:15:44.152788+0000","last_undegraded":"2024-09-10T05:15:44.152788+0000","last_fullsized":"2024-09-10T05:15:44.152788+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-10T05:15:44.152676+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-10T05:15:44.152676+0000","last_clean_scrub_stamp":"2024-09-10T05:15:44.152676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:11:01.228571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.609490+0000","last_change":"2024-09-10T05:15:03.609389+0000","last_active":"2024-09-10T05:15:03.609490+0000","last_peered":"2024-09-10T05:15:03.609490+0000","last_clean":"2024-09-10T05:15:03.609490+0000","last_became_active":"2024-09-10T05:11:29.730285+0000","last_became_peered":"2024-09-10T05:11:29.730285+0000","last_unstale":"2024-09-10T05:15:03.609490+0000","last_undegraded":"2024-09-10T05:15:03.609490+0000","last_fullsized":"2024-09-10T05:15:03.609490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.609295+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.609295+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.609295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:48.096904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.429038+0000","last_change":"2024-09-10T05:14:47.429038+0000","last_active":"2024-09-10T05:14:47.429038+0000","last_peered":"2024-09-10T05:14:47.429038+0000","last_clean":"2024-09-10T05:14:47.429038+0000","last_became_active":"2024-09-10T05:11:27.731108+0000","last_became_peered":"2024-09-10T05:11:27.731108+0000","last_unstale":"2024-09-10T05:14:47.429038+0000","last_undegraded":"2024-09-10T05:14:47.429038+0000","last_fullsized":"2024-09-10T05:14:47.429038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:47.428954+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:47.428954+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.428954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:33.646520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.995787+0000","last_change":"2024-09-10T05:14:52.995705+0000","last_active":"2024-09-10T05:14:52.995787+0000","last_peered":"2024-09-10T05:14:52.995787+0000","last_clean":"2024-09-10T05:14:52.995787+0000","last_became_active":"2024-09-10T05:11:16.531468+0000","last_became_peered":"2024-09-10T05:11:16.531468+0000","last_unstale":"2024-09-10T05:14:52.995787+0000","last_undegraded":"2024-09-10T05:14:52.995787+0000","last_fullsized":"2024-09-10T05:14:52.995787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.995618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.995618+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.995618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:43.970590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001329722,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.962538+0000","last_change":"2024-09-10T05:15:34.962538+0000","last_active":"2024-09-10T05:15:34.962538+0000","last_peered":"2024-09-10T05:15:34.962538+0000","last_clean":"2024-09-10T05:15:34.962538+0000","last_became_active":"2024-09-10T05:11:31.732753+0000","last_became_peered":"2024-09-10T05:11:31.732753+0000","last_unstale":"2024-09-10T05:15:34.962538+0000","last_undegraded":"2024-09-10T05:15:34.962538+0000","last_fullsized":"2024-09-10T05:15:34.962538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:34.962423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:34.962423+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.962423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:12.195846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'106","reported_seq":206,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.713783+0000","last_change":"2024-09-10T05:15:21.713723+0000","last_active":"2024-09-10T05:15:21.713783+0000","last_peered":"2024-09-10T05:15:21.713783+0000","last_clean":"2024-09-10T05:15:21.713783+0000","last_became_active":"2024-09-10T05:11:33.744217+0000","last_became_peered":"2024-09-10T05:11:33.744217+0000","last_unstale":"2024-09-10T05:15:21.713783+0000","last_undegraded":"2024-09-10T05:15:21.713783+0000","last_fullsized":"2024-09-10T05:15:21.713783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'106","last_scrub_stamp":"2024-09-10T05:15:21.713617+0000","last_deep_scrub":"37'106","last_deep_scrub_stamp":"2024-09-10T05:15:21.713617+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.713617+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:18.813436+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:28.623134+0000","last_change":"2024-09-10T05:15:28.623134+0000","last_active":"2024-09-10T05:15:28.623134+0000","last_peered":"2024-09-10T05:15:28.623134+0000","last_clean":"2024-09-10T05:15:28.623134+0000","last_became_active":"2024-09-10T05:11:35.747924+0000","last_became_peered":"2024-09-10T05:11:35.747924+0000","last_unstale":"2024-09-10T05:15:28.623134+0000","last_undegraded":"2024-09-10T05:15:28.623134+0000","last_fullsized":"2024-09-10T05:15:28.623134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:28.623034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:28.623034+0000","last_clean_scrub_stamp":"2024-09-10T05:15:28.623034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:48.440071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:37.686465+0000","last_change":"2024-09-10T05:15:37.686465+0000","last_active":"2024-09-10T05:15:37.686465+0000","last_peered":"2024-09-10T05:15:37.686465+0000","last_clean":"2024-09-10T05:15:37.686465+0000","last_became_active":"2024-09-10T05:11:37.757947+0000","last_became_peered":"2024-09-10T05:11:37.757947+0000","last_unstale":"2024-09-10T05:15:37.686465+0000","last_undegraded":"2024-09-10T05:15:37.686465+0000","last_fullsized":"2024-09-10T05:15:37.686465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:37.686363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:37.686363+0000","last_clean_scrub_stamp":"2024-09-10T05:15:37.686363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:06.623851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:40.805413+0000","last_change":"2024-09-10T05:15:40.805413+0000","last_active":"2024-09-10T05:15:40.805413+0000","last_peered":"2024-09-10T05:15:40.805413+0000","last_clean":"2024-09-10T05:15:40.805413+0000","last_became_active":"2024-09-10T05:11:37.759217+0000","last_became_peered":"2024-09-10T05:11:37.759217+0000","last_unstale":"2024-09-10T05:15:40.805413+0000","last_undegraded":"2024-09-10T05:15:40.805413+0000","last_fullsized":"2024-09-10T05:15:40.805413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:40.805307+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:40.805307+0000","last_clean_scrub_stamp":"2024-09-10T05:15:40.805307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:46.454929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'12","reported_seq":90,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:06.623135+0000","last_change":"2024-09-10T05:15:06.623135+0000","last_active":"2024-09-10T05:15:06.623135+0000","last_peered":"2024-09-10T05:15:06.623135+0000","last_clean":"2024-09-10T05:15:06.623135+0000","last_became_active":"2024-09-10T05:11:29.730105+0000","last_became_peered":"2024-09-10T05:11:29.730105+0000","last_unstale":"2024-09-10T05:15:06.623135+0000","last_undegraded":"2024-09-10T05:15:06.623135+0000","last_fullsized":"2024-09-10T05:15:06.623135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-10T05:15:06.623056+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-10T05:15:06.623056+0000","last_clean_scrub_stamp":"2024-09-10T05:15:06.623056+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:01.300449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.953621+0000","last_change":"2024-09-10T05:15:00.953621+0000","last_active":"2024-09-10T05:15:00.953621+0000","last_peered":"2024-09-10T05:15:00.953621+0000","last_clean":"2024-09-10T05:15:00.953621+0000","last_became_active":"2024-09-10T05:11:27.731634+0000","last_became_peered":"2024-09-10T05:11:27.731634+0000","last_unstale":"2024-09-10T05:15:00.953621+0000","last_undegraded":"2024-09-10T05:15:00.953621+0000","last_fullsized":"2024-09-10T05:15:00.953621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:00.953536+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:00.953536+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.953536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.954553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.266780+0000","last_change":"2024-09-10T05:15:23.266780+0000","last_active":"2024-09-10T05:15:23.266780+0000","last_peered":"2024-09-10T05:15:23.266780+0000","last_clean":"2024-09-10T05:15:23.266780+0000","last_became_active":"2024-09-10T05:12:04.967513+0000","last_became_peered":"2024-09-10T05:12:04.967513+0000","last_unstale":"2024-09-10T05:15:23.266780+0000","last_undegraded":"2024-09-10T05:15:23.266780+0000","last_fullsized":"2024-09-10T05:15:23.266780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:23.266688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:23.266688+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.266688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:14:49.877447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'42","reported_seq":96,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.095775+0000","last_change":"2024-09-10T05:11:33.745631+0000","last_active":"2024-09-10T05:14:43.095775+0000","last_peered":"2024-09-10T05:14:43.095775+0000","last_clean":"2024-09-10T05:14:43.095775+0000","last_became_active":"2024-09-10T05:11:33.745347+0000","last_became_peered":"2024-09-10T05:11:33.745347+0000","last_unstale":"2024-09-10T05:14:43.095775+0000","last_undegraded":"2024-09-10T05:14:43.095775+0000","last_fullsized":"2024-09-10T05:14:43.095775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:36.538308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954872+0000","last_change":"2024-09-10T05:11:35.754614+0000","last_active":"2024-09-10T05:12:04.954872+0000","last_peered":"2024-09-10T05:12:04.954872+0000","last_clean":"2024-09-10T05:12:04.954872+0000","last_became_active":"2024-09-10T05:11:35.754318+0000","last_became_peered":"2024-09-10T05:11:35.754318+0000","last_unstale":"2024-09-10T05:12:04.954872+0000","last_undegraded":"2024-09-10T05:12:04.954872+0000","last_fullsized":"2024-09-10T05:12:04.954872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:32.929275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:38.908676+0000","last_change":"2024-09-10T05:11:37.760662+0000","last_active":"2024-09-10T05:13:38.908676+0000","last_peered":"2024-09-10T05:13:38.908676+0000","last_clean":"2024-09-10T05:13:38.908676+0000","last_became_active":"2024-09-10T05:11:37.760471+0000","last_became_peered":"2024-09-10T05:11:37.760471+0000","last_unstale":"2024-09-10T05:13:38.908676+0000","last_undegraded":"2024-09-10T05:13:38.908676+0000","last_fullsized":"2024-09-10T05:13:38.908676+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:06.365828+0000","last_change":"2024-09-10T05:15:06.365828+0000","last_active":"2024-09-10T05:15:06.365828+0000","last_peered":"2024-09-10T05:15:06.365828+0000","last_clean":"2024-09-10T05:15:06.365828+0000","last_became_active":"2024-09-10T05:11:29.727550+0000","last_became_peered":"2024-09-10T05:11:29.727550+0000","last_unstale":"2024-09-10T05:15:06.365828+0000","last_undegraded":"2024-09-10T05:15:06.365828+0000","last_fullsized":"2024-09-10T05:15:06.365828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:06.365720+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:06.365720+0000","last_clean_scrub_stamp":"2024-09-10T05:15:06.365720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:23.986492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.731049+0000","last_change":"2024-09-10T05:14:51.731049+0000","last_active":"2024-09-10T05:14:51.731049+0000","last_peered":"2024-09-10T05:14:51.731049+0000","last_clean":"2024-09-10T05:14:51.731049+0000","last_became_active":"2024-09-10T05:11:27.724637+0000","last_became_peered":"2024-09-10T05:11:27.724637+0000","last_unstale":"2024-09-10T05:14:51.731049+0000","last_undegraded":"2024-09-10T05:14:51.731049+0000","last_fullsized":"2024-09-10T05:14:51.731049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:51.730965+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:51.730965+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.730965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:07.979601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:42.019303+0000","last_change":"2024-09-10T05:15:42.019303+0000","last_active":"2024-09-10T05:15:42.019303+0000","last_peered":"2024-09-10T05:15:42.019303+0000","last_clean":"2024-09-10T05:15:42.019303+0000","last_became_active":"2024-09-10T05:11:31.736758+0000","last_became_peered":"2024-09-10T05:11:31.736758+0000","last_unstale":"2024-09-10T05:15:42.019303+0000","last_undegraded":"2024-09-10T05:15:42.019303+0000","last_fullsized":"2024-09-10T05:15:42.019303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:42.019205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:42.019205+0000","last_clean_scrub_stamp":"2024-09-10T05:15:42.019205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:35.436605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'9","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.744425+0000","last_change":"2024-09-10T05:15:23.744425+0000","last_active":"2024-09-10T05:15:23.744425+0000","last_peered":"2024-09-10T05:15:23.744425+0000","last_clean":"2024-09-10T05:15:23.744425+0000","last_became_active":"2024-09-10T05:11:33.742039+0000","last_became_peered":"2024-09-10T05:11:33.742039+0000","last_unstale":"2024-09-10T05:15:23.744425+0000","last_undegraded":"2024-09-10T05:15:23.744425+0000","last_fullsized":"2024-09-10T05:15:23.744425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-10T05:15:23.744296+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-10T05:15:23.744296+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.744296+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:24:56.856947+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:31.713764+0000","last_change":"2024-09-10T05:15:31.713764+0000","last_active":"2024-09-10T05:15:31.713764+0000","last_peered":"2024-09-10T05:15:31.713764+0000","last_clean":"2024-09-10T05:15:31.713764+0000","last_became_active":"2024-09-10T05:11:35.751244+0000","last_became_peered":"2024-09-10T05:11:35.751244+0000","last_unstale":"2024-09-10T05:15:31.713764+0000","last_undegraded":"2024-09-10T05:15:31.713764+0000","last_fullsized":"2024-09-10T05:15:31.713764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:31.713667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:31.713667+0000","last_clean_scrub_stamp":"2024-09-10T05:15:31.713667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:26:13.902660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.676093+0000","last_change":"2024-09-10T05:11:37.755735+0000","last_active":"2024-09-10T05:13:35.676093+0000","last_peered":"2024-09-10T05:13:35.676093+0000","last_clean":"2024-09-10T05:13:35.676093+0000","last_became_active":"2024-09-10T05:11:37.755533+0000","last_became_peered":"2024-09-10T05:11:37.755533+0000","last_unstale":"2024-09-10T05:13:35.676093+0000","last_undegraded":"2024-09-10T05:13:35.676093+0000","last_fullsized":"2024-09-10T05:13:35.676093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:37.895455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.660492+0000","last_change":"2024-09-10T05:15:12.660492+0000","last_active":"2024-09-10T05:15:12.660492+0000","last_peered":"2024-09-10T05:15:12.660492+0000","last_clean":"2024-09-10T05:15:12.660492+0000","last_became_active":"2024-09-10T05:11:29.727400+0000","last_became_peered":"2024-09-10T05:11:29.727400+0000","last_unstale":"2024-09-10T05:15:12.660492+0000","last_undegraded":"2024-09-10T05:15:12.660492+0000","last_fullsized":"2024-09-10T05:15:12.660492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:12.660389+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:12.660389+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.660389+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:36.645663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.665768+0000","last_change":"2024-09-10T05:14:55.665768+0000","last_active":"2024-09-10T05:14:55.665768+0000","last_peered":"2024-09-10T05:14:55.665768+0000","last_clean":"2024-09-10T05:14:55.665768+0000","last_became_active":"2024-09-10T05:11:27.727561+0000","last_became_peered":"2024-09-10T05:11:27.727561+0000","last_unstale":"2024-09-10T05:14:55.665768+0000","last_undegraded":"2024-09-10T05:14:55.665768+0000","last_fullsized":"2024-09-10T05:14:55.665768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:55.665677+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:55.665677+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.665677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:14.595232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"37'2","reported_seq":230,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.691856+0000","last_change":"2024-09-10T05:15:17.691856+0000","last_active":"2024-09-10T05:15:17.691856+0000","last_peered":"2024-09-10T05:15:17.691856+0000","last_clean":"2024-09-10T05:15:17.691856+0000","last_became_active":"2024-09-10T05:11:31.733793+0000","last_became_peered":"2024-09-10T05:11:31.733793+0000","last_unstale":"2024-09-10T05:15:17.691856+0000","last_undegraded":"2024-09-10T05:15:17.691856+0000","last_fullsized":"2024-09-10T05:15:17.691856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:17.691774+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:17.691774+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.691774+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:00.262242+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'51","reported_seq":123,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.735826+0000","last_change":"2024-09-10T05:15:24.735826+0000","last_active":"2024-09-10T05:15:24.735826+0000","last_peered":"2024-09-10T05:15:24.735826+0000","last_clean":"2024-09-10T05:15:24.735826+0000","last_became_active":"2024-09-10T05:11:33.744634+0000","last_became_peered":"2024-09-10T05:11:33.744634+0000","last_unstale":"2024-09-10T05:15:24.735826+0000","last_undegraded":"2024-09-10T05:15:24.735826+0000","last_fullsized":"2024-09-10T05:15:24.735826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'51","last_scrub_stamp":"2024-09-10T05:15:24.735737+0000","last_deep_scrub":"37'51","last_deep_scrub_stamp":"2024-09-10T05:15:24.735737+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.735737+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:27.977793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:36.128990+0000","last_change":"2024-09-10T05:15:36.128990+0000","last_active":"2024-09-10T05:15:36.128990+0000","last_peered":"2024-09-10T05:15:36.128990+0000","last_clean":"2024-09-10T05:15:36.128990+0000","last_became_active":"2024-09-10T05:11:35.748406+0000","last_became_peered":"2024-09-10T05:11:35.748406+0000","last_unstale":"2024-09-10T05:15:36.128990+0000","last_undegraded":"2024-09-10T05:15:36.128990+0000","last_fullsized":"2024-09-10T05:15:36.128990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:36.128911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:36.128911+0000","last_clean_scrub_stamp":"2024-09-10T05:15:36.128911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:39.255053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.370496+0000","last_change":"2024-09-10T05:11:37.765627+0000","last_active":"2024-09-10T05:14:36.370496+0000","last_peered":"2024-09-10T05:14:36.370496+0000","last_clean":"2024-09-10T05:14:36.370496+0000","last_became_active":"2024-09-10T05:11:37.765188+0000","last_became_peered":"2024-09-10T05:11:37.765188+0000","last_unstale":"2024-09-10T05:14:36.370496+0000","last_undegraded":"2024-09-10T05:14:36.370496+0000","last_fullsized":"2024-09-10T05:14:36.370496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:35.729959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.025498+0000","last_change":"2024-09-10T05:15:21.025498+0000","last_active":"2024-09-10T05:15:21.025498+0000","last_peered":"2024-09-10T05:15:21.025498+0000","last_clean":"2024-09-10T05:15:21.025498+0000","last_became_active":"2024-09-10T05:11:29.735101+0000","last_became_peered":"2024-09-10T05:11:29.735101+0000","last_unstale":"2024-09-10T05:15:21.025498+0000","last_undegraded":"2024-09-10T05:15:21.025498+0000","last_fullsized":"2024-09-10T05:15:21.025498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:21.025412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:21.025412+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.025412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:22.721305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.411020+0000","last_change":"2024-09-10T05:14:50.411020+0000","last_active":"2024-09-10T05:14:50.411020+0000","last_peered":"2024-09-10T05:14:50.411020+0000","last_clean":"2024-09-10T05:14:50.411020+0000","last_became_active":"2024-09-10T05:11:27.715729+0000","last_became_peered":"2024-09-10T05:11:27.715729+0000","last_unstale":"2024-09-10T05:14:50.411020+0000","last_undegraded":"2024-09-10T05:14:50.411020+0000","last_fullsized":"2024-09-10T05:14:50.411020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.410933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.410933+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.410933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:35.070195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:40.023328+0000","last_change":"2024-09-10T05:15:40.023328+0000","last_active":"2024-09-10T05:15:40.023328+0000","last_peered":"2024-09-10T05:15:40.023328+0000","last_clean":"2024-09-10T05:15:40.023328+0000","last_became_active":"2024-09-10T05:11:31.732476+0000","last_became_peered":"2024-09-10T05:11:31.732476+0000","last_unstale":"2024-09-10T05:15:40.023328+0000","last_undegraded":"2024-09-10T05:15:40.023328+0000","last_fullsized":"2024-09-10T05:15:40.023328+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:40.023244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:40.023244+0000","last_clean_scrub_stamp":"2024-09-10T05:15:40.023244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:22.273834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'38","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:25.695074+0000","last_change":"2024-09-10T05:15:25.695074+0000","last_active":"2024-09-10T05:15:25.695074+0000","last_peered":"2024-09-10T05:15:25.695074+0000","last_clean":"2024-09-10T05:15:25.695074+0000","last_became_active":"2024-09-10T05:11:33.740483+0000","last_became_peered":"2024-09-10T05:11:33.740483+0000","last_unstale":"2024-09-10T05:15:25.695074+0000","last_undegraded":"2024-09-10T05:15:25.695074+0000","last_fullsized":"2024-09-10T05:15:25.695074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-10T05:15:25.694982+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-10T05:15:25.694982+0000","last_clean_scrub_stamp":"2024-09-10T05:15:25.694982+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:43.315754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:32.736066+0000","last_change":"2024-09-10T05:15:32.736066+0000","last_active":"2024-09-10T05:15:32.736066+0000","last_peered":"2024-09-10T05:15:32.736066+0000","last_clean":"2024-09-10T05:15:32.736066+0000","last_became_active":"2024-09-10T05:11:35.745886+0000","last_became_peered":"2024-09-10T05:11:35.745886+0000","last_unstale":"2024-09-10T05:15:32.736066+0000","last_undegraded":"2024-09-10T05:15:32.736066+0000","last_fullsized":"2024-09-10T05:15:32.736066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:32.735947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:32.735947+0000","last_clean_scrub_stamp":"2024-09-10T05:15:32.735947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:20.165956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'4","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.009524+0000","last_change":"2024-09-10T05:15:27.009451+0000","last_active":"2024-09-10T05:15:27.009524+0000","last_peered":"2024-09-10T05:15:27.009524+0000","last_clean":"2024-09-10T05:15:27.009524+0000","last_became_active":"2024-09-10T05:11:29.731824+0000","last_became_peered":"2024-09-10T05:11:29.731824+0000","last_unstale":"2024-09-10T05:15:27.009524+0000","last_undegraded":"2024-09-10T05:15:27.009524+0000","last_fullsized":"2024-09-10T05:15:27.009524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:27.009372+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:27.009372+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.009372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:47.379586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.955838+0000","last_change":"2024-09-10T05:15:02.955838+0000","last_active":"2024-09-10T05:15:02.955838+0000","last_peered":"2024-09-10T05:15:02.955838+0000","last_clean":"2024-09-10T05:15:02.955838+0000","last_became_active":"2024-09-10T05:11:27.734652+0000","last_became_peered":"2024-09-10T05:11:27.734652+0000","last_unstale":"2024-09-10T05:15:02.955838+0000","last_undegraded":"2024-09-10T05:15:02.955838+0000","last_fullsized":"2024-09-10T05:15:02.955838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:02.955753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:02.955753+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.955753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:03.026683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.707831+0000","last_change":"2024-09-10T05:15:21.707762+0000","last_active":"2024-09-10T05:15:21.707831+0000","last_peered":"2024-09-10T05:15:21.707831+0000","last_clean":"2024-09-10T05:15:21.707831+0000","last_became_active":"2024-09-10T05:11:31.734774+0000","last_became_peered":"2024-09-10T05:11:31.734774+0000","last_unstale":"2024-09-10T05:15:21.707831+0000","last_undegraded":"2024-09-10T05:15:21.707831+0000","last_fullsized":"2024-09-10T05:15:21.707831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:21.707674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:21.707674+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.707674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:24.042654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'72","reported_seq":151,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:26.709919+0000","last_change":"2024-09-10T05:15:26.709919+0000","last_active":"2024-09-10T05:15:26.709919+0000","last_peered":"2024-09-10T05:15:26.709919+0000","last_clean":"2024-09-10T05:15:26.709919+0000","last_became_active":"2024-09-10T05:11:33.741136+0000","last_became_peered":"2024-09-10T05:11:33.741136+0000","last_unstale":"2024-09-10T05:15:26.709919+0000","last_undegraded":"2024-09-10T05:15:26.709919+0000","last_fullsized":"2024-09-10T05:15:26.709919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'72","last_scrub_stamp":"2024-09-10T05:15:26.709822+0000","last_deep_scrub":"37'72","last_deep_scrub_stamp":"2024-09-10T05:15:26.709822+0000","last_clean_scrub_stamp":"2024-09-10T05:15:26.709822+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:58.542377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:33.758682+0000","last_change":"2024-09-10T05:15:33.758682+0000","last_active":"2024-09-10T05:15:33.758682+0000","last_peered":"2024-09-10T05:15:33.758682+0000","last_clean":"2024-09-10T05:15:33.758682+0000","last_became_active":"2024-09-10T05:11:35.745795+0000","last_became_peered":"2024-09-10T05:11:35.745795+0000","last_unstale":"2024-09-10T05:15:33.758682+0000","last_undegraded":"2024-09-10T05:15:33.758682+0000","last_fullsized":"2024-09-10T05:15:33.758682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:33.758579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:33.758579+0000","last_clean_scrub_stamp":"2024-09-10T05:15:33.758579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:25.812947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.609239+0000","last_change":"2024-09-10T05:11:37.758689+0000","last_active":"2024-09-10T05:13:35.609239+0000","last_peered":"2024-09-10T05:13:35.609239+0000","last_clean":"2024-09-10T05:13:35.609239+0000","last_became_active":"2024-09-10T05:11:37.758360+0000","last_became_peered":"2024-09-10T05:11:37.758360+0000","last_unstale":"2024-09-10T05:13:35.609239+0000","last_undegraded":"2024-09-10T05:13:35.609239+0000","last_fullsized":"2024-09-10T05:13:35.609239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:10.895588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'9","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.487806+0000","last_change":"2024-09-10T05:15:04.487731+0000","last_active":"2024-09-10T05:15:04.487806+0000","last_peered":"2024-09-10T05:15:04.487806+0000","last_clean":"2024-09-10T05:15:04.487806+0000","last_became_active":"2024-09-10T05:11:29.723722+0000","last_became_peered":"2024-09-10T05:11:29.723722+0000","last_unstale":"2024-09-10T05:15:04.487806+0000","last_undegraded":"2024-09-10T05:15:04.487806+0000","last_fullsized":"2024-09-10T05:15:04.487806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-10T05:15:04.487622+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-10T05:15:04.487622+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.487622+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:01.563035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.432455+0000","last_change":"2024-09-10T05:14:48.432455+0000","last_active":"2024-09-10T05:14:48.432455+0000","last_peered":"2024-09-10T05:14:48.432455+0000","last_clean":"2024-09-10T05:14:48.432455+0000","last_became_active":"2024-09-10T05:11:27.727770+0000","last_became_peered":"2024-09-10T05:11:27.727770+0000","last_unstale":"2024-09-10T05:14:48.432455+0000","last_undegraded":"2024-09-10T05:14:48.432455+0000","last_fullsized":"2024-09-10T05:14:48.432455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.432373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.432373+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.432373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:56.267844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.739665+0000","last_change":"2024-09-10T05:15:19.739584+0000","last_active":"2024-09-10T05:15:19.739665+0000","last_peered":"2024-09-10T05:15:19.739665+0000","last_clean":"2024-09-10T05:15:19.739665+0000","last_became_active":"2024-09-10T05:11:31.728653+0000","last_became_peered":"2024-09-10T05:11:31.728653+0000","last_unstale":"2024-09-10T05:15:19.739665+0000","last_undegraded":"2024-09-10T05:15:19.739665+0000","last_fullsized":"2024-09-10T05:15:19.739665+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:19.739465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:19.739465+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.739465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:10.896874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.057351+0000","last_change":"2024-09-10T05:11:33.743527+0000","last_active":"2024-09-10T05:14:43.057351+0000","last_peered":"2024-09-10T05:14:43.057351+0000","last_clean":"2024-09-10T05:14:43.057351+0000","last_became_active":"2024-09-10T05:11:33.743048+0000","last_became_peered":"2024-09-10T05:11:33.743048+0000","last_unstale":"2024-09-10T05:14:43.057351+0000","last_undegraded":"2024-09-10T05:14:43.057351+0000","last_fullsized":"2024-09-10T05:14:43.057351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:52:59.505330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:39.127420+0000","last_change":"2024-09-10T05:15:39.127420+0000","last_active":"2024-09-10T05:15:39.127420+0000","last_peered":"2024-09-10T05:15:39.127420+0000","last_clean":"2024-09-10T05:15:39.127420+0000","last_became_active":"2024-09-10T05:11:35.752971+0000","last_became_peered":"2024-09-10T05:11:35.752971+0000","last_unstale":"2024-09-10T05:15:39.127420+0000","last_undegraded":"2024-09-10T05:15:39.127420+0000","last_fullsized":"2024-09-10T05:15:39.127420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:39.127342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:39.127342+0000","last_clean_scrub_stamp":"2024-09-10T05:15:39.127342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:18.920925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954464+0000","last_change":"2024-09-10T05:11:37.768354+0000","last_active":"2024-09-10T05:12:04.954464+0000","last_peered":"2024-09-10T05:12:04.954464+0000","last_clean":"2024-09-10T05:12:04.954464+0000","last_became_active":"2024-09-10T05:11:37.768036+0000","last_became_peered":"2024-09-10T05:11:37.768036+0000","last_unstale":"2024-09-10T05:12:04.954464+0000","last_undegraded":"2024-09-10T05:12:04.954464+0000","last_fullsized":"2024-09-10T05:12:04.954464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:28.716788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:26.004309+0000","last_change":"2024-09-10T05:15:26.004309+0000","last_active":"2024-09-10T05:15:26.004309+0000","last_peered":"2024-09-10T05:15:26.004309+0000","last_clean":"2024-09-10T05:15:26.004309+0000","last_became_active":"2024-09-10T05:11:29.734714+0000","last_became_peered":"2024-09-10T05:11:29.734714+0000","last_unstale":"2024-09-10T05:15:26.004309+0000","last_undegraded":"2024-09-10T05:15:26.004309+0000","last_fullsized":"2024-09-10T05:15:26.004309+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:26.004225+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:26.004225+0000","last_clean_scrub_stamp":"2024-09-10T05:15:26.004225+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:49.905656+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.434007+0000","last_change":"2024-09-10T05:14:53.434007+0000","last_active":"2024-09-10T05:14:53.434007+0000","last_peered":"2024-09-10T05:14:53.434007+0000","last_clean":"2024-09-10T05:14:53.434007+0000","last_became_active":"2024-09-10T05:11:27.718251+0000","last_became_peered":"2024-09-10T05:11:27.718251+0000","last_unstale":"2024-09-10T05:14:53.434007+0000","last_undegraded":"2024-09-10T05:14:53.434007+0000","last_fullsized":"2024-09-10T05:14:53.434007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:53.433919+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:53.433919+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.433919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:36.001843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.733593+0000","last_change":"2024-09-10T05:15:18.733593+0000","last_active":"2024-09-10T05:15:18.733593+0000","last_peered":"2024-09-10T05:15:18.733593+0000","last_clean":"2024-09-10T05:15:18.733593+0000","last_became_active":"2024-09-10T05:11:31.727998+0000","last_became_peered":"2024-09-10T05:11:31.727998+0000","last_unstale":"2024-09-10T05:15:18.733593+0000","last_undegraded":"2024-09-10T05:15:18.733593+0000","last_fullsized":"2024-09-10T05:15:18.733593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:18.733458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:18.733458+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.733458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:16.898611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'47","reported_seq":110,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.670352+0000","last_change":"2024-09-10T05:15:27.670277+0000","last_active":"2024-09-10T05:15:27.670352+0000","last_peered":"2024-09-10T05:15:27.670352+0000","last_clean":"2024-09-10T05:15:27.670352+0000","last_became_active":"2024-09-10T05:11:33.742594+0000","last_became_peered":"2024-09-10T05:11:33.742594+0000","last_unstale":"2024-09-10T05:15:27.670352+0000","last_undegraded":"2024-09-10T05:15:27.670352+0000","last_fullsized":"2024-09-10T05:15:27.670352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'47","last_scrub_stamp":"2024-09-10T05:15:27.670186+0000","last_deep_scrub":"37'47","last_deep_scrub_stamp":"2024-09-10T05:15:27.670186+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.670186+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:14.370124+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:38.636474+0000","last_change":"2024-09-10T05:15:38.636384+0000","last_active":"2024-09-10T05:15:38.636474+0000","last_peered":"2024-09-10T05:15:38.636474+0000","last_clean":"2024-09-10T05:15:38.636474+0000","last_became_active":"2024-09-10T05:11:35.748464+0000","last_became_peered":"2024-09-10T05:11:35.748464+0000","last_unstale":"2024-09-10T05:15:38.636474+0000","last_undegraded":"2024-09-10T05:15:38.636474+0000","last_fullsized":"2024-09-10T05:15:38.636474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:38.636277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:38.636277+0000","last_clean_scrub_stamp":"2024-09-10T05:15:38.636277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:46.050421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.674549+0000","last_change":"2024-09-10T05:11:37.768552+0000","last_active":"2024-09-10T05:13:35.674549+0000","last_peered":"2024-09-10T05:13:35.674549+0000","last_clean":"2024-09-10T05:13:35.674549+0000","last_became_active":"2024-09-10T05:11:37.768248+0000","last_became_peered":"2024-09-10T05:11:37.768248+0000","last_unstale":"2024-09-10T05:13:35.674549+0000","last_undegraded":"2024-09-10T05:13:35.674549+0000","last_fullsized":"2024-09-10T05:13:35.674549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:47.039216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.466476+0000","last_change":"2024-09-10T05:15:03.466476+0000","last_active":"2024-09-10T05:15:03.466476+0000","last_peered":"2024-09-10T05:15:03.466476+0000","last_clean":"2024-09-10T05:15:03.466476+0000","last_became_active":"2024-09-10T05:11:29.727038+0000","last_became_peered":"2024-09-10T05:11:29.727038+0000","last_unstale":"2024-09-10T05:15:03.466476+0000","last_undegraded":"2024-09-10T05:15:03.466476+0000","last_fullsized":"2024-09-10T05:15:03.466476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:03.466382+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:03.466382+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.466382+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:51.671119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.996465+0000","last_change":"2024-09-10T05:15:03.996465+0000","last_active":"2024-09-10T05:15:03.996465+0000","last_peered":"2024-09-10T05:15:03.996465+0000","last_clean":"2024-09-10T05:15:03.996465+0000","last_became_active":"2024-09-10T05:11:27.733320+0000","last_became_peered":"2024-09-10T05:11:27.733320+0000","last_unstale":"2024-09-10T05:15:03.996465+0000","last_undegraded":"2024-09-10T05:15:03.996465+0000","last_fullsized":"2024-09-10T05:15:03.996465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.996375+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.996375+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.996375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:10:21.072269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:28.218144+0000","last_change":"2024-09-10T05:15:28.218144+0000","last_active":"2024-09-10T05:15:28.218144+0000","last_peered":"2024-09-10T05:15:28.218144+0000","last_clean":"2024-09-10T05:15:28.218144+0000","last_became_active":"2024-09-10T05:11:31.734684+0000","last_became_peered":"2024-09-10T05:11:31.734684+0000","last_unstale":"2024-09-10T05:15:28.218144+0000","last_undegraded":"2024-09-10T05:15:28.218144+0000","last_fullsized":"2024-09-10T05:15:28.218144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:28.218055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:28.218055+0000","last_clean_scrub_stamp":"2024-09-10T05:15:28.218055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:16.287090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'16","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.914107+0000","last_change":"2024-09-10T05:11:33.748823+0000","last_active":"2024-09-10T05:13:35.914107+0000","last_peered":"2024-09-10T05:13:35.914107+0000","last_clean":"2024-09-10T05:13:35.914107+0000","last_became_active":"2024-09-10T05:11:33.748547+0000","last_became_peered":"2024-09-10T05:11:33.748547+0000","last_unstale":"2024-09-10T05:13:35.914107+0000","last_undegraded":"2024-09-10T05:13:35.914107+0000","last_fullsized":"2024-09-10T05:13:35.914107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'286","reported_seq":379,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.740219+0000","last_change":"2024-09-10T05:15:34.740113+0000","last_active":"2024-09-10T05:15:34.740219+0000","last_peered":"2024-09-10T05:15:34.740219+0000","last_clean":"2024-09-10T05:15:34.740219+0000","last_became_active":"2024-09-10T05:11:35.750761+0000","last_became_peered":"2024-09-10T05:11:35.750761+0000","last_unstale":"2024-09-10T05:15:34.740219+0000","last_undegraded":"2024-09-10T05:15:34.740219+0000","last_fullsized":"2024-09-10T05:15:34.740219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:34.740001+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:34.740001+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.740001+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:39.734962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954021+0000","last_change":"2024-09-10T05:11:37.768088+0000","last_active":"2024-09-10T05:12:04.954021+0000","last_peered":"2024-09-10T05:12:04.954021+0000","last_clean":"2024-09-10T05:12:04.954021+0000","last_became_active":"2024-09-10T05:11:37.767816+0000","last_became_peered":"2024-09-10T05:11:37.767816+0000","last_unstale":"2024-09-10T05:12:04.954021+0000","last_undegraded":"2024-09-10T05:12:04.954021+0000","last_fullsized":"2024-09-10T05:12:04.954021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:32.684488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.732045+0000","last_change":"2024-09-10T05:15:10.732045+0000","last_active":"2024-09-10T05:15:10.732045+0000","last_peered":"2024-09-10T05:15:10.732045+0000","last_clean":"2024-09-10T05:15:10.732045+0000","last_became_active":"2024-09-10T05:11:29.720243+0000","last_became_peered":"2024-09-10T05:11:29.720243+0000","last_unstale":"2024-09-10T05:15:10.732045+0000","last_undegraded":"2024-09-10T05:15:10.732045+0000","last_fullsized":"2024-09-10T05:15:10.732045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:10.731923+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:10.731923+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.731923+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:05.159738+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.448490+0000","last_change":"2024-09-10T05:14:51.448490+0000","last_active":"2024-09-10T05:14:51.448490+0000","last_peered":"2024-09-10T05:14:51.448490+0000","last_clean":"2024-09-10T05:14:51.448490+0000","last_became_active":"2024-09-10T05:11:27.723630+0000","last_became_peered":"2024-09-10T05:11:27.723630+0000","last_unstale":"2024-09-10T05:14:51.448490+0000","last_undegraded":"2024-09-10T05:14:51.448490+0000","last_fullsized":"2024-09-10T05:14:51.448490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:51.448399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:51.448399+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.448399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:08.698148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:26.253278+0000","last_change":"2024-09-10T05:15:26.253278+0000","last_active":"2024-09-10T05:15:26.253278+0000","last_peered":"2024-09-10T05:15:26.253278+0000","last_clean":"2024-09-10T05:15:26.253278+0000","last_became_active":"2024-09-10T05:11:31.737547+0000","last_became_peered":"2024-09-10T05:11:31.737547+0000","last_unstale":"2024-09-10T05:15:26.253278+0000","last_undegraded":"2024-09-10T05:15:26.253278+0000","last_fullsized":"2024-09-10T05:15:26.253278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:26.253156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:26.253156+0000","last_clean_scrub_stamp":"2024-09-10T05:15:26.253156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:07.907112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'74","reported_seq":156,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:33.219849+0000","last_change":"2024-09-10T05:15:33.219849+0000","last_active":"2024-09-10T05:15:33.219849+0000","last_peered":"2024-09-10T05:15:33.219849+0000","last_clean":"2024-09-10T05:15:33.219849+0000","last_became_active":"2024-09-10T05:11:33.740489+0000","last_became_peered":"2024-09-10T05:11:33.740489+0000","last_unstale":"2024-09-10T05:15:33.219849+0000","last_undegraded":"2024-09-10T05:15:33.219849+0000","last_fullsized":"2024-09-10T05:15:33.219849+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-10T05:15:33.219755+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-10T05:15:33.219755+0000","last_clean_scrub_stamp":"2024-09-10T05:15:33.219755+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:12.994581+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:37.606377+0000","last_change":"2024-09-10T05:15:37.606377+0000","last_active":"2024-09-10T05:15:37.606377+0000","last_peered":"2024-09-10T05:15:37.606377+0000","last_clean":"2024-09-10T05:15:37.606377+0000","last_became_active":"2024-09-10T05:11:35.753856+0000","last_became_peered":"2024-09-10T05:11:35.753856+0000","last_unstale":"2024-09-10T05:15:37.606377+0000","last_undegraded":"2024-09-10T05:15:37.606377+0000","last_fullsized":"2024-09-10T05:15:37.606377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:37.606291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:37.606291+0000","last_clean_scrub_stamp":"2024-09-10T05:15:37.606291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:42.715047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:45.104695+0000","last_change":"2024-09-10T05:15:45.104695+0000","last_active":"2024-09-10T05:15:45.104695+0000","last_peered":"2024-09-10T05:15:45.104695+0000","last_clean":"2024-09-10T05:15:45.104695+0000","last_became_active":"2024-09-10T05:11:37.758332+0000","last_became_peered":"2024-09-10T05:11:37.758332+0000","last_unstale":"2024-09-10T05:15:45.104695+0000","last_undegraded":"2024-09-10T05:15:45.104695+0000","last_fullsized":"2024-09-10T05:15:45.104695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:45.104610+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:45.104610+0000","last_clean_scrub_stamp":"2024-09-10T05:15:45.104610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:15.516776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.713125+0000","last_change":"2024-09-10T05:15:08.713125+0000","last_active":"2024-09-10T05:15:08.713125+0000","last_peered":"2024-09-10T05:15:08.713125+0000","last_clean":"2024-09-10T05:15:08.713125+0000","last_became_active":"2024-09-10T05:11:29.721899+0000","last_became_peered":"2024-09-10T05:11:29.721899+0000","last_unstale":"2024-09-10T05:15:08.713125+0000","last_undegraded":"2024-09-10T05:15:08.713125+0000","last_fullsized":"2024-09-10T05:15:08.713125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:08.713028+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:08.713028+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.713028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:16.548499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.992028+0000","last_change":"2024-09-10T05:15:04.992028+0000","last_active":"2024-09-10T05:15:04.992028+0000","last_peered":"2024-09-10T05:15:04.992028+0000","last_clean":"2024-09-10T05:15:04.992028+0000","last_became_active":"2024-09-10T05:11:27.733451+0000","last_became_peered":"2024-09-10T05:11:27.733451+0000","last_unstale":"2024-09-10T05:15:04.992028+0000","last_undegraded":"2024-09-10T05:15:04.992028+0000","last_fullsized":"2024-09-10T05:15:04.992028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:04.991935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:04.991935+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.991935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:35.404102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.749996+0000","last_change":"2024-09-10T05:15:20.749996+0000","last_active":"2024-09-10T05:15:20.749996+0000","last_peered":"2024-09-10T05:15:20.749996+0000","last_clean":"2024-09-10T05:15:20.749996+0000","last_became_active":"2024-09-10T05:11:31.735565+0000","last_became_peered":"2024-09-10T05:11:31.735565+0000","last_unstale":"2024-09-10T05:15:20.749996+0000","last_undegraded":"2024-09-10T05:15:20.749996+0000","last_fullsized":"2024-09-10T05:15:20.749996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:20.749892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:20.749892+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.749892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:19.742771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'44","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:25.706116+0000","last_change":"2024-09-10T05:15:25.706116+0000","last_active":"2024-09-10T05:15:25.706116+0000","last_peered":"2024-09-10T05:15:25.706116+0000","last_clean":"2024-09-10T05:15:25.706116+0000","last_became_active":"2024-09-10T05:11:33.742656+0000","last_became_peered":"2024-09-10T05:11:33.742656+0000","last_unstale":"2024-09-10T05:15:25.706116+0000","last_undegraded":"2024-09-10T05:15:25.706116+0000","last_fullsized":"2024-09-10T05:15:25.706116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'44","last_scrub_stamp":"2024-09-10T05:15:25.706013+0000","last_deep_scrub":"37'44","last_deep_scrub_stamp":"2024-09-10T05:15:25.706013+0000","last_clean_scrub_stamp":"2024-09-10T05:15:25.706013+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:31.251549+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954236+0000","last_change":"2024-09-10T05:11:35.751391+0000","last_active":"2024-09-10T05:12:04.954236+0000","last_peered":"2024-09-10T05:12:04.954236+0000","last_clean":"2024-09-10T05:12:04.954236+0000","last_became_active":"2024-09-10T05:11:35.750960+0000","last_became_peered":"2024-09-10T05:11:35.750960+0000","last_unstale":"2024-09-10T05:12:04.954236+0000","last_undegraded":"2024-09-10T05:12:04.954236+0000","last_fullsized":"2024-09-10T05:12:04.954236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:07.690221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.959775+0000","last_change":"2024-09-10T05:11:37.768897+0000","last_active":"2024-09-10T05:12:51.959775+0000","last_peered":"2024-09-10T05:12:51.959775+0000","last_clean":"2024-09-10T05:12:51.959775+0000","last_became_active":"2024-09-10T05:11:37.768559+0000","last_became_peered":"2024-09-10T05:11:37.768559+0000","last_unstale":"2024-09-10T05:12:51.959775+0000","last_undegraded":"2024-09-10T05:12:51.959775+0000","last_fullsized":"2024-09-10T05:12:51.959775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:41.676922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.981935+0000","last_change":"2024-09-10T05:15:24.981935+0000","last_active":"2024-09-10T05:15:24.981935+0000","last_peered":"2024-09-10T05:15:24.981935+0000","last_clean":"2024-09-10T05:15:24.981935+0000","last_became_active":"2024-09-10T05:11:29.732703+0000","last_became_peered":"2024-09-10T05:11:29.732703+0000","last_unstale":"2024-09-10T05:15:24.981935+0000","last_undegraded":"2024-09-10T05:15:24.981935+0000","last_fullsized":"2024-09-10T05:15:24.981935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:24.981859+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:24.981859+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.981859+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:28.030709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.494634+0000","last_change":"2024-09-10T05:14:56.494569+0000","last_active":"2024-09-10T05:14:56.494634+0000","last_peered":"2024-09-10T05:14:56.494634+0000","last_clean":"2024-09-10T05:14:56.494634+0000","last_became_active":"2024-09-10T05:11:27.713416+0000","last_became_peered":"2024-09-10T05:11:27.713416+0000","last_unstale":"2024-09-10T05:14:56.494634+0000","last_undegraded":"2024-09-10T05:14:56.494634+0000","last_fullsized":"2024-09-10T05:14:56.494634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:56.494480+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.494480+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.494480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:49.778320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.315033+0000","last_change":"2024-09-10T05:15:24.315033+0000","last_active":"2024-09-10T05:15:24.315033+0000","last_peered":"2024-09-10T05:15:24.315033+0000","last_clean":"2024-09-10T05:15:24.315033+0000","last_became_active":"2024-09-10T05:11:31.736540+0000","last_became_peered":"2024-09-10T05:11:31.736540+0000","last_unstale":"2024-09-10T05:15:24.315033+0000","last_undegraded":"2024-09-10T05:15:24.315033+0000","last_fullsized":"2024-09-10T05:15:24.315033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:24.314941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:24.314941+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.314941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:23:29.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'36","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.101381+0000","last_change":"2024-09-10T05:11:33.743575+0000","last_active":"2024-09-10T05:14:43.101381+0000","last_peered":"2024-09-10T05:14:43.101381+0000","last_clean":"2024-09-10T05:14:43.101381+0000","last_became_active":"2024-09-10T05:11:33.743207+0000","last_became_peered":"2024-09-10T05:11:33.743207+0000","last_unstale":"2024-09-10T05:14:43.101381+0000","last_undegraded":"2024-09-10T05:14:43.101381+0000","last_fullsized":"2024-09-10T05:14:43.101381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:19.732970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954998+0000","last_change":"2024-09-10T05:11:35.753328+0000","last_active":"2024-09-10T05:12:04.954998+0000","last_peered":"2024-09-10T05:12:04.954998+0000","last_clean":"2024-09-10T05:12:04.954998+0000","last_became_active":"2024-09-10T05:11:35.753001+0000","last_became_peered":"2024-09-10T05:11:35.753001+0000","last_unstale":"2024-09-10T05:12:04.954998+0000","last_undegraded":"2024-09-10T05:12:04.954998+0000","last_fullsized":"2024-09-10T05:12:04.954998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:34.730376+0000","last_clean_scrub_stamp":"2024-09-10T05:11:34.730376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:19.217985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.480743+0000","last_change":"2024-09-10T05:11:37.767945+0000","last_active":"2024-09-10T05:14:36.480743+0000","last_peered":"2024-09-10T05:14:36.480743+0000","last_clean":"2024-09-10T05:14:36.480743+0000","last_became_active":"2024-09-10T05:11:37.767649+0000","last_became_peered":"2024-09-10T05:11:37.767649+0000","last_unstale":"2024-09-10T05:14:36.480743+0000","last_undegraded":"2024-09-10T05:14:36.480743+0000","last_fullsized":"2024-09-10T05:14:36.480743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:47.436935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.664923+0000","last_change":"2024-09-10T05:15:07.664923+0000","last_active":"2024-09-10T05:15:07.664923+0000","last_peered":"2024-09-10T05:15:07.664923+0000","last_clean":"2024-09-10T05:15:07.664923+0000","last_became_active":"2024-09-10T05:11:29.718689+0000","last_became_peered":"2024-09-10T05:11:29.718689+0000","last_unstale":"2024-09-10T05:15:07.664923+0000","last_undegraded":"2024-09-10T05:15:07.664923+0000","last_fullsized":"2024-09-10T05:15:07.664923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:07.664840+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:07.664840+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.664840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:53.882406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.493574+0000","last_change":"2024-09-10T05:14:57.493473+0000","last_active":"2024-09-10T05:14:57.493574+0000","last_peered":"2024-09-10T05:14:57.493574+0000","last_clean":"2024-09-10T05:14:57.493574+0000","last_became_active":"2024-09-10T05:11:27.716073+0000","last_became_peered":"2024-09-10T05:11:27.716073+0000","last_unstale":"2024-09-10T05:14:57.493574+0000","last_undegraded":"2024-09-10T05:14:57.493574+0000","last_fullsized":"2024-09-10T05:14:57.493574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:57.493360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:57.493360+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.493360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:16.549263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:25.285210+0000","last_change":"2024-09-10T05:15:25.285210+0000","last_active":"2024-09-10T05:15:25.285210+0000","last_peered":"2024-09-10T05:15:25.285210+0000","last_clean":"2024-09-10T05:15:25.285210+0000","last_became_active":"2024-09-10T05:11:31.735726+0000","last_became_peered":"2024-09-10T05:11:31.735726+0000","last_unstale":"2024-09-10T05:15:25.285210+0000","last_undegraded":"2024-09-10T05:15:25.285210+0000","last_fullsized":"2024-09-10T05:15:25.285210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:15:25.285128+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:15:25.285128+0000","last_clean_scrub_stamp":"2024-09-10T05:15:25.285128+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:58.121835+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'47","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:43.110530+0000","last_change":"2024-09-10T05:11:33.748407+0000","last_active":"2024-09-10T05:14:43.110530+0000","last_peered":"2024-09-10T05:14:43.110530+0000","last_clean":"2024-09-10T05:14:43.110530+0000","last_became_active":"2024-09-10T05:11:33.748120+0000","last_became_peered":"2024-09-10T05:11:33.748120+0000","last_unstale":"2024-09-10T05:14:43.110530+0000","last_undegraded":"2024-09-10T05:14:43.110530+0000","last_fullsized":"2024-09-10T05:14:43.110530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:32.722156+0000","last_clean_scrub_stamp":"2024-09-10T05:11:32.722156+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:46:20.643301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:40.613346+0000","last_change":"2024-09-10T05:15:40.613346+0000","last_active":"2024-09-10T05:15:40.613346+0000","last_peered":"2024-09-10T05:15:40.613346+0000","last_clean":"2024-09-10T05:15:40.613346+0000","last_became_active":"2024-09-10T05:11:35.753437+0000","last_became_peered":"2024-09-10T05:11:35.753437+0000","last_unstale":"2024-09-10T05:15:40.613346+0000","last_undegraded":"2024-09-10T05:15:40.613346+0000","last_fullsized":"2024-09-10T05:15:40.613346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:40.613217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:40.613217+0000","last_clean_scrub_stamp":"2024-09-10T05:15:40.613217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:40.765442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'10","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.285208+0000","last_change":"2024-09-10T05:11:37.765397+0000","last_active":"2024-09-10T05:13:34.285208+0000","last_peered":"2024-09-10T05:13:34.285208+0000","last_clean":"2024-09-10T05:13:34.285208+0000","last_became_active":"2024-09-10T05:11:37.765102+0000","last_became_peered":"2024-09-10T05:11:37.765102+0000","last_unstale":"2024-09-10T05:13:34.285208+0000","last_undegraded":"2024-09-10T05:13:34.285208+0000","last_fullsized":"2024-09-10T05:13:34.285208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:41.297084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":67,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.375108+0000","last_change":"2024-09-10T05:15:08.375108+0000","last_active":"2024-09-10T05:15:08.375108+0000","last_peered":"2024-09-10T05:15:08.375108+0000","last_clean":"2024-09-10T05:15:08.375108+0000","last_became_active":"2024-09-10T05:11:29.729468+0000","last_became_peered":"2024-09-10T05:11:29.729468+0000","last_unstale":"2024-09-10T05:15:08.375108+0000","last_undegraded":"2024-09-10T05:15:08.375108+0000","last_fullsized":"2024-09-10T05:15:08.375108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:08.375011+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:08.375011+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.375011+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:38.702635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.709903+0000","last_change":"2024-09-10T05:14:54.709815+0000","last_active":"2024-09-10T05:14:54.709903+0000","last_peered":"2024-09-10T05:14:54.709903+0000","last_clean":"2024-09-10T05:14:54.709903+0000","last_became_active":"2024-09-10T05:11:27.706484+0000","last_became_peered":"2024-09-10T05:11:27.706484+0000","last_unstale":"2024-09-10T05:14:54.709903+0000","last_undegraded":"2024-09-10T05:14:54.709903+0000","last_fullsized":"2024-09-10T05:14:54.709903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:54.709723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:54.709723+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.709723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:58.926828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'12","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.590666+0000","last_change":"2024-09-10T05:15:08.590666+0000","last_active":"2024-09-10T05:15:08.590666+0000","last_peered":"2024-09-10T05:15:08.590666+0000","last_clean":"2024-09-10T05:15:08.590666+0000","last_became_active":"2024-09-10T05:11:29.729019+0000","last_became_peered":"2024-09-10T05:11:29.729019+0000","last_unstale":"2024-09-10T05:15:08.590666+0000","last_undegraded":"2024-09-10T05:15:08.590666+0000","last_fullsized":"2024-09-10T05:15:08.590666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-10T05:15:08.590592+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-10T05:15:08.590592+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.590592+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:11.806872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.491538+0000","last_change":"2024-09-10T05:14:52.491464+0000","last_active":"2024-09-10T05:14:52.491538+0000","last_peered":"2024-09-10T05:14:52.491538+0000","last_clean":"2024-09-10T05:14:52.491538+0000","last_became_active":"2024-09-10T05:11:27.714487+0000","last_became_peered":"2024-09-10T05:11:27.714487+0000","last_unstale":"2024-09-10T05:14:52.491538+0000","last_undegraded":"2024-09-10T05:14:52.491538+0000","last_fullsized":"2024-09-10T05:14:52.491538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:52.491377+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:52.491377+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.491377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:49.460874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'2","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:28.983488+0000","last_change":"2024-09-10T05:15:28.983488+0000","last_active":"2024-09-10T05:15:28.983488+0000","last_peered":"2024-09-10T05:15:28.983488+0000","last_clean":"2024-09-10T05:15:28.983488+0000","last_became_active":"2024-09-10T05:11:29.729359+0000","last_became_peered":"2024-09-10T05:11:29.729359+0000","last_unstale":"2024-09-10T05:15:28.983488+0000","last_undegraded":"2024-09-10T05:15:28.983488+0000","last_fullsized":"2024-09-10T05:15:28.983488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:28.983403+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:28.983403+0000","last_clean_scrub_stamp":"2024-09-10T05:15:28.983403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:30.534141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.978066+0000","last_change":"2024-09-10T05:15:05.978001+0000","last_active":"2024-09-10T05:15:05.978066+0000","last_peered":"2024-09-10T05:15:05.978066+0000","last_clean":"2024-09-10T05:15:05.978066+0000","last_became_active":"2024-09-10T05:11:27.730905+0000","last_became_peered":"2024-09-10T05:11:27.730905+0000","last_unstale":"2024-09-10T05:15:05.978066+0000","last_undegraded":"2024-09-10T05:15:05.978066+0000","last_fullsized":"2024-09-10T05:15:05.978066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:05.977914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:05.977914+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.977914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:59.732683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.630650+0000","last_change":"2024-09-10T05:15:09.630650+0000","last_active":"2024-09-10T05:15:09.630650+0000","last_peered":"2024-09-10T05:15:09.630650+0000","last_clean":"2024-09-10T05:15:09.630650+0000","last_became_active":"2024-09-10T05:11:29.727454+0000","last_became_peered":"2024-09-10T05:11:29.727454+0000","last_unstale":"2024-09-10T05:15:09.630650+0000","last_undegraded":"2024-09-10T05:15:09.630650+0000","last_fullsized":"2024-09-10T05:15:09.630650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:09.630545+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:09.630545+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.630545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:42.825841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.503693+0000","last_change":"2024-09-10T05:14:54.503637+0000","last_active":"2024-09-10T05:14:54.503693+0000","last_peered":"2024-09-10T05:14:54.503693+0000","last_clean":"2024-09-10T05:14:54.503693+0000","last_became_active":"2024-09-10T05:11:27.713962+0000","last_became_peered":"2024-09-10T05:11:27.713962+0000","last_unstale":"2024-09-10T05:14:54.503693+0000","last_undegraded":"2024-09-10T05:14:54.503693+0000","last_fullsized":"2024-09-10T05:14:54.503693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:54.503543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:54.503543+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.503543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:36.529415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'8","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.551836+0000","last_change":"2024-09-10T05:15:07.551762+0000","last_active":"2024-09-10T05:15:07.551836+0000","last_peered":"2024-09-10T05:15:07.551836+0000","last_clean":"2024-09-10T05:15:07.551836+0000","last_became_active":"2024-09-10T05:11:29.725099+0000","last_became_peered":"2024-09-10T05:11:29.725099+0000","last_unstale":"2024-09-10T05:15:07.551836+0000","last_undegraded":"2024-09-10T05:15:07.551836+0000","last_fullsized":"2024-09-10T05:15:07.551836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:07.551648+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:07.551648+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.551648+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:16.567800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.545597+0000","last_change":"2024-09-10T05:14:49.545597+0000","last_active":"2024-09-10T05:14:49.545597+0000","last_peered":"2024-09-10T05:14:49.545597+0000","last_clean":"2024-09-10T05:14:49.545597+0000","last_became_active":"2024-09-10T05:11:27.718926+0000","last_became_peered":"2024-09-10T05:11:27.718926+0000","last_unstale":"2024-09-10T05:14:49.545597+0000","last_undegraded":"2024-09-10T05:14:49.545597+0000","last_fullsized":"2024-09-10T05:14:49.545597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:49.545500+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:49.545500+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.545500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:57.641677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'8","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.398363+0000","last_change":"2024-09-10T05:15:07.398282+0000","last_active":"2024-09-10T05:15:07.398363+0000","last_peered":"2024-09-10T05:15:07.398363+0000","last_clean":"2024-09-10T05:15:07.398363+0000","last_became_active":"2024-09-10T05:12:04.964750+0000","last_became_peered":"2024-09-10T05:12:04.964750+0000","last_unstale":"2024-09-10T05:15:07.398363+0000","last_undegraded":"2024-09-10T05:15:07.398363+0000","last_fullsized":"2024-09-10T05:15:07.398363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:07.398168+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:07.398168+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.398168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:10.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.416193+0000","last_change":"2024-09-10T05:14:52.416193+0000","last_active":"2024-09-10T05:14:52.416193+0000","last_peered":"2024-09-10T05:14:52.416193+0000","last_clean":"2024-09-10T05:14:52.416193+0000","last_became_active":"2024-09-10T05:11:27.718282+0000","last_became_peered":"2024-09-10T05:11:27.718282+0000","last_unstale":"2024-09-10T05:14:52.416193+0000","last_undegraded":"2024-09-10T05:14:52.416193+0000","last_fullsized":"2024-09-10T05:14:52.416193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.416097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.416097+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.416097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:11.180415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:06.501458+0000","last_change":"2024-09-10T05:15:06.501364+0000","last_active":"2024-09-10T05:15:06.501458+0000","last_peered":"2024-09-10T05:15:06.501458+0000","last_clean":"2024-09-10T05:15:06.501458+0000","last_became_active":"2024-09-10T05:11:29.723387+0000","last_became_peered":"2024-09-10T05:11:29.723387+0000","last_unstale":"2024-09-10T05:15:06.501458+0000","last_undegraded":"2024-09-10T05:15:06.501458+0000","last_fullsized":"2024-09-10T05:15:06.501458+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:06.501241+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:06.501241+0000","last_clean_scrub_stamp":"2024-09-10T05:15:06.501241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:02.303540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.663822+0000","last_change":"2024-09-10T05:14:56.663822+0000","last_active":"2024-09-10T05:14:56.663822+0000","last_peered":"2024-09-10T05:14:56.663822+0000","last_clean":"2024-09-10T05:14:56.663822+0000","last_became_active":"2024-09-10T05:11:27.724815+0000","last_became_peered":"2024-09-10T05:11:27.724815+0000","last_unstale":"2024-09-10T05:14:56.663822+0000","last_undegraded":"2024-09-10T05:14:56.663822+0000","last_fullsized":"2024-09-10T05:14:56.663822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:14:56.663737+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.663737+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.663737+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:18.281662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.394144+0000","last_change":"2024-09-10T05:15:05.394073+0000","last_active":"2024-09-10T05:15:05.394144+0000","last_peered":"2024-09-10T05:15:05.394144+0000","last_clean":"2024-09-10T05:15:05.394144+0000","last_became_active":"2024-09-10T05:11:29.723469+0000","last_became_peered":"2024-09-10T05:11:29.723469+0000","last_unstale":"2024-09-10T05:15:05.394144+0000","last_undegraded":"2024-09-10T05:15:05.394144+0000","last_fullsized":"2024-09-10T05:15:05.394144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-10T05:15:05.393954+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-10T05:15:05.393954+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.393954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:38:36.032466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.489090+0000","last_change":"2024-09-10T05:14:55.489090+0000","last_active":"2024-09-10T05:14:55.489090+0000","last_peered":"2024-09-10T05:14:55.489090+0000","last_clean":"2024-09-10T05:14:55.489090+0000","last_became_active":"2024-09-10T05:11:27.714348+0000","last_became_peered":"2024-09-10T05:11:27.714348+0000","last_unstale":"2024-09-10T05:14:55.489090+0000","last_undegraded":"2024-09-10T05:14:55.489090+0000","last_fullsized":"2024-09-10T05:14:55.489090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:55.488990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:55.488990+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.488990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:10.435358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'8","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.268130+0000","last_change":"2024-09-10T05:15:13.268130+0000","last_active":"2024-09-10T05:15:13.268130+0000","last_peered":"2024-09-10T05:15:13.268130+0000","last_clean":"2024-09-10T05:15:13.268130+0000","last_became_active":"2024-09-10T05:11:29.729148+0000","last_became_peered":"2024-09-10T05:11:29.729148+0000","last_unstale":"2024-09-10T05:15:13.268130+0000","last_undegraded":"2024-09-10T05:15:13.268130+0000","last_fullsized":"2024-09-10T05:15:13.268130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:13.268020+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:13.268020+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.268020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:00.698029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.019917+0000","last_change":"2024-09-10T05:15:07.019917+0000","last_active":"2024-09-10T05:15:07.019917+0000","last_peered":"2024-09-10T05:15:07.019917+0000","last_clean":"2024-09-10T05:15:07.019917+0000","last_became_active":"2024-09-10T05:11:27.735159+0000","last_became_peered":"2024-09-10T05:11:27.735159+0000","last_unstale":"2024-09-10T05:15:07.019917+0000","last_undegraded":"2024-09-10T05:15:07.019917+0000","last_fullsized":"2024-09-10T05:15:07.019917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:07.019834+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:07.019834+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.019834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:09.595861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'12","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:29.936528+0000","last_change":"2024-09-10T05:15:29.936528+0000","last_active":"2024-09-10T05:15:29.936528+0000","last_peered":"2024-09-10T05:15:29.936528+0000","last_clean":"2024-09-10T05:15:29.936528+0000","last_became_active":"2024-09-10T05:11:29.729476+0000","last_became_peered":"2024-09-10T05:11:29.729476+0000","last_unstale":"2024-09-10T05:15:29.936528+0000","last_undegraded":"2024-09-10T05:15:29.936528+0000","last_fullsized":"2024-09-10T05:15:29.936528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-10T05:15:29.936445+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-10T05:15:29.936445+0000","last_clean_scrub_stamp":"2024-09-10T05:15:29.936445+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:39:28.532827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.511867+0000","last_change":"2024-09-10T05:14:57.511867+0000","last_active":"2024-09-10T05:14:57.511867+0000","last_peered":"2024-09-10T05:14:57.511867+0000","last_clean":"2024-09-10T05:14:57.511867+0000","last_became_active":"2024-09-10T05:11:27.715014+0000","last_became_peered":"2024-09-10T05:11:27.715014+0000","last_unstale":"2024-09-10T05:14:57.511867+0000","last_undegraded":"2024-09-10T05:14:57.511867+0000","last_fullsized":"2024-09-10T05:14:57.511867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:57.511763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:57.511763+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.511763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:55.932537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.690109+0000","last_change":"2024-09-10T05:15:13.690109+0000","last_active":"2024-09-10T05:15:13.690109+0000","last_peered":"2024-09-10T05:15:13.690109+0000","last_clean":"2024-09-10T05:15:13.690109+0000","last_became_active":"2024-09-10T05:11:29.725047+0000","last_became_peered":"2024-09-10T05:11:29.725047+0000","last_unstale":"2024-09-10T05:15:13.690109+0000","last_undegraded":"2024-09-10T05:15:13.690109+0000","last_fullsized":"2024-09-10T05:15:13.690109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:13.690031+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:13.690031+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.690031+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:40.863292+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.482237+0000","last_change":"2024-09-10T05:14:54.482237+0000","last_active":"2024-09-10T05:14:54.482237+0000","last_peered":"2024-09-10T05:14:54.482237+0000","last_clean":"2024-09-10T05:14:54.482237+0000","last_became_active":"2024-09-10T05:11:27.728257+0000","last_became_peered":"2024-09-10T05:11:27.728257+0000","last_unstale":"2024-09-10T05:14:54.482237+0000","last_undegraded":"2024-09-10T05:14:54.482237+0000","last_fullsized":"2024-09-10T05:14:54.482237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:54.482153+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:54.482153+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.482153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:10.009942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.314698+0000","last_change":"2024-09-10T05:15:12.314698+0000","last_active":"2024-09-10T05:15:12.314698+0000","last_peered":"2024-09-10T05:15:12.314698+0000","last_clean":"2024-09-10T05:15:12.314698+0000","last_became_active":"2024-09-10T05:11:29.721826+0000","last_became_peered":"2024-09-10T05:11:29.721826+0000","last_unstale":"2024-09-10T05:15:12.314698+0000","last_undegraded":"2024-09-10T05:15:12.314698+0000","last_fullsized":"2024-09-10T05:15:12.314698+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:15:12.314615+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:15:12.314615+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.314615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:25:54.503608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.515429+0000","last_change":"2024-09-10T05:14:56.515429+0000","last_active":"2024-09-10T05:14:56.515429+0000","last_peered":"2024-09-10T05:14:56.515429+0000","last_clean":"2024-09-10T05:14:56.515429+0000","last_became_active":"2024-09-10T05:11:27.730469+0000","last_became_peered":"2024-09-10T05:11:27.730469+0000","last_unstale":"2024-09-10T05:14:56.515429+0000","last_undegraded":"2024-09-10T05:14:56.515429+0000","last_fullsized":"2024-09-10T05:14:56.515429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:14:56.515326+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.515326+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.515326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:20.046107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'18","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.342989+0000","last_change":"2024-09-10T05:15:11.342989+0000","last_active":"2024-09-10T05:15:11.342989+0000","last_peered":"2024-09-10T05:15:11.342989+0000","last_clean":"2024-09-10T05:15:11.342989+0000","last_became_active":"2024-09-10T05:12:04.965056+0000","last_became_peered":"2024-09-10T05:12:04.965056+0000","last_unstale":"2024-09-10T05:15:11.342989+0000","last_undegraded":"2024-09-10T05:15:11.342989+0000","last_fullsized":"2024-09-10T05:15:11.342989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-10T05:15:11.342907+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-10T05:15:11.342907+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.342907+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:55.366767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.012305+0000","last_change":"2024-09-10T05:15:08.012305+0000","last_active":"2024-09-10T05:15:08.012305+0000","last_peered":"2024-09-10T05:15:08.012305+0000","last_clean":"2024-09-10T05:15:08.012305+0000","last_became_active":"2024-09-10T05:11:27.722079+0000","last_became_peered":"2024-09-10T05:11:27.722079+0000","last_unstale":"2024-09-10T05:15:08.012305+0000","last_undegraded":"2024-09-10T05:15:08.012305+0000","last_fullsized":"2024-09-10T05:15:08.012305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:08.012205+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:08.012205+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.012205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:47.103635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'16","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.323651+0000","last_change":"2024-09-10T05:15:10.323651+0000","last_active":"2024-09-10T05:15:10.323651+0000","last_peered":"2024-09-10T05:15:10.323651+0000","last_clean":"2024-09-10T05:15:10.323651+0000","last_became_active":"2024-09-10T05:11:29.733895+0000","last_became_peered":"2024-09-10T05:11:29.733895+0000","last_unstale":"2024-09-10T05:15:10.323651+0000","last_undegraded":"2024-09-10T05:15:10.323651+0000","last_fullsized":"2024-09-10T05:15:10.323651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:10.323533+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:10.323533+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.323533+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:55.632072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.024782+0000","last_change":"2024-09-10T05:15:09.024782+0000","last_active":"2024-09-10T05:15:09.024782+0000","last_peered":"2024-09-10T05:15:09.024782+0000","last_clean":"2024-09-10T05:15:09.024782+0000","last_became_active":"2024-09-10T05:11:27.735801+0000","last_became_peered":"2024-09-10T05:11:27.735801+0000","last_unstale":"2024-09-10T05:15:09.024782+0000","last_undegraded":"2024-09-10T05:15:09.024782+0000","last_fullsized":"2024-09-10T05:15:09.024782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:15:09.024688+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:15:09.024688+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.024688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:45.203541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'8","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.965572+0000","last_change":"2024-09-10T05:15:27.965572+0000","last_active":"2024-09-10T05:15:27.965572+0000","last_peered":"2024-09-10T05:15:27.965572+0000","last_clean":"2024-09-10T05:15:27.965572+0000","last_became_active":"2024-09-10T05:11:29.735555+0000","last_became_peered":"2024-09-10T05:11:29.735555+0000","last_unstale":"2024-09-10T05:15:27.965572+0000","last_undegraded":"2024-09-10T05:15:27.965572+0000","last_fullsized":"2024-09-10T05:15:27.965572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:27.965487+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:27.965487+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.965487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:21.675276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.675684+0000","last_change":"2024-09-10T05:14:59.675684+0000","last_active":"2024-09-10T05:14:59.675684+0000","last_peered":"2024-09-10T05:14:59.675684+0000","last_clean":"2024-09-10T05:14:59.675684+0000","last_became_active":"2024-09-10T05:11:27.723820+0000","last_became_peered":"2024-09-10T05:11:27.723820+0000","last_unstale":"2024-09-10T05:14:59.675684+0000","last_undegraded":"2024-09-10T05:14:59.675684+0000","last_fullsized":"2024-09-10T05:14:59.675684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:59.675555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:59.675555+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.675555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:06.058468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.371665+0000","last_change":"2024-09-10T05:15:09.371665+0000","last_active":"2024-09-10T05:15:09.371665+0000","last_peered":"2024-09-10T05:15:09.371665+0000","last_clean":"2024-09-10T05:15:09.371665+0000","last_became_active":"2024-09-10T05:11:29.723816+0000","last_became_peered":"2024-09-10T05:11:29.723816+0000","last_unstale":"2024-09-10T05:15:09.371665+0000","last_undegraded":"2024-09-10T05:15:09.371665+0000","last_fullsized":"2024-09-10T05:15:09.371665+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:09.371549+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:09.371549+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.371549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:50.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.054715+0000","last_change":"2024-09-10T05:15:11.054715+0000","last_active":"2024-09-10T05:15:11.054715+0000","last_peered":"2024-09-10T05:15:11.054715+0000","last_clean":"2024-09-10T05:15:11.054715+0000","last_became_active":"2024-09-10T05:11:27.736370+0000","last_became_peered":"2024-09-10T05:11:27.736370+0000","last_unstale":"2024-09-10T05:15:11.054715+0000","last_undegraded":"2024-09-10T05:15:11.054715+0000","last_fullsized":"2024-09-10T05:15:11.054715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:11.054610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:11.054610+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.054610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:14.341859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.066856+0000","last_change":"2024-09-10T05:15:10.066856+0000","last_active":"2024-09-10T05:15:10.066856+0000","last_peered":"2024-09-10T05:15:10.066856+0000","last_clean":"2024-09-10T05:15:10.066856+0000","last_became_active":"2024-09-10T05:11:27.731202+0000","last_became_peered":"2024-09-10T05:11:27.731202+0000","last_unstale":"2024-09-10T05:15:10.066856+0000","last_undegraded":"2024-09-10T05:15:10.066856+0000","last_fullsized":"2024-09-10T05:15:10.066856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:10.066744+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:10.066744+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.066744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:52.986117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.611484+0000","last_change":"2024-09-10T05:15:11.611484+0000","last_active":"2024-09-10T05:15:11.611484+0000","last_peered":"2024-09-10T05:15:11.611484+0000","last_clean":"2024-09-10T05:15:11.611484+0000","last_became_active":"2024-09-10T05:11:29.723467+0000","last_became_peered":"2024-09-10T05:11:29.723467+0000","last_unstale":"2024-09-10T05:15:11.611484+0000","last_undegraded":"2024-09-10T05:15:11.611484+0000","last_fullsized":"2024-09-10T05:15:11.611484+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:11.611402+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:11.611402+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.611402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:40.804159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.480235+0000","last_change":"2024-09-10T05:14:58.480235+0000","last_active":"2024-09-10T05:14:58.480235+0000","last_peered":"2024-09-10T05:14:58.480235+0000","last_clean":"2024-09-10T05:14:58.480235+0000","last_became_active":"2024-09-10T05:11:27.713659+0000","last_became_peered":"2024-09-10T05:11:27.713659+0000","last_unstale":"2024-09-10T05:14:58.480235+0000","last_undegraded":"2024-09-10T05:14:58.480235+0000","last_fullsized":"2024-09-10T05:14:58.480235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.480141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.480141+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.480141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:58.809531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'10","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.277001+0000","last_change":"2024-09-10T05:15:19.277001+0000","last_active":"2024-09-10T05:15:19.277001+0000","last_peered":"2024-09-10T05:15:19.277001+0000","last_clean":"2024-09-10T05:15:19.277001+0000","last_became_active":"2024-09-10T05:12:04.964552+0000","last_became_peered":"2024-09-10T05:12:04.964552+0000","last_unstale":"2024-09-10T05:15:19.277001+0000","last_undegraded":"2024-09-10T05:15:19.277001+0000","last_fullsized":"2024-09-10T05:15:19.277001+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:15:19.276901+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:15:19.276901+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.276901+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:58.105940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2287,"ondisk_log_size":2287,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1713,"ondisk_log_size":1713,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640314,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":160879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640315,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":749393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640315,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40540,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331300,"statfs":{"total":96636764160,"available":96595251200,"internally_reserved":0,"allocated":1060864,"data_stored":750309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44128,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327712,"statfs":{"total":96636764160,"available":96591577088,"internally_reserved":0,"allocated":475136,"data_stored":160447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:15:48.660 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.660 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.660 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.661 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.661 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.661 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.661 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.662 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.662 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.662 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.662 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.662 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.663 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.663 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.663 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.663 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.663 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.664 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.664 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.664 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.664 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.664 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.665 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.665 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.665 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.665 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.665 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.665 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.666 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.666 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.666 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.666 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T05:11:34.730376+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.666 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.666 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T05:11:32.722156+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=32, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.666 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:15:48.667 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T05:16:08.668 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:16:08.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.779+0000 7f6e2fb3d640 1 Processor -- start 2024-09-10T05:16:08.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.779+0000 7f6e2fb3d640 1 -- start start 2024-09-10T05:16:08.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.779+0000 7f6e2fb3d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6e28130340 0x7f6e28132730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:16:08.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.779+0000 7f6e2fb3d640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e28124160 con 0x7f6e28123670 2024-09-10T05:16:08.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.779+0000 7f6e2fb3d640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f6e28073e00 con 0x7f6e28130340 2024-09-10T05:16:08.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.780+0000 7f6e2d0d8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6e28130340 0x7f6e28132730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:16:08.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.780+0000 7f6e2d8d9640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6e28123670 0x7f6e28123a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:54226/0 (socket says 172.21.15.139:54226) 2024-09-10T05:16:08.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.780+0000 7f6e2d8d9640 1 -- 172.21.15.139:0/4076770817 learned_addr learned my addr 172.21.15.139:0/4076770817 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:16:08.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.780+0000 7f6e2d0d8640 1 -- 172.21.15.139:0/4076770817 >> v1:172.21.15.139:6789/0 conn(0x7f6e28123670 legacy=0x7f6e28123a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:16:08.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.780+0000 7f6e2d0d8640 1 -- 172.21.15.139:0/4076770817 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2806dea0 con 0x7f6e28130340 2024-09-10T05:16:08.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.781+0000 7f6e2d0d8640 1 --2- 172.21.15.139:0/4076770817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e28130340 0x7f6e28132730 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009720 tx=0x7f6e1802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adebc805ed85a353 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:16:08.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.781+0000 7f6e2c8d7640 1 -- 172.21.15.139:0/4076770817 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e18037070 con 0x7f6e28130340 2024-09-10T05:16:08.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.781+0000 7f6e2c8d7640 1 -- 172.21.15.139:0/4076770817 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1802ad90 con 0x7f6e28130340 2024-09-10T05:16:08.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.781+0000 7f6e2c8d7640 1 -- 172.21.15.139:0/4076770817 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e18032590 con 0x7f6e28130340 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.781+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/4076770817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e28130340 msgr2=0x7f6e28132730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.781+0000 7f6e2fb3d640 1 --2- 172.21.15.139:0/4076770817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e28130340 0x7f6e28132730 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009720 tx=0x7f6e1802a110 comp rx=0 tx=0).stop 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.781+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/4076770817 shutdown_connections 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.781+0000 7f6e2fb3d640 1 --2- 172.21.15.139:0/4076770817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e28130340 0x7f6e28132730 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.781+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/4076770817 >> 172.21.15.139:0/4076770817 conn(0x7f6e28071510 msgr2=0x7f6e2810fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.781+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/4076770817 shutdown_connections 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.781+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/4076770817 wait complete. 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.782+0000 7f6e2fb3d640 1 Processor -- start 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.782+0000 7f6e2fb3d640 1 -- start start 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.783+0000 7f6e2fb3d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e28123670 0x7f6e28129680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.783+0000 7f6e2fb3d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2806ea80 con 0x7f6e28123670 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.783+0000 7f6e2d8d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e28123670 0x7f6e28129680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:16:08.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.783+0000 7f6e2d8d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e28123670 0x7f6e28129680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39484/0 (socket says 172.21.15.139:39484) 2024-09-10T05:16:08.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.783+0000 7f6e2d8d9640 1 -- 172.21.15.139:0/3446515165 learned_addr learned my addr 172.21.15.139:0/3446515165 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:16:08.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.783+0000 7f6e2d8d9640 1 -- 172.21.15.139:0/3446515165 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e28127830 con 0x7f6e28123670 2024-09-10T05:16:08.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.783+0000 7f6e2d8d9640 1 --2- 172.21.15.139:0/3446515165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e28123670 0x7f6e28129680 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400cbd0 tx=0x7f6e2400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:16:08.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.783+0000 7f6e1e7fc640 1 -- 172.21.15.139:0/3446515165 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e24017070 con 0x7f6e28123670 2024-09-10T05:16:08.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.783+0000 7f6e1e7fc640 1 -- 172.21.15.139:0/3446515165 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2400abc0 con 0x7f6e28123670 2024-09-10T05:16:08.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.783+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/3446515165 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e28128a00 con 0x7f6e28123670 2024-09-10T05:16:08.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.783+0000 7f6e1e7fc640 1 -- 172.21.15.139:0/3446515165 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e24012400 con 0x7f6e28123670 2024-09-10T05:16:08.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.783+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/3446515165 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e28129bc0 con 0x7f6e28123670 2024-09-10T05:16:08.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.784+0000 7f6e1e7fc640 1 -- 172.21.15.139:0/3446515165 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f6e2401a070 con 0x7f6e28123670 2024-09-10T05:16:08.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.784+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/3446515165 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e28123a50 con 0x7f6e28123670 2024-09-10T05:16:08.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.784+0000 7f6e1e7fc640 1 --2- 172.21.15.139:0/3446515165 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6e0c03de90 0x7f6e0c040350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:16:08.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.784+0000 7f6e1e7fc640 1 -- 172.21.15.139:0/3446515165 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6e24052a60 con 0x7f6e28123670 2024-09-10T05:16:08.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.785+0000 7f6e2d0d8640 1 --2- 172.21.15.139:0/3446515165 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6e0c03de90 0x7f6e0c040350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:16:08.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.785+0000 7f6e2d0d8640 1 --2- 172.21.15.139:0/3446515165 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6e0c03de90 0x7f6e0c040350 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6e18034000 tx=0x7f6e1802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:16:08.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.789+0000 7f6e1e7fc640 1 -- 172.21.15.139:0/3446515165 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f6e240078c0 con 0x7f6e28123670 2024-09-10T05:16:08.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.965+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/3446515165 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e28129400 con 0x7f6e0c03de90 2024-09-10T05:16:08.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.975+0000 7f6e1e7fc640 1 -- 172.21.15.139:0/3446515165 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666174 (secure 0 0 0) 0x7f6e28129400 con 0x7f6e0c03de90 2024-09-10T05:16:08.983 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:16:08.989 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-10T05:16:08.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.981+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/3446515165 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6e0c03de90 msgr2=0x7f6e0c040350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:16:08.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.981+0000 7f6e2fb3d640 1 --2- 172.21.15.139:0/3446515165 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6e0c03de90 0x7f6e0c040350 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6e18034000 tx=0x7f6e1802e000 comp rx=0 tx=0).stop 2024-09-10T05:16:08.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.981+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/3446515165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e28123670 msgr2=0x7f6e28129680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:16:08.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.981+0000 7f6e2fb3d640 1 --2- 172.21.15.139:0/3446515165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e28123670 0x7f6e28129680 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400cbd0 tx=0x7f6e2400a430 comp rx=0 tx=0).stop 2024-09-10T05:16:08.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.981+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/3446515165 shutdown_connections 2024-09-10T05:16:08.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.981+0000 7f6e2fb3d640 1 --2- 172.21.15.139:0/3446515165 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f6e0c03de90 0x7f6e0c040350 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:16:08.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.981+0000 7f6e2fb3d640 1 --2- 172.21.15.139:0/3446515165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e28123670 0x7f6e28129680 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:16:08.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.981+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/3446515165 >> 172.21.15.139:0/3446515165 conn(0x7f6e28071510 msgr2=0x7f6e280718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:16:08.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.981+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/3446515165 shutdown_connections 2024-09-10T05:16:08.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:08.981+0000 7f6e2fb3d640 1 -- 172.21.15.139:0/3446515165 wait complete. 2024-09-10T05:16:08.993 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-10T05:16:07.967597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5433,"num_read_kb":4987,"num_write":2313,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5013,"ondisk_log_size":5013,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165184,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322176,"statfs":{"total":386547056640,"available":386377908224,"internally_reserved":0,"allocated":3080192,"data_stored":1821028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004230"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.686266+0000","last_change":"2024-09-10T05:15:00.686212+0000","last_active":"2024-09-10T05:15:00.686266+0000","last_peered":"2024-09-10T05:15:00.686266+0000","last_clean":"2024-09-10T05:15:00.686266+0000","last_became_active":"2024-09-10T05:11:27.716775+0000","last_became_peered":"2024-09-10T05:11:27.716775+0000","last_unstale":"2024-09-10T05:15:00.686266+0000","last_undegraded":"2024-09-10T05:15:00.686266+0000","last_fullsized":"2024-09-10T05:15:00.686266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:00.686129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:00.686129+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.686129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.852215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.239534+0000","last_change":"2024-09-10T05:15:18.239534+0000","last_active":"2024-09-10T05:15:18.239534+0000","last_peered":"2024-09-10T05:15:18.239534+0000","last_clean":"2024-09-10T05:15:18.239534+0000","last_became_active":"2024-09-10T05:11:29.733565+0000","last_became_peered":"2024-09-10T05:11:29.733565+0000","last_unstale":"2024-09-10T05:15:18.239534+0000","last_undegraded":"2024-09-10T05:15:18.239534+0000","last_fullsized":"2024-09-10T05:15:18.239534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:18.239427+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:18.239427+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.239427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:47.176915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.473256+0000","last_change":"2024-09-10T05:15:00.473123+0000","last_active":"2024-09-10T05:15:00.473256+0000","last_peered":"2024-09-10T05:15:00.473256+0000","last_clean":"2024-09-10T05:15:00.473256+0000","last_became_active":"2024-09-10T05:11:27.713698+0000","last_became_peered":"2024-09-10T05:11:27.713698+0000","last_unstale":"2024-09-10T05:15:00.473256+0000","last_undegraded":"2024-09-10T05:15:00.473256+0000","last_fullsized":"2024-09-10T05:15:00.473256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:00.473021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:00.473021+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.473021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:20.018847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'10","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:31.924354+0000","last_change":"2024-09-10T05:15:31.924354+0000","last_active":"2024-09-10T05:15:31.924354+0000","last_peered":"2024-09-10T05:15:31.924354+0000","last_clean":"2024-09-10T05:15:31.924354+0000","last_became_active":"2024-09-10T05:11:29.728621+0000","last_became_peered":"2024-09-10T05:11:29.728621+0000","last_unstale":"2024-09-10T05:15:31.924354+0000","last_undegraded":"2024-09-10T05:15:31.924354+0000","last_fullsized":"2024-09-10T05:15:31.924354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:15:31.924269+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:15:31.924269+0000","last_clean_scrub_stamp":"2024-09-10T05:15:31.924269+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:41.446801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.073847+0000","last_change":"2024-09-10T05:15:15.073781+0000","last_active":"2024-09-10T05:15:15.073847+0000","last_peered":"2024-09-10T05:15:15.073847+0000","last_clean":"2024-09-10T05:15:15.073847+0000","last_became_active":"2024-09-10T05:11:27.733147+0000","last_became_peered":"2024-09-10T05:11:27.733147+0000","last_unstale":"2024-09-10T05:15:15.073847+0000","last_undegraded":"2024-09-10T05:15:15.073847+0000","last_fullsized":"2024-09-10T05:15:15.073847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:15.073683+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:15.073683+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.073683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:55.579728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:32.960484+0000","last_change":"2024-09-10T05:15:32.960484+0000","last_active":"2024-09-10T05:15:32.960484+0000","last_peered":"2024-09-10T05:15:32.960484+0000","last_clean":"2024-09-10T05:15:32.960484+0000","last_became_active":"2024-09-10T05:11:29.728696+0000","last_became_peered":"2024-09-10T05:11:29.728696+0000","last_unstale":"2024-09-10T05:15:32.960484+0000","last_undegraded":"2024-09-10T05:15:32.960484+0000","last_fullsized":"2024-09-10T05:15:32.960484+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:32.960388+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:32.960388+0000","last_clean_scrub_stamp":"2024-09-10T05:15:32.960388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:36.297564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.676875+0000","last_change":"2024-09-10T05:14:58.676818+0000","last_active":"2024-09-10T05:14:58.676875+0000","last_peered":"2024-09-10T05:14:58.676875+0000","last_clean":"2024-09-10T05:14:58.676875+0000","last_became_active":"2024-09-10T05:11:27.722701+0000","last_became_peered":"2024-09-10T05:11:27.722701+0000","last_unstale":"2024-09-10T05:14:58.676875+0000","last_undegraded":"2024-09-10T05:14:58.676875+0000","last_fullsized":"2024-09-10T05:14:58.676875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.676697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.676697+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.676697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:08.137298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'22","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.003330+0000","last_change":"2024-09-10T05:15:34.003330+0000","last_active":"2024-09-10T05:15:34.003330+0000","last_peered":"2024-09-10T05:15:34.003330+0000","last_clean":"2024-09-10T05:15:34.003330+0000","last_became_active":"2024-09-10T05:11:29.731850+0000","last_became_peered":"2024-09-10T05:11:29.731850+0000","last_unstale":"2024-09-10T05:15:34.003330+0000","last_undegraded":"2024-09-10T05:15:34.003330+0000","last_fullsized":"2024-09-10T05:15:34.003330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-10T05:15:34.003213+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-10T05:15:34.003213+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.003213+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:18.186667+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.056519+0000","last_change":"2024-09-10T05:15:14.056519+0000","last_active":"2024-09-10T05:15:14.056519+0000","last_peered":"2024-09-10T05:15:14.056519+0000","last_clean":"2024-09-10T05:15:14.056519+0000","last_became_active":"2024-09-10T05:11:27.732922+0000","last_became_peered":"2024-09-10T05:11:27.732922+0000","last_unstale":"2024-09-10T05:15:14.056519+0000","last_undegraded":"2024-09-10T05:15:14.056519+0000","last_fullsized":"2024-09-10T05:15:14.056519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:14.056436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:14.056436+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.056436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:49.245406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.288006+0000","last_change":"2024-09-10T05:15:16.287941+0000","last_active":"2024-09-10T05:15:16.288006+0000","last_peered":"2024-09-10T05:15:16.288006+0000","last_clean":"2024-09-10T05:15:16.288006+0000","last_became_active":"2024-09-10T05:11:29.722189+0000","last_became_peered":"2024-09-10T05:11:29.722189+0000","last_unstale":"2024-09-10T05:15:16.288006+0000","last_undegraded":"2024-09-10T05:15:16.288006+0000","last_fullsized":"2024-09-10T05:15:16.288006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:16.287854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:16.287854+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.287854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.329858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.707592+0000","last_change":"2024-09-10T05:14:57.707592+0000","last_active":"2024-09-10T05:14:57.707592+0000","last_peered":"2024-09-10T05:14:57.707592+0000","last_clean":"2024-09-10T05:14:57.707592+0000","last_became_active":"2024-09-10T05:11:27.706559+0000","last_became_peered":"2024-09-10T05:11:27.706559+0000","last_unstale":"2024-09-10T05:14:57.707592+0000","last_undegraded":"2024-09-10T05:14:57.707592+0000","last_fullsized":"2024-09-10T05:14:57.707592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:57.707507+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:57.707507+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.707507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:37.363037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:35.953580+0000","last_change":"2024-09-10T05:15:35.953519+0000","last_active":"2024-09-10T05:15:35.953580+0000","last_peered":"2024-09-10T05:15:35.953580+0000","last_clean":"2024-09-10T05:15:35.953580+0000","last_became_active":"2024-09-10T05:11:29.730492+0000","last_became_peered":"2024-09-10T05:11:29.730492+0000","last_unstale":"2024-09-10T05:15:35.953580+0000","last_undegraded":"2024-09-10T05:15:35.953580+0000","last_fullsized":"2024-09-10T05:15:35.953580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:35.953428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:35.953428+0000","last_clean_scrub_stamp":"2024-09-10T05:15:35.953428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:26.676535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.012797+0000","last_change":"2024-09-10T05:15:13.012797+0000","last_active":"2024-09-10T05:15:13.012797+0000","last_peered":"2024-09-10T05:15:13.012797+0000","last_clean":"2024-09-10T05:15:13.012797+0000","last_became_active":"2024-09-10T05:11:27.718363+0000","last_became_peered":"2024-09-10T05:11:27.718363+0000","last_unstale":"2024-09-10T05:15:13.012797+0000","last_undegraded":"2024-09-10T05:15:13.012797+0000","last_fullsized":"2024-09-10T05:15:13.012797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:13.012701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:13.012701+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.012701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:59.217408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.740078+0000","last_change":"2024-09-10T05:15:13.739994+0000","last_active":"2024-09-10T05:15:13.740078+0000","last_peered":"2024-09-10T05:15:13.740078+0000","last_clean":"2024-09-10T05:15:13.740078+0000","last_became_active":"2024-09-10T05:11:29.726884+0000","last_became_peered":"2024-09-10T05:11:29.726884+0000","last_unstale":"2024-09-10T05:15:13.740078+0000","last_undegraded":"2024-09-10T05:15:13.740078+0000","last_fullsized":"2024-09-10T05:15:13.740078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:13.739888+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:13.739888+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.739888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:29.267677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.496721+0000","last_change":"2024-09-10T05:14:59.496721+0000","last_active":"2024-09-10T05:14:59.496721+0000","last_peered":"2024-09-10T05:14:59.496721+0000","last_clean":"2024-09-10T05:14:59.496721+0000","last_became_active":"2024-09-10T05:11:27.718868+0000","last_became_peered":"2024-09-10T05:11:27.718868+0000","last_unstale":"2024-09-10T05:14:59.496721+0000","last_undegraded":"2024-09-10T05:14:59.496721+0000","last_fullsized":"2024-09-10T05:14:59.496721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:59.496621+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:59.496621+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.496621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:59.831011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.726027+0000","last_change":"2024-09-10T05:15:11.725923+0000","last_active":"2024-09-10T05:15:11.726027+0000","last_peered":"2024-09-10T05:15:11.726027+0000","last_clean":"2024-09-10T05:15:11.726027+0000","last_became_active":"2024-09-10T05:11:29.723497+0000","last_became_peered":"2024-09-10T05:11:29.723497+0000","last_unstale":"2024-09-10T05:15:11.726027+0000","last_undegraded":"2024-09-10T05:15:11.726027+0000","last_fullsized":"2024-09-10T05:15:11.726027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:11.725827+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:11.725827+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.725827+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:27.991023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:30.951922+0000","last_change":"2024-09-10T05:15:30.951922+0000","last_active":"2024-09-10T05:15:30.951922+0000","last_peered":"2024-09-10T05:15:30.951922+0000","last_clean":"2024-09-10T05:15:30.951922+0000","last_became_active":"2024-09-10T05:11:29.727536+0000","last_became_peered":"2024-09-10T05:11:29.727536+0000","last_unstale":"2024-09-10T05:15:30.951922+0000","last_undegraded":"2024-09-10T05:15:30.951922+0000","last_fullsized":"2024-09-10T05:15:30.951922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:30.951821+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:30.951821+0000","last_clean_scrub_stamp":"2024-09-10T05:15:30.951821+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:46.376233+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.476686+0000","last_change":"2024-09-10T05:14:59.476686+0000","last_active":"2024-09-10T05:14:59.476686+0000","last_peered":"2024-09-10T05:14:59.476686+0000","last_clean":"2024-09-10T05:14:59.476686+0000","last_became_active":"2024-09-10T05:11:27.728114+0000","last_became_peered":"2024-09-10T05:11:27.728114+0000","last_unstale":"2024-09-10T05:14:59.476686+0000","last_undegraded":"2024-09-10T05:14:59.476686+0000","last_fullsized":"2024-09-10T05:14:59.476686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:59.476601+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:59.476601+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.476601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:04.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.247977+0000","last_change":"2024-09-10T05:15:14.247977+0000","last_active":"2024-09-10T05:15:14.247977+0000","last_peered":"2024-09-10T05:15:14.247977+0000","last_clean":"2024-09-10T05:15:14.247977+0000","last_became_active":"2024-09-10T05:11:29.732864+0000","last_became_peered":"2024-09-10T05:11:29.732864+0000","last_unstale":"2024-09-10T05:15:14.247977+0000","last_undegraded":"2024-09-10T05:15:14.247977+0000","last_fullsized":"2024-09-10T05:15:14.247977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:14.247889+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:14.247889+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.247889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:06.302257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.645979+0000","last_change":"2024-09-10T05:15:02.645979+0000","last_active":"2024-09-10T05:15:02.645979+0000","last_peered":"2024-09-10T05:15:02.645979+0000","last_clean":"2024-09-10T05:15:02.645979+0000","last_became_active":"2024-09-10T05:11:27.706698+0000","last_became_peered":"2024-09-10T05:11:27.706698+0000","last_unstale":"2024-09-10T05:15:02.645979+0000","last_undegraded":"2024-09-10T05:15:02.645979+0000","last_fullsized":"2024-09-10T05:15:02.645979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:02.645892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:02.645892+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.645892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:35.605736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'10","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.286808+0000","last_change":"2024-09-10T05:15:17.286808+0000","last_active":"2024-09-10T05:15:17.286808+0000","last_peered":"2024-09-10T05:15:17.286808+0000","last_clean":"2024-09-10T05:15:17.286808+0000","last_became_active":"2024-09-10T05:11:29.731842+0000","last_became_peered":"2024-09-10T05:11:29.731842+0000","last_unstale":"2024-09-10T05:15:17.286808+0000","last_undegraded":"2024-09-10T05:15:17.286808+0000","last_fullsized":"2024-09-10T05:15:17.286808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:15:17.286726+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:15:17.286726+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.286726+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:48.199975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.476461+0000","last_change":"2024-09-10T05:14:58.476461+0000","last_active":"2024-09-10T05:14:58.476461+0000","last_peered":"2024-09-10T05:14:58.476461+0000","last_clean":"2024-09-10T05:14:58.476461+0000","last_became_active":"2024-09-10T05:11:27.719257+0000","last_became_peered":"2024-09-10T05:11:27.719257+0000","last_unstale":"2024-09-10T05:14:58.476461+0000","last_undegraded":"2024-09-10T05:14:58.476461+0000","last_fullsized":"2024-09-10T05:14:58.476461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.476369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.476369+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.476369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:03.036373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.654931+0000","last_change":"2024-09-10T05:15:10.654931+0000","last_active":"2024-09-10T05:15:10.654931+0000","last_peered":"2024-09-10T05:15:10.654931+0000","last_clean":"2024-09-10T05:15:10.654931+0000","last_became_active":"2024-09-10T05:12:04.967642+0000","last_became_peered":"2024-09-10T05:12:04.967642+0000","last_unstale":"2024-09-10T05:15:10.654931+0000","last_undegraded":"2024-09-10T05:15:10.654931+0000","last_fullsized":"2024-09-10T05:15:10.654931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:10.654800+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:10.654800+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.654800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:19.179150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"37'3","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.500764+0000","last_change":"2024-09-10T05:14:55.500764+0000","last_active":"2024-09-10T05:14:55.500764+0000","last_peered":"2024-09-10T05:14:55.500764+0000","last_clean":"2024-09-10T05:14:55.500764+0000","last_became_active":"2024-09-10T05:11:27.724439+0000","last_became_peered":"2024-09-10T05:11:27.724439+0000","last_unstale":"2024-09-10T05:14:55.500764+0000","last_undegraded":"2024-09-10T05:14:55.500764+0000","last_fullsized":"2024-09-10T05:14:55.500764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:14:55.500672+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:14:55.500672+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.500672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:26.970541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.746780+0000","last_change":"2024-09-10T05:15:09.746780+0000","last_active":"2024-09-10T05:15:09.746780+0000","last_peered":"2024-09-10T05:15:09.746780+0000","last_clean":"2024-09-10T05:15:09.746780+0000","last_became_active":"2024-09-10T05:11:29.722894+0000","last_became_peered":"2024-09-10T05:11:29.722894+0000","last_unstale":"2024-09-10T05:15:09.746780+0000","last_undegraded":"2024-09-10T05:15:09.746780+0000","last_fullsized":"2024-09-10T05:15:09.746780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:09.746683+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:09.746683+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.746683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:47.372939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.710949+0000","last_change":"2024-09-10T05:15:16.710949+0000","last_active":"2024-09-10T05:15:16.710949+0000","last_peered":"2024-09-10T05:15:16.710949+0000","last_clean":"2024-09-10T05:15:16.710949+0000","last_became_active":"2024-09-10T05:11:27.714926+0000","last_became_peered":"2024-09-10T05:11:27.714926+0000","last_unstale":"2024-09-10T05:15:16.710949+0000","last_undegraded":"2024-09-10T05:15:16.710949+0000","last_fullsized":"2024-09-10T05:15:16.710949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:16.710850+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:16.710850+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.710850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:15.748556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.253244+0000","last_change":"2024-09-10T05:15:15.253244+0000","last_active":"2024-09-10T05:15:15.253244+0000","last_peered":"2024-09-10T05:15:15.253244+0000","last_clean":"2024-09-10T05:15:15.253244+0000","last_became_active":"2024-09-10T05:11:29.721876+0000","last_became_peered":"2024-09-10T05:11:29.721876+0000","last_unstale":"2024-09-10T05:15:15.253244+0000","last_undegraded":"2024-09-10T05:15:15.253244+0000","last_fullsized":"2024-09-10T05:15:15.253244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:15.253159+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:15.253159+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.253159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:20.248120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.060849+0000","last_change":"2024-09-10T05:15:12.060849+0000","last_active":"2024-09-10T05:15:12.060849+0000","last_peered":"2024-09-10T05:15:12.060849+0000","last_clean":"2024-09-10T05:15:12.060849+0000","last_became_active":"2024-09-10T05:11:27.720197+0000","last_became_peered":"2024-09-10T05:11:27.720197+0000","last_unstale":"2024-09-10T05:15:12.060849+0000","last_undegraded":"2024-09-10T05:15:12.060849+0000","last_fullsized":"2024-09-10T05:15:12.060849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:12.060756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:12.060756+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.060756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:16.632715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'36","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:46.116302+0000","last_change":"2024-09-10T05:15:46.116302+0000","last_active":"2024-09-10T05:15:46.116302+0000","last_peered":"2024-09-10T05:15:46.116302+0000","last_clean":"2024-09-10T05:15:46.116302+0000","last_became_active":"2024-09-10T05:11:37.763019+0000","last_became_peered":"2024-09-10T05:11:37.763019+0000","last_unstale":"2024-09-10T05:15:46.116302+0000","last_undegraded":"2024-09-10T05:15:46.116302+0000","last_fullsized":"2024-09-10T05:15:46.116302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'36","last_scrub_stamp":"2024-09-10T05:15:46.116217+0000","last_deep_scrub":"37'36","last_deep_scrub_stamp":"2024-09-10T05:15:46.116217+0000","last_clean_scrub_stamp":"2024-09-10T05:15:46.116217+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:39.870987+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.009597+0000","last_change":"2024-09-10T05:15:22.009597+0000","last_active":"2024-09-10T05:15:22.009597+0000","last_peered":"2024-09-10T05:15:22.009597+0000","last_clean":"2024-09-10T05:15:22.009597+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:15:22.009597+0000","last_undegraded":"2024-09-10T05:15:22.009597+0000","last_fullsized":"2024-09-10T05:15:22.009597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:22.009499+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:22.009499+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.009499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:02.796822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.908025+0000","last_change":"2024-09-10T05:14:59.908025+0000","last_active":"2024-09-10T05:14:59.908025+0000","last_peered":"2024-09-10T05:14:59.908025+0000","last_clean":"2024-09-10T05:14:59.908025+0000","last_became_active":"2024-09-10T05:11:27.733612+0000","last_became_peered":"2024-09-10T05:11:27.733612+0000","last_unstale":"2024-09-10T05:14:59.908025+0000","last_undegraded":"2024-09-10T05:14:59.908025+0000","last_fullsized":"2024-09-10T05:14:59.908025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:59.907936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:59.907936+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.907936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:14.244325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:43.025760+0000","last_change":"2024-09-10T05:15:43.025760+0000","last_active":"2024-09-10T05:15:43.025760+0000","last_peered":"2024-09-10T05:15:43.025760+0000","last_clean":"2024-09-10T05:15:43.025760+0000","last_became_active":"2024-09-10T05:11:31.736788+0000","last_became_peered":"2024-09-10T05:11:31.736788+0000","last_unstale":"2024-09-10T05:15:43.025760+0000","last_undegraded":"2024-09-10T05:15:43.025760+0000","last_fullsized":"2024-09-10T05:15:43.025760+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:43.025669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:43.025669+0000","last_clean_scrub_stamp":"2024-09-10T05:15:43.025669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:43.646838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'53","reported_seq":120,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:52.012348+0000","last_change":"2024-09-10T05:15:52.012348+0000","last_active":"2024-09-10T05:15:52.012348+0000","last_peered":"2024-09-10T05:15:52.012348+0000","last_clean":"2024-09-10T05:15:52.012348+0000","last_became_active":"2024-09-10T05:11:33.746595+0000","last_became_peered":"2024-09-10T05:11:33.746595+0000","last_unstale":"2024-09-10T05:15:52.012348+0000","last_undegraded":"2024-09-10T05:15:52.012348+0000","last_fullsized":"2024-09-10T05:15:52.012348+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'53","last_scrub_stamp":"2024-09-10T05:15:52.012243+0000","last_deep_scrub":"37'53","last_deep_scrub_stamp":"2024-09-10T05:15:52.012243+0000","last_clean_scrub_stamp":"2024-09-10T05:15:52.012243+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:45.695633+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:38.127688+0000","last_change":"2024-09-10T05:15:38.127688+0000","last_active":"2024-09-10T05:15:38.127688+0000","last_peered":"2024-09-10T05:15:38.127688+0000","last_clean":"2024-09-10T05:15:38.127688+0000","last_became_active":"2024-09-10T05:11:35.746594+0000","last_became_peered":"2024-09-10T05:11:35.746594+0000","last_unstale":"2024-09-10T05:15:38.127688+0000","last_undegraded":"2024-09-10T05:15:38.127688+0000","last_fullsized":"2024-09-10T05:15:38.127688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:38.127605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:38.127605+0000","last_clean_scrub_stamp":"2024-09-10T05:15:38.127605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:08.742502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:47.099196+0000","last_change":"2024-09-10T05:15:47.099196+0000","last_active":"2024-09-10T05:15:47.099196+0000","last_peered":"2024-09-10T05:15:47.099196+0000","last_clean":"2024-09-10T05:15:47.099196+0000","last_became_active":"2024-09-10T05:11:37.756495+0000","last_became_peered":"2024-09-10T05:11:37.756495+0000","last_unstale":"2024-09-10T05:15:47.099196+0000","last_undegraded":"2024-09-10T05:15:47.099196+0000","last_fullsized":"2024-09-10T05:15:47.099196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-10T05:15:47.099110+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-10T05:15:47.099110+0000","last_clean_scrub_stamp":"2024-09-10T05:15:47.099110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:48.110236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.037012+0000","last_change":"2024-09-10T05:15:23.037012+0000","last_active":"2024-09-10T05:15:23.037012+0000","last_peered":"2024-09-10T05:15:23.037012+0000","last_clean":"2024-09-10T05:15:23.037012+0000","last_became_active":"2024-09-10T05:11:29.732267+0000","last_became_peered":"2024-09-10T05:11:29.732267+0000","last_unstale":"2024-09-10T05:15:23.037012+0000","last_undegraded":"2024-09-10T05:15:23.037012+0000","last_fullsized":"2024-09-10T05:15:23.037012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:23.036921+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:23.036921+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.036921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:21.103347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.746344+0000","last_change":"2024-09-10T05:14:52.746344+0000","last_active":"2024-09-10T05:14:52.746344+0000","last_peered":"2024-09-10T05:14:52.746344+0000","last_clean":"2024-09-10T05:14:52.746344+0000","last_became_active":"2024-09-10T05:11:27.726599+0000","last_became_peered":"2024-09-10T05:11:27.726599+0000","last_unstale":"2024-09-10T05:14:52.746344+0000","last_undegraded":"2024-09-10T05:14:52.746344+0000","last_fullsized":"2024-09-10T05:14:52.746344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.746259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.746259+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.746259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:50.519180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.670477+0000","last_change":"2024-09-10T05:15:20.670477+0000","last_active":"2024-09-10T05:15:20.670477+0000","last_peered":"2024-09-10T05:15:20.670477+0000","last_clean":"2024-09-10T05:15:20.670477+0000","last_became_active":"2024-09-10T05:11:31.731231+0000","last_became_peered":"2024-09-10T05:11:31.731231+0000","last_unstale":"2024-09-10T05:15:20.670477+0000","last_undegraded":"2024-09-10T05:15:20.670477+0000","last_fullsized":"2024-09-10T05:15:20.670477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:20.670391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:20.670391+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.670391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:50.967791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"37'17","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:31.220968+0000","last_change":"2024-09-10T05:15:31.220968+0000","last_active":"2024-09-10T05:15:31.220968+0000","last_peered":"2024-09-10T05:15:31.220968+0000","last_clean":"2024-09-10T05:15:31.220968+0000","last_became_active":"2024-09-10T05:11:33.743847+0000","last_became_peered":"2024-09-10T05:11:33.743847+0000","last_unstale":"2024-09-10T05:15:31.220968+0000","last_undegraded":"2024-09-10T05:15:31.220968+0000","last_fullsized":"2024-09-10T05:15:31.220968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'17","last_scrub_stamp":"2024-09-10T05:15:31.220881+0000","last_deep_scrub":"37'17","last_deep_scrub_stamp":"2024-09-10T05:15:31.220881+0000","last_clean_scrub_stamp":"2024-09-10T05:15:31.220881+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:23.297965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:37.129655+0000","last_change":"2024-09-10T05:15:37.129655+0000","last_active":"2024-09-10T05:15:37.129655+0000","last_peered":"2024-09-10T05:15:37.129655+0000","last_clean":"2024-09-10T05:15:37.129655+0000","last_became_active":"2024-09-10T05:11:35.749634+0000","last_became_peered":"2024-09-10T05:11:35.749634+0000","last_unstale":"2024-09-10T05:15:37.129655+0000","last_undegraded":"2024-09-10T05:15:37.129655+0000","last_fullsized":"2024-09-10T05:15:37.129655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:37.129560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:37.129560+0000","last_clean_scrub_stamp":"2024-09-10T05:15:37.129560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:58.199238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:44.633458+0000","last_change":"2024-09-10T05:15:44.633458+0000","last_active":"2024-09-10T05:15:44.633458+0000","last_peered":"2024-09-10T05:15:44.633458+0000","last_clean":"2024-09-10T05:15:44.633458+0000","last_became_active":"2024-09-10T05:11:37.755078+0000","last_became_peered":"2024-09-10T05:11:37.755078+0000","last_unstale":"2024-09-10T05:15:44.633458+0000","last_undegraded":"2024-09-10T05:15:44.633458+0000","last_fullsized":"2024-09-10T05:15:44.633458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:15:44.633361+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:15:44.633361+0000","last_clean_scrub_stamp":"2024-09-10T05:15:44.633361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:02.212177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.007105+0000","last_change":"2024-09-10T05:15:24.007105+0000","last_active":"2024-09-10T05:15:24.007105+0000","last_peered":"2024-09-10T05:15:24.007105+0000","last_clean":"2024-09-10T05:15:24.007105+0000","last_became_active":"2024-09-10T05:11:29.731780+0000","last_became_peered":"2024-09-10T05:11:29.731780+0000","last_unstale":"2024-09-10T05:15:24.007105+0000","last_undegraded":"2024-09-10T05:15:24.007105+0000","last_fullsized":"2024-09-10T05:15:24.007105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:24.007017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:24.007017+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.007017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:45.996847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.998628+0000","last_change":"2024-09-10T05:15:01.998628+0000","last_active":"2024-09-10T05:15:01.998628+0000","last_peered":"2024-09-10T05:15:01.998628+0000","last_clean":"2024-09-10T05:15:01.998628+0000","last_became_active":"2024-09-10T05:11:27.732573+0000","last_became_peered":"2024-09-10T05:11:27.732573+0000","last_unstale":"2024-09-10T05:15:01.998628+0000","last_undegraded":"2024-09-10T05:15:01.998628+0000","last_fullsized":"2024-09-10T05:15:01.998628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:01.998527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:01.998527+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.998527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:38.110563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.728959+0000","last_change":"2024-09-10T05:15:16.728959+0000","last_active":"2024-09-10T05:15:16.728959+0000","last_peered":"2024-09-10T05:15:16.728959+0000","last_clean":"2024-09-10T05:15:16.728959+0000","last_became_active":"2024-09-10T05:12:04.965494+0000","last_became_peered":"2024-09-10T05:12:04.965494+0000","last_unstale":"2024-09-10T05:15:16.728959+0000","last_undegraded":"2024-09-10T05:15:16.728959+0000","last_fullsized":"2024-09-10T05:15:16.728959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:16.728878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:16.728878+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.728878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.784781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"37'29","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:26.675464+0000","last_change":"2024-09-10T05:15:26.675464+0000","last_active":"2024-09-10T05:15:26.675464+0000","last_peered":"2024-09-10T05:15:26.675464+0000","last_clean":"2024-09-10T05:15:26.675464+0000","last_became_active":"2024-09-10T05:11:33.745336+0000","last_became_peered":"2024-09-10T05:11:33.745336+0000","last_unstale":"2024-09-10T05:15:26.675464+0000","last_undegraded":"2024-09-10T05:15:26.675464+0000","last_fullsized":"2024-09-10T05:15:26.675464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'29","last_scrub_stamp":"2024-09-10T05:15:26.675347+0000","last_deep_scrub":"37'29","last_deep_scrub_stamp":"2024-09-10T05:15:26.675347+0000","last_clean_scrub_stamp":"2024-09-10T05:15:26.675347+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:29.397202+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'286","reported_seq":427,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:00.066084+0000","last_change":"2024-09-10T05:16:00.066084+0000","last_active":"2024-09-10T05:16:00.066084+0000","last_peered":"2024-09-10T05:16:00.066084+0000","last_clean":"2024-09-10T05:16:00.066084+0000","last_became_active":"2024-09-10T05:11:35.752290+0000","last_became_peered":"2024-09-10T05:11:35.752290+0000","last_unstale":"2024-09-10T05:16:00.066084+0000","last_undegraded":"2024-09-10T05:16:00.066084+0000","last_fullsized":"2024-09-10T05:16:00.066084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:16:00.065967+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:16:00.065967+0000","last_clean_scrub_stamp":"2024-09-10T05:16:00.065967+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:41.284351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:39.761754+0000","last_change":"2024-09-10T05:15:39.761754+0000","last_active":"2024-09-10T05:15:39.761754+0000","last_peered":"2024-09-10T05:15:39.761754+0000","last_clean":"2024-09-10T05:15:39.761754+0000","last_became_active":"2024-09-10T05:11:37.759311+0000","last_became_peered":"2024-09-10T05:11:37.759311+0000","last_unstale":"2024-09-10T05:15:39.761754+0000","last_undegraded":"2024-09-10T05:15:39.761754+0000","last_fullsized":"2024-09-10T05:15:39.761754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:39.761663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:39.761663+0000","last_clean_scrub_stamp":"2024-09-10T05:15:39.761663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:30.436312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.495305+0000","last_change":"2024-09-10T05:15:05.495305+0000","last_active":"2024-09-10T05:15:05.495305+0000","last_peered":"2024-09-10T05:15:05.495305+0000","last_clean":"2024-09-10T05:15:05.495305+0000","last_became_active":"2024-09-10T05:11:29.723919+0000","last_became_peered":"2024-09-10T05:11:29.723919+0000","last_unstale":"2024-09-10T05:15:05.495305+0000","last_undegraded":"2024-09-10T05:15:05.495305+0000","last_fullsized":"2024-09-10T05:15:05.495305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:05.495212+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:05.495212+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.495212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:47.310404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.435128+0000","last_change":"2024-09-10T05:14:49.435128+0000","last_active":"2024-09-10T05:14:49.435128+0000","last_peered":"2024-09-10T05:14:49.435128+0000","last_clean":"2024-09-10T05:14:49.435128+0000","last_became_active":"2024-09-10T05:11:27.719835+0000","last_became_peered":"2024-09-10T05:11:27.719835+0000","last_unstale":"2024-09-10T05:14:49.435128+0000","last_undegraded":"2024-09-10T05:14:49.435128+0000","last_fullsized":"2024-09-10T05:14:49.435128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:49.435035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:49.435035+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.435035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:32.661631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:44.032974+0000","last_change":"2024-09-10T05:15:44.032974+0000","last_active":"2024-09-10T05:15:44.032974+0000","last_peered":"2024-09-10T05:15:44.032974+0000","last_clean":"2024-09-10T05:15:44.032974+0000","last_became_active":"2024-09-10T05:11:31.737411+0000","last_became_peered":"2024-09-10T05:11:31.737411+0000","last_unstale":"2024-09-10T05:15:44.032974+0000","last_undegraded":"2024-09-10T05:15:44.032974+0000","last_fullsized":"2024-09-10T05:15:44.032974+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:44.032888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:44.032888+0000","last_clean_scrub_stamp":"2024-09-10T05:15:44.032888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:02.424864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'44","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.681845+0000","last_change":"2024-09-10T05:15:27.681845+0000","last_active":"2024-09-10T05:15:27.681845+0000","last_peered":"2024-09-10T05:15:27.681845+0000","last_clean":"2024-09-10T05:15:27.681845+0000","last_became_active":"2024-09-10T05:11:33.744920+0000","last_became_peered":"2024-09-10T05:11:33.744920+0000","last_unstale":"2024-09-10T05:15:27.681845+0000","last_undegraded":"2024-09-10T05:15:27.681845+0000","last_fullsized":"2024-09-10T05:15:27.681845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'44","last_scrub_stamp":"2024-09-10T05:15:27.681741+0000","last_deep_scrub":"37'44","last_deep_scrub_stamp":"2024-09-10T05:15:27.681741+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.681741+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:58.009365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'286","reported_seq":436,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:36.610715+0000","last_change":"2024-09-10T05:15:36.610715+0000","last_active":"2024-09-10T05:15:36.610715+0000","last_peered":"2024-09-10T05:15:36.610715+0000","last_clean":"2024-09-10T05:15:36.610715+0000","last_became_active":"2024-09-10T05:11:35.748328+0000","last_became_peered":"2024-09-10T05:11:35.748328+0000","last_unstale":"2024-09-10T05:15:36.610715+0000","last_undegraded":"2024-09-10T05:15:36.610715+0000","last_fullsized":"2024-09-10T05:15:36.610715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:36.610628+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:36.610628+0000","last_clean_scrub_stamp":"2024-09-10T05:15:36.610628+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:59.554801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'8","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.072515+0000","last_change":"2024-09-10T05:15:19.072422+0000","last_active":"2024-09-10T05:15:19.072515+0000","last_peered":"2024-09-10T05:15:19.072515+0000","last_clean":"2024-09-10T05:15:19.072515+0000","last_became_active":"2024-09-10T05:11:29.735799+0000","last_became_peered":"2024-09-10T05:11:29.735799+0000","last_unstale":"2024-09-10T05:15:19.072515+0000","last_undegraded":"2024-09-10T05:15:19.072515+0000","last_fullsized":"2024-09-10T05:15:19.072515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:19.072304+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:19.072304+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.072304+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:47.414562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.750293+0000","last_change":"2024-09-10T05:14:53.750206+0000","last_active":"2024-09-10T05:14:53.750293+0000","last_peered":"2024-09-10T05:14:53.750293+0000","last_clean":"2024-09-10T05:14:53.750293+0000","last_became_active":"2024-09-10T05:11:27.716318+0000","last_became_peered":"2024-09-10T05:11:27.716318+0000","last_unstale":"2024-09-10T05:14:53.750293+0000","last_undegraded":"2024-09-10T05:14:53.750293+0000","last_fullsized":"2024-09-10T05:14:53.750293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.750095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.750095+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.750095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:30.144747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.283703+0000","last_change":"2024-09-10T05:15:21.283646+0000","last_active":"2024-09-10T05:15:21.283703+0000","last_peered":"2024-09-10T05:15:21.283703+0000","last_clean":"2024-09-10T05:15:21.283703+0000","last_became_active":"2024-09-10T05:11:31.734975+0000","last_became_peered":"2024-09-10T05:11:31.734975+0000","last_unstale":"2024-09-10T05:15:21.283703+0000","last_undegraded":"2024-09-10T05:15:21.283703+0000","last_fullsized":"2024-09-10T05:15:21.283703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:21.283528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:21.283528+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.283528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:26.933150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'60","reported_seq":127,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.726912+0000","last_change":"2024-09-10T05:15:22.726852+0000","last_active":"2024-09-10T05:15:22.726912+0000","last_peered":"2024-09-10T05:15:22.726912+0000","last_clean":"2024-09-10T05:15:22.726912+0000","last_became_active":"2024-09-10T05:11:33.746522+0000","last_became_peered":"2024-09-10T05:11:33.746522+0000","last_unstale":"2024-09-10T05:15:22.726912+0000","last_undegraded":"2024-09-10T05:15:22.726912+0000","last_fullsized":"2024-09-10T05:15:22.726912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'60","last_scrub_stamp":"2024-09-10T05:15:22.726746+0000","last_deep_scrub":"37'60","last_deep_scrub_stamp":"2024-09-10T05:15:22.726746+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.726746+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:43:04.485808+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:35.565302+0000","last_change":"2024-09-10T05:15:35.565302+0000","last_active":"2024-09-10T05:15:35.565302+0000","last_peered":"2024-09-10T05:15:35.565302+0000","last_clean":"2024-09-10T05:15:35.565302+0000","last_became_active":"2024-09-10T05:11:35.745840+0000","last_became_peered":"2024-09-10T05:11:35.745840+0000","last_unstale":"2024-09-10T05:15:35.565302+0000","last_undegraded":"2024-09-10T05:15:35.565302+0000","last_fullsized":"2024-09-10T05:15:35.565302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:35.565219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:35.565219+0000","last_clean_scrub_stamp":"2024-09-10T05:15:35.565219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:26:21.749001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:36.705160+0000","last_change":"2024-09-10T05:15:36.705072+0000","last_active":"2024-09-10T05:15:36.705160+0000","last_peered":"2024-09-10T05:15:36.705160+0000","last_clean":"2024-09-10T05:15:36.705160+0000","last_became_active":"2024-09-10T05:11:37.754562+0000","last_became_peered":"2024-09-10T05:11:37.754562+0000","last_unstale":"2024-09-10T05:15:36.705160+0000","last_undegraded":"2024-09-10T05:15:36.705160+0000","last_fullsized":"2024-09-10T05:15:36.705160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:15:36.704960+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:15:36.704960+0000","last_clean_scrub_stamp":"2024-09-10T05:15:36.704960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:30.793914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.352924+0000","last_change":"2024-09-10T05:15:03.352861+0000","last_active":"2024-09-10T05:15:03.352924+0000","last_peered":"2024-09-10T05:15:03.352924+0000","last_clean":"2024-09-10T05:15:03.352924+0000","last_became_active":"2024-09-10T05:11:29.721292+0000","last_became_peered":"2024-09-10T05:11:29.721292+0000","last_unstale":"2024-09-10T05:15:03.352924+0000","last_undegraded":"2024-09-10T05:15:03.352924+0000","last_fullsized":"2024-09-10T05:15:03.352924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.352761+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.352761+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.352761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:39.971897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.706267+0000","last_change":"2024-09-10T05:14:50.706205+0000","last_active":"2024-09-10T05:14:50.706267+0000","last_peered":"2024-09-10T05:14:50.706267+0000","last_clean":"2024-09-10T05:14:50.706267+0000","last_became_active":"2024-09-10T05:11:27.726419+0000","last_became_peered":"2024-09-10T05:11:27.726419+0000","last_unstale":"2024-09-10T05:14:50.706267+0000","last_undegraded":"2024-09-10T05:14:50.706267+0000","last_fullsized":"2024-09-10T05:14:50.706267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:14:50.706120+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:14:50.706120+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.706120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:55:39.305300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.699673+0000","last_change":"2024-09-10T05:15:14.699611+0000","last_active":"2024-09-10T05:15:14.699673+0000","last_peered":"2024-09-10T05:15:14.699673+0000","last_clean":"2024-09-10T05:15:14.699673+0000","last_became_active":"2024-09-10T05:11:31.732017+0000","last_became_peered":"2024-09-10T05:11:31.732017+0000","last_unstale":"2024-09-10T05:15:14.699673+0000","last_undegraded":"2024-09-10T05:15:14.699673+0000","last_fullsized":"2024-09-10T05:15:14.699673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:14.699495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:14.699495+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.699495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:03.772467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'45","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:50.005807+0000","last_change":"2024-09-10T05:15:50.005697+0000","last_active":"2024-09-10T05:15:50.005807+0000","last_peered":"2024-09-10T05:15:50.005807+0000","last_clean":"2024-09-10T05:15:50.005807+0000","last_became_active":"2024-09-10T05:11:33.747334+0000","last_became_peered":"2024-09-10T05:11:33.747334+0000","last_unstale":"2024-09-10T05:15:50.005807+0000","last_undegraded":"2024-09-10T05:15:50.005807+0000","last_fullsized":"2024-09-10T05:15:50.005807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'45","last_scrub_stamp":"2024-09-10T05:15:50.005589+0000","last_deep_scrub":"37'45","last_deep_scrub_stamp":"2024-09-10T05:15:50.005589+0000","last_clean_scrub_stamp":"2024-09-10T05:15:50.005589+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:18.741833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.594500+0000","last_change":"2024-09-10T05:15:34.594411+0000","last_active":"2024-09-10T05:15:34.594500+0000","last_peered":"2024-09-10T05:15:34.594500+0000","last_clean":"2024-09-10T05:15:34.594500+0000","last_became_active":"2024-09-10T05:11:35.753453+0000","last_became_peered":"2024-09-10T05:11:35.753453+0000","last_unstale":"2024-09-10T05:15:34.594500+0000","last_undegraded":"2024-09-10T05:15:34.594500+0000","last_fullsized":"2024-09-10T05:15:34.594500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:34.594319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:34.594319+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.594319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:42.002121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'4","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:40.141366+0000","last_change":"2024-09-10T05:15:40.141268+0000","last_active":"2024-09-10T05:15:40.141366+0000","last_peered":"2024-09-10T05:15:40.141366+0000","last_clean":"2024-09-10T05:15:40.141366+0000","last_became_active":"2024-09-10T05:11:37.757307+0000","last_became_peered":"2024-09-10T05:11:37.757307+0000","last_unstale":"2024-09-10T05:15:40.141366+0000","last_undegraded":"2024-09-10T05:15:40.141366+0000","last_fullsized":"2024-09-10T05:15:40.141366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:40.141152+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:40.141152+0000","last_clean_scrub_stamp":"2024-09-10T05:15:40.141152+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:54.477540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.667546+0000","last_change":"2024-09-10T05:15:01.667460+0000","last_active":"2024-09-10T05:15:01.667546+0000","last_peered":"2024-09-10T05:15:01.667546+0000","last_clean":"2024-09-10T05:15:01.667546+0000","last_became_active":"2024-09-10T05:11:29.722719+0000","last_became_peered":"2024-09-10T05:11:29.722719+0000","last_unstale":"2024-09-10T05:15:01.667546+0000","last_undegraded":"2024-09-10T05:15:01.667546+0000","last_fullsized":"2024-09-10T05:15:01.667546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:01.667364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:01.667364+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.667364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:59.866263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.927388+0000","last_change":"2024-09-10T05:14:58.927325+0000","last_active":"2024-09-10T05:14:58.927388+0000","last_peered":"2024-09-10T05:14:58.927388+0000","last_clean":"2024-09-10T05:14:58.927388+0000","last_became_active":"2024-09-10T05:11:27.722553+0000","last_became_peered":"2024-09-10T05:11:27.722553+0000","last_unstale":"2024-09-10T05:14:58.927388+0000","last_undegraded":"2024-09-10T05:14:58.927388+0000","last_fullsized":"2024-09-10T05:14:58.927388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:58.927238+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:58.927238+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.927238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:40.559986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'5","reported_seq":239,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.697265+0000","last_change":"2024-09-10T05:15:19.697159+0000","last_active":"2024-09-10T05:15:19.697265+0000","last_peered":"2024-09-10T05:15:19.697265+0000","last_clean":"2024-09-10T05:15:19.697265+0000","last_became_active":"2024-09-10T05:11:31.733822+0000","last_became_peered":"2024-09-10T05:11:31.733822+0000","last_unstale":"2024-09-10T05:15:19.697265+0000","last_undegraded":"2024-09-10T05:15:19.697265+0000","last_fullsized":"2024-09-10T05:15:19.697265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-10T05:15:19.697017+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-10T05:15:19.697017+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.697017+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:40.978284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'60","reported_seq":131,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:47.992137+0000","last_change":"2024-09-10T05:15:47.992078+0000","last_active":"2024-09-10T05:15:47.992137+0000","last_peered":"2024-09-10T05:15:47.992137+0000","last_clean":"2024-09-10T05:15:47.992137+0000","last_became_active":"2024-09-10T05:11:33.747938+0000","last_became_peered":"2024-09-10T05:11:33.747938+0000","last_unstale":"2024-09-10T05:15:47.992137+0000","last_undegraded":"2024-09-10T05:15:47.992137+0000","last_fullsized":"2024-09-10T05:15:47.992137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'60","last_scrub_stamp":"2024-09-10T05:15:47.991966+0000","last_deep_scrub":"37'60","last_deep_scrub_stamp":"2024-09-10T05:15:47.991966+0000","last_clean_scrub_stamp":"2024-09-10T05:15:47.991966+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:54.283493+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'286","reported_seq":361,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:33.562063+0000","last_change":"2024-09-10T05:15:33.561944+0000","last_active":"2024-09-10T05:15:33.562063+0000","last_peered":"2024-09-10T05:15:33.562063+0000","last_clean":"2024-09-10T05:15:33.562063+0000","last_became_active":"2024-09-10T05:11:35.753663+0000","last_became_peered":"2024-09-10T05:11:35.753663+0000","last_unstale":"2024-09-10T05:15:33.562063+0000","last_undegraded":"2024-09-10T05:15:33.562063+0000","last_fullsized":"2024-09-10T05:15:33.562063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:33.561838+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:33.561838+0000","last_clean_scrub_stamp":"2024-09-10T05:15:33.561838+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:25.576672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:41.642902+0000","last_change":"2024-09-10T05:15:41.642778+0000","last_active":"2024-09-10T05:15:41.642902+0000","last_peered":"2024-09-10T05:15:41.642902+0000","last_clean":"2024-09-10T05:15:41.642902+0000","last_became_active":"2024-09-10T05:11:37.754959+0000","last_became_peered":"2024-09-10T05:11:37.754959+0000","last_unstale":"2024-09-10T05:15:41.642902+0000","last_undegraded":"2024-09-10T05:15:41.642902+0000","last_fullsized":"2024-09-10T05:15:41.642902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:41.642679+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:41.642679+0000","last_clean_scrub_stamp":"2024-09-10T05:15:41.642679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:33:20.364799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'17","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.630502+0000","last_change":"2024-09-10T05:15:04.630437+0000","last_active":"2024-09-10T05:15:04.630502+0000","last_peered":"2024-09-10T05:15:04.630502+0000","last_clean":"2024-09-10T05:15:04.630502+0000","last_became_active":"2024-09-10T05:11:29.722267+0000","last_became_peered":"2024-09-10T05:11:29.722267+0000","last_unstale":"2024-09-10T05:15:04.630502+0000","last_undegraded":"2024-09-10T05:15:04.630502+0000","last_fullsized":"2024-09-10T05:15:04.630502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'17","last_scrub_stamp":"2024-09-10T05:15:04.630348+0000","last_deep_scrub":"37'17","last_deep_scrub_stamp":"2024-09-10T05:15:04.630348+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.630348+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:25.140187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.914476+0000","last_change":"2024-09-10T05:14:57.914417+0000","last_active":"2024-09-10T05:14:57.914476+0000","last_peered":"2024-09-10T05:14:57.914476+0000","last_clean":"2024-09-10T05:14:57.914476+0000","last_became_active":"2024-09-10T05:11:27.731909+0000","last_became_peered":"2024-09-10T05:11:27.731909+0000","last_unstale":"2024-09-10T05:14:57.914476+0000","last_undegraded":"2024-09-10T05:14:57.914476+0000","last_fullsized":"2024-09-10T05:14:57.914476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:14:57.914334+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:14:57.914334+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.914334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:28.529230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.678820+0000","last_change":"2024-09-10T05:15:15.678760+0000","last_active":"2024-09-10T05:15:15.678820+0000","last_peered":"2024-09-10T05:15:15.678820+0000","last_clean":"2024-09-10T05:15:15.678820+0000","last_became_active":"2024-09-10T05:11:31.732807+0000","last_became_peered":"2024-09-10T05:11:31.732807+0000","last_unstale":"2024-09-10T05:15:15.678820+0000","last_undegraded":"2024-09-10T05:15:15.678820+0000","last_fullsized":"2024-09-10T05:15:15.678820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:15.678675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:15.678675+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.678675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:44.860207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'79","reported_seq":165,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:49.035814+0000","last_change":"2024-09-10T05:15:49.035750+0000","last_active":"2024-09-10T05:15:49.035814+0000","last_peered":"2024-09-10T05:15:49.035814+0000","last_clean":"2024-09-10T05:15:49.035814+0000","last_became_active":"2024-09-10T05:11:33.745449+0000","last_became_peered":"2024-09-10T05:11:33.745449+0000","last_unstale":"2024-09-10T05:15:49.035814+0000","last_undegraded":"2024-09-10T05:15:49.035814+0000","last_fullsized":"2024-09-10T05:15:49.035814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'79","last_scrub_stamp":"2024-09-10T05:15:49.035608+0000","last_deep_scrub":"37'79","last_deep_scrub_stamp":"2024-09-10T05:15:49.035608+0000","last_clean_scrub_stamp":"2024-09-10T05:15:49.035608+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:55.683639+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:31.560915+0000","last_change":"2024-09-10T05:15:31.560828+0000","last_active":"2024-09-10T05:15:31.560915+0000","last_peered":"2024-09-10T05:15:31.560915+0000","last_clean":"2024-09-10T05:15:31.560915+0000","last_became_active":"2024-09-10T05:11:35.747913+0000","last_became_peered":"2024-09-10T05:11:35.747913+0000","last_unstale":"2024-09-10T05:15:31.560915+0000","last_undegraded":"2024-09-10T05:15:31.560915+0000","last_fullsized":"2024-09-10T05:15:31.560915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:31.560744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:31.560744+0000","last_clean_scrub_stamp":"2024-09-10T05:15:31.560744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:46.528586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'23","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:43.590380+0000","last_change":"2024-09-10T05:15:43.590312+0000","last_active":"2024-09-10T05:15:43.590380+0000","last_peered":"2024-09-10T05:15:43.590380+0000","last_clean":"2024-09-10T05:15:43.590380+0000","last_became_active":"2024-09-10T05:11:37.754915+0000","last_became_peered":"2024-09-10T05:11:37.754915+0000","last_unstale":"2024-09-10T05:15:43.590380+0000","last_undegraded":"2024-09-10T05:15:43.590380+0000","last_fullsized":"2024-09-10T05:15:43.590380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'23","last_scrub_stamp":"2024-09-10T05:15:43.590226+0000","last_deep_scrub":"37'23","last_deep_scrub_stamp":"2024-09-10T05:15:43.590226+0000","last_clean_scrub_stamp":"2024-09-10T05:15:43.590226+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:18.298302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'14","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.379388+0000","last_change":"2024-09-10T05:15:02.379312+0000","last_active":"2024-09-10T05:15:02.379388+0000","last_peered":"2024-09-10T05:15:02.379388+0000","last_clean":"2024-09-10T05:15:02.379388+0000","last_became_active":"2024-09-10T05:11:29.727349+0000","last_became_peered":"2024-09-10T05:11:29.727349+0000","last_unstale":"2024-09-10T05:15:02.379388+0000","last_undegraded":"2024-09-10T05:15:02.379388+0000","last_fullsized":"2024-09-10T05:15:02.379388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:02.379225+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:02.379225+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.379225+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:14.485317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.470614+0000","last_change":"2024-09-10T05:14:51.470556+0000","last_active":"2024-09-10T05:14:51.470614+0000","last_peered":"2024-09-10T05:14:51.470614+0000","last_clean":"2024-09-10T05:14:51.470614+0000","last_became_active":"2024-09-10T05:11:27.717887+0000","last_became_peered":"2024-09-10T05:11:27.717887+0000","last_unstale":"2024-09-10T05:14:51.470614+0000","last_undegraded":"2024-09-10T05:14:51.470614+0000","last_fullsized":"2024-09-10T05:14:51.470614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:51.470452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:51.470452+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.470452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:41.087698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.704188+0000","last_change":"2024-09-10T05:15:14.704114+0000","last_active":"2024-09-10T05:15:14.704188+0000","last_peered":"2024-09-10T05:15:14.704188+0000","last_clean":"2024-09-10T05:15:14.704188+0000","last_became_active":"2024-09-10T05:11:31.735386+0000","last_became_peered":"2024-09-10T05:11:31.735386+0000","last_unstale":"2024-09-10T05:15:14.704188+0000","last_undegraded":"2024-09-10T05:15:14.704188+0000","last_fullsized":"2024-09-10T05:15:14.704188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:14.704035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:14.704035+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.704035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:48.911727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'47","reported_seq":110,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:32.179120+0000","last_change":"2024-09-10T05:15:32.179060+0000","last_active":"2024-09-10T05:15:32.179120+0000","last_peered":"2024-09-10T05:15:32.179120+0000","last_clean":"2024-09-10T05:15:32.179120+0000","last_became_active":"2024-09-10T05:11:33.744026+0000","last_became_peered":"2024-09-10T05:11:33.744026+0000","last_unstale":"2024-09-10T05:15:32.179120+0000","last_undegraded":"2024-09-10T05:15:32.179120+0000","last_fullsized":"2024-09-10T05:15:32.179120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'47","last_scrub_stamp":"2024-09-10T05:15:32.178957+0000","last_deep_scrub":"37'47","last_deep_scrub_stamp":"2024-09-10T05:15:32.178957+0000","last_clean_scrub_stamp":"2024-09-10T05:15:32.178957+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:27:26.704119+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:02.134730+0000","last_change":"2024-09-10T05:16:02.134651+0000","last_active":"2024-09-10T05:16:02.134730+0000","last_peered":"2024-09-10T05:16:02.134730+0000","last_clean":"2024-09-10T05:16:02.134730+0000","last_became_active":"2024-09-10T05:11:35.748874+0000","last_became_peered":"2024-09-10T05:11:35.748874+0000","last_unstale":"2024-09-10T05:16:02.134730+0000","last_undegraded":"2024-09-10T05:16:02.134730+0000","last_fullsized":"2024-09-10T05:16:02.134730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:16:02.134561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:16:02.134561+0000","last_clean_scrub_stamp":"2024-09-10T05:16:02.134561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:40:20.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'10","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:05.081716+0000","last_change":"2024-09-10T05:16:05.081716+0000","last_active":"2024-09-10T05:16:05.081716+0000","last_peered":"2024-09-10T05:16:05.081716+0000","last_clean":"2024-09-10T05:16:05.081716+0000","last_became_active":"2024-09-10T05:11:37.767895+0000","last_became_peered":"2024-09-10T05:11:37.767895+0000","last_unstale":"2024-09-10T05:16:05.081716+0000","last_undegraded":"2024-09-10T05:16:05.081716+0000","last_fullsized":"2024-09-10T05:16:05.081716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:16:05.081606+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:16:05.081606+0000","last_clean_scrub_stamp":"2024-09-10T05:16:05.081606+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:54.382220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'16","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.041664+0000","last_change":"2024-09-10T05:15:20.041594+0000","last_active":"2024-09-10T05:15:20.041664+0000","last_peered":"2024-09-10T05:15:20.041664+0000","last_clean":"2024-09-10T05:15:20.041664+0000","last_became_active":"2024-09-10T05:11:29.733870+0000","last_became_peered":"2024-09-10T05:11:29.733870+0000","last_unstale":"2024-09-10T05:15:20.041664+0000","last_undegraded":"2024-09-10T05:15:20.041664+0000","last_fullsized":"2024-09-10T05:15:20.041664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:20.041507+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:20.041507+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.041507+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:39:13.856170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.937938+0000","last_change":"2024-09-10T05:14:56.937882+0000","last_active":"2024-09-10T05:14:56.937938+0000","last_peered":"2024-09-10T05:14:56.937938+0000","last_clean":"2024-09-10T05:14:56.937938+0000","last_became_active":"2024-09-10T05:11:27.725852+0000","last_became_peered":"2024-09-10T05:11:27.725852+0000","last_unstale":"2024-09-10T05:14:56.937938+0000","last_undegraded":"2024-09-10T05:14:56.937938+0000","last_fullsized":"2024-09-10T05:14:56.937938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:56.937795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:56.937795+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.937795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:18.007474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.665003+0000","last_change":"2024-09-10T05:15:18.664914+0000","last_active":"2024-09-10T05:15:18.665003+0000","last_peered":"2024-09-10T05:15:18.665003+0000","last_clean":"2024-09-10T05:15:18.665003+0000","last_became_active":"2024-09-10T05:11:31.733756+0000","last_became_peered":"2024-09-10T05:11:31.733756+0000","last_unstale":"2024-09-10T05:15:18.665003+0000","last_undegraded":"2024-09-10T05:15:18.665003+0000","last_fullsized":"2024-09-10T05:15:18.665003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:18.664801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:18.664801+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.664801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:56.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'48","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.724538+0000","last_change":"2024-09-10T05:15:24.724473+0000","last_active":"2024-09-10T05:15:24.724538+0000","last_peered":"2024-09-10T05:15:24.724538+0000","last_clean":"2024-09-10T05:15:24.724538+0000","last_became_active":"2024-09-10T05:11:33.741848+0000","last_became_peered":"2024-09-10T05:11:33.741848+0000","last_unstale":"2024-09-10T05:15:24.724538+0000","last_undegraded":"2024-09-10T05:15:24.724538+0000","last_fullsized":"2024-09-10T05:15:24.724538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'48","last_scrub_stamp":"2024-09-10T05:15:24.724365+0000","last_deep_scrub":"37'48","last_deep_scrub_stamp":"2024-09-10T05:15:24.724365+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.724365+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:38:55.362877+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'286","reported_seq":465,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:30.715721+0000","last_change":"2024-09-10T05:15:30.715629+0000","last_active":"2024-09-10T05:15:30.715721+0000","last_peered":"2024-09-10T05:15:30.715721+0000","last_clean":"2024-09-10T05:15:30.715721+0000","last_became_active":"2024-09-10T05:11:35.752511+0000","last_became_peered":"2024-09-10T05:11:35.752511+0000","last_unstale":"2024-09-10T05:15:30.715721+0000","last_undegraded":"2024-09-10T05:15:30.715721+0000","last_fullsized":"2024-09-10T05:15:30.715721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:30.715509+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:30.715509+0000","last_clean_scrub_stamp":"2024-09-10T05:15:30.715509+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:14.739369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'15","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:39.603245+0000","last_change":"2024-09-10T05:15:39.603185+0000","last_active":"2024-09-10T05:15:39.603245+0000","last_peered":"2024-09-10T05:15:39.603245+0000","last_clean":"2024-09-10T05:15:39.603245+0000","last_became_active":"2024-09-10T05:11:37.758381+0000","last_became_peered":"2024-09-10T05:11:37.758381+0000","last_unstale":"2024-09-10T05:15:39.603245+0000","last_undegraded":"2024-09-10T05:15:39.603245+0000","last_fullsized":"2024-09-10T05:15:39.603245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-10T05:15:39.603096+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-10T05:15:39.603096+0000","last_clean_scrub_stamp":"2024-09-10T05:15:39.603096+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:57.716844+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'14","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.632159+0000","last_change":"2024-09-10T05:15:05.632091+0000","last_active":"2024-09-10T05:15:05.632159+0000","last_peered":"2024-09-10T05:15:05.632159+0000","last_clean":"2024-09-10T05:15:05.632159+0000","last_became_active":"2024-09-10T05:11:29.722170+0000","last_became_peered":"2024-09-10T05:11:29.722170+0000","last_unstale":"2024-09-10T05:15:05.632159+0000","last_undegraded":"2024-09-10T05:15:05.632159+0000","last_fullsized":"2024-09-10T05:15:05.632159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:05.632009+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:05.632009+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.632009+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:23.914770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.932455+0000","last_change":"2024-09-10T05:14:55.932355+0000","last_active":"2024-09-10T05:14:55.932455+0000","last_peered":"2024-09-10T05:14:55.932455+0000","last_clean":"2024-09-10T05:14:55.932455+0000","last_became_active":"2024-09-10T05:11:27.732591+0000","last_became_peered":"2024-09-10T05:11:27.732591+0000","last_unstale":"2024-09-10T05:14:55.932455+0000","last_undegraded":"2024-09-10T05:14:55.932455+0000","last_fullsized":"2024-09-10T05:14:55.932455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:55.932231+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:55.932231+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.932231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:54.606915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'5","reported_seq":429,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.298671+0000","last_change":"2024-09-10T05:15:22.298554+0000","last_active":"2024-09-10T05:15:22.298671+0000","last_peered":"2024-09-10T05:15:22.298671+0000","last_clean":"2024-09-10T05:15:22.298671+0000","last_became_active":"2024-09-10T05:11:31.734714+0000","last_became_peered":"2024-09-10T05:11:31.734714+0000","last_unstale":"2024-09-10T05:15:22.298671+0000","last_undegraded":"2024-09-10T05:15:22.298671+0000","last_fullsized":"2024-09-10T05:15:22.298671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-10T05:15:22.298439+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-10T05:15:22.298439+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.298439+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:58.275665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:51.038253+0000","last_change":"2024-09-10T05:15:51.038191+0000","last_active":"2024-09-10T05:15:51.038253+0000","last_peered":"2024-09-10T05:15:51.038253+0000","last_clean":"2024-09-10T05:15:51.038253+0000","last_became_active":"2024-09-10T05:11:33.747376+0000","last_became_peered":"2024-09-10T05:11:33.747376+0000","last_unstale":"2024-09-10T05:15:51.038253+0000","last_undegraded":"2024-09-10T05:15:51.038253+0000","last_fullsized":"2024-09-10T05:15:51.038253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-10T05:15:51.038096+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-10T05:15:51.038096+0000","last_clean_scrub_stamp":"2024-09-10T05:15:51.038096+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:53.852770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'286","reported_seq":476,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:35.144668+0000","last_change":"2024-09-10T05:15:35.144600+0000","last_active":"2024-09-10T05:15:35.144668+0000","last_peered":"2024-09-10T05:15:35.144668+0000","last_clean":"2024-09-10T05:15:35.144668+0000","last_became_active":"2024-09-10T05:11:35.751352+0000","last_became_peered":"2024-09-10T05:11:35.751352+0000","last_unstale":"2024-09-10T05:15:35.144668+0000","last_undegraded":"2024-09-10T05:15:35.144668+0000","last_fullsized":"2024-09-10T05:15:35.144668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:35.144513+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:35.144513+0000","last_clean_scrub_stamp":"2024-09-10T05:15:35.144513+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:18.378095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'6","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:35.734339+0000","last_change":"2024-09-10T05:15:35.734274+0000","last_active":"2024-09-10T05:15:35.734339+0000","last_peered":"2024-09-10T05:15:35.734339+0000","last_clean":"2024-09-10T05:15:35.734339+0000","last_became_active":"2024-09-10T05:11:37.756734+0000","last_became_peered":"2024-09-10T05:11:37.756734+0000","last_unstale":"2024-09-10T05:15:35.734339+0000","last_undegraded":"2024-09-10T05:15:35.734339+0000","last_fullsized":"2024-09-10T05:15:35.734339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:35.734191+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:35.734191+0000","last_clean_scrub_stamp":"2024-09-10T05:15:35.734191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:58.776195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'24","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.367549+0000","last_change":"2024-09-10T05:15:04.367487+0000","last_active":"2024-09-10T05:15:04.367549+0000","last_peered":"2024-09-10T05:15:04.367549+0000","last_clean":"2024-09-10T05:15:04.367549+0000","last_became_active":"2024-09-10T05:11:29.735032+0000","last_became_peered":"2024-09-10T05:11:29.735032+0000","last_unstale":"2024-09-10T05:15:04.367549+0000","last_undegraded":"2024-09-10T05:15:04.367549+0000","last_fullsized":"2024-09-10T05:15:04.367549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24","last_scrub_stamp":"2024-09-10T05:15:04.367405+0000","last_deep_scrub":"37'24","last_deep_scrub_stamp":"2024-09-10T05:15:04.367405+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.367405+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:35.414356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.972875+0000","last_change":"2024-09-10T05:14:54.972818+0000","last_active":"2024-09-10T05:14:54.972875+0000","last_peered":"2024-09-10T05:14:54.972875+0000","last_clean":"2024-09-10T05:14:54.972875+0000","last_became_active":"2024-09-10T05:11:27.734204+0000","last_became_peered":"2024-09-10T05:11:27.734204+0000","last_unstale":"2024-09-10T05:14:54.972875+0000","last_undegraded":"2024-09-10T05:14:54.972875+0000","last_fullsized":"2024-09-10T05:14:54.972875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:54.972735+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:54.972735+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.972735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:47.793245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:41.049439+0000","last_change":"2024-09-10T05:15:41.049375+0000","last_active":"2024-09-10T05:15:41.049439+0000","last_peered":"2024-09-10T05:15:41.049439+0000","last_clean":"2024-09-10T05:15:41.049439+0000","last_became_active":"2024-09-10T05:11:31.736841+0000","last_became_peered":"2024-09-10T05:11:31.736841+0000","last_unstale":"2024-09-10T05:15:41.049439+0000","last_undegraded":"2024-09-10T05:15:41.049439+0000","last_fullsized":"2024-09-10T05:15:41.049439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:41.049287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:41.049287+0000","last_clean_scrub_stamp":"2024-09-10T05:15:41.049287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:48.427927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'50","reported_seq":110,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:30.217436+0000","last_change":"2024-09-10T05:15:30.217359+0000","last_active":"2024-09-10T05:15:30.217436+0000","last_peered":"2024-09-10T05:15:30.217436+0000","last_clean":"2024-09-10T05:15:30.217436+0000","last_became_active":"2024-09-10T05:11:33.744394+0000","last_became_peered":"2024-09-10T05:11:33.744394+0000","last_unstale":"2024-09-10T05:15:30.217436+0000","last_undegraded":"2024-09-10T05:15:30.217436+0000","last_fullsized":"2024-09-10T05:15:30.217436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'50","last_scrub_stamp":"2024-09-10T05:15:30.217260+0000","last_deep_scrub":"37'50","last_deep_scrub_stamp":"2024-09-10T05:15:30.217260+0000","last_clean_scrub_stamp":"2024-09-10T05:15:30.217260+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:35.417233+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:28.646049+0000","last_change":"2024-09-10T05:15:28.645981+0000","last_active":"2024-09-10T05:15:28.646049+0000","last_peered":"2024-09-10T05:15:28.646049+0000","last_clean":"2024-09-10T05:15:28.646049+0000","last_became_active":"2024-09-10T05:11:35.750450+0000","last_became_peered":"2024-09-10T05:11:35.750450+0000","last_unstale":"2024-09-10T05:15:28.646049+0000","last_undegraded":"2024-09-10T05:15:28.646049+0000","last_fullsized":"2024-09-10T05:15:28.646049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:28.645895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:28.645895+0000","last_clean_scrub_stamp":"2024-09-10T05:15:28.645895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:09.716244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'7","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:41.110038+0000","last_change":"2024-09-10T05:15:41.109973+0000","last_active":"2024-09-10T05:15:41.110038+0000","last_peered":"2024-09-10T05:15:41.110038+0000","last_clean":"2024-09-10T05:15:41.110038+0000","last_became_active":"2024-09-10T05:11:37.757289+0000","last_became_peered":"2024-09-10T05:11:37.757289+0000","last_unstale":"2024-09-10T05:15:41.110038+0000","last_undegraded":"2024-09-10T05:15:41.110038+0000","last_fullsized":"2024-09-10T05:15:41.110038+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-10T05:15:41.109884+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-10T05:15:41.109884+0000","last_clean_scrub_stamp":"2024-09-10T05:15:41.109884+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:06.110902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'8","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.043784+0000","last_change":"2024-09-10T05:15:16.043718+0000","last_active":"2024-09-10T05:15:16.043784+0000","last_peered":"2024-09-10T05:15:16.043784+0000","last_clean":"2024-09-10T05:15:16.043784+0000","last_became_active":"2024-09-10T05:11:29.734367+0000","last_became_peered":"2024-09-10T05:11:29.734367+0000","last_unstale":"2024-09-10T05:15:16.043784+0000","last_undegraded":"2024-09-10T05:15:16.043784+0000","last_fullsized":"2024-09-10T05:15:16.043784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:16.043611+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:16.043611+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.043611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:32.661692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":157,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:46.450464+0000","last_change":"2024-09-10T05:14:46.450393+0000","last_active":"2024-09-10T05:14:46.450464+0000","last_peered":"2024-09-10T05:14:46.450464+0000","last_clean":"2024-09-10T05:14:46.450464+0000","last_became_active":"2024-09-10T05:11:14.293121+0000","last_became_peered":"2024-09-10T05:11:14.293121+0000","last_unstale":"2024-09-10T05:14:46.450464+0000","last_undegraded":"2024-09-10T05:14:46.450464+0000","last_fullsized":"2024-09-10T05:14:46.450464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-10T05:14:46.450301+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-10T05:14:46.450301+0000","last_clean_scrub_stamp":"2024-09-10T05:14:46.450301+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:41.127694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.069728+0000","last_change":"2024-09-10T05:14:51.069657+0000","last_active":"2024-09-10T05:14:51.069728+0000","last_peered":"2024-09-10T05:14:51.069728+0000","last_clean":"2024-09-10T05:14:51.069728+0000","last_became_active":"2024-09-10T05:11:16.531926+0000","last_became_peered":"2024-09-10T05:11:16.531926+0000","last_unstale":"2024-09-10T05:14:51.069728+0000","last_undegraded":"2024-09-10T05:14:51.069728+0000","last_fullsized":"2024-09-10T05:14:51.069728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:51.069579+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:51.069579+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.069579+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:40.169755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001121101,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.034338+0000","last_change":"2024-09-10T05:14:52.034277+0000","last_active":"2024-09-10T05:14:52.034338+0000","last_peered":"2024-09-10T05:14:52.034338+0000","last_clean":"2024-09-10T05:14:52.034338+0000","last_became_active":"2024-09-10T05:11:27.735941+0000","last_became_peered":"2024-09-10T05:11:27.735941+0000","last_unstale":"2024-09-10T05:14:52.034338+0000","last_undegraded":"2024-09-10T05:14:52.034338+0000","last_fullsized":"2024-09-10T05:14:52.034338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.034181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.034181+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.034181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:53.640936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.297619+0000","last_change":"2024-09-10T05:15:20.297566+0000","last_active":"2024-09-10T05:15:20.297619+0000","last_peered":"2024-09-10T05:15:20.297619+0000","last_clean":"2024-09-10T05:15:20.297619+0000","last_became_active":"2024-09-10T05:11:31.736104+0000","last_became_peered":"2024-09-10T05:11:31.736104+0000","last_unstale":"2024-09-10T05:15:20.297619+0000","last_undegraded":"2024-09-10T05:15:20.297619+0000","last_fullsized":"2024-09-10T05:15:20.297619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:20.297474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:20.297474+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.297474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:10.972123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'100","reported_seq":197,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:47.032260+0000","last_change":"2024-09-10T05:15:47.032180+0000","last_active":"2024-09-10T05:15:47.032260+0000","last_peered":"2024-09-10T05:15:47.032260+0000","last_clean":"2024-09-10T05:15:47.032260+0000","last_became_active":"2024-09-10T05:11:33.743933+0000","last_became_peered":"2024-09-10T05:11:33.743933+0000","last_unstale":"2024-09-10T05:15:47.032260+0000","last_undegraded":"2024-09-10T05:15:47.032260+0000","last_fullsized":"2024-09-10T05:15:47.032260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'100","last_scrub_stamp":"2024-09-10T05:15:47.032063+0000","last_deep_scrub":"37'100","last_deep_scrub_stamp":"2024-09-10T05:15:47.032063+0000","last_clean_scrub_stamp":"2024-09-10T05:15:47.032063+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:09.140156+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:30.587681+0000","last_change":"2024-09-10T05:15:30.587614+0000","last_active":"2024-09-10T05:15:30.587681+0000","last_peered":"2024-09-10T05:15:30.587681+0000","last_clean":"2024-09-10T05:15:30.587681+0000","last_became_active":"2024-09-10T05:11:35.750248+0000","last_became_peered":"2024-09-10T05:11:35.750248+0000","last_unstale":"2024-09-10T05:15:30.587681+0000","last_undegraded":"2024-09-10T05:15:30.587681+0000","last_fullsized":"2024-09-10T05:15:30.587681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:30.587529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:30.587529+0000","last_clean_scrub_stamp":"2024-09-10T05:15:30.587529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:38.060858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'85","reported_seq":176,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:38.717811+0000","last_change":"2024-09-10T05:15:38.717751+0000","last_active":"2024-09-10T05:15:38.717811+0000","last_peered":"2024-09-10T05:15:38.717811+0000","last_clean":"2024-09-10T05:15:38.717811+0000","last_became_active":"2024-09-10T05:11:37.755239+0000","last_became_peered":"2024-09-10T05:11:37.755239+0000","last_unstale":"2024-09-10T05:15:38.717811+0000","last_undegraded":"2024-09-10T05:15:38.717811+0000","last_fullsized":"2024-09-10T05:15:38.717811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'85","last_scrub_stamp":"2024-09-10T05:15:38.717658+0000","last_deep_scrub":"37'85","last_deep_scrub_stamp":"2024-09-10T05:15:38.717658+0000","last_clean_scrub_stamp":"2024-09-10T05:15:38.717658+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:17.546697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.100559+0000","last_change":"2024-09-10T05:15:18.100459+0000","last_active":"2024-09-10T05:15:18.100559+0000","last_peered":"2024-09-10T05:15:18.100559+0000","last_clean":"2024-09-10T05:15:18.100559+0000","last_became_active":"2024-09-10T05:11:29.732560+0000","last_became_peered":"2024-09-10T05:11:29.732560+0000","last_unstale":"2024-09-10T05:15:18.100559+0000","last_undegraded":"2024-09-10T05:15:18.100559+0000","last_fullsized":"2024-09-10T05:15:18.100559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:18.100314+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:18.100314+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.100314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:05.619104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.116452+0000","last_change":"2024-09-10T05:14:48.116383+0000","last_active":"2024-09-10T05:14:48.116452+0000","last_peered":"2024-09-10T05:14:48.116452+0000","last_clean":"2024-09-10T05:14:48.116452+0000","last_became_active":"2024-09-10T05:11:16.531911+0000","last_became_peered":"2024-09-10T05:11:16.531911+0000","last_unstale":"2024-09-10T05:14:48.116452+0000","last_undegraded":"2024-09-10T05:14:48.116452+0000","last_fullsized":"2024-09-10T05:14:48.116452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.116290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.116290+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.116290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:40.342657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039105900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.545709+0000","last_change":"2024-09-10T05:14:48.545643+0000","last_active":"2024-09-10T05:14:48.545709+0000","last_peered":"2024-09-10T05:14:48.545709+0000","last_clean":"2024-09-10T05:14:48.545709+0000","last_became_active":"2024-09-10T05:11:27.713026+0000","last_became_peered":"2024-09-10T05:11:27.713026+0000","last_unstale":"2024-09-10T05:14:48.545709+0000","last_undegraded":"2024-09-10T05:14:48.545709+0000","last_fullsized":"2024-09-10T05:14:48.545709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:48.545569+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:48.545569+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.545569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:09.108323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:39.033457+0000","last_change":"2024-09-10T05:15:39.033339+0000","last_active":"2024-09-10T05:15:39.033457+0000","last_peered":"2024-09-10T05:15:39.033457+0000","last_clean":"2024-09-10T05:15:39.033457+0000","last_became_active":"2024-09-10T05:11:31.737199+0000","last_became_peered":"2024-09-10T05:11:31.737199+0000","last_unstale":"2024-09-10T05:15:39.033457+0000","last_undegraded":"2024-09-10T05:15:39.033457+0000","last_fullsized":"2024-09-10T05:15:39.033457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:39.033234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:39.033234+0000","last_clean_scrub_stamp":"2024-09-10T05:15:39.033234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:00.913610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'303","reported_seq":534,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:29.204862+0000","last_change":"2024-09-10T05:15:29.204803+0000","last_active":"2024-09-10T05:15:29.204862+0000","last_peered":"2024-09-10T05:15:29.204862+0000","last_clean":"2024-09-10T05:15:29.204862+0000","last_became_active":"2024-09-10T05:11:33.744103+0000","last_became_peered":"2024-09-10T05:11:33.744103+0000","last_unstale":"2024-09-10T05:15:29.204862+0000","last_undegraded":"2024-09-10T05:15:29.204862+0000","last_fullsized":"2024-09-10T05:15:29.204862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'303","last_scrub_stamp":"2024-09-10T05:15:29.204689+0000","last_deep_scrub":"37'303","last_deep_scrub_stamp":"2024-09-10T05:15:29.204689+0000","last_clean_scrub_stamp":"2024-09-10T05:15:29.204689+0000","objects_scrubbed":11,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:40.315728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":393,"num_read_kb":395,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:59.028079+0000","last_change":"2024-09-10T05:15:59.028079+0000","last_active":"2024-09-10T05:15:59.028079+0000","last_peered":"2024-09-10T05:15:59.028079+0000","last_clean":"2024-09-10T05:15:59.028079+0000","last_became_active":"2024-09-10T05:11:35.748767+0000","last_became_peered":"2024-09-10T05:11:35.748767+0000","last_unstale":"2024-09-10T05:15:59.028079+0000","last_undegraded":"2024-09-10T05:15:59.028079+0000","last_fullsized":"2024-09-10T05:15:59.028079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:59.027964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:59.027964+0000","last_clean_scrub_stamp":"2024-09-10T05:15:59.027964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:48.516154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:43.139099+0000","last_change":"2024-09-10T05:15:43.139042+0000","last_active":"2024-09-10T05:15:43.139099+0000","last_peered":"2024-09-10T05:15:43.139099+0000","last_clean":"2024-09-10T05:15:43.139099+0000","last_became_active":"2024-09-10T05:11:37.758114+0000","last_became_peered":"2024-09-10T05:11:37.758114+0000","last_unstale":"2024-09-10T05:15:43.139099+0000","last_undegraded":"2024-09-10T05:15:43.139099+0000","last_fullsized":"2024-09-10T05:15:43.139099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:15:43.138964+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:15:43.138964+0000","last_clean_scrub_stamp":"2024-09-10T05:15:43.138964+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:43.209895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'14","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.455557+0000","last_change":"2024-09-10T05:15:02.455496+0000","last_active":"2024-09-10T05:15:02.455557+0000","last_peered":"2024-09-10T05:15:02.455557+0000","last_clean":"2024-09-10T05:15:02.455557+0000","last_became_active":"2024-09-10T05:11:29.723609+0000","last_became_peered":"2024-09-10T05:11:29.723609+0000","last_unstale":"2024-09-10T05:15:02.455557+0000","last_undegraded":"2024-09-10T05:15:02.455557+0000","last_fullsized":"2024-09-10T05:15:02.455557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:02.455410+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:02.455410+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.455410+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:08.842470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.698496+0000","last_change":"2024-09-10T05:14:48.698433+0000","last_active":"2024-09-10T05:14:48.698496+0000","last_peered":"2024-09-10T05:14:48.698496+0000","last_clean":"2024-09-10T05:14:48.698496+0000","last_became_active":"2024-09-10T05:11:16.530448+0000","last_became_peered":"2024-09-10T05:11:16.530448+0000","last_unstale":"2024-09-10T05:14:48.698496+0000","last_undegraded":"2024-09-10T05:14:48.698496+0000","last_fullsized":"2024-09-10T05:14:48.698496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.698352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.698352+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.698352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:12.098710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036982300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.508575+0000","last_change":"2024-09-10T05:14:47.508513+0000","last_active":"2024-09-10T05:14:47.508575+0000","last_peered":"2024-09-10T05:14:47.508575+0000","last_clean":"2024-09-10T05:14:47.508575+0000","last_became_active":"2024-09-10T05:11:27.714299+0000","last_became_peered":"2024-09-10T05:11:27.714299+0000","last_unstale":"2024-09-10T05:14:47.508575+0000","last_undegraded":"2024-09-10T05:14:47.508575+0000","last_fullsized":"2024-09-10T05:14:47.508575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:14:47.508436+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:14:47.508436+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.508436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:06.719872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.694025+0000","last_change":"2024-09-10T05:15:15.693954+0000","last_active":"2024-09-10T05:15:15.694025+0000","last_peered":"2024-09-10T05:15:15.694025+0000","last_clean":"2024-09-10T05:15:15.694025+0000","last_became_active":"2024-09-10T05:11:31.730978+0000","last_became_peered":"2024-09-10T05:11:31.730978+0000","last_unstale":"2024-09-10T05:15:15.694025+0000","last_undegraded":"2024-09-10T05:15:15.694025+0000","last_fullsized":"2024-09-10T05:15:15.694025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:15.693862+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:15.693862+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.693862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:07.673571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'25","reported_seq":102,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.710113+0000","last_change":"2024-09-10T05:15:23.710054+0000","last_active":"2024-09-10T05:15:23.710113+0000","last_peered":"2024-09-10T05:15:23.710113+0000","last_clean":"2024-09-10T05:15:23.710113+0000","last_became_active":"2024-09-10T05:11:33.746102+0000","last_became_peered":"2024-09-10T05:11:33.746102+0000","last_unstale":"2024-09-10T05:15:23.710113+0000","last_undegraded":"2024-09-10T05:15:23.710113+0000","last_fullsized":"2024-09-10T05:15:23.710113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'25","last_scrub_stamp":"2024-09-10T05:15:23.709956+0000","last_deep_scrub":"37'25","last_deep_scrub_stamp":"2024-09-10T05:15:23.709956+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.709956+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:03.932613+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:29.636148+0000","last_change":"2024-09-10T05:15:29.636086+0000","last_active":"2024-09-10T05:15:29.636148+0000","last_peered":"2024-09-10T05:15:29.636148+0000","last_clean":"2024-09-10T05:15:29.636148+0000","last_became_active":"2024-09-10T05:11:35.753342+0000","last_became_peered":"2024-09-10T05:11:35.753342+0000","last_unstale":"2024-09-10T05:15:29.636148+0000","last_undegraded":"2024-09-10T05:15:29.636148+0000","last_fullsized":"2024-09-10T05:15:29.636148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:29.635990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:29.635990+0000","last_clean_scrub_stamp":"2024-09-10T05:15:29.635990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:08.235675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.955113+0000","last_change":"2024-09-10T05:11:37.769011+0000","last_active":"2024-09-10T05:12:04.955113+0000","last_peered":"2024-09-10T05:12:04.955113+0000","last_clean":"2024-09-10T05:12:04.955113+0000","last_became_active":"2024-09-10T05:11:37.767788+0000","last_became_peered":"2024-09-10T05:11:37.767788+0000","last_unstale":"2024-09-10T05:12:04.955113+0000","last_undegraded":"2024-09-10T05:12:04.955113+0000","last_fullsized":"2024-09-10T05:12:04.955113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:55.792983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.435961+0000","last_change":"2024-09-10T05:15:01.435853+0000","last_active":"2024-09-10T05:15:01.435961+0000","last_peered":"2024-09-10T05:15:01.435961+0000","last_clean":"2024-09-10T05:15:01.435961+0000","last_became_active":"2024-09-10T05:11:29.727022+0000","last_became_peered":"2024-09-10T05:11:29.727022+0000","last_unstale":"2024-09-10T05:15:01.435961+0000","last_undegraded":"2024-09-10T05:15:01.435961+0000","last_fullsized":"2024-09-10T05:15:01.435961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:01.435758+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:01.435758+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.435758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:15.080229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.096802+0000","last_change":"2024-09-10T05:14:49.096748+0000","last_active":"2024-09-10T05:14:49.096802+0000","last_peered":"2024-09-10T05:14:49.096802+0000","last_clean":"2024-09-10T05:14:49.096802+0000","last_became_active":"2024-09-10T05:11:16.530756+0000","last_became_peered":"2024-09-10T05:11:16.530756+0000","last_unstale":"2024-09-10T05:14:49.096802+0000","last_undegraded":"2024-09-10T05:14:49.096802+0000","last_fullsized":"2024-09-10T05:14:49.096802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:14:49.096654+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:14:49.096654+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.096654+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:56.602270+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001047784,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.744820+0000","last_change":"2024-09-10T05:14:47.744764+0000","last_active":"2024-09-10T05:14:47.744820+0000","last_peered":"2024-09-10T05:14:47.744820+0000","last_clean":"2024-09-10T05:14:47.744820+0000","last_became_active":"2024-09-10T05:11:27.718333+0000","last_became_peered":"2024-09-10T05:11:27.718333+0000","last_unstale":"2024-09-10T05:14:47.744820+0000","last_undegraded":"2024-09-10T05:14:47.744820+0000","last_fullsized":"2024-09-10T05:14:47.744820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:47.744665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:47.744665+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.744665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:14.527839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.760190+0000","last_change":"2024-09-10T05:15:12.760190+0000","last_active":"2024-09-10T05:15:12.760190+0000","last_peered":"2024-09-10T05:15:12.760190+0000","last_clean":"2024-09-10T05:15:12.760190+0000","last_became_active":"2024-09-10T05:12:04.964996+0000","last_became_peered":"2024-09-10T05:12:04.964996+0000","last_unstale":"2024-09-10T05:15:12.760190+0000","last_undegraded":"2024-09-10T05:15:12.760190+0000","last_fullsized":"2024-09-10T05:15:12.760190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:12.760098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:12.760098+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.760098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:29.723294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"37'20","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:46.020779+0000","last_change":"2024-09-10T05:15:46.020657+0000","last_active":"2024-09-10T05:15:46.020779+0000","last_peered":"2024-09-10T05:15:46.020779+0000","last_clean":"2024-09-10T05:15:46.020779+0000","last_became_active":"2024-09-10T05:11:33.743292+0000","last_became_peered":"2024-09-10T05:11:33.743292+0000","last_unstale":"2024-09-10T05:15:46.020779+0000","last_undegraded":"2024-09-10T05:15:46.020779+0000","last_fullsized":"2024-09-10T05:15:46.020779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20","last_scrub_stamp":"2024-09-10T05:15:46.020536+0000","last_deep_scrub":"37'20","last_deep_scrub_stamp":"2024-09-10T05:15:46.020536+0000","last_clean_scrub_stamp":"2024-09-10T05:15:46.020536+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:09.384528+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:57.105430+0000","last_change":"2024-09-10T05:15:57.105430+0000","last_active":"2024-09-10T05:15:57.105430+0000","last_peered":"2024-09-10T05:15:57.105430+0000","last_clean":"2024-09-10T05:15:57.105430+0000","last_became_active":"2024-09-10T05:11:35.751982+0000","last_became_peered":"2024-09-10T05:11:35.751982+0000","last_unstale":"2024-09-10T05:15:57.105430+0000","last_undegraded":"2024-09-10T05:15:57.105430+0000","last_fullsized":"2024-09-10T05:15:57.105430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:57.105306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:57.105306+0000","last_clean_scrub_stamp":"2024-09-10T05:15:57.105306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:42.117238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:42.135922+0000","last_change":"2024-09-10T05:15:42.135829+0000","last_active":"2024-09-10T05:15:42.135922+0000","last_peered":"2024-09-10T05:15:42.135922+0000","last_clean":"2024-09-10T05:15:42.135922+0000","last_became_active":"2024-09-10T05:11:37.762327+0000","last_became_peered":"2024-09-10T05:11:37.762327+0000","last_unstale":"2024-09-10T05:15:42.135922+0000","last_undegraded":"2024-09-10T05:15:42.135922+0000","last_fullsized":"2024-09-10T05:15:42.135922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:42.135733+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:42.135733+0000","last_clean_scrub_stamp":"2024-09-10T05:15:42.135733+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:18.247769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'16","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.437539+0000","last_change":"2024-09-10T05:15:00.437426+0000","last_active":"2024-09-10T05:15:00.437539+0000","last_peered":"2024-09-10T05:15:00.437539+0000","last_clean":"2024-09-10T05:15:00.437539+0000","last_became_active":"2024-09-10T05:11:29.730589+0000","last_became_peered":"2024-09-10T05:11:29.730589+0000","last_unstale":"2024-09-10T05:15:00.437539+0000","last_undegraded":"2024-09-10T05:15:00.437539+0000","last_fullsized":"2024-09-10T05:15:00.437539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:00.437305+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:00.437305+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.437305+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:23:10.739442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.660396+0000","last_change":"2024-09-10T05:14:49.660336+0000","last_active":"2024-09-10T05:14:49.660396+0000","last_peered":"2024-09-10T05:14:49.660396+0000","last_clean":"2024-09-10T05:14:49.660396+0000","last_became_active":"2024-09-10T05:11:27.716023+0000","last_became_peered":"2024-09-10T05:11:27.716023+0000","last_unstale":"2024-09-10T05:14:49.660396+0000","last_undegraded":"2024-09-10T05:14:49.660396+0000","last_fullsized":"2024-09-10T05:14:49.660396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:49.660254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:49.660254+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.660254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:37.581398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:46.486507+0000","last_change":"2024-09-10T05:14:46.486459+0000","last_active":"2024-09-10T05:14:46.486507+0000","last_peered":"2024-09-10T05:14:46.486507+0000","last_clean":"2024-09-10T05:14:46.486507+0000","last_became_active":"2024-09-10T05:11:16.532795+0000","last_became_peered":"2024-09-10T05:11:16.532795+0000","last_unstale":"2024-09-10T05:14:46.486507+0000","last_undegraded":"2024-09-10T05:14:46.486507+0000","last_fullsized":"2024-09-10T05:14:46.486507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:46.486390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:46.486390+0000","last_clean_scrub_stamp":"2024-09-10T05:14:46.486390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:24.690009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060128199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.692331+0000","last_change":"2024-09-10T05:15:17.692271+0000","last_active":"2024-09-10T05:15:17.692331+0000","last_peered":"2024-09-10T05:15:17.692331+0000","last_clean":"2024-09-10T05:15:17.692331+0000","last_became_active":"2024-09-10T05:11:31.734707+0000","last_became_peered":"2024-09-10T05:11:31.734707+0000","last_unstale":"2024-09-10T05:15:17.692331+0000","last_undegraded":"2024-09-10T05:15:17.692331+0000","last_fullsized":"2024-09-10T05:15:17.692331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:17.692187+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:17.692187+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.692187+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:34:44.621445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'90","reported_seq":179,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.758226+0000","last_change":"2024-09-10T05:15:22.758130+0000","last_active":"2024-09-10T05:15:22.758226+0000","last_peered":"2024-09-10T05:15:22.758226+0000","last_clean":"2024-09-10T05:15:22.758226+0000","last_became_active":"2024-09-10T05:11:33.743238+0000","last_became_peered":"2024-09-10T05:11:33.743238+0000","last_unstale":"2024-09-10T05:15:22.758226+0000","last_undegraded":"2024-09-10T05:15:22.758226+0000","last_fullsized":"2024-09-10T05:15:22.758226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'90","last_scrub_stamp":"2024-09-10T05:15:22.758015+0000","last_deep_scrub":"37'90","last_deep_scrub_stamp":"2024-09-10T05:15:22.758015+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.758015+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:54:47.346297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:29.688075+0000","last_change":"2024-09-10T05:15:29.688020+0000","last_active":"2024-09-10T05:15:29.688075+0000","last_peered":"2024-09-10T05:15:29.688075+0000","last_clean":"2024-09-10T05:15:29.688075+0000","last_became_active":"2024-09-10T05:11:35.750830+0000","last_became_peered":"2024-09-10T05:11:35.750830+0000","last_unstale":"2024-09-10T05:15:29.688075+0000","last_undegraded":"2024-09-10T05:15:29.688075+0000","last_fullsized":"2024-09-10T05:15:29.688075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:29.687940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:29.687940+0000","last_clean_scrub_stamp":"2024-09-10T05:15:29.687940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:14.996480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:42.597661+0000","last_change":"2024-09-10T05:15:42.597661+0000","last_active":"2024-09-10T05:15:42.597661+0000","last_peered":"2024-09-10T05:15:42.597661+0000","last_clean":"2024-09-10T05:15:42.597661+0000","last_became_active":"2024-09-10T05:11:37.758971+0000","last_became_peered":"2024-09-10T05:11:37.758971+0000","last_unstale":"2024-09-10T05:15:42.597661+0000","last_undegraded":"2024-09-10T05:15:42.597661+0000","last_fullsized":"2024-09-10T05:15:42.597661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-10T05:15:42.597524+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-10T05:15:42.597524+0000","last_clean_scrub_stamp":"2024-09-10T05:15:42.597524+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:11.776658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'14","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.389673+0000","last_change":"2024-09-10T05:15:01.389613+0000","last_active":"2024-09-10T05:15:01.389673+0000","last_peered":"2024-09-10T05:15:01.389673+0000","last_clean":"2024-09-10T05:15:01.389673+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:15:01.389673+0000","last_undegraded":"2024-09-10T05:15:01.389673+0000","last_fullsized":"2024-09-10T05:15:01.389673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:01.389524+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:01.389524+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.389524+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:15.262748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.500548+0000","last_change":"2024-09-10T05:14:50.500467+0000","last_active":"2024-09-10T05:14:50.500548+0000","last_peered":"2024-09-10T05:14:50.500548+0000","last_clean":"2024-09-10T05:14:50.500548+0000","last_became_active":"2024-09-10T05:11:27.718756+0000","last_became_peered":"2024-09-10T05:11:27.718756+0000","last_unstale":"2024-09-10T05:14:50.500548+0000","last_undegraded":"2024-09-10T05:14:50.500548+0000","last_fullsized":"2024-09-10T05:14:50.500548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.500341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.500341+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.500341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:21.655128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.083367+0000","last_change":"2024-09-10T05:14:50.083297+0000","last_active":"2024-09-10T05:14:50.083367+0000","last_peered":"2024-09-10T05:14:50.083367+0000","last_clean":"2024-09-10T05:14:50.083367+0000","last_became_active":"2024-09-10T05:11:16.530746+0000","last_became_peered":"2024-09-10T05:11:16.530746+0000","last_unstale":"2024-09-10T05:14:50.083367+0000","last_undegraded":"2024-09-10T05:14:50.083367+0000","last_fullsized":"2024-09-10T05:14:50.083367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.083200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.083200+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.083200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:05.779343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048256999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:38.012117+0000","last_change":"2024-09-10T05:15:38.012028+0000","last_active":"2024-09-10T05:15:38.012117+0000","last_peered":"2024-09-10T05:15:38.012117+0000","last_clean":"2024-09-10T05:15:38.012117+0000","last_became_active":"2024-09-10T05:11:31.734333+0000","last_became_peered":"2024-09-10T05:11:31.734333+0000","last_unstale":"2024-09-10T05:15:38.012117+0000","last_undegraded":"2024-09-10T05:15:38.012117+0000","last_fullsized":"2024-09-10T05:15:38.012117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:38.011934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:38.011934+0000","last_clean_scrub_stamp":"2024-09-10T05:15:38.011934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:40.284016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"37'29","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.269623+0000","last_change":"2024-09-10T05:15:27.269561+0000","last_active":"2024-09-10T05:15:27.269623+0000","last_peered":"2024-09-10T05:15:27.269623+0000","last_clean":"2024-09-10T05:15:27.269623+0000","last_became_active":"2024-09-10T05:11:33.744011+0000","last_became_peered":"2024-09-10T05:11:33.744011+0000","last_unstale":"2024-09-10T05:15:27.269623+0000","last_undegraded":"2024-09-10T05:15:27.269623+0000","last_fullsized":"2024-09-10T05:15:27.269623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'29","last_scrub_stamp":"2024-09-10T05:15:27.269468+0000","last_deep_scrub":"37'29","last_deep_scrub_stamp":"2024-09-10T05:15:27.269468+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.269468+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:28.915634+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'286","reported_seq":359,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.192783+0000","last_change":"2024-09-10T05:15:34.192731+0000","last_active":"2024-09-10T05:15:34.192783+0000","last_peered":"2024-09-10T05:15:34.192783+0000","last_clean":"2024-09-10T05:15:34.192783+0000","last_became_active":"2024-09-10T05:11:35.743571+0000","last_became_peered":"2024-09-10T05:11:35.743571+0000","last_unstale":"2024-09-10T05:15:34.192783+0000","last_undegraded":"2024-09-10T05:15:34.192783+0000","last_fullsized":"2024-09-10T05:15:34.192783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:34.192645+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:34.192645+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.192645+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:41.449001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:32.602302+0000","last_change":"2024-09-10T05:11:37.764931+0000","last_active":"2024-09-10T05:13:32.602302+0000","last_peered":"2024-09-10T05:13:32.602302+0000","last_clean":"2024-09-10T05:13:32.602302+0000","last_became_active":"2024-09-10T05:11:37.764657+0000","last_became_peered":"2024-09-10T05:11:37.764657+0000","last_unstale":"2024-09-10T05:13:32.602302+0000","last_undegraded":"2024-09-10T05:13:32.602302+0000","last_fullsized":"2024-09-10T05:13:32.602302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:33.836899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.069015+0000","last_change":"2024-09-10T05:15:17.068949+0000","last_active":"2024-09-10T05:15:17.069015+0000","last_peered":"2024-09-10T05:15:17.069015+0000","last_clean":"2024-09-10T05:15:17.069015+0000","last_became_active":"2024-09-10T05:11:29.734731+0000","last_became_peered":"2024-09-10T05:11:29.734731+0000","last_unstale":"2024-09-10T05:15:17.069015+0000","last_undegraded":"2024-09-10T05:15:17.069015+0000","last_fullsized":"2024-09-10T05:15:17.069015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:17.068869+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:17.068869+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.068869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:24.980749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.997220+0000","last_change":"2024-09-10T05:14:53.997163+0000","last_active":"2024-09-10T05:14:53.997220+0000","last_peered":"2024-09-10T05:14:53.997220+0000","last_clean":"2024-09-10T05:14:53.997220+0000","last_became_active":"2024-09-10T05:11:27.723268+0000","last_became_peered":"2024-09-10T05:11:27.723268+0000","last_unstale":"2024-09-10T05:14:53.997220+0000","last_undegraded":"2024-09-10T05:14:53.997220+0000","last_fullsized":"2024-09-10T05:14:53.997220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.997077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.997077+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.997077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:30.512459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.499303+0000","last_change":"2024-09-10T05:14:53.499227+0000","last_active":"2024-09-10T05:14:53.499303+0000","last_peered":"2024-09-10T05:14:53.499303+0000","last_clean":"2024-09-10T05:14:53.499303+0000","last_became_active":"2024-09-10T05:11:16.531550+0000","last_became_peered":"2024-09-10T05:11:16.531550+0000","last_unstale":"2024-09-10T05:14:53.499303+0000","last_undegraded":"2024-09-10T05:14:53.499303+0000","last_fullsized":"2024-09-10T05:14:53.499303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.499101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.499101+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.499101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:59:02.083006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00063503699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:36.995729+0000","last_change":"2024-09-10T05:15:36.995651+0000","last_active":"2024-09-10T05:15:36.995729+0000","last_peered":"2024-09-10T05:15:36.995729+0000","last_clean":"2024-09-10T05:15:36.995729+0000","last_became_active":"2024-09-10T05:11:31.734310+0000","last_became_peered":"2024-09-10T05:11:31.734310+0000","last_unstale":"2024-09-10T05:15:36.995729+0000","last_undegraded":"2024-09-10T05:15:36.995729+0000","last_fullsized":"2024-09-10T05:15:36.995729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:36.995574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:36.995574+0000","last_clean_scrub_stamp":"2024-09-10T05:15:36.995574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:51.268902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'23","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:45.041432+0000","last_change":"2024-09-10T05:15:45.041358+0000","last_active":"2024-09-10T05:15:45.041432+0000","last_peered":"2024-09-10T05:15:45.041432+0000","last_clean":"2024-09-10T05:15:45.041432+0000","last_became_active":"2024-09-10T05:11:33.748603+0000","last_became_peered":"2024-09-10T05:11:33.748603+0000","last_unstale":"2024-09-10T05:15:45.041432+0000","last_undegraded":"2024-09-10T05:15:45.041432+0000","last_fullsized":"2024-09-10T05:15:45.041432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'23","last_scrub_stamp":"2024-09-10T05:15:45.041266+0000","last_deep_scrub":"37'23","last_deep_scrub_stamp":"2024-09-10T05:15:45.041266+0000","last_clean_scrub_stamp":"2024-09-10T05:15:45.041266+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:23.170240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'286","reported_seq":402,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:32.599810+0000","last_change":"2024-09-10T05:15:32.599749+0000","last_active":"2024-09-10T05:15:32.599810+0000","last_peered":"2024-09-10T05:15:32.599810+0000","last_clean":"2024-09-10T05:15:32.599810+0000","last_became_active":"2024-09-10T05:11:35.745807+0000","last_became_peered":"2024-09-10T05:11:35.745807+0000","last_unstale":"2024-09-10T05:15:32.599810+0000","last_undegraded":"2024-09-10T05:15:32.599810+0000","last_fullsized":"2024-09-10T05:15:32.599810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:32.599633+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:32.599633+0000","last_clean_scrub_stamp":"2024-09-10T05:15:32.599633+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:25.495767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'3","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:44.152788+0000","last_change":"2024-09-10T05:15:44.152788+0000","last_active":"2024-09-10T05:15:44.152788+0000","last_peered":"2024-09-10T05:15:44.152788+0000","last_clean":"2024-09-10T05:15:44.152788+0000","last_became_active":"2024-09-10T05:11:37.762407+0000","last_became_peered":"2024-09-10T05:11:37.762407+0000","last_unstale":"2024-09-10T05:15:44.152788+0000","last_undegraded":"2024-09-10T05:15:44.152788+0000","last_fullsized":"2024-09-10T05:15:44.152788+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-10T05:15:44.152676+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-10T05:15:44.152676+0000","last_clean_scrub_stamp":"2024-09-10T05:15:44.152676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:11:01.228571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.609490+0000","last_change":"2024-09-10T05:15:03.609389+0000","last_active":"2024-09-10T05:15:03.609490+0000","last_peered":"2024-09-10T05:15:03.609490+0000","last_clean":"2024-09-10T05:15:03.609490+0000","last_became_active":"2024-09-10T05:11:29.730285+0000","last_became_peered":"2024-09-10T05:11:29.730285+0000","last_unstale":"2024-09-10T05:15:03.609490+0000","last_undegraded":"2024-09-10T05:15:03.609490+0000","last_fullsized":"2024-09-10T05:15:03.609490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.609295+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.609295+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.609295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:48.096904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.429097+0000","last_change":"2024-09-10T05:14:47.429038+0000","last_active":"2024-09-10T05:14:47.429097+0000","last_peered":"2024-09-10T05:14:47.429097+0000","last_clean":"2024-09-10T05:14:47.429097+0000","last_became_active":"2024-09-10T05:11:27.731108+0000","last_became_peered":"2024-09-10T05:11:27.731108+0000","last_unstale":"2024-09-10T05:14:47.429097+0000","last_undegraded":"2024-09-10T05:14:47.429097+0000","last_fullsized":"2024-09-10T05:14:47.429097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:47.428954+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:47.428954+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.428954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:33.646520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.995787+0000","last_change":"2024-09-10T05:14:52.995705+0000","last_active":"2024-09-10T05:14:52.995787+0000","last_peered":"2024-09-10T05:14:52.995787+0000","last_clean":"2024-09-10T05:14:52.995787+0000","last_became_active":"2024-09-10T05:11:16.531468+0000","last_became_peered":"2024-09-10T05:11:16.531468+0000","last_unstale":"2024-09-10T05:14:52.995787+0000","last_undegraded":"2024-09-10T05:14:52.995787+0000","last_fullsized":"2024-09-10T05:14:52.995787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.995618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.995618+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.995618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:43.970590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001329722,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.962538+0000","last_change":"2024-09-10T05:15:34.962538+0000","last_active":"2024-09-10T05:15:34.962538+0000","last_peered":"2024-09-10T05:15:34.962538+0000","last_clean":"2024-09-10T05:15:34.962538+0000","last_became_active":"2024-09-10T05:11:31.732753+0000","last_became_peered":"2024-09-10T05:11:31.732753+0000","last_unstale":"2024-09-10T05:15:34.962538+0000","last_undegraded":"2024-09-10T05:15:34.962538+0000","last_fullsized":"2024-09-10T05:15:34.962538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:34.962423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:34.962423+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.962423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:12.195846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'106","reported_seq":206,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.713783+0000","last_change":"2024-09-10T05:15:21.713723+0000","last_active":"2024-09-10T05:15:21.713783+0000","last_peered":"2024-09-10T05:15:21.713783+0000","last_clean":"2024-09-10T05:15:21.713783+0000","last_became_active":"2024-09-10T05:11:33.744217+0000","last_became_peered":"2024-09-10T05:11:33.744217+0000","last_unstale":"2024-09-10T05:15:21.713783+0000","last_undegraded":"2024-09-10T05:15:21.713783+0000","last_fullsized":"2024-09-10T05:15:21.713783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'106","last_scrub_stamp":"2024-09-10T05:15:21.713617+0000","last_deep_scrub":"37'106","last_deep_scrub_stamp":"2024-09-10T05:15:21.713617+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.713617+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:18.813436+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:28.623214+0000","last_change":"2024-09-10T05:15:28.623134+0000","last_active":"2024-09-10T05:15:28.623214+0000","last_peered":"2024-09-10T05:15:28.623214+0000","last_clean":"2024-09-10T05:15:28.623214+0000","last_became_active":"2024-09-10T05:11:35.747924+0000","last_became_peered":"2024-09-10T05:11:35.747924+0000","last_unstale":"2024-09-10T05:15:28.623214+0000","last_undegraded":"2024-09-10T05:15:28.623214+0000","last_fullsized":"2024-09-10T05:15:28.623214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:28.623034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:28.623034+0000","last_clean_scrub_stamp":"2024-09-10T05:15:28.623034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:48.440071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:37.686465+0000","last_change":"2024-09-10T05:15:37.686465+0000","last_active":"2024-09-10T05:15:37.686465+0000","last_peered":"2024-09-10T05:15:37.686465+0000","last_clean":"2024-09-10T05:15:37.686465+0000","last_became_active":"2024-09-10T05:11:37.757947+0000","last_became_peered":"2024-09-10T05:11:37.757947+0000","last_unstale":"2024-09-10T05:15:37.686465+0000","last_undegraded":"2024-09-10T05:15:37.686465+0000","last_fullsized":"2024-09-10T05:15:37.686465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:37.686363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:37.686363+0000","last_clean_scrub_stamp":"2024-09-10T05:15:37.686363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:06.623851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:40.805500+0000","last_change":"2024-09-10T05:15:40.805413+0000","last_active":"2024-09-10T05:15:40.805500+0000","last_peered":"2024-09-10T05:15:40.805500+0000","last_clean":"2024-09-10T05:15:40.805500+0000","last_became_active":"2024-09-10T05:11:37.759217+0000","last_became_peered":"2024-09-10T05:11:37.759217+0000","last_unstale":"2024-09-10T05:15:40.805500+0000","last_undegraded":"2024-09-10T05:15:40.805500+0000","last_fullsized":"2024-09-10T05:15:40.805500+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:40.805307+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:40.805307+0000","last_clean_scrub_stamp":"2024-09-10T05:15:40.805307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:46.454929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'12","reported_seq":90,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:06.623135+0000","last_change":"2024-09-10T05:15:06.623135+0000","last_active":"2024-09-10T05:15:06.623135+0000","last_peered":"2024-09-10T05:15:06.623135+0000","last_clean":"2024-09-10T05:15:06.623135+0000","last_became_active":"2024-09-10T05:11:29.730105+0000","last_became_peered":"2024-09-10T05:11:29.730105+0000","last_unstale":"2024-09-10T05:15:06.623135+0000","last_undegraded":"2024-09-10T05:15:06.623135+0000","last_fullsized":"2024-09-10T05:15:06.623135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-10T05:15:06.623056+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-10T05:15:06.623056+0000","last_clean_scrub_stamp":"2024-09-10T05:15:06.623056+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:01.300449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.953621+0000","last_change":"2024-09-10T05:15:00.953621+0000","last_active":"2024-09-10T05:15:00.953621+0000","last_peered":"2024-09-10T05:15:00.953621+0000","last_clean":"2024-09-10T05:15:00.953621+0000","last_became_active":"2024-09-10T05:11:27.731634+0000","last_became_peered":"2024-09-10T05:11:27.731634+0000","last_unstale":"2024-09-10T05:15:00.953621+0000","last_undegraded":"2024-09-10T05:15:00.953621+0000","last_fullsized":"2024-09-10T05:15:00.953621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:00.953536+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:00.953536+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.953536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.954553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.266780+0000","last_change":"2024-09-10T05:15:23.266780+0000","last_active":"2024-09-10T05:15:23.266780+0000","last_peered":"2024-09-10T05:15:23.266780+0000","last_clean":"2024-09-10T05:15:23.266780+0000","last_became_active":"2024-09-10T05:12:04.967513+0000","last_became_peered":"2024-09-10T05:12:04.967513+0000","last_unstale":"2024-09-10T05:15:23.266780+0000","last_undegraded":"2024-09-10T05:15:23.266780+0000","last_fullsized":"2024-09-10T05:15:23.266780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:23.266688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:23.266688+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.266688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:14:49.877447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'48","reported_seq":110,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:54.058942+0000","last_change":"2024-09-10T05:15:54.058942+0000","last_active":"2024-09-10T05:15:54.058942+0000","last_peered":"2024-09-10T05:15:54.058942+0000","last_clean":"2024-09-10T05:15:54.058942+0000","last_became_active":"2024-09-10T05:11:33.745347+0000","last_became_peered":"2024-09-10T05:11:33.745347+0000","last_unstale":"2024-09-10T05:15:54.058942+0000","last_undegraded":"2024-09-10T05:15:54.058942+0000","last_fullsized":"2024-09-10T05:15:54.058942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'48","last_scrub_stamp":"2024-09-10T05:15:54.058853+0000","last_deep_scrub":"37'48","last_deep_scrub_stamp":"2024-09-10T05:15:54.058853+0000","last_clean_scrub_stamp":"2024-09-10T05:15:54.058853+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:43.941270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:01.097289+0000","last_change":"2024-09-10T05:16:01.097289+0000","last_active":"2024-09-10T05:16:01.097289+0000","last_peered":"2024-09-10T05:16:01.097289+0000","last_clean":"2024-09-10T05:16:01.097289+0000","last_became_active":"2024-09-10T05:11:35.754318+0000","last_became_peered":"2024-09-10T05:11:35.754318+0000","last_unstale":"2024-09-10T05:16:01.097289+0000","last_undegraded":"2024-09-10T05:16:01.097289+0000","last_fullsized":"2024-09-10T05:16:01.097289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:16:01.097209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:16:01.097209+0000","last_clean_scrub_stamp":"2024-09-10T05:16:01.097209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:57.897010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:47.616065+0000","last_change":"2024-09-10T05:15:47.616065+0000","last_active":"2024-09-10T05:15:47.616065+0000","last_peered":"2024-09-10T05:15:47.616065+0000","last_clean":"2024-09-10T05:15:47.616065+0000","last_became_active":"2024-09-10T05:11:37.760471+0000","last_became_peered":"2024-09-10T05:11:37.760471+0000","last_unstale":"2024-09-10T05:15:47.616065+0000","last_undegraded":"2024-09-10T05:15:47.616065+0000","last_fullsized":"2024-09-10T05:15:47.616065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:15:47.615986+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:15:47.615986+0000","last_clean_scrub_stamp":"2024-09-10T05:15:47.615986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:39.421431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:06.365828+0000","last_change":"2024-09-10T05:15:06.365828+0000","last_active":"2024-09-10T05:15:06.365828+0000","last_peered":"2024-09-10T05:15:06.365828+0000","last_clean":"2024-09-10T05:15:06.365828+0000","last_became_active":"2024-09-10T05:11:29.727550+0000","last_became_peered":"2024-09-10T05:11:29.727550+0000","last_unstale":"2024-09-10T05:15:06.365828+0000","last_undegraded":"2024-09-10T05:15:06.365828+0000","last_fullsized":"2024-09-10T05:15:06.365828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:06.365720+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:06.365720+0000","last_clean_scrub_stamp":"2024-09-10T05:15:06.365720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:23.986492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.731049+0000","last_change":"2024-09-10T05:14:51.731049+0000","last_active":"2024-09-10T05:14:51.731049+0000","last_peered":"2024-09-10T05:14:51.731049+0000","last_clean":"2024-09-10T05:14:51.731049+0000","last_became_active":"2024-09-10T05:11:27.724637+0000","last_became_peered":"2024-09-10T05:11:27.724637+0000","last_unstale":"2024-09-10T05:14:51.731049+0000","last_undegraded":"2024-09-10T05:14:51.731049+0000","last_fullsized":"2024-09-10T05:14:51.731049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:51.730965+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:51.730965+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.730965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:07.979601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:42.019303+0000","last_change":"2024-09-10T05:15:42.019303+0000","last_active":"2024-09-10T05:15:42.019303+0000","last_peered":"2024-09-10T05:15:42.019303+0000","last_clean":"2024-09-10T05:15:42.019303+0000","last_became_active":"2024-09-10T05:11:31.736758+0000","last_became_peered":"2024-09-10T05:11:31.736758+0000","last_unstale":"2024-09-10T05:15:42.019303+0000","last_undegraded":"2024-09-10T05:15:42.019303+0000","last_fullsized":"2024-09-10T05:15:42.019303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:42.019205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:42.019205+0000","last_clean_scrub_stamp":"2024-09-10T05:15:42.019205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:35.436605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'9","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.744425+0000","last_change":"2024-09-10T05:15:23.744425+0000","last_active":"2024-09-10T05:15:23.744425+0000","last_peered":"2024-09-10T05:15:23.744425+0000","last_clean":"2024-09-10T05:15:23.744425+0000","last_became_active":"2024-09-10T05:11:33.742039+0000","last_became_peered":"2024-09-10T05:11:33.742039+0000","last_unstale":"2024-09-10T05:15:23.744425+0000","last_undegraded":"2024-09-10T05:15:23.744425+0000","last_fullsized":"2024-09-10T05:15:23.744425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-10T05:15:23.744296+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-10T05:15:23.744296+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.744296+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:24:56.856947+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:31.713764+0000","last_change":"2024-09-10T05:15:31.713764+0000","last_active":"2024-09-10T05:15:31.713764+0000","last_peered":"2024-09-10T05:15:31.713764+0000","last_clean":"2024-09-10T05:15:31.713764+0000","last_became_active":"2024-09-10T05:11:35.751244+0000","last_became_peered":"2024-09-10T05:11:35.751244+0000","last_unstale":"2024-09-10T05:15:31.713764+0000","last_undegraded":"2024-09-10T05:15:31.713764+0000","last_fullsized":"2024-09-10T05:15:31.713764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:31.713667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:31.713667+0000","last_clean_scrub_stamp":"2024-09-10T05:15:31.713667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:26:13.902660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:46.624854+0000","last_change":"2024-09-10T05:15:46.624854+0000","last_active":"2024-09-10T05:15:46.624854+0000","last_peered":"2024-09-10T05:15:46.624854+0000","last_clean":"2024-09-10T05:15:46.624854+0000","last_became_active":"2024-09-10T05:11:37.755533+0000","last_became_peered":"2024-09-10T05:11:37.755533+0000","last_unstale":"2024-09-10T05:15:46.624854+0000","last_undegraded":"2024-09-10T05:15:46.624854+0000","last_fullsized":"2024-09-10T05:15:46.624854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:46.624756+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:46.624756+0000","last_clean_scrub_stamp":"2024-09-10T05:15:46.624756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:44.080407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.660492+0000","last_change":"2024-09-10T05:15:12.660492+0000","last_active":"2024-09-10T05:15:12.660492+0000","last_peered":"2024-09-10T05:15:12.660492+0000","last_clean":"2024-09-10T05:15:12.660492+0000","last_became_active":"2024-09-10T05:11:29.727400+0000","last_became_peered":"2024-09-10T05:11:29.727400+0000","last_unstale":"2024-09-10T05:15:12.660492+0000","last_undegraded":"2024-09-10T05:15:12.660492+0000","last_fullsized":"2024-09-10T05:15:12.660492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:12.660389+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:12.660389+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.660389+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:36.645663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.665768+0000","last_change":"2024-09-10T05:14:55.665768+0000","last_active":"2024-09-10T05:14:55.665768+0000","last_peered":"2024-09-10T05:14:55.665768+0000","last_clean":"2024-09-10T05:14:55.665768+0000","last_became_active":"2024-09-10T05:11:27.727561+0000","last_became_peered":"2024-09-10T05:11:27.727561+0000","last_unstale":"2024-09-10T05:14:55.665768+0000","last_undegraded":"2024-09-10T05:14:55.665768+0000","last_fullsized":"2024-09-10T05:14:55.665768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:55.665677+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:55.665677+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.665677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:14.595232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"37'2","reported_seq":230,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.691856+0000","last_change":"2024-09-10T05:15:17.691856+0000","last_active":"2024-09-10T05:15:17.691856+0000","last_peered":"2024-09-10T05:15:17.691856+0000","last_clean":"2024-09-10T05:15:17.691856+0000","last_became_active":"2024-09-10T05:11:31.733793+0000","last_became_peered":"2024-09-10T05:11:31.733793+0000","last_unstale":"2024-09-10T05:15:17.691856+0000","last_undegraded":"2024-09-10T05:15:17.691856+0000","last_fullsized":"2024-09-10T05:15:17.691856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:17.691774+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:17.691774+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.691774+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:00.262242+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'51","reported_seq":123,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.735826+0000","last_change":"2024-09-10T05:15:24.735826+0000","last_active":"2024-09-10T05:15:24.735826+0000","last_peered":"2024-09-10T05:15:24.735826+0000","last_clean":"2024-09-10T05:15:24.735826+0000","last_became_active":"2024-09-10T05:11:33.744634+0000","last_became_peered":"2024-09-10T05:11:33.744634+0000","last_unstale":"2024-09-10T05:15:24.735826+0000","last_undegraded":"2024-09-10T05:15:24.735826+0000","last_fullsized":"2024-09-10T05:15:24.735826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'51","last_scrub_stamp":"2024-09-10T05:15:24.735737+0000","last_deep_scrub":"37'51","last_deep_scrub_stamp":"2024-09-10T05:15:24.735737+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.735737+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:27.977793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:36.128990+0000","last_change":"2024-09-10T05:15:36.128990+0000","last_active":"2024-09-10T05:15:36.128990+0000","last_peered":"2024-09-10T05:15:36.128990+0000","last_clean":"2024-09-10T05:15:36.128990+0000","last_became_active":"2024-09-10T05:11:35.748406+0000","last_became_peered":"2024-09-10T05:11:35.748406+0000","last_unstale":"2024-09-10T05:15:36.128990+0000","last_undegraded":"2024-09-10T05:15:36.128990+0000","last_fullsized":"2024-09-10T05:15:36.128990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:36.128911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:36.128911+0000","last_clean_scrub_stamp":"2024-09-10T05:15:36.128911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:39.255053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.370496+0000","last_change":"2024-09-10T05:11:37.765627+0000","last_active":"2024-09-10T05:14:36.370496+0000","last_peered":"2024-09-10T05:14:36.370496+0000","last_clean":"2024-09-10T05:14:36.370496+0000","last_became_active":"2024-09-10T05:11:37.765188+0000","last_became_peered":"2024-09-10T05:11:37.765188+0000","last_unstale":"2024-09-10T05:14:36.370496+0000","last_undegraded":"2024-09-10T05:14:36.370496+0000","last_fullsized":"2024-09-10T05:14:36.370496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:35.729959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.025498+0000","last_change":"2024-09-10T05:15:21.025498+0000","last_active":"2024-09-10T05:15:21.025498+0000","last_peered":"2024-09-10T05:15:21.025498+0000","last_clean":"2024-09-10T05:15:21.025498+0000","last_became_active":"2024-09-10T05:11:29.735101+0000","last_became_peered":"2024-09-10T05:11:29.735101+0000","last_unstale":"2024-09-10T05:15:21.025498+0000","last_undegraded":"2024-09-10T05:15:21.025498+0000","last_fullsized":"2024-09-10T05:15:21.025498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:21.025412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:21.025412+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.025412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:22.721305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.411020+0000","last_change":"2024-09-10T05:14:50.411020+0000","last_active":"2024-09-10T05:14:50.411020+0000","last_peered":"2024-09-10T05:14:50.411020+0000","last_clean":"2024-09-10T05:14:50.411020+0000","last_became_active":"2024-09-10T05:11:27.715729+0000","last_became_peered":"2024-09-10T05:11:27.715729+0000","last_unstale":"2024-09-10T05:14:50.411020+0000","last_undegraded":"2024-09-10T05:14:50.411020+0000","last_fullsized":"2024-09-10T05:14:50.411020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.410933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.410933+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.410933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:35.070195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:40.023328+0000","last_change":"2024-09-10T05:15:40.023328+0000","last_active":"2024-09-10T05:15:40.023328+0000","last_peered":"2024-09-10T05:15:40.023328+0000","last_clean":"2024-09-10T05:15:40.023328+0000","last_became_active":"2024-09-10T05:11:31.732476+0000","last_became_peered":"2024-09-10T05:11:31.732476+0000","last_unstale":"2024-09-10T05:15:40.023328+0000","last_undegraded":"2024-09-10T05:15:40.023328+0000","last_fullsized":"2024-09-10T05:15:40.023328+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:40.023244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:40.023244+0000","last_clean_scrub_stamp":"2024-09-10T05:15:40.023244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:22.273834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'38","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:25.695074+0000","last_change":"2024-09-10T05:15:25.695074+0000","last_active":"2024-09-10T05:15:25.695074+0000","last_peered":"2024-09-10T05:15:25.695074+0000","last_clean":"2024-09-10T05:15:25.695074+0000","last_became_active":"2024-09-10T05:11:33.740483+0000","last_became_peered":"2024-09-10T05:11:33.740483+0000","last_unstale":"2024-09-10T05:15:25.695074+0000","last_undegraded":"2024-09-10T05:15:25.695074+0000","last_fullsized":"2024-09-10T05:15:25.695074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-10T05:15:25.694982+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-10T05:15:25.694982+0000","last_clean_scrub_stamp":"2024-09-10T05:15:25.694982+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:43.315754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:32.736066+0000","last_change":"2024-09-10T05:15:32.736066+0000","last_active":"2024-09-10T05:15:32.736066+0000","last_peered":"2024-09-10T05:15:32.736066+0000","last_clean":"2024-09-10T05:15:32.736066+0000","last_became_active":"2024-09-10T05:11:35.745886+0000","last_became_peered":"2024-09-10T05:11:35.745886+0000","last_unstale":"2024-09-10T05:15:32.736066+0000","last_undegraded":"2024-09-10T05:15:32.736066+0000","last_fullsized":"2024-09-10T05:15:32.736066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:32.735947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:32.735947+0000","last_clean_scrub_stamp":"2024-09-10T05:15:32.735947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:20.165956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'4","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.009524+0000","last_change":"2024-09-10T05:15:27.009451+0000","last_active":"2024-09-10T05:15:27.009524+0000","last_peered":"2024-09-10T05:15:27.009524+0000","last_clean":"2024-09-10T05:15:27.009524+0000","last_became_active":"2024-09-10T05:11:29.731824+0000","last_became_peered":"2024-09-10T05:11:29.731824+0000","last_unstale":"2024-09-10T05:15:27.009524+0000","last_undegraded":"2024-09-10T05:15:27.009524+0000","last_fullsized":"2024-09-10T05:15:27.009524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:27.009372+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:27.009372+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.009372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:47.379586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.955838+0000","last_change":"2024-09-10T05:15:02.955838+0000","last_active":"2024-09-10T05:15:02.955838+0000","last_peered":"2024-09-10T05:15:02.955838+0000","last_clean":"2024-09-10T05:15:02.955838+0000","last_became_active":"2024-09-10T05:11:27.734652+0000","last_became_peered":"2024-09-10T05:11:27.734652+0000","last_unstale":"2024-09-10T05:15:02.955838+0000","last_undegraded":"2024-09-10T05:15:02.955838+0000","last_fullsized":"2024-09-10T05:15:02.955838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:02.955753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:02.955753+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.955753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:03.026683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.707831+0000","last_change":"2024-09-10T05:15:21.707762+0000","last_active":"2024-09-10T05:15:21.707831+0000","last_peered":"2024-09-10T05:15:21.707831+0000","last_clean":"2024-09-10T05:15:21.707831+0000","last_became_active":"2024-09-10T05:11:31.734774+0000","last_became_peered":"2024-09-10T05:11:31.734774+0000","last_unstale":"2024-09-10T05:15:21.707831+0000","last_undegraded":"2024-09-10T05:15:21.707831+0000","last_fullsized":"2024-09-10T05:15:21.707831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:21.707674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:21.707674+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.707674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:24.042654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'72","reported_seq":151,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:26.709919+0000","last_change":"2024-09-10T05:15:26.709919+0000","last_active":"2024-09-10T05:15:26.709919+0000","last_peered":"2024-09-10T05:15:26.709919+0000","last_clean":"2024-09-10T05:15:26.709919+0000","last_became_active":"2024-09-10T05:11:33.741136+0000","last_became_peered":"2024-09-10T05:11:33.741136+0000","last_unstale":"2024-09-10T05:15:26.709919+0000","last_undegraded":"2024-09-10T05:15:26.709919+0000","last_fullsized":"2024-09-10T05:15:26.709919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'72","last_scrub_stamp":"2024-09-10T05:15:26.709822+0000","last_deep_scrub":"37'72","last_deep_scrub_stamp":"2024-09-10T05:15:26.709822+0000","last_clean_scrub_stamp":"2024-09-10T05:15:26.709822+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:58.542377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:33.758682+0000","last_change":"2024-09-10T05:15:33.758682+0000","last_active":"2024-09-10T05:15:33.758682+0000","last_peered":"2024-09-10T05:15:33.758682+0000","last_clean":"2024-09-10T05:15:33.758682+0000","last_became_active":"2024-09-10T05:11:35.745795+0000","last_became_peered":"2024-09-10T05:11:35.745795+0000","last_unstale":"2024-09-10T05:15:33.758682+0000","last_undegraded":"2024-09-10T05:15:33.758682+0000","last_fullsized":"2024-09-10T05:15:33.758682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:33.758579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:33.758579+0000","last_clean_scrub_stamp":"2024-09-10T05:15:33.758579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:25.812947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:45.653257+0000","last_change":"2024-09-10T05:15:45.653257+0000","last_active":"2024-09-10T05:15:45.653257+0000","last_peered":"2024-09-10T05:15:45.653257+0000","last_clean":"2024-09-10T05:15:45.653257+0000","last_became_active":"2024-09-10T05:11:37.758360+0000","last_became_peered":"2024-09-10T05:11:37.758360+0000","last_unstale":"2024-09-10T05:15:45.653257+0000","last_undegraded":"2024-09-10T05:15:45.653257+0000","last_fullsized":"2024-09-10T05:15:45.653257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:45.653164+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:45.653164+0000","last_clean_scrub_stamp":"2024-09-10T05:15:45.653164+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:01.291661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'9","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.487806+0000","last_change":"2024-09-10T05:15:04.487731+0000","last_active":"2024-09-10T05:15:04.487806+0000","last_peered":"2024-09-10T05:15:04.487806+0000","last_clean":"2024-09-10T05:15:04.487806+0000","last_became_active":"2024-09-10T05:11:29.723722+0000","last_became_peered":"2024-09-10T05:11:29.723722+0000","last_unstale":"2024-09-10T05:15:04.487806+0000","last_undegraded":"2024-09-10T05:15:04.487806+0000","last_fullsized":"2024-09-10T05:15:04.487806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-10T05:15:04.487622+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-10T05:15:04.487622+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.487622+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:01.563035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.432455+0000","last_change":"2024-09-10T05:14:48.432455+0000","last_active":"2024-09-10T05:14:48.432455+0000","last_peered":"2024-09-10T05:14:48.432455+0000","last_clean":"2024-09-10T05:14:48.432455+0000","last_became_active":"2024-09-10T05:11:27.727770+0000","last_became_peered":"2024-09-10T05:11:27.727770+0000","last_unstale":"2024-09-10T05:14:48.432455+0000","last_undegraded":"2024-09-10T05:14:48.432455+0000","last_fullsized":"2024-09-10T05:14:48.432455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.432373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.432373+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.432373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:56.267844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.739665+0000","last_change":"2024-09-10T05:15:19.739584+0000","last_active":"2024-09-10T05:15:19.739665+0000","last_peered":"2024-09-10T05:15:19.739665+0000","last_clean":"2024-09-10T05:15:19.739665+0000","last_became_active":"2024-09-10T05:11:31.728653+0000","last_became_peered":"2024-09-10T05:11:31.728653+0000","last_unstale":"2024-09-10T05:15:19.739665+0000","last_undegraded":"2024-09-10T05:15:19.739665+0000","last_fullsized":"2024-09-10T05:15:19.739665+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:19.739465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:19.739465+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.739465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:10.896874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'46","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:55.093641+0000","last_change":"2024-09-10T05:15:55.093641+0000","last_active":"2024-09-10T05:15:55.093641+0000","last_peered":"2024-09-10T05:15:55.093641+0000","last_clean":"2024-09-10T05:15:55.093641+0000","last_became_active":"2024-09-10T05:11:33.743048+0000","last_became_peered":"2024-09-10T05:11:33.743048+0000","last_unstale":"2024-09-10T05:15:55.093641+0000","last_undegraded":"2024-09-10T05:15:55.093641+0000","last_fullsized":"2024-09-10T05:15:55.093641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-10T05:15:55.093540+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-10T05:15:55.093540+0000","last_clean_scrub_stamp":"2024-09-10T05:15:55.093540+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:28.102787+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:39.127420+0000","last_change":"2024-09-10T05:15:39.127420+0000","last_active":"2024-09-10T05:15:39.127420+0000","last_peered":"2024-09-10T05:15:39.127420+0000","last_clean":"2024-09-10T05:15:39.127420+0000","last_became_active":"2024-09-10T05:11:35.752971+0000","last_became_peered":"2024-09-10T05:11:35.752971+0000","last_unstale":"2024-09-10T05:15:39.127420+0000","last_undegraded":"2024-09-10T05:15:39.127420+0000","last_fullsized":"2024-09-10T05:15:39.127420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:39.127342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:39.127342+0000","last_clean_scrub_stamp":"2024-09-10T05:15:39.127342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:18.920925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954464+0000","last_change":"2024-09-10T05:11:37.768354+0000","last_active":"2024-09-10T05:12:04.954464+0000","last_peered":"2024-09-10T05:12:04.954464+0000","last_clean":"2024-09-10T05:12:04.954464+0000","last_became_active":"2024-09-10T05:11:37.768036+0000","last_became_peered":"2024-09-10T05:11:37.768036+0000","last_unstale":"2024-09-10T05:12:04.954464+0000","last_undegraded":"2024-09-10T05:12:04.954464+0000","last_fullsized":"2024-09-10T05:12:04.954464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:28.716788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:26.004309+0000","last_change":"2024-09-10T05:15:26.004309+0000","last_active":"2024-09-10T05:15:26.004309+0000","last_peered":"2024-09-10T05:15:26.004309+0000","last_clean":"2024-09-10T05:15:26.004309+0000","last_became_active":"2024-09-10T05:11:29.734714+0000","last_became_peered":"2024-09-10T05:11:29.734714+0000","last_unstale":"2024-09-10T05:15:26.004309+0000","last_undegraded":"2024-09-10T05:15:26.004309+0000","last_fullsized":"2024-09-10T05:15:26.004309+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:26.004225+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:26.004225+0000","last_clean_scrub_stamp":"2024-09-10T05:15:26.004225+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:49.905656+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.434007+0000","last_change":"2024-09-10T05:14:53.434007+0000","last_active":"2024-09-10T05:14:53.434007+0000","last_peered":"2024-09-10T05:14:53.434007+0000","last_clean":"2024-09-10T05:14:53.434007+0000","last_became_active":"2024-09-10T05:11:27.718251+0000","last_became_peered":"2024-09-10T05:11:27.718251+0000","last_unstale":"2024-09-10T05:14:53.434007+0000","last_undegraded":"2024-09-10T05:14:53.434007+0000","last_fullsized":"2024-09-10T05:14:53.434007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:53.433919+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:53.433919+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.433919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:36.001843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.733593+0000","last_change":"2024-09-10T05:15:18.733593+0000","last_active":"2024-09-10T05:15:18.733593+0000","last_peered":"2024-09-10T05:15:18.733593+0000","last_clean":"2024-09-10T05:15:18.733593+0000","last_became_active":"2024-09-10T05:11:31.727998+0000","last_became_peered":"2024-09-10T05:11:31.727998+0000","last_unstale":"2024-09-10T05:15:18.733593+0000","last_undegraded":"2024-09-10T05:15:18.733593+0000","last_fullsized":"2024-09-10T05:15:18.733593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:18.733458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:18.733458+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.733458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:16.898611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'47","reported_seq":110,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.670352+0000","last_change":"2024-09-10T05:15:27.670277+0000","last_active":"2024-09-10T05:15:27.670352+0000","last_peered":"2024-09-10T05:15:27.670352+0000","last_clean":"2024-09-10T05:15:27.670352+0000","last_became_active":"2024-09-10T05:11:33.742594+0000","last_became_peered":"2024-09-10T05:11:33.742594+0000","last_unstale":"2024-09-10T05:15:27.670352+0000","last_undegraded":"2024-09-10T05:15:27.670352+0000","last_fullsized":"2024-09-10T05:15:27.670352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'47","last_scrub_stamp":"2024-09-10T05:15:27.670186+0000","last_deep_scrub":"37'47","last_deep_scrub_stamp":"2024-09-10T05:15:27.670186+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.670186+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:14.370124+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:38.636474+0000","last_change":"2024-09-10T05:15:38.636384+0000","last_active":"2024-09-10T05:15:38.636474+0000","last_peered":"2024-09-10T05:15:38.636474+0000","last_clean":"2024-09-10T05:15:38.636474+0000","last_became_active":"2024-09-10T05:11:35.748464+0000","last_became_peered":"2024-09-10T05:11:35.748464+0000","last_unstale":"2024-09-10T05:15:38.636474+0000","last_undegraded":"2024-09-10T05:15:38.636474+0000","last_fullsized":"2024-09-10T05:15:38.636474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:38.636277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:38.636277+0000","last_clean_scrub_stamp":"2024-09-10T05:15:38.636277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:46.050421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:35.674549+0000","last_change":"2024-09-10T05:11:37.768552+0000","last_active":"2024-09-10T05:13:35.674549+0000","last_peered":"2024-09-10T05:13:35.674549+0000","last_clean":"2024-09-10T05:13:35.674549+0000","last_became_active":"2024-09-10T05:11:37.768248+0000","last_became_peered":"2024-09-10T05:11:37.768248+0000","last_unstale":"2024-09-10T05:13:35.674549+0000","last_undegraded":"2024-09-10T05:13:35.674549+0000","last_fullsized":"2024-09-10T05:13:35.674549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:47.039216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.466476+0000","last_change":"2024-09-10T05:15:03.466476+0000","last_active":"2024-09-10T05:15:03.466476+0000","last_peered":"2024-09-10T05:15:03.466476+0000","last_clean":"2024-09-10T05:15:03.466476+0000","last_became_active":"2024-09-10T05:11:29.727038+0000","last_became_peered":"2024-09-10T05:11:29.727038+0000","last_unstale":"2024-09-10T05:15:03.466476+0000","last_undegraded":"2024-09-10T05:15:03.466476+0000","last_fullsized":"2024-09-10T05:15:03.466476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:03.466382+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:03.466382+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.466382+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:51.671119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.996465+0000","last_change":"2024-09-10T05:15:03.996465+0000","last_active":"2024-09-10T05:15:03.996465+0000","last_peered":"2024-09-10T05:15:03.996465+0000","last_clean":"2024-09-10T05:15:03.996465+0000","last_became_active":"2024-09-10T05:11:27.733320+0000","last_became_peered":"2024-09-10T05:11:27.733320+0000","last_unstale":"2024-09-10T05:15:03.996465+0000","last_undegraded":"2024-09-10T05:15:03.996465+0000","last_fullsized":"2024-09-10T05:15:03.996465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.996375+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.996375+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.996375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:10:21.072269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:28.218144+0000","last_change":"2024-09-10T05:15:28.218144+0000","last_active":"2024-09-10T05:15:28.218144+0000","last_peered":"2024-09-10T05:15:28.218144+0000","last_clean":"2024-09-10T05:15:28.218144+0000","last_became_active":"2024-09-10T05:11:31.734684+0000","last_became_peered":"2024-09-10T05:11:31.734684+0000","last_unstale":"2024-09-10T05:15:28.218144+0000","last_undegraded":"2024-09-10T05:15:28.218144+0000","last_fullsized":"2024-09-10T05:15:28.218144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:28.218055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:28.218055+0000","last_clean_scrub_stamp":"2024-09-10T05:15:28.218055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:16.287090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"37'22","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:58.082798+0000","last_change":"2024-09-10T05:15:58.082798+0000","last_active":"2024-09-10T05:15:58.082798+0000","last_peered":"2024-09-10T05:15:58.082798+0000","last_clean":"2024-09-10T05:15:58.082798+0000","last_became_active":"2024-09-10T05:11:33.748547+0000","last_became_peered":"2024-09-10T05:11:33.748547+0000","last_unstale":"2024-09-10T05:15:58.082798+0000","last_undegraded":"2024-09-10T05:15:58.082798+0000","last_fullsized":"2024-09-10T05:15:58.082798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-10T05:15:58.082678+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-10T05:15:58.082678+0000","last_clean_scrub_stamp":"2024-09-10T05:15:58.082678+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:47.758655+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'286","reported_seq":379,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.740219+0000","last_change":"2024-09-10T05:15:34.740113+0000","last_active":"2024-09-10T05:15:34.740219+0000","last_peered":"2024-09-10T05:15:34.740219+0000","last_clean":"2024-09-10T05:15:34.740219+0000","last_became_active":"2024-09-10T05:11:35.750761+0000","last_became_peered":"2024-09-10T05:11:35.750761+0000","last_unstale":"2024-09-10T05:15:34.740219+0000","last_undegraded":"2024-09-10T05:15:34.740219+0000","last_fullsized":"2024-09-10T05:15:34.740219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:34.740001+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:34.740001+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.740001+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:39.734962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:04.954021+0000","last_change":"2024-09-10T05:11:37.768088+0000","last_active":"2024-09-10T05:12:04.954021+0000","last_peered":"2024-09-10T05:12:04.954021+0000","last_clean":"2024-09-10T05:12:04.954021+0000","last_became_active":"2024-09-10T05:11:37.767816+0000","last_became_peered":"2024-09-10T05:11:37.767816+0000","last_unstale":"2024-09-10T05:12:04.954021+0000","last_undegraded":"2024-09-10T05:12:04.954021+0000","last_fullsized":"2024-09-10T05:12:04.954021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:32.684488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.732045+0000","last_change":"2024-09-10T05:15:10.732045+0000","last_active":"2024-09-10T05:15:10.732045+0000","last_peered":"2024-09-10T05:15:10.732045+0000","last_clean":"2024-09-10T05:15:10.732045+0000","last_became_active":"2024-09-10T05:11:29.720243+0000","last_became_peered":"2024-09-10T05:11:29.720243+0000","last_unstale":"2024-09-10T05:15:10.732045+0000","last_undegraded":"2024-09-10T05:15:10.732045+0000","last_fullsized":"2024-09-10T05:15:10.732045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:10.731923+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:10.731923+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.731923+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:05.159738+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.448490+0000","last_change":"2024-09-10T05:14:51.448490+0000","last_active":"2024-09-10T05:14:51.448490+0000","last_peered":"2024-09-10T05:14:51.448490+0000","last_clean":"2024-09-10T05:14:51.448490+0000","last_became_active":"2024-09-10T05:11:27.723630+0000","last_became_peered":"2024-09-10T05:11:27.723630+0000","last_unstale":"2024-09-10T05:14:51.448490+0000","last_undegraded":"2024-09-10T05:14:51.448490+0000","last_fullsized":"2024-09-10T05:14:51.448490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:51.448399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:51.448399+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.448399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:08.698148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:26.253278+0000","last_change":"2024-09-10T05:15:26.253278+0000","last_active":"2024-09-10T05:15:26.253278+0000","last_peered":"2024-09-10T05:15:26.253278+0000","last_clean":"2024-09-10T05:15:26.253278+0000","last_became_active":"2024-09-10T05:11:31.737547+0000","last_became_peered":"2024-09-10T05:11:31.737547+0000","last_unstale":"2024-09-10T05:15:26.253278+0000","last_undegraded":"2024-09-10T05:15:26.253278+0000","last_fullsized":"2024-09-10T05:15:26.253278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:26.253156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:26.253156+0000","last_clean_scrub_stamp":"2024-09-10T05:15:26.253156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:07.907112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'74","reported_seq":156,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:33.219849+0000","last_change":"2024-09-10T05:15:33.219849+0000","last_active":"2024-09-10T05:15:33.219849+0000","last_peered":"2024-09-10T05:15:33.219849+0000","last_clean":"2024-09-10T05:15:33.219849+0000","last_became_active":"2024-09-10T05:11:33.740489+0000","last_became_peered":"2024-09-10T05:11:33.740489+0000","last_unstale":"2024-09-10T05:15:33.219849+0000","last_undegraded":"2024-09-10T05:15:33.219849+0000","last_fullsized":"2024-09-10T05:15:33.219849+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-10T05:15:33.219755+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-10T05:15:33.219755+0000","last_clean_scrub_stamp":"2024-09-10T05:15:33.219755+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:12.994581+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:37.606377+0000","last_change":"2024-09-10T05:15:37.606377+0000","last_active":"2024-09-10T05:15:37.606377+0000","last_peered":"2024-09-10T05:15:37.606377+0000","last_clean":"2024-09-10T05:15:37.606377+0000","last_became_active":"2024-09-10T05:11:35.753856+0000","last_became_peered":"2024-09-10T05:11:35.753856+0000","last_unstale":"2024-09-10T05:15:37.606377+0000","last_undegraded":"2024-09-10T05:15:37.606377+0000","last_fullsized":"2024-09-10T05:15:37.606377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:37.606291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:37.606291+0000","last_clean_scrub_stamp":"2024-09-10T05:15:37.606291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:42.715047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:45.104695+0000","last_change":"2024-09-10T05:15:45.104695+0000","last_active":"2024-09-10T05:15:45.104695+0000","last_peered":"2024-09-10T05:15:45.104695+0000","last_clean":"2024-09-10T05:15:45.104695+0000","last_became_active":"2024-09-10T05:11:37.758332+0000","last_became_peered":"2024-09-10T05:11:37.758332+0000","last_unstale":"2024-09-10T05:15:45.104695+0000","last_undegraded":"2024-09-10T05:15:45.104695+0000","last_fullsized":"2024-09-10T05:15:45.104695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:45.104610+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:45.104610+0000","last_clean_scrub_stamp":"2024-09-10T05:15:45.104610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:15.516776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.713125+0000","last_change":"2024-09-10T05:15:08.713125+0000","last_active":"2024-09-10T05:15:08.713125+0000","last_peered":"2024-09-10T05:15:08.713125+0000","last_clean":"2024-09-10T05:15:08.713125+0000","last_became_active":"2024-09-10T05:11:29.721899+0000","last_became_peered":"2024-09-10T05:11:29.721899+0000","last_unstale":"2024-09-10T05:15:08.713125+0000","last_undegraded":"2024-09-10T05:15:08.713125+0000","last_fullsized":"2024-09-10T05:15:08.713125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:08.713028+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:08.713028+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.713028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:16.548499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.992028+0000","last_change":"2024-09-10T05:15:04.992028+0000","last_active":"2024-09-10T05:15:04.992028+0000","last_peered":"2024-09-10T05:15:04.992028+0000","last_clean":"2024-09-10T05:15:04.992028+0000","last_became_active":"2024-09-10T05:11:27.733451+0000","last_became_peered":"2024-09-10T05:11:27.733451+0000","last_unstale":"2024-09-10T05:15:04.992028+0000","last_undegraded":"2024-09-10T05:15:04.992028+0000","last_fullsized":"2024-09-10T05:15:04.992028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:04.991935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:04.991935+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.991935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:35.404102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.749996+0000","last_change":"2024-09-10T05:15:20.749996+0000","last_active":"2024-09-10T05:15:20.749996+0000","last_peered":"2024-09-10T05:15:20.749996+0000","last_clean":"2024-09-10T05:15:20.749996+0000","last_became_active":"2024-09-10T05:11:31.735565+0000","last_became_peered":"2024-09-10T05:11:31.735565+0000","last_unstale":"2024-09-10T05:15:20.749996+0000","last_undegraded":"2024-09-10T05:15:20.749996+0000","last_fullsized":"2024-09-10T05:15:20.749996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:20.749892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:20.749892+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.749892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:19.742771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'44","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:25.706116+0000","last_change":"2024-09-10T05:15:25.706116+0000","last_active":"2024-09-10T05:15:25.706116+0000","last_peered":"2024-09-10T05:15:25.706116+0000","last_clean":"2024-09-10T05:15:25.706116+0000","last_became_active":"2024-09-10T05:11:33.742656+0000","last_became_peered":"2024-09-10T05:11:33.742656+0000","last_unstale":"2024-09-10T05:15:25.706116+0000","last_undegraded":"2024-09-10T05:15:25.706116+0000","last_fullsized":"2024-09-10T05:15:25.706116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'44","last_scrub_stamp":"2024-09-10T05:15:25.706013+0000","last_deep_scrub":"37'44","last_deep_scrub_stamp":"2024-09-10T05:15:25.706013+0000","last_clean_scrub_stamp":"2024-09-10T05:15:25.706013+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:31.251549+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:03.132301+0000","last_change":"2024-09-10T05:16:03.132301+0000","last_active":"2024-09-10T05:16:03.132301+0000","last_peered":"2024-09-10T05:16:03.132301+0000","last_clean":"2024-09-10T05:16:03.132301+0000","last_became_active":"2024-09-10T05:11:35.750960+0000","last_became_peered":"2024-09-10T05:11:35.750960+0000","last_unstale":"2024-09-10T05:16:03.132301+0000","last_undegraded":"2024-09-10T05:16:03.132301+0000","last_fullsized":"2024-09-10T05:16:03.132301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:16:03.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:16:03.132214+0000","last_clean_scrub_stamp":"2024-09-10T05:16:03.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:09.561348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:12:51.959775+0000","last_change":"2024-09-10T05:11:37.768897+0000","last_active":"2024-09-10T05:12:51.959775+0000","last_peered":"2024-09-10T05:12:51.959775+0000","last_clean":"2024-09-10T05:12:51.959775+0000","last_became_active":"2024-09-10T05:11:37.768559+0000","last_became_peered":"2024-09-10T05:11:37.768559+0000","last_unstale":"2024-09-10T05:12:51.959775+0000","last_undegraded":"2024-09-10T05:12:51.959775+0000","last_fullsized":"2024-09-10T05:12:51.959775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:41.676922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.981935+0000","last_change":"2024-09-10T05:15:24.981935+0000","last_active":"2024-09-10T05:15:24.981935+0000","last_peered":"2024-09-10T05:15:24.981935+0000","last_clean":"2024-09-10T05:15:24.981935+0000","last_became_active":"2024-09-10T05:11:29.732703+0000","last_became_peered":"2024-09-10T05:11:29.732703+0000","last_unstale":"2024-09-10T05:15:24.981935+0000","last_undegraded":"2024-09-10T05:15:24.981935+0000","last_fullsized":"2024-09-10T05:15:24.981935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:24.981859+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:24.981859+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.981859+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:28.030709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.494634+0000","last_change":"2024-09-10T05:14:56.494569+0000","last_active":"2024-09-10T05:14:56.494634+0000","last_peered":"2024-09-10T05:14:56.494634+0000","last_clean":"2024-09-10T05:14:56.494634+0000","last_became_active":"2024-09-10T05:11:27.713416+0000","last_became_peered":"2024-09-10T05:11:27.713416+0000","last_unstale":"2024-09-10T05:14:56.494634+0000","last_undegraded":"2024-09-10T05:14:56.494634+0000","last_fullsized":"2024-09-10T05:14:56.494634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:56.494480+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.494480+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.494480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:49.778320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.315033+0000","last_change":"2024-09-10T05:15:24.315033+0000","last_active":"2024-09-10T05:15:24.315033+0000","last_peered":"2024-09-10T05:15:24.315033+0000","last_clean":"2024-09-10T05:15:24.315033+0000","last_became_active":"2024-09-10T05:11:31.736540+0000","last_became_peered":"2024-09-10T05:11:31.736540+0000","last_unstale":"2024-09-10T05:15:24.315033+0000","last_undegraded":"2024-09-10T05:15:24.315033+0000","last_fullsized":"2024-09-10T05:15:24.315033+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:24.314941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:24.314941+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.314941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:23:29.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'39","reported_seq":98,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:56.058318+0000","last_change":"2024-09-10T05:15:56.058318+0000","last_active":"2024-09-10T05:15:56.058318+0000","last_peered":"2024-09-10T05:15:56.058318+0000","last_clean":"2024-09-10T05:15:56.058318+0000","last_became_active":"2024-09-10T05:11:33.743207+0000","last_became_peered":"2024-09-10T05:11:33.743207+0000","last_unstale":"2024-09-10T05:15:56.058318+0000","last_undegraded":"2024-09-10T05:15:56.058318+0000","last_fullsized":"2024-09-10T05:15:56.058318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'39","last_scrub_stamp":"2024-09-10T05:15:56.058207+0000","last_deep_scrub":"37'39","last_deep_scrub_stamp":"2024-09-10T05:15:56.058207+0000","last_clean_scrub_stamp":"2024-09-10T05:15:56.058207+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:19.718465+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:04.094674+0000","last_change":"2024-09-10T05:16:04.094674+0000","last_active":"2024-09-10T05:16:04.094674+0000","last_peered":"2024-09-10T05:16:04.094674+0000","last_clean":"2024-09-10T05:16:04.094674+0000","last_became_active":"2024-09-10T05:11:35.753001+0000","last_became_peered":"2024-09-10T05:11:35.753001+0000","last_unstale":"2024-09-10T05:16:04.094674+0000","last_undegraded":"2024-09-10T05:16:04.094674+0000","last_fullsized":"2024-09-10T05:16:04.094674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:16:04.094577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:16:04.094577+0000","last_clean_scrub_stamp":"2024-09-10T05:16:04.094577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:27.246905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:36.480743+0000","last_change":"2024-09-10T05:11:37.767945+0000","last_active":"2024-09-10T05:14:36.480743+0000","last_peered":"2024-09-10T05:14:36.480743+0000","last_clean":"2024-09-10T05:14:36.480743+0000","last_became_active":"2024-09-10T05:11:37.767649+0000","last_became_peered":"2024-09-10T05:11:37.767649+0000","last_unstale":"2024-09-10T05:14:36.480743+0000","last_undegraded":"2024-09-10T05:14:36.480743+0000","last_fullsized":"2024-09-10T05:14:36.480743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:47.436935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.664923+0000","last_change":"2024-09-10T05:15:07.664923+0000","last_active":"2024-09-10T05:15:07.664923+0000","last_peered":"2024-09-10T05:15:07.664923+0000","last_clean":"2024-09-10T05:15:07.664923+0000","last_became_active":"2024-09-10T05:11:29.718689+0000","last_became_peered":"2024-09-10T05:11:29.718689+0000","last_unstale":"2024-09-10T05:15:07.664923+0000","last_undegraded":"2024-09-10T05:15:07.664923+0000","last_fullsized":"2024-09-10T05:15:07.664923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:07.664840+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:07.664840+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.664840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:53.882406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.493574+0000","last_change":"2024-09-10T05:14:57.493473+0000","last_active":"2024-09-10T05:14:57.493574+0000","last_peered":"2024-09-10T05:14:57.493574+0000","last_clean":"2024-09-10T05:14:57.493574+0000","last_became_active":"2024-09-10T05:11:27.716073+0000","last_became_peered":"2024-09-10T05:11:27.716073+0000","last_unstale":"2024-09-10T05:14:57.493574+0000","last_undegraded":"2024-09-10T05:14:57.493574+0000","last_fullsized":"2024-09-10T05:14:57.493574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:57.493360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:57.493360+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.493360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:16.549263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:25.285210+0000","last_change":"2024-09-10T05:15:25.285210+0000","last_active":"2024-09-10T05:15:25.285210+0000","last_peered":"2024-09-10T05:15:25.285210+0000","last_clean":"2024-09-10T05:15:25.285210+0000","last_became_active":"2024-09-10T05:11:31.735726+0000","last_became_peered":"2024-09-10T05:11:31.735726+0000","last_unstale":"2024-09-10T05:15:25.285210+0000","last_undegraded":"2024-09-10T05:15:25.285210+0000","last_fullsized":"2024-09-10T05:15:25.285210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:15:25.285128+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:15:25.285128+0000","last_clean_scrub_stamp":"2024-09-10T05:15:25.285128+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:58.121835+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'54","reported_seq":123,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:53.018352+0000","last_change":"2024-09-10T05:15:53.018352+0000","last_active":"2024-09-10T05:15:53.018352+0000","last_peered":"2024-09-10T05:15:53.018352+0000","last_clean":"2024-09-10T05:15:53.018352+0000","last_became_active":"2024-09-10T05:11:33.748120+0000","last_became_peered":"2024-09-10T05:11:33.748120+0000","last_unstale":"2024-09-10T05:15:53.018352+0000","last_undegraded":"2024-09-10T05:15:53.018352+0000","last_fullsized":"2024-09-10T05:15:53.018352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'54","last_scrub_stamp":"2024-09-10T05:15:53.018247+0000","last_deep_scrub":"37'54","last_deep_scrub_stamp":"2024-09-10T05:15:53.018247+0000","last_clean_scrub_stamp":"2024-09-10T05:15:53.018247+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:27.335125+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:40.613346+0000","last_change":"2024-09-10T05:15:40.613346+0000","last_active":"2024-09-10T05:15:40.613346+0000","last_peered":"2024-09-10T05:15:40.613346+0000","last_clean":"2024-09-10T05:15:40.613346+0000","last_became_active":"2024-09-10T05:11:35.753437+0000","last_became_peered":"2024-09-10T05:11:35.753437+0000","last_unstale":"2024-09-10T05:15:40.613346+0000","last_undegraded":"2024-09-10T05:15:40.613346+0000","last_fullsized":"2024-09-10T05:15:40.613346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:40.613217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:40.613217+0000","last_clean_scrub_stamp":"2024-09-10T05:15:40.613217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:40.765442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'10","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:13:34.285208+0000","last_change":"2024-09-10T05:11:37.765397+0000","last_active":"2024-09-10T05:13:34.285208+0000","last_peered":"2024-09-10T05:13:34.285208+0000","last_clean":"2024-09-10T05:13:34.285208+0000","last_became_active":"2024-09-10T05:11:37.765102+0000","last_became_peered":"2024-09-10T05:11:37.765102+0000","last_unstale":"2024-09-10T05:13:34.285208+0000","last_undegraded":"2024-09-10T05:13:34.285208+0000","last_fullsized":"2024-09-10T05:13:34.285208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:11:36.737079+0000","last_clean_scrub_stamp":"2024-09-10T05:11:36.737079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:41.297084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":67,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.375172+0000","last_change":"2024-09-10T05:15:08.375108+0000","last_active":"2024-09-10T05:15:08.375172+0000","last_peered":"2024-09-10T05:15:08.375172+0000","last_clean":"2024-09-10T05:15:08.375172+0000","last_became_active":"2024-09-10T05:11:29.729468+0000","last_became_peered":"2024-09-10T05:11:29.729468+0000","last_unstale":"2024-09-10T05:15:08.375172+0000","last_undegraded":"2024-09-10T05:15:08.375172+0000","last_fullsized":"2024-09-10T05:15:08.375172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:08.375011+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:08.375011+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.375011+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:38.702635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.709903+0000","last_change":"2024-09-10T05:14:54.709815+0000","last_active":"2024-09-10T05:14:54.709903+0000","last_peered":"2024-09-10T05:14:54.709903+0000","last_clean":"2024-09-10T05:14:54.709903+0000","last_became_active":"2024-09-10T05:11:27.706484+0000","last_became_peered":"2024-09-10T05:11:27.706484+0000","last_unstale":"2024-09-10T05:14:54.709903+0000","last_undegraded":"2024-09-10T05:14:54.709903+0000","last_fullsized":"2024-09-10T05:14:54.709903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:54.709723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:54.709723+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.709723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:58.926828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'12","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.590727+0000","last_change":"2024-09-10T05:15:08.590666+0000","last_active":"2024-09-10T05:15:08.590727+0000","last_peered":"2024-09-10T05:15:08.590727+0000","last_clean":"2024-09-10T05:15:08.590727+0000","last_became_active":"2024-09-10T05:11:29.729019+0000","last_became_peered":"2024-09-10T05:11:29.729019+0000","last_unstale":"2024-09-10T05:15:08.590727+0000","last_undegraded":"2024-09-10T05:15:08.590727+0000","last_fullsized":"2024-09-10T05:15:08.590727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-10T05:15:08.590592+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-10T05:15:08.590592+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.590592+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:11.806872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.491538+0000","last_change":"2024-09-10T05:14:52.491464+0000","last_active":"2024-09-10T05:14:52.491538+0000","last_peered":"2024-09-10T05:14:52.491538+0000","last_clean":"2024-09-10T05:14:52.491538+0000","last_became_active":"2024-09-10T05:11:27.714487+0000","last_became_peered":"2024-09-10T05:11:27.714487+0000","last_unstale":"2024-09-10T05:14:52.491538+0000","last_undegraded":"2024-09-10T05:14:52.491538+0000","last_fullsized":"2024-09-10T05:14:52.491538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:52.491377+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:52.491377+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.491377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:49.460874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'2","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:28.983544+0000","last_change":"2024-09-10T05:15:28.983488+0000","last_active":"2024-09-10T05:15:28.983544+0000","last_peered":"2024-09-10T05:15:28.983544+0000","last_clean":"2024-09-10T05:15:28.983544+0000","last_became_active":"2024-09-10T05:11:29.729359+0000","last_became_peered":"2024-09-10T05:11:29.729359+0000","last_unstale":"2024-09-10T05:15:28.983544+0000","last_undegraded":"2024-09-10T05:15:28.983544+0000","last_fullsized":"2024-09-10T05:15:28.983544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:28.983403+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:28.983403+0000","last_clean_scrub_stamp":"2024-09-10T05:15:28.983403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:30.534141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.978066+0000","last_change":"2024-09-10T05:15:05.978001+0000","last_active":"2024-09-10T05:15:05.978066+0000","last_peered":"2024-09-10T05:15:05.978066+0000","last_clean":"2024-09-10T05:15:05.978066+0000","last_became_active":"2024-09-10T05:11:27.730905+0000","last_became_peered":"2024-09-10T05:11:27.730905+0000","last_unstale":"2024-09-10T05:15:05.978066+0000","last_undegraded":"2024-09-10T05:15:05.978066+0000","last_fullsized":"2024-09-10T05:15:05.978066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:05.977914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:05.977914+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.977914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:59.732683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.630745+0000","last_change":"2024-09-10T05:15:09.630650+0000","last_active":"2024-09-10T05:15:09.630745+0000","last_peered":"2024-09-10T05:15:09.630745+0000","last_clean":"2024-09-10T05:15:09.630745+0000","last_became_active":"2024-09-10T05:11:29.727454+0000","last_became_peered":"2024-09-10T05:11:29.727454+0000","last_unstale":"2024-09-10T05:15:09.630745+0000","last_undegraded":"2024-09-10T05:15:09.630745+0000","last_fullsized":"2024-09-10T05:15:09.630745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:09.630545+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:09.630545+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.630545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:42.825841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.503693+0000","last_change":"2024-09-10T05:14:54.503637+0000","last_active":"2024-09-10T05:14:54.503693+0000","last_peered":"2024-09-10T05:14:54.503693+0000","last_clean":"2024-09-10T05:14:54.503693+0000","last_became_active":"2024-09-10T05:11:27.713962+0000","last_became_peered":"2024-09-10T05:11:27.713962+0000","last_unstale":"2024-09-10T05:14:54.503693+0000","last_undegraded":"2024-09-10T05:14:54.503693+0000","last_fullsized":"2024-09-10T05:14:54.503693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:54.503543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:54.503543+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.503543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:36.529415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'8","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.551836+0000","last_change":"2024-09-10T05:15:07.551762+0000","last_active":"2024-09-10T05:15:07.551836+0000","last_peered":"2024-09-10T05:15:07.551836+0000","last_clean":"2024-09-10T05:15:07.551836+0000","last_became_active":"2024-09-10T05:11:29.725099+0000","last_became_peered":"2024-09-10T05:11:29.725099+0000","last_unstale":"2024-09-10T05:15:07.551836+0000","last_undegraded":"2024-09-10T05:15:07.551836+0000","last_fullsized":"2024-09-10T05:15:07.551836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:07.551648+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:07.551648+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.551648+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:16.567800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.545656+0000","last_change":"2024-09-10T05:14:49.545597+0000","last_active":"2024-09-10T05:14:49.545656+0000","last_peered":"2024-09-10T05:14:49.545656+0000","last_clean":"2024-09-10T05:14:49.545656+0000","last_became_active":"2024-09-10T05:11:27.718926+0000","last_became_peered":"2024-09-10T05:11:27.718926+0000","last_unstale":"2024-09-10T05:14:49.545656+0000","last_undegraded":"2024-09-10T05:14:49.545656+0000","last_fullsized":"2024-09-10T05:14:49.545656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:49.545500+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:49.545500+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.545500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:57.641677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'8","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.398363+0000","last_change":"2024-09-10T05:15:07.398282+0000","last_active":"2024-09-10T05:15:07.398363+0000","last_peered":"2024-09-10T05:15:07.398363+0000","last_clean":"2024-09-10T05:15:07.398363+0000","last_became_active":"2024-09-10T05:12:04.964750+0000","last_became_peered":"2024-09-10T05:12:04.964750+0000","last_unstale":"2024-09-10T05:15:07.398363+0000","last_undegraded":"2024-09-10T05:15:07.398363+0000","last_fullsized":"2024-09-10T05:15:07.398363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:07.398168+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:07.398168+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.398168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:10.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.416280+0000","last_change":"2024-09-10T05:14:52.416193+0000","last_active":"2024-09-10T05:14:52.416280+0000","last_peered":"2024-09-10T05:14:52.416280+0000","last_clean":"2024-09-10T05:14:52.416280+0000","last_became_active":"2024-09-10T05:11:27.718282+0000","last_became_peered":"2024-09-10T05:11:27.718282+0000","last_unstale":"2024-09-10T05:14:52.416280+0000","last_undegraded":"2024-09-10T05:14:52.416280+0000","last_fullsized":"2024-09-10T05:14:52.416280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.416097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.416097+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.416097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:11.180415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:06.501458+0000","last_change":"2024-09-10T05:15:06.501364+0000","last_active":"2024-09-10T05:15:06.501458+0000","last_peered":"2024-09-10T05:15:06.501458+0000","last_clean":"2024-09-10T05:15:06.501458+0000","last_became_active":"2024-09-10T05:11:29.723387+0000","last_became_peered":"2024-09-10T05:11:29.723387+0000","last_unstale":"2024-09-10T05:15:06.501458+0000","last_undegraded":"2024-09-10T05:15:06.501458+0000","last_fullsized":"2024-09-10T05:15:06.501458+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:06.501241+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:06.501241+0000","last_clean_scrub_stamp":"2024-09-10T05:15:06.501241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:02.303540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.663887+0000","last_change":"2024-09-10T05:14:56.663822+0000","last_active":"2024-09-10T05:14:56.663887+0000","last_peered":"2024-09-10T05:14:56.663887+0000","last_clean":"2024-09-10T05:14:56.663887+0000","last_became_active":"2024-09-10T05:11:27.724815+0000","last_became_peered":"2024-09-10T05:11:27.724815+0000","last_unstale":"2024-09-10T05:14:56.663887+0000","last_undegraded":"2024-09-10T05:14:56.663887+0000","last_fullsized":"2024-09-10T05:14:56.663887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:14:56.663737+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.663737+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.663737+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:18.281662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.394144+0000","last_change":"2024-09-10T05:15:05.394073+0000","last_active":"2024-09-10T05:15:05.394144+0000","last_peered":"2024-09-10T05:15:05.394144+0000","last_clean":"2024-09-10T05:15:05.394144+0000","last_became_active":"2024-09-10T05:11:29.723469+0000","last_became_peered":"2024-09-10T05:11:29.723469+0000","last_unstale":"2024-09-10T05:15:05.394144+0000","last_undegraded":"2024-09-10T05:15:05.394144+0000","last_fullsized":"2024-09-10T05:15:05.394144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-10T05:15:05.393954+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-10T05:15:05.393954+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.393954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:38:36.032466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.489228+0000","last_change":"2024-09-10T05:14:55.489090+0000","last_active":"2024-09-10T05:14:55.489228+0000","last_peered":"2024-09-10T05:14:55.489228+0000","last_clean":"2024-09-10T05:14:55.489228+0000","last_became_active":"2024-09-10T05:11:27.714348+0000","last_became_peered":"2024-09-10T05:11:27.714348+0000","last_unstale":"2024-09-10T05:14:55.489228+0000","last_undegraded":"2024-09-10T05:14:55.489228+0000","last_fullsized":"2024-09-10T05:14:55.489228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:55.488990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:55.488990+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.488990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:10.435358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'8","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.268130+0000","last_change":"2024-09-10T05:15:13.268130+0000","last_active":"2024-09-10T05:15:13.268130+0000","last_peered":"2024-09-10T05:15:13.268130+0000","last_clean":"2024-09-10T05:15:13.268130+0000","last_became_active":"2024-09-10T05:11:29.729148+0000","last_became_peered":"2024-09-10T05:11:29.729148+0000","last_unstale":"2024-09-10T05:15:13.268130+0000","last_undegraded":"2024-09-10T05:15:13.268130+0000","last_fullsized":"2024-09-10T05:15:13.268130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:13.268020+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:13.268020+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.268020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:00.698029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.019975+0000","last_change":"2024-09-10T05:15:07.019917+0000","last_active":"2024-09-10T05:15:07.019975+0000","last_peered":"2024-09-10T05:15:07.019975+0000","last_clean":"2024-09-10T05:15:07.019975+0000","last_became_active":"2024-09-10T05:11:27.735159+0000","last_became_peered":"2024-09-10T05:11:27.735159+0000","last_unstale":"2024-09-10T05:15:07.019975+0000","last_undegraded":"2024-09-10T05:15:07.019975+0000","last_fullsized":"2024-09-10T05:15:07.019975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:07.019834+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:07.019834+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.019834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:09.595861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'12","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:29.936528+0000","last_change":"2024-09-10T05:15:29.936528+0000","last_active":"2024-09-10T05:15:29.936528+0000","last_peered":"2024-09-10T05:15:29.936528+0000","last_clean":"2024-09-10T05:15:29.936528+0000","last_became_active":"2024-09-10T05:11:29.729476+0000","last_became_peered":"2024-09-10T05:11:29.729476+0000","last_unstale":"2024-09-10T05:15:29.936528+0000","last_undegraded":"2024-09-10T05:15:29.936528+0000","last_fullsized":"2024-09-10T05:15:29.936528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-10T05:15:29.936445+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-10T05:15:29.936445+0000","last_clean_scrub_stamp":"2024-09-10T05:15:29.936445+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:39:28.532827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.511923+0000","last_change":"2024-09-10T05:14:57.511867+0000","last_active":"2024-09-10T05:14:57.511923+0000","last_peered":"2024-09-10T05:14:57.511923+0000","last_clean":"2024-09-10T05:14:57.511923+0000","last_became_active":"2024-09-10T05:11:27.715014+0000","last_became_peered":"2024-09-10T05:11:27.715014+0000","last_unstale":"2024-09-10T05:14:57.511923+0000","last_undegraded":"2024-09-10T05:14:57.511923+0000","last_fullsized":"2024-09-10T05:14:57.511923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:57.511763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:57.511763+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.511763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:55.932537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.690164+0000","last_change":"2024-09-10T05:15:13.690109+0000","last_active":"2024-09-10T05:15:13.690164+0000","last_peered":"2024-09-10T05:15:13.690164+0000","last_clean":"2024-09-10T05:15:13.690164+0000","last_became_active":"2024-09-10T05:11:29.725047+0000","last_became_peered":"2024-09-10T05:11:29.725047+0000","last_unstale":"2024-09-10T05:15:13.690164+0000","last_undegraded":"2024-09-10T05:15:13.690164+0000","last_fullsized":"2024-09-10T05:15:13.690164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:13.690031+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:13.690031+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.690031+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:40.863292+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.482294+0000","last_change":"2024-09-10T05:14:54.482237+0000","last_active":"2024-09-10T05:14:54.482294+0000","last_peered":"2024-09-10T05:14:54.482294+0000","last_clean":"2024-09-10T05:14:54.482294+0000","last_became_active":"2024-09-10T05:11:27.728257+0000","last_became_peered":"2024-09-10T05:11:27.728257+0000","last_unstale":"2024-09-10T05:14:54.482294+0000","last_undegraded":"2024-09-10T05:14:54.482294+0000","last_fullsized":"2024-09-10T05:14:54.482294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:54.482153+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:54.482153+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.482153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:10.009942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.314773+0000","last_change":"2024-09-10T05:15:12.314698+0000","last_active":"2024-09-10T05:15:12.314773+0000","last_peered":"2024-09-10T05:15:12.314773+0000","last_clean":"2024-09-10T05:15:12.314773+0000","last_became_active":"2024-09-10T05:11:29.721826+0000","last_became_peered":"2024-09-10T05:11:29.721826+0000","last_unstale":"2024-09-10T05:15:12.314773+0000","last_undegraded":"2024-09-10T05:15:12.314773+0000","last_fullsized":"2024-09-10T05:15:12.314773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:15:12.314615+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:15:12.314615+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.314615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:25:54.503608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.515528+0000","last_change":"2024-09-10T05:14:56.515429+0000","last_active":"2024-09-10T05:14:56.515528+0000","last_peered":"2024-09-10T05:14:56.515528+0000","last_clean":"2024-09-10T05:14:56.515528+0000","last_became_active":"2024-09-10T05:11:27.730469+0000","last_became_peered":"2024-09-10T05:11:27.730469+0000","last_unstale":"2024-09-10T05:14:56.515528+0000","last_undegraded":"2024-09-10T05:14:56.515528+0000","last_fullsized":"2024-09-10T05:14:56.515528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:14:56.515326+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.515326+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.515326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:20.046107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'18","reported_seq":90,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.343052+0000","last_change":"2024-09-10T05:15:11.342989+0000","last_active":"2024-09-10T05:15:11.343052+0000","last_peered":"2024-09-10T05:15:11.343052+0000","last_clean":"2024-09-10T05:15:11.343052+0000","last_became_active":"2024-09-10T05:12:04.965056+0000","last_became_peered":"2024-09-10T05:12:04.965056+0000","last_unstale":"2024-09-10T05:15:11.343052+0000","last_undegraded":"2024-09-10T05:15:11.343052+0000","last_fullsized":"2024-09-10T05:15:11.343052+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-10T05:15:11.342907+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-10T05:15:11.342907+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.342907+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:55.366767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.012410+0000","last_change":"2024-09-10T05:15:08.012305+0000","last_active":"2024-09-10T05:15:08.012410+0000","last_peered":"2024-09-10T05:15:08.012410+0000","last_clean":"2024-09-10T05:15:08.012410+0000","last_became_active":"2024-09-10T05:11:27.722079+0000","last_became_peered":"2024-09-10T05:11:27.722079+0000","last_unstale":"2024-09-10T05:15:08.012410+0000","last_undegraded":"2024-09-10T05:15:08.012410+0000","last_fullsized":"2024-09-10T05:15:08.012410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:08.012205+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:08.012205+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.012205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:47.103635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'16","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.323742+0000","last_change":"2024-09-10T05:15:10.323651+0000","last_active":"2024-09-10T05:15:10.323742+0000","last_peered":"2024-09-10T05:15:10.323742+0000","last_clean":"2024-09-10T05:15:10.323742+0000","last_became_active":"2024-09-10T05:11:29.733895+0000","last_became_peered":"2024-09-10T05:11:29.733895+0000","last_unstale":"2024-09-10T05:15:10.323742+0000","last_undegraded":"2024-09-10T05:15:10.323742+0000","last_fullsized":"2024-09-10T05:15:10.323742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:10.323533+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:10.323533+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.323533+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:55.632072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.024855+0000","last_change":"2024-09-10T05:15:09.024782+0000","last_active":"2024-09-10T05:15:09.024855+0000","last_peered":"2024-09-10T05:15:09.024855+0000","last_clean":"2024-09-10T05:15:09.024855+0000","last_became_active":"2024-09-10T05:11:27.735801+0000","last_became_peered":"2024-09-10T05:11:27.735801+0000","last_unstale":"2024-09-10T05:15:09.024855+0000","last_undegraded":"2024-09-10T05:15:09.024855+0000","last_fullsized":"2024-09-10T05:15:09.024855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:15:09.024688+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:15:09.024688+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.024688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:45.203541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'8","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.965628+0000","last_change":"2024-09-10T05:15:27.965572+0000","last_active":"2024-09-10T05:15:27.965628+0000","last_peered":"2024-09-10T05:15:27.965628+0000","last_clean":"2024-09-10T05:15:27.965628+0000","last_became_active":"2024-09-10T05:11:29.735555+0000","last_became_peered":"2024-09-10T05:11:29.735555+0000","last_unstale":"2024-09-10T05:15:27.965628+0000","last_undegraded":"2024-09-10T05:15:27.965628+0000","last_fullsized":"2024-09-10T05:15:27.965628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:27.965487+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:27.965487+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.965487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:21.675276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.675684+0000","last_change":"2024-09-10T05:14:59.675684+0000","last_active":"2024-09-10T05:14:59.675684+0000","last_peered":"2024-09-10T05:14:59.675684+0000","last_clean":"2024-09-10T05:14:59.675684+0000","last_became_active":"2024-09-10T05:11:27.723820+0000","last_became_peered":"2024-09-10T05:11:27.723820+0000","last_unstale":"2024-09-10T05:14:59.675684+0000","last_undegraded":"2024-09-10T05:14:59.675684+0000","last_fullsized":"2024-09-10T05:14:59.675684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:59.675555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:59.675555+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.675555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:06.058468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.371745+0000","last_change":"2024-09-10T05:15:09.371665+0000","last_active":"2024-09-10T05:15:09.371745+0000","last_peered":"2024-09-10T05:15:09.371745+0000","last_clean":"2024-09-10T05:15:09.371745+0000","last_became_active":"2024-09-10T05:11:29.723816+0000","last_became_peered":"2024-09-10T05:11:29.723816+0000","last_unstale":"2024-09-10T05:15:09.371745+0000","last_undegraded":"2024-09-10T05:15:09.371745+0000","last_fullsized":"2024-09-10T05:15:09.371745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:09.371549+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:09.371549+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.371549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:50.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.054715+0000","last_change":"2024-09-10T05:15:11.054715+0000","last_active":"2024-09-10T05:15:11.054715+0000","last_peered":"2024-09-10T05:15:11.054715+0000","last_clean":"2024-09-10T05:15:11.054715+0000","last_became_active":"2024-09-10T05:11:27.736370+0000","last_became_peered":"2024-09-10T05:11:27.736370+0000","last_unstale":"2024-09-10T05:15:11.054715+0000","last_undegraded":"2024-09-10T05:15:11.054715+0000","last_fullsized":"2024-09-10T05:15:11.054715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:11.054610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:11.054610+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.054610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:14.341859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.066856+0000","last_change":"2024-09-10T05:15:10.066856+0000","last_active":"2024-09-10T05:15:10.066856+0000","last_peered":"2024-09-10T05:15:10.066856+0000","last_clean":"2024-09-10T05:15:10.066856+0000","last_became_active":"2024-09-10T05:11:27.731202+0000","last_became_peered":"2024-09-10T05:11:27.731202+0000","last_unstale":"2024-09-10T05:15:10.066856+0000","last_undegraded":"2024-09-10T05:15:10.066856+0000","last_fullsized":"2024-09-10T05:15:10.066856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:10.066744+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:10.066744+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.066744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:52.986117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.611484+0000","last_change":"2024-09-10T05:15:11.611484+0000","last_active":"2024-09-10T05:15:11.611484+0000","last_peered":"2024-09-10T05:15:11.611484+0000","last_clean":"2024-09-10T05:15:11.611484+0000","last_became_active":"2024-09-10T05:11:29.723467+0000","last_became_peered":"2024-09-10T05:11:29.723467+0000","last_unstale":"2024-09-10T05:15:11.611484+0000","last_undegraded":"2024-09-10T05:15:11.611484+0000","last_fullsized":"2024-09-10T05:15:11.611484+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:11.611402+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:11.611402+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.611402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:40.804159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.480235+0000","last_change":"2024-09-10T05:14:58.480235+0000","last_active":"2024-09-10T05:14:58.480235+0000","last_peered":"2024-09-10T05:14:58.480235+0000","last_clean":"2024-09-10T05:14:58.480235+0000","last_became_active":"2024-09-10T05:11:27.713659+0000","last_became_peered":"2024-09-10T05:11:27.713659+0000","last_unstale":"2024-09-10T05:14:58.480235+0000","last_undegraded":"2024-09-10T05:14:58.480235+0000","last_fullsized":"2024-09-10T05:14:58.480235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.480141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.480141+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.480141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:58.809531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'10","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.277001+0000","last_change":"2024-09-10T05:15:19.277001+0000","last_active":"2024-09-10T05:15:19.277001+0000","last_peered":"2024-09-10T05:15:19.277001+0000","last_clean":"2024-09-10T05:15:19.277001+0000","last_became_active":"2024-09-10T05:12:04.964552+0000","last_became_peered":"2024-09-10T05:12:04.964552+0000","last_unstale":"2024-09-10T05:15:19.277001+0000","last_undegraded":"2024-09-10T05:15:19.277001+0000","last_fullsized":"2024-09-10T05:15:19.277001+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:15:19.276901+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:15:19.276901+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.276901+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:58.105940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1787,"ondisk_log_size":1787,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640318,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":160879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640319,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":749393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640319,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40540,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331300,"statfs":{"total":96636764160,"available":96595251200,"internally_reserved":0,"allocated":1060864,"data_stored":750309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44128,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327712,"statfs":{"total":96636764160,"available":96591577088,"internally_reserved":0,"allocated":475136,"data_stored":160447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:16:09.004 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:16:09.005 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:16:09.005 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:16:09.006 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:16:09.006 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:16:09.006 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:16:09.006 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:16:09.006 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:16:09.007 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T05:11:36.737079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=11, tm_sec=36, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=14, tm_sec=44, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:16:09.007 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T05:16:29.008 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:16:29.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.117+0000 7f5874ac8640 1 Processor -- start 2024-09-10T05:16:29.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.117+0000 7f5874ac8640 1 -- start start 2024-09-10T05:16:29.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.118+0000 7f5874ac8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5870112110 0x7f5870130b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:16:29.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.118+0000 7f5874ac8640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5870112810 con 0x7f5870111620 2024-09-10T05:16:29.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.118+0000 7f5874ac8640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f5870073a70 con 0x7f5870112110 2024-09-10T05:16:29.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.118+0000 7f586dd9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5870112110 0x7f5870130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:16:29.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.118+0000 7f586e59c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f5870111620 0x7f5870111a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38878/0 (socket says 172.21.15.139:38878) 2024-09-10T05:16:29.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.118+0000 7f586dd9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5870112110 0x7f5870130b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40848/0 (socket says 172.21.15.139:40848) 2024-09-10T05:16:29.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.118+0000 7f586e59c640 1 -- 172.21.15.139:0/719156247 learned_addr learned my addr 172.21.15.139:0/719156247 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:16:29.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.118+0000 7f586dd9b640 1 -- 172.21.15.139:0/719156247 >> v1:172.21.15.139:6789/0 conn(0x7f5870111620 legacy=0x7f5870111a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:16:29.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.118+0000 7f586dd9b640 1 -- 172.21.15.139:0/719156247 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5870113340 con 0x7f5870112110 2024-09-10T05:16:29.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.118+0000 7f586d59a640 1 -- 172.21.15.139:0/719156247 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24087803 0 0) 0x7f5870112810 con 0x7f5870111620 2024-09-10T05:16:29.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.119+0000 7f586dd9b640 1 --2- 172.21.15.139:0/719156247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5870112110 0x7f5870130b80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f586400a8c0 tx=0x7f586402b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce14263f6168f0bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:16:29.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.119+0000 7f586d59a640 1 -- 172.21.15.139:0/719156247 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f586400b040 con 0x7f5870112110 2024-09-10T05:16:29.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.119+0000 7f586d59a640 1 -- 172.21.15.139:0/719156247 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5864030640 con 0x7f5870112110 2024-09-10T05:16:29.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.119+0000 7f586d59a640 1 -- 172.21.15.139:0/719156247 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5864030940 con 0x7f5870112110 2024-09-10T05:16:29.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.119+0000 7f5874ac8640 1 -- 172.21.15.139:0/719156247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5870112110 msgr2=0x7f5870130b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:16:29.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.119+0000 7f5874ac8640 1 --2- 172.21.15.139:0/719156247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5870112110 0x7f5870130b80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f586400a8c0 tx=0x7f586402b4d0 comp rx=0 tx=0).stop 2024-09-10T05:16:29.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.119+0000 7f5874ac8640 1 -- 172.21.15.139:0/719156247 shutdown_connections 2024-09-10T05:16:29.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.119+0000 7f5874ac8640 1 --2- 172.21.15.139:0/719156247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5870112110 0x7f5870130b80 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:16:29.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.119+0000 7f5874ac8640 1 -- 172.21.15.139:0/719156247 >> 172.21.15.139:0/719156247 conn(0x7f5870070850 msgr2=0x7f5870072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:16:29.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.119+0000 7f5874ac8640 1 -- 172.21.15.139:0/719156247 shutdown_connections 2024-09-10T05:16:29.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.120+0000 7f5874ac8640 1 -- 172.21.15.139:0/719156247 wait complete. 2024-09-10T05:16:29.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.120+0000 7f5874ac8640 1 Processor -- start 2024-09-10T05:16:29.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.121+0000 7f5874ac8640 1 -- start start 2024-09-10T05:16:29.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.121+0000 7f5874ac8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5870111620 0x7f58701c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:16:29.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.121+0000 7f5874ac8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5870111120 con 0x7f5870111620 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.121+0000 7f586e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5870111620 0x7f58701c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.121+0000 7f586e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5870111620 0x7f58701c3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40852/0 (socket says 172.21.15.139:40852) 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.121+0000 7f586e59c640 1 -- 172.21.15.139:0/2029327568 learned_addr learned my addr 172.21.15.139:0/2029327568 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.121+0000 7f586e59c640 1 -- 172.21.15.139:0/2029327568 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58701155f0 con 0x7f5870111620 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.121+0000 7f586e59c640 1 --2- 172.21.15.139:0/2029327568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5870111620 0x7f58701c3c00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f586000c3d0 tx=0x7f586000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.122+0000 7f585effd640 1 -- 172.21.15.139:0/2029327568 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58600074d0 con 0x7f5870111620 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.122+0000 7f585effd640 1 -- 172.21.15.139:0/2029327568 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58600047e0 con 0x7f5870111620 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.122+0000 7f5874ac8640 1 -- 172.21.15.139:0/2029327568 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587011a0e0 con 0x7f5870111620 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.122+0000 7f585effd640 1 -- 172.21.15.139:0/2029327568 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5860007670 con 0x7f5870111620 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.122+0000 7f5874ac8640 1 -- 172.21.15.139:0/2029327568 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58701c4320 con 0x7f5870111620 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.123+0000 7f5874ac8640 1 -- 172.21.15.139:0/2029327568 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5870111a00 con 0x7f5870111620 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.123+0000 7f585effd640 1 -- 172.21.15.139:0/2029327568 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7f5860011070 con 0x7f5870111620 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.123+0000 7f585effd640 1 --2- 172.21.15.139:0/2029327568 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f585003dee0 0x7f58500403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:16:29.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.123+0000 7f585effd640 1 -- 172.21.15.139:0/2029327568 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f58600529b0 con 0x7f5870111620 2024-09-10T05:16:29.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.124+0000 7f586dd9b640 1 --2- 172.21.15.139:0/2029327568 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f585003dee0 0x7f58500403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:16:29.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.124+0000 7f586dd9b640 1 --2- 172.21.15.139:0/2029327568 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f585003dee0 0x7f58500403a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5864035000 tx=0x7f5864030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:16:29.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.127+0000 7f585effd640 1 -- 172.21.15.139:0/2029327568 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7f5860012dd0 con 0x7f5870111620 2024-09-10T05:16:29.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.298+0000 7f5874ac8640 1 -- 172.21.15.139:0/2029327568 --> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5870125cf0 con 0x7f585003dee0 2024-09-10T05:16:29.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.308+0000 7f585effd640 1 -- 172.21.15.139:0/2029327568 <== mgr.4098 v2:172.21.15.192:6824/1421803816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666192 (secure 0 0 0) 0x7f5870125cf0 con 0x7f585003dee0 2024-09-10T05:16:29.316 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-10T05:16:29.321 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-09-10T05:16:29.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.313+0000 7f5874ac8640 1 -- 172.21.15.139:0/2029327568 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f585003dee0 msgr2=0x7f58500403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:16:29.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.313+0000 7f5874ac8640 1 --2- 172.21.15.139:0/2029327568 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f585003dee0 0x7f58500403a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5864035000 tx=0x7f5864030000 comp rx=0 tx=0).stop 2024-09-10T05:16:29.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.313+0000 7f5874ac8640 1 -- 172.21.15.139:0/2029327568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5870111620 msgr2=0x7f58701c3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:16:29.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.313+0000 7f5874ac8640 1 --2- 172.21.15.139:0/2029327568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5870111620 0x7f58701c3c00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f586000c3d0 tx=0x7f586000c890 comp rx=0 tx=0).stop 2024-09-10T05:16:29.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.313+0000 7f5874ac8640 1 -- 172.21.15.139:0/2029327568 shutdown_connections 2024-09-10T05:16:29.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.313+0000 7f5874ac8640 1 --2- 172.21.15.139:0/2029327568 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7f585003dee0 0x7f58500403a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:16:29.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.313+0000 7f5874ac8640 1 --2- 172.21.15.139:0/2029327568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5870111620 0x7f58701c3c00 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:16:29.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.313+0000 7f5874ac8640 1 -- 172.21.15.139:0/2029327568 >> 172.21.15.139:0/2029327568 conn(0x7f5870070850 msgr2=0x7f5870127f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:16:29.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.313+0000 7f5874ac8640 1 -- 172.21.15.139:0/2029327568 shutdown_connections 2024-09-10T05:16:29.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.313+0000 7f5874ac8640 1 -- 172.21.15.139:0/2029327568 wait complete. 2024-09-10T05:16:29.328 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-10T05:16:27.974219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5433,"num_read_kb":4987,"num_write":2313,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5014,"ondisk_log_size":5014,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165184,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322176,"statfs":{"total":386547056640,"available":386377908224,"internally_reserved":0,"allocated":3080192,"data_stored":1821028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004055"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.686266+0000","last_change":"2024-09-10T05:15:00.686212+0000","last_active":"2024-09-10T05:15:00.686266+0000","last_peered":"2024-09-10T05:15:00.686266+0000","last_clean":"2024-09-10T05:15:00.686266+0000","last_became_active":"2024-09-10T05:11:27.716775+0000","last_became_peered":"2024-09-10T05:11:27.716775+0000","last_unstale":"2024-09-10T05:15:00.686266+0000","last_undegraded":"2024-09-10T05:15:00.686266+0000","last_fullsized":"2024-09-10T05:15:00.686266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:00.686129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:00.686129+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.686129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:33.852215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.239534+0000","last_change":"2024-09-10T05:15:18.239534+0000","last_active":"2024-09-10T05:15:18.239534+0000","last_peered":"2024-09-10T05:15:18.239534+0000","last_clean":"2024-09-10T05:15:18.239534+0000","last_became_active":"2024-09-10T05:11:29.733565+0000","last_became_peered":"2024-09-10T05:11:29.733565+0000","last_unstale":"2024-09-10T05:15:18.239534+0000","last_undegraded":"2024-09-10T05:15:18.239534+0000","last_fullsized":"2024-09-10T05:15:18.239534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:18.239427+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:18.239427+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.239427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:47.176915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.473256+0000","last_change":"2024-09-10T05:15:00.473123+0000","last_active":"2024-09-10T05:15:00.473256+0000","last_peered":"2024-09-10T05:15:00.473256+0000","last_clean":"2024-09-10T05:15:00.473256+0000","last_became_active":"2024-09-10T05:11:27.713698+0000","last_became_peered":"2024-09-10T05:11:27.713698+0000","last_unstale":"2024-09-10T05:15:00.473256+0000","last_undegraded":"2024-09-10T05:15:00.473256+0000","last_fullsized":"2024-09-10T05:15:00.473256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:00.473021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:00.473021+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.473021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:20.018847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'10","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:31.924354+0000","last_change":"2024-09-10T05:15:31.924354+0000","last_active":"2024-09-10T05:15:31.924354+0000","last_peered":"2024-09-10T05:15:31.924354+0000","last_clean":"2024-09-10T05:15:31.924354+0000","last_became_active":"2024-09-10T05:11:29.728621+0000","last_became_peered":"2024-09-10T05:11:29.728621+0000","last_unstale":"2024-09-10T05:15:31.924354+0000","last_undegraded":"2024-09-10T05:15:31.924354+0000","last_fullsized":"2024-09-10T05:15:31.924354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:15:31.924269+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:15:31.924269+0000","last_clean_scrub_stamp":"2024-09-10T05:15:31.924269+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:41.446801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.073847+0000","last_change":"2024-09-10T05:15:15.073781+0000","last_active":"2024-09-10T05:15:15.073847+0000","last_peered":"2024-09-10T05:15:15.073847+0000","last_clean":"2024-09-10T05:15:15.073847+0000","last_became_active":"2024-09-10T05:11:27.733147+0000","last_became_peered":"2024-09-10T05:11:27.733147+0000","last_unstale":"2024-09-10T05:15:15.073847+0000","last_undegraded":"2024-09-10T05:15:15.073847+0000","last_fullsized":"2024-09-10T05:15:15.073847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:15.073683+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:15.073683+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.073683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:55.579728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:32.960484+0000","last_change":"2024-09-10T05:15:32.960484+0000","last_active":"2024-09-10T05:15:32.960484+0000","last_peered":"2024-09-10T05:15:32.960484+0000","last_clean":"2024-09-10T05:15:32.960484+0000","last_became_active":"2024-09-10T05:11:29.728696+0000","last_became_peered":"2024-09-10T05:11:29.728696+0000","last_unstale":"2024-09-10T05:15:32.960484+0000","last_undegraded":"2024-09-10T05:15:32.960484+0000","last_fullsized":"2024-09-10T05:15:32.960484+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:32.960388+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:32.960388+0000","last_clean_scrub_stamp":"2024-09-10T05:15:32.960388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:36.297564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.676875+0000","last_change":"2024-09-10T05:14:58.676818+0000","last_active":"2024-09-10T05:14:58.676875+0000","last_peered":"2024-09-10T05:14:58.676875+0000","last_clean":"2024-09-10T05:14:58.676875+0000","last_became_active":"2024-09-10T05:11:27.722701+0000","last_became_peered":"2024-09-10T05:11:27.722701+0000","last_unstale":"2024-09-10T05:14:58.676875+0000","last_undegraded":"2024-09-10T05:14:58.676875+0000","last_fullsized":"2024-09-10T05:14:58.676875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.676697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.676697+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.676697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:08.137298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'22","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.003330+0000","last_change":"2024-09-10T05:15:34.003330+0000","last_active":"2024-09-10T05:15:34.003330+0000","last_peered":"2024-09-10T05:15:34.003330+0000","last_clean":"2024-09-10T05:15:34.003330+0000","last_became_active":"2024-09-10T05:11:29.731850+0000","last_became_peered":"2024-09-10T05:11:29.731850+0000","last_unstale":"2024-09-10T05:15:34.003330+0000","last_undegraded":"2024-09-10T05:15:34.003330+0000","last_fullsized":"2024-09-10T05:15:34.003330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-10T05:15:34.003213+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-10T05:15:34.003213+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.003213+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:18.186667+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.056519+0000","last_change":"2024-09-10T05:15:14.056519+0000","last_active":"2024-09-10T05:15:14.056519+0000","last_peered":"2024-09-10T05:15:14.056519+0000","last_clean":"2024-09-10T05:15:14.056519+0000","last_became_active":"2024-09-10T05:11:27.732922+0000","last_became_peered":"2024-09-10T05:11:27.732922+0000","last_unstale":"2024-09-10T05:15:14.056519+0000","last_undegraded":"2024-09-10T05:15:14.056519+0000","last_fullsized":"2024-09-10T05:15:14.056519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:14.056436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:14.056436+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.056436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:49.245406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.288006+0000","last_change":"2024-09-10T05:15:16.287941+0000","last_active":"2024-09-10T05:15:16.288006+0000","last_peered":"2024-09-10T05:15:16.288006+0000","last_clean":"2024-09-10T05:15:16.288006+0000","last_became_active":"2024-09-10T05:11:29.722189+0000","last_became_peered":"2024-09-10T05:11:29.722189+0000","last_unstale":"2024-09-10T05:15:16.288006+0000","last_undegraded":"2024-09-10T05:15:16.288006+0000","last_fullsized":"2024-09-10T05:15:16.288006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:16.287854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:16.287854+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.287854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.329858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.707592+0000","last_change":"2024-09-10T05:14:57.707592+0000","last_active":"2024-09-10T05:14:57.707592+0000","last_peered":"2024-09-10T05:14:57.707592+0000","last_clean":"2024-09-10T05:14:57.707592+0000","last_became_active":"2024-09-10T05:11:27.706559+0000","last_became_peered":"2024-09-10T05:11:27.706559+0000","last_unstale":"2024-09-10T05:14:57.707592+0000","last_undegraded":"2024-09-10T05:14:57.707592+0000","last_fullsized":"2024-09-10T05:14:57.707592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:57.707507+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:57.707507+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.707507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:37.363037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:35.953580+0000","last_change":"2024-09-10T05:15:35.953519+0000","last_active":"2024-09-10T05:15:35.953580+0000","last_peered":"2024-09-10T05:15:35.953580+0000","last_clean":"2024-09-10T05:15:35.953580+0000","last_became_active":"2024-09-10T05:11:29.730492+0000","last_became_peered":"2024-09-10T05:11:29.730492+0000","last_unstale":"2024-09-10T05:15:35.953580+0000","last_undegraded":"2024-09-10T05:15:35.953580+0000","last_fullsized":"2024-09-10T05:15:35.953580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:35.953428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:35.953428+0000","last_clean_scrub_stamp":"2024-09-10T05:15:35.953428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:26.676535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.012797+0000","last_change":"2024-09-10T05:15:13.012797+0000","last_active":"2024-09-10T05:15:13.012797+0000","last_peered":"2024-09-10T05:15:13.012797+0000","last_clean":"2024-09-10T05:15:13.012797+0000","last_became_active":"2024-09-10T05:11:27.718363+0000","last_became_peered":"2024-09-10T05:11:27.718363+0000","last_unstale":"2024-09-10T05:15:13.012797+0000","last_undegraded":"2024-09-10T05:15:13.012797+0000","last_fullsized":"2024-09-10T05:15:13.012797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:13.012701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:13.012701+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.012701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:59.217408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.740078+0000","last_change":"2024-09-10T05:15:13.739994+0000","last_active":"2024-09-10T05:15:13.740078+0000","last_peered":"2024-09-10T05:15:13.740078+0000","last_clean":"2024-09-10T05:15:13.740078+0000","last_became_active":"2024-09-10T05:11:29.726884+0000","last_became_peered":"2024-09-10T05:11:29.726884+0000","last_unstale":"2024-09-10T05:15:13.740078+0000","last_undegraded":"2024-09-10T05:15:13.740078+0000","last_fullsized":"2024-09-10T05:15:13.740078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:13.739888+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:13.739888+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.739888+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:29.267677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.496721+0000","last_change":"2024-09-10T05:14:59.496721+0000","last_active":"2024-09-10T05:14:59.496721+0000","last_peered":"2024-09-10T05:14:59.496721+0000","last_clean":"2024-09-10T05:14:59.496721+0000","last_became_active":"2024-09-10T05:11:27.718868+0000","last_became_peered":"2024-09-10T05:11:27.718868+0000","last_unstale":"2024-09-10T05:14:59.496721+0000","last_undegraded":"2024-09-10T05:14:59.496721+0000","last_fullsized":"2024-09-10T05:14:59.496721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:59.496621+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:59.496621+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.496621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:59.831011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.726027+0000","last_change":"2024-09-10T05:15:11.725923+0000","last_active":"2024-09-10T05:15:11.726027+0000","last_peered":"2024-09-10T05:15:11.726027+0000","last_clean":"2024-09-10T05:15:11.726027+0000","last_became_active":"2024-09-10T05:11:29.723497+0000","last_became_peered":"2024-09-10T05:11:29.723497+0000","last_unstale":"2024-09-10T05:15:11.726027+0000","last_undegraded":"2024-09-10T05:15:11.726027+0000","last_fullsized":"2024-09-10T05:15:11.726027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:11.725827+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:11.725827+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.725827+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:27.991023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:30.951982+0000","last_change":"2024-09-10T05:15:30.951922+0000","last_active":"2024-09-10T05:15:30.951982+0000","last_peered":"2024-09-10T05:15:30.951982+0000","last_clean":"2024-09-10T05:15:30.951982+0000","last_became_active":"2024-09-10T05:11:29.727536+0000","last_became_peered":"2024-09-10T05:11:29.727536+0000","last_unstale":"2024-09-10T05:15:30.951982+0000","last_undegraded":"2024-09-10T05:15:30.951982+0000","last_fullsized":"2024-09-10T05:15:30.951982+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:30.951821+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:30.951821+0000","last_clean_scrub_stamp":"2024-09-10T05:15:30.951821+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:46.376233+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.476749+0000","last_change":"2024-09-10T05:14:59.476686+0000","last_active":"2024-09-10T05:14:59.476749+0000","last_peered":"2024-09-10T05:14:59.476749+0000","last_clean":"2024-09-10T05:14:59.476749+0000","last_became_active":"2024-09-10T05:11:27.728114+0000","last_became_peered":"2024-09-10T05:11:27.728114+0000","last_unstale":"2024-09-10T05:14:59.476749+0000","last_undegraded":"2024-09-10T05:14:59.476749+0000","last_fullsized":"2024-09-10T05:14:59.476749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:59.476601+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:59.476601+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.476601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:04.416444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.248032+0000","last_change":"2024-09-10T05:15:14.247977+0000","last_active":"2024-09-10T05:15:14.248032+0000","last_peered":"2024-09-10T05:15:14.248032+0000","last_clean":"2024-09-10T05:15:14.248032+0000","last_became_active":"2024-09-10T05:11:29.732864+0000","last_became_peered":"2024-09-10T05:11:29.732864+0000","last_unstale":"2024-09-10T05:15:14.248032+0000","last_undegraded":"2024-09-10T05:15:14.248032+0000","last_fullsized":"2024-09-10T05:15:14.248032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:14.247889+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:14.247889+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.247889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:06.302257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.646041+0000","last_change":"2024-09-10T05:15:02.645979+0000","last_active":"2024-09-10T05:15:02.646041+0000","last_peered":"2024-09-10T05:15:02.646041+0000","last_clean":"2024-09-10T05:15:02.646041+0000","last_became_active":"2024-09-10T05:11:27.706698+0000","last_became_peered":"2024-09-10T05:11:27.706698+0000","last_unstale":"2024-09-10T05:15:02.646041+0000","last_undegraded":"2024-09-10T05:15:02.646041+0000","last_fullsized":"2024-09-10T05:15:02.646041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:02.645892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:02.645892+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.645892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:35.605736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'10","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.286869+0000","last_change":"2024-09-10T05:15:17.286808+0000","last_active":"2024-09-10T05:15:17.286869+0000","last_peered":"2024-09-10T05:15:17.286869+0000","last_clean":"2024-09-10T05:15:17.286869+0000","last_became_active":"2024-09-10T05:11:29.731842+0000","last_became_peered":"2024-09-10T05:11:29.731842+0000","last_unstale":"2024-09-10T05:15:17.286869+0000","last_undegraded":"2024-09-10T05:15:17.286869+0000","last_fullsized":"2024-09-10T05:15:17.286869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:15:17.286726+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:15:17.286726+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.286726+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:48.199975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.476530+0000","last_change":"2024-09-10T05:14:58.476461+0000","last_active":"2024-09-10T05:14:58.476530+0000","last_peered":"2024-09-10T05:14:58.476530+0000","last_clean":"2024-09-10T05:14:58.476530+0000","last_became_active":"2024-09-10T05:11:27.719257+0000","last_became_peered":"2024-09-10T05:11:27.719257+0000","last_unstale":"2024-09-10T05:14:58.476530+0000","last_undegraded":"2024-09-10T05:14:58.476530+0000","last_fullsized":"2024-09-10T05:14:58.476530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.476369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.476369+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.476369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:03.036373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.655003+0000","last_change":"2024-09-10T05:15:10.654931+0000","last_active":"2024-09-10T05:15:10.655003+0000","last_peered":"2024-09-10T05:15:10.655003+0000","last_clean":"2024-09-10T05:15:10.655003+0000","last_became_active":"2024-09-10T05:12:04.967642+0000","last_became_peered":"2024-09-10T05:12:04.967642+0000","last_unstale":"2024-09-10T05:15:10.655003+0000","last_undegraded":"2024-09-10T05:15:10.655003+0000","last_fullsized":"2024-09-10T05:15:10.655003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:10.654800+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:10.654800+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.654800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:45:19.179150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"37'3","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.500832+0000","last_change":"2024-09-10T05:14:55.500764+0000","last_active":"2024-09-10T05:14:55.500832+0000","last_peered":"2024-09-10T05:14:55.500832+0000","last_clean":"2024-09-10T05:14:55.500832+0000","last_became_active":"2024-09-10T05:11:27.724439+0000","last_became_peered":"2024-09-10T05:11:27.724439+0000","last_unstale":"2024-09-10T05:14:55.500832+0000","last_undegraded":"2024-09-10T05:14:55.500832+0000","last_fullsized":"2024-09-10T05:14:55.500832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:14:55.500672+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:14:55.500672+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.500672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:26.970541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.746838+0000","last_change":"2024-09-10T05:15:09.746780+0000","last_active":"2024-09-10T05:15:09.746838+0000","last_peered":"2024-09-10T05:15:09.746838+0000","last_clean":"2024-09-10T05:15:09.746838+0000","last_became_active":"2024-09-10T05:11:29.722894+0000","last_became_peered":"2024-09-10T05:11:29.722894+0000","last_unstale":"2024-09-10T05:15:09.746838+0000","last_undegraded":"2024-09-10T05:15:09.746838+0000","last_fullsized":"2024-09-10T05:15:09.746838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:09.746683+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:09.746683+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.746683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:47.372939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.711010+0000","last_change":"2024-09-10T05:15:16.710949+0000","last_active":"2024-09-10T05:15:16.711010+0000","last_peered":"2024-09-10T05:15:16.711010+0000","last_clean":"2024-09-10T05:15:16.711010+0000","last_became_active":"2024-09-10T05:11:27.714926+0000","last_became_peered":"2024-09-10T05:11:27.714926+0000","last_unstale":"2024-09-10T05:15:16.711010+0000","last_undegraded":"2024-09-10T05:15:16.711010+0000","last_fullsized":"2024-09-10T05:15:16.711010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:16.710850+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:16.710850+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.710850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:15.748556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.253313+0000","last_change":"2024-09-10T05:15:15.253244+0000","last_active":"2024-09-10T05:15:15.253313+0000","last_peered":"2024-09-10T05:15:15.253313+0000","last_clean":"2024-09-10T05:15:15.253313+0000","last_became_active":"2024-09-10T05:11:29.721876+0000","last_became_peered":"2024-09-10T05:11:29.721876+0000","last_unstale":"2024-09-10T05:15:15.253313+0000","last_undegraded":"2024-09-10T05:15:15.253313+0000","last_fullsized":"2024-09-10T05:15:15.253313+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:15.253159+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:15.253159+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.253159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:20.248120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.060919+0000","last_change":"2024-09-10T05:15:12.060849+0000","last_active":"2024-09-10T05:15:12.060919+0000","last_peered":"2024-09-10T05:15:12.060919+0000","last_clean":"2024-09-10T05:15:12.060919+0000","last_became_active":"2024-09-10T05:11:27.720197+0000","last_became_peered":"2024-09-10T05:11:27.720197+0000","last_unstale":"2024-09-10T05:15:12.060919+0000","last_undegraded":"2024-09-10T05:15:12.060919+0000","last_fullsized":"2024-09-10T05:15:12.060919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:12.060756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:12.060756+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.060756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:16.632715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'36","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:46.116302+0000","last_change":"2024-09-10T05:15:46.116302+0000","last_active":"2024-09-10T05:15:46.116302+0000","last_peered":"2024-09-10T05:15:46.116302+0000","last_clean":"2024-09-10T05:15:46.116302+0000","last_became_active":"2024-09-10T05:11:37.763019+0000","last_became_peered":"2024-09-10T05:11:37.763019+0000","last_unstale":"2024-09-10T05:15:46.116302+0000","last_undegraded":"2024-09-10T05:15:46.116302+0000","last_fullsized":"2024-09-10T05:15:46.116302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'36","last_scrub_stamp":"2024-09-10T05:15:46.116217+0000","last_deep_scrub":"37'36","last_deep_scrub_stamp":"2024-09-10T05:15:46.116217+0000","last_clean_scrub_stamp":"2024-09-10T05:15:46.116217+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:39.870987+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.009715+0000","last_change":"2024-09-10T05:15:22.009597+0000","last_active":"2024-09-10T05:15:22.009715+0000","last_peered":"2024-09-10T05:15:22.009715+0000","last_clean":"2024-09-10T05:15:22.009715+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:15:22.009715+0000","last_undegraded":"2024-09-10T05:15:22.009715+0000","last_fullsized":"2024-09-10T05:15:22.009715+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:22.009499+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:22.009499+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.009499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:02.796822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.908082+0000","last_change":"2024-09-10T05:14:59.908025+0000","last_active":"2024-09-10T05:14:59.908082+0000","last_peered":"2024-09-10T05:14:59.908082+0000","last_clean":"2024-09-10T05:14:59.908082+0000","last_became_active":"2024-09-10T05:11:27.733612+0000","last_became_peered":"2024-09-10T05:11:27.733612+0000","last_unstale":"2024-09-10T05:14:59.908082+0000","last_undegraded":"2024-09-10T05:14:59.908082+0000","last_fullsized":"2024-09-10T05:14:59.908082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:59.907936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:59.907936+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.907936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:14.244325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:43.025820+0000","last_change":"2024-09-10T05:15:43.025760+0000","last_active":"2024-09-10T05:15:43.025820+0000","last_peered":"2024-09-10T05:15:43.025820+0000","last_clean":"2024-09-10T05:15:43.025820+0000","last_became_active":"2024-09-10T05:11:31.736788+0000","last_became_peered":"2024-09-10T05:11:31.736788+0000","last_unstale":"2024-09-10T05:15:43.025820+0000","last_undegraded":"2024-09-10T05:15:43.025820+0000","last_fullsized":"2024-09-10T05:15:43.025820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:43.025669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:43.025669+0000","last_clean_scrub_stamp":"2024-09-10T05:15:43.025669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:43.646838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'53","reported_seq":121,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:52.012418+0000","last_change":"2024-09-10T05:15:52.012348+0000","last_active":"2024-09-10T05:15:52.012418+0000","last_peered":"2024-09-10T05:15:52.012418+0000","last_clean":"2024-09-10T05:15:52.012418+0000","last_became_active":"2024-09-10T05:11:33.746595+0000","last_became_peered":"2024-09-10T05:11:33.746595+0000","last_unstale":"2024-09-10T05:15:52.012418+0000","last_undegraded":"2024-09-10T05:15:52.012418+0000","last_fullsized":"2024-09-10T05:15:52.012418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'53","last_scrub_stamp":"2024-09-10T05:15:52.012243+0000","last_deep_scrub":"37'53","last_deep_scrub_stamp":"2024-09-10T05:15:52.012243+0000","last_clean_scrub_stamp":"2024-09-10T05:15:52.012243+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:45.695633+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:38.127754+0000","last_change":"2024-09-10T05:15:38.127688+0000","last_active":"2024-09-10T05:15:38.127754+0000","last_peered":"2024-09-10T05:15:38.127754+0000","last_clean":"2024-09-10T05:15:38.127754+0000","last_became_active":"2024-09-10T05:11:35.746594+0000","last_became_peered":"2024-09-10T05:11:35.746594+0000","last_unstale":"2024-09-10T05:15:38.127754+0000","last_undegraded":"2024-09-10T05:15:38.127754+0000","last_fullsized":"2024-09-10T05:15:38.127754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:38.127605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:38.127605+0000","last_clean_scrub_stamp":"2024-09-10T05:15:38.127605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:08.742502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:47.099196+0000","last_change":"2024-09-10T05:15:47.099196+0000","last_active":"2024-09-10T05:15:47.099196+0000","last_peered":"2024-09-10T05:15:47.099196+0000","last_clean":"2024-09-10T05:15:47.099196+0000","last_became_active":"2024-09-10T05:11:37.756495+0000","last_became_peered":"2024-09-10T05:11:37.756495+0000","last_unstale":"2024-09-10T05:15:47.099196+0000","last_undegraded":"2024-09-10T05:15:47.099196+0000","last_fullsized":"2024-09-10T05:15:47.099196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-10T05:15:47.099110+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-10T05:15:47.099110+0000","last_clean_scrub_stamp":"2024-09-10T05:15:47.099110+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:48.110236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.037148+0000","last_change":"2024-09-10T05:15:23.037012+0000","last_active":"2024-09-10T05:15:23.037148+0000","last_peered":"2024-09-10T05:15:23.037148+0000","last_clean":"2024-09-10T05:15:23.037148+0000","last_became_active":"2024-09-10T05:11:29.732267+0000","last_became_peered":"2024-09-10T05:11:29.732267+0000","last_unstale":"2024-09-10T05:15:23.037148+0000","last_undegraded":"2024-09-10T05:15:23.037148+0000","last_fullsized":"2024-09-10T05:15:23.037148+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:23.036921+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:23.036921+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.036921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:21.103347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.746397+0000","last_change":"2024-09-10T05:14:52.746344+0000","last_active":"2024-09-10T05:14:52.746397+0000","last_peered":"2024-09-10T05:14:52.746397+0000","last_clean":"2024-09-10T05:14:52.746397+0000","last_became_active":"2024-09-10T05:11:27.726599+0000","last_became_peered":"2024-09-10T05:11:27.726599+0000","last_unstale":"2024-09-10T05:14:52.746397+0000","last_undegraded":"2024-09-10T05:14:52.746397+0000","last_fullsized":"2024-09-10T05:14:52.746397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.746259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.746259+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.746259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:50.519180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.670545+0000","last_change":"2024-09-10T05:15:20.670477+0000","last_active":"2024-09-10T05:15:20.670545+0000","last_peered":"2024-09-10T05:15:20.670545+0000","last_clean":"2024-09-10T05:15:20.670545+0000","last_became_active":"2024-09-10T05:11:31.731231+0000","last_became_peered":"2024-09-10T05:11:31.731231+0000","last_unstale":"2024-09-10T05:15:20.670545+0000","last_undegraded":"2024-09-10T05:15:20.670545+0000","last_fullsized":"2024-09-10T05:15:20.670545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:20.670391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:20.670391+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.670391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:50.967791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"37'17","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:31.221026+0000","last_change":"2024-09-10T05:15:31.220968+0000","last_active":"2024-09-10T05:15:31.221026+0000","last_peered":"2024-09-10T05:15:31.221026+0000","last_clean":"2024-09-10T05:15:31.221026+0000","last_became_active":"2024-09-10T05:11:33.743847+0000","last_became_peered":"2024-09-10T05:11:33.743847+0000","last_unstale":"2024-09-10T05:15:31.221026+0000","last_undegraded":"2024-09-10T05:15:31.221026+0000","last_fullsized":"2024-09-10T05:15:31.221026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'17","last_scrub_stamp":"2024-09-10T05:15:31.220881+0000","last_deep_scrub":"37'17","last_deep_scrub_stamp":"2024-09-10T05:15:31.220881+0000","last_clean_scrub_stamp":"2024-09-10T05:15:31.220881+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:23.297965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:37.129728+0000","last_change":"2024-09-10T05:15:37.129655+0000","last_active":"2024-09-10T05:15:37.129728+0000","last_peered":"2024-09-10T05:15:37.129728+0000","last_clean":"2024-09-10T05:15:37.129728+0000","last_became_active":"2024-09-10T05:11:35.749634+0000","last_became_peered":"2024-09-10T05:11:35.749634+0000","last_unstale":"2024-09-10T05:15:37.129728+0000","last_undegraded":"2024-09-10T05:15:37.129728+0000","last_fullsized":"2024-09-10T05:15:37.129728+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:37.129560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:37.129560+0000","last_clean_scrub_stamp":"2024-09-10T05:15:37.129560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:58.199238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:44.633458+0000","last_change":"2024-09-10T05:15:44.633458+0000","last_active":"2024-09-10T05:15:44.633458+0000","last_peered":"2024-09-10T05:15:44.633458+0000","last_clean":"2024-09-10T05:15:44.633458+0000","last_became_active":"2024-09-10T05:11:37.755078+0000","last_became_peered":"2024-09-10T05:11:37.755078+0000","last_unstale":"2024-09-10T05:15:44.633458+0000","last_undegraded":"2024-09-10T05:15:44.633458+0000","last_fullsized":"2024-09-10T05:15:44.633458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:15:44.633361+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:15:44.633361+0000","last_clean_scrub_stamp":"2024-09-10T05:15:44.633361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:02.212177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.007212+0000","last_change":"2024-09-10T05:15:24.007105+0000","last_active":"2024-09-10T05:15:24.007212+0000","last_peered":"2024-09-10T05:15:24.007212+0000","last_clean":"2024-09-10T05:15:24.007212+0000","last_became_active":"2024-09-10T05:11:29.731780+0000","last_became_peered":"2024-09-10T05:11:29.731780+0000","last_unstale":"2024-09-10T05:15:24.007212+0000","last_undegraded":"2024-09-10T05:15:24.007212+0000","last_fullsized":"2024-09-10T05:15:24.007212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:24.007017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:24.007017+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.007017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:45.996847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.998706+0000","last_change":"2024-09-10T05:15:01.998628+0000","last_active":"2024-09-10T05:15:01.998706+0000","last_peered":"2024-09-10T05:15:01.998706+0000","last_clean":"2024-09-10T05:15:01.998706+0000","last_became_active":"2024-09-10T05:11:27.732573+0000","last_became_peered":"2024-09-10T05:11:27.732573+0000","last_unstale":"2024-09-10T05:15:01.998706+0000","last_undegraded":"2024-09-10T05:15:01.998706+0000","last_fullsized":"2024-09-10T05:15:01.998706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:01.998527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:01.998527+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.998527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:38.110563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.728959+0000","last_change":"2024-09-10T05:15:16.728959+0000","last_active":"2024-09-10T05:15:16.728959+0000","last_peered":"2024-09-10T05:15:16.728959+0000","last_clean":"2024-09-10T05:15:16.728959+0000","last_became_active":"2024-09-10T05:12:04.965494+0000","last_became_peered":"2024-09-10T05:12:04.965494+0000","last_unstale":"2024-09-10T05:15:16.728959+0000","last_undegraded":"2024-09-10T05:15:16.728959+0000","last_fullsized":"2024-09-10T05:15:16.728959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:16.728878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:16.728878+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.728878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.784781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"37'29","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:26.675559+0000","last_change":"2024-09-10T05:15:26.675464+0000","last_active":"2024-09-10T05:15:26.675559+0000","last_peered":"2024-09-10T05:15:26.675559+0000","last_clean":"2024-09-10T05:15:26.675559+0000","last_became_active":"2024-09-10T05:11:33.745336+0000","last_became_peered":"2024-09-10T05:11:33.745336+0000","last_unstale":"2024-09-10T05:15:26.675559+0000","last_undegraded":"2024-09-10T05:15:26.675559+0000","last_fullsized":"2024-09-10T05:15:26.675559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'29","last_scrub_stamp":"2024-09-10T05:15:26.675347+0000","last_deep_scrub":"37'29","last_deep_scrub_stamp":"2024-09-10T05:15:26.675347+0000","last_clean_scrub_stamp":"2024-09-10T05:15:26.675347+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:29.397202+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'286","reported_seq":428,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:00.066147+0000","last_change":"2024-09-10T05:16:00.066084+0000","last_active":"2024-09-10T05:16:00.066147+0000","last_peered":"2024-09-10T05:16:00.066147+0000","last_clean":"2024-09-10T05:16:00.066147+0000","last_became_active":"2024-09-10T05:11:35.752290+0000","last_became_peered":"2024-09-10T05:11:35.752290+0000","last_unstale":"2024-09-10T05:16:00.066147+0000","last_undegraded":"2024-09-10T05:16:00.066147+0000","last_fullsized":"2024-09-10T05:16:00.066147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:16:00.065967+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:16:00.065967+0000","last_clean_scrub_stamp":"2024-09-10T05:16:00.065967+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:41.284351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:39.761754+0000","last_change":"2024-09-10T05:15:39.761754+0000","last_active":"2024-09-10T05:15:39.761754+0000","last_peered":"2024-09-10T05:15:39.761754+0000","last_clean":"2024-09-10T05:15:39.761754+0000","last_became_active":"2024-09-10T05:11:37.759311+0000","last_became_peered":"2024-09-10T05:11:37.759311+0000","last_unstale":"2024-09-10T05:15:39.761754+0000","last_undegraded":"2024-09-10T05:15:39.761754+0000","last_fullsized":"2024-09-10T05:15:39.761754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:39.761663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:39.761663+0000","last_clean_scrub_stamp":"2024-09-10T05:15:39.761663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:30.436312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.495407+0000","last_change":"2024-09-10T05:15:05.495305+0000","last_active":"2024-09-10T05:15:05.495407+0000","last_peered":"2024-09-10T05:15:05.495407+0000","last_clean":"2024-09-10T05:15:05.495407+0000","last_became_active":"2024-09-10T05:11:29.723919+0000","last_became_peered":"2024-09-10T05:11:29.723919+0000","last_unstale":"2024-09-10T05:15:05.495407+0000","last_undegraded":"2024-09-10T05:15:05.495407+0000","last_fullsized":"2024-09-10T05:15:05.495407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:05.495212+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:05.495212+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.495212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:47.310404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.435184+0000","last_change":"2024-09-10T05:14:49.435128+0000","last_active":"2024-09-10T05:14:49.435184+0000","last_peered":"2024-09-10T05:14:49.435184+0000","last_clean":"2024-09-10T05:14:49.435184+0000","last_became_active":"2024-09-10T05:11:27.719835+0000","last_became_peered":"2024-09-10T05:11:27.719835+0000","last_unstale":"2024-09-10T05:14:49.435184+0000","last_undegraded":"2024-09-10T05:14:49.435184+0000","last_fullsized":"2024-09-10T05:14:49.435184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:49.435035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:49.435035+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.435035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:32.661631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:44.033039+0000","last_change":"2024-09-10T05:15:44.032974+0000","last_active":"2024-09-10T05:15:44.033039+0000","last_peered":"2024-09-10T05:15:44.033039+0000","last_clean":"2024-09-10T05:15:44.033039+0000","last_became_active":"2024-09-10T05:11:31.737411+0000","last_became_peered":"2024-09-10T05:11:31.737411+0000","last_unstale":"2024-09-10T05:15:44.033039+0000","last_undegraded":"2024-09-10T05:15:44.033039+0000","last_fullsized":"2024-09-10T05:15:44.033039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:44.032888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:44.032888+0000","last_clean_scrub_stamp":"2024-09-10T05:15:44.032888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:18:02.424864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'44","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.681902+0000","last_change":"2024-09-10T05:15:27.681845+0000","last_active":"2024-09-10T05:15:27.681902+0000","last_peered":"2024-09-10T05:15:27.681902+0000","last_clean":"2024-09-10T05:15:27.681902+0000","last_became_active":"2024-09-10T05:11:33.744920+0000","last_became_peered":"2024-09-10T05:11:33.744920+0000","last_unstale":"2024-09-10T05:15:27.681902+0000","last_undegraded":"2024-09-10T05:15:27.681902+0000","last_fullsized":"2024-09-10T05:15:27.681902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'44","last_scrub_stamp":"2024-09-10T05:15:27.681741+0000","last_deep_scrub":"37'44","last_deep_scrub_stamp":"2024-09-10T05:15:27.681741+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.681741+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:58.009365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'286","reported_seq":437,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:36.610779+0000","last_change":"2024-09-10T05:15:36.610715+0000","last_active":"2024-09-10T05:15:36.610779+0000","last_peered":"2024-09-10T05:15:36.610779+0000","last_clean":"2024-09-10T05:15:36.610779+0000","last_became_active":"2024-09-10T05:11:35.748328+0000","last_became_peered":"2024-09-10T05:11:35.748328+0000","last_unstale":"2024-09-10T05:15:36.610779+0000","last_undegraded":"2024-09-10T05:15:36.610779+0000","last_fullsized":"2024-09-10T05:15:36.610779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:36.610628+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:36.610628+0000","last_clean_scrub_stamp":"2024-09-10T05:15:36.610628+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:59.554801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'8","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.072515+0000","last_change":"2024-09-10T05:15:19.072422+0000","last_active":"2024-09-10T05:15:19.072515+0000","last_peered":"2024-09-10T05:15:19.072515+0000","last_clean":"2024-09-10T05:15:19.072515+0000","last_became_active":"2024-09-10T05:11:29.735799+0000","last_became_peered":"2024-09-10T05:11:29.735799+0000","last_unstale":"2024-09-10T05:15:19.072515+0000","last_undegraded":"2024-09-10T05:15:19.072515+0000","last_fullsized":"2024-09-10T05:15:19.072515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:19.072304+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:19.072304+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.072304+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:47.414562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.750293+0000","last_change":"2024-09-10T05:14:53.750206+0000","last_active":"2024-09-10T05:14:53.750293+0000","last_peered":"2024-09-10T05:14:53.750293+0000","last_clean":"2024-09-10T05:14:53.750293+0000","last_became_active":"2024-09-10T05:11:27.716318+0000","last_became_peered":"2024-09-10T05:11:27.716318+0000","last_unstale":"2024-09-10T05:14:53.750293+0000","last_undegraded":"2024-09-10T05:14:53.750293+0000","last_fullsized":"2024-09-10T05:14:53.750293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.750095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.750095+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.750095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:30.144747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.283703+0000","last_change":"2024-09-10T05:15:21.283646+0000","last_active":"2024-09-10T05:15:21.283703+0000","last_peered":"2024-09-10T05:15:21.283703+0000","last_clean":"2024-09-10T05:15:21.283703+0000","last_became_active":"2024-09-10T05:11:31.734975+0000","last_became_peered":"2024-09-10T05:11:31.734975+0000","last_unstale":"2024-09-10T05:15:21.283703+0000","last_undegraded":"2024-09-10T05:15:21.283703+0000","last_fullsized":"2024-09-10T05:15:21.283703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:21.283528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:21.283528+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.283528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:26.933150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'60","reported_seq":127,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.726912+0000","last_change":"2024-09-10T05:15:22.726852+0000","last_active":"2024-09-10T05:15:22.726912+0000","last_peered":"2024-09-10T05:15:22.726912+0000","last_clean":"2024-09-10T05:15:22.726912+0000","last_became_active":"2024-09-10T05:11:33.746522+0000","last_became_peered":"2024-09-10T05:11:33.746522+0000","last_unstale":"2024-09-10T05:15:22.726912+0000","last_undegraded":"2024-09-10T05:15:22.726912+0000","last_fullsized":"2024-09-10T05:15:22.726912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'60","last_scrub_stamp":"2024-09-10T05:15:22.726746+0000","last_deep_scrub":"37'60","last_deep_scrub_stamp":"2024-09-10T05:15:22.726746+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.726746+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:43:04.485808+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:35.565365+0000","last_change":"2024-09-10T05:15:35.565302+0000","last_active":"2024-09-10T05:15:35.565365+0000","last_peered":"2024-09-10T05:15:35.565365+0000","last_clean":"2024-09-10T05:15:35.565365+0000","last_became_active":"2024-09-10T05:11:35.745840+0000","last_became_peered":"2024-09-10T05:11:35.745840+0000","last_unstale":"2024-09-10T05:15:35.565365+0000","last_undegraded":"2024-09-10T05:15:35.565365+0000","last_fullsized":"2024-09-10T05:15:35.565365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:35.565219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:35.565219+0000","last_clean_scrub_stamp":"2024-09-10T05:15:35.565219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:26:21.749001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:36.705160+0000","last_change":"2024-09-10T05:15:36.705072+0000","last_active":"2024-09-10T05:15:36.705160+0000","last_peered":"2024-09-10T05:15:36.705160+0000","last_clean":"2024-09-10T05:15:36.705160+0000","last_became_active":"2024-09-10T05:11:37.754562+0000","last_became_peered":"2024-09-10T05:11:37.754562+0000","last_unstale":"2024-09-10T05:15:36.705160+0000","last_undegraded":"2024-09-10T05:15:36.705160+0000","last_fullsized":"2024-09-10T05:15:36.705160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:15:36.704960+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:15:36.704960+0000","last_clean_scrub_stamp":"2024-09-10T05:15:36.704960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:30.793914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.352924+0000","last_change":"2024-09-10T05:15:03.352861+0000","last_active":"2024-09-10T05:15:03.352924+0000","last_peered":"2024-09-10T05:15:03.352924+0000","last_clean":"2024-09-10T05:15:03.352924+0000","last_became_active":"2024-09-10T05:11:29.721292+0000","last_became_peered":"2024-09-10T05:11:29.721292+0000","last_unstale":"2024-09-10T05:15:03.352924+0000","last_undegraded":"2024-09-10T05:15:03.352924+0000","last_fullsized":"2024-09-10T05:15:03.352924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.352761+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.352761+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.352761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:39.971897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.706267+0000","last_change":"2024-09-10T05:14:50.706205+0000","last_active":"2024-09-10T05:14:50.706267+0000","last_peered":"2024-09-10T05:14:50.706267+0000","last_clean":"2024-09-10T05:14:50.706267+0000","last_became_active":"2024-09-10T05:11:27.726419+0000","last_became_peered":"2024-09-10T05:11:27.726419+0000","last_unstale":"2024-09-10T05:14:50.706267+0000","last_undegraded":"2024-09-10T05:14:50.706267+0000","last_fullsized":"2024-09-10T05:14:50.706267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:14:50.706120+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:14:50.706120+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.706120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:55:39.305300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.699673+0000","last_change":"2024-09-10T05:15:14.699611+0000","last_active":"2024-09-10T05:15:14.699673+0000","last_peered":"2024-09-10T05:15:14.699673+0000","last_clean":"2024-09-10T05:15:14.699673+0000","last_became_active":"2024-09-10T05:11:31.732017+0000","last_became_peered":"2024-09-10T05:11:31.732017+0000","last_unstale":"2024-09-10T05:15:14.699673+0000","last_undegraded":"2024-09-10T05:15:14.699673+0000","last_fullsized":"2024-09-10T05:15:14.699673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:14.699495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:14.699495+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.699495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:03.772467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'45","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:50.005807+0000","last_change":"2024-09-10T05:15:50.005697+0000","last_active":"2024-09-10T05:15:50.005807+0000","last_peered":"2024-09-10T05:15:50.005807+0000","last_clean":"2024-09-10T05:15:50.005807+0000","last_became_active":"2024-09-10T05:11:33.747334+0000","last_became_peered":"2024-09-10T05:11:33.747334+0000","last_unstale":"2024-09-10T05:15:50.005807+0000","last_undegraded":"2024-09-10T05:15:50.005807+0000","last_fullsized":"2024-09-10T05:15:50.005807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'45","last_scrub_stamp":"2024-09-10T05:15:50.005589+0000","last_deep_scrub":"37'45","last_deep_scrub_stamp":"2024-09-10T05:15:50.005589+0000","last_clean_scrub_stamp":"2024-09-10T05:15:50.005589+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:18.741833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.594500+0000","last_change":"2024-09-10T05:15:34.594411+0000","last_active":"2024-09-10T05:15:34.594500+0000","last_peered":"2024-09-10T05:15:34.594500+0000","last_clean":"2024-09-10T05:15:34.594500+0000","last_became_active":"2024-09-10T05:11:35.753453+0000","last_became_peered":"2024-09-10T05:11:35.753453+0000","last_unstale":"2024-09-10T05:15:34.594500+0000","last_undegraded":"2024-09-10T05:15:34.594500+0000","last_fullsized":"2024-09-10T05:15:34.594500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:34.594319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:34.594319+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.594319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:42.002121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'4","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:40.141366+0000","last_change":"2024-09-10T05:15:40.141268+0000","last_active":"2024-09-10T05:15:40.141366+0000","last_peered":"2024-09-10T05:15:40.141366+0000","last_clean":"2024-09-10T05:15:40.141366+0000","last_became_active":"2024-09-10T05:11:37.757307+0000","last_became_peered":"2024-09-10T05:11:37.757307+0000","last_unstale":"2024-09-10T05:15:40.141366+0000","last_undegraded":"2024-09-10T05:15:40.141366+0000","last_fullsized":"2024-09-10T05:15:40.141366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:40.141152+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:40.141152+0000","last_clean_scrub_stamp":"2024-09-10T05:15:40.141152+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:54.477540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.667546+0000","last_change":"2024-09-10T05:15:01.667460+0000","last_active":"2024-09-10T05:15:01.667546+0000","last_peered":"2024-09-10T05:15:01.667546+0000","last_clean":"2024-09-10T05:15:01.667546+0000","last_became_active":"2024-09-10T05:11:29.722719+0000","last_became_peered":"2024-09-10T05:11:29.722719+0000","last_unstale":"2024-09-10T05:15:01.667546+0000","last_undegraded":"2024-09-10T05:15:01.667546+0000","last_fullsized":"2024-09-10T05:15:01.667546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:01.667364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:01.667364+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.667364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:59.866263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.927388+0000","last_change":"2024-09-10T05:14:58.927325+0000","last_active":"2024-09-10T05:14:58.927388+0000","last_peered":"2024-09-10T05:14:58.927388+0000","last_clean":"2024-09-10T05:14:58.927388+0000","last_became_active":"2024-09-10T05:11:27.722553+0000","last_became_peered":"2024-09-10T05:11:27.722553+0000","last_unstale":"2024-09-10T05:14:58.927388+0000","last_undegraded":"2024-09-10T05:14:58.927388+0000","last_fullsized":"2024-09-10T05:14:58.927388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:58.927238+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:58.927238+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.927238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:40.559986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'5","reported_seq":239,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.697265+0000","last_change":"2024-09-10T05:15:19.697159+0000","last_active":"2024-09-10T05:15:19.697265+0000","last_peered":"2024-09-10T05:15:19.697265+0000","last_clean":"2024-09-10T05:15:19.697265+0000","last_became_active":"2024-09-10T05:11:31.733822+0000","last_became_peered":"2024-09-10T05:11:31.733822+0000","last_unstale":"2024-09-10T05:15:19.697265+0000","last_undegraded":"2024-09-10T05:15:19.697265+0000","last_fullsized":"2024-09-10T05:15:19.697265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-10T05:15:19.697017+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-10T05:15:19.697017+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.697017+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:40.978284+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'60","reported_seq":131,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:47.992137+0000","last_change":"2024-09-10T05:15:47.992078+0000","last_active":"2024-09-10T05:15:47.992137+0000","last_peered":"2024-09-10T05:15:47.992137+0000","last_clean":"2024-09-10T05:15:47.992137+0000","last_became_active":"2024-09-10T05:11:33.747938+0000","last_became_peered":"2024-09-10T05:11:33.747938+0000","last_unstale":"2024-09-10T05:15:47.992137+0000","last_undegraded":"2024-09-10T05:15:47.992137+0000","last_fullsized":"2024-09-10T05:15:47.992137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'60","last_scrub_stamp":"2024-09-10T05:15:47.991966+0000","last_deep_scrub":"37'60","last_deep_scrub_stamp":"2024-09-10T05:15:47.991966+0000","last_clean_scrub_stamp":"2024-09-10T05:15:47.991966+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:54.283493+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'286","reported_seq":361,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:33.562063+0000","last_change":"2024-09-10T05:15:33.561944+0000","last_active":"2024-09-10T05:15:33.562063+0000","last_peered":"2024-09-10T05:15:33.562063+0000","last_clean":"2024-09-10T05:15:33.562063+0000","last_became_active":"2024-09-10T05:11:35.753663+0000","last_became_peered":"2024-09-10T05:11:35.753663+0000","last_unstale":"2024-09-10T05:15:33.562063+0000","last_undegraded":"2024-09-10T05:15:33.562063+0000","last_fullsized":"2024-09-10T05:15:33.562063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:33.561838+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:33.561838+0000","last_clean_scrub_stamp":"2024-09-10T05:15:33.561838+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:25.576672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:41.642902+0000","last_change":"2024-09-10T05:15:41.642778+0000","last_active":"2024-09-10T05:15:41.642902+0000","last_peered":"2024-09-10T05:15:41.642902+0000","last_clean":"2024-09-10T05:15:41.642902+0000","last_became_active":"2024-09-10T05:11:37.754959+0000","last_became_peered":"2024-09-10T05:11:37.754959+0000","last_unstale":"2024-09-10T05:15:41.642902+0000","last_undegraded":"2024-09-10T05:15:41.642902+0000","last_fullsized":"2024-09-10T05:15:41.642902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:41.642679+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:41.642679+0000","last_clean_scrub_stamp":"2024-09-10T05:15:41.642679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:33:20.364799+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'17","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.630502+0000","last_change":"2024-09-10T05:15:04.630437+0000","last_active":"2024-09-10T05:15:04.630502+0000","last_peered":"2024-09-10T05:15:04.630502+0000","last_clean":"2024-09-10T05:15:04.630502+0000","last_became_active":"2024-09-10T05:11:29.722267+0000","last_became_peered":"2024-09-10T05:11:29.722267+0000","last_unstale":"2024-09-10T05:15:04.630502+0000","last_undegraded":"2024-09-10T05:15:04.630502+0000","last_fullsized":"2024-09-10T05:15:04.630502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'17","last_scrub_stamp":"2024-09-10T05:15:04.630348+0000","last_deep_scrub":"37'17","last_deep_scrub_stamp":"2024-09-10T05:15:04.630348+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.630348+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:08:25.140187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.914476+0000","last_change":"2024-09-10T05:14:57.914417+0000","last_active":"2024-09-10T05:14:57.914476+0000","last_peered":"2024-09-10T05:14:57.914476+0000","last_clean":"2024-09-10T05:14:57.914476+0000","last_became_active":"2024-09-10T05:11:27.731909+0000","last_became_peered":"2024-09-10T05:11:27.731909+0000","last_unstale":"2024-09-10T05:14:57.914476+0000","last_undegraded":"2024-09-10T05:14:57.914476+0000","last_fullsized":"2024-09-10T05:14:57.914476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:14:57.914334+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:14:57.914334+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.914334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:13:28.529230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":18,"num_write":56,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.678820+0000","last_change":"2024-09-10T05:15:15.678760+0000","last_active":"2024-09-10T05:15:15.678820+0000","last_peered":"2024-09-10T05:15:15.678820+0000","last_clean":"2024-09-10T05:15:15.678820+0000","last_became_active":"2024-09-10T05:11:31.732807+0000","last_became_peered":"2024-09-10T05:11:31.732807+0000","last_unstale":"2024-09-10T05:15:15.678820+0000","last_undegraded":"2024-09-10T05:15:15.678820+0000","last_fullsized":"2024-09-10T05:15:15.678820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:15.678675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:15.678675+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.678675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:44.860207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'79","reported_seq":165,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:49.035814+0000","last_change":"2024-09-10T05:15:49.035750+0000","last_active":"2024-09-10T05:15:49.035814+0000","last_peered":"2024-09-10T05:15:49.035814+0000","last_clean":"2024-09-10T05:15:49.035814+0000","last_became_active":"2024-09-10T05:11:33.745449+0000","last_became_peered":"2024-09-10T05:11:33.745449+0000","last_unstale":"2024-09-10T05:15:49.035814+0000","last_undegraded":"2024-09-10T05:15:49.035814+0000","last_fullsized":"2024-09-10T05:15:49.035814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'79","last_scrub_stamp":"2024-09-10T05:15:49.035608+0000","last_deep_scrub":"37'79","last_deep_scrub_stamp":"2024-09-10T05:15:49.035608+0000","last_clean_scrub_stamp":"2024-09-10T05:15:49.035608+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:58:55.683639+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:31.560915+0000","last_change":"2024-09-10T05:15:31.560828+0000","last_active":"2024-09-10T05:15:31.560915+0000","last_peered":"2024-09-10T05:15:31.560915+0000","last_clean":"2024-09-10T05:15:31.560915+0000","last_became_active":"2024-09-10T05:11:35.747913+0000","last_became_peered":"2024-09-10T05:11:35.747913+0000","last_unstale":"2024-09-10T05:15:31.560915+0000","last_undegraded":"2024-09-10T05:15:31.560915+0000","last_fullsized":"2024-09-10T05:15:31.560915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:31.560744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:31.560744+0000","last_clean_scrub_stamp":"2024-09-10T05:15:31.560744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:46.528586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'23","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:43.590380+0000","last_change":"2024-09-10T05:15:43.590312+0000","last_active":"2024-09-10T05:15:43.590380+0000","last_peered":"2024-09-10T05:15:43.590380+0000","last_clean":"2024-09-10T05:15:43.590380+0000","last_became_active":"2024-09-10T05:11:37.754915+0000","last_became_peered":"2024-09-10T05:11:37.754915+0000","last_unstale":"2024-09-10T05:15:43.590380+0000","last_undegraded":"2024-09-10T05:15:43.590380+0000","last_fullsized":"2024-09-10T05:15:43.590380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'23","last_scrub_stamp":"2024-09-10T05:15:43.590226+0000","last_deep_scrub":"37'23","last_deep_scrub_stamp":"2024-09-10T05:15:43.590226+0000","last_clean_scrub_stamp":"2024-09-10T05:15:43.590226+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:18.298302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'14","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.379388+0000","last_change":"2024-09-10T05:15:02.379312+0000","last_active":"2024-09-10T05:15:02.379388+0000","last_peered":"2024-09-10T05:15:02.379388+0000","last_clean":"2024-09-10T05:15:02.379388+0000","last_became_active":"2024-09-10T05:11:29.727349+0000","last_became_peered":"2024-09-10T05:11:29.727349+0000","last_unstale":"2024-09-10T05:15:02.379388+0000","last_undegraded":"2024-09-10T05:15:02.379388+0000","last_fullsized":"2024-09-10T05:15:02.379388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:02.379225+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:02.379225+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.379225+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:14.485317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.470614+0000","last_change":"2024-09-10T05:14:51.470556+0000","last_active":"2024-09-10T05:14:51.470614+0000","last_peered":"2024-09-10T05:14:51.470614+0000","last_clean":"2024-09-10T05:14:51.470614+0000","last_became_active":"2024-09-10T05:11:27.717887+0000","last_became_peered":"2024-09-10T05:11:27.717887+0000","last_unstale":"2024-09-10T05:14:51.470614+0000","last_undegraded":"2024-09-10T05:14:51.470614+0000","last_fullsized":"2024-09-10T05:14:51.470614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:51.470452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:51.470452+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.470452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:41.087698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:14.704188+0000","last_change":"2024-09-10T05:15:14.704114+0000","last_active":"2024-09-10T05:15:14.704188+0000","last_peered":"2024-09-10T05:15:14.704188+0000","last_clean":"2024-09-10T05:15:14.704188+0000","last_became_active":"2024-09-10T05:11:31.735386+0000","last_became_peered":"2024-09-10T05:11:31.735386+0000","last_unstale":"2024-09-10T05:15:14.704188+0000","last_undegraded":"2024-09-10T05:15:14.704188+0000","last_fullsized":"2024-09-10T05:15:14.704188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:14.704035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:14.704035+0000","last_clean_scrub_stamp":"2024-09-10T05:15:14.704035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:48.911727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'47","reported_seq":110,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:32.179120+0000","last_change":"2024-09-10T05:15:32.179060+0000","last_active":"2024-09-10T05:15:32.179120+0000","last_peered":"2024-09-10T05:15:32.179120+0000","last_clean":"2024-09-10T05:15:32.179120+0000","last_became_active":"2024-09-10T05:11:33.744026+0000","last_became_peered":"2024-09-10T05:11:33.744026+0000","last_unstale":"2024-09-10T05:15:32.179120+0000","last_undegraded":"2024-09-10T05:15:32.179120+0000","last_fullsized":"2024-09-10T05:15:32.179120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'47","last_scrub_stamp":"2024-09-10T05:15:32.178957+0000","last_deep_scrub":"37'47","last_deep_scrub_stamp":"2024-09-10T05:15:32.178957+0000","last_clean_scrub_stamp":"2024-09-10T05:15:32.178957+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:27:26.704119+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:02.134730+0000","last_change":"2024-09-10T05:16:02.134651+0000","last_active":"2024-09-10T05:16:02.134730+0000","last_peered":"2024-09-10T05:16:02.134730+0000","last_clean":"2024-09-10T05:16:02.134730+0000","last_became_active":"2024-09-10T05:11:35.748874+0000","last_became_peered":"2024-09-10T05:11:35.748874+0000","last_unstale":"2024-09-10T05:16:02.134730+0000","last_undegraded":"2024-09-10T05:16:02.134730+0000","last_fullsized":"2024-09-10T05:16:02.134730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:16:02.134561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:16:02.134561+0000","last_clean_scrub_stamp":"2024-09-10T05:16:02.134561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:40:20.022329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'10","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:05.081716+0000","last_change":"2024-09-10T05:16:05.081716+0000","last_active":"2024-09-10T05:16:05.081716+0000","last_peered":"2024-09-10T05:16:05.081716+0000","last_clean":"2024-09-10T05:16:05.081716+0000","last_became_active":"2024-09-10T05:11:37.767895+0000","last_became_peered":"2024-09-10T05:11:37.767895+0000","last_unstale":"2024-09-10T05:16:05.081716+0000","last_undegraded":"2024-09-10T05:16:05.081716+0000","last_fullsized":"2024-09-10T05:16:05.081716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:16:05.081606+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:16:05.081606+0000","last_clean_scrub_stamp":"2024-09-10T05:16:05.081606+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:54.382220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'16","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.041664+0000","last_change":"2024-09-10T05:15:20.041594+0000","last_active":"2024-09-10T05:15:20.041664+0000","last_peered":"2024-09-10T05:15:20.041664+0000","last_clean":"2024-09-10T05:15:20.041664+0000","last_became_active":"2024-09-10T05:11:29.733870+0000","last_became_peered":"2024-09-10T05:11:29.733870+0000","last_unstale":"2024-09-10T05:15:20.041664+0000","last_undegraded":"2024-09-10T05:15:20.041664+0000","last_fullsized":"2024-09-10T05:15:20.041664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:20.041507+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:20.041507+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.041507+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:39:13.856170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.937938+0000","last_change":"2024-09-10T05:14:56.937882+0000","last_active":"2024-09-10T05:14:56.937938+0000","last_peered":"2024-09-10T05:14:56.937938+0000","last_clean":"2024-09-10T05:14:56.937938+0000","last_became_active":"2024-09-10T05:11:27.725852+0000","last_became_peered":"2024-09-10T05:11:27.725852+0000","last_unstale":"2024-09-10T05:14:56.937938+0000","last_undegraded":"2024-09-10T05:14:56.937938+0000","last_fullsized":"2024-09-10T05:14:56.937938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:56.937795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:56.937795+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.937795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:18.007474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.665003+0000","last_change":"2024-09-10T05:15:18.664914+0000","last_active":"2024-09-10T05:15:18.665003+0000","last_peered":"2024-09-10T05:15:18.665003+0000","last_clean":"2024-09-10T05:15:18.665003+0000","last_became_active":"2024-09-10T05:11:31.733756+0000","last_became_peered":"2024-09-10T05:11:31.733756+0000","last_unstale":"2024-09-10T05:15:18.665003+0000","last_undegraded":"2024-09-10T05:15:18.665003+0000","last_fullsized":"2024-09-10T05:15:18.665003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:18.664801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:18.664801+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.664801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:56.006579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'48","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.724538+0000","last_change":"2024-09-10T05:15:24.724473+0000","last_active":"2024-09-10T05:15:24.724538+0000","last_peered":"2024-09-10T05:15:24.724538+0000","last_clean":"2024-09-10T05:15:24.724538+0000","last_became_active":"2024-09-10T05:11:33.741848+0000","last_became_peered":"2024-09-10T05:11:33.741848+0000","last_unstale":"2024-09-10T05:15:24.724538+0000","last_undegraded":"2024-09-10T05:15:24.724538+0000","last_fullsized":"2024-09-10T05:15:24.724538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'48","last_scrub_stamp":"2024-09-10T05:15:24.724365+0000","last_deep_scrub":"37'48","last_deep_scrub_stamp":"2024-09-10T05:15:24.724365+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.724365+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:38:55.362877+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'286","reported_seq":465,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:30.715721+0000","last_change":"2024-09-10T05:15:30.715629+0000","last_active":"2024-09-10T05:15:30.715721+0000","last_peered":"2024-09-10T05:15:30.715721+0000","last_clean":"2024-09-10T05:15:30.715721+0000","last_became_active":"2024-09-10T05:11:35.752511+0000","last_became_peered":"2024-09-10T05:11:35.752511+0000","last_unstale":"2024-09-10T05:15:30.715721+0000","last_undegraded":"2024-09-10T05:15:30.715721+0000","last_fullsized":"2024-09-10T05:15:30.715721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:30.715509+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:30.715509+0000","last_clean_scrub_stamp":"2024-09-10T05:15:30.715509+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:14.739369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'15","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:39.603245+0000","last_change":"2024-09-10T05:15:39.603185+0000","last_active":"2024-09-10T05:15:39.603245+0000","last_peered":"2024-09-10T05:15:39.603245+0000","last_clean":"2024-09-10T05:15:39.603245+0000","last_became_active":"2024-09-10T05:11:37.758381+0000","last_became_peered":"2024-09-10T05:11:37.758381+0000","last_unstale":"2024-09-10T05:15:39.603245+0000","last_undegraded":"2024-09-10T05:15:39.603245+0000","last_fullsized":"2024-09-10T05:15:39.603245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-10T05:15:39.603096+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-10T05:15:39.603096+0000","last_clean_scrub_stamp":"2024-09-10T05:15:39.603096+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:57.716844+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'14","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.632159+0000","last_change":"2024-09-10T05:15:05.632091+0000","last_active":"2024-09-10T05:15:05.632159+0000","last_peered":"2024-09-10T05:15:05.632159+0000","last_clean":"2024-09-10T05:15:05.632159+0000","last_became_active":"2024-09-10T05:11:29.722170+0000","last_became_peered":"2024-09-10T05:11:29.722170+0000","last_unstale":"2024-09-10T05:15:05.632159+0000","last_undegraded":"2024-09-10T05:15:05.632159+0000","last_fullsized":"2024-09-10T05:15:05.632159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:05.632009+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:05.632009+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.632009+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:23.914770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.932455+0000","last_change":"2024-09-10T05:14:55.932355+0000","last_active":"2024-09-10T05:14:55.932455+0000","last_peered":"2024-09-10T05:14:55.932455+0000","last_clean":"2024-09-10T05:14:55.932455+0000","last_became_active":"2024-09-10T05:11:27.732591+0000","last_became_peered":"2024-09-10T05:11:27.732591+0000","last_unstale":"2024-09-10T05:14:55.932455+0000","last_undegraded":"2024-09-10T05:14:55.932455+0000","last_fullsized":"2024-09-10T05:14:55.932455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:55.932231+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:55.932231+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.932231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:54.606915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'5","reported_seq":429,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.298671+0000","last_change":"2024-09-10T05:15:22.298554+0000","last_active":"2024-09-10T05:15:22.298671+0000","last_peered":"2024-09-10T05:15:22.298671+0000","last_clean":"2024-09-10T05:15:22.298671+0000","last_became_active":"2024-09-10T05:11:31.734714+0000","last_became_peered":"2024-09-10T05:11:31.734714+0000","last_unstale":"2024-09-10T05:15:22.298671+0000","last_undegraded":"2024-09-10T05:15:22.298671+0000","last_fullsized":"2024-09-10T05:15:22.298671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-10T05:15:22.298439+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-10T05:15:22.298439+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.298439+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:39:58.275665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:51.038253+0000","last_change":"2024-09-10T05:15:51.038191+0000","last_active":"2024-09-10T05:15:51.038253+0000","last_peered":"2024-09-10T05:15:51.038253+0000","last_clean":"2024-09-10T05:15:51.038253+0000","last_became_active":"2024-09-10T05:11:33.747376+0000","last_became_peered":"2024-09-10T05:11:33.747376+0000","last_unstale":"2024-09-10T05:15:51.038253+0000","last_undegraded":"2024-09-10T05:15:51.038253+0000","last_fullsized":"2024-09-10T05:15:51.038253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-10T05:15:51.038096+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-10T05:15:51.038096+0000","last_clean_scrub_stamp":"2024-09-10T05:15:51.038096+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:53.852770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'286","reported_seq":476,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:35.144668+0000","last_change":"2024-09-10T05:15:35.144600+0000","last_active":"2024-09-10T05:15:35.144668+0000","last_peered":"2024-09-10T05:15:35.144668+0000","last_clean":"2024-09-10T05:15:35.144668+0000","last_became_active":"2024-09-10T05:11:35.751352+0000","last_became_peered":"2024-09-10T05:11:35.751352+0000","last_unstale":"2024-09-10T05:15:35.144668+0000","last_undegraded":"2024-09-10T05:15:35.144668+0000","last_fullsized":"2024-09-10T05:15:35.144668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:35.144513+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:35.144513+0000","last_clean_scrub_stamp":"2024-09-10T05:15:35.144513+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:18.378095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'6","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:35.734339+0000","last_change":"2024-09-10T05:15:35.734274+0000","last_active":"2024-09-10T05:15:35.734339+0000","last_peered":"2024-09-10T05:15:35.734339+0000","last_clean":"2024-09-10T05:15:35.734339+0000","last_became_active":"2024-09-10T05:11:37.756734+0000","last_became_peered":"2024-09-10T05:11:37.756734+0000","last_unstale":"2024-09-10T05:15:35.734339+0000","last_undegraded":"2024-09-10T05:15:35.734339+0000","last_fullsized":"2024-09-10T05:15:35.734339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:35.734191+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:35.734191+0000","last_clean_scrub_stamp":"2024-09-10T05:15:35.734191+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:58.776195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'24","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.367549+0000","last_change":"2024-09-10T05:15:04.367487+0000","last_active":"2024-09-10T05:15:04.367549+0000","last_peered":"2024-09-10T05:15:04.367549+0000","last_clean":"2024-09-10T05:15:04.367549+0000","last_became_active":"2024-09-10T05:11:29.735032+0000","last_became_peered":"2024-09-10T05:11:29.735032+0000","last_unstale":"2024-09-10T05:15:04.367549+0000","last_undegraded":"2024-09-10T05:15:04.367549+0000","last_fullsized":"2024-09-10T05:15:04.367549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24","last_scrub_stamp":"2024-09-10T05:15:04.367405+0000","last_deep_scrub":"37'24","last_deep_scrub_stamp":"2024-09-10T05:15:04.367405+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.367405+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:35.414356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.972875+0000","last_change":"2024-09-10T05:14:54.972818+0000","last_active":"2024-09-10T05:14:54.972875+0000","last_peered":"2024-09-10T05:14:54.972875+0000","last_clean":"2024-09-10T05:14:54.972875+0000","last_became_active":"2024-09-10T05:11:27.734204+0000","last_became_peered":"2024-09-10T05:11:27.734204+0000","last_unstale":"2024-09-10T05:14:54.972875+0000","last_undegraded":"2024-09-10T05:14:54.972875+0000","last_fullsized":"2024-09-10T05:14:54.972875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:54.972735+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:54.972735+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.972735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:47.793245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:41.049439+0000","last_change":"2024-09-10T05:15:41.049375+0000","last_active":"2024-09-10T05:15:41.049439+0000","last_peered":"2024-09-10T05:15:41.049439+0000","last_clean":"2024-09-10T05:15:41.049439+0000","last_became_active":"2024-09-10T05:11:31.736841+0000","last_became_peered":"2024-09-10T05:11:31.736841+0000","last_unstale":"2024-09-10T05:15:41.049439+0000","last_undegraded":"2024-09-10T05:15:41.049439+0000","last_fullsized":"2024-09-10T05:15:41.049439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:41.049287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:41.049287+0000","last_clean_scrub_stamp":"2024-09-10T05:15:41.049287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:48.427927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'50","reported_seq":110,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:30.217436+0000","last_change":"2024-09-10T05:15:30.217359+0000","last_active":"2024-09-10T05:15:30.217436+0000","last_peered":"2024-09-10T05:15:30.217436+0000","last_clean":"2024-09-10T05:15:30.217436+0000","last_became_active":"2024-09-10T05:11:33.744394+0000","last_became_peered":"2024-09-10T05:11:33.744394+0000","last_unstale":"2024-09-10T05:15:30.217436+0000","last_undegraded":"2024-09-10T05:15:30.217436+0000","last_fullsized":"2024-09-10T05:15:30.217436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'50","last_scrub_stamp":"2024-09-10T05:15:30.217260+0000","last_deep_scrub":"37'50","last_deep_scrub_stamp":"2024-09-10T05:15:30.217260+0000","last_clean_scrub_stamp":"2024-09-10T05:15:30.217260+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:35.417233+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:28.646049+0000","last_change":"2024-09-10T05:15:28.645981+0000","last_active":"2024-09-10T05:15:28.646049+0000","last_peered":"2024-09-10T05:15:28.646049+0000","last_clean":"2024-09-10T05:15:28.646049+0000","last_became_active":"2024-09-10T05:11:35.750450+0000","last_became_peered":"2024-09-10T05:11:35.750450+0000","last_unstale":"2024-09-10T05:15:28.646049+0000","last_undegraded":"2024-09-10T05:15:28.646049+0000","last_fullsized":"2024-09-10T05:15:28.646049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:28.645895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:28.645895+0000","last_clean_scrub_stamp":"2024-09-10T05:15:28.645895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:09.716244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'7","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:41.110038+0000","last_change":"2024-09-10T05:15:41.109973+0000","last_active":"2024-09-10T05:15:41.110038+0000","last_peered":"2024-09-10T05:15:41.110038+0000","last_clean":"2024-09-10T05:15:41.110038+0000","last_became_active":"2024-09-10T05:11:37.757289+0000","last_became_peered":"2024-09-10T05:11:37.757289+0000","last_unstale":"2024-09-10T05:15:41.110038+0000","last_undegraded":"2024-09-10T05:15:41.110038+0000","last_fullsized":"2024-09-10T05:15:41.110038+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-10T05:15:41.109884+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-10T05:15:41.109884+0000","last_clean_scrub_stamp":"2024-09-10T05:15:41.109884+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:06.110902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'8","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:16.043784+0000","last_change":"2024-09-10T05:15:16.043718+0000","last_active":"2024-09-10T05:15:16.043784+0000","last_peered":"2024-09-10T05:15:16.043784+0000","last_clean":"2024-09-10T05:15:16.043784+0000","last_became_active":"2024-09-10T05:11:29.734367+0000","last_became_peered":"2024-09-10T05:11:29.734367+0000","last_unstale":"2024-09-10T05:15:16.043784+0000","last_undegraded":"2024-09-10T05:15:16.043784+0000","last_fullsized":"2024-09-10T05:15:16.043784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:16.043611+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:16.043611+0000","last_clean_scrub_stamp":"2024-09-10T05:15:16.043611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:32.661692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":157,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:46.450464+0000","last_change":"2024-09-10T05:14:46.450393+0000","last_active":"2024-09-10T05:14:46.450464+0000","last_peered":"2024-09-10T05:14:46.450464+0000","last_clean":"2024-09-10T05:14:46.450464+0000","last_became_active":"2024-09-10T05:11:14.293121+0000","last_became_peered":"2024-09-10T05:11:14.293121+0000","last_unstale":"2024-09-10T05:14:46.450464+0000","last_undegraded":"2024-09-10T05:14:46.450464+0000","last_fullsized":"2024-09-10T05:14:46.450464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-10T05:14:46.450301+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-10T05:14:46.450301+0000","last_clean_scrub_stamp":"2024-09-10T05:14:46.450301+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:41.127694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.069728+0000","last_change":"2024-09-10T05:14:51.069657+0000","last_active":"2024-09-10T05:14:51.069728+0000","last_peered":"2024-09-10T05:14:51.069728+0000","last_clean":"2024-09-10T05:14:51.069728+0000","last_became_active":"2024-09-10T05:11:16.531926+0000","last_became_peered":"2024-09-10T05:11:16.531926+0000","last_unstale":"2024-09-10T05:14:51.069728+0000","last_undegraded":"2024-09-10T05:14:51.069728+0000","last_fullsized":"2024-09-10T05:14:51.069728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:51.069579+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:51.069579+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.069579+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:40.169755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001121101,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.034338+0000","last_change":"2024-09-10T05:14:52.034277+0000","last_active":"2024-09-10T05:14:52.034338+0000","last_peered":"2024-09-10T05:14:52.034338+0000","last_clean":"2024-09-10T05:14:52.034338+0000","last_became_active":"2024-09-10T05:11:27.735941+0000","last_became_peered":"2024-09-10T05:11:27.735941+0000","last_unstale":"2024-09-10T05:14:52.034338+0000","last_undegraded":"2024-09-10T05:14:52.034338+0000","last_fullsized":"2024-09-10T05:14:52.034338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.034181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.034181+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.034181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:53.640936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.297619+0000","last_change":"2024-09-10T05:15:20.297566+0000","last_active":"2024-09-10T05:15:20.297619+0000","last_peered":"2024-09-10T05:15:20.297619+0000","last_clean":"2024-09-10T05:15:20.297619+0000","last_became_active":"2024-09-10T05:11:31.736104+0000","last_became_peered":"2024-09-10T05:11:31.736104+0000","last_unstale":"2024-09-10T05:15:20.297619+0000","last_undegraded":"2024-09-10T05:15:20.297619+0000","last_fullsized":"2024-09-10T05:15:20.297619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:20.297474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:20.297474+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.297474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:53:10.972123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'100","reported_seq":197,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:47.032260+0000","last_change":"2024-09-10T05:15:47.032180+0000","last_active":"2024-09-10T05:15:47.032260+0000","last_peered":"2024-09-10T05:15:47.032260+0000","last_clean":"2024-09-10T05:15:47.032260+0000","last_became_active":"2024-09-10T05:11:33.743933+0000","last_became_peered":"2024-09-10T05:11:33.743933+0000","last_unstale":"2024-09-10T05:15:47.032260+0000","last_undegraded":"2024-09-10T05:15:47.032260+0000","last_fullsized":"2024-09-10T05:15:47.032260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'100","last_scrub_stamp":"2024-09-10T05:15:47.032063+0000","last_deep_scrub":"37'100","last_deep_scrub_stamp":"2024-09-10T05:15:47.032063+0000","last_clean_scrub_stamp":"2024-09-10T05:15:47.032063+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:09.140156+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:30.587681+0000","last_change":"2024-09-10T05:15:30.587614+0000","last_active":"2024-09-10T05:15:30.587681+0000","last_peered":"2024-09-10T05:15:30.587681+0000","last_clean":"2024-09-10T05:15:30.587681+0000","last_became_active":"2024-09-10T05:11:35.750248+0000","last_became_peered":"2024-09-10T05:11:35.750248+0000","last_unstale":"2024-09-10T05:15:30.587681+0000","last_undegraded":"2024-09-10T05:15:30.587681+0000","last_fullsized":"2024-09-10T05:15:30.587681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:30.587529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:30.587529+0000","last_clean_scrub_stamp":"2024-09-10T05:15:30.587529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:38.060858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'85","reported_seq":176,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:38.717811+0000","last_change":"2024-09-10T05:15:38.717751+0000","last_active":"2024-09-10T05:15:38.717811+0000","last_peered":"2024-09-10T05:15:38.717811+0000","last_clean":"2024-09-10T05:15:38.717811+0000","last_became_active":"2024-09-10T05:11:37.755239+0000","last_became_peered":"2024-09-10T05:11:37.755239+0000","last_unstale":"2024-09-10T05:15:38.717811+0000","last_undegraded":"2024-09-10T05:15:38.717811+0000","last_fullsized":"2024-09-10T05:15:38.717811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'85","last_scrub_stamp":"2024-09-10T05:15:38.717658+0000","last_deep_scrub":"37'85","last_deep_scrub_stamp":"2024-09-10T05:15:38.717658+0000","last_clean_scrub_stamp":"2024-09-10T05:15:38.717658+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:17.546697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":225,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.100559+0000","last_change":"2024-09-10T05:15:18.100459+0000","last_active":"2024-09-10T05:15:18.100559+0000","last_peered":"2024-09-10T05:15:18.100559+0000","last_clean":"2024-09-10T05:15:18.100559+0000","last_became_active":"2024-09-10T05:11:29.732560+0000","last_became_peered":"2024-09-10T05:11:29.732560+0000","last_unstale":"2024-09-10T05:15:18.100559+0000","last_undegraded":"2024-09-10T05:15:18.100559+0000","last_fullsized":"2024-09-10T05:15:18.100559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:18.100314+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:18.100314+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.100314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:05.619104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.116452+0000","last_change":"2024-09-10T05:14:48.116383+0000","last_active":"2024-09-10T05:14:48.116452+0000","last_peered":"2024-09-10T05:14:48.116452+0000","last_clean":"2024-09-10T05:14:48.116452+0000","last_became_active":"2024-09-10T05:11:16.531911+0000","last_became_peered":"2024-09-10T05:11:16.531911+0000","last_unstale":"2024-09-10T05:14:48.116452+0000","last_undegraded":"2024-09-10T05:14:48.116452+0000","last_fullsized":"2024-09-10T05:14:48.116452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.116290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.116290+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.116290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:40.342657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039105900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.545709+0000","last_change":"2024-09-10T05:14:48.545643+0000","last_active":"2024-09-10T05:14:48.545709+0000","last_peered":"2024-09-10T05:14:48.545709+0000","last_clean":"2024-09-10T05:14:48.545709+0000","last_became_active":"2024-09-10T05:11:27.713026+0000","last_became_peered":"2024-09-10T05:11:27.713026+0000","last_unstale":"2024-09-10T05:14:48.545709+0000","last_undegraded":"2024-09-10T05:14:48.545709+0000","last_fullsized":"2024-09-10T05:14:48.545709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:48.545569+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:48.545569+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.545569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:09.108323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:39.033457+0000","last_change":"2024-09-10T05:15:39.033339+0000","last_active":"2024-09-10T05:15:39.033457+0000","last_peered":"2024-09-10T05:15:39.033457+0000","last_clean":"2024-09-10T05:15:39.033457+0000","last_became_active":"2024-09-10T05:11:31.737199+0000","last_became_peered":"2024-09-10T05:11:31.737199+0000","last_unstale":"2024-09-10T05:15:39.033457+0000","last_undegraded":"2024-09-10T05:15:39.033457+0000","last_fullsized":"2024-09-10T05:15:39.033457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:39.033234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:39.033234+0000","last_clean_scrub_stamp":"2024-09-10T05:15:39.033234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:00.913610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'303","reported_seq":534,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:29.204862+0000","last_change":"2024-09-10T05:15:29.204803+0000","last_active":"2024-09-10T05:15:29.204862+0000","last_peered":"2024-09-10T05:15:29.204862+0000","last_clean":"2024-09-10T05:15:29.204862+0000","last_became_active":"2024-09-10T05:11:33.744103+0000","last_became_peered":"2024-09-10T05:11:33.744103+0000","last_unstale":"2024-09-10T05:15:29.204862+0000","last_undegraded":"2024-09-10T05:15:29.204862+0000","last_fullsized":"2024-09-10T05:15:29.204862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'303","last_scrub_stamp":"2024-09-10T05:15:29.204689+0000","last_deep_scrub":"37'303","last_deep_scrub_stamp":"2024-09-10T05:15:29.204689+0000","last_clean_scrub_stamp":"2024-09-10T05:15:29.204689+0000","objects_scrubbed":11,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:40.315728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":393,"num_read_kb":395,"num_write":48,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:59.028079+0000","last_change":"2024-09-10T05:15:59.028079+0000","last_active":"2024-09-10T05:15:59.028079+0000","last_peered":"2024-09-10T05:15:59.028079+0000","last_clean":"2024-09-10T05:15:59.028079+0000","last_became_active":"2024-09-10T05:11:35.748767+0000","last_became_peered":"2024-09-10T05:11:35.748767+0000","last_unstale":"2024-09-10T05:15:59.028079+0000","last_undegraded":"2024-09-10T05:15:59.028079+0000","last_fullsized":"2024-09-10T05:15:59.028079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:59.027964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:59.027964+0000","last_clean_scrub_stamp":"2024-09-10T05:15:59.027964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:48.516154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:43.139099+0000","last_change":"2024-09-10T05:15:43.139042+0000","last_active":"2024-09-10T05:15:43.139099+0000","last_peered":"2024-09-10T05:15:43.139099+0000","last_clean":"2024-09-10T05:15:43.139099+0000","last_became_active":"2024-09-10T05:11:37.758114+0000","last_became_peered":"2024-09-10T05:11:37.758114+0000","last_unstale":"2024-09-10T05:15:43.139099+0000","last_undegraded":"2024-09-10T05:15:43.139099+0000","last_fullsized":"2024-09-10T05:15:43.139099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:15:43.138964+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:15:43.138964+0000","last_clean_scrub_stamp":"2024-09-10T05:15:43.138964+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:43.209895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'14","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.455557+0000","last_change":"2024-09-10T05:15:02.455496+0000","last_active":"2024-09-10T05:15:02.455557+0000","last_peered":"2024-09-10T05:15:02.455557+0000","last_clean":"2024-09-10T05:15:02.455557+0000","last_became_active":"2024-09-10T05:11:29.723609+0000","last_became_peered":"2024-09-10T05:11:29.723609+0000","last_unstale":"2024-09-10T05:15:02.455557+0000","last_undegraded":"2024-09-10T05:15:02.455557+0000","last_fullsized":"2024-09-10T05:15:02.455557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:02.455410+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:02.455410+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.455410+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:08.842470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.698496+0000","last_change":"2024-09-10T05:14:48.698433+0000","last_active":"2024-09-10T05:14:48.698496+0000","last_peered":"2024-09-10T05:14:48.698496+0000","last_clean":"2024-09-10T05:14:48.698496+0000","last_became_active":"2024-09-10T05:11:16.530448+0000","last_became_peered":"2024-09-10T05:11:16.530448+0000","last_unstale":"2024-09-10T05:14:48.698496+0000","last_undegraded":"2024-09-10T05:14:48.698496+0000","last_fullsized":"2024-09-10T05:14:48.698496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.698352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.698352+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.698352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:12.098710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036982300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.508575+0000","last_change":"2024-09-10T05:14:47.508513+0000","last_active":"2024-09-10T05:14:47.508575+0000","last_peered":"2024-09-10T05:14:47.508575+0000","last_clean":"2024-09-10T05:14:47.508575+0000","last_became_active":"2024-09-10T05:11:27.714299+0000","last_became_peered":"2024-09-10T05:11:27.714299+0000","last_unstale":"2024-09-10T05:14:47.508575+0000","last_undegraded":"2024-09-10T05:14:47.508575+0000","last_fullsized":"2024-09-10T05:14:47.508575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:14:47.508436+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:14:47.508436+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.508436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:06.719872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:15.694025+0000","last_change":"2024-09-10T05:15:15.693954+0000","last_active":"2024-09-10T05:15:15.694025+0000","last_peered":"2024-09-10T05:15:15.694025+0000","last_clean":"2024-09-10T05:15:15.694025+0000","last_became_active":"2024-09-10T05:11:31.730978+0000","last_became_peered":"2024-09-10T05:11:31.730978+0000","last_unstale":"2024-09-10T05:15:15.694025+0000","last_undegraded":"2024-09-10T05:15:15.694025+0000","last_fullsized":"2024-09-10T05:15:15.694025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:15.693862+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:15.693862+0000","last_clean_scrub_stamp":"2024-09-10T05:15:15.693862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:07.673571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'25","reported_seq":102,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.710113+0000","last_change":"2024-09-10T05:15:23.710054+0000","last_active":"2024-09-10T05:15:23.710113+0000","last_peered":"2024-09-10T05:15:23.710113+0000","last_clean":"2024-09-10T05:15:23.710113+0000","last_became_active":"2024-09-10T05:11:33.746102+0000","last_became_peered":"2024-09-10T05:11:33.746102+0000","last_unstale":"2024-09-10T05:15:23.710113+0000","last_undegraded":"2024-09-10T05:15:23.710113+0000","last_fullsized":"2024-09-10T05:15:23.710113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'25","last_scrub_stamp":"2024-09-10T05:15:23.709956+0000","last_deep_scrub":"37'25","last_deep_scrub_stamp":"2024-09-10T05:15:23.709956+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.709956+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:46:03.932613+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:29.636148+0000","last_change":"2024-09-10T05:15:29.636086+0000","last_active":"2024-09-10T05:15:29.636148+0000","last_peered":"2024-09-10T05:15:29.636148+0000","last_clean":"2024-09-10T05:15:29.636148+0000","last_became_active":"2024-09-10T05:11:35.753342+0000","last_became_peered":"2024-09-10T05:11:35.753342+0000","last_unstale":"2024-09-10T05:15:29.636148+0000","last_undegraded":"2024-09-10T05:15:29.636148+0000","last_fullsized":"2024-09-10T05:15:29.636148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:29.635990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:29.635990+0000","last_clean_scrub_stamp":"2024-09-10T05:15:29.635990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:08.235675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"35'2","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:06.086502+0000","last_change":"2024-09-10T05:16:06.086443+0000","last_active":"2024-09-10T05:16:06.086502+0000","last_peered":"2024-09-10T05:16:06.086502+0000","last_clean":"2024-09-10T05:16:06.086502+0000","last_became_active":"2024-09-10T05:11:37.767788+0000","last_became_peered":"2024-09-10T05:11:37.767788+0000","last_unstale":"2024-09-10T05:16:06.086502+0000","last_undegraded":"2024-09-10T05:16:06.086502+0000","last_fullsized":"2024-09-10T05:16:06.086502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:16:06.086339+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:16:06.086339+0000","last_clean_scrub_stamp":"2024-09-10T05:16:06.086339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:34:03.018760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.435961+0000","last_change":"2024-09-10T05:15:01.435853+0000","last_active":"2024-09-10T05:15:01.435961+0000","last_peered":"2024-09-10T05:15:01.435961+0000","last_clean":"2024-09-10T05:15:01.435961+0000","last_became_active":"2024-09-10T05:11:29.727022+0000","last_became_peered":"2024-09-10T05:11:29.727022+0000","last_unstale":"2024-09-10T05:15:01.435961+0000","last_undegraded":"2024-09-10T05:15:01.435961+0000","last_fullsized":"2024-09-10T05:15:01.435961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:01.435758+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:01.435758+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.435758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:15.080229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.096802+0000","last_change":"2024-09-10T05:14:49.096748+0000","last_active":"2024-09-10T05:14:49.096802+0000","last_peered":"2024-09-10T05:14:49.096802+0000","last_clean":"2024-09-10T05:14:49.096802+0000","last_became_active":"2024-09-10T05:11:16.530756+0000","last_became_peered":"2024-09-10T05:11:16.530756+0000","last_unstale":"2024-09-10T05:14:49.096802+0000","last_undegraded":"2024-09-10T05:14:49.096802+0000","last_fullsized":"2024-09-10T05:14:49.096802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:14:49.096654+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:14:49.096654+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.096654+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:56.602270+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001047784,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.744820+0000","last_change":"2024-09-10T05:14:47.744764+0000","last_active":"2024-09-10T05:14:47.744820+0000","last_peered":"2024-09-10T05:14:47.744820+0000","last_clean":"2024-09-10T05:14:47.744820+0000","last_became_active":"2024-09-10T05:11:27.718333+0000","last_became_peered":"2024-09-10T05:11:27.718333+0000","last_unstale":"2024-09-10T05:14:47.744820+0000","last_undegraded":"2024-09-10T05:14:47.744820+0000","last_fullsized":"2024-09-10T05:14:47.744820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:47.744665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:47.744665+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.744665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:14.527839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.760244+0000","last_change":"2024-09-10T05:15:12.760190+0000","last_active":"2024-09-10T05:15:12.760244+0000","last_peered":"2024-09-10T05:15:12.760244+0000","last_clean":"2024-09-10T05:15:12.760244+0000","last_became_active":"2024-09-10T05:12:04.964996+0000","last_became_peered":"2024-09-10T05:12:04.964996+0000","last_unstale":"2024-09-10T05:15:12.760244+0000","last_undegraded":"2024-09-10T05:15:12.760244+0000","last_fullsized":"2024-09-10T05:15:12.760244+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:12.760098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:12.760098+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.760098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:29.723294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"37'20","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:46.020779+0000","last_change":"2024-09-10T05:15:46.020657+0000","last_active":"2024-09-10T05:15:46.020779+0000","last_peered":"2024-09-10T05:15:46.020779+0000","last_clean":"2024-09-10T05:15:46.020779+0000","last_became_active":"2024-09-10T05:11:33.743292+0000","last_became_peered":"2024-09-10T05:11:33.743292+0000","last_unstale":"2024-09-10T05:15:46.020779+0000","last_undegraded":"2024-09-10T05:15:46.020779+0000","last_fullsized":"2024-09-10T05:15:46.020779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20","last_scrub_stamp":"2024-09-10T05:15:46.020536+0000","last_deep_scrub":"37'20","last_deep_scrub_stamp":"2024-09-10T05:15:46.020536+0000","last_clean_scrub_stamp":"2024-09-10T05:15:46.020536+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:09.384528+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:57.105430+0000","last_change":"2024-09-10T05:15:57.105430+0000","last_active":"2024-09-10T05:15:57.105430+0000","last_peered":"2024-09-10T05:15:57.105430+0000","last_clean":"2024-09-10T05:15:57.105430+0000","last_became_active":"2024-09-10T05:11:35.751982+0000","last_became_peered":"2024-09-10T05:11:35.751982+0000","last_unstale":"2024-09-10T05:15:57.105430+0000","last_undegraded":"2024-09-10T05:15:57.105430+0000","last_fullsized":"2024-09-10T05:15:57.105430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:57.105306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:57.105306+0000","last_clean_scrub_stamp":"2024-09-10T05:15:57.105306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:42.117238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:42.135922+0000","last_change":"2024-09-10T05:15:42.135829+0000","last_active":"2024-09-10T05:15:42.135922+0000","last_peered":"2024-09-10T05:15:42.135922+0000","last_clean":"2024-09-10T05:15:42.135922+0000","last_became_active":"2024-09-10T05:11:37.762327+0000","last_became_peered":"2024-09-10T05:11:37.762327+0000","last_unstale":"2024-09-10T05:15:42.135922+0000","last_undegraded":"2024-09-10T05:15:42.135922+0000","last_fullsized":"2024-09-10T05:15:42.135922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:42.135733+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:42.135733+0000","last_clean_scrub_stamp":"2024-09-10T05:15:42.135733+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:18.247769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'16","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.437539+0000","last_change":"2024-09-10T05:15:00.437426+0000","last_active":"2024-09-10T05:15:00.437539+0000","last_peered":"2024-09-10T05:15:00.437539+0000","last_clean":"2024-09-10T05:15:00.437539+0000","last_became_active":"2024-09-10T05:11:29.730589+0000","last_became_peered":"2024-09-10T05:11:29.730589+0000","last_unstale":"2024-09-10T05:15:00.437539+0000","last_undegraded":"2024-09-10T05:15:00.437539+0000","last_fullsized":"2024-09-10T05:15:00.437539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:00.437305+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:00.437305+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.437305+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:23:10.739442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.660396+0000","last_change":"2024-09-10T05:14:49.660336+0000","last_active":"2024-09-10T05:14:49.660396+0000","last_peered":"2024-09-10T05:14:49.660396+0000","last_clean":"2024-09-10T05:14:49.660396+0000","last_became_active":"2024-09-10T05:11:27.716023+0000","last_became_peered":"2024-09-10T05:11:27.716023+0000","last_unstale":"2024-09-10T05:14:49.660396+0000","last_undegraded":"2024-09-10T05:14:49.660396+0000","last_fullsized":"2024-09-10T05:14:49.660396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:49.660254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:49.660254+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.660254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:37.581398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:46.486507+0000","last_change":"2024-09-10T05:14:46.486459+0000","last_active":"2024-09-10T05:14:46.486507+0000","last_peered":"2024-09-10T05:14:46.486507+0000","last_clean":"2024-09-10T05:14:46.486507+0000","last_became_active":"2024-09-10T05:11:16.532795+0000","last_became_peered":"2024-09-10T05:11:16.532795+0000","last_unstale":"2024-09-10T05:14:46.486507+0000","last_undegraded":"2024-09-10T05:14:46.486507+0000","last_fullsized":"2024-09-10T05:14:46.486507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:46.486390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:46.486390+0000","last_clean_scrub_stamp":"2024-09-10T05:14:46.486390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:24.690009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060128199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.692331+0000","last_change":"2024-09-10T05:15:17.692271+0000","last_active":"2024-09-10T05:15:17.692331+0000","last_peered":"2024-09-10T05:15:17.692331+0000","last_clean":"2024-09-10T05:15:17.692331+0000","last_became_active":"2024-09-10T05:11:31.734707+0000","last_became_peered":"2024-09-10T05:11:31.734707+0000","last_unstale":"2024-09-10T05:15:17.692331+0000","last_undegraded":"2024-09-10T05:15:17.692331+0000","last_fullsized":"2024-09-10T05:15:17.692331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:17.692187+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:17.692187+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.692187+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:34:44.621445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'90","reported_seq":179,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:22.758226+0000","last_change":"2024-09-10T05:15:22.758130+0000","last_active":"2024-09-10T05:15:22.758226+0000","last_peered":"2024-09-10T05:15:22.758226+0000","last_clean":"2024-09-10T05:15:22.758226+0000","last_became_active":"2024-09-10T05:11:33.743238+0000","last_became_peered":"2024-09-10T05:11:33.743238+0000","last_unstale":"2024-09-10T05:15:22.758226+0000","last_undegraded":"2024-09-10T05:15:22.758226+0000","last_fullsized":"2024-09-10T05:15:22.758226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'90","last_scrub_stamp":"2024-09-10T05:15:22.758015+0000","last_deep_scrub":"37'90","last_deep_scrub_stamp":"2024-09-10T05:15:22.758015+0000","last_clean_scrub_stamp":"2024-09-10T05:15:22.758015+0000","objects_scrubbed":11,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:54:47.346297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:29.688075+0000","last_change":"2024-09-10T05:15:29.688020+0000","last_active":"2024-09-10T05:15:29.688075+0000","last_peered":"2024-09-10T05:15:29.688075+0000","last_clean":"2024-09-10T05:15:29.688075+0000","last_became_active":"2024-09-10T05:11:35.750830+0000","last_became_peered":"2024-09-10T05:11:35.750830+0000","last_unstale":"2024-09-10T05:15:29.688075+0000","last_undegraded":"2024-09-10T05:15:29.688075+0000","last_fullsized":"2024-09-10T05:15:29.688075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:29.687940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:29.687940+0000","last_clean_scrub_stamp":"2024-09-10T05:15:29.687940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:14.996480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:42.597763+0000","last_change":"2024-09-10T05:15:42.597661+0000","last_active":"2024-09-10T05:15:42.597763+0000","last_peered":"2024-09-10T05:15:42.597763+0000","last_clean":"2024-09-10T05:15:42.597763+0000","last_became_active":"2024-09-10T05:11:37.758971+0000","last_became_peered":"2024-09-10T05:11:37.758971+0000","last_unstale":"2024-09-10T05:15:42.597763+0000","last_undegraded":"2024-09-10T05:15:42.597763+0000","last_fullsized":"2024-09-10T05:15:42.597763+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-10T05:15:42.597524+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-10T05:15:42.597524+0000","last_clean_scrub_stamp":"2024-09-10T05:15:42.597524+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:11.776658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'14","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:01.389673+0000","last_change":"2024-09-10T05:15:01.389613+0000","last_active":"2024-09-10T05:15:01.389673+0000","last_peered":"2024-09-10T05:15:01.389673+0000","last_clean":"2024-09-10T05:15:01.389673+0000","last_became_active":"2024-09-10T05:11:29.729340+0000","last_became_peered":"2024-09-10T05:11:29.729340+0000","last_unstale":"2024-09-10T05:15:01.389673+0000","last_undegraded":"2024-09-10T05:15:01.389673+0000","last_fullsized":"2024-09-10T05:15:01.389673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:01.389524+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:01.389524+0000","last_clean_scrub_stamp":"2024-09-10T05:15:01.389524+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:15.262748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.500548+0000","last_change":"2024-09-10T05:14:50.500467+0000","last_active":"2024-09-10T05:14:50.500548+0000","last_peered":"2024-09-10T05:14:50.500548+0000","last_clean":"2024-09-10T05:14:50.500548+0000","last_became_active":"2024-09-10T05:11:27.718756+0000","last_became_peered":"2024-09-10T05:11:27.718756+0000","last_unstale":"2024-09-10T05:14:50.500548+0000","last_undegraded":"2024-09-10T05:14:50.500548+0000","last_fullsized":"2024-09-10T05:14:50.500548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.500341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.500341+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.500341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:21.655128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.083367+0000","last_change":"2024-09-10T05:14:50.083297+0000","last_active":"2024-09-10T05:14:50.083367+0000","last_peered":"2024-09-10T05:14:50.083367+0000","last_clean":"2024-09-10T05:14:50.083367+0000","last_became_active":"2024-09-10T05:11:16.530746+0000","last_became_peered":"2024-09-10T05:11:16.530746+0000","last_unstale":"2024-09-10T05:14:50.083367+0000","last_undegraded":"2024-09-10T05:14:50.083367+0000","last_fullsized":"2024-09-10T05:14:50.083367+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.083200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.083200+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.083200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:05.779343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048256999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:38.012117+0000","last_change":"2024-09-10T05:15:38.012028+0000","last_active":"2024-09-10T05:15:38.012117+0000","last_peered":"2024-09-10T05:15:38.012117+0000","last_clean":"2024-09-10T05:15:38.012117+0000","last_became_active":"2024-09-10T05:11:31.734333+0000","last_became_peered":"2024-09-10T05:11:31.734333+0000","last_unstale":"2024-09-10T05:15:38.012117+0000","last_undegraded":"2024-09-10T05:15:38.012117+0000","last_fullsized":"2024-09-10T05:15:38.012117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:38.011934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:38.011934+0000","last_clean_scrub_stamp":"2024-09-10T05:15:38.011934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:40.284016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"37'29","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.269623+0000","last_change":"2024-09-10T05:15:27.269561+0000","last_active":"2024-09-10T05:15:27.269623+0000","last_peered":"2024-09-10T05:15:27.269623+0000","last_clean":"2024-09-10T05:15:27.269623+0000","last_became_active":"2024-09-10T05:11:33.744011+0000","last_became_peered":"2024-09-10T05:11:33.744011+0000","last_unstale":"2024-09-10T05:15:27.269623+0000","last_undegraded":"2024-09-10T05:15:27.269623+0000","last_fullsized":"2024-09-10T05:15:27.269623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'29","last_scrub_stamp":"2024-09-10T05:15:27.269468+0000","last_deep_scrub":"37'29","last_deep_scrub_stamp":"2024-09-10T05:15:27.269468+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.269468+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:28.915634+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'286","reported_seq":359,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.192783+0000","last_change":"2024-09-10T05:15:34.192731+0000","last_active":"2024-09-10T05:15:34.192783+0000","last_peered":"2024-09-10T05:15:34.192783+0000","last_clean":"2024-09-10T05:15:34.192783+0000","last_became_active":"2024-09-10T05:11:35.743571+0000","last_became_peered":"2024-09-10T05:11:35.743571+0000","last_unstale":"2024-09-10T05:15:34.192783+0000","last_undegraded":"2024-09-10T05:15:34.192783+0000","last_fullsized":"2024-09-10T05:15:34.192783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:34.192645+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:34.192645+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.192645+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:41.449001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:07.077056+0000","last_change":"2024-09-10T05:16:07.076987+0000","last_active":"2024-09-10T05:16:07.077056+0000","last_peered":"2024-09-10T05:16:07.077056+0000","last_clean":"2024-09-10T05:16:07.077056+0000","last_became_active":"2024-09-10T05:11:37.764657+0000","last_became_peered":"2024-09-10T05:11:37.764657+0000","last_unstale":"2024-09-10T05:16:07.077056+0000","last_undegraded":"2024-09-10T05:16:07.077056+0000","last_fullsized":"2024-09-10T05:16:07.077056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:16:07.076901+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:16:07.076901+0000","last_clean_scrub_stamp":"2024-09-10T05:16:07.076901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:17.356339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.069015+0000","last_change":"2024-09-10T05:15:17.068949+0000","last_active":"2024-09-10T05:15:17.069015+0000","last_peered":"2024-09-10T05:15:17.069015+0000","last_clean":"2024-09-10T05:15:17.069015+0000","last_became_active":"2024-09-10T05:11:29.734731+0000","last_became_peered":"2024-09-10T05:11:29.734731+0000","last_unstale":"2024-09-10T05:15:17.069015+0000","last_undegraded":"2024-09-10T05:15:17.069015+0000","last_fullsized":"2024-09-10T05:15:17.069015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:17.068869+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:17.068869+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.068869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:24.980749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.997220+0000","last_change":"2024-09-10T05:14:53.997163+0000","last_active":"2024-09-10T05:14:53.997220+0000","last_peered":"2024-09-10T05:14:53.997220+0000","last_clean":"2024-09-10T05:14:53.997220+0000","last_became_active":"2024-09-10T05:11:27.723268+0000","last_became_peered":"2024-09-10T05:11:27.723268+0000","last_unstale":"2024-09-10T05:14:53.997220+0000","last_undegraded":"2024-09-10T05:14:53.997220+0000","last_fullsized":"2024-09-10T05:14:53.997220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.997077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.997077+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.997077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:30.512459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.499303+0000","last_change":"2024-09-10T05:14:53.499227+0000","last_active":"2024-09-10T05:14:53.499303+0000","last_peered":"2024-09-10T05:14:53.499303+0000","last_clean":"2024-09-10T05:14:53.499303+0000","last_became_active":"2024-09-10T05:11:16.531550+0000","last_became_peered":"2024-09-10T05:11:16.531550+0000","last_unstale":"2024-09-10T05:14:53.499303+0000","last_undegraded":"2024-09-10T05:14:53.499303+0000","last_fullsized":"2024-09-10T05:14:53.499303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:53.499101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:53.499101+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.499101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:59:02.083006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00063503699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:36.995729+0000","last_change":"2024-09-10T05:15:36.995651+0000","last_active":"2024-09-10T05:15:36.995729+0000","last_peered":"2024-09-10T05:15:36.995729+0000","last_clean":"2024-09-10T05:15:36.995729+0000","last_became_active":"2024-09-10T05:11:31.734310+0000","last_became_peered":"2024-09-10T05:11:31.734310+0000","last_unstale":"2024-09-10T05:15:36.995729+0000","last_undegraded":"2024-09-10T05:15:36.995729+0000","last_fullsized":"2024-09-10T05:15:36.995729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:36.995574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:36.995574+0000","last_clean_scrub_stamp":"2024-09-10T05:15:36.995574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:51.268902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'23","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:45.041432+0000","last_change":"2024-09-10T05:15:45.041358+0000","last_active":"2024-09-10T05:15:45.041432+0000","last_peered":"2024-09-10T05:15:45.041432+0000","last_clean":"2024-09-10T05:15:45.041432+0000","last_became_active":"2024-09-10T05:11:33.748603+0000","last_became_peered":"2024-09-10T05:11:33.748603+0000","last_unstale":"2024-09-10T05:15:45.041432+0000","last_undegraded":"2024-09-10T05:15:45.041432+0000","last_fullsized":"2024-09-10T05:15:45.041432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'23","last_scrub_stamp":"2024-09-10T05:15:45.041266+0000","last_deep_scrub":"37'23","last_deep_scrub_stamp":"2024-09-10T05:15:45.041266+0000","last_clean_scrub_stamp":"2024-09-10T05:15:45.041266+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:23.170240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'286","reported_seq":402,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:32.599810+0000","last_change":"2024-09-10T05:15:32.599749+0000","last_active":"2024-09-10T05:15:32.599810+0000","last_peered":"2024-09-10T05:15:32.599810+0000","last_clean":"2024-09-10T05:15:32.599810+0000","last_became_active":"2024-09-10T05:11:35.745807+0000","last_became_peered":"2024-09-10T05:11:35.745807+0000","last_unstale":"2024-09-10T05:15:32.599810+0000","last_undegraded":"2024-09-10T05:15:32.599810+0000","last_fullsized":"2024-09-10T05:15:32.599810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:32.599633+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:32.599633+0000","last_clean_scrub_stamp":"2024-09-10T05:15:32.599633+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:25.495767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"35'3","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:44.152879+0000","last_change":"2024-09-10T05:15:44.152788+0000","last_active":"2024-09-10T05:15:44.152879+0000","last_peered":"2024-09-10T05:15:44.152879+0000","last_clean":"2024-09-10T05:15:44.152879+0000","last_became_active":"2024-09-10T05:11:37.762407+0000","last_became_peered":"2024-09-10T05:11:37.762407+0000","last_unstale":"2024-09-10T05:15:44.152879+0000","last_undegraded":"2024-09-10T05:15:44.152879+0000","last_fullsized":"2024-09-10T05:15:44.152879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-10T05:15:44.152676+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-10T05:15:44.152676+0000","last_clean_scrub_stamp":"2024-09-10T05:15:44.152676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:11:01.228571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.609490+0000","last_change":"2024-09-10T05:15:03.609389+0000","last_active":"2024-09-10T05:15:03.609490+0000","last_peered":"2024-09-10T05:15:03.609490+0000","last_clean":"2024-09-10T05:15:03.609490+0000","last_became_active":"2024-09-10T05:11:29.730285+0000","last_became_peered":"2024-09-10T05:11:29.730285+0000","last_unstale":"2024-09-10T05:15:03.609490+0000","last_undegraded":"2024-09-10T05:15:03.609490+0000","last_fullsized":"2024-09-10T05:15:03.609490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.609295+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.609295+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.609295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:48.096904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:47.429097+0000","last_change":"2024-09-10T05:14:47.429038+0000","last_active":"2024-09-10T05:14:47.429097+0000","last_peered":"2024-09-10T05:14:47.429097+0000","last_clean":"2024-09-10T05:14:47.429097+0000","last_became_active":"2024-09-10T05:11:27.731108+0000","last_became_peered":"2024-09-10T05:11:27.731108+0000","last_unstale":"2024-09-10T05:14:47.429097+0000","last_undegraded":"2024-09-10T05:14:47.429097+0000","last_fullsized":"2024-09-10T05:14:47.429097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:47.428954+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:47.428954+0000","last_clean_scrub_stamp":"2024-09-10T05:14:47.428954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:33.646520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.995787+0000","last_change":"2024-09-10T05:14:52.995705+0000","last_active":"2024-09-10T05:14:52.995787+0000","last_peered":"2024-09-10T05:14:52.995787+0000","last_clean":"2024-09-10T05:14:52.995787+0000","last_became_active":"2024-09-10T05:11:16.531468+0000","last_became_peered":"2024-09-10T05:11:16.531468+0000","last_unstale":"2024-09-10T05:14:52.995787+0000","last_undegraded":"2024-09-10T05:14:52.995787+0000","last_fullsized":"2024-09-10T05:14:52.995787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.995618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.995618+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.995618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:43.970590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001329722,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.962538+0000","last_change":"2024-09-10T05:15:34.962538+0000","last_active":"2024-09-10T05:15:34.962538+0000","last_peered":"2024-09-10T05:15:34.962538+0000","last_clean":"2024-09-10T05:15:34.962538+0000","last_became_active":"2024-09-10T05:11:31.732753+0000","last_became_peered":"2024-09-10T05:11:31.732753+0000","last_unstale":"2024-09-10T05:15:34.962538+0000","last_undegraded":"2024-09-10T05:15:34.962538+0000","last_fullsized":"2024-09-10T05:15:34.962538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:34.962423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:34.962423+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.962423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:12.195846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'106","reported_seq":206,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.713783+0000","last_change":"2024-09-10T05:15:21.713723+0000","last_active":"2024-09-10T05:15:21.713783+0000","last_peered":"2024-09-10T05:15:21.713783+0000","last_clean":"2024-09-10T05:15:21.713783+0000","last_became_active":"2024-09-10T05:11:33.744217+0000","last_became_peered":"2024-09-10T05:11:33.744217+0000","last_unstale":"2024-09-10T05:15:21.713783+0000","last_undegraded":"2024-09-10T05:15:21.713783+0000","last_fullsized":"2024-09-10T05:15:21.713783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'106","last_scrub_stamp":"2024-09-10T05:15:21.713617+0000","last_deep_scrub":"37'106","last_deep_scrub_stamp":"2024-09-10T05:15:21.713617+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.713617+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:18.813436+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:28.623214+0000","last_change":"2024-09-10T05:15:28.623134+0000","last_active":"2024-09-10T05:15:28.623214+0000","last_peered":"2024-09-10T05:15:28.623214+0000","last_clean":"2024-09-10T05:15:28.623214+0000","last_became_active":"2024-09-10T05:11:35.747924+0000","last_became_peered":"2024-09-10T05:11:35.747924+0000","last_unstale":"2024-09-10T05:15:28.623214+0000","last_undegraded":"2024-09-10T05:15:28.623214+0000","last_fullsized":"2024-09-10T05:15:28.623214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:28.623034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:28.623034+0000","last_clean_scrub_stamp":"2024-09-10T05:15:28.623034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:48.440071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:37.686563+0000","last_change":"2024-09-10T05:15:37.686465+0000","last_active":"2024-09-10T05:15:37.686563+0000","last_peered":"2024-09-10T05:15:37.686563+0000","last_clean":"2024-09-10T05:15:37.686563+0000","last_became_active":"2024-09-10T05:11:37.757947+0000","last_became_peered":"2024-09-10T05:11:37.757947+0000","last_unstale":"2024-09-10T05:15:37.686563+0000","last_undegraded":"2024-09-10T05:15:37.686563+0000","last_fullsized":"2024-09-10T05:15:37.686563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:37.686363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:37.686363+0000","last_clean_scrub_stamp":"2024-09-10T05:15:37.686363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:06.623851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:40.805500+0000","last_change":"2024-09-10T05:15:40.805413+0000","last_active":"2024-09-10T05:15:40.805500+0000","last_peered":"2024-09-10T05:15:40.805500+0000","last_clean":"2024-09-10T05:15:40.805500+0000","last_became_active":"2024-09-10T05:11:37.759217+0000","last_became_peered":"2024-09-10T05:11:37.759217+0000","last_unstale":"2024-09-10T05:15:40.805500+0000","last_undegraded":"2024-09-10T05:15:40.805500+0000","last_fullsized":"2024-09-10T05:15:40.805500+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:40.805307+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:40.805307+0000","last_clean_scrub_stamp":"2024-09-10T05:15:40.805307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:46.454929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'12","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:06.623191+0000","last_change":"2024-09-10T05:15:06.623135+0000","last_active":"2024-09-10T05:15:06.623191+0000","last_peered":"2024-09-10T05:15:06.623191+0000","last_clean":"2024-09-10T05:15:06.623191+0000","last_became_active":"2024-09-10T05:11:29.730105+0000","last_became_peered":"2024-09-10T05:11:29.730105+0000","last_unstale":"2024-09-10T05:15:06.623191+0000","last_undegraded":"2024-09-10T05:15:06.623191+0000","last_fullsized":"2024-09-10T05:15:06.623191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-10T05:15:06.623056+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-10T05:15:06.623056+0000","last_clean_scrub_stamp":"2024-09-10T05:15:06.623056+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:01.300449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:00.953684+0000","last_change":"2024-09-10T05:15:00.953621+0000","last_active":"2024-09-10T05:15:00.953684+0000","last_peered":"2024-09-10T05:15:00.953684+0000","last_clean":"2024-09-10T05:15:00.953684+0000","last_became_active":"2024-09-10T05:11:27.731634+0000","last_became_peered":"2024-09-10T05:11:27.731634+0000","last_unstale":"2024-09-10T05:15:00.953684+0000","last_undegraded":"2024-09-10T05:15:00.953684+0000","last_fullsized":"2024-09-10T05:15:00.953684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:00.953536+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:00.953536+0000","last_clean_scrub_stamp":"2024-09-10T05:15:00.953536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:25.954553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.266832+0000","last_change":"2024-09-10T05:15:23.266780+0000","last_active":"2024-09-10T05:15:23.266832+0000","last_peered":"2024-09-10T05:15:23.266832+0000","last_clean":"2024-09-10T05:15:23.266832+0000","last_became_active":"2024-09-10T05:12:04.967513+0000","last_became_peered":"2024-09-10T05:12:04.967513+0000","last_unstale":"2024-09-10T05:15:23.266832+0000","last_undegraded":"2024-09-10T05:15:23.266832+0000","last_fullsized":"2024-09-10T05:15:23.266832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:23.266688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:23.266688+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.266688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:14:49.877447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'48","reported_seq":111,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:54.059013+0000","last_change":"2024-09-10T05:15:54.058942+0000","last_active":"2024-09-10T05:15:54.059013+0000","last_peered":"2024-09-10T05:15:54.059013+0000","last_clean":"2024-09-10T05:15:54.059013+0000","last_became_active":"2024-09-10T05:11:33.745347+0000","last_became_peered":"2024-09-10T05:11:33.745347+0000","last_unstale":"2024-09-10T05:15:54.059013+0000","last_undegraded":"2024-09-10T05:15:54.059013+0000","last_fullsized":"2024-09-10T05:15:54.059013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'48","last_scrub_stamp":"2024-09-10T05:15:54.058853+0000","last_deep_scrub":"37'48","last_deep_scrub_stamp":"2024-09-10T05:15:54.058853+0000","last_clean_scrub_stamp":"2024-09-10T05:15:54.058853+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:43.941270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:01.097353+0000","last_change":"2024-09-10T05:16:01.097289+0000","last_active":"2024-09-10T05:16:01.097353+0000","last_peered":"2024-09-10T05:16:01.097353+0000","last_clean":"2024-09-10T05:16:01.097353+0000","last_became_active":"2024-09-10T05:11:35.754318+0000","last_became_peered":"2024-09-10T05:11:35.754318+0000","last_unstale":"2024-09-10T05:16:01.097353+0000","last_undegraded":"2024-09-10T05:16:01.097353+0000","last_fullsized":"2024-09-10T05:16:01.097353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:16:01.097209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:16:01.097209+0000","last_clean_scrub_stamp":"2024-09-10T05:16:01.097209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:57.897010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:47.616065+0000","last_change":"2024-09-10T05:15:47.616065+0000","last_active":"2024-09-10T05:15:47.616065+0000","last_peered":"2024-09-10T05:15:47.616065+0000","last_clean":"2024-09-10T05:15:47.616065+0000","last_became_active":"2024-09-10T05:11:37.760471+0000","last_became_peered":"2024-09-10T05:11:37.760471+0000","last_unstale":"2024-09-10T05:15:47.616065+0000","last_undegraded":"2024-09-10T05:15:47.616065+0000","last_fullsized":"2024-09-10T05:15:47.616065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:15:47.615986+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:15:47.615986+0000","last_clean_scrub_stamp":"2024-09-10T05:15:47.615986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:39.421431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:06.365915+0000","last_change":"2024-09-10T05:15:06.365828+0000","last_active":"2024-09-10T05:15:06.365915+0000","last_peered":"2024-09-10T05:15:06.365915+0000","last_clean":"2024-09-10T05:15:06.365915+0000","last_became_active":"2024-09-10T05:11:29.727550+0000","last_became_peered":"2024-09-10T05:11:29.727550+0000","last_unstale":"2024-09-10T05:15:06.365915+0000","last_undegraded":"2024-09-10T05:15:06.365915+0000","last_fullsized":"2024-09-10T05:15:06.365915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:06.365720+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:06.365720+0000","last_clean_scrub_stamp":"2024-09-10T05:15:06.365720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:23.986492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.731123+0000","last_change":"2024-09-10T05:14:51.731049+0000","last_active":"2024-09-10T05:14:51.731123+0000","last_peered":"2024-09-10T05:14:51.731123+0000","last_clean":"2024-09-10T05:14:51.731123+0000","last_became_active":"2024-09-10T05:11:27.724637+0000","last_became_peered":"2024-09-10T05:11:27.724637+0000","last_unstale":"2024-09-10T05:14:51.731123+0000","last_undegraded":"2024-09-10T05:14:51.731123+0000","last_fullsized":"2024-09-10T05:14:51.731123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:51.730965+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:51.730965+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.730965+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:07.979601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:42.019378+0000","last_change":"2024-09-10T05:15:42.019303+0000","last_active":"2024-09-10T05:15:42.019378+0000","last_peered":"2024-09-10T05:15:42.019378+0000","last_clean":"2024-09-10T05:15:42.019378+0000","last_became_active":"2024-09-10T05:11:31.736758+0000","last_became_peered":"2024-09-10T05:11:31.736758+0000","last_unstale":"2024-09-10T05:15:42.019378+0000","last_undegraded":"2024-09-10T05:15:42.019378+0000","last_fullsized":"2024-09-10T05:15:42.019378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:42.019205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:42.019205+0000","last_clean_scrub_stamp":"2024-09-10T05:15:42.019205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:35.436605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'9","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:23.744538+0000","last_change":"2024-09-10T05:15:23.744425+0000","last_active":"2024-09-10T05:15:23.744538+0000","last_peered":"2024-09-10T05:15:23.744538+0000","last_clean":"2024-09-10T05:15:23.744538+0000","last_became_active":"2024-09-10T05:11:33.742039+0000","last_became_peered":"2024-09-10T05:11:33.742039+0000","last_unstale":"2024-09-10T05:15:23.744538+0000","last_undegraded":"2024-09-10T05:15:23.744538+0000","last_fullsized":"2024-09-10T05:15:23.744538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-10T05:15:23.744296+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-10T05:15:23.744296+0000","last_clean_scrub_stamp":"2024-09-10T05:15:23.744296+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:24:56.856947+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:31.713817+0000","last_change":"2024-09-10T05:15:31.713764+0000","last_active":"2024-09-10T05:15:31.713817+0000","last_peered":"2024-09-10T05:15:31.713817+0000","last_clean":"2024-09-10T05:15:31.713817+0000","last_became_active":"2024-09-10T05:11:35.751244+0000","last_became_peered":"2024-09-10T05:11:35.751244+0000","last_unstale":"2024-09-10T05:15:31.713817+0000","last_undegraded":"2024-09-10T05:15:31.713817+0000","last_fullsized":"2024-09-10T05:15:31.713817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:31.713667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:31.713667+0000","last_clean_scrub_stamp":"2024-09-10T05:15:31.713667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:26:13.902660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:46.624854+0000","last_change":"2024-09-10T05:15:46.624854+0000","last_active":"2024-09-10T05:15:46.624854+0000","last_peered":"2024-09-10T05:15:46.624854+0000","last_clean":"2024-09-10T05:15:46.624854+0000","last_became_active":"2024-09-10T05:11:37.755533+0000","last_became_peered":"2024-09-10T05:11:37.755533+0000","last_unstale":"2024-09-10T05:15:46.624854+0000","last_undegraded":"2024-09-10T05:15:46.624854+0000","last_fullsized":"2024-09-10T05:15:46.624854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:46.624756+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:46.624756+0000","last_clean_scrub_stamp":"2024-09-10T05:15:46.624756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:44.080407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'6","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.660620+0000","last_change":"2024-09-10T05:15:12.660492+0000","last_active":"2024-09-10T05:15:12.660620+0000","last_peered":"2024-09-10T05:15:12.660620+0000","last_clean":"2024-09-10T05:15:12.660620+0000","last_became_active":"2024-09-10T05:11:29.727400+0000","last_became_peered":"2024-09-10T05:11:29.727400+0000","last_unstale":"2024-09-10T05:15:12.660620+0000","last_undegraded":"2024-09-10T05:15:12.660620+0000","last_fullsized":"2024-09-10T05:15:12.660620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:12.660389+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:12.660389+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.660389+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:36.645663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.665829+0000","last_change":"2024-09-10T05:14:55.665768+0000","last_active":"2024-09-10T05:14:55.665829+0000","last_peered":"2024-09-10T05:14:55.665829+0000","last_clean":"2024-09-10T05:14:55.665829+0000","last_became_active":"2024-09-10T05:11:27.727561+0000","last_became_peered":"2024-09-10T05:11:27.727561+0000","last_unstale":"2024-09-10T05:14:55.665829+0000","last_undegraded":"2024-09-10T05:14:55.665829+0000","last_fullsized":"2024-09-10T05:14:55.665829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:55.665677+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:55.665677+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.665677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:14.595232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"37'2","reported_seq":231,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:17.691928+0000","last_change":"2024-09-10T05:15:17.691856+0000","last_active":"2024-09-10T05:15:17.691928+0000","last_peered":"2024-09-10T05:15:17.691928+0000","last_clean":"2024-09-10T05:15:17.691928+0000","last_became_active":"2024-09-10T05:11:31.733793+0000","last_became_peered":"2024-09-10T05:11:31.733793+0000","last_unstale":"2024-09-10T05:15:17.691928+0000","last_undegraded":"2024-09-10T05:15:17.691928+0000","last_fullsized":"2024-09-10T05:15:17.691928+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:17.691774+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:17.691774+0000","last_clean_scrub_stamp":"2024-09-10T05:15:17.691774+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:00.262242+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'51","reported_seq":124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.735892+0000","last_change":"2024-09-10T05:15:24.735826+0000","last_active":"2024-09-10T05:15:24.735892+0000","last_peered":"2024-09-10T05:15:24.735892+0000","last_clean":"2024-09-10T05:15:24.735892+0000","last_became_active":"2024-09-10T05:11:33.744634+0000","last_became_peered":"2024-09-10T05:11:33.744634+0000","last_unstale":"2024-09-10T05:15:24.735892+0000","last_undegraded":"2024-09-10T05:15:24.735892+0000","last_fullsized":"2024-09-10T05:15:24.735892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'51","last_scrub_stamp":"2024-09-10T05:15:24.735737+0000","last_deep_scrub":"37'51","last_deep_scrub_stamp":"2024-09-10T05:15:24.735737+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.735737+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:27.977793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:36.129041+0000","last_change":"2024-09-10T05:15:36.128990+0000","last_active":"2024-09-10T05:15:36.129041+0000","last_peered":"2024-09-10T05:15:36.129041+0000","last_clean":"2024-09-10T05:15:36.129041+0000","last_became_active":"2024-09-10T05:11:35.748406+0000","last_became_peered":"2024-09-10T05:11:35.748406+0000","last_unstale":"2024-09-10T05:15:36.129041+0000","last_undegraded":"2024-09-10T05:15:36.129041+0000","last_fullsized":"2024-09-10T05:15:36.129041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:36.128911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:36.128911+0000","last_clean_scrub_stamp":"2024-09-10T05:15:36.128911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:39.255053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:14.007458+0000","last_change":"2024-09-10T05:16:14.007458+0000","last_active":"2024-09-10T05:16:14.007458+0000","last_peered":"2024-09-10T05:16:14.007458+0000","last_clean":"2024-09-10T05:16:14.007458+0000","last_became_active":"2024-09-10T05:11:37.765188+0000","last_became_peered":"2024-09-10T05:11:37.765188+0000","last_unstale":"2024-09-10T05:16:14.007458+0000","last_undegraded":"2024-09-10T05:16:14.007458+0000","last_fullsized":"2024-09-10T05:16:14.007458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:16:14.007361+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:16:14.007361+0000","last_clean_scrub_stamp":"2024-09-10T05:16:14.007361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:58.222292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.025560+0000","last_change":"2024-09-10T05:15:21.025498+0000","last_active":"2024-09-10T05:15:21.025560+0000","last_peered":"2024-09-10T05:15:21.025560+0000","last_clean":"2024-09-10T05:15:21.025560+0000","last_became_active":"2024-09-10T05:11:29.735101+0000","last_became_peered":"2024-09-10T05:11:29.735101+0000","last_unstale":"2024-09-10T05:15:21.025560+0000","last_undegraded":"2024-09-10T05:15:21.025560+0000","last_fullsized":"2024-09-10T05:15:21.025560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:21.025412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:21.025412+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.025412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:22.721305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:50.411073+0000","last_change":"2024-09-10T05:14:50.411020+0000","last_active":"2024-09-10T05:14:50.411073+0000","last_peered":"2024-09-10T05:14:50.411073+0000","last_clean":"2024-09-10T05:14:50.411073+0000","last_became_active":"2024-09-10T05:11:27.715729+0000","last_became_peered":"2024-09-10T05:11:27.715729+0000","last_unstale":"2024-09-10T05:14:50.411073+0000","last_undegraded":"2024-09-10T05:14:50.411073+0000","last_fullsized":"2024-09-10T05:14:50.411073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:50.410933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:50.410933+0000","last_clean_scrub_stamp":"2024-09-10T05:14:50.410933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:35.070195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:40.023388+0000","last_change":"2024-09-10T05:15:40.023328+0000","last_active":"2024-09-10T05:15:40.023388+0000","last_peered":"2024-09-10T05:15:40.023388+0000","last_clean":"2024-09-10T05:15:40.023388+0000","last_became_active":"2024-09-10T05:11:31.732476+0000","last_became_peered":"2024-09-10T05:11:31.732476+0000","last_unstale":"2024-09-10T05:15:40.023388+0000","last_undegraded":"2024-09-10T05:15:40.023388+0000","last_fullsized":"2024-09-10T05:15:40.023388+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:40.023244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:40.023244+0000","last_clean_scrub_stamp":"2024-09-10T05:15:40.023244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:22.273834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'38","reported_seq":94,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:25.695136+0000","last_change":"2024-09-10T05:15:25.695074+0000","last_active":"2024-09-10T05:15:25.695136+0000","last_peered":"2024-09-10T05:15:25.695136+0000","last_clean":"2024-09-10T05:15:25.695136+0000","last_became_active":"2024-09-10T05:11:33.740483+0000","last_became_peered":"2024-09-10T05:11:33.740483+0000","last_unstale":"2024-09-10T05:15:25.695136+0000","last_undegraded":"2024-09-10T05:15:25.695136+0000","last_fullsized":"2024-09-10T05:15:25.695136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-10T05:15:25.694982+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-10T05:15:25.694982+0000","last_clean_scrub_stamp":"2024-09-10T05:15:25.694982+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:43.315754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:32.736122+0000","last_change":"2024-09-10T05:15:32.736066+0000","last_active":"2024-09-10T05:15:32.736122+0000","last_peered":"2024-09-10T05:15:32.736122+0000","last_clean":"2024-09-10T05:15:32.736122+0000","last_became_active":"2024-09-10T05:11:35.745886+0000","last_became_peered":"2024-09-10T05:11:35.745886+0000","last_unstale":"2024-09-10T05:15:32.736122+0000","last_undegraded":"2024-09-10T05:15:32.736122+0000","last_fullsized":"2024-09-10T05:15:32.736122+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:32.735947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:32.735947+0000","last_clean_scrub_stamp":"2024-09-10T05:15:32.735947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:20.165956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'4","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.009524+0000","last_change":"2024-09-10T05:15:27.009451+0000","last_active":"2024-09-10T05:15:27.009524+0000","last_peered":"2024-09-10T05:15:27.009524+0000","last_clean":"2024-09-10T05:15:27.009524+0000","last_became_active":"2024-09-10T05:11:29.731824+0000","last_became_peered":"2024-09-10T05:11:29.731824+0000","last_unstale":"2024-09-10T05:15:27.009524+0000","last_undegraded":"2024-09-10T05:15:27.009524+0000","last_fullsized":"2024-09-10T05:15:27.009524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:27.009372+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:27.009372+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.009372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:47.379586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:02.955895+0000","last_change":"2024-09-10T05:15:02.955838+0000","last_active":"2024-09-10T05:15:02.955895+0000","last_peered":"2024-09-10T05:15:02.955895+0000","last_clean":"2024-09-10T05:15:02.955895+0000","last_became_active":"2024-09-10T05:11:27.734652+0000","last_became_peered":"2024-09-10T05:11:27.734652+0000","last_unstale":"2024-09-10T05:15:02.955895+0000","last_undegraded":"2024-09-10T05:15:02.955895+0000","last_fullsized":"2024-09-10T05:15:02.955895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:02.955753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:02.955753+0000","last_clean_scrub_stamp":"2024-09-10T05:15:02.955753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:03.026683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:21.707831+0000","last_change":"2024-09-10T05:15:21.707762+0000","last_active":"2024-09-10T05:15:21.707831+0000","last_peered":"2024-09-10T05:15:21.707831+0000","last_clean":"2024-09-10T05:15:21.707831+0000","last_became_active":"2024-09-10T05:11:31.734774+0000","last_became_peered":"2024-09-10T05:11:31.734774+0000","last_unstale":"2024-09-10T05:15:21.707831+0000","last_undegraded":"2024-09-10T05:15:21.707831+0000","last_fullsized":"2024-09-10T05:15:21.707831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:21.707674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:21.707674+0000","last_clean_scrub_stamp":"2024-09-10T05:15:21.707674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:24.042654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'72","reported_seq":151,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:26.709919+0000","last_change":"2024-09-10T05:15:26.709919+0000","last_active":"2024-09-10T05:15:26.709919+0000","last_peered":"2024-09-10T05:15:26.709919+0000","last_clean":"2024-09-10T05:15:26.709919+0000","last_became_active":"2024-09-10T05:11:33.741136+0000","last_became_peered":"2024-09-10T05:11:33.741136+0000","last_unstale":"2024-09-10T05:15:26.709919+0000","last_undegraded":"2024-09-10T05:15:26.709919+0000","last_fullsized":"2024-09-10T05:15:26.709919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'72","last_scrub_stamp":"2024-09-10T05:15:26.709822+0000","last_deep_scrub":"37'72","last_deep_scrub_stamp":"2024-09-10T05:15:26.709822+0000","last_clean_scrub_stamp":"2024-09-10T05:15:26.709822+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:58.542377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:33.758682+0000","last_change":"2024-09-10T05:15:33.758682+0000","last_active":"2024-09-10T05:15:33.758682+0000","last_peered":"2024-09-10T05:15:33.758682+0000","last_clean":"2024-09-10T05:15:33.758682+0000","last_became_active":"2024-09-10T05:11:35.745795+0000","last_became_peered":"2024-09-10T05:11:35.745795+0000","last_unstale":"2024-09-10T05:15:33.758682+0000","last_undegraded":"2024-09-10T05:15:33.758682+0000","last_fullsized":"2024-09-10T05:15:33.758682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:33.758579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:33.758579+0000","last_clean_scrub_stamp":"2024-09-10T05:15:33.758579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:25.812947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:45.653380+0000","last_change":"2024-09-10T05:15:45.653257+0000","last_active":"2024-09-10T05:15:45.653380+0000","last_peered":"2024-09-10T05:15:45.653380+0000","last_clean":"2024-09-10T05:15:45.653380+0000","last_became_active":"2024-09-10T05:11:37.758360+0000","last_became_peered":"2024-09-10T05:11:37.758360+0000","last_unstale":"2024-09-10T05:15:45.653380+0000","last_undegraded":"2024-09-10T05:15:45.653380+0000","last_fullsized":"2024-09-10T05:15:45.653380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-10T05:15:45.653164+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-10T05:15:45.653164+0000","last_clean_scrub_stamp":"2024-09-10T05:15:45.653164+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:01.291661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'9","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.487806+0000","last_change":"2024-09-10T05:15:04.487731+0000","last_active":"2024-09-10T05:15:04.487806+0000","last_peered":"2024-09-10T05:15:04.487806+0000","last_clean":"2024-09-10T05:15:04.487806+0000","last_became_active":"2024-09-10T05:11:29.723722+0000","last_became_peered":"2024-09-10T05:11:29.723722+0000","last_unstale":"2024-09-10T05:15:04.487806+0000","last_undegraded":"2024-09-10T05:15:04.487806+0000","last_fullsized":"2024-09-10T05:15:04.487806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-10T05:15:04.487622+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-10T05:15:04.487622+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.487622+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:01.563035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:48.432508+0000","last_change":"2024-09-10T05:14:48.432455+0000","last_active":"2024-09-10T05:14:48.432508+0000","last_peered":"2024-09-10T05:14:48.432508+0000","last_clean":"2024-09-10T05:14:48.432508+0000","last_became_active":"2024-09-10T05:11:27.727770+0000","last_became_peered":"2024-09-10T05:11:27.727770+0000","last_unstale":"2024-09-10T05:14:48.432508+0000","last_undegraded":"2024-09-10T05:14:48.432508+0000","last_fullsized":"2024-09-10T05:14:48.432508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:48.432373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:48.432373+0000","last_clean_scrub_stamp":"2024-09-10T05:14:48.432373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:56.267844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.739665+0000","last_change":"2024-09-10T05:15:19.739584+0000","last_active":"2024-09-10T05:15:19.739665+0000","last_peered":"2024-09-10T05:15:19.739665+0000","last_clean":"2024-09-10T05:15:19.739665+0000","last_became_active":"2024-09-10T05:11:31.728653+0000","last_became_peered":"2024-09-10T05:11:31.728653+0000","last_unstale":"2024-09-10T05:15:19.739665+0000","last_undegraded":"2024-09-10T05:15:19.739665+0000","last_fullsized":"2024-09-10T05:15:19.739665+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:19.739465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:19.739465+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.739465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:10.896874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'46","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:55.093641+0000","last_change":"2024-09-10T05:15:55.093641+0000","last_active":"2024-09-10T05:15:55.093641+0000","last_peered":"2024-09-10T05:15:55.093641+0000","last_clean":"2024-09-10T05:15:55.093641+0000","last_became_active":"2024-09-10T05:11:33.743048+0000","last_became_peered":"2024-09-10T05:11:33.743048+0000","last_unstale":"2024-09-10T05:15:55.093641+0000","last_undegraded":"2024-09-10T05:15:55.093641+0000","last_fullsized":"2024-09-10T05:15:55.093641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-10T05:15:55.093540+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-10T05:15:55.093540+0000","last_clean_scrub_stamp":"2024-09-10T05:15:55.093540+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:54:28.102787+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:39.127420+0000","last_change":"2024-09-10T05:15:39.127420+0000","last_active":"2024-09-10T05:15:39.127420+0000","last_peered":"2024-09-10T05:15:39.127420+0000","last_clean":"2024-09-10T05:15:39.127420+0000","last_became_active":"2024-09-10T05:11:35.752971+0000","last_became_peered":"2024-09-10T05:11:35.752971+0000","last_unstale":"2024-09-10T05:15:39.127420+0000","last_undegraded":"2024-09-10T05:15:39.127420+0000","last_fullsized":"2024-09-10T05:15:39.127420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:39.127342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:39.127342+0000","last_clean_scrub_stamp":"2024-09-10T05:15:39.127342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:18.920925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:10.028623+0000","last_change":"2024-09-10T05:16:10.028554+0000","last_active":"2024-09-10T05:16:10.028623+0000","last_peered":"2024-09-10T05:16:10.028623+0000","last_clean":"2024-09-10T05:16:10.028623+0000","last_became_active":"2024-09-10T05:11:37.768036+0000","last_became_peered":"2024-09-10T05:11:37.768036+0000","last_unstale":"2024-09-10T05:16:10.028623+0000","last_undegraded":"2024-09-10T05:16:10.028623+0000","last_fullsized":"2024-09-10T05:16:10.028623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:16:10.028462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:16:10.028462+0000","last_clean_scrub_stamp":"2024-09-10T05:16:10.028462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:53.231889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:26.004309+0000","last_change":"2024-09-10T05:15:26.004309+0000","last_active":"2024-09-10T05:15:26.004309+0000","last_peered":"2024-09-10T05:15:26.004309+0000","last_clean":"2024-09-10T05:15:26.004309+0000","last_became_active":"2024-09-10T05:11:29.734714+0000","last_became_peered":"2024-09-10T05:11:29.734714+0000","last_unstale":"2024-09-10T05:15:26.004309+0000","last_undegraded":"2024-09-10T05:15:26.004309+0000","last_fullsized":"2024-09-10T05:15:26.004309+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:26.004225+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:26.004225+0000","last_clean_scrub_stamp":"2024-09-10T05:15:26.004225+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:49.905656+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:53.434007+0000","last_change":"2024-09-10T05:14:53.434007+0000","last_active":"2024-09-10T05:14:53.434007+0000","last_peered":"2024-09-10T05:14:53.434007+0000","last_clean":"2024-09-10T05:14:53.434007+0000","last_became_active":"2024-09-10T05:11:27.718251+0000","last_became_peered":"2024-09-10T05:11:27.718251+0000","last_unstale":"2024-09-10T05:14:53.434007+0000","last_undegraded":"2024-09-10T05:14:53.434007+0000","last_fullsized":"2024-09-10T05:14:53.434007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:53.433919+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:53.433919+0000","last_clean_scrub_stamp":"2024-09-10T05:14:53.433919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:36.001843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:18.733593+0000","last_change":"2024-09-10T05:15:18.733593+0000","last_active":"2024-09-10T05:15:18.733593+0000","last_peered":"2024-09-10T05:15:18.733593+0000","last_clean":"2024-09-10T05:15:18.733593+0000","last_became_active":"2024-09-10T05:11:31.727998+0000","last_became_peered":"2024-09-10T05:11:31.727998+0000","last_unstale":"2024-09-10T05:15:18.733593+0000","last_undegraded":"2024-09-10T05:15:18.733593+0000","last_fullsized":"2024-09-10T05:15:18.733593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:18.733458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:18.733458+0000","last_clean_scrub_stamp":"2024-09-10T05:15:18.733458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:16.898611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'47","reported_seq":110,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.670352+0000","last_change":"2024-09-10T05:15:27.670277+0000","last_active":"2024-09-10T05:15:27.670352+0000","last_peered":"2024-09-10T05:15:27.670352+0000","last_clean":"2024-09-10T05:15:27.670352+0000","last_became_active":"2024-09-10T05:11:33.742594+0000","last_became_peered":"2024-09-10T05:11:33.742594+0000","last_unstale":"2024-09-10T05:15:27.670352+0000","last_undegraded":"2024-09-10T05:15:27.670352+0000","last_fullsized":"2024-09-10T05:15:27.670352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'47","last_scrub_stamp":"2024-09-10T05:15:27.670186+0000","last_deep_scrub":"37'47","last_deep_scrub_stamp":"2024-09-10T05:15:27.670186+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.670186+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:14.370124+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:38.636474+0000","last_change":"2024-09-10T05:15:38.636384+0000","last_active":"2024-09-10T05:15:38.636474+0000","last_peered":"2024-09-10T05:15:38.636474+0000","last_clean":"2024-09-10T05:15:38.636474+0000","last_became_active":"2024-09-10T05:11:35.748464+0000","last_became_peered":"2024-09-10T05:11:35.748464+0000","last_unstale":"2024-09-10T05:15:38.636474+0000","last_undegraded":"2024-09-10T05:15:38.636474+0000","last_fullsized":"2024-09-10T05:15:38.636474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:38.636277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:38.636277+0000","last_clean_scrub_stamp":"2024-09-10T05:15:38.636277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:46.050421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'5","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:09.044870+0000","last_change":"2024-09-10T05:16:09.044806+0000","last_active":"2024-09-10T05:16:09.044870+0000","last_peered":"2024-09-10T05:16:09.044870+0000","last_clean":"2024-09-10T05:16:09.044870+0000","last_became_active":"2024-09-10T05:11:37.768248+0000","last_became_peered":"2024-09-10T05:11:37.768248+0000","last_unstale":"2024-09-10T05:16:09.044870+0000","last_undegraded":"2024-09-10T05:16:09.044870+0000","last_fullsized":"2024-09-10T05:16:09.044870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-10T05:16:09.044701+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-10T05:16:09.044701+0000","last_clean_scrub_stamp":"2024-09-10T05:16:09.044701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:07.236175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.466476+0000","last_change":"2024-09-10T05:15:03.466476+0000","last_active":"2024-09-10T05:15:03.466476+0000","last_peered":"2024-09-10T05:15:03.466476+0000","last_clean":"2024-09-10T05:15:03.466476+0000","last_became_active":"2024-09-10T05:11:29.727038+0000","last_became_peered":"2024-09-10T05:11:29.727038+0000","last_unstale":"2024-09-10T05:15:03.466476+0000","last_undegraded":"2024-09-10T05:15:03.466476+0000","last_fullsized":"2024-09-10T05:15:03.466476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:03.466382+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:03.466382+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.466382+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:51.671119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:03.996465+0000","last_change":"2024-09-10T05:15:03.996465+0000","last_active":"2024-09-10T05:15:03.996465+0000","last_peered":"2024-09-10T05:15:03.996465+0000","last_clean":"2024-09-10T05:15:03.996465+0000","last_became_active":"2024-09-10T05:11:27.733320+0000","last_became_peered":"2024-09-10T05:11:27.733320+0000","last_unstale":"2024-09-10T05:15:03.996465+0000","last_undegraded":"2024-09-10T05:15:03.996465+0000","last_fullsized":"2024-09-10T05:15:03.996465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:03.996375+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:03.996375+0000","last_clean_scrub_stamp":"2024-09-10T05:15:03.996375+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:10:21.072269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:28.218144+0000","last_change":"2024-09-10T05:15:28.218144+0000","last_active":"2024-09-10T05:15:28.218144+0000","last_peered":"2024-09-10T05:15:28.218144+0000","last_clean":"2024-09-10T05:15:28.218144+0000","last_became_active":"2024-09-10T05:11:31.734684+0000","last_became_peered":"2024-09-10T05:11:31.734684+0000","last_unstale":"2024-09-10T05:15:28.218144+0000","last_undegraded":"2024-09-10T05:15:28.218144+0000","last_fullsized":"2024-09-10T05:15:28.218144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:28.218055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:28.218055+0000","last_clean_scrub_stamp":"2024-09-10T05:15:28.218055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:16.287090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"37'22","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:58.082798+0000","last_change":"2024-09-10T05:15:58.082798+0000","last_active":"2024-09-10T05:15:58.082798+0000","last_peered":"2024-09-10T05:15:58.082798+0000","last_clean":"2024-09-10T05:15:58.082798+0000","last_became_active":"2024-09-10T05:11:33.748547+0000","last_became_peered":"2024-09-10T05:11:33.748547+0000","last_unstale":"2024-09-10T05:15:58.082798+0000","last_undegraded":"2024-09-10T05:15:58.082798+0000","last_fullsized":"2024-09-10T05:15:58.082798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-10T05:15:58.082678+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-10T05:15:58.082678+0000","last_clean_scrub_stamp":"2024-09-10T05:15:58.082678+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:16:47.758655+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'286","reported_seq":379,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:34.740219+0000","last_change":"2024-09-10T05:15:34.740113+0000","last_active":"2024-09-10T05:15:34.740219+0000","last_peered":"2024-09-10T05:15:34.740219+0000","last_clean":"2024-09-10T05:15:34.740219+0000","last_became_active":"2024-09-10T05:11:35.750761+0000","last_became_peered":"2024-09-10T05:11:35.750761+0000","last_unstale":"2024-09-10T05:15:34.740219+0000","last_undegraded":"2024-09-10T05:15:34.740219+0000","last_fullsized":"2024-09-10T05:15:34.740219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-10T05:15:34.740001+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-10T05:15:34.740001+0000","last_clean_scrub_stamp":"2024-09-10T05:15:34.740001+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:39.734962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:08.077947+0000","last_change":"2024-09-10T05:16:08.077891+0000","last_active":"2024-09-10T05:16:08.077947+0000","last_peered":"2024-09-10T05:16:08.077947+0000","last_clean":"2024-09-10T05:16:08.077947+0000","last_became_active":"2024-09-10T05:11:37.767816+0000","last_became_peered":"2024-09-10T05:11:37.767816+0000","last_unstale":"2024-09-10T05:16:08.077947+0000","last_undegraded":"2024-09-10T05:16:08.077947+0000","last_fullsized":"2024-09-10T05:16:08.077947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:16:08.077806+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:16:08.077806+0000","last_clean_scrub_stamp":"2024-09-10T05:16:08.077806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:13.271149+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.732045+0000","last_change":"2024-09-10T05:15:10.732045+0000","last_active":"2024-09-10T05:15:10.732045+0000","last_peered":"2024-09-10T05:15:10.732045+0000","last_clean":"2024-09-10T05:15:10.732045+0000","last_became_active":"2024-09-10T05:11:29.720243+0000","last_became_peered":"2024-09-10T05:11:29.720243+0000","last_unstale":"2024-09-10T05:15:10.732045+0000","last_undegraded":"2024-09-10T05:15:10.732045+0000","last_fullsized":"2024-09-10T05:15:10.732045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:10.731923+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:10.731923+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.731923+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:31:05.159738+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:51.448490+0000","last_change":"2024-09-10T05:14:51.448490+0000","last_active":"2024-09-10T05:14:51.448490+0000","last_peered":"2024-09-10T05:14:51.448490+0000","last_clean":"2024-09-10T05:14:51.448490+0000","last_became_active":"2024-09-10T05:11:27.723630+0000","last_became_peered":"2024-09-10T05:11:27.723630+0000","last_unstale":"2024-09-10T05:14:51.448490+0000","last_undegraded":"2024-09-10T05:14:51.448490+0000","last_fullsized":"2024-09-10T05:14:51.448490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:51.448399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:51.448399+0000","last_clean_scrub_stamp":"2024-09-10T05:14:51.448399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:08.698148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:26.253278+0000","last_change":"2024-09-10T05:15:26.253278+0000","last_active":"2024-09-10T05:15:26.253278+0000","last_peered":"2024-09-10T05:15:26.253278+0000","last_clean":"2024-09-10T05:15:26.253278+0000","last_became_active":"2024-09-10T05:11:31.737547+0000","last_became_peered":"2024-09-10T05:11:31.737547+0000","last_unstale":"2024-09-10T05:15:26.253278+0000","last_undegraded":"2024-09-10T05:15:26.253278+0000","last_fullsized":"2024-09-10T05:15:26.253278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:26.253156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:26.253156+0000","last_clean_scrub_stamp":"2024-09-10T05:15:26.253156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:07.907112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'74","reported_seq":157,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:33.219911+0000","last_change":"2024-09-10T05:15:33.219849+0000","last_active":"2024-09-10T05:15:33.219911+0000","last_peered":"2024-09-10T05:15:33.219911+0000","last_clean":"2024-09-10T05:15:33.219911+0000","last_became_active":"2024-09-10T05:11:33.740489+0000","last_became_peered":"2024-09-10T05:11:33.740489+0000","last_unstale":"2024-09-10T05:15:33.219911+0000","last_undegraded":"2024-09-10T05:15:33.219911+0000","last_fullsized":"2024-09-10T05:15:33.219911+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-10T05:15:33.219755+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-10T05:15:33.219755+0000","last_clean_scrub_stamp":"2024-09-10T05:15:33.219755+0000","objects_scrubbed":11,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:12.994581+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:37.606377+0000","last_change":"2024-09-10T05:15:37.606377+0000","last_active":"2024-09-10T05:15:37.606377+0000","last_peered":"2024-09-10T05:15:37.606377+0000","last_clean":"2024-09-10T05:15:37.606377+0000","last_became_active":"2024-09-10T05:11:35.753856+0000","last_became_peered":"2024-09-10T05:11:35.753856+0000","last_unstale":"2024-09-10T05:15:37.606377+0000","last_undegraded":"2024-09-10T05:15:37.606377+0000","last_fullsized":"2024-09-10T05:15:37.606377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:37.606291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:37.606291+0000","last_clean_scrub_stamp":"2024-09-10T05:15:37.606291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:42.715047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:45.104695+0000","last_change":"2024-09-10T05:15:45.104695+0000","last_active":"2024-09-10T05:15:45.104695+0000","last_peered":"2024-09-10T05:15:45.104695+0000","last_clean":"2024-09-10T05:15:45.104695+0000","last_became_active":"2024-09-10T05:11:37.758332+0000","last_became_peered":"2024-09-10T05:11:37.758332+0000","last_unstale":"2024-09-10T05:15:45.104695+0000","last_undegraded":"2024-09-10T05:15:45.104695+0000","last_fullsized":"2024-09-10T05:15:45.104695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:45.104610+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:45.104610+0000","last_clean_scrub_stamp":"2024-09-10T05:15:45.104610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:50:15.516776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.713125+0000","last_change":"2024-09-10T05:15:08.713125+0000","last_active":"2024-09-10T05:15:08.713125+0000","last_peered":"2024-09-10T05:15:08.713125+0000","last_clean":"2024-09-10T05:15:08.713125+0000","last_became_active":"2024-09-10T05:11:29.721899+0000","last_became_peered":"2024-09-10T05:11:29.721899+0000","last_unstale":"2024-09-10T05:15:08.713125+0000","last_undegraded":"2024-09-10T05:15:08.713125+0000","last_fullsized":"2024-09-10T05:15:08.713125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:08.713028+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:08.713028+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.713028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:16.548499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:04.992028+0000","last_change":"2024-09-10T05:15:04.992028+0000","last_active":"2024-09-10T05:15:04.992028+0000","last_peered":"2024-09-10T05:15:04.992028+0000","last_clean":"2024-09-10T05:15:04.992028+0000","last_became_active":"2024-09-10T05:11:27.733451+0000","last_became_peered":"2024-09-10T05:11:27.733451+0000","last_unstale":"2024-09-10T05:15:04.992028+0000","last_undegraded":"2024-09-10T05:15:04.992028+0000","last_fullsized":"2024-09-10T05:15:04.992028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:04.991935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:04.991935+0000","last_clean_scrub_stamp":"2024-09-10T05:15:04.991935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:49:35.404102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:20.749996+0000","last_change":"2024-09-10T05:15:20.749996+0000","last_active":"2024-09-10T05:15:20.749996+0000","last_peered":"2024-09-10T05:15:20.749996+0000","last_clean":"2024-09-10T05:15:20.749996+0000","last_became_active":"2024-09-10T05:11:31.735565+0000","last_became_peered":"2024-09-10T05:11:31.735565+0000","last_unstale":"2024-09-10T05:15:20.749996+0000","last_undegraded":"2024-09-10T05:15:20.749996+0000","last_fullsized":"2024-09-10T05:15:20.749996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:20.749892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:20.749892+0000","last_clean_scrub_stamp":"2024-09-10T05:15:20.749892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:19.742771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'44","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:25.706176+0000","last_change":"2024-09-10T05:15:25.706116+0000","last_active":"2024-09-10T05:15:25.706176+0000","last_peered":"2024-09-10T05:15:25.706176+0000","last_clean":"2024-09-10T05:15:25.706176+0000","last_became_active":"2024-09-10T05:11:33.742656+0000","last_became_peered":"2024-09-10T05:11:33.742656+0000","last_unstale":"2024-09-10T05:15:25.706176+0000","last_undegraded":"2024-09-10T05:15:25.706176+0000","last_fullsized":"2024-09-10T05:15:25.706176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'44","last_scrub_stamp":"2024-09-10T05:15:25.706013+0000","last_deep_scrub":"37'44","last_deep_scrub_stamp":"2024-09-10T05:15:25.706013+0000","last_clean_scrub_stamp":"2024-09-10T05:15:25.706013+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:31.251549+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:03.132375+0000","last_change":"2024-09-10T05:16:03.132301+0000","last_active":"2024-09-10T05:16:03.132375+0000","last_peered":"2024-09-10T05:16:03.132375+0000","last_clean":"2024-09-10T05:16:03.132375+0000","last_became_active":"2024-09-10T05:11:35.750960+0000","last_became_peered":"2024-09-10T05:11:35.750960+0000","last_unstale":"2024-09-10T05:16:03.132375+0000","last_undegraded":"2024-09-10T05:16:03.132375+0000","last_fullsized":"2024-09-10T05:16:03.132375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:16:03.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:16:03.132214+0000","last_clean_scrub_stamp":"2024-09-10T05:16:03.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:09.561348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:12.994846+0000","last_change":"2024-09-10T05:16:12.994846+0000","last_active":"2024-09-10T05:16:12.994846+0000","last_peered":"2024-09-10T05:16:12.994846+0000","last_clean":"2024-09-10T05:16:12.994846+0000","last_became_active":"2024-09-10T05:11:37.768559+0000","last_became_peered":"2024-09-10T05:11:37.768559+0000","last_unstale":"2024-09-10T05:16:12.994846+0000","last_undegraded":"2024-09-10T05:16:12.994846+0000","last_fullsized":"2024-09-10T05:16:12.994846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:16:12.994754+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:16:12.994754+0000","last_clean_scrub_stamp":"2024-09-10T05:16:12.994754+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:05.843946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.982002+0000","last_change":"2024-09-10T05:15:24.981935+0000","last_active":"2024-09-10T05:15:24.982002+0000","last_peered":"2024-09-10T05:15:24.982002+0000","last_clean":"2024-09-10T05:15:24.982002+0000","last_became_active":"2024-09-10T05:11:29.732703+0000","last_became_peered":"2024-09-10T05:11:29.732703+0000","last_unstale":"2024-09-10T05:15:24.982002+0000","last_undegraded":"2024-09-10T05:15:24.982002+0000","last_fullsized":"2024-09-10T05:15:24.982002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:24.981859+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:24.981859+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.981859+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:28.030709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.494634+0000","last_change":"2024-09-10T05:14:56.494569+0000","last_active":"2024-09-10T05:14:56.494634+0000","last_peered":"2024-09-10T05:14:56.494634+0000","last_clean":"2024-09-10T05:14:56.494634+0000","last_became_active":"2024-09-10T05:11:27.713416+0000","last_became_peered":"2024-09-10T05:11:27.713416+0000","last_unstale":"2024-09-10T05:14:56.494634+0000","last_undegraded":"2024-09-10T05:14:56.494634+0000","last_fullsized":"2024-09-10T05:14:56.494634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:56.494480+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.494480+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.494480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:49.778320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:24.315129+0000","last_change":"2024-09-10T05:15:24.315033+0000","last_active":"2024-09-10T05:15:24.315129+0000","last_peered":"2024-09-10T05:15:24.315129+0000","last_clean":"2024-09-10T05:15:24.315129+0000","last_became_active":"2024-09-10T05:11:31.736540+0000","last_became_peered":"2024-09-10T05:11:31.736540+0000","last_unstale":"2024-09-10T05:15:24.315129+0000","last_undegraded":"2024-09-10T05:15:24.315129+0000","last_fullsized":"2024-09-10T05:15:24.315129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:24.314941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:24.314941+0000","last_clean_scrub_stamp":"2024-09-10T05:15:24.314941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:23:29.272640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'39","reported_seq":98,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:56.058318+0000","last_change":"2024-09-10T05:15:56.058318+0000","last_active":"2024-09-10T05:15:56.058318+0000","last_peered":"2024-09-10T05:15:56.058318+0000","last_clean":"2024-09-10T05:15:56.058318+0000","last_became_active":"2024-09-10T05:11:33.743207+0000","last_became_peered":"2024-09-10T05:11:33.743207+0000","last_unstale":"2024-09-10T05:15:56.058318+0000","last_undegraded":"2024-09-10T05:15:56.058318+0000","last_fullsized":"2024-09-10T05:15:56.058318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'39","last_scrub_stamp":"2024-09-10T05:15:56.058207+0000","last_deep_scrub":"37'39","last_deep_scrub_stamp":"2024-09-10T05:15:56.058207+0000","last_clean_scrub_stamp":"2024-09-10T05:15:56.058207+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:19.718465+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:04.094674+0000","last_change":"2024-09-10T05:16:04.094674+0000","last_active":"2024-09-10T05:16:04.094674+0000","last_peered":"2024-09-10T05:16:04.094674+0000","last_clean":"2024-09-10T05:16:04.094674+0000","last_became_active":"2024-09-10T05:11:35.753001+0000","last_became_peered":"2024-09-10T05:11:35.753001+0000","last_unstale":"2024-09-10T05:16:04.094674+0000","last_undegraded":"2024-09-10T05:16:04.094674+0000","last_fullsized":"2024-09-10T05:16:04.094674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:16:04.094577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:16:04.094577+0000","last_clean_scrub_stamp":"2024-09-10T05:16:04.094577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:27.246905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'7","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:12.035485+0000","last_change":"2024-09-10T05:16:12.035485+0000","last_active":"2024-09-10T05:16:12.035485+0000","last_peered":"2024-09-10T05:16:12.035485+0000","last_clean":"2024-09-10T05:16:12.035485+0000","last_became_active":"2024-09-10T05:11:37.767649+0000","last_became_peered":"2024-09-10T05:11:37.767649+0000","last_unstale":"2024-09-10T05:16:12.035485+0000","last_undegraded":"2024-09-10T05:16:12.035485+0000","last_fullsized":"2024-09-10T05:16:12.035485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-10T05:16:12.035382+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-10T05:16:12.035382+0000","last_clean_scrub_stamp":"2024-09-10T05:16:12.035382+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:52.724873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'4","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.664989+0000","last_change":"2024-09-10T05:15:07.664923+0000","last_active":"2024-09-10T05:15:07.664989+0000","last_peered":"2024-09-10T05:15:07.664989+0000","last_clean":"2024-09-10T05:15:07.664989+0000","last_became_active":"2024-09-10T05:11:29.718689+0000","last_became_peered":"2024-09-10T05:11:29.718689+0000","last_unstale":"2024-09-10T05:15:07.664989+0000","last_undegraded":"2024-09-10T05:15:07.664989+0000","last_fullsized":"2024-09-10T05:15:07.664989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:07.664840+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:07.664840+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.664840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:53.882406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.493574+0000","last_change":"2024-09-10T05:14:57.493473+0000","last_active":"2024-09-10T05:14:57.493574+0000","last_peered":"2024-09-10T05:14:57.493574+0000","last_clean":"2024-09-10T05:14:57.493574+0000","last_became_active":"2024-09-10T05:11:27.716073+0000","last_became_peered":"2024-09-10T05:11:27.716073+0000","last_unstale":"2024-09-10T05:14:57.493574+0000","last_undegraded":"2024-09-10T05:14:57.493574+0000","last_fullsized":"2024-09-10T05:14:57.493574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:57.493360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:57.493360+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.493360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:16.549263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:25.285265+0000","last_change":"2024-09-10T05:15:25.285210+0000","last_active":"2024-09-10T05:15:25.285265+0000","last_peered":"2024-09-10T05:15:25.285265+0000","last_clean":"2024-09-10T05:15:25.285265+0000","last_became_active":"2024-09-10T05:11:31.735726+0000","last_became_peered":"2024-09-10T05:11:31.735726+0000","last_unstale":"2024-09-10T05:15:25.285265+0000","last_undegraded":"2024-09-10T05:15:25.285265+0000","last_fullsized":"2024-09-10T05:15:25.285265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-10T05:15:25.285128+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-10T05:15:25.285128+0000","last_clean_scrub_stamp":"2024-09-10T05:15:25.285128+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:58.121835+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'54","reported_seq":123,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:53.018352+0000","last_change":"2024-09-10T05:15:53.018352+0000","last_active":"2024-09-10T05:15:53.018352+0000","last_peered":"2024-09-10T05:15:53.018352+0000","last_clean":"2024-09-10T05:15:53.018352+0000","last_became_active":"2024-09-10T05:11:33.748120+0000","last_became_peered":"2024-09-10T05:11:33.748120+0000","last_unstale":"2024-09-10T05:15:53.018352+0000","last_undegraded":"2024-09-10T05:15:53.018352+0000","last_fullsized":"2024-09-10T05:15:53.018352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'54","last_scrub_stamp":"2024-09-10T05:15:53.018247+0000","last_deep_scrub":"37'54","last_deep_scrub_stamp":"2024-09-10T05:15:53.018247+0000","last_clean_scrub_stamp":"2024-09-10T05:15:53.018247+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:27.335125+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:40.613346+0000","last_change":"2024-09-10T05:15:40.613346+0000","last_active":"2024-09-10T05:15:40.613346+0000","last_peered":"2024-09-10T05:15:40.613346+0000","last_clean":"2024-09-10T05:15:40.613346+0000","last_became_active":"2024-09-10T05:11:35.753437+0000","last_became_peered":"2024-09-10T05:11:35.753437+0000","last_unstale":"2024-09-10T05:15:40.613346+0000","last_undegraded":"2024-09-10T05:15:40.613346+0000","last_fullsized":"2024-09-10T05:15:40.613346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:40.613217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:40.613217+0000","last_clean_scrub_stamp":"2024-09-10T05:15:40.613217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:40.765442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'10","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:16:11.043161+0000","last_change":"2024-09-10T05:16:11.043073+0000","last_active":"2024-09-10T05:16:11.043161+0000","last_peered":"2024-09-10T05:16:11.043161+0000","last_clean":"2024-09-10T05:16:11.043161+0000","last_became_active":"2024-09-10T05:11:37.765102+0000","last_became_peered":"2024-09-10T05:11:37.765102+0000","last_unstale":"2024-09-10T05:16:11.043161+0000","last_undegraded":"2024-09-10T05:16:11.043161+0000","last_fullsized":"2024-09-10T05:16:11.043161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:16:11.042963+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:16:11.042963+0000","last_clean_scrub_stamp":"2024-09-10T05:16:11.042963+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:54.173463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":67,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.375172+0000","last_change":"2024-09-10T05:15:08.375108+0000","last_active":"2024-09-10T05:15:08.375172+0000","last_peered":"2024-09-10T05:15:08.375172+0000","last_clean":"2024-09-10T05:15:08.375172+0000","last_became_active":"2024-09-10T05:11:29.729468+0000","last_became_peered":"2024-09-10T05:11:29.729468+0000","last_unstale":"2024-09-10T05:15:08.375172+0000","last_undegraded":"2024-09-10T05:15:08.375172+0000","last_fullsized":"2024-09-10T05:15:08.375172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:08.375011+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:08.375011+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.375011+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:38.702635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.709903+0000","last_change":"2024-09-10T05:14:54.709815+0000","last_active":"2024-09-10T05:14:54.709903+0000","last_peered":"2024-09-10T05:14:54.709903+0000","last_clean":"2024-09-10T05:14:54.709903+0000","last_became_active":"2024-09-10T05:11:27.706484+0000","last_became_peered":"2024-09-10T05:11:27.706484+0000","last_unstale":"2024-09-10T05:14:54.709903+0000","last_undegraded":"2024-09-10T05:14:54.709903+0000","last_fullsized":"2024-09-10T05:14:54.709903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:54.709723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:54.709723+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.709723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:58.926828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'12","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.590727+0000","last_change":"2024-09-10T05:15:08.590666+0000","last_active":"2024-09-10T05:15:08.590727+0000","last_peered":"2024-09-10T05:15:08.590727+0000","last_clean":"2024-09-10T05:15:08.590727+0000","last_became_active":"2024-09-10T05:11:29.729019+0000","last_became_peered":"2024-09-10T05:11:29.729019+0000","last_unstale":"2024-09-10T05:15:08.590727+0000","last_undegraded":"2024-09-10T05:15:08.590727+0000","last_fullsized":"2024-09-10T05:15:08.590727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-10T05:15:08.590592+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-10T05:15:08.590592+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.590592+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:11.806872+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":61,"num_read_kb":57,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.491538+0000","last_change":"2024-09-10T05:14:52.491464+0000","last_active":"2024-09-10T05:14:52.491538+0000","last_peered":"2024-09-10T05:14:52.491538+0000","last_clean":"2024-09-10T05:14:52.491538+0000","last_became_active":"2024-09-10T05:11:27.714487+0000","last_became_peered":"2024-09-10T05:11:27.714487+0000","last_unstale":"2024-09-10T05:14:52.491538+0000","last_undegraded":"2024-09-10T05:14:52.491538+0000","last_fullsized":"2024-09-10T05:14:52.491538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:52.491377+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:52.491377+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.491377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:49.460874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'2","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:28.983544+0000","last_change":"2024-09-10T05:15:28.983488+0000","last_active":"2024-09-10T05:15:28.983544+0000","last_peered":"2024-09-10T05:15:28.983544+0000","last_clean":"2024-09-10T05:15:28.983544+0000","last_became_active":"2024-09-10T05:11:29.729359+0000","last_became_peered":"2024-09-10T05:11:29.729359+0000","last_unstale":"2024-09-10T05:15:28.983544+0000","last_undegraded":"2024-09-10T05:15:28.983544+0000","last_fullsized":"2024-09-10T05:15:28.983544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:28.983403+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:28.983403+0000","last_clean_scrub_stamp":"2024-09-10T05:15:28.983403+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:30.534141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.978066+0000","last_change":"2024-09-10T05:15:05.978001+0000","last_active":"2024-09-10T05:15:05.978066+0000","last_peered":"2024-09-10T05:15:05.978066+0000","last_clean":"2024-09-10T05:15:05.978066+0000","last_became_active":"2024-09-10T05:11:27.730905+0000","last_became_peered":"2024-09-10T05:11:27.730905+0000","last_unstale":"2024-09-10T05:15:05.978066+0000","last_undegraded":"2024-09-10T05:15:05.978066+0000","last_fullsized":"2024-09-10T05:15:05.978066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:05.977914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:05.977914+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.977914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:59.732683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.630745+0000","last_change":"2024-09-10T05:15:09.630650+0000","last_active":"2024-09-10T05:15:09.630745+0000","last_peered":"2024-09-10T05:15:09.630745+0000","last_clean":"2024-09-10T05:15:09.630745+0000","last_became_active":"2024-09-10T05:11:29.727454+0000","last_became_peered":"2024-09-10T05:11:29.727454+0000","last_unstale":"2024-09-10T05:15:09.630745+0000","last_undegraded":"2024-09-10T05:15:09.630745+0000","last_fullsized":"2024-09-10T05:15:09.630745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:15:09.630545+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:15:09.630545+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.630545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:42.825841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.503693+0000","last_change":"2024-09-10T05:14:54.503637+0000","last_active":"2024-09-10T05:14:54.503693+0000","last_peered":"2024-09-10T05:14:54.503693+0000","last_clean":"2024-09-10T05:14:54.503693+0000","last_became_active":"2024-09-10T05:11:27.713962+0000","last_became_peered":"2024-09-10T05:11:27.713962+0000","last_unstale":"2024-09-10T05:14:54.503693+0000","last_undegraded":"2024-09-10T05:14:54.503693+0000","last_fullsized":"2024-09-10T05:14:54.503693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:54.503543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:54.503543+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.503543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:36.529415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'8","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.551836+0000","last_change":"2024-09-10T05:15:07.551762+0000","last_active":"2024-09-10T05:15:07.551836+0000","last_peered":"2024-09-10T05:15:07.551836+0000","last_clean":"2024-09-10T05:15:07.551836+0000","last_became_active":"2024-09-10T05:11:29.725099+0000","last_became_peered":"2024-09-10T05:11:29.725099+0000","last_unstale":"2024-09-10T05:15:07.551836+0000","last_undegraded":"2024-09-10T05:15:07.551836+0000","last_fullsized":"2024-09-10T05:15:07.551836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:07.551648+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:07.551648+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.551648+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:37:16.567800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:49.545656+0000","last_change":"2024-09-10T05:14:49.545597+0000","last_active":"2024-09-10T05:14:49.545656+0000","last_peered":"2024-09-10T05:14:49.545656+0000","last_clean":"2024-09-10T05:14:49.545656+0000","last_became_active":"2024-09-10T05:11:27.718926+0000","last_became_peered":"2024-09-10T05:11:27.718926+0000","last_unstale":"2024-09-10T05:14:49.545656+0000","last_undegraded":"2024-09-10T05:14:49.545656+0000","last_fullsized":"2024-09-10T05:14:49.545656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-10T05:14:49.545500+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-10T05:14:49.545500+0000","last_clean_scrub_stamp":"2024-09-10T05:14:49.545500+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:57.641677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'8","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.398363+0000","last_change":"2024-09-10T05:15:07.398282+0000","last_active":"2024-09-10T05:15:07.398363+0000","last_peered":"2024-09-10T05:15:07.398363+0000","last_clean":"2024-09-10T05:15:07.398363+0000","last_became_active":"2024-09-10T05:12:04.964750+0000","last_became_peered":"2024-09-10T05:12:04.964750+0000","last_unstale":"2024-09-10T05:15:07.398363+0000","last_undegraded":"2024-09-10T05:15:07.398363+0000","last_fullsized":"2024-09-10T05:15:07.398363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:07.398168+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:07.398168+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.398168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:10.120023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:52.416280+0000","last_change":"2024-09-10T05:14:52.416193+0000","last_active":"2024-09-10T05:14:52.416280+0000","last_peered":"2024-09-10T05:14:52.416280+0000","last_clean":"2024-09-10T05:14:52.416280+0000","last_became_active":"2024-09-10T05:11:27.718282+0000","last_became_peered":"2024-09-10T05:11:27.718282+0000","last_unstale":"2024-09-10T05:14:52.416280+0000","last_undegraded":"2024-09-10T05:14:52.416280+0000","last_fullsized":"2024-09-10T05:14:52.416280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:52.416097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:52.416097+0000","last_clean_scrub_stamp":"2024-09-10T05:14:52.416097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:11.180415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:06.501458+0000","last_change":"2024-09-10T05:15:06.501364+0000","last_active":"2024-09-10T05:15:06.501458+0000","last_peered":"2024-09-10T05:15:06.501458+0000","last_clean":"2024-09-10T05:15:06.501458+0000","last_became_active":"2024-09-10T05:11:29.723387+0000","last_became_peered":"2024-09-10T05:11:29.723387+0000","last_unstale":"2024-09-10T05:15:06.501458+0000","last_undegraded":"2024-09-10T05:15:06.501458+0000","last_fullsized":"2024-09-10T05:15:06.501458+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:06.501241+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:06.501241+0000","last_clean_scrub_stamp":"2024-09-10T05:15:06.501241+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:02.303540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.663887+0000","last_change":"2024-09-10T05:14:56.663822+0000","last_active":"2024-09-10T05:14:56.663887+0000","last_peered":"2024-09-10T05:14:56.663887+0000","last_clean":"2024-09-10T05:14:56.663887+0000","last_became_active":"2024-09-10T05:11:27.724815+0000","last_became_peered":"2024-09-10T05:11:27.724815+0000","last_unstale":"2024-09-10T05:14:56.663887+0000","last_undegraded":"2024-09-10T05:14:56.663887+0000","last_fullsized":"2024-09-10T05:14:56.663887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:14:56.663737+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.663737+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.663737+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:18.281662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:05.394144+0000","last_change":"2024-09-10T05:15:05.394073+0000","last_active":"2024-09-10T05:15:05.394144+0000","last_peered":"2024-09-10T05:15:05.394144+0000","last_clean":"2024-09-10T05:15:05.394144+0000","last_became_active":"2024-09-10T05:11:29.723469+0000","last_became_peered":"2024-09-10T05:11:29.723469+0000","last_unstale":"2024-09-10T05:15:05.394144+0000","last_undegraded":"2024-09-10T05:15:05.394144+0000","last_fullsized":"2024-09-10T05:15:05.394144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-10T05:15:05.393954+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-10T05:15:05.393954+0000","last_clean_scrub_stamp":"2024-09-10T05:15:05.393954+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:38:36.032466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:55.489228+0000","last_change":"2024-09-10T05:14:55.489090+0000","last_active":"2024-09-10T05:14:55.489228+0000","last_peered":"2024-09-10T05:14:55.489228+0000","last_clean":"2024-09-10T05:14:55.489228+0000","last_became_active":"2024-09-10T05:11:27.714348+0000","last_became_peered":"2024-09-10T05:11:27.714348+0000","last_unstale":"2024-09-10T05:14:55.489228+0000","last_undegraded":"2024-09-10T05:14:55.489228+0000","last_fullsized":"2024-09-10T05:14:55.489228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:55.488990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:55.488990+0000","last_clean_scrub_stamp":"2024-09-10T05:14:55.488990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:10.435358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.268215+0000","last_change":"2024-09-10T05:15:13.268130+0000","last_active":"2024-09-10T05:15:13.268215+0000","last_peered":"2024-09-10T05:15:13.268215+0000","last_clean":"2024-09-10T05:15:13.268215+0000","last_became_active":"2024-09-10T05:11:29.729148+0000","last_became_peered":"2024-09-10T05:11:29.729148+0000","last_unstale":"2024-09-10T05:15:13.268215+0000","last_undegraded":"2024-09-10T05:15:13.268215+0000","last_fullsized":"2024-09-10T05:15:13.268215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:13.268020+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:13.268020+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.268020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:00.698029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:07.019975+0000","last_change":"2024-09-10T05:15:07.019917+0000","last_active":"2024-09-10T05:15:07.019975+0000","last_peered":"2024-09-10T05:15:07.019975+0000","last_clean":"2024-09-10T05:15:07.019975+0000","last_became_active":"2024-09-10T05:11:27.735159+0000","last_became_peered":"2024-09-10T05:11:27.735159+0000","last_unstale":"2024-09-10T05:15:07.019975+0000","last_undegraded":"2024-09-10T05:15:07.019975+0000","last_fullsized":"2024-09-10T05:15:07.019975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:07.019834+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:07.019834+0000","last_clean_scrub_stamp":"2024-09-10T05:15:07.019834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:09.595861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'12","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:29.936587+0000","last_change":"2024-09-10T05:15:29.936528+0000","last_active":"2024-09-10T05:15:29.936587+0000","last_peered":"2024-09-10T05:15:29.936587+0000","last_clean":"2024-09-10T05:15:29.936587+0000","last_became_active":"2024-09-10T05:11:29.729476+0000","last_became_peered":"2024-09-10T05:11:29.729476+0000","last_unstale":"2024-09-10T05:15:29.936587+0000","last_undegraded":"2024-09-10T05:15:29.936587+0000","last_fullsized":"2024-09-10T05:15:29.936587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-10T05:15:29.936445+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-10T05:15:29.936445+0000","last_clean_scrub_stamp":"2024-09-10T05:15:29.936445+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:39:28.532827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:57.511923+0000","last_change":"2024-09-10T05:14:57.511867+0000","last_active":"2024-09-10T05:14:57.511923+0000","last_peered":"2024-09-10T05:14:57.511923+0000","last_clean":"2024-09-10T05:14:57.511923+0000","last_became_active":"2024-09-10T05:11:27.715014+0000","last_became_peered":"2024-09-10T05:11:27.715014+0000","last_unstale":"2024-09-10T05:14:57.511923+0000","last_undegraded":"2024-09-10T05:14:57.511923+0000","last_fullsized":"2024-09-10T05:14:57.511923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:57.511763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:57.511763+0000","last_clean_scrub_stamp":"2024-09-10T05:14:57.511763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:55.932537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:13.690164+0000","last_change":"2024-09-10T05:15:13.690109+0000","last_active":"2024-09-10T05:15:13.690164+0000","last_peered":"2024-09-10T05:15:13.690164+0000","last_clean":"2024-09-10T05:15:13.690164+0000","last_became_active":"2024-09-10T05:11:29.725047+0000","last_became_peered":"2024-09-10T05:11:29.725047+0000","last_unstale":"2024-09-10T05:15:13.690164+0000","last_undegraded":"2024-09-10T05:15:13.690164+0000","last_fullsized":"2024-09-10T05:15:13.690164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:13.690031+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:13.690031+0000","last_clean_scrub_stamp":"2024-09-10T05:15:13.690031+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:40.863292+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:54.482294+0000","last_change":"2024-09-10T05:14:54.482237+0000","last_active":"2024-09-10T05:14:54.482294+0000","last_peered":"2024-09-10T05:14:54.482294+0000","last_clean":"2024-09-10T05:14:54.482294+0000","last_became_active":"2024-09-10T05:11:27.728257+0000","last_became_peered":"2024-09-10T05:11:27.728257+0000","last_unstale":"2024-09-10T05:14:54.482294+0000","last_undegraded":"2024-09-10T05:14:54.482294+0000","last_fullsized":"2024-09-10T05:14:54.482294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:14:54.482153+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:14:54.482153+0000","last_clean_scrub_stamp":"2024-09-10T05:14:54.482153+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:10.009942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:12.314773+0000","last_change":"2024-09-10T05:15:12.314698+0000","last_active":"2024-09-10T05:15:12.314773+0000","last_peered":"2024-09-10T05:15:12.314773+0000","last_clean":"2024-09-10T05:15:12.314773+0000","last_became_active":"2024-09-10T05:11:29.721826+0000","last_became_peered":"2024-09-10T05:11:29.721826+0000","last_unstale":"2024-09-10T05:15:12.314773+0000","last_undegraded":"2024-09-10T05:15:12.314773+0000","last_fullsized":"2024-09-10T05:15:12.314773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:15:12.314615+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:15:12.314615+0000","last_clean_scrub_stamp":"2024-09-10T05:15:12.314615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:25:54.503608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:56.515528+0000","last_change":"2024-09-10T05:14:56.515429+0000","last_active":"2024-09-10T05:14:56.515528+0000","last_peered":"2024-09-10T05:14:56.515528+0000","last_clean":"2024-09-10T05:14:56.515528+0000","last_became_active":"2024-09-10T05:11:27.730469+0000","last_became_peered":"2024-09-10T05:11:27.730469+0000","last_unstale":"2024-09-10T05:14:56.515528+0000","last_undegraded":"2024-09-10T05:14:56.515528+0000","last_fullsized":"2024-09-10T05:14:56.515528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:14:56.515326+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:14:56.515326+0000","last_clean_scrub_stamp":"2024-09-10T05:14:56.515326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:20.046107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'18","reported_seq":90,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.343052+0000","last_change":"2024-09-10T05:15:11.342989+0000","last_active":"2024-09-10T05:15:11.343052+0000","last_peered":"2024-09-10T05:15:11.343052+0000","last_clean":"2024-09-10T05:15:11.343052+0000","last_became_active":"2024-09-10T05:12:04.965056+0000","last_became_peered":"2024-09-10T05:12:04.965056+0000","last_unstale":"2024-09-10T05:15:11.343052+0000","last_undegraded":"2024-09-10T05:15:11.343052+0000","last_fullsized":"2024-09-10T05:15:11.343052+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-10T05:15:11.342907+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-10T05:15:11.342907+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.342907+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:55.366767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:08.012410+0000","last_change":"2024-09-10T05:15:08.012305+0000","last_active":"2024-09-10T05:15:08.012410+0000","last_peered":"2024-09-10T05:15:08.012410+0000","last_clean":"2024-09-10T05:15:08.012410+0000","last_became_active":"2024-09-10T05:11:27.722079+0000","last_became_peered":"2024-09-10T05:11:27.722079+0000","last_unstale":"2024-09-10T05:15:08.012410+0000","last_undegraded":"2024-09-10T05:15:08.012410+0000","last_fullsized":"2024-09-10T05:15:08.012410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:08.012205+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:08.012205+0000","last_clean_scrub_stamp":"2024-09-10T05:15:08.012205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:47.103635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'16","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.323742+0000","last_change":"2024-09-10T05:15:10.323651+0000","last_active":"2024-09-10T05:15:10.323742+0000","last_peered":"2024-09-10T05:15:10.323742+0000","last_clean":"2024-09-10T05:15:10.323742+0000","last_became_active":"2024-09-10T05:11:29.733895+0000","last_became_peered":"2024-09-10T05:11:29.733895+0000","last_unstale":"2024-09-10T05:15:10.323742+0000","last_undegraded":"2024-09-10T05:15:10.323742+0000","last_fullsized":"2024-09-10T05:15:10.323742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-10T05:15:10.323533+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-10T05:15:10.323533+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.323533+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:18:55.632072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.024855+0000","last_change":"2024-09-10T05:15:09.024782+0000","last_active":"2024-09-10T05:15:09.024855+0000","last_peered":"2024-09-10T05:15:09.024855+0000","last_clean":"2024-09-10T05:15:09.024855+0000","last_became_active":"2024-09-10T05:11:27.735801+0000","last_became_peered":"2024-09-10T05:11:27.735801+0000","last_unstale":"2024-09-10T05:15:09.024855+0000","last_undegraded":"2024-09-10T05:15:09.024855+0000","last_fullsized":"2024-09-10T05:15:09.024855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-10T05:15:09.024688+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-10T05:15:09.024688+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.024688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:45.203541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'8","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:27.965628+0000","last_change":"2024-09-10T05:15:27.965572+0000","last_active":"2024-09-10T05:15:27.965628+0000","last_peered":"2024-09-10T05:15:27.965628+0000","last_clean":"2024-09-10T05:15:27.965628+0000","last_became_active":"2024-09-10T05:11:29.735555+0000","last_became_peered":"2024-09-10T05:11:29.735555+0000","last_unstale":"2024-09-10T05:15:27.965628+0000","last_undegraded":"2024-09-10T05:15:27.965628+0000","last_fullsized":"2024-09-10T05:15:27.965628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-10T05:15:27.965487+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-10T05:15:27.965487+0000","last_clean_scrub_stamp":"2024-09-10T05:15:27.965487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:21.675276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:59.675778+0000","last_change":"2024-09-10T05:14:59.675684+0000","last_active":"2024-09-10T05:14:59.675778+0000","last_peered":"2024-09-10T05:14:59.675778+0000","last_clean":"2024-09-10T05:14:59.675778+0000","last_became_active":"2024-09-10T05:11:27.723820+0000","last_became_peered":"2024-09-10T05:11:27.723820+0000","last_unstale":"2024-09-10T05:14:59.675778+0000","last_undegraded":"2024-09-10T05:14:59.675778+0000","last_fullsized":"2024-09-10T05:14:59.675778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:59.675555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:59.675555+0000","last_clean_scrub_stamp":"2024-09-10T05:14:59.675555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:52:06.058468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:09.371745+0000","last_change":"2024-09-10T05:15:09.371665+0000","last_active":"2024-09-10T05:15:09.371745+0000","last_peered":"2024-09-10T05:15:09.371745+0000","last_clean":"2024-09-10T05:15:09.371745+0000","last_became_active":"2024-09-10T05:11:29.723816+0000","last_became_peered":"2024-09-10T05:11:29.723816+0000","last_unstale":"2024-09-10T05:15:09.371745+0000","last_undegraded":"2024-09-10T05:15:09.371745+0000","last_fullsized":"2024-09-10T05:15:09.371745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:09.371549+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:09.371549+0000","last_clean_scrub_stamp":"2024-09-10T05:15:09.371549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:50.441898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.054797+0000","last_change":"2024-09-10T05:15:11.054715+0000","last_active":"2024-09-10T05:15:11.054797+0000","last_peered":"2024-09-10T05:15:11.054797+0000","last_clean":"2024-09-10T05:15:11.054797+0000","last_became_active":"2024-09-10T05:11:27.736370+0000","last_became_peered":"2024-09-10T05:11:27.736370+0000","last_unstale":"2024-09-10T05:15:11.054797+0000","last_undegraded":"2024-09-10T05:15:11.054797+0000","last_fullsized":"2024-09-10T05:15:11.054797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:15:11.054610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:15:11.054610+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.054610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:14.341859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:10.066945+0000","last_change":"2024-09-10T05:15:10.066856+0000","last_active":"2024-09-10T05:15:10.066945+0000","last_peered":"2024-09-10T05:15:10.066945+0000","last_clean":"2024-09-10T05:15:10.066945+0000","last_became_active":"2024-09-10T05:11:27.731202+0000","last_became_peered":"2024-09-10T05:11:27.731202+0000","last_unstale":"2024-09-10T05:15:10.066945+0000","last_undegraded":"2024-09-10T05:15:10.066945+0000","last_fullsized":"2024-09-10T05:15:10.066945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-10T05:15:10.066744+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-10T05:15:10.066744+0000","last_clean_scrub_stamp":"2024-09-10T05:15:10.066744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:52.986117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:11.611546+0000","last_change":"2024-09-10T05:15:11.611484+0000","last_active":"2024-09-10T05:15:11.611546+0000","last_peered":"2024-09-10T05:15:11.611546+0000","last_clean":"2024-09-10T05:15:11.611546+0000","last_became_active":"2024-09-10T05:11:29.723467+0000","last_became_peered":"2024-09-10T05:11:29.723467+0000","last_unstale":"2024-09-10T05:15:11.611546+0000","last_undegraded":"2024-09-10T05:15:11.611546+0000","last_fullsized":"2024-09-10T05:15:11.611546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-10T05:15:11.611402+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-10T05:15:11.611402+0000","last_clean_scrub_stamp":"2024-09-10T05:15:11.611402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:40.804159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:14:58.480356+0000","last_change":"2024-09-10T05:14:58.480235+0000","last_active":"2024-09-10T05:14:58.480356+0000","last_peered":"2024-09-10T05:14:58.480356+0000","last_clean":"2024-09-10T05:14:58.480356+0000","last_became_active":"2024-09-10T05:11:27.713659+0000","last_became_peered":"2024-09-10T05:11:27.713659+0000","last_unstale":"2024-09-10T05:14:58.480356+0000","last_undegraded":"2024-09-10T05:14:58.480356+0000","last_fullsized":"2024-09-10T05:14:58.480356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:14:58.480141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:14:58.480141+0000","last_clean_scrub_stamp":"2024-09-10T05:14:58.480141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:58.809531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'10","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T05:15:19.277058+0000","last_change":"2024-09-10T05:15:19.277001+0000","last_active":"2024-09-10T05:15:19.277058+0000","last_peered":"2024-09-10T05:15:19.277058+0000","last_clean":"2024-09-10T05:15:19.277058+0000","last_became_active":"2024-09-10T05:12:04.964552+0000","last_became_peered":"2024-09-10T05:12:04.964552+0000","last_unstale":"2024-09-10T05:15:19.277058+0000","last_undegraded":"2024-09-10T05:15:19.277058+0000","last_fullsized":"2024-09-10T05:15:19.277058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-10T05:15:19.276901+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-10T05:15:19.276901+0000","last_clean_scrub_stamp":"2024-09-10T05:15:19.276901+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:58.105940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":690,"num_read_kb":658,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1787,"ondisk_log_size":1787,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1672,"num_read_kb":1562,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640322,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40000,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331840,"statfs":{"total":96636764160,"available":96595804160,"internally_reserved":0,"allocated":507904,"data_stored":160879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640323,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":749393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640323,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40540,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331300,"statfs":{"total":96636764160,"available":96595251200,"internally_reserved":0,"allocated":1060864,"data_stored":750309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44128,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327712,"statfs":{"total":96636764160,"available":96591577088,"internally_reserved":0,"allocated":475136,"data_stored":160447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:16:29.341 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T05:16:29.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.461+0000 7fbdacd07640 1 Processor -- start 2024-09-10T05:16:29.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.461+0000 7fbdacd07640 1 -- start start 2024-09-10T05:16:29.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.462+0000 7fbdacd07640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbda809a680 0x7fbda8134770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:16:29.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.462+0000 7fbdacd07640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda809b5c0 con 0x7fbda812f4b0 2024-09-10T05:16:29.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.462+0000 7fbdacd07640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fbda809bd30 con 0x7fbda809a680 2024-09-10T05:16:29.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.462+0000 7fbda5d9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbda809a680 0x7fbda8134770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:16:29.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.462+0000 7fbda659c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fbda812f4b0 0x7fbda812f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38882/0 (socket says 172.21.15.139:38882) 2024-09-10T05:16:29.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.462+0000 7fbda5d9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbda809a680 0x7fbda8134770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40854/0 (socket says 172.21.15.139:40854) 2024-09-10T05:16:29.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.462+0000 7fbda659c640 1 -- 172.21.15.139:0/2650666825 learned_addr learned my addr 172.21.15.139:0/2650666825 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-09-10T05:16:29.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.462+0000 7fbda5d9b640 1 -- 172.21.15.139:0/2650666825 >> v1:172.21.15.139:6789/0 conn(0x7fbda812f4b0 legacy=0x7fbda812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:16:29.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.462+0000 7fbda5d9b640 1 -- 172.21.15.139:0/2650666825 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda812ffa0 con 0x7fbda809a680 2024-09-10T05:16:29.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.463+0000 7fbda5d9b640 1 --2- 172.21.15.139:0/2650666825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda809a680 0x7fbda8134770 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009720 tx=0x7fbd9002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17b8f9b68374ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:16:29.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.463+0000 7fbda559a640 1 -- 172.21.15.139:0/2650666825 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd90037070 con 0x7fbda809a680 2024-09-10T05:16:29.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.463+0000 7fbda559a640 1 -- 172.21.15.139:0/2650666825 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd9002ad90 con 0x7fbda809a680 2024-09-10T05:16:29.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.463+0000 7fbda559a640 1 -- 172.21.15.139:0/2650666825 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd90032590 con 0x7fbda809a680 2024-09-10T05:16:29.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.464+0000 7fbdacd07640 1 -- 172.21.15.139:0/2650666825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda809a680 msgr2=0x7fbda8134770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:16:29.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.464+0000 7fbdacd07640 1 --2- 172.21.15.139:0/2650666825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda809a680 0x7fbda8134770 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009720 tx=0x7fbd9002a110 comp rx=0 tx=0).stop 2024-09-10T05:16:29.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.464+0000 7fbdacd07640 1 -- 172.21.15.139:0/2650666825 shutdown_connections 2024-09-10T05:16:29.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.464+0000 7fbdacd07640 1 --2- 172.21.15.139:0/2650666825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda809a680 0x7fbda8134770 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:16:29.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.464+0000 7fbdacd07640 1 -- 172.21.15.139:0/2650666825 >> 172.21.15.139:0/2650666825 conn(0x7fbda80a0000 msgr2=0x7fbda80a03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:16:29.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.464+0000 7fbdacd07640 1 -- 172.21.15.139:0/2650666825 shutdown_connections 2024-09-10T05:16:29.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.464+0000 7fbdacd07640 1 -- 172.21.15.139:0/2650666825 wait complete. 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.465+0000 7fbdacd07640 1 Processor -- start 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.465+0000 7fbdacd07640 1 -- start start 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.465+0000 7fbdacd07640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda809a680 0x7fbda81c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.465+0000 7fbdacd07640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbda809ae00 con 0x7fbda809a680 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.465+0000 7fbda659c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda809a680 0x7fbda81c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.465+0000 7fbda659c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda809a680 0x7fbda81c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40866/0 (socket says 172.21.15.139:40866) 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.465+0000 7fbda659c640 1 -- 172.21.15.139:0/3870149565 learned_addr learned my addr 172.21.15.139:0/3870149565 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.465+0000 7fbda659c640 1 -- 172.21.15.139:0/3870149565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda809c0f0 con 0x7fbda809a680 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.466+0000 7fbda659c640 1 --2- 172.21.15.139:0/3870149565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda809a680 0x7fbda81c4270 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800c480 tx=0x7fbd9800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.466+0000 7fbd9effd640 1 -- 172.21.15.139:0/3870149565 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd98017070 con 0x7fbda809a680 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.466+0000 7fbd9effd640 1 -- 172.21.15.139:0/3870149565 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd98005c10 con 0x7fbda809a680 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.466+0000 7fbdacd07640 1 -- 172.21.15.139:0/3870149565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda812a4b0 con 0x7fbda809a680 2024-09-10T05:16:29.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.466+0000 7fbd9effd640 1 -- 172.21.15.139:0/3870149565 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd98007070 con 0x7fbda809a680 2024-09-10T05:16:29.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.466+0000 7fbdacd07640 1 -- 172.21.15.139:0/3870149565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda8129170 con 0x7fbda809a680 2024-09-10T05:16:29.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.467+0000 7fbd9effd640 1 -- 172.21.15.139:0/3870149565 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 50419+0+0 (secure 0 0 0) 0x7fbd9801a070 con 0x7fbda809a680 2024-09-10T05:16:29.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.467+0000 7fbd9effd640 1 --2- 172.21.15.139:0/3870149565 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbd8803de70 0x7fbd88040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T05:16:29.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.467+0000 7fbdacd07640 1 -- 172.21.15.139:0/3870149565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda812a0c0 con 0x7fbda809a680 2024-09-10T05:16:29.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.467+0000 7fbd9effd640 1 -- 172.21.15.139:0/3870149565 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fbd98051fe0 con 0x7fbda809a680 2024-09-10T05:16:29.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.467+0000 7fbda5d9b640 1 --2- 172.21.15.139:0/3870149565 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbd8803de70 0x7fbd88040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T05:16:29.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.468+0000 7fbda5d9b640 1 --2- 172.21.15.139:0/3870149565 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbd8803de70 0x7fbd88040330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbd90034000 tx=0x7fbd9002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T05:16:29.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.471+0000 7fbd9effd640 1 -- 172.21.15.139:0/3870149565 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (secure 0 0 0) 0x7fbda809c0f0 con 0x7fbda809a680 2024-09-10T05:16:29.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.647+0000 7fbdacd07640 1 -- 172.21.15.139:0/3870149565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbda8068da0 con 0x7fbda809a680 2024-09-10T05:16:29.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.649+0000 7fbd9effd640 1 -- 172.21.15.139:0/3870149565 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fbd9801ac60 con 0x7fbda809a680 2024-09-10T05:16:29.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.650+0000 7fbd9effd640 1 -- 172.21.15.139:0/3870149565 <== mon.0 v2:172.21.15.139:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbd98019840 con 0x7fbda809a680 2024-09-10T05:16:29.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.652+0000 7fbdacd07640 1 -- 172.21.15.139:0/3870149565 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbd8803de70 msgr2=0x7fbd88040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:16:29.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.652+0000 7fbdacd07640 1 --2- 172.21.15.139:0/3870149565 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbd8803de70 0x7fbd88040330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbd90034000 tx=0x7fbd9002e000 comp rx=0 tx=0).stop 2024-09-10T05:16:29.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.652+0000 7fbdacd07640 1 -- 172.21.15.139:0/3870149565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda809a680 msgr2=0x7fbda81c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T05:16:29.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.652+0000 7fbdacd07640 1 --2- 172.21.15.139:0/3870149565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda809a680 0x7fbda81c4270 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800c480 tx=0x7fbd9800c940 comp rx=0 tx=0).stop 2024-09-10T05:16:29.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.652+0000 7fbdacd07640 1 -- 172.21.15.139:0/3870149565 shutdown_connections 2024-09-10T05:16:29.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.652+0000 7fbdacd07640 1 --2- 172.21.15.139:0/3870149565 >> [v2:172.21.15.192:6824/1421803816,v1:172.21.15.192:6825/1421803816] conn(0x7fbd8803de70 0x7fbd88040330 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:16:29.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.652+0000 7fbdacd07640 1 --2- 172.21.15.139:0/3870149565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbda809a680 0x7fbda81c4270 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T05:16:29.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.652+0000 7fbdacd07640 1 -- 172.21.15.139:0/3870149565 >> 172.21.15.139:0/3870149565 conn(0x7fbda80a0000 msgr2=0x7fbda8133250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T05:16:29.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.652+0000 7fbdacd07640 1 -- 172.21.15.139:0/3870149565 shutdown_connections 2024-09-10T05:16:29.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-10T05:16:29.652+0000 7fbdacd07640 1 -- 172.21.15.139:0/3870149565 wait complete. 2024-09-10T05:16:29.663 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T05:16:29.663 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T05:16:29.663 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T05:16:29.664 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:16:29.702 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T05:16:29.703 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T05:16:29.703 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:16:29.740 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T05:16:29.740 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T05:16:29.740 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:16:29.807 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T05:16:29.807 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T05:16:29.807 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:16:29.876 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T05:16:29.876 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T05:16:29.877 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T05:16:29.877 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:16:29.947 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T05:16:29.947 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T05:16:29.947 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T05:16:29.947 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:16:29.958 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T05:16:29.958 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T05:16:29.958 DEBUG:teuthology.orchestra.run.smithi139:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-10T05:16:30.034 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-10T05:16:30.034 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T05:16:30.184 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-10T05:16:30.184 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T05:16:30.308 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-10T05:16:30.308 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T05:16:30.392 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-10T05:16:30.393 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T05:16:30.461 INFO:tasks.ceph:Archiving mon data... 2024-09-10T05:16:30.462 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898693/data/mon.a.tgz 2024-09-10T05:16:30.463 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-09-10T05:16:30.478 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.ioa8P9hTTL 2024-09-10T05:16:30.478 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ioa8P9hTTL 2024-09-10T05:16:30.633 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.ioa8P9hTTL 2024-09-10T05:16:30.716 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.ioa8P9hTTL is 281KB 2024-09-10T05:16:30.810 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.ioa8P9hTTL 2024-09-10T05:16:30.825 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T05:16:30.825 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T05:16:30.867 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T05:16:30.945 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T05:16:30.965 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T05:16:30.965 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T05:16:30.967 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898693/remote/smithi139/crash 2024-09-10T05:16:30.968 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T05:16:31.009 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898693/remote/smithi192/crash 2024-09-10T05:16:31.010 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T05:16:31.045 INFO:tasks.ceph:Compressing logs... 2024-09-10T05:16:31.045 DEBUG:teuthology.orchestra.run.smithi139:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T05:16:31.054 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T05:16:31.096 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T05:16:31.097 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32465.log 2024-09-10T05:16:31.097 INFO:teuthology.orchestra.run.smithi139.stderr:gzip/var/log/ceph/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32799.log 2024-09-10T05:16:31.097 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31016.log 2024-09-10T05:16:31.097 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32799.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32465.log.gz 2024-09-10T05:16:31.097 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31802.log 2024-09-10T05:16:31.097 INFO:teuthology.orchestra.run.smithi139.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.32799.log.gz 2024-09-10T05:16:31.097 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32507.log 2024-09-10T05:16:31.097 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31016.log: /var/log/ceph/ceph-client.admin.31802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31067.log 2024-09-10T05:16:31.097 INFO:teuthology.orchestra.run.smithi139.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31016.log.gz 2024-09-10T05:16:31.097 INFO:teuthology.orchestra.run.smithi139.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31802.log.gz 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30931.log 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31067.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32507.log.gz 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31460.log 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31067.log.gz 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.30931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30991.log 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30931.log.gz 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29360.log 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.30991.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31460.log.gz 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32675.log 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30991.log.gz 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.29360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31949.log 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.29360.log.gz 2024-09-10T05:16:31.098 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32675.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31949.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32675.log.gz 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31151.log 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31949.log.gz 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31193.log 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32381.log 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr: 88.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31193.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31151.log.gz 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31463.log 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31193.log.gz 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32759.log 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32381.log.gz 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32045.log 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32759.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31463.log.gz 2024-09-10T05:16:31.099 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30878.log 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32759.log.gz 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31631.log 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32045.log.gz 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.30878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32255.log 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30878.log.gz 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32087.log 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31631.log.gz 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32255.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32255.log.gz 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31806.log 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-mon.a.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32087.log.gz 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27525.log 2024-09-10T05:16:31.100 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32633.log 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31806.log.gz 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph.tmp-client.admin.27525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31907.log 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27525.log.gz 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31630.log 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32633.log.gz 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32339.log 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31907.log.gz 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32549.log 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31630.log.gz 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31590.log 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32339.log: /var/log/ceph/ceph-client.admin.32549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31109.log 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32339.log.gz 2024-09-10T05:16:31.101 INFO:teuthology.orchestra.run.smithi139.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32549.log.gz 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31295.log 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31109.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31590.log.gz 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31295.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31109.log.gz 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32297.log 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31295.log.gz 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31461.log 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.32297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31739.log 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32297.log.gz 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31591.log 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31461.log.gz 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32423.log 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31739.log.gz 2024-09-10T05:16:31.102 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29233.log 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31591.log: /var/log/ceph/ceph-client.admin.32423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31759.log 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.31591.log.gz 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32423.log.gz 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.29233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32171.log 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.29233.log.gz 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5/var/log/ceph/ceph-client.admin.31759.log: --verbose -- /var/log/ceph/ceph-client.admin.29403.log 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.31759.log.gz 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32129.log 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31991.log 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.32171.log.gz 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.29403.log: /var/log/ceph/ceph-client.admin.32129.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.29403.log.gz 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31293.log 2024-09-10T05:16:31.103 INFO:teuthology.orchestra.run.smithi139.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32129.log.gz 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31292.log 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31293.log: gzip -5 --verbose -- 86.5% /var/log/ceph/ceph-client.admin.32213.log 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31991.log.gz 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31293.log.gz 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31462.log 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31292.log.gz 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32717.log 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32213.log: /var/log/ceph/ceph-client.admin.31462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31294.log 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32213.log.gz 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31462.log.gz 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.32717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32591.log 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32717.log.gz 2024-09-10T05:16:31.104 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.31294.log: /var/log/ceph/ceph-client.admin.32591.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31294.log.gz 2024-09-10T05:16:31.105 INFO:teuthology.orchestra.run.smithi139.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32591.log.gz 2024-09-10T05:16:31.117 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31300.log 2024-09-10T05:16:31.122 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51137.log 2024-09-10T05:16:31.122 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35669.log 2024-09-10T05:16:31.122 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.31300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40852.log 2024-09-10T05:16:31.122 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31380.log 2024-09-10T05:16:31.122 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86215.log 2024-09-10T05:16:31.122 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.51137.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.31300.log.gz 2024-09-10T05:16:31.122 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.35669.log: /var/log/ceph/ceph-client.0.40852.log: /var/log/ceph/ceph-client.admin.31380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96534.log 2024-09-10T05:16:31.122 INFO:teuthology.orchestra.run.smithi192.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35669.log.gz 2024-09-10T05:16:31.123 INFO:teuthology.orchestra.run.smithi192.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.31380.log.gz 2024-09-10T05:16:31.123 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.86215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66262.log 2024-09-10T05:16:31.123 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.96534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52952.log 2024-09-10T05:16:31.123 INFO:teuthology.orchestra.run.smithi192.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.86215.log.gz 2024-09-10T05:16:31.123 INFO:teuthology.orchestra.run.smithi192.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40852.log.gz 2024-09-10T05:16:31.123 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.66262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69892.log 2024-09-10T05:16:31.123 INFO:teuthology.orchestra.run.smithi192.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.51137.log.gz 2024-09-10T05:16:31.123 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.52952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46902.log 2024-09-10T05:16:31.123 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.69892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58397.log 2024-09-10T05:16:31.123 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.46902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78362.log 2024-09-10T05:16:31.123 INFO:teuthology.orchestra.run.smithi192.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.66262.log.gz 2024-09-10T05:16:31.124 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52952.log.gz 2024-09-10T05:16:31.124 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.58397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74732.log 2024-09-10T05:16:31.124 INFO:teuthology.orchestra.run.smithi192.stderr:gzip/var/log/ceph/ceph-client.0.78362.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35709.log 2024-09-10T05:16:31.175 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.74732.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T05:16:31.176 INFO:teuthology.orchestra.run.smithi192.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.96534.log.gz 2024-09-10T05:16:31.176 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46902.log.gz 2024-09-10T05:16:31.176 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.35709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48717.log 2024-09-10T05:16:31.176 INFO:teuthology.orchestra.run.smithi192.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.35709.log.gz 2024-09-10T05:16:31.176 INFO:teuthology.orchestra.run.smithi192.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.69892.log.gz 2024-09-10T05:16:31.176 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.58397.log.gz 2024-09-10T05:16:31.176 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77152.log 2024-09-10T05:16:31.176 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78362.log.gz 2024-09-10T05:16:31.176 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.48717.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74732.log.gz 2024-09-10T05:16:31.176 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-10T05:16:31.176 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.77152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88617.log 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60212.log 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.48717.log.gz 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.88617.log: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59002.log 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77152.log.gz 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68682.log 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.60212.log: /var/log/ceph/ceph-client.0.59002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89827.log 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.88617.log.gz 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.68682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85017.log 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71707.log 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.89827.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.59002.log.gz 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.85017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77757.log 2024-09-10T05:16:31.177 INFO:teuthology.orchestra.run.smithi192.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.60212.log.gz 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.71707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83807.log 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.85017.log.gz 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.77757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54162.log 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.83807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43272.log 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3%/var/log/ceph/ceph-client.0.54162.log: -- replaced with /var/log/ceph/ceph-client.0.89827.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.91642.log 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.68682.log.gz 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.71707.log.gz 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77757.log.gz 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36623.log 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.43272.log: /var/log/ceph/ceph-client.0.91642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90432.log 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54162.log.gz 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.36623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38438.log 2024-09-10T05:16:31.178 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5/var/log/ceph/ceph-client.0.90432.log: --verbose -- /var/log/ceph/ceph-client.0.52347.log 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1%/var/log/ceph/ceph-client.0.38438.log: -- replaced with /var/log/ceph/ceph-client.0.43272.log.gz 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81387.log 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr: 91.0% 91.7% -- replaced with /var/log/ceph/ceph-client.0.83807.log.gz 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr: -- replaced with /var/log/ceph/ceph-client.0.91642.log.gz 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76547.log 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.52347.log: gzip 92.0% -- replaced with /var/log/ceph/ceph-client.0.36623.log.gz 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.81387.log: -5 --verbose -- /var/log/ceph/ceph-client.0.74127.log 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.76547.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.90432.log.gz 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84412.log 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.38438.log.gz 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.74127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92247.log 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.84412.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42667.log 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr: -- replaced with /var/log/ceph/ceph-client.0.52347.log.gz 2024-09-10T05:16:31.179 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76547.log.gz 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.92247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42062.log 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.42667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80177.log 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.42062.log: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91037.log 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74127.log.gz 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81387.log.gz 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr: -- replaced with /var/log/ceph/ceph-client.0.84412.log.gz 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.80177.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92247.log.gz 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42667.log.gz 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61422.log 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.42062.log.gz 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.91037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53557.log 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.61422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81992.log 2024-09-10T05:16:31.180 INFO:teuthology.orchestra.run.smithi192.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80177.log.gz 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.53557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75942.log 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.81992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55372.log 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.91037.log.gz 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.61422.log.gz 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.75942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59607.log 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.55372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57792.log 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53557.log.gz 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.59607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37228.log 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.57792.log: gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.75942.log.gz 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.68077.log 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.37228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94062.log 91.5% -- replaced with /var/log/ceph/ceph-client.0.55372.log.gz 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-10T05:16:31.181 INFO:teuthology.orchestra.run.smithi192.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.59607.log.gz 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.68077.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.81992.log.gz 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86814.log 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57792.log.gz 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50532.log 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.94062.log: /var/log/ceph/ceph-client.0.86814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63842.log 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.50532.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37228.log.gz 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73522.log 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86814.log.gz 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.68077.log.gz 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.63842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72917.log 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.94062.log.gz 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31260.log 2024-09-10T05:16:31.182 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.73522.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50532.log.gz 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.72917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49322.log 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63842.log.gz 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.31260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44482.log 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.31260.log.gz 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5/var/log/ceph/ceph-client.0.49322.log: --verbose -- /var/log/ceph/ceph-client.0.39648.log 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.44482.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93457.log 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.73522.log.gz 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr: -- replaced with /var/log/ceph/ceph-client.0.72917.log.gz 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.39648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85616.log 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.93457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40247.log 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49322.log.gz 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.39648.log.gz 2024-09-10T05:16:31.183 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.85616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63237.log 2024-09-10T05:16:31.184 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.44482.log.gz 2024-09-10T05:16:31.184 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.40247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95272.log 2024-09-10T05:16:31.184 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.63237.log: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48112.log 2024-09-10T05:16:31.184 INFO:teuthology.orchestra.run.smithi192.stderr: -- replaced with /var/log/ceph/ceph-client.0.85616.log.gz 2024-09-10T05:16:31.184 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93457.log.gz 2024-09-10T05:16:31.184 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.95272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39043.log 2024-09-10T05:16:31.184 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.48112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56582.log 2024-09-10T05:16:31.184 INFO:teuthology.orchestra.run.smithi192.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.40247.log.gz 2024-09-10T05:16:31.184 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.39043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46297.log 2024-09-10T05:16:31.184 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.56582.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.63237.log.gz 2024-09-10T05:16:31.184 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94667.log 2024-09-10T05:16:31.184 INFO:teuthology.orchestra.run.smithi192.stderr: -- replaced with /var/log/ceph/ceph-client.0.95272.log.gz 2024-09-10T05:16:31.185 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.46297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82597.log 2024-09-10T05:16:31.185 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48112.log.gz 2024-09-10T05:16:31.185 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.94667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64447.log 2024-09-10T05:16:31.185 INFO:teuthology.orchestra.run.smithi192.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39043.log.gz 2024-09-10T05:16:31.185 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.82597.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T05:16:31.185 INFO:teuthology.orchestra.run.smithi192.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56582.log.gz 2024-09-10T05:16:31.185 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.64447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62027.log 2024-09-10T05:16:31.185 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.46297.log.gz 2024-09-10T05:16:31.185 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose --/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.0.54767.log 2024-09-10T05:16:31.185 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94667.log.gz 2024-09-10T05:16:31.185 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.62027.log: gzip -5 91.2% -- replaced with /var/log/ceph/ceph-client.0.82597.log.gz 2024-09-10T05:16:31.185 INFO:teuthology.orchestra.run.smithi192.stderr: --verbose -- /var/log/ceph/ceph-client.0.95877.log 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.54767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65657.log 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.95877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75337.log 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.64447.log.gz 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.65657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70497.log 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.75337.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.62027.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.79572.log 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.54767.log.gz 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.95877.log.gz 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.70497.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65657.log.gz 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.75337.log.gz 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35789.log 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.79572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45087.log 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.70497.log.gz 2024-09-10T05:16:31.186 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.35789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92852.log 2024-09-10T05:16:31.187 INFO:teuthology.orchestra.run.smithi192.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.35789.log.gz 2024-09-10T05:16:31.187 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.45087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55977.log 2024-09-10T05:16:31.187 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T05:16:31.187 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.92852.log: /var/log/ceph/ceph-client.0.55977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87413.log 2024-09-10T05:16:31.187 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- 91.2% -- replaced with /var/log/ceph/ceph-client.0.79572.log.gz 2024-09-10T05:16:31.187 INFO:teuthology.orchestra.run.smithi192.stderr: /var/log/ceph/ceph-client.0.43877.log 2024-09-10T05:16:31.187 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45087.log.gz 2024-09-10T05:16:31.187 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- 91.1% /var/log/ceph/ceph-client.0.78967.log 2024-09-10T05:16:31.187 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.87413.log: -- replaced with /var/log/ceph/ceph-client.0.92852.log.gz 2024-09-10T05:16:31.187 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.43877.log: gzip 91.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.35829.log 2024-09-10T05:16:31.187 INFO:teuthology.orchestra.run.smithi192.stderr: -- replaced with /var/log/ceph/ceph-client.0.55977.log.gz 2024-09-10T05:16:31.187 INFO:teuthology.orchestra.run.smithi192.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.87413.log.gz 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.78967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83202.log 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr:gzip/var/log/ceph/ceph-client.admin.35829.log: -5 --verbose -- /var/log/ceph/ceph-client.0.37833.log 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.83202.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.35829.log.gz 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80782.log 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr: -- replaced with /var/log/ceph/ceph-client.0.43877.log.gz 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.37833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71102.log 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78967.log.gz 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72312.log 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.80782.log: /var/log/ceph/ceph-client.0.71102.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83202.log.gz 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.72312.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37833.log.gz 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80782.log.gz 2024-09-10T05:16:31.188 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.71102.log.gz 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88012.log 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69287.log 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.88012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35749.log 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.72312.log.gz 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.69287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45692.log 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.35749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47507.log 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35749.log.gz 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.88012.log.gz/var/log/ceph/ceph-client.0.45692.log: 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57187.log 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.47507.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45692.log.gz 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47507.log.gz 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 93.4% -- replaced with /var/log/ceph/ceph-client.0.69287.log.gz 2024-09-10T05:16:31.189 INFO:teuthology.orchestra.run.smithi192.stderr: --verbose -- /var/log/ceph/ceph-client.0.67472.log 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.57187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49927.log 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.67472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60817.log 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.49927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62632.log 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr: 91.4%/var/log/ceph/ceph-client.0.60817.log: -- replaced with /var/log/ceph/ceph-client.0.57187.log.gz 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.67472.log.gz 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.62632.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41457.log 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr: -- replaced with /var/log/ceph/ceph-client.0.49927.log.gz 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65052.log 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.41457.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60817.log.gz 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.62632.log.gz 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51742.log 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31340.log 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.65052.log: /var/log/ceph/ceph-client.0.51742.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41457.log.gz 2024-09-10T05:16:31.190 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66867.log 2024-09-10T05:16:31.191 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.31340.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.31340.log.gz 2024-09-10T05:16:31.191 INFO:teuthology.orchestra.run.smithi192.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51742.log.gz 2024-09-10T05:16:31.191 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89222.log 2024-09-10T05:16:31.191 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.66867.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.65052.log.gz 2024-09-10T05:16:31.191 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.0.89222.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.66867.log.gz 2024-09-10T05:16:31.191 INFO:teuthology.orchestra.run.smithi192.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89222.log.gz 2024-09-10T05:16:31.198 INFO:teuthology.orchestra.run.smithi192.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-10T05:16:31.213 INFO:teuthology.orchestra.run.smithi192.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T05:16:31.260 INFO:teuthology.orchestra.run.smithi139.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T05:16:32.001 INFO:teuthology.orchestra.run.smithi139.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T05:16:32.003 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-09-10T05:16:32.003 INFO:teuthology.orchestra.run.smithi139.stderr:real 0m0.937s 2024-09-10T05:16:32.003 INFO:teuthology.orchestra.run.smithi139.stderr:user 0m1.086s 2024-09-10T05:16:32.003 INFO:teuthology.orchestra.run.smithi139.stderr:sys 0m0.084s 2024-09-10T05:16:32.011 INFO:teuthology.orchestra.run.smithi192.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T05:16:32.116 INFO:teuthology.orchestra.run.smithi192.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T05:16:32.155 INFO:teuthology.orchestra.run.smithi192.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T05:16:32.158 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-10T05:16:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m1.051s 2024-09-10T05:16:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m3.002s 2024-09-10T05:16:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m0.198s 2024-09-10T05:16:32.158 INFO:tasks.ceph:Archiving logs... 2024-09-10T05:16:32.158 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898693/remote/smithi139/log 2024-09-10T05:16:32.160 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T05:16:32.400 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898693/remote/smithi192/log 2024-09-10T05:16:32.401 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T05:16:32.939 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T05:16:32.948 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T05:16:32.949 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T05:16:32.951 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T05:16:33.018 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T05:16:33.027 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T05:16:33.027 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T05:16:33.029 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T05:16:33.042 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-09-10T05:16:33.044 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-10T05:16:33.047 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T05:16:33.047 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-09-10T05:16:33.047 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 35 +145us[ +145us] +/- 43ms 2024-09-10T05:16:33.047 INFO:teuthology.orchestra.run.smithi139.stdout:^* hv02.front.sepia.ceph.com 3 6 377 37 -243us[ -223us] +/- 61ms 2024-09-10T05:16:33.047 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +172us[ +172us] +/- 63ms 2024-09-10T05:16:33.047 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T05:16:33.049 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T05:16:33.049 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-10T05:16:33.049 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 34 +122us[ +124us] +/- 43ms 2024-09-10T05:16:33.049 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv02.front.sepia.ceph.com 3 6 377 34 -262us[ -260us] +/- 61ms 2024-09-10T05:16:33.049 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +167us[ +169us] +/- 63ms 2024-09-10T05:16:33.049 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T05:16:33.050 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T05:16:33.058 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T05:16:33.058 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T05:16:33.067 DEBUG:teuthology.orchestra.run.smithi139:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T05:16:33.152 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T05:16:33.212 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T05:16:33.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:16:33.240 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T05:16:33.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:16:33.267 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T05:16:33.276 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T05:16:33.285 INFO:teuthology.task.internal:Duration was 716.240259 seconds 2024-09-10T05:16:33.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T05:16:33.293 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T05:16:33.294 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T05:16:33.296 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T05:16:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T05:16:33.346 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T05:16:33.743 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T05:16:33.743 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-09-10T05:16:33.743 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T05:16:33.804 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2024-09-10T05:16:33.804 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T05:16:33.833 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T05:16:33.833 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T05:16:33.846 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T05:16:33.899 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T05:16:33.900 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T05:16:33.913 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T05:16:34.037 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T05:16:34.046 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T05:16:34.046 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T05:16:34.072 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T05:16:34.096 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T05:16:34.106 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T05:16:34.115 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T05:16:34.136 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-09-10T05:16:34.159 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2024-09-10T05:16:34.183 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T05:16:34.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:16:34.221 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T05:16:34.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:16:34.238 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T05:16:34.248 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T05:16:34.249 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898693/remote/smithi139 2024-09-10T05:16:34.249 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T05:16:34.295 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-10_03:21:45-rgw-wip-rgw-meta-handlers-distro-default-smithi/7898693/remote/smithi192 2024-09-10T05:16:34.295 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T05:16:34.327 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T05:16:34.327 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T05:16:34.333 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T05:16:34.378 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T05:16:34.390 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T05:16:34.390 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T05:16:34.401 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T05:16:34.401 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T05:16:34.404 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T05:16:34.416 INFO:teuthology.orchestra.run.smithi139.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 05:16 /home/ubuntu/cephtest 2024-09-10T05:16:34.432 INFO:teuthology.orchestra.run.smithi192.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 05:16 /home/ubuntu/cephtest 2024-09-10T05:16:34.433 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T05:16:34.446 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T05:16:34.467 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} duration: 716.2402586936951 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-10T05:16:34.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T05:16:34.537 INFO:teuthology.run:pass